JPWO2008038333A1 - Data recording apparatus, data recording method, data recording program, and computer-readable recording medium - Google Patents

Abstract

A detection part (101) detects the imaging target vehicle used as the imaging target located in the periphery of a vehicle. The imaging unit (102) images the imaging target vehicle detected by the detection unit (101). The image recognition unit (103) recognizes a specific part in the image data including the imaging target vehicle imaged by the imaging unit (102). The image processing unit (104) performs predetermined image processing on the specific part recognized by the image recognition unit (103), and the recording unit (105) is subjected to image processing by the image processing unit (104). Record image data.

Description

  The present invention relates to a data recording apparatus for recording image data, a data recording method, a data recording program, and a computer-readable recording medium. However, the use of the present invention is not limited to the above-described data recording apparatus, data recording method, data recording program, and computer-readable recording medium.

  Conventionally, an in-vehicle camera installed in a vehicle can photograph a landscape or a person outside the vehicle. In recent years, when shooting a landscape or a person from outside the vehicle using a keyless controller for remote operation with the in-vehicle camera, it is possible to shoot by remote operation and also to the operator and subject person with the in-vehicle camera. There is a proposal for notifying that (see, for example, Patent Document 1 below).

Japanese Patent Laid-Open No. 2005-199948

  However, in the above-described prior art, an operator has to operate at the time of shooting, and when the vehicle is running, it is difficult to accurately capture and shoot a subject. An example of the problem is that an image containing a subject cannot be acquired. In particular, if the driver operates the in-vehicle camera while the vehicle is running, safe driving is hindered.

  On the other hand, even when the vehicle is stopped, when shooting a dynamic subject such as an oncoming vehicle, it is difficult to capture the subject accurately because of blurring, etc. An example of the problem is that it is not possible to acquire.

  Furthermore, even if an image contains a subject desired by the user, if the photographer is taken together with information such as a person image of the subject or information specifying the subject, personal information about the subject is exposed to the risk of leakage. The problem is given as an example.

  In order to solve the above-described problems and achieve the object, a data recording apparatus according to a first aspect of the present invention includes a detection unit that detects an imaging target vehicle that is an imaging target located in the periphery of the vehicle, and is detected by the detection unit. Imaging means for imaging the captured imaging target vehicle, image recognition means for recognizing a specific part in image data including the imaging target vehicle imaged by the imaging means, and a specific part recognized by the image recognition means Image processing means for performing image processing, and recording means for recording image data subjected to image processing by the image processing means.

  The data recording method according to the invention of claim 8 includes a detection step of detecting an imaging target vehicle that is an imaging target located around the vehicle, and an imaging step of imaging the imaging target vehicle detected by the detection step. An image recognition process for recognizing a specific part in image data including the imaging target vehicle imaged by the imaging process, an image processing process for performing predetermined image processing on the specific part recognized by the image recognition process, and the image And a recording step of recording image data that has been subjected to image processing by the processing step.

  A data recording program according to a ninth aspect of the invention causes a computer to execute the data recording method according to the eighth aspect.

  A computer-readable recording medium according to a tenth aspect of the invention records the data recording program according to the ninth aspect.

FIG. 1 is a block diagram illustrating an example of a functional configuration of the data recording apparatus according to the present embodiment. FIG. 2 is a flowchart showing the contents of processing of the data recording apparatus according to the present embodiment. FIG. 3 is a block diagram illustrating an example of a hardware configuration of the in-vehicle device according to the present embodiment. FIG. 4 is an explanatory diagram of image data that has been image-recognized according to the present embodiment. FIG. 5 is an explanatory diagram of image data that has been subjected to image processing according to the present embodiment. FIG. 6 is a flowchart showing the contents of the processing of the in-vehicle device according to the present embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Data recording device 101 Detection part 102 Imaging part 103 Image recognition part 104 Image processing part 105 Recording part

  Exemplary embodiments of a data recording apparatus, a data recording method, a data recording program, and a computer-readable recording medium according to the present invention will be explained below in detail with reference to the accompanying drawings.

(Embodiment)
(Functional configuration of data recording device)
A functional configuration of the data recording apparatus according to the present embodiment will be described with reference to FIG. FIG. 1 is a block diagram illustrating an example of a functional configuration of the data recording apparatus according to the present embodiment.

  In FIG. 1, the data recording apparatus 100 includes a detection unit 101, an imaging unit 102, an image recognition unit 103, an image processing unit 104, and a recording unit 105.

  The detection unit 101 detects an imaging target vehicle that is an imaging target located around the vehicle. The imaging target vehicle is detected by, for example, a sensor such as an infrared sensor or an ultrasonic sensor (not shown), vehicle-to-vehicle communication, or the like.

  Specifically, for example, the detection unit 101 may detect a positional relationship between the vehicle and the imaging target vehicle, or may detect a relative speed of the imaging target vehicle with respect to the vehicle.

  The imaging unit 102 images the imaging target vehicle detected by the detection unit 101. The imaging target vehicle may be imaged by, for example, a vehicle-mounted camera (not shown), and may be a movable vehicle-mounted camera that can capture an image in any direction.

  Specifically, for example, the imaging unit 102 may capture an imaging target vehicle when the positional relationship detected by the detection unit 101 reaches a predetermined distance. Moreover, the structure which has a drive part which drives so that an imaging object vehicle may be imaged according to the relative speed detected by the detection part 101 may be sufficient. In other words, the imaging unit 102 may perform panning by driving the drive unit according to the relative speed of the imaging target vehicle.

  More specifically, for example, the imaging unit 102 causes the driving unit to follow in accordance with the relative speed of the imaging target vehicle, and the rotation angle of the driving unit becomes a predetermined angle (for example, 45 degrees) from the front of the vehicle. It is good also as imaging.

  Further, the imaging unit 102 causes the drive unit to follow in accordance with the relative speed of the imaging target vehicle, captures images at a predetermined interval (for example, 30 times per second), and calculates the imaging target vehicle calculated by the image recognition unit 103 described later. When the ratio of the length of the bumper to the side of the vehicle is a predetermined value (for example, 1: 2), the imaging target vehicle may be imaged. That is, the imaging target vehicle in the image data is displayed at an appropriate angle by imaging the imaging target vehicle so that the ratio between the length of the bumper of the imaging target vehicle and the side surface of the vehicle becomes a predetermined value. .

  The image recognition unit 103 recognizes a specific part in the image data including the imaging target vehicle imaged by the imaging unit 102. Specifically, for example, the image recognition unit 103 may recognize a passenger of the imaging target vehicle in the image data, or recognize a license plate of the imaging target vehicle in the image data.

  Moreover, the image recognition part 103 is good also as, for example, recognizing other vehicles different from the imaging target vehicle in image data. Further, the image recognition unit 103 may be configured to recognize the vehicle type of the imaging target vehicle in the image data, for example.

  Further, the image recognition unit 103 recognizes the length of the bumper and the vehicle side surface of the image pickup target vehicle from the image data including the image pickup target vehicle imaged by the image pickup unit 102, thereby the ratio of the length of the bumper to the vehicle side surface. May be configured to calculate.

  The image processing unit 104 performs predetermined image processing on the specific part recognized by the image recognition unit 103. Specifically, for example, the image processing unit 104 performs image processing such that the passenger recognized by the image recognition unit 103 cannot be identified, or the image plate recognized by the image recognition unit 103 cannot be identified. Processing may be performed.

  In addition, the image processing unit 104 may perform image processing so as to erase other vehicles from the image data, for example, by superimposing a background image as a background on the other vehicles recognized by the image recognition unit 103. Further, the image processing unit 104 may perform image processing when the vehicle type recognized by the image recognition unit 103 is a predetermined vehicle type.

  For example, the predetermined vehicle type may be registered in advance by the user, and may be a vehicle type that the user desires to record as image data.

  The recording unit 105 records the image data that has been subjected to image processing by the image processing unit 104. For example, the image data may be recorded on a recording medium (not shown) or output to an external server (not shown) by communication.

  In the description of FIG. 1, the vehicle type is recognized by the image recognition unit 103. However, when an imaging target vehicle is detected by inter-vehicle communication, information on the vehicle type may be received by inter-vehicle communication.

  In the description of FIG. 1, the image recognition unit 103 is configured to recognize the vehicle type with respect to image data including the imaging target vehicle imaged by the imaging unit 102, but the image subjected to image processing by the image processing unit 104. It is good also as recognizing a vehicle model regarding data. In that case, the recording unit 105 may record the image data when the vehicle type recognized by the image recognition unit 103 is a predetermined vehicle type.

(Contents of data recording device processing)
Next, the contents of processing of the data recording apparatus 100 according to the present embodiment will be described with reference to FIG. FIG. 2 is a flowchart showing the contents of processing of the data recording apparatus according to the present embodiment. In the flowchart of FIG. 2, first, the detection unit 101 determines whether an imaging target vehicle has been detected (step S201).

  In step S201, waiting for detection of the imaging target vehicle and detecting it (step S201: Yes), the imaging unit 102 images the imaging target vehicle detected in step S201 (step S202).

  Next, the image recognition unit 103 recognizes a specific part in the image data including the imaging target vehicle imaged in step S202 (step S203).

  Then, the image processing unit 104 performs predetermined image processing on the specific part recognized in step S203 (step S204).

  Thereafter, the recording unit 105 records the image data on which image processing has been performed in step S204 (step S205), and the series of processing ends.

  The data recording apparatus, the data recording method, the data recording program, and the computer-readable recording medium of the present invention are realized by the data recording apparatus 100 shown in FIG. The apparatus is not limited to 100, and a plurality of apparatuses may be used as long as the function unit illustrated in FIG. When each functional unit is connected as a different device, the connection between the devices may be established by performing communication using Bluetooth (registered trademark) or the like, regardless of wired or wireless.

  As described above, according to the data recording device, the data recording method, the data recording program, and the computer-readable recording medium according to the present embodiment, the user can perform imaging without operating the data recording device. Image data of the target vehicle can be automatically collected. In particular, since the driver can check the imaging target vehicle by using the image data after driving, it is not necessary to pay attention to the imaging target vehicle during driving, and safe driving can be achieved.

  In addition, according to the present embodiment, it is possible to drive the drive unit in accordance with the relative speed of the imaging target vehicle to image the imaging target vehicle, and thus it is possible to accurately capture the imaging target vehicle.

  Further, since the image data of the imaging target vehicle for the predetermined vehicle type is recorded, it is possible to optimize the collection of the image data without recording unnecessary image data. In addition, for vehicles other than the imaging target vehicle, since the background image can be overlaid and erased from the image data, the image data can be optimized without an unintended vehicle entering the image data.

  In addition, since the imaging target vehicle is configured to perform image processing that makes it impossible to discriminate passengers, license plates, and the like, personal information regarding the passenger and owner of the imaging target vehicle can be appropriately protected. it can.

  Examples of the present invention will be described below. In the present embodiment, an example in which the data recording device of the present invention is implemented by an in-vehicle device mounted on a moving body such as a vehicle (including a four-wheeled vehicle and a two-wheeled vehicle) will be described.

(Hardware configuration of in-vehicle device)
The hardware configuration of the in-vehicle device according to the present embodiment will be described with reference to FIG. FIG. 3 is a block diagram illustrating an example of a hardware configuration of the in-vehicle device according to the present embodiment.

  In FIG. 3, an in-vehicle device 300 is mounted on a moving body such as a vehicle, and includes a CPU 301, a ROM 302, a RAM 303, a magnetic disk drive 304, a magnetic disk 305, an optical disk drive 306, an optical disk 307, and an audio. I / F (interface) 308, speaker 309, input device 310, video I / F 311, display 312, camera 313, communication I / F 314, GPS unit 315, and various sensors 316 are provided. ing. Each component 301 to 316 is connected by a bus 320.

  First, the CPU 301 governs overall control of the in-vehicle device 300. The ROM 302 stores various programs such as a boot program, an image capturing program, an image recognition program, an image processing program, and a data recording program. The RAM 303 is used as a work area for the CPU 301.

  For example, when a vehicle approaching a predetermined range from the own vehicle is detected by various sensors 316 described later, the image capturing program causes the camera 313 described later to capture the approached vehicle as an imaging target vehicle.

  Specifically, for example, the imaging target vehicle is an oncoming vehicle approaching the host vehicle, calculates a relative speed using output values from various sensors 316, and drives a driving unit (not shown) in the camera 313. It may be a panning shot. In this way, by driving the drive unit and capturing an image, it is possible to accurately capture the oncoming vehicle without blurring.

  For example, the image recognition program causes image recognition using image data captured by a camera 313 described later. Specifically, for example, in the image recognition, it is recognized whether the vehicle included in the image data is a vehicle of a predetermined vehicle type. The predetermined vehicle type may be, for example, a configuration that can be registered in advance by the user, or a vehicle type that the user desires to collect as image data.

  Further, the image recognition may be, for example, to recognize a vehicle occupant or license plate included in the image data, or a vehicle other than the oncoming vehicle to be imaged.

  Although detailed description is omitted because it is a well-known technique, image recognition is performed by, for example, removing distortion and noise from digitized image data and performing correction processing such as enlargement, reduction, and rotation, and then performing feature extraction. Thus, a feature parameter or a feature vector is obtained. Then, from the obtained feature quantities such as feature parameters or feature vectors, a feature quantity that matches or close to the standard pattern is determined by identification, and is associated with a predetermined category. More specifically, for example, the image recognition may be performed by detecting whether there is an input image data that is the same as or close to the standard pattern in advance by pattern matching using a feature amount. .

  For example, the image processing program causes the image data recognized by the image recognition to be subjected to predetermined image processing. Although details will be described with reference to FIGS. 4 and 5, the predetermined image processing may be performed such that, for example, a vehicle occupant or a license plate included in the image data cannot be discriminated, or an oncoming vehicle that has been imaged. It is good also as superimposing a background image on vehicles other than.

  For example, the data recording program controls a magnetic disk drive 304 and an optical disk drive 306 described later to record data on a recording medium such as the magnetic disk 305 and the optical disk 307. Specifically, for example, the data to be recorded is image data subjected to image processing by an image processing program. In this way, by recording image data that has been subjected to image processing, the user can obtain desired vehicle type and image data in which personal information is appropriately protected. In other words, after image data before image processing is recorded, image processing is performed, image data that is not protected by personal information is temporarily recorded, and personal information cannot be properly protected. Can be prevented.

  The magnetic disk drive 304 controls the reading / writing of the data with respect to the magnetic disk 305 according to control of CPU301. The magnetic disk 305 records data written under the control of the magnetic disk drive 304. As the magnetic disk 305, for example, an HD (hard disk) or an FD (flexible disk) can be used.

  Examples of information recorded on the magnetic disk 305 include standard patterns used for image recognition and image processing, predetermined vehicle types, and image data subjected to image processing. In the present embodiment, the standard pattern, the predetermined vehicle type, and the image data are recorded on the magnetic disk 305, but may be recorded on the optical disk 307 to be described later.

  In addition, the standard pattern, the predetermined vehicle type, and the image data are not limited to those provided integrally with the hardware of the in-vehicle device 300, and may be provided outside the in-vehicle device 300. In that case, for example, the in-vehicle device 300 acquires a standard pattern or a predetermined vehicle type or outputs image data via the network through the communication I / F 314. The acquired standard pattern and the predetermined vehicle type are stored in the RAM 303 or the like.

  The optical disk drive 306 controls the reading / writing of the data with respect to the optical disk 307 according to control of CPU301. The optical disk 307 is a detachable recording medium from which data is read according to the control of the optical disk drive 306. As the optical disc 307, a writable recording medium can be used. In addition to the optical disk 307, the removable recording medium may be an MO, a memory card, or the like.

  The audio I / F 308 is connected to an audio output speaker 309, and audio is output from the speaker 309.

  Examples of the input device 310 include a remote controller having a plurality of keys for inputting characters, numerical values, and various instructions, a keyboard, a mouse, and a touch panel.

  The video I / F 311 is connected to the display 312 and the camera 313. Specifically, the video I / F 311 includes, for example, a graphic controller that controls the entire display 312, a buffer memory such as a VRAM (Video RAM) that temporarily records image information that can be displayed immediately, and a graphic controller. Based on the output image data, the display 312 is configured by a control IC or the like.

  The display 312 displays icons, cursors, menus, windows, or various data such as characters and images. As this display 312, for example, a CRT, a TFT liquid crystal display, a plasma display, or the like can be adopted. A plurality of displays 312 may be provided in the vehicle, for example, for the driver and for a passenger seated in the rear seat.

  The camera 313 is installed on the dashboard or ceiling of the vehicle and captures images outside the vehicle. The image may be either a still image or a moving image. For example, the oncoming vehicle is imaged by the camera 313, and the captured image data is processed by an image recognition program, an image processing program, or the like, and then recorded on a recording medium such as the magnetic disk 305 or the optical disk 307. It is good also as outputting. In addition, the camera 313 may be a movable type that can image the imaging direction determined by driving of the driving unit.

  The communication I / F 314 is connected to a network via wireless and functions as an interface between the in-vehicle device 300 and the CPU 301. The communication I / F 314 is further connected to a communication network such as the Internet via wireless, and also functions as an interface between the communication network and the CPU 301.

  Communication networks include LANs, WANs, public line networks and mobile phone networks. Specifically, the communication I / F 314 includes, for example, an FM tuner, a VICS (Vehicle Information and Communication System) / beacon receiver, a radio navigation device, and other navigation devices. Obtain road traffic information such as regulations. VICS is a registered trademark.

  The GPS unit 315 receives radio waves from GPS satellites and outputs information indicating the current location of the vehicle. The output information of the GPS unit 315 is used when the current position of the vehicle is calculated by the CPU 301 together with output values of various sensors 316 described later. The information indicating the current location is information for specifying one point on the map information, such as latitude / longitude and altitude, for example, and the location of the image data may be confirmed by associating it with the image data to be recorded.

  The various sensors 316 include a vehicle speed sensor, an acceleration sensor, an angular velocity sensor, and the like, and the output values of the various sensors 316 are used by the CPU 301 to calculate the current position of the vehicle and to measure the amount of change in speed and direction.

  The various sensors 316 may be an infrared sensor, an ultrasonic sensor, or the like, and may be configured to detect a vehicle located around the own vehicle. In the description of FIG. 3, various sensors 316 are used to detect a vehicle located in the vicinity of the own vehicle. However, communication I / F 314 is used to detect a surrounding vehicle using inter-vehicle communication. Also good.

  The data recording device 100 shown in FIG. 1 includes a detection unit 101, an imaging unit 102, an image recognition unit 103, an image processing unit 104, and a recording unit 105 that are the ROM 302, RAM 303, and magnetic disk 305 in the in-vehicle device 300 shown in FIG. The CPU 301 executes a predetermined program using a program or data recorded on the optical disc 307 or the like, and controls each unit in the in-vehicle device 300 to realize the function.

  That is, the in-vehicle device 300 of the present embodiment executes the various programs recorded in the ROM 302 as a recording medium in the in-vehicle device 300, so that the functions provided in the data recording device 100 shown in FIG. It can be executed according to the procedure shown.

(Outline of image recognition and image processing)
Here, an outline of image recognition and image processing according to the present embodiment will be described with reference to FIGS. 4 and 5. FIG. 4 is an explanatory diagram of image data that has been image-recognized according to the present embodiment.

  In FIG. 4, the image data 400 includes an oncoming vehicle 401 imaged by the camera 313, a driver 402 driving the oncoming vehicle 401, and a license plate 403 installed on the oncoming vehicle 401.

  The oncoming vehicle 401 is detected by various sensors 316 and is imaged under the control of the CPU 301. Specifically, for example, a relative speed is calculated by using an output value from various sensors 316 by an image capturing program, and an image is captured by a panning shot in which a driving unit (not shown) in the camera 313 is driven. The oncoming vehicle 401 is recognized by the image recognition program as to whether or not it is a predetermined vehicle type registered by the user, and is assumed to be a predetermined vehicle type in the description of the present embodiment.

  The driver 402 is imaged when the oncoming vehicle 401 is imaged, and is recognized by the image recognition program. Similarly, the license plate 403 is imaged when the oncoming vehicle 401 is imaged, and is recognized by the image recognition program. Although not described in FIG. 4, the image data 400 may include other vehicles in addition to the oncoming vehicle 401, and the other vehicles are recognized by the image recognition program.

  Next, image processing according to the present embodiment will be described with reference to FIG. FIG. 5 is an explanatory diagram of image data that has been subjected to image processing according to the present embodiment.

  In FIG. 5, the image data 500 includes an oncoming vehicle 501, a light reflection image 502, and a license plate mark 503.

  The oncoming vehicle 501 is subjected to predetermined image processing, and the driver 402 and the license plate 403 shown in FIG. 4 cannot be discriminated. Specifically, for example, in the predetermined image processing, a light reflection image 502 representing a state in which light is reflected on the windshield is superimposed on the driver 402 recognized by the image recognition program by the image processing program. The driver's face disappears with a natural look.

  In the predetermined image processing, for example, the license plate 403 recognized by the image recognition program is filled with a number to form a license plate trace 503.

  Thus, the oncoming vehicle 501 that has undergone image processing appropriately protects personal information that identifies the user and the like, and by storing the image data 500 that has undergone image processing, The user can appropriately collect the image data 500 including the desired vehicle.

  Although the description is omitted in the description of FIG. 5, when another vehicle different from the oncoming vehicle 401 is recognized by the image recognition program, a background image such as a guardrail or a road is superimposed on the other vehicle, and the oncoming vehicle is overlapped. Image data 500 including only 501 may be used.

(Contents of processing of in-vehicle device 300)
Next, the contents of the process of the in-vehicle device 300 according to the present embodiment will be described with reference to FIG. FIG. 6 is a flowchart showing the contents of the processing of the in-vehicle device according to the present embodiment. In the flowchart of FIG. 6, first, it is determined by the various sensors 316 whether an oncoming vehicle has approached (step S601). The approach of the oncoming vehicle may be configured to detect that the oncoming vehicle is located within a predetermined distance from the own vehicle, for example.

  More specifically, for example, an oncoming lane may be recognized by recognizing a center line on a road, and a vehicle having a vector in the opposite direction to the own vehicle in the oncoming lane may be used as the oncoming vehicle.

  In step S601, waiting for the oncoming vehicle to approach and approaching (step S601: Yes), the CPU 301 uses the output values of the various sensors 316 to determine the relative speed of the oncoming vehicle approaching in step S601. Calculate (step S602).

  Next, the oncoming vehicle is shot by controlling the driving unit of the camera 313 so that the oncoming vehicle can be imaged by the CPU 301 in accordance with the relative speed calculated in step S602 (step S603).

  Then, the CPU 301 detects the number plate of the oncoming vehicle by recognizing the image data captured in step S603 (step S604), and deletes the number plate detected from the image data by performing image processing (step S605). ). For example, the number plate may be deleted so that the number cannot be distinguished.

  Next, the CPU 301 detects an oncoming vehicle occupant by recognizing the image data captured in step S603 (step S606), and performs image processing to display a light reflection image on the occupant detected from the image data. Overwriting is performed (step S607).

  Then, the CPU 301 recognizes the image data picked up in step S603 to determine whether a vehicle other than the oncoming vehicle is included in the image data (step S608).

  In step S608, if another vehicle is present (step S608: Yes), the CPU 301 performs image processing to overwrite the background image on the other vehicle determined in step S608 (step S609).

  In step S608, if there is no other vehicle (step S608: No), the process proceeds to step S610.

  Then, the CPU 301 determines whether or not the oncoming vehicle is a predetermined vehicle type by recognizing the image data captured in step S603 (step S610). There may be a plurality of predetermined vehicle types, or information defining a category such as a sports car.

  Specifically, for example, the vehicle type may be determined by matching with an image of a predetermined vehicle type such as a user's preference registered in advance. Further, the vehicle type may be determined from the tire diameter and interval. Specifically, for example, when the tire diameter is large and the interval is large, a truck, and when the tire diameter is large but the interval is narrow, a sports car is used. When the tire diameter is small and the interval is narrow, it may be determined as a light vehicle. Alternatively, the configuration may be such that the vehicle type is determined from the shape or color of a one-box car, sedan, jeep, or the like from the outer shape of the oncoming vehicle, or characters attached to the vehicle body are recognized.

  In step S610, when it is a predetermined vehicle type (step S610: Yes), the CPU 301 records the image data processed in step S605, step S607, or step S609 (step S611), and ends the series of processes. To do.

  In step S610, when it is not a predetermined vehicle type (step S610: No), a series of processing is ended as it is. Although the description is omitted in the flowchart of FIG. 6, when the vehicle is not a predetermined vehicle type (step S610: No), the image data may be deleted.

  Note that the order of image recognition and image processing in steps S604 to S610 described in the flowchart of FIG. 6 is not limited to this. Specifically, for example, image recognition and image processing related to a passenger may be performed before image recognition and image processing related to a license plate. Alternatively, a configuration may be used in which it is first determined whether or not the vehicle is a predetermined vehicle type.

  As described above, according to the present embodiment, since an oncoming vehicle approaching the host vehicle can be imaged, the user can collect image data without operating the camera. Can achieve safe driving without gazing at the oncoming vehicle to be imaged during driving.

  Further, since the panning can be performed by driving the camera drive unit according to the relative speed of the oncoming vehicle approaching the host vehicle, the oncoming vehicle can be imaged without blurring. In addition, since the license plate and the passenger can be recognized and image processing that cannot be determined can be performed, appropriate personal information can be protected.

  In addition, the panning may be performed by changing the shutter speed of the camera in accordance with the relative speed of the oncoming vehicle approaching the host vehicle. Specifically, for example, the shutter speed may be changed by increasing the shutter speed when the relative speed of the oncoming vehicle is high and decreasing the shutter speed when the relative speed of the oncoming vehicle is low. In this way, it is possible to acquire realistic image data by blurring only the background without the oncoming vehicle blurring.

  Further, since image data of a predetermined vehicle type can be recorded, it is possible to optimize image data collection without storing other than the vehicle type desired by the user.

  In the above description, the image data of the oncoming vehicle is mounted on the vehicle. However, the image data of the imaging target vehicle may be captured without being mounted on the vehicle. Specifically, for example, image data of the imaging target vehicle may be captured and collected by a fixed point camera or the like. If it is a fixed-point camera, it is not necessary to take measures against vibrations when mounted on the vehicle, so that an inexpensive system can be provided.

  In addition, although the description is omitted in this embodiment, the captured image of the oncoming vehicle may be displayed as an album. Specifically, for example, in an album, only oncoming vehicles may be selectively extracted from the captured images and collected. By collecting as an album in this way, you can be sure that you will be able to check if there are different cars later, use them for car type quizzes, refer to them when you buy new cars, and even rare car models.

  In addition, when a part of the oncoming vehicle cannot be imaged due to a shield or the like, the interpolation process may be performed by using the fact that the vehicle is generally symmetrical. Furthermore, it is good also as taking the image of the front, side, and back of an oncoming vehicle together using the back camera which images the back of a vehicle. In this way, it is possible to accurately understand the structure of the vehicle and to create a 3D model of the entire vehicle.

  Moreover, you may provide the structure which records the information of an oncoming vehicle. Specifically, for example, as the oncoming vehicle information, an image of the leading vehicle in the traffic jam may be recorded, and an image of the leading vehicle or information such as an accident may be transmitted to the vehicle in the traffic jam. Alternatively, in a case where there is a traffic jam, a configuration may be used in which information indicating that the traffic jam has occurred is transmitted when the vehicle passes by an oncoming vehicle that is traveling alone. In this way, the vehicle user who has received the information can determine whether the cause of the traffic jam is an accident or waiting for a signal.

  The information on the oncoming vehicle may include information such as the number of oncoming vehicles and the result of vehicle type determination such as trucks. It can be judged whether there are many. Further, if the oncoming vehicle is not imaged during congestion, it is possible to prevent many oncoming vehicles from being detected and taking too many pictures.

  In the present invention, the object to be imaged is a vehicle, but is not limited to a vehicle. For example, an image of an airplane, a train, or the like as another moving body, or a building other than the moving body may be imaged. In this way, it is possible to collect image data of a subject desired by a wide range of users.

  The data recording method described in this embodiment can be realized by executing a program prepared in advance on a computer such as a personal computer or a workstation. This program is recorded on a computer-readable recording medium such as a hard disk, a flexible disk, a CD-ROM, an MO, and a DVD, and is executed by being read from the recording medium by the computer. The program may be a transmission medium that can be distributed via a network such as the Internet.

[0002]
An example is the problem of information being exposed to the risk of leakage.
Means for Solving the Problems [0007]
In order to solve the above-described problems and achieve the object, a data recording apparatus according to a first aspect of the present invention includes a detection unit that detects an imaging target vehicle that is an imaging target located in the periphery of the vehicle, and is detected by the detection unit. Imaging means for imaging the captured imaging target vehicle, image recognition means for recognizing a specific part in image data including the imaging target vehicle imaged by the imaging means, and a specific part recognized by the image recognition means Image processing means for performing image processing, and recording means for recording image data subjected to image processing by the image processing means, wherein the image recognition means identifies a passenger of the imaging target vehicle in the image data. And the image processing means is recognized by the image recognition means using an image related to a part normally used for a window portion of the imaging target vehicle. And characterized by applying discrimination impossible image processing occupant. According to a second aspect of the present invention, there is provided a data recording apparatus comprising: a detection unit that detects an imaging target vehicle that is an imaging target located around the vehicle; and an imaging unit that images the imaging target vehicle detected by the detection unit. Image recognition means for recognizing a specific part in image data including the imaging target vehicle imaged by the imaging means, image processing means for performing predetermined image processing on the specific part recognized by the image recognition means, and the image Recording means for recording image data subjected to image processing by the processing means, and the image recognition means recognizes the vehicle type of the imaging target vehicle in the image data based on the diameter of the tire and its interval. The image processing means performs image processing when the vehicle type recognized by the image recognition means is a predetermined vehicle type.
[0008]
According to a sixth aspect of the present invention, there is provided a data recording method comprising: a detection step of detecting an imaging target vehicle that is an imaging target located around the vehicle; and an imaging step of imaging the imaging target vehicle detected by the detection step; An image recognition process for recognizing a specific part in image data including the imaging target vehicle imaged by the imaging process, an image processing process for performing predetermined image processing on the specific part recognized by the image recognition process, and the image A recording step of recording the image data subjected to the image processing by the processing step, wherein the image recognition step recognizes a passenger of the imaging target vehicle in the image data, and the image processing step includes the imaging Using an image related to a part normally used in the window of the target vehicle, image processing is performed so that the passenger recognized in the image recognition process cannot be determined. And wherein the door.
[0009]
According to a seventh aspect of the present invention, a data recording program causes a computer to execute the data recording method according to the sixth aspect.
[0010]
A recording medium according to an eighth aspect of the invention is characterized in that the data recording program according to the seventh aspect can be read by a computer.
BRIEF DESCRIPTION OF THE DRAWINGS [0011]
FIG. 1 is a block diagram showing an example of a functional configuration of a data recording apparatus according to the present embodiment.
FIG. 2 is a flowchart showing the contents of processing of the data recording apparatus according to the present embodiment.
FIG. 3 is a block diagram illustrating an example of a hardware configuration of the in-vehicle device according to the present embodiment.
[FIG. 4] FIG. 4 is an explanatory diagram of image data that has been image-recognized according to the present embodiment.

  The present invention relates to a data recording apparatus for recording image data, a data recording method, a data recording program, and a computer-readable recording medium. However, the use of the present invention is not limited to the above-described data recording apparatus, data recording method, data recording program, and computer-readable recording medium.

  Conventionally, an in-vehicle camera installed in a vehicle can photograph a landscape or a person outside the vehicle. In recent years, when shooting a landscape or a person from outside the vehicle using a keyless controller for remote operation with the in-vehicle camera, it is possible to shoot by remote operation and also to the operator and subject person with the in-vehicle camera. There is a proposal for notifying that (see, for example, Patent Document 1 below).

Japanese Patent Laid-Open No. 2005-199948

  However, in the above-described prior art, an operator has to operate at the time of shooting, and when the vehicle is running, it is difficult to accurately capture and shoot a subject. An example of the problem is that an image containing a subject cannot be acquired. In particular, if the driver operates the in-vehicle camera while the vehicle is running, safe driving is hindered.

  On the other hand, even when the vehicle is stopped, when shooting a dynamic subject such as an oncoming vehicle, it is difficult to capture the subject accurately because of blurring, etc. An example of the problem is that it is not possible to acquire.

  Furthermore, even if an image contains a subject desired by the user, if the photographer is taken together with information such as a person image of the subject or information specifying the subject, personal information about the subject is exposed to the risk of leakage. The problem is given as an example.

  In order to solve the above-described problems and achieve the object, a data recording apparatus according to a first aspect of the present invention includes a detection unit that detects an imaging target vehicle that is an imaging target located in the periphery of the vehicle, and is detected by the detection unit. Imaging means for imaging the captured imaging target vehicle, image recognition means for recognizing a specific part in image data including the imaging target vehicle imaged by the imaging means, and a specific part recognized by the image recognition means Image processing means for performing image processing, and recording means for recording image data subjected to image processing by the image processing means, wherein the image recognition means identifies a passenger of the imaging target vehicle in the image data. And the image processing means is recognized by the image recognition means using an image relating to the equipment used for the window of the imaging target vehicle. And characterized by applying discrimination impossible image processing multiplication and person. According to a second aspect of the present invention, there is provided a data recording apparatus comprising: a detection unit that detects an imaging target vehicle that is an imaging target located around the vehicle; and an imaging unit that images the imaging target vehicle detected by the detection unit. Image recognition means for recognizing a specific part in image data including the imaging target vehicle imaged by the imaging means, image processing means for performing predetermined image processing on the specific part recognized by the image recognition means, and the image Recording means for recording image data subjected to image processing by the processing means, and the image recognition means recognizes the vehicle type of the imaging target vehicle in the image data based on the diameter of the tire and its interval. The image processing means performs image processing when the vehicle type recognized by the image recognition means is a predetermined vehicle type.

  According to a sixth aspect of the present invention, there is provided a data recording method comprising: a detection step of detecting an imaging target vehicle that is an imaging target located around the vehicle; and an imaging step of imaging the imaging target vehicle detected by the detection step; An image recognition process for recognizing a specific part in image data including the imaging target vehicle imaged by the imaging process, an image processing process for performing predetermined image processing on the specific part recognized by the image recognition process, and the image A recording step of recording image data subjected to image processing by the processing step, wherein the image recognition step recognizes a passenger of the imaging target vehicle in the image data, and the image processing step includes the imaging Using the image relating to the equipment used in the window of the target vehicle, image processing is performed so that the passenger recognized by the image recognition process cannot be identified. The features.

  According to a seventh aspect of the present invention, there is provided a data recording method comprising: a detection step of detecting an imaging target vehicle that is an imaging target located around the vehicle; and an imaging step of imaging the imaging target vehicle detected by the detection step; An image recognition process for recognizing a specific part in image data including the imaging target vehicle imaged by the imaging process, an image processing process for performing predetermined image processing on the specific part recognized by the image recognition process, and the image A recording step of recording the image data subjected to the image processing by the processing step, wherein the image recognition step recognizes a vehicle type of the imaging target vehicle in the image data based on a diameter of the tire and an interval thereof. The image processing step performs image processing when the vehicle type recognized by the image recognition step is a predetermined vehicle type.

  A data recording program according to the invention of claim 8 causes a computer to execute the data recording method of claim 6 or 7.

  A recording medium according to a ninth aspect of the invention is characterized in that the data recording program according to the eighth aspect can be read by a computer.

It is a block diagram which shows an example of a functional structure of the data recording device concerning this Embodiment. It is a flowchart which shows the content of the process of the data recording device concerning this Embodiment. It is a block diagram which shows an example of the hardware constitutions of the vehicle-mounted apparatus concerning a present Example. It is explanatory drawing which shows the image data by which the image recognition concerning a present Example was recognized. It is explanatory drawing which shows the image data in which the image process concerning a present Example was performed. It is a flowchart which shows the content of the process of the vehicle-mounted apparatus concerning a present Example.

  Exemplary embodiments of a data recording apparatus, a data recording method, a data recording program, and a computer-readable recording medium according to the present invention will be explained below in detail with reference to the accompanying drawings.

(Embodiment)
(Functional configuration of data recording device)
A functional configuration of the data recording apparatus according to the present embodiment will be described with reference to FIG. FIG. 1 is a block diagram illustrating an example of a functional configuration of the data recording apparatus according to the present embodiment.

  In FIG. 1, the data recording apparatus 100 includes a detection unit 101, an imaging unit 102, an image recognition unit 103, an image processing unit 104, and a recording unit 105.

  The detection unit 101 detects an imaging target vehicle that is an imaging target located around the vehicle. The imaging target vehicle is detected by, for example, a sensor such as an infrared sensor or an ultrasonic sensor (not shown), vehicle-to-vehicle communication, or the like.

  Specifically, for example, the detection unit 101 may detect a positional relationship between the vehicle and the imaging target vehicle, or may detect a relative speed of the imaging target vehicle with respect to the vehicle.

  The imaging unit 102 images the imaging target vehicle detected by the detection unit 101. The imaging target vehicle may be imaged by, for example, a vehicle-mounted camera (not shown) and may be a movable vehicle-mounted camera that can capture an image in any direction.

  Specifically, for example, the imaging unit 102 may capture an imaging target vehicle when the positional relationship detected by the detection unit 101 reaches a predetermined distance. Moreover, the structure which has a drive part which drives so that an imaging object vehicle may be imaged according to the relative speed detected by the detection part 101 may be sufficient. In other words, the imaging unit 102 may perform panning by driving the drive unit according to the relative speed of the imaging target vehicle.

  More specifically, for example, the imaging unit 102 causes the driving unit to follow in accordance with the relative speed of the imaging target vehicle, and the rotation angle of the driving unit becomes a predetermined angle (for example, 45 degrees) from the front of the vehicle. It is good also as imaging.

  Further, the imaging unit 102 causes the drive unit to follow in accordance with the relative speed of the imaging target vehicle, captures images at a predetermined interval (for example, 30 times per second), and calculates the imaging target vehicle calculated by the image recognition unit 103 described later. When the ratio of the length of the bumper to the side of the vehicle is a predetermined value (for example, 1: 2), the imaging target vehicle may be imaged. That is, the imaging target vehicle in the image data is displayed at an appropriate angle by imaging the imaging target vehicle so that the ratio between the length of the bumper of the imaging target vehicle and the side surface of the vehicle becomes a predetermined value. .

  The image recognition unit 103 recognizes a specific part in the image data including the imaging target vehicle imaged by the imaging unit 102. Specifically, for example, the image recognition unit 103 may recognize a passenger of the imaging target vehicle in the image data, or recognize a license plate of the imaging target vehicle in the image data.

  Moreover, the image recognition part 103 is good also as, for example, recognizing other vehicles different from the imaging target vehicle in image data. Further, the image recognition unit 103 may be configured to recognize the vehicle type of the imaging target vehicle in the image data, for example.

  Further, the image recognition unit 103 recognizes the length of the bumper and the vehicle side surface of the image pickup target vehicle from the image data including the image pickup target vehicle imaged by the image pickup unit 102, thereby the ratio of the length of the bumper to the vehicle side surface. May be configured to calculate.

  The image processing unit 104 performs predetermined image processing on the specific part recognized by the image recognition unit 103. Specifically, for example, the image processing unit 104 performs image processing such that the passenger recognized by the image recognition unit 103 cannot be identified, or the image plate recognized by the image recognition unit 103 cannot be identified. Processing may be performed.

  In addition, the image processing unit 104 may perform image processing so as to erase other vehicles from the image data, for example, by superimposing a background image as a background on the other vehicles recognized by the image recognition unit 103. Further, the image processing unit 104 may perform image processing when the vehicle type recognized by the image recognition unit 103 is a predetermined vehicle type.

  For example, the predetermined vehicle type may be registered in advance by the user, and may be a vehicle type that the user desires to record as image data.

  The recording unit 105 records the image data that has been subjected to image processing by the image processing unit 104. For example, the image data may be recorded on a recording medium (not shown) or output to an external server (not shown) by communication.

  In the description of FIG. 1, the vehicle type is recognized by the image recognition unit 103. However, when an imaging target vehicle is detected by inter-vehicle communication, information on the vehicle type may be received by inter-vehicle communication.

  In the description of FIG. 1, the image recognition unit 103 is configured to recognize the vehicle type with respect to image data including the imaging target vehicle imaged by the imaging unit 102, but the image subjected to image processing by the image processing unit 104. It is good also as recognizing a vehicle model regarding data. In that case, the recording unit 105 may record the image data when the vehicle type recognized by the image recognition unit 103 is a predetermined vehicle type.

(Contents of data recording device processing)
Next, the contents of processing of the data recording apparatus 100 according to the present embodiment will be described with reference to FIG. FIG. 2 is a flowchart showing the contents of processing of the data recording apparatus according to the present embodiment. In the flowchart of FIG. 2, first, the detection unit 101 determines whether an imaging target vehicle has been detected (step S201).

  In step S201, waiting for detection of the imaging target vehicle and detecting it (step S201: Yes), the imaging unit 102 images the imaging target vehicle detected in step S201 (step S202).

  Next, the image recognition unit 103 recognizes a specific part in the image data including the imaging target vehicle imaged in step S202 (step S203).

  Then, the image processing unit 104 performs predetermined image processing on the specific part recognized in step S203 (step S204).

  Thereafter, the recording unit 105 records the image data on which image processing has been performed in step S204 (step S205), and the series of processing ends.

  The data recording apparatus, the data recording method, the data recording program, and the computer-readable recording medium of the present invention are realized by the data recording apparatus 100 shown in FIG. The apparatus is not limited to 100, and a plurality of apparatuses may be used as long as the function unit illustrated in FIG. When each functional unit is connected as a different device, the connection between the devices may be established by performing communication using Bluetooth (registered trademark) or the like, regardless of wired or wireless.

  As described above, according to the data recording device, the data recording method, the data recording program, and the computer-readable recording medium according to the present embodiment, the user can perform imaging without operating the data recording device. Image data of the target vehicle can be automatically collected. In particular, since the driver can check the imaging target vehicle by using the image data after driving, it is not necessary to pay attention to the imaging target vehicle during driving, and safe driving can be achieved.

  In addition, according to the present embodiment, it is possible to drive the drive unit in accordance with the relative speed of the imaging target vehicle to image the imaging target vehicle, and thus it is possible to accurately capture the imaging target vehicle.

  Further, since the image data of the imaging target vehicle for the predetermined vehicle type is recorded, it is possible to optimize the collection of the image data without recording unnecessary image data. In addition, for vehicles other than the imaging target vehicle, since the background image can be overlaid and erased from the image data, the image data can be optimized without an unintended vehicle entering the image data.

  In addition, since the imaging target vehicle is configured to perform image processing that makes it impossible to discriminate passengers, license plates, and the like, personal information regarding the passenger and owner of the imaging target vehicle can be appropriately protected. it can.

  Examples of the present invention will be described below. In the present embodiment, an example in which the data recording device of the present invention is implemented by an in-vehicle device mounted on a moving body such as a vehicle (including a four-wheeled vehicle and a two-wheeled vehicle) will be described.

(Hardware configuration of in-vehicle device)
The hardware configuration of the in-vehicle device according to the present embodiment will be described with reference to FIG. FIG. 3 is a block diagram illustrating an example of a hardware configuration of the in-vehicle device according to the present embodiment.

  In FIG. 3, an in-vehicle device 300 is mounted on a moving body such as a vehicle, and includes a CPU 301, a ROM 302, a RAM 303, a magnetic disk drive 304, a magnetic disk 305, an optical disk drive 306, an optical disk 307, and an audio. I / F (interface) 308, speaker 309, input device 310, video I / F 311, display 312, camera 313, communication I / F 314, GPS unit 315, and various sensors 316 are provided. ing. Each component 301 to 316 is connected by a bus 320.

  First, the CPU 301 governs overall control of the in-vehicle device 300. The ROM 302 stores various programs such as a boot program, an image capturing program, an image recognition program, an image processing program, and a data recording program. The RAM 303 is used as a work area for the CPU 301.

  For example, when a vehicle approaching a predetermined range from the own vehicle is detected by various sensors 316 described later, the image capturing program causes the camera 313 described later to capture the approached vehicle as an imaging target vehicle.

  Specifically, for example, the imaging target vehicle is an oncoming vehicle approaching the host vehicle, calculates a relative speed using output values from various sensors 316, and drives a driving unit (not shown) in the camera 313. It may be a panning shot. In this way, by driving the drive unit and capturing an image, it is possible to accurately capture the oncoming vehicle without blurring.

  For example, the image recognition program causes image recognition using image data captured by a camera 313 described later. Specifically, for example, in the image recognition, it is recognized whether the vehicle included in the image data is a vehicle of a predetermined vehicle type. The predetermined vehicle type may be, for example, a configuration that can be registered in advance by the user, or a vehicle type that the user desires to collect as image data.

  Further, the image recognition may be, for example, to recognize a vehicle occupant or license plate included in the image data, or a vehicle other than the oncoming vehicle to be imaged.

  Although detailed description is omitted because it is a well-known technique, image recognition is performed by, for example, removing distortion and noise from digitized image data and performing correction processing such as enlargement, reduction, and rotation, and then performing feature extraction. Thus, a feature parameter or a feature vector is obtained. Then, from the obtained feature quantities such as feature parameters or feature vectors, a feature quantity that matches or close to the standard pattern is determined by identification, and is associated with a predetermined category. More specifically, for example, the image recognition may be performed by detecting whether there is an input image data that is the same as or close to the standard pattern in advance by pattern matching using a feature amount. .

  For example, the image processing program causes the image data recognized by the image recognition to be subjected to predetermined image processing. Although details will be described with reference to FIGS. 4 and 5, the predetermined image processing may be performed such that, for example, a vehicle occupant or a license plate included in the image data cannot be discriminated, or an oncoming vehicle that has been imaged. It is good also as superimposing a background image on vehicles other than.

  For example, the data recording program controls a magnetic disk drive 304 and an optical disk drive 306 described later to record data on a recording medium such as the magnetic disk 305 and the optical disk 307. Specifically, for example, the data to be recorded is image data subjected to image processing by an image processing program. In this way, by recording image data that has been subjected to image processing, the user can obtain desired vehicle type and image data in which personal information is appropriately protected. In other words, after image data before image processing is recorded, image processing is performed, image data that is not protected by personal information is temporarily recorded, and personal information cannot be properly protected. Can be prevented.

  The magnetic disk drive 304 controls the reading / writing of the data with respect to the magnetic disk 305 according to control of CPU301. The magnetic disk 305 records data written under the control of the magnetic disk drive 304. As the magnetic disk 305, for example, an HD (hard disk) or an FD (flexible disk) can be used.

  Examples of information recorded on the magnetic disk 305 include standard patterns used for image recognition and image processing, predetermined vehicle types, and image data subjected to image processing. In the present embodiment, the standard pattern, the predetermined vehicle type, and the image data are recorded on the magnetic disk 305, but may be recorded on the optical disk 307 to be described later.

  In addition, the standard pattern, the predetermined vehicle type, and the image data are not limited to those provided integrally with the hardware of the in-vehicle device 300, and may be provided outside the in-vehicle device 300. In that case, for example, the in-vehicle device 300 acquires a standard pattern or a predetermined vehicle type or outputs image data via the network through the communication I / F 314. The acquired standard pattern and the predetermined vehicle type are stored in the RAM 303 or the like.

  The optical disk drive 306 controls the reading / writing of the data with respect to the optical disk 307 according to control of CPU301. The optical disk 307 is a detachable recording medium from which data is read according to the control of the optical disk drive 306. As the optical disc 307, a writable recording medium can be used. In addition to the optical disk 307, the removable recording medium may be an MO, a memory card, or the like.

  The audio I / F 308 is connected to an audio output speaker 309, and audio is output from the speaker 309.

  Examples of the input device 310 include a remote controller having a plurality of keys for inputting characters, numerical values, and various instructions, a keyboard, a mouse, and a touch panel.

  The video I / F 311 is connected to the display 312 and the camera 313. Specifically, the video I / F 311 includes, for example, a graphic controller that controls the entire display 312, a buffer memory such as a VRAM (Video RAM) that temporarily records image information that can be displayed immediately, and a graphic controller. Based on the output image data, the display 312 is configured by a control IC or the like.

  The display 312 displays icons, cursors, menus, windows, or various data such as characters and images. As this display 312, for example, a CRT, a TFT liquid crystal display, a plasma display, or the like can be adopted. A plurality of displays 312 may be provided in the vehicle, for example, for the driver and for a passenger seated in the rear seat.

  The camera 313 is installed on the dashboard or ceiling of the vehicle and captures images outside the vehicle. The image may be either a still image or a moving image. For example, the oncoming vehicle is imaged by the camera 313, and the captured image data is processed by an image recognition program, an image processing program, or the like, and then recorded on a recording medium such as the magnetic disk 305 or the optical disk 307. It is good also as outputting. In addition, the camera 313 may be a movable type that can image the imaging direction determined by driving of the driving unit.

  The communication I / F 314 is connected to a network via wireless and functions as an interface between the in-vehicle device 300 and the CPU 301. The communication I / F 314 is further connected to a communication network such as the Internet via wireless, and also functions as an interface between the communication network and the CPU 301.

  Communication networks include LANs, WANs, public line networks and mobile phone networks. Specifically, the communication I / F 314 includes, for example, an FM tuner, a VICS (Vehicle Information and Communication System) / beacon receiver, a radio navigation device, and other navigation devices. Obtain road traffic information such as regulations. VICS is a registered trademark.

  The GPS unit 315 receives radio waves from GPS satellites and outputs information indicating the current location of the vehicle. The output information of the GPS unit 315 is used when the current position of the vehicle is calculated by the CPU 301 together with output values of various sensors 316 described later. The information indicating the current location is information for specifying one point on the map information, such as latitude / longitude and altitude, for example, and the location of the image data may be confirmed by associating it with the image data to be recorded.

  The various sensors 316 include a vehicle speed sensor, an acceleration sensor, an angular velocity sensor, and the like, and the output values of the various sensors 316 are used by the CPU 301 to calculate the current position of the vehicle and to measure the amount of change in speed and direction.

  The various sensors 316 may be an infrared sensor, an ultrasonic sensor, or the like, and may be configured to detect a vehicle located around the own vehicle. In the description of FIG. 3, various sensors 316 are used to detect a vehicle located in the vicinity of the own vehicle. However, communication I / F 314 is used to detect a surrounding vehicle using inter-vehicle communication. Also good.

  The data recording device 100 shown in FIG. 1 includes a detection unit 101, an imaging unit 102, an image recognition unit 103, an image processing unit 104, and a recording unit 105 that are the ROM 302, RAM 303, and magnetic disk 305 in the in-vehicle device 300 shown in FIG. The CPU 301 executes a predetermined program using a program or data recorded on the optical disc 307 or the like, and controls each unit in the in-vehicle device 300 to realize the function.

  That is, the in-vehicle device 300 of the present embodiment executes the various programs recorded in the ROM 302 as a recording medium in the in-vehicle device 300, so that the functions provided in the data recording device 100 shown in FIG. It can be executed according to the procedure shown.

(Outline of image recognition and image processing)
Here, an outline of image recognition and image processing according to the present embodiment will be described with reference to FIGS. 4 and 5. FIG. 4 is an explanatory diagram of image data that has been image-recognized according to the present embodiment.

  In FIG. 4, the image data 400 includes an oncoming vehicle 401 imaged by the camera 313, a driver 402 driving the oncoming vehicle 401, and a license plate 403 installed on the oncoming vehicle 401.

  The oncoming vehicle 401 is detected by various sensors 316 and is imaged under the control of the CPU 301. Specifically, for example, a relative speed is calculated by using an output value from various sensors 316 by an image capturing program, and an image is captured by a panning shot in which a driving unit (not shown) in the camera 313 is driven. The oncoming vehicle 401 is recognized by the image recognition program as to whether or not it is a predetermined vehicle type registered by the user, and is assumed to be a predetermined vehicle type in the description of the present embodiment.

  The driver 402 is imaged when the oncoming vehicle 401 is imaged, and is recognized by the image recognition program. Similarly, the license plate 403 is imaged when the oncoming vehicle 401 is imaged, and is recognized by the image recognition program. Although not described in FIG. 4, the image data 400 may include other vehicles in addition to the oncoming vehicle 401, and the other vehicles are recognized by the image recognition program.

  Next, image processing according to the present embodiment will be described with reference to FIG. FIG. 5 is an explanatory diagram of image data that has been subjected to image processing according to the present embodiment.

  In FIG. 5, the image data 500 includes an oncoming vehicle 501, a light reflection image 502, and a license plate mark 503.

  The oncoming vehicle 501 is subjected to predetermined image processing, and the driver 402 and the license plate 403 shown in FIG. 4 cannot be discriminated. Specifically, for example, in the predetermined image processing, a light reflection image 502 representing a state in which light is reflected on the windshield is superimposed on the driver 402 recognized by the image recognition program by the image processing program. The driver's face disappears with a natural look.

  In the predetermined image processing, for example, the license plate 403 recognized by the image recognition program is filled with a number to form a license plate trace 503.

  Thus, the oncoming vehicle 501 that has undergone image processing appropriately protects personal information that identifies the user and the like, and by storing the image data 500 that has undergone image processing, The user can appropriately collect the image data 500 including the desired vehicle.

  Although the description is omitted in the description of FIG. 5, when another vehicle different from the oncoming vehicle 401 is recognized by the image recognition program, a background image such as a guardrail or a road is superimposed on the other vehicle, and the oncoming vehicle is overlapped. Image data 500 including only 501 may be used.

(Contents of processing of in-vehicle device 300)
Next, the contents of the process of the in-vehicle device 300 according to the present embodiment will be described with reference to FIG. FIG. 6 is a flowchart showing the contents of the processing of the in-vehicle device according to the present embodiment. In the flowchart of FIG. 6, first, it is determined by the various sensors 316 whether an oncoming vehicle has approached (step S601). The approach of the oncoming vehicle may be configured to detect that the oncoming vehicle is located within a predetermined distance from the own vehicle, for example.

  More specifically, for example, an oncoming lane may be recognized by recognizing a center line on a road, and a vehicle having a vector in the opposite direction to the own vehicle in the oncoming lane may be used as the oncoming vehicle.

  In step S601, waiting for the oncoming vehicle to approach and approaching (step S601: Yes), the CPU 301 uses the output values of the various sensors 316 to determine the relative speed of the oncoming vehicle approaching in step S601. Calculate (step S602).

  Next, the oncoming vehicle is shot by controlling the driving unit of the camera 313 so that the oncoming vehicle can be imaged by the CPU 301 in accordance with the relative speed calculated in step S602 (step S603).

  Then, the CPU 301 detects the number plate of the oncoming vehicle by recognizing the image data captured in step S603 (step S604), and deletes the number plate detected from the image data by performing image processing (step S605). ). For example, the number plate may be deleted so that the number cannot be distinguished.

  Next, the CPU 301 detects an oncoming vehicle occupant by recognizing the image data captured in step S603 (step S606), and performs image processing to display a light reflection image on the occupant detected from the image data. Overwriting is performed (step S607).

  Then, the CPU 301 recognizes the image data picked up in step S603 to determine whether a vehicle other than the oncoming vehicle is included in the image data (step S608).

  In step S608, if another vehicle is present (step S608: Yes), the CPU 301 performs image processing to overwrite the background image on the other vehicle determined in step S608 (step S609).

  In step S608, if there is no other vehicle (step S608: No), the process proceeds to step S610.

  Then, the CPU 301 determines whether or not the oncoming vehicle is a predetermined vehicle type by recognizing the image data captured in step S603 (step S610). There may be a plurality of predetermined vehicle types, or information defining a category such as a sports car.

  Specifically, for example, the vehicle type may be determined by matching with an image of a predetermined vehicle type such as a user's preference registered in advance. Further, the vehicle type may be determined from the tire diameter and interval. Specifically, for example, when the tire diameter is large and the interval is large, a truck, and when the tire diameter is large but the interval is narrow, a sports car is used. When the tire diameter is small and the interval is narrow, it may be determined as a light vehicle. Alternatively, the configuration may be such that the vehicle type is determined from the shape or color of a one-box car, sedan, jeep, or the like from the outer shape of the oncoming vehicle, or characters attached to the vehicle body are recognized.

  In step S610, when it is a predetermined vehicle type (step S610: Yes), the CPU 301 records the image data processed in step S605, step S607, or step S609 (step S611), and ends the series of processes. To do.

  In step S610, when it is not a predetermined vehicle type (step S610: No), a series of processing is ended as it is. Although the description is omitted in the flowchart of FIG. 6, when the vehicle is not a predetermined vehicle type (step S610: No), the image data may be deleted.

  Note that the order of image recognition and image processing in steps S604 to S610 described in the flowchart of FIG. 6 is not limited to this. Specifically, for example, image recognition and image processing related to a passenger may be performed before image recognition and image processing related to a license plate. Alternatively, a configuration may be used in which it is first determined whether or not the vehicle is a predetermined vehicle type.

  As described above, according to the present embodiment, since an oncoming vehicle approaching the host vehicle can be imaged, the user can collect image data without operating the camera. Can achieve safe driving without gazing at the oncoming vehicle to be imaged during driving.

  Further, since the panning can be performed by driving the camera drive unit according to the relative speed of the oncoming vehicle approaching the host vehicle, the oncoming vehicle can be imaged without blurring. In addition, since the license plate and the passenger can be recognized and image processing that cannot be determined can be performed, appropriate personal information can be protected.

  In addition, the panning may be performed by changing the shutter speed of the camera in accordance with the relative speed of the oncoming vehicle approaching the host vehicle. Specifically, for example, the shutter speed may be changed by increasing the shutter speed when the relative speed of the oncoming vehicle is high and decreasing the shutter speed when the relative speed of the oncoming vehicle is low. In this way, it is possible to acquire realistic image data by blurring only the background without the oncoming vehicle blurring.

  Further, since image data of a predetermined vehicle type can be recorded, it is possible to optimize image data collection without storing other than the vehicle type desired by the user.

  In the above description, the image data of the oncoming vehicle is mounted on the vehicle. However, the image data of the imaging target vehicle may be captured without being mounted on the vehicle. Specifically, for example, image data of the imaging target vehicle may be captured and collected by a fixed point camera or the like. If it is a fixed-point camera, it is not necessary to take measures against vibrations when mounted on the vehicle, so that an inexpensive system can be provided.

  In addition, although the description is omitted in this embodiment, the captured image of the oncoming vehicle may be displayed as an album. Specifically, for example, in an album, only oncoming vehicles may be selectively extracted from the captured images and collected. By collecting as an album in this way, you can be sure that you will be able to check if there are different cars later, use them for car type quizzes, refer to them when you buy new cars, and even rare car models.

  In addition, when a part of the oncoming vehicle cannot be imaged due to a shield or the like, the interpolation process may be performed by using the fact that the vehicle is generally symmetrical. Furthermore, it is good also as taking the image of the front, side, and back of an oncoming vehicle together using the back camera which images the back of a vehicle. In this way, it is possible to accurately understand the structure of the vehicle and to create a 3D model of the entire vehicle.

  Moreover, you may provide the structure which records the information of an oncoming vehicle. Specifically, for example, as the oncoming vehicle information, an image of the leading vehicle in the traffic jam may be recorded, and an image of the leading vehicle or information such as an accident may be transmitted to the vehicle in the traffic jam. Alternatively, in a case where there is a traffic jam, a configuration may be used in which information indicating that the traffic jam has occurred is transmitted when the vehicle passes by an oncoming vehicle that is traveling alone. In this way, the vehicle user who has received the information can determine whether the cause of the traffic jam is an accident or waiting for a signal.

  The information on the oncoming vehicle may include information such as the number of oncoming vehicles and the result of vehicle type determination such as trucks. It can be judged whether there are many. Further, if the oncoming vehicle is not imaged during congestion, it is possible to prevent many oncoming vehicles from being detected and taking too many pictures.

  In the present invention, the object to be imaged is a vehicle, but is not limited to a vehicle. For example, an image of an airplane, a train, or the like as another moving body, or a building other than the moving body may be imaged. In this way, it is possible to collect image data of a subject desired by a wide range of users.

  The data recording method described in this embodiment can be realized by executing a program prepared in advance on a computer such as a personal computer or a workstation. This program is recorded on a computer-readable recording medium such as a hard disk, a flexible disk, a CD-ROM, an MO, and a DVD, and is executed by being read from the recording medium by the computer. The program may be a transmission medium that can be distributed via a network such as the Internet.

DESCRIPTION OF SYMBOLS 100 Data recording device 101 Detection part 102 Imaging part 103 Image recognition part 104 Image processing part 105 Recording part

Claims (10)

Detecting means for detecting an imaging target vehicle that is an imaging target located around the vehicle;
Imaging means for imaging the imaging target vehicle detected by the detection means;
Image recognition means for recognizing a specific part in image data including the imaging target vehicle imaged by the imaging means;
Image processing means for performing predetermined image processing on the specific part recognized by the image recognition means;
Recording means for recording image data subjected to image processing by the image processing means;
A data recording apparatus comprising: The detection means includes
Detecting a positional relationship between the vehicle and the imaging target vehicle;
The imaging means includes
The data recording apparatus according to claim 1, wherein the imaging target vehicle is imaged when the positional relationship detected by the detection unit reaches a predetermined distance. The detection means includes
Detecting a relative speed of the vehicle to be imaged with respect to the vehicle;
The imaging means includes
The data recording apparatus according to claim 1, further comprising a drive unit configured to drive the imaging target vehicle to take an image according to a relative speed detected by the detection unit. The image recognition means includes
Recognizing a passenger of the imaging target vehicle in the image data,
The image processing means includes
2. The data recording apparatus according to claim 1, wherein image processing is performed so that a passenger recognized by the image recognition means cannot be discriminated. The image recognition means includes
Recognizing the license plate of the imaging target vehicle in the image data,
The image processing means includes
2. The data recording apparatus according to claim 1, wherein the number plate recognized by the image recognition means is subjected to image processing so as not to be discriminated. The image recognition means includes
Recognizing another vehicle different from the imaging target vehicle in the image data;
The image processing means includes
The data recording apparatus according to claim 1, wherein the other vehicle is erased from the image data by superimposing a background image as a background on the other vehicle recognized by the image recognition means. The image recognition means includes
Recognizing the vehicle type of the imaging target vehicle in the image data;
The image processing means includes
The data recording apparatus according to claim 1, wherein image processing is performed when the vehicle type recognized by the image recognition unit is a predetermined vehicle type. A detection step of detecting an imaging target vehicle that is an imaging target located around the vehicle;
An imaging step of imaging the imaging target vehicle detected by the detection step;
An image recognition step for recognizing a specific part in the image data including the imaging target vehicle imaged by the imaging step;
An image processing step of performing predetermined image processing on the specific part recognized by the image recognition step;
A recording step of recording image data subjected to image processing by the image processing step;
A data recording method comprising:   A data recording program for causing a computer to execute the data recording method according to claim 8.   A computer-readable recording medium on which the data recording program according to claim 9 is recorded.

Images