JP6223697B2 - Vehicle imaging device - Google Patents

Description

  The present invention detects a predetermined change in the situation of a person in a vehicle interior, or acquires the number of photographing positions of photographs taken in the past around the vehicle by a plurality of contributors, and And / or a vehicle imaging device that stores an image of an outdoor image and an imaging assist that acquires the number of shooting positions of photos taken in the past around the vehicle by a plurality of contributors and notifies the user of notification information It relates to devices.

  FIG. 1A of Patent Document 1 discloses an imaging device 1 that can be applied to a drive log. The imaging device 1 is set on a dashboard, and an outdoor image with the traveling direction (front direction) of the automobile as a subject direction. Is stored and the image is stored. As shown in FIG. 3A of Patent Document 1, the imaging apparatus 1 determines a time interval (T4, T3, T2, T1) between the current image and the next image according to the speed. . By determining the timing for imaging according to the speed in this way, as shown in FIG. 3B of Patent Document 1, the imaging device 1 captures an image at a certain distance Lx, and the image is captured. Can be remembered.

JP 2009-49950 A

  However, in the imaging device 1 of Patent Document 1, there is a possibility that an image stored at every constant distance Lx does not represent an optimal moment for the user. Therefore, in order to store the image at the optimum moment, the storage timing must be improved or changed, or the image must always be stored. In other words, it is difficult to store images at good timing, and the storage capacity increases in order to always store images.

  One object of the present invention is to provide an imaging apparatus for a vehicle that can store an image at a good timing, or an imaging assistance apparatus that can assist the imaging of an image at a good timing. Another object of the present invention is to provide a vehicular imaging device or the like that can suppress an increase in storage capacity. Other objects of the present invention will become apparent to those skilled in the art by reference to the following several and preferred embodiments and the accompanying drawings.

  In the following, in order to easily understand the outline of the present invention, embodiments according to the present invention will be exemplified.

According to a first aspect of the present invention, there is provided an imaging unit that images an inside and / or outside of a vehicle room to generate an image;
A detection unit for detecting a predetermined change in the situation of the person inside the room;
A detection unit for detecting the position of the vehicle;
A determination unit for determining whether or not the predetermined situation change of the person has occurred;
A storage unit for storing the image based on a signal indicating that the predetermined situation change of the person has occurred;
With
If the number of shooting positions of photographs taken in the past in a determination area around the position of the vehicle by a plurality of contributors is equal to or greater than a first threshold, the determination unit decreases the second threshold. When the parameter indicating the predetermined situation change of the person is greater than or equal to the second threshold, the signal indicating that the predetermined situation change of the person has occurred is generated. Related to the imaging device.

  The vehicle imaging device stores an image generated by the imaging unit based on a signal indicating that a predetermined situation change of a person inside the vehicle room (a user of the vehicle imaging device) has occurred. Likely to show good timing. Moreover, when there are many photographs taken in the past by a plurality of contributors, there is a possibility that the photographing position of the photograph is a place (scenic point) with a good view for the user. Therefore, when the vehicle is approaching such a shooting position, it is preferable to store an image generated by the imaging unit even if the user's predetermined situation change is small. Since the determination unit lowers the second threshold value, an image generated by the imaging unit is easily stored at the scenic point, and thus the image is highly likely to represent an optimal moment.

In a second aspect according to the present invention, in the first aspect,
The predetermined situation change of the person may be a predetermined facial expression change of the person.

  In the second aspect, an image generated by the imaging unit based on a predetermined facial expression change such as a user's smile can be stored.

In a third aspect according to the present invention, in the first aspect,
The predetermined situation change of the person may be a predetermined behavior change of the person.

  In the third aspect, an image generated by the imaging unit based on a predetermined behavior change such as a user's movement can be stored.

According to a fourth aspect of the present invention, there is provided an imaging unit that images an inside and / or outside of a vehicle room to generate an image;
A detection unit for detecting the position of the vehicle;
A determination unit that determines whether or not the number of shooting positions of photographs taken in the past in a determination region around the position of the vehicle by a plurality of contributors is equal to or greater than a first threshold;
A storage unit for storing the image based on a signal indicating that the number of the shooting positions of the photograph is equal to or greater than the first threshold;
It is related with the imaging device for vehicles characterized by providing.

  In general, when there are many photographs taken by a plurality of contributors in the past, the photographing position of the photographs may be a scenic point for the user of the vehicle imaging device. Therefore, it is preferable to store an image generated by the imaging unit when the vehicle is approaching such a shooting position.

In a fifth aspect according to the present invention, any one of the first to fourth aspects is
You may further provide the setting part which sets the said determination area | region and / or a said 1st threshold value based on the said position of the said vehicle.

  Generally, depending on the position of the vehicle, the scenic points are likely to be scattered or concentrated. Specifically, when a vehicle travels around a tourist spot such as a mountain, lake or coast, for example, the scenic point is likely to be scattered, and when the vehicle travels around a city such as a Tokyo station, for example, Easy to concentrate. Therefore, by setting the determination region and / or the first threshold based on the position of the vehicle, it can be more appropriately determined whether or not the vehicle is approaching the scenic point.

In a sixth aspect according to the present invention, any of the first to fourth aspects is
You may further provide the setting part which sets the said determination area | region and / or a said 1st threshold value based on the said person's operation signal.

  Depending on the person inside the vehicle room (the user of the vehicle image pickup apparatus), it is easy to be interested in or difficult to have a scenic point or a general scenic point for a plurality of contributors. Therefore, it becomes easy for the vehicle to approach the scenic point according to the user's preference, or it becomes difficult to approach.

In a seventh aspect according to the present invention, in the fifth or sixth aspect,
When the vehicle is guided to a destination, the setting unit may set the determination area along a route from the position of the vehicle to the destination.

  When the setting unit sets the determination area along the route from the position of the vehicle to the destination, it is possible to extract a scenic point in the direction in which the vehicle travels.

In an eighth aspect according to the present invention, in the fifth or sixth aspect,
When the vehicle is not guided to the destination, the setting unit may set the determination area based on a center area centered on the position of the vehicle.

  When the setting unit sets the determination area based on the central area centered on the position of the vehicle, it is possible to extract a scenic point where the vehicle may travel.

In a ninth aspect according to the present invention, in any one of the first to eighth aspects,
The shooting positions of the photos within a predetermined distance may be grouped,
The determination unit may determine whether the number of the shooting positions of the grouped photographs is equal to or greater than the first threshold.

  Since the scenic point is determined based on the grouped photograph or the grouped photograph, the scenic point can be specified more accurately. In addition, since it is not necessary to acquire or count the number of shooting positions that are not grouped, it is possible to reduce the processing load of the vehicle imaging device.

In a tenth aspect according to the present invention, in any one of the first to ninth aspects,
The imaging unit may generate the image as a series of images,
The storage unit may store a part of the series of images.

  As the images are generated continuously, the series of images can include images at the optimal moment. In other words, an image captured discontinuously (for example, at a certain distance) may not represent an optimal moment. In the tenth aspect, a series of images including images at the optimal moment is generated, and not all of the series of images are stored in the storage unit, but a part of the series of images is stored in the storage unit. Thereby, an increase in the storage capacity of the storage unit can be suppressed.

An eleventh aspect according to the present invention includes a detection unit that detects the position of the vehicle;
A determination unit that determines whether or not the number of shooting positions of photographs taken in the past in a determination region around the position of the vehicle by a plurality of contributors is equal to or greater than a first threshold;
A notification unit that notifies the user of notification information based on a signal indicating that the number of the shooting positions of the photograph is equal to or greater than the first threshold;
It is related with the imaging auxiliary device characterized by providing.

  In general, when there are many photographs taken by a plurality of contributors in the past, the photographing position of the photographs may be a scenic point for the user of the imaging assistance device. Therefore, it is preferable to notify the user of notification information when the vehicle is approaching such a shooting position. Thereby, when a vehicle passes a scenic point, possibility that a user will miss a scenic point becomes low, and the user can image the image of a scenic point with favorable timing.

In a twelfth aspect according to the present invention, the eleventh aspect is
You may further provide the setting part which sets the said determination area | region and / or the said 1st threshold value.

  By making it possible to set the determination region and / or the first threshold value, for example, it can be more appropriately determined whether or not the vehicle is approaching the scenic point. Or it becomes easy for a vehicle to approach a scenic point according to a user's preference, or it becomes difficult to approach.

In a thirteenth aspect according to the present invention, in the eleventh or twelfth aspect,
The shooting positions of the photos within a predetermined distance may be grouped,
The determination unit may determine whether the number of the shooting positions of the grouped photographs is equal to or greater than the first threshold.

  Since the scenic point is determined based on the grouped photograph or the grouped photograph, the scenic point can be specified more accurately. In addition, since it is not necessary to acquire or count the number of shooting positions that are not grouped, it is possible to reduce the processing load of the imaging assisting device.

  Those skilled in the art will readily understand that the illustrated embodiments according to the present invention can be further modified without departing from the spirit of the present invention.

1 shows a schematic configuration diagram of a vehicle imaging device according to the present invention. FIG. The example of arrangement | positioning of the imaging device for vehicles is shown. The example of arrangement | positioning of an audio | voice output means or an alerting | reporting part is shown. An example of an image (internal image) generated by an in-vehicle camera when a predetermined situation change of a person occurs is shown. The structural example of the moving image memorize | stored by the memory | storage means of FIG. 1 is shown. The flowchart showing the operation example of the imaging device for vehicles of FIG. 1 is shown. An example of vehicle travel will be shown. 8A, FIG. 8B, FIG. 8C, and FIG. 8D are respectively times t1, t2, t3, and t4 of FIG. 7 in which a vehicle that is not guided to the destination travels through the sightseeing spot. An example of setting the determination area in FIG. 9 (A), 9 (B), 9 (C) and 9 (D) respectively show the times t1, t2, t3 in FIG. 7 when the vehicle guided to the destination travels through the sightseeing spot. An example of setting the determination area at t4 is shown. The other schematic block diagram of the imaging device for vehicles according to this invention is shown. 11 is a flowchart illustrating an operation example of the vehicle imaging device in FIG. 10. 6 shows a flowchart showing an operation example of the imaging assistance device according to the present invention.

  The preferred embodiments described below are used to facilitate an understanding of the present invention. Accordingly, those skilled in the art should note that the present invention is not unduly limited by the embodiments described below.

  FIG. 1 is a schematic configuration diagram of a vehicle imaging device according to the present invention. The vehicle imaging device can include, for example, an internal imaging unit such as the in-vehicle camera 70 shown in FIG. 1 and a storage unit such as the storage unit 60. In the example of FIG. 1, the in-vehicle camera 70 used as an internal imaging unit can continuously capture the inside of a room 130 (see FIG. 2) of a vehicle such as an automobile and generate a series of internal images. Moreover, the vehicle imaging device can further include a detection unit and a determination unit. For example, the in-vehicle camera 70 shown in FIG. 1 can be used as a detection unit. For example, the detection unit configured by the in-vehicle camera 70 can detect a predetermined change in the situation of a person inside the vehicle room 130 (a user of the vehicle imaging device, a vehicle occupant). A series of internal images generated by the in-vehicle camera 70 is stored in, for example, the primary storage unit 50 and is sent to a determination unit configured by, for example, the determination unit 30 or the situation change determination unit 30b.

  The situation change determination unit 30b determines whether or not there has been a predetermined situation change of a person (user) based on a series of internal images, that is, based on the images constituting the series of internal images. When there is a predetermined situation change of a person (user), the situation change determination means 30b generates a signal (trigger signal) indicating that there is a predetermined situation change of the person, and the trigger signal is stored in the primary storage means 50. Can be sent to. Based on this trigger signal, the primary storage means 50 can send, for example, a part of a series of internal images to the storage means 60. The storage unit 60 stores a part of the series of internal images based on the trigger signal from the situation change determination unit 30b. The primary storage means 50 may be constituted by, for example, SRAM (volatile memory), an internal memory of the in-vehicle camera 70, etc., and the storage means 60 is constituted by, for example, flash memory (nonvolatile memory), a hard disk drive, or the like. May be.

  The storage unit 60 is, for example, an image (for example, an image generated by an internal imaging unit) based on a signal (trigger signal) indicating that a predetermined situation change has occurred in a person inside the vehicle room 130 (a user of the vehicle imaging device). The state of the interior of the vehicle room 130, etc.) is stored, and the image is likely to show good timing.

  The vehicular imaging device can include not only the internal imaging unit but also an external imaging unit such as an on-vehicle camera 40 shown in FIG. Alternatively, the vehicle imaging device may include an external imaging unit instead of the internal imaging unit. As described above, the vehicular imaging apparatus includes an imaging unit including, for example, the in-vehicle camera 70 and / or the in-vehicle camera 40. When the vehicle imaging apparatus includes at least the vehicle exterior camera 40, the storage unit 60 stores, for example, an image (for example, scenery) generated by the vehicle exterior camera 40 based on the trigger signal. There is a high possibility of showing timing.

  Here, since the vehicle camera 40 continuously captures an image of the outside of the vehicle compartment 130 as one operation mode, for example, every fixed distance Lx as shown in FIG. This is different from the imaging apparatus 1 that captures an image. In other words, when the external camera 40 continuously captures the outside of the vehicle room 130 to generate a series of external images, the series of external images can include images at the optimal moment. On the other hand, an image captured discontinuously (for example, every fixed distance) may not represent an optimal moment.

  In addition, when a series of external images and / or a series of internal images are continuously stored, the storage capacity of the primary storage unit 50 increases. Thus, the primary storage means 50 stores only a certain amount of the latest series of external images and / or series of internal images, and the old external images and / or internal images are sequentially replaced with new external images and / or Replaced with internal image. In other words, a series of external images and / or a series of internal images are only temporarily stored in the primary storage means 50, and the primary storage means 50 stores a certain amount of a series of external images and / or series. Can be stored endlessly.

  Furthermore, the storage unit 60 can store a part of the series of external images and / or a part of the series of internal images based on the trigger signal. In other words, the storage means 60 does not always store a series of external images and / or a series of internal images, but a part of the series of external images at a good timing including an image at an optimal moment. And / or storing a portion of a series of internal images. Thereby, an increase in the storage capacity of the storage means 60 can be suppressed.

  By the way, when the vehicle passes through a place (scenic point) with a good view for a person inside the vehicle room 130 (a user of the vehicle imaging device) (a trigger signal) ) May not be generated. In other words, the image captured by the imaging unit at the scenic point may represent an optimal moment. Therefore, when the vehicle approaches the scenic point, the storage unit 60 preferably stores an image generated by the imaging unit.

  In the example of FIG. 1, the vehicle imaging device further includes a detection unit such as a position detection unit 25 and an acquisition unit such as a shooting position acquisition unit 35 in order to determine whether or not the vehicle is approaching a scenic point. Can do. Specifically, the detection unit or position detection means 25 is configured by, for example, a GPS receiver that receives a GPS signal, and can detect the position of the vehicle from the GPS signal or the like.

  Specifically, the acquisition unit or the imaging position acquisition unit 35 is configured by a mobile communication module that communicates data with a communication device on the Internet connected via a mobile phone communication network, for example, and stores the communication device. Data can be acquired from the apparatus 300 using, for example, 3G radio waves. Note that the mobile communication module can also acquire information on the base station, and thereby an approximate distance between the base station and the mobile communication module, that is, an approximate position of the vehicle may be detected. In other words, the mobile communication module can also be used as the detection unit or the position detection unit 25.

  More specifically, the acquisition unit or the shooting position acquisition unit 35 transmits a determination area around the position of the vehicle to the communication device, and determines the number of shooting positions of photographs taken in the past in the determination region. Can be received from. Here, the communication device is, for example, a server, and the storage device 300 stores a plurality of photos, and creates a database of shooting positions (for example, latitude and longitude) of the plurality of photos. Therefore, the communication device can search the number of photographs taken in the determination area (for example, the latitude range and the light range) received from the obtaining unit or the photographing position obtaining unit 35 in the photographing position database of the storage device 300. For example, the photos stored in the storage device 300 configured by a hard disk drive or the like are uploaded from a plurality of contributor terminals (not shown), and new photos are uploaded by new contributors, for example. Then, the communication device can update the shooting position database by referring to the tag information of the new photo and acquiring the shooting position in the tab information.

  In the example of FIG. 1, the determination unit 30 includes not only the situation change determination unit 30 b but also the shooting position determination unit 30 a, and the shooting position determination unit 30 a or the determination unit is placed around the vehicle position by a plurality of contributors. It is determined whether or not the number of shooting positions of photographs taken in the past in a certain determination area is equal to or greater than a first threshold value. When the number of shooting positions of photographs taken in the past in the determination area is equal to or greater than the first threshold, the determination unit can determine or estimate that the vehicle is approaching the scenic point. When the vehicle is approaching the scenic point, it is preferable to store the image generated by the in-vehicle camera 70 and / or the out-of-vehicle camera 40 in the storage unit 60 even if the user's predetermined situation change is small. . In other words, when images generated by the in-vehicle camera 70 and / or the external camera 40 are easily stored in the storage unit 60 at the scenic point, the image stored in the storage unit 60 may represent an optimal moment. Get higher.

  Since the situation change determination unit 30b generates a trigger signal when the parameter indicating the person's predetermined situation change is equal to or greater than the second threshold value, the user's predetermined situation change is small by reducing the second threshold value. Even in this case, an image generated by the in-vehicle camera 70 and / or the out-of-vehicle camera 40 can be easily stored in the storage unit 60. Here, the predetermined change in the situation of the person is, for example, a change in the predetermined expression of the person. More specifically, the situation change determination unit 30b is included in the image generated by the in-vehicle camera 70 used as the detection unit. A feature point of the user's face is extracted, and a mouth region such as a lip region or a tooth region can be specified based on the feature point. Thereafter, the situation change determination means 30b calculates a smile parameter indicating smile based on, for example, a parameter indicating the opening of the mouth, a parameter indicating the appearance of the teeth, and the like, and the trigger signal is output when the smile parameter is equal to or greater than the second threshold (smile threshold). Is generated.

  The predetermined change in the situation of the person may be, for example, a change in the behavior of the person, and the situation change determination means 30b is based on a change in the user's motion based on a pixel change in the image generated by the in-vehicle camera 70 used as the detection unit. The presence or absence of can be determined. Alternatively, the predetermined change in the situation of the person may be, for example, a change in the voice of the person, and the situation change determination unit 30b changes the volume of the sound generated by, for example, a detection microphone (not shown) as the detection unit. The presence or absence of the user's utterance can be determined based on the above.

  In the example of FIG. 1, the vehicle imaging device can further include a setting unit such as a determination condition setting unit 15. The determination condition setting unit 15 or the setting unit sets a determination region and / or a first threshold value. Here, the determination region and / or the first threshold value is set based on the position of the vehicle from the position detection means 25, for example. Generally, depending on the position of the vehicle, the scenic points are likely to be scattered or concentrated. Specifically, when a vehicle travels around a tourist spot such as a mountain, lake or coast, for example, the scenic point is likely to be scattered, and when the vehicle travels around a city such as a Tokyo station, for example, Easy to concentrate. Therefore, by setting the determination region and / or the first threshold based on the position of the vehicle, it can be more appropriately determined whether or not the vehicle is approaching the scenic point.

  The determination region and / or the first threshold value may be set based on a human operation signal from an operation unit such as the operation unit 240, for example. Depending on the user, it is easy to be interested in or difficult to have a scenic point or a general scenic point for a plurality of contributors. Therefore, it becomes easy for the vehicle to approach the scenic point according to the user's preference, or it becomes difficult to approach.

  In the example of FIG. 1, the processing units such as the situation change determination unit 30 and the determination condition setting unit 15 can be configured by a CPU, an MPU, or the like, for example. In addition, the operation unit such as the operation unit 240 can be configured with, for example, hardware buttons, software buttons, a keyboard, and the like. In the example of FIG. 1, the vehicle imaging device can further include a display device 110 and an audio output means 230, which will be described later. However, the vehicle imaging device may not include the audio output unit 230 or the notification unit.

  FIG. 2 shows an arrangement example of the vehicle imaging device. In the example of FIG. 2, the vehicle external camera 40 (external imaging unit) in FIG. 1 is configured by, for example, one vehicle external camera, and captures images in a plurality of directions (for example, the longitudinal direction DR1 and DR2 of the vehicle). In order to do so, it may be composed of a plurality of external cameras. In the example of FIG. 2, the external camera 40 is disposed, for example, in front of an inner rear view mirror 14 (room mirror, rearview mirror) of an automobile. In the example of FIG. 2, the in-vehicle camera 70 (internal imaging unit) is configured by, for example, one in-vehicle camera, and is disposed behind the inner rear view mirror 14. The in-vehicle camera 40 and / or the in-vehicle camera 70 may be disposed on the dashboard 16, for example.

  As shown in FIG. 1, the display device 110 is a car navigation device having a touch panel display, for example. In the example of FIG. 2, the car navigation device arranged inside the dashboard includes the display device 110, the vehicle The position detection unit 25, the photographing position acquisition unit 35, and the operation unit 240 can be combined. Further, for example, the determination condition setting means 15, the determination means 30, the primary storage means 50, and the storage means 60 constitute an ECU, and the external camera 40 and the in-vehicle camera 70 can be driven by the ECU. In addition, the ECU is connected to the car navigation apparatus via an in-vehicle network such as CAN.

  In the example of FIG. 2, the notification unit such as the audio output unit 230 is omitted, but the audio output unit 230 is specifically configured by an in-vehicle speaker connected to a car navigation device, for example. The vehicle imaging device is, for example, a combination of a car navigation device, an ECU, an in-vehicle camera 40, and an in-vehicle camera 70, but may be a mobile terminal such as a so-called smartphone.

  FIG. 3 shows an arrangement example of the audio output means 230 or the notification unit. In the example of FIG. 3, the audio output means 230 of FIG. 1 is composed of left and right speakers, which are parts of a mobile terminal. In other words, for example, a portable terminal having a Bluetooth (registered trademark) communication module cooperates with a car navigation apparatus having a Bluetooth (registered trademark) communication module, and the left and right speakers of the portable terminal output sound instead of the in-vehicle speaker. it can. The display panel 410 of the portable terminal can display characters, images, and the like instead of or in addition to the voice.

  FIG. 4 shows an example of an image (internal image) generated by the in-vehicle camera 70 when a predetermined situation change of a person (user, passenger) occurs. The image generated by the in-vehicle camera 70 includes an adult male driver (driver seat in the first seat row) and an adult woman (passenger seat in the first seat row). Smiling. The storage unit 60 can store not only an external image (for example, scenery) at an optimal moment, but also an internal image (for example, a state inside a vehicle room) at an optimal moment.

  FIG. 5 shows a configuration example of a moving image stored in the storage unit 60 of FIG. In the example of FIG. 5, the time T represents the time when a predetermined situation change of a person is detected. As shown in FIG. 5, the primary storage means 50 of FIG. 1 can record a series of external images and / or a series of internal images, and the storage means 60 of FIG. Only a part of the series of external images and only a part of the series of internal images corresponding to the time from 15 to the time 15 seconds after the time T can be stored. In the example of FIG. 5, the image stored in the storage unit 60 is, for example, a moving image for 20 seconds (external moving image and / or internal moving image), but the time for storing the moving image is not limited to 20 seconds. The storage unit 60 may store a moving image for, for example, 20 seconds after the time T, or may store a still image (an external still image and / or an internal still image) triggered by the time T. The display device 110 or the car navigation device in FIG. 1 can display an image (moving image, still image) in the storage unit 60.

  FIG. 6 is a flowchart showing an operation example of the vehicle imaging apparatus of FIG. In the example of FIG. 6, the vehicle position detection unit 25 detects the position of the vehicle from, for example, a GPS signal (step ST01), and sends the vehicle position to the determination condition setting unit 15. The determination condition setting unit 15 refers to, for example, the internal memory or the storage unit 60 of the determination condition setting unit 15 and determines whether or not the determination condition is set by the user (step ST02). When the determination conditions (r, a, x, b) are set in advance by the user, the determination condition setting unit 15 uses the determination conditions (step ST03). Alternatively, when the determination condition is not set in advance by the user, the determination condition (default value, initial value) set for each travel area is used.

  In the example of FIG. 6, the determination condition setting unit 15 determines the travel area of the vehicle from the position of the vehicle and, for example, map information (step ST04). Here, the map information is stored in, for example, an internal drive (not shown) of the car navigation apparatus or the storage unit 60, and a certain position (for example, latitude and longitude) is any one of, for example, a sightseeing spot, an urban area, and general (others). Information that can be used to determine whether or not an indication is given. In other words, the determination condition setting unit 15 can search the travel information area corresponding to the position of the vehicle in the map information database. For example, when the vehicle travels through a sightseeing spot, the determination condition setting means 15 includes a radius r = 2 [km], a first threshold value a = 20 [pieces], a travel route x = 1 [km], and a first threshold value b. = 10 [pieces] is set as a determination condition (step ST05).

  In the example of FIG. 6, the determination condition setting means 15 can prepare two types of determination areas. Specifically, the determination condition setting unit 15 can prepare, for example, a perfect circle area with a radius r as a center area centered on the position of the vehicle. Further, the determination condition setting unit 15 can prepare, for example, a road peripheral region from the vehicle position to the travel route x as a route region based on the route from the vehicle position to the destination. The determination condition setting means 15 sends the prepared determination areas (perfect circle area, road peripheral area) to the imaging position acquisition means 35.

  In the example of FIG. 6, the shooting position acquisition unit 35 transmits a determination region specified by, for example, latitude and longitude to, for example, an SNS server (communication device) on the Internet, and the SNS server captures a photograph taken in the determination region. The photographing position is searched from the photographing position database of the storage device 300, and the photographing position acquisition unit 35 can receive the photographing position of the photograph taken in the determination area from the SNS server (step ST06). The shooting position determination unit 30a groups the shooting positions of photos within a predetermined distance with respect to the photos shot in the determination area acquired via the shooting position acquisition unit 35 (step ST07). Since the scenic point is determined based on the grouped photographing positions or the collective photographing positions, the scenic point can be specified more accurately. In addition, since it is not necessary to acquire or count the number of shooting positions that are not grouped, it is possible to reduce the processing load of the vehicle imaging device.

  In the example of FIG. 6, the shooting position determination unit 30a determines whether or not the number of grouped shooting positions is equal to or greater than a predetermined number (step ST08). When the number of grouped shooting positions is equal to or greater than the predetermined number, the determination condition setting unit 15 determines whether or not the car navigation device is guiding the vehicle to the destination (step ST09). When the vehicle is guided to the destination, the determination condition setting means 15 determines the road peripheral area as the determination area, and the shooting position determination means 30a has the first shooting position grouped in the road peripheral area. It is determined whether or not it is equal to or greater than a threshold value (a = 20 [for example]) (step ST10).

  In the example of FIG. 6, when the number of shooting positions grouped in the road peripheral region is equal to or larger than the first threshold (a = for example, 20 [pieces]), the situation change determination unit 30b uses the second threshold (smile). For example, the threshold value is set to a range of “medium” among “large”, “medium”, and “small” (step ST11). On the other hand, when the number of shooting positions grouped in the road peripheral region is not equal to or greater than the first threshold (b = 10 [pieces]), the situation change determination unit 30b sets the second threshold (smile threshold) to, for example, “ A range of “large” among “large”, “medium” and “small” is set (step ST12). As described above, when the number of shooting positions grouped in the road peripheral region is equal to or larger than the first threshold (b = for example, 10 [pieces]), the situation change determination unit 30b sets the second threshold to “medium”. Can be reduced to a range of.

  In step ST06, when the vehicle is not guided to the destination, the determination condition setting unit 15 determines a perfect circle region as the determination region, and the shooting position determination unit 30a has the number of shooting positions grouped in the perfect circle region. It is determined whether or not it is equal to or greater than a first threshold value (a = for example, 20 [pieces]) (step ST13). When the number of shooting positions grouped in the perfect circle region is equal to or greater than the first threshold (a = 20 [pieces]), the situation change determination unit 30b sets the second threshold (smile threshold) to, for example, “large” ”,“ Medium ”, and“ small ”are set in the“ medium ”range (step ST14). On the other hand, when the number of shooting positions grouped in the perfect circle region is not equal to or greater than the first threshold (a = 20 [pieces]), the situation change determination unit 30b sets the second threshold (smile threshold) to, for example, “ A range of “large” among “large”, “medium” and “small” is set (step ST12).

  In the example of FIG. 6, the situation change determination unit 30b calculates a parameter indicating the smile of the occupant (step ST15), and determines whether the smile parameter is greater than or equal to a second threshold (smile threshold) (step ST16). ), A trigger signal is generated when the smile parameter is equal to or greater than the second threshold (smile threshold) (step ST17). In response to this, the primary storage unit 50 can store, for example, a part of a series of images in the storage unit 60 based on the trigger signal (step ST18).

  In the example of FIG. 6, for example, step ST07 and step ST08 may be omitted. In this case, when the vehicle is guided to the destination in step ST10, the determination condition setting unit 15 selects the road peripheral region as the determination region. The shooting position determination means 30a determines whether or not the number of shooting positions that have been shot in the past in the road peripheral area and are not grouped is equal to or greater than a first threshold (b = 10 [pieces]). You may judge. Similarly, in step ST13, it may be determined whether or not the number of shooting positions not grouped is equal to or greater than a first threshold value (a = 20 [pieces]).

  FIG. 7 shows an example of traveling of the vehicle. In the example of FIG. 7, for example, a temple is illustrated as the scenic point, and the vehicle approaches the scenic point from time t1 to time t3. In addition, the vehicle passes the scenic point at time t4. In addition, shooting positions surrounded by dotted circles around the temple indicate grouped shooting positions, while shooting positions not surrounded by dotted circles indicate ungrouped shooting positions. Yes.

  8A, FIG. 8B, FIG. 8C, and FIG. 8D are respectively times t1, t2, t3, and t4 of FIG. 7 in which a vehicle that is not guided to the destination travels through the sightseeing spot. An example of setting the determination area in FIG. In the example of FIG. 8A, since the number of shooting positions is zero in the perfect circle region (first determination region), the second threshold value (smile threshold value) is maintained as it is (see step ST08 in FIG. 6). . In the example of FIG. 8B, the number of shooting positions (in the first group) grouped in the perfect circle area (first determination area) is equal to or greater than the first threshold (a = for example, 20 [pieces]). Therefore, the second threshold (smile threshold) is set in the “medium” range (see step ST14). In the example of FIG. 8C and the example of FIG. 8D, the second threshold value (smile threshold value) is set in the “medium” range (see step ST14).

  However, at time t4 shown in the example of FIG. 8D, since the vehicle passes the scenic point, the determination condition setting unit 15 considers the traveling direction of the vehicle, The semicircular area (second determination area) on the traveling side of the vehicle in the determination area) is fixed, and the shooting positions (of the first group) grouped in the semicircular area (second determination area) are determined. Step ST13 in FIG. 6 may be changed so as to determine whether or not the number is equal to or greater than a first threshold (a = for example, 20 [pieces]) (see step S13-1 in FIG. 12 described later). . In addition, the first threshold (a = for example 20 [pieces]) may be changed to a ratio (for example, 1/3) of the number of grouped (first group) shooting positions. It can be appropriately determined whether or not the vehicle has passed the scenic point (see step S13-1 in FIG. 12 described later).

  In addition, since there is a high building between the vehicle and the scenic point at time t2 shown in the example of FIG. 8B, the determination condition setting unit 15 searches the map information database for the presence or absence of an obstruction. If there is an obstacle, step ST13 in FIG. 6 may be changed so that the second threshold (smile threshold) is set in the range of “large” (step in FIG. 12 described later). (See S13-2).

  9 (A), 9 (B), 9 (C) and 9 (D) respectively show the times t1, t2, t3 in FIG. 7 when the vehicle guided to the destination travels through the sightseeing spot. An example of setting the determination area at t4 is shown. When the vehicle is guided to the destination, the determination area is already determined in consideration of the traveling direction of the vehicle. Therefore, at the time t4 shown in the example of FIG. 9D, the number of shooting positions (in the first group) grouped in the road peripheral area (determination area) is the first threshold (b = for example 10 [pieces]. ]), The second threshold (smile threshold) is not set in the “medium” range (see step ST12 in FIG. 6). However, at this time, the first threshold (b = 10 [number], for example) may be changed to a ratio (for example, 1/3) of the number of grouped (first group) shooting positions, In this case, it can be appropriately determined whether or not the vehicle has passed the scenic point (see step S13-1 in FIG. 12 described later).

  Similarly, since there is a tall building between the vehicle and the scenic point at time t2 shown in the example of FIG. 9B, the determination condition setting unit 15 searches the map information database for the presence or absence of the shielding object. Then, when there is an obstacle, step ST11 in FIG. 6 may be changed so that the second threshold (smile threshold) is set in the range of “large” (FIG. 12 described later). (See Step S13-2).

  FIG. 10 shows another schematic configuration diagram of the vehicle imaging device according to the present invention. In the example of FIG. 10, the in-vehicle camera 70 does not need to be used as a detection unit. In other words, the vehicle imaging device may not include a detection unit that detects a predetermined change in the situation of a person (user, occupant). Therefore, the determination unit 30 of FIG. 1 may be configured only by the shooting position determination unit 30a. In other words, the vehicular imaging apparatus determines whether or not the number of shooting positions of photographs taken in the past in a determination area around the position of the vehicle by a plurality of contributors is equal to or more than the first threshold value. Can be provided. In addition, the determination unit can generate a trigger signal when the number of photo shooting positions is equal to or greater than the first threshold.

  In general, when there are many photographs taken by a plurality of contributors in the past, the photographing position of the photographs may be a scenic point for the user of the vehicle imaging device. Therefore, it is preferable to store an image generated by the imaging unit when the vehicle is approaching such a shooting position.

  FIG. 11 is a flowchart showing an operation example of the vehicle imaging device of FIG. The vehicle imaging device can omit, for example, steps ST11, ST12, ST14, ST15, and ST16 of FIG.

  In the example of FIG. 1 and the example of FIG. 10, the vehicular imaging device may not include the primary storage unit 50. In other words, the imaging unit configured by the in-vehicle camera 70 and / or the outside camera 40 does not need to continuously capture the inside and / or outside of the vehicle to generate a series of images, When the number of photo shooting positions is equal to or greater than the first threshold value, the inside and / or outside of the vehicle may be picked up according to the trigger signal to generate an image. In this case, the storage means 60 picks up the image according to the trigger signal. The processed image may be stored. As described above, when the vehicle approaches the scenic point, the vehicle imaging device can automatically capture the inside and / or the outside of the vehicle and automatically store the generated image.

  By the way, in the example of FIG. 10, for example, the vehicle imaging device does not need to include the imaging unit (the in-vehicle camera 70 and / or the in-vehicle camera 40), and therefore the storage unit (storage unit 60) and the display device 110 are also included. There is no need to prepare. In other words, the vehicular imaging device can be constructed as a photographing assisting device, and the photographing assisting device includes a detection unit (vehicle position detecting means 25) for detecting the position of the vehicle, and the position of the vehicle by a plurality of contributors. A determination unit (capturing position determination unit 30a) that determines whether the number of shooting positions of a photograph taken in the past in a determination area around the first threshold is greater than or equal to a first threshold, and the number of shooting positions of the photograph And a notification unit (speech output unit 230) that notifies the user of notification information based on a signal indicating that the threshold value is 1 or more.

  In general, when there are many photographs taken by a plurality of contributors in the past, the photographing position of the photographs may be a scenic point for the user of the imaging assistance device. Therefore, it is preferable to notify the user of notification information when the vehicle is approaching such a shooting position. Thereby, when a vehicle passes a scenic point, possibility that a user will miss a scenic point becomes low, and the user can image the image of a scenic point with favorable timing.

  FIG. 12 is a flowchart showing an operation example of the imaging assistance device according to the present invention. For example, the imaging assisting device can omit steps ST11, ST12, ST14, ST15, and ST16 of FIG. 6, and executes step S18 ′ instead of step ST18. In addition, the imaging assistance device may execute not only step ST13 but also steps ST13-1 and ST13-2.

  When the imaging assisting device executes steps ST13-1 and ST13-2, for example, in the example of FIG. 8A, the number of shooting positions in the perfect circle region (first determination region) is zero. (Smile threshold) is maintained as it is (see step ST08 in FIG. 12).

  For example, in the example of FIG. 8B, the number of shooting positions (in the first group) grouped in the perfect circle area (first determination area) is the first threshold value (a = 20 [pieces]). Because of the above (see step ST13 in FIG. 12), the first threshold value (a = 20 [for example]) is a ratio (for example, 1/3) of the number of grouped (first group) shooting positions. ). After that, the number of shooting positions (in the first group) grouped in the semicircular area (second determination area) in consideration of the traveling direction of the vehicle is the first threshold (of the shooting position in the first group). Since it is equal to or more than 1/3 of the number (see step ST13-1 in FIG. 12), the determination condition setting means 15 searches the map information database for the presence / absence of the shielding object, and the shielding object exists (FIG. 12). Step ST13-2), the trigger signal is not generated, and the imaging auxiliary device does not notify the user of the notification information.

  For example, in the example of FIG. 8C, when there is no shielding object (see step ST13-2 in FIG. 12), a trigger signal is generated (see step ST17 in FIG. 12), and the imaging assisting device reports information (vehicle Is approaching the scenic point) to the user (see step ST18 ′ in FIG. 12).

  For example, in the example of FIG. 8D, the number of shooting positions (in the first group) grouped in a semicircular area (second determination area) in which the traveling direction of the vehicle is considered is the first threshold ( Since it is not equal to or more than 1/3 of the number of shooting positions of the first group (see step ST13-1 in FIG. 12), the trigger signal is not generated, and the imaging assisting device ends the notification to the user.

  The present invention is not limited to the above-described exemplary embodiments, and those skilled in the art will be able to easily modify the above-described exemplary embodiments to the extent included in the claims. .

  DESCRIPTION OF SYMBOLS 14 ... Inner rear view mirror, 15 ... Determination condition setting means (setting part), 16 ... Dashboard, 25 ... Vehicle position detection means (detection part), 30 ... Determination means (determination part) / Processing unit), 30a... Shooting position determination means, 30b... Situation change determination means, 35... Shooting position acquisition means (acquisition part), 40. ..Primary storage means (imaging part / storage part / processing part), 60... Storage means (storage part), 70 .. in-vehicle camera (imaging part / detection part), 110... Display device (display) Part / guide part), 230 ... voice output means (notification part), 240 ... operation means (operation part), 130 ... vehicle room, 131 ... ceiling part, 300 ... photographing position Storage device (database), 410... Display panel (display unit / notification unit)

Claims (8)

An imaging unit that captures an image of the inside and / or outside of a vehicle room that is running and generates an image ;
A detection unit for detecting a position of pre-Symbol vehicle,
Shooting for determining whether or not the number of shooting positions of photographs taken in the past by a plurality of contributors in the determination area around the position of the vehicle detected by the detection unit is greater than or equal to a first threshold value A position determination unit;
A detection unit for detecting a change in a situation of a person inside the room;
A situation change determination unit that determines whether a parameter indicating the situation change detected by the detection unit is equal to or greater than a second threshold ;
A storage unit that stores the image generated by the imaging unit when the parameter is determined to be greater than or equal to the second threshold by the situation change determination unit ;
With
The status change determination unit, when said number of said photographing position by the imaging position determining unit determines that the is the first threshold value or more, the first of the compared with the case is less than the threshold a second threshold An imaging apparatus for a vehicle characterized in that the determination is made with lowering. 2. The vehicular imaging apparatus according to claim 1, wherein the situation change determination unit determines whether or not the parameter indicating the facial expression change or behavior change of the person is equal to or greater than the second threshold value . The vehicle imaging apparatus according to claim 1 or 2, further comprising a setting unit that sets the determination area and / or the first threshold value based on the position of the vehicle. The vehicle imaging apparatus according to claim 1 or 2, further comprising a setting unit that sets the determination area and / or the first threshold value based on the operation signal of the person. If the vehicle is guided to the destination, the setting unit, according to claim 3 or 4, characterized in that to set the determination region along the path to the position placed et the destination of the vehicle An imaging device for a vehicle. If the vehicle is not guided to their destinations, the setting unit for a vehicle according to claim 3 or 4, characterized in that sets the determination area based on the center region around the position of the vehicle Imaging device. The imaging position determining section, any one of claims 1 to 6, wherein the determining whether the number of the previous SL photographing position grouped located within a predetermined distance is equal to or greater than the first threshold value The vehicle imaging device according to Item. The imaging unit generates the image as a series of images,
The storage unit, the series of vehicle imaging apparatus according to any one of claims 1 to 7, characterized in that the storing part of the image.

Images