JP2018132320A - On-vehicle system, on-vehicle device, program and method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an on-vehicle device which can image boarding people which board on a vehicle and an imaging object outside the vehicle.SOLUTION: The on-vehicle device 10 comprises a processing unit 11 which acquires position of the imaging object outside the vehicle and determines if it is possible to image the boarding people and the imaging object on the basis of positional relationship between optical axis direction of an imaging unit 21 acquiring a picture image and the imaging object outside the vehicle and causes the imaging unit 21 to image the picture image containing the boarding people and the imaging object if it is possible to image and output units 13,16 which output the imaged picture image.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an in-vehicle system, an in-vehicle device, a program, and a method.

  2. Description of the Related Art Conventionally, there are cases where a scene outside a vehicle is imaged from the interior of a vehicle when the user is on a vehicle and moving around a sightseeing spot.

  In a car running in a scenic area, when a passenger other than the person driving the vehicle captures an image so that the passenger and an imaging object such as a mountain outside the car are included in one image There is.

  Since the in-vehicle device having the navigation function has map information on which the vehicle is traveling, it can be determined that the vehicle is traveling in a region with a good scenery outside the vehicle such as a sightseeing spot.

  For example, Patent Document 1 proposes a vehicular video recording device that records a video outside the vehicle when the vehicle is traveling within a predetermined distance from a tourist spot.

JP 2011-28651 A

  However, the technique disclosed in Patent Document 1 described above does not disclose that the passenger on the vehicle and the imaging object outside the vehicle are imaged simultaneously.

  This specification makes it a subject to provide the vehicle-mounted system, vehicle-mounted apparatus, program, and method which can image the passenger who is boarding the vehicle, and the imaging target object outside a vehicle.

  According to the in-vehicle system disclosed in the present specification, the position of an imaging unit that acquires an image and an imaging target outside the vehicle is acquired, and based on the positional relationship between the optical axis direction of the imaging unit and the imaging target outside the vehicle. A processing unit that determines whether the passenger and the imaging object can be imaged, and when the imaging is possible, causes the imaging unit to capture an image including the passenger and the imaging object, and an output unit that outputs the captured image. .

  According to the in-vehicle device disclosed in the present specification, the position of the imaging object outside the vehicle is acquired, and based on the positional relationship between the optical axis direction of the imaging unit that acquires the image and the imaging object outside the vehicle, A processing unit that determines whether or not an imaging target can be captured, and causes the imaging unit to capture an image including a passenger and the imaging target when imaging is possible, and an output unit that outputs the captured image.

  Further, according to the program disclosed in the present specification, the position of the imaging object outside the vehicle is acquired, the optical axis direction of the imaging unit that acquires the image, and the positional relationship between the imaging object outside the vehicle. The processor is configured to determine whether an image including the passenger and the imaging target can be captured, and to capture an image of the passenger and the imaging target using the imaging unit when the imaging is possible.

  Furthermore, according to the method disclosed in the present specification, the position of the imaging target object outside the vehicle is acquired, the optical axis direction of the imaging unit that acquires the image, and the positional relationship between the imaging target object outside the vehicle. Determining whether an image including the passenger and the imaging object can be captured, and capturing an image including the passenger and the imaging object using the imaging unit when imaging is possible.

  According to the above-described in-vehicle system disclosed in the present specification, it is possible to capture an image of a passenger on the vehicle and an imaging object outside the vehicle.

  According to the vehicle-mounted device disclosed in the present specification described above, it is possible to capture an image of an occupant on the vehicle and an imaging object outside the vehicle.

  Further, according to the above-described program disclosed in the present specification, it is possible to capture an image of a passenger on the vehicle and an imaging object outside the vehicle.

  Furthermore, according to the method disclosed in the present specification described above, it is possible to capture an image of a passenger on the vehicle and an imaging object outside the vehicle.

FIG. 1 illustrates one embodiment of a system disclosed herein. It is a hardware block diagram of the vehicle-mounted apparatus disclosed to this specification. It is a figure explaining an imaging target object table. It is a figure explaining the optical axis direction of the imaging device arrange | positioned at a vehicle. It is a figure explaining determining whether a passenger and an imaging subject can be imaged. It is a figure explaining an imaging possible area, an imaging recommendation area, and an imaging non-recommended area. It is a figure explaining the memory | storage part of a server. It is a sequence diagram explaining operation | movement of a system. It is a figure which shows the screen which selects an imaging area. It is a figure which shows the screen which selects imaging mode. It is a flowchart (the 1) explaining operation | movement of a vehicle-mounted apparatus. It is a flowchart (the 2) explaining operation | movement of a vehicle-mounted apparatus. It is a figure which shows the screen which notifies imaging. It is a figure which shows the image which imaged the passenger and the imaging target object. It is a figure which shows the other form of a vehicle-mounted apparatus.

  Hereinafter, a preferred embodiment of the system disclosed in the present specification will be described with reference to the drawings. However, the technical scope of the present invention is not limited to these embodiments, but extends to the invention described in the claims and equivalents thereof.

  FIG. 1 is a diagram illustrating one embodiment of a system disclosed in this specification.

  The system 1 according to the present embodiment includes an in-vehicle device 10 mounted on a vehicle, and a server 40 that is communicably connected to the in-vehicle device 10 via a network N.

  The in-vehicle device 10 obtains an imaging position at which an image of an occupant on the vehicle and an imaging object outside the vehicle can be imaged on a route traveled by the vehicle on which the in-vehicle device 10 is mounted. Take images so that they are included in one image.

  The server 40 stores imaging object information including position information of the imaging object. The server 40 transmits imaging object information to the in-vehicle device 10 via the network N. The in-vehicle device 10 obtains an imaging position where the passenger and the imaging object outside the vehicle can be imaged on the route to the destination based on the imaging object information received from the server 40.

  Examples of the imaging object include natural objects such as the sea, mountains, and valleys, and artificial landmarks such as towers and buildings. In the server 40, the imaging target object information is updated as needed.

  Examples of the vehicle on which the in-vehicle device 10 is mounted include a vehicle having four or more wheels such as an automobile, a light vehicle such as a motorcycle, and a bicycle. In the present embodiment, the in-vehicle device is mounted on an automobile.

  Next, the in-vehicle device 10 will be described in detail below.

  FIG. 2 is a hardware configuration diagram of the in-vehicle device 10.

  The in-vehicle device 10 includes a processing unit 11, a storage unit 12, a display unit 13, an operation unit 14, an acoustic output unit 15, a communication unit 16, and imaging devices 20a to 20d.

  The processing unit 11 includes one or a plurality of processors and peripheral circuits. The processing unit 11 performs control and various processing of each hardware component of the in-vehicle device 10 according to a predetermined program 12a stored in advance in the storage unit 12, and temporarily stores data generated during the processing. The storage unit 12 is used.

  The processing unit 11 includes an optical axis direction determination unit 11a, an imaging target object setting unit 11b, a navigation unit 11c, and an imaging determination unit 11d.

  Each of these units included in the processing unit 11 is, for example, a functional module realized by a computer program that operates on a processor included in the processing unit 11. Each of these units included in the processing unit 11 may be mounted on the in-vehicle device 10 as a separate circuit. The description of each part will be described later.

  The storage unit 12 may include a semiconductor memory such as a random access memory (RAM) or a read only memory (ROM), or a nonvolatile memory such as a magnetic disk or a flash memory. The storage unit 12 may use a disk drive (not shown) as a drive that can read a non-temporary storage medium that stores the predetermined program 12a.

  The storage unit 12 stores a predetermined program 12a, map data 12b, image data 12c, an imaging object table 12d, an imaging recommended area table 12e, and an imaging non-recommended area table 12f.

  FIG. 3 is a diagram illustrating the imaging target table.

  The imaging object table 300 registers an imaging object identification information field 301 in which identification information for identifying an imaging object is registered, a name field 302 in which the name of the imaging object is registered, and position information of the imaging object. The position information column 303 is provided. The position information of the imaging object registered in the position information column 303 may be represented by a single point in the coordinates on the map, or may be represented as a region having a predetermined area. The position information of the object to be imaged is expressed in a two-dimensional map coordinate system that represents the route of the vehicle in the map data.

  The map data 12b, the image data 12c, the recommended imaging area table 12e, and the non-imaging area table 12f will be described later.

  The display part 13 is arrange | positioned at the center console, for example, is controlled by the process part 11, and can display the various information accompanying operation | movement of the vehicle-mounted apparatus 10. FIG. For example, a liquid crystal display can be used as the display unit 13.

  The operation unit 14 is operated by a passenger and can input an operation. The in-vehicle device 10 can use, for example, a touch panel formed integrally with the display unit 13 as the operation unit 14.

  The sound output unit 15 has a speaker (not shown), and is controlled by the processing unit 11 to output sound.

  The communication unit 16 transmits and receives information to and from the server 40 via the network N using wireless communication. The communication unit 16 is connected to the network N via a base station in accordance with a predetermined communication standard such as 3GPP (Third Generation Partnership Project) or LTE (Long Term Evolution). The communication unit 16 communicates with the imaging devices 20a to 20d. Furthermore, the communication unit 16 is connected to an in-vehicle network (Controller Area Network: compliant with CAN) mounted on the vehicle. For example, the processing unit 11 uses the communication unit 16 to receive a vehicle signal indicating the vehicle speed via the CAN. The communication unit 46 may include a communication circuit that performs transmission and reception and a communication line or antenna.

  In addition, position information indicating the position of the vehicle is input to the in-vehicle device 10 from the GPS information receiving unit 30 mounted on the vehicle. The GPS information receiving unit 30 receives the GPS radio wave transmitted by the GPS artificial satellite, obtains the position of the vehicle, and outputs the position information of the vehicle to the in-vehicle device 10.

  The navigation unit 11c of the processing unit 11 has a navigation function. The navigation unit 11 c is a functional module that is realized by using the map data 12 b that is also stored in the storage unit 12 by executing the program stored in the storage unit 12, and the vehicle current acquired from the GPS information receiving unit 30. The route guidance to the destination is performed based on the position of. Based on the map data 12b stored in the storage unit 12 and the position of the vehicle, the processing unit 11 generates a map image and voice guidance information indicating a map around the vehicle. Further, when the destination is set by the passenger, the processing unit 11 derives a route from the current vehicle position to the destination and superimposes the route on the map image. The map image generated by the processing unit 11 is displayed on the display unit 13. The voice guidance information generated by the navigation unit 11 c is output from the acoustic output unit 15.

  Next, the imaging devices 20a to 20d will be described in detail below.

  The imaging devices 20 a to 20 d include an imaging unit 21 and an optical axis adjustment unit 22.

  The imaging unit 21 has a predetermined optical axis direction, and the optical axis direction can be set using the optical axis adjustment unit 22 so as to capture the outside of the vehicle including passengers in the vehicle. The imaging unit 21 has a predetermined range of viewing angles with the optical axis direction as the center, and can capture a subject within the range of viewing angles.

  The imaging unit 21 includes, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The imaging unit 21 images a subject to generate image data, and transmits the generated image data to the in-vehicle device 10. The processing unit 11 of the in-vehicle device 10 stores the received image data 12c in the storage unit 12. The processing unit 11 of the in-vehicle device 10 can output the received image data 12c to the display unit 13 and display it.

  The optical axis adjustment unit 22 is operated by a vehicle occupant and adjusts the optical axis direction of the imaging unit 21 and the magnification of the image. While the imaging unit 21 is imaging the subject, the vehicle occupant uses the optical axis adjustment unit 22 while confirming the image on the display unit 13 and uses the optical axis adjustment unit 22 and the image enlargement ratio. Adjust. Note that the optical axis adjustment unit 22 may be performed using the operation unit 14 of the in-vehicle device 10.

  The optical axis adjustment unit 22 transmits movement amount information in the optical axis direction indicating the movement amount in the optical axis direction moved by the adjustment to the in-vehicle device 10 with reference to the optical axis direction of the imaging unit 21 in the initial state. The optical axis direction determination unit 11a of the processing unit 11 of the in-vehicle device 10 is based on the received movement amount information of the imaging unit 21 in the optical axis direction, and the vehicle coordinate system in which the optical axis direction of the imaging unit 21 is fixed to the vehicle. To determine. That is, the optical axis direction of the imaging unit 21 is expressed in the vehicle coordinate system. The vehicle coordinate system will be described later with reference to FIG.

  FIG. 4 is a diagram illustrating the optical axis direction of the imaging device arranged in the vehicle.

  In the vehicle compartment of the vehicle 50, four imaging devices 20a to 20d are arranged.

  The optical axis direction A1 is set so that the imaging unit 21 of the imaging device 20a captures images of the passenger 51a sitting in the driver's seat and the outside of the vehicle. The imaging device 20a is disposed, for example, inside an A pillar (not shown) on the left side of the vehicle 50.

  The image pickup unit 21 of the image pickup apparatus 20b is set in the optical axis direction A2 so as to pick up images of the passenger 51b sitting in the passenger seat and the outside of the vehicle. The imaging device 20b is disposed, for example, inside an A pillar (not shown) on the right side of the vehicle 50.

  The imaging unit 21 of the imaging device 20c is set with the optical axis direction A3 so as to capture the image of the passenger 51c sitting behind the driver's seat and the outside of the vehicle. The imaging device 20c is disposed, for example, behind the driver's seat.

  The image pickup unit 21 of the image pickup apparatus 20d is set with the optical axis direction A4 so as to pick up images of the passenger 51d sitting behind the passenger seat and the outside of the vehicle. The imaging device 20d is disposed, for example, behind the passenger seat.

  The optical axis direction A1 of the imaging device 20a is expressed in a vehicle coordinate system S fixed to the vehicle. Similarly, the optical axis directions A2 to A4 of the other imaging devices 20b to 20d are also expressed in the vehicle coordinate system S.

  In the present embodiment, the vehicle coordinate system S is a two-dimensional rectangular coordinate system having an origin O fixed to the vehicle and an X-axis direction and a Y-axis direction. The vehicle coordinate system S may be a three-dimensional coordinate system. In this case, the optical axis directions A1 to A4 are also expressed in the three-dimensional coordinate system.

  Next, whether or not the imaging determination unit 11d of the processing unit 11 of the in-vehicle device 10 can capture the passenger and the imaging object based on the positional relationship between the optical axis direction of the imaging unit 21 and the imaging object outside the vehicle. The process for determining whether will be described below.

  FIG. 5 is a diagram for explaining whether it is possible to image the passenger and the imaging object.

  The imaging determination unit 11d is configured such that, on the path 70 along which the vehicle 50 on which the vehicle-mounted device 10 is mounted travels, the passenger and the optical axis direction A1 of the imaging device 20a cross the position of the imaging target object 60. It is determined that the imaging object can be imaged. Thereby, a passenger and an imaging target object can be imaged at the timing most suitable for imaging. Here, when the position information of the imaging object 60 is represented as an area having a predetermined area on the map, it is determined that imaging is possible in an area on the predetermined route along which the vehicle 50 travels. There is a case.

  The Y-axis direction of the vehicle coordinate system S coincides with the traveling direction of the vehicle in the two-dimensional map coordinate system representing the route to the destination. For example, the Y-axis direction of the vehicle coordinate system S may match the direction in which the route along which the vehicle 50 is traveling extends. The imaging determination unit 11d converts the optical axis direction A1 of the imaging device 20a expressed in the vehicle coordinate system S into a map coordinate system. Then, the imaging determination unit 11d obtains the position on the vehicle path 70 when the optical axis direction A1 of the imaging device 20a expressed in the map coordinate system intersects the position of the imaging target 60 as an imaging possible region. . Specifically, the imaging determination unit 11d checks whether or not a straight line extending in the optical axis direction A1 from the position of the imaging device 20a of the vehicle 50 intersects the imaging object 60 on the map. The obtained imageable area may be a point on the route 70 or may be a part of a predetermined range on the route 70.

  As described above, the optical axis direction A1 of the imaging device 20a is set so as to capture the outside of the vehicle including the passenger 51a in the driver's seat, so that an image captured by the imaging device 20a in the imageable region is The passenger 51a and the imaging object 60 outside the vehicle are imaged so as to be included in one image.

  The above description of the imageable area using the imaging device 20a is also applied as appropriate to the other imaging devices 20b to 20d.

  Next, the imageable area, the recommended imaging area, and the non-recommended imaging area will be further described below.

  FIG. 6 is a diagram illustrating an imageable area, an imaging recommended area, and an imaging non-recommended area.

  As described above, the imageable area is a position on the path when the optical axis direction of the imaging devices 20a to 20d expressed in the map coordinate system intersects the position of the imaging target on the path.

  In the example illustrated in FIG. 6, the imaging determination unit 11 d determines that the imaging device 20 a mounted on the vehicle 50 has the imageable region R in a predetermined range on the route 70. The imageable area R is an area including an imaging recommended area R2 and imaging non-recommended areas R1 and R3 described later. As shown in FIG. 6, when the path is curved so as to turn around the imaging object 60, there may be a case where the imageable region R is in a predetermined range on the path 70.

  The imaging determination unit 11d may record an image using the imaging device 20a in the imageable region R, or may capture an image at a predetermined interval.

  The imageable region R is usually a portion of a route 70 over which the imaging object 60 can be seen from the position where the vehicle 50 travels.

  In the example illustrated in FIG. 6, imaging non-recommended areas R <b> 1 and R <b> 3 in which it is not recommended to image the imaging object 60 outside the vehicle are set on the route 70 on which the vehicle 50 on which the in-vehicle device 10 is mounted travels. ing.

  In the imaging non-recommended region R1, an obstacle 80 such as a fence is located between the route 70 and the imaging object 60. Therefore, when the imaging device 20a captures an image from within the vehicle, the passenger and the imaging object 60 Since the obstacle 80 appears in between, there is a possibility that the imaging object 60 outside the vehicle cannot be imaged.

  Further, in the imaging non-recommended region R3, an obstacle 81 such as a building is located between the route 70 and the imaging target 60. Therefore, when the imaging device 20a captures an image from within the vehicle, the passenger and the imaging target 60 Since there is an obstacle 81 between them, there is a possibility that the imaging object 60 outside the vehicle cannot be imaged.

  On the other hand, between the imaging non-recommended region R1 and the imaging non-recommended region R3, an imaging recommended region R2 that is recommended to image the imaging object 60 outside the vehicle is set.

  The imaging recommended region R2 is a portion on the route 70 where the imaging object 60 outside the vehicle is expected to be beautifully captured. The imaging recommendation region R2 is a so-called viewpoint.

  The recommended imaging area information including the position information of the recommended imaging area R2 on the route 70 is registered in the recommended imaging area table 12e of the storage unit 12 of the in-vehicle device 10. In the imaging recommendation area table 12e, identification information for identifying the imaging recommendation area R2 and position information on the path 70 of the imaging recommendation area R2 are associated and registered.

  Further, the imaging non-recommended area information including the position information on the route 70 of the imaging non-recommended areas R1 and R3 described above is registered in the imaging non-recommended area table 12f of the storage unit 12 of the in-vehicle device 10. In the imaging non-recommended area table 12f, identification information for identifying the imaging non-recommended areas R1 and R3 and position information on the path 70 of the imaging non-recommended areas R1 and R3 are associated and registered.

  In the example illustrated in FIG. 6, the imageable region R includes a region R4 that is neither an imaging recommendation region nor an imaging recommendation region between the imaging non-recommended region R3 and the imaging recommended region R2. In the region R4, the optical axis direction A1 of the imaging device 20a intersects the position of the imaging target.

  In the example illustrated in FIG. 6, the imageable area, the recommended imaging area, and the non-recommended imaging area that are determined to be imageable with respect to the imaging device 20a have been described. The description of FIG. 6 described above is also appropriately applied to the other imaging devices 20b to 20d.

  Next, the server 40 will be described in detail below.

  The server 40 includes a processing unit 41, a storage unit 42, and a communication unit 43.

  The processing unit 41 includes one or a plurality of processors and peripheral circuits. The processing unit 41 controls each hardware component of the server 40 and performs various processes according to a predetermined program stored in the storage unit 42 in advance, and stores the data generated during the processing temporarily. 42 is used. Note that the number of servers is not limited to one. The operation of the server may be realized by cooperation of a plurality of servers that are communicably connected via the network N.

  The storage unit 42 may include a semiconductor memory such as a random access memory (RAM) or a read only memory (ROM), or a nonvolatile memory such as a magnetic disk or a flash memory. The storage unit 42 may use a disk drive (not shown) as a drive that can read a non-temporary storage medium that stores a predetermined program.

  FIG. 7 is a diagram illustrating the storage unit of the server.

  The storage unit 42 stores a server imaging object table 42a, a server imaging recommended area table 42b, and a server imaging non-recommended area table 42c.

  In the server imaging target table 42a, the name of the imaging target and the position information of the imaging target are registered in association with the imaging target identification information for identifying the imaging target. As the imaging object, for example, a popular object as an imaging object can be registered on the web. Information registered in the server imaging object table 42a is also referred to as imaging object information.

  In the server image pickup recommended area table 42b, identification information for identifying the image pickup recommended area and position information on the route of the image pickup recommended area are registered in association with each other. The imaging recommended area can register a part on a route having a high reputation as being suitable for imaging an imaging object on the web.

  In the server imaging non-recommended area table 42c, identification information for identifying the imaging non-recommended area and position information on the path of the imaging non-recommended area are associated and registered. The imaging non-recommended area can register a part on the route that is notified unfortunately not suitable for imaging an imaging object on the web.

  The communication unit 43 transmits and receives information to and from the in-vehicle device 10 via the network N. The processing unit 41 performs various processes based on the information received using the communication unit 43. In addition, the processing unit 41 transmits the results of various processes using the communication unit 43. The communication unit 43 may include a communication circuit that performs transmission and reception and a communication line or antenna.

  Next, in the system 1, the operation of the in-vehicle device 10 determining the optical axis direction of the imaging devices 20 a to 20 d and receiving the imaging target information from the server 40 while referring to the sequence diagram shown in FIG. This will be described below.

  First, in step S801, the vehicle occupant operates the optical axis adjustment unit 22 of each of the imaging devices 20a to 20d to set the optical axis direction of the imaging unit 21. Specifically, the vehicle passenger adjusts the optical axis while checking the image on the display unit 13 so that the imaging unit 21 of each of the imaging devices 20a to 20d can capture the passenger and the scenery outside the vehicle together. Using the unit 22 or the operation unit 14, the optical axis direction of the imaging unit 21 and the image enlargement ratio are adjusted. By adjusting the optical axis direction of the imaging unit 21 and the magnification ratio of the image, the ratio of the passenger in the field of view of the imaging unit 21 and the ratio of the outside of the vehicle are changed.

  The optical axis direction determination unit 11a of the processing unit 11 of the in-vehicle device 10 determines the optical axis direction of each imaging unit 21 based on the movement amount information in the optical axis direction of the imaging unit 21 received from the imaging devices 20a to 20d. To the vehicle coordinate system fixed to

  Next, in step S <b> 803, the imaging object setting unit 11 b of the processing unit 11 of the in-vehicle apparatus 10 transmits an imaging object information request for requesting imaging object information to the server 40 via the network N. Further, the imaging target object setting unit 11b transmits an imaging recommended area information request for requesting imaging recommended area information and an imaging non-recommended area information request for requesting imaging non-recommended area information to the server 40 via the network N. .

  Next, in step S805, the server 40 receives the imaging target information request, the imaging recommended area information request, and the imaging non-recommended area information request.

  Next, in step S807, the processing unit 41 of the server 40 refers to the server imaging object table 41a stored in the storage unit 42, reads imaging object information, and uses the read imaging object information as a network. N to the vehicle-mounted device 10. Further, the processing unit 41 of the server 40 reads the recommended imaging region information with reference to the server recommended imaging region table 42 b stored in the storage unit 42, and the read recommended imaging region information is mounted on the vehicle via the network N. Transmit to device 10. Further, the processing unit 41 of the server 40 refers to the server imaging non-recommended region table 42c stored in the storage unit 42, reads out the imaging non-recommended region information, and stores the read out imaging non-recommended region information in the network N. Via the in-vehicle device 10.

  Next, in step S809, the imaging target setting unit 11b receives imaging target information, imaging recommended area information, and imaging non-recommended area information.

  Next, in step S811, the imaging object setting unit 11b registers the received imaging object information in the imaging object table 12d of the storage unit 12. In addition, the imaging target object setting unit 11 b registers the received recommended imaging area information in the recommended imaging area table 12 e of the storage unit 12. Furthermore, the shadow object setting unit 11 b registers the received imaging non-recommended area information in the imaging non-recommended area table 12 f of the storage unit 12.

  The vehicle occupant may operate the operation unit 14 of the in-vehicle device 10 to register the imaging object information of the imaging object desired to be imaged in the imaging object table 12 d of the storage unit 12. Similarly, the vehicle occupant may register the recommended imaging area information that he / she knows in the recommended imaging area table 12 e of the storage unit 12. Furthermore, the vehicle occupant may register the imaging non-recommended area information found by himself / herself in the imaging non-recommended area table 12 f of the storage unit 12. In this way, the vehicle occupant may appropriately register the imaging object information and the like in the in-vehicle device 10 in addition to the information stored in the server 40. In addition, the imaging target object setting unit 11b transmits information registered in addition to the imaging target object table 12d, the imaging non-recommended area table 12f or the imaging non-recommended area table 12f to the server 40, and stores it in the storage unit 42. It may be registered in each stored table.

  Next, in step S813, the imaging determination unit 11d of the processing unit 11 of the in-vehicle device 10 displays three imaging areas selected by the vehicle occupant on the display unit 13.

  FIG. 9 is a diagram illustrating a screen for selecting an imaging region.

  When “1. Take an image in an imageable area” is selected, the imaging determination unit 11d uses the imaging devices 20a to 20d when the vehicle is located in an imageable area on the route to capture images of the passenger and the outside of the vehicle. Image an object. In the example shown in FIG. 6, while the vehicle is traveling in the imageable region R, the imaging determination unit 11d images the passenger and the imaging object outside the vehicle using the imaging devices 20a to 20d. In this case, the imaging determination unit 11d may capture an image using the imaging devices 20a to 20d.

  When “2. Take an image in the recommended imaging area” is selected, the imaging determination unit 11d selects the imaging devices 20a to 20d when the vehicle is located in the imageable area on the route and in the recommended imaging area. It uses to image the passenger and the imaging object outside the vehicle. As a result, even in the region on the route where the passenger and the imaging object outside the vehicle can be imaged, it is possible to capture an image when the imaging object is expected to be particularly excellent. In the example illustrated in FIG. 6, while the vehicle is traveling in the recommended imaging region R2, the imaging determination unit 11d uses the imaging devices 20a to 20d to image the passenger and the imaging object outside the vehicle.

  When “3. Do not capture in the imaging non-recommended region” is selected, the imaging determination unit 11d captures the image when the vehicle is positioned in the imaging non-recommended region even if the vehicle is positioned in the imaging possible region on the route. The apparatus 20a to 20d is not used to image the passenger and the imaging object outside the vehicle. Thereby, even if it is predicted that the imaging object cannot be imaged well even in the region on the route where the imaging object can be captured outside the passenger and the vehicle, the imaging can be prevented. In the example illustrated in FIG. 6, even when the vehicle is traveling in the imageable region R, the imaging determination unit 11d uses the imaging devices 20a to 20d when the vehicle is positioned in the imaging non-recommended regions R1 and R3. The imaging object outside the passenger and the vehicle is not imaged.

  The imaging determination unit 11d inputs an imaging region selected by the vehicle occupant using the operation unit 14, and images using the imaging devices 20a to 20d while the vehicle is traveling in the input imaging region.

  Next, in step S815, the imaging determination unit 11d of the processing unit 11 of the in-vehicle device 10 displays two imaging modes selected by the vehicle occupant on the display unit 13.

  When “1. Capture in synchronization with first imaging device” is selected, imaging determination unit 11d determines that imaging is possible for imaging device 20a that captures a passenger seated in the driver's seat. Sometimes, the imaging device 20a is caused to take an image, and the other imaging devices 20b to 20d are also caused to take an image. As a result, the imaging device 20a captures the image of the passenger sitting in the driver's seat and the imaging object outside the vehicle, and the imaging device 20a captures the passenger sitting in the other seat in synchronization with the imaging. Imaging can be performed using the devices 20b to 20d. Thereby, for example, each passenger's facial expression or the like that is captured in a magnificent scenery outside the vehicle can be captured. The first imaging device may be an imaging device other than the imaging device 20a.

  When “2. Each imaging device captures images independently” is selected, the imaging determination unit 11d determines that imaging is possible for the imaging devices 20a to 20d that capture each passenger seated in the vehicle. When this occurs, each imaging device 20a is caused to take an image. Since the optical axis directions A1 to A4 of the imaging devices 20a to 20d are usually different, the timing at which it is determined that imaging is possible is also different. Therefore, the imaging determination unit 11d determines whether or not each of the imaging devices 20a to 20d can capture images, and can capture images of the passenger and an imaging target outside the vehicle, respectively, when imaging is possible.

  The imaging determination unit 11d inputs an imaging mode selected by a vehicle occupant using the operation unit 14, and captures an image using the imaging devices 20a to 20d while the vehicle is traveling in the input imaging mode.

  The above is description of the process etc. in which the vehicle-mounted apparatus 10 determines the optical axis direction of the imaging devices 20a-20d and receives imaging target object information from the server 40 in the system 1. FIG.

  Next, an operation in which the in-vehicle device 10 captures an image of an imaging target while traveling on a route to the destination will be described below with reference to the flowcharts shown in FIGS. 11 and 12.

  First, in step S1101, the navigation unit 11c of the processing unit 11 of the in-vehicle device 10 inputs a destination from a vehicle occupant and derives a route from the current vehicle position to the destination.

  Next, in step S1103, the imaging determination unit 11d refers to the map data 12b and the imaging target table 12d stored in the storage unit 12, and plans to travel on the route from the current vehicle position to the destination. The imaging object located within a predetermined distance from the route is searched. Then, the imaging determination unit 11d is on the path where the optical axis direction of the imaging unit 21 intersects the position of the imaging target with respect to the imaging devices 20a to 20d based on the selected imaging mode (see FIG. 10). Is determined as an imageable area. When the imaging mode for imaging in synchronization with the first imaging device (imaging device 20a) is selected, the imaging determination unit 11d obtains an imageable area from the imaging device 20a. On the other hand, when the imaging mode in which each imaging device captures images independently is selected, the imaging determination unit 11d obtains an imageable area for each of the imaging devices 20a to 20d. The reason for searching for an imaging object located within a predetermined distance from the planned travel route is that an imaging object located too far from the route is normally considered not to be imaged. The predetermined distance is a distance in a direction orthogonal to the direction in which the route extends. For example, the predetermined distance may be 1 km to 200 km. Note that, depending on the weather, there may be cases where imaging is not possible even if the imaging object is located within a predetermined distance, but in this specification, the imaging area is the imaging object outside the passenger and the vehicle if the weather is not bad. It means the position on the path where an object can be imaged. Therefore, in the present specification, the imaging devices 20a to 20d actually capture images of the passenger and the imaging object outside the vehicle in the imageable region, depending on the weather or an unexpected state. It is also included when not. As an unexpected state, for example, a new building is constructed between the route and the imaging object.

  If there is no imaging object located within a predetermined distance from the planned travel route, the navigation unit 11c continues route guidance to the destination. Here, the following description will be given on the assumption that at least one imaging object has been searched.

  Then, the imaging determination unit 11d refers to the imaging recommended region table 12e or the imaging non-recommended region table 12f stored in the storage unit 12 based on the selected imaging region (see FIG. 9), and the obtained imaging. The final imageable region is determined by excluding the region where imaging is not performed from the possible region.

  The imaging determination unit 11d may display the name of the imaging object on the map unit 13 on the map unit 13 together with the route obtained by the navigation unit 11c. Thereby, the passenger of a vehicle can grasp | ascertain the position on the path | route which can be imaged.

  Next, in step S1105, the navigation unit 11c performs route guidance by starting execution of the navigation function as the vehicle starts traveling.

  Next, in step S1107, the imaging determination unit 11d determines whether or not the predicted time until reaching the imageable area has reached a predetermined time. It is preferable that the predetermined time is a time during which a passenger who has received a notice of imaging notice can prepare for imaging. For example, the predetermined time can be 10 seconds. Here, the predetermined time may have a certain range. For example, if the predicted time is between 9 seconds and 11 seconds as the predetermined time, it may be determined that the predicted time has reached the predetermined time. In addition, when there are a plurality of imageable areas, the predicted time means the time required to reach an imageable area that is closest to the current vehicle position in the traveling direction of the vehicle.

  The imaging determination unit 11d obtains a predicted time until the imaging possible area is reached based on the distance from the current vehicle position to the imaging possible area and the current vehicle speed. For example, when the vehicle speed is 50 km / h, the estimated time is 10 seconds at a position approximately 139 m before the imageable area. When the vehicle speed is 100 km / h, the estimated time is 10 seconds at a position about 278 m before the imageable area.

  When the predicted time until reaching the imageable area reaches a predetermined time (Yes in step S1107), the imaging determination unit 11d displays that the vehicle is approaching the imageable area. 13 or the sound output unit 15 is used to notify the passenger (step S1109).

  FIG. 13 is a diagram illustrating a screen for notifying imaging.

  For example, as illustrated in FIG. 13, the imaging determination unit 11 d may display on the display unit 13 “I will image the passenger and the imaging object after 10 seconds”.

  In addition, the imaging determination unit 11d counts down the time from when it is notified that the vehicle is approaching the imageable area until it reaches the imageable area, and boarding using the display unit 13 or the sound output unit 15 The person may be notified. As a result, a passenger seated in a place other than the driver's seat can pose toward the imaging unit 21 to prepare for imaging.

  On the other hand, if the predicted time until reaching the imageable region is not the predetermined time (No in step S1107), the process returns to the step before S1105.

  Next, in step S1111, the navigation unit 11c executes a navigation function and continues route guidance.

  Next, in step S1113, the imaging determination unit 11d determines whether or not the vehicle has reached the imageable area. As described above, in the mappable area, the optical axis direction of the imaging unit 21 intersects the imaging target object in the map coordinate system, and the imaging target object outside the passenger and the vehicle using the imaging devices 20a to 20b. Can be captured so as to be included in one image.

  When it is determined that the vehicle has reached the imageable area (Yes in step S1113), the imaging determination unit 11d uses the imaging devices 20a to 20d determined to be capable of imaging based on the imaging mode. The person and the object to be imaged outside the vehicle are imaged (step S1201). FIG. 14 shows an image in which the passenger sitting in the driver's seat and the imaging object outside the vehicle are captured using the imaging device 20a. The imaging determination unit 11d stores the captured image as image data 12c in the storage unit 12. The imaging determination unit 11d may transmit the captured image to the server 40 via the network N. The server 40 may store the received image in the storage unit 42.

  On the other hand, if it is determined that the vehicle has not reached the imageable region (No in step S1113), the process returns to step S1111.

  Next, in step S1203, the navigation unit 11c executes a navigation function and continues route guidance.

  In step S1205, the navigation unit 11c determines whether the vehicle has arrived at the destination. If the vehicle has arrived at the destination (Yes in step S1205), the in-vehicle device 10 ends the operation of imaging the imaging object. On the other hand, if the vehicle has not arrived at the destination (in the case of No in step S1205), the process returns to step S1105.

  According to the in-vehicle device 10 of the system 1 of the present embodiment described above, it is possible to take an image so that a passenger on the vehicle and an imaging object outside the vehicle are included in one image while the vehicle is traveling.

  For example, conventionally, when the driver who is in the vehicle is only the driver, when imaging the imaging object outside the vehicle, the vehicle is stopped and the driver performs imaging. It was. On the other hand, according to the in-vehicle device 10 of the present embodiment, it is possible to capture an image of a passenger sitting on the driver's seat and an imaging object outside the vehicle without stopping the traveling vehicle.

  Conventionally, in a traveling vehicle, when a passenger images an object to be imaged outside the vehicle, the image is sometimes deviated from the most suitable timing for imaging. On the other hand, according to the in-vehicle device 10 of the present embodiment, since the imageable area on the route is obtained and imaged, it is possible to image at the most suitable timing for imaging.

  In the present invention, the in-vehicle system, the in-vehicle apparatus, the program, and the method according to the above-described embodiments can be appropriately changed without departing from the gist of the present invention.

  For example, the above-described in-vehicle device may be a high function portable terminal. The above-described in-vehicle device can be realized even by using a high-function mobile terminal having a navigation function and an imaging function.

  FIG. 15 is a diagram illustrating a high-function mobile terminal as another embodiment of the in-vehicle device.

  The high function portable terminal 90 includes an imaging unit 91 and a touch panel 92 as a display unit and an operation unit. The high function portable terminal 90 includes a processing unit, a storage unit, a sound output unit, a communication unit, and a GPS information receiving unit (not shown). The high function portable terminal 90 may receive the speed of the vehicle by connecting to the CAN, or may obtain the speed of the vehicle based on a change in the current position.

  The high function portable terminal 90 is fixed in the vehicle interior using the mounter 100.

  The mounter 100 includes a movable part 101 that fixes the high-functional portable terminal 90 and a fixed part 102 that fixes the movable part 101 in the vehicle interior so as to be rotatable.

  The movable portion 101 has four locking portions 101a to 101d, and the high function portable terminal 90 is fixed to the movable portion 101 using these locking portions 101a to 101d.

  The fixing unit 102 is fixed in the vehicle interior based on a predetermined positional relationship with respect to the vehicle coordinate system. For example, the fixing portion 102 is fixed at a position on the left end of the dashboard. As a result, the optical axis direction of the imaging unit 91 can be set so as to capture an image of a passenger seated in the driver's seat and an imaging object outside the vehicle, using the imaging unit 91 of the high-functional portable terminal 90.

  The movable part 101 is rotatable with respect to the fixed part 102 as shown by the direction of the arrow in FIG. Thereby, the direction of the high function portable terminal 90 fixed to the movable unit 101 can be changed, and the optical axis direction of the imaging unit 91 can be set so as to capture the outside of the vehicle including the passengers in the vehicle.

  An indicator 102 a indicating the positional relationship of the movable unit 101 with respect to the fixed unit 102 is displayed on the fixed unit 102.

  An optical axis direction index 101e is displayed below the movable part 101. By reading the optical axis direction index 101e at a position that coincides with the index 102a, the positional relationship of the movable part 101 with respect to the fixed part 102 can be obtained. Has been made.

  The vehicle occupant sets the optical axis direction and magnification of the imaging unit 91 while viewing the image on the touch panel 92, and then reads the optical axis direction index 101e at the position that coincides with the index 102a, and the read optical axis direction index 101e. Is input to the high function portable terminal 90.

  Based on the input optical axis direction index 101e and a predetermined positional relationship with respect to the vehicle coordinate system of the fixed unit 102 fixed to the passenger compartment, the high function portable terminal 90 determines the optical axis direction of the imaging unit 91 as the vehicle To the vehicle coordinate system fixed to

  The high-function mobile terminal 90 can operate in the same manner as the in-vehicle device 10 of the above-described embodiment, and is based on the positional relationship between the optical axis direction of the imaging unit 91 and the imaging object outside the vehicle. It is determined whether the object can be imaged, and when the image can be captured, the passenger and the imaging object are imaged using the imaging unit 91.

  In the above-described embodiment, the processing unit 11 determines that the passenger and the imaging object can be imaged when the optical axis direction of the imaging unit 21 intersects the position of the imaging object. When the imaging object is included in the field of view of the imaging unit 21, it may be determined that the passenger and the imaging object can be imaged.

DESCRIPTION OF SYMBOLS 1 System 10 In-vehicle apparatus 11 Processing part 11a Optical axis direction determination part 11b Imaging target object setting part 11c Navigation part 11d Imaging determination part 12 Storage part 12a Program 12b Map data 12c Image data 12d Imaging target object table 12e Imaging recommendation area | region table 12f Imaging Deprecated area table 13 Display section (output)
14 operation unit 15 sound output unit 16 communication unit (output unit)
20a to 20d Imaging device 21 Imaging unit 22 Optical axis adjustment unit 30 GPS information reception unit 40 Server 41 Processing unit 42 Storage unit 43 Communication unit 50 Vehicle 51a to 51d Passenger 60 Imaging object 70 Route 80 Obstacle 81 Obstacle 90 Terminal 91 imaging unit 100 mounter 101 movable unit 101a to 101d locking unit 101e optical axis direction index 102 fixed unit 102a index N network P image

Claims (9)

An imaging unit for acquiring an image;
When the position of the imaging object outside the vehicle is acquired, it is determined whether the passenger and the imaging object can be imaged based on the positional relationship between the optical axis direction of the imaging unit and the imaging object outside the vehicle, and when the imaging is possible A processing unit that causes the imaging unit to capture an image including a passenger and an imaging target;
An output unit for outputting the captured image;
An in-vehicle system.   The in-vehicle system according to claim 1, wherein the processing unit determines that the passenger and the imaging target can be imaged when an optical axis direction of the imaging unit intersects a position of the imaging target.   The processing unit obtains an imaging position at which a passenger and an imaging object can be imaged on a route traveled by the vehicle on which the in-vehicle device is mounted, and before the vehicle reaches the imaging position, The in-vehicle system according to claim 1, wherein the passenger is notified of imaging of the passenger and the imaging object. In the route traveled by the vehicle on which the in-vehicle device is mounted, an imaging recommended area recommended to image an imaging object outside the vehicle is set,
The processing unit determines that the passenger and the imaging object can be imaged, and causes the imaging unit to image the passenger and the imaging object when a vehicle is located in the recommended imaging area. The vehicle-mounted system as described in any one of 1-3. An imaging non-recommended area where it is not recommended to image an imaging object outside the vehicle is set in the route traveled by the vehicle on which the in-vehicle device is mounted,
Even when it is determined that the passenger and the imaging object can be imaged, the processing unit does not cause the imaging unit to image the passenger and the imaging object when the vehicle is located in the imaging non-recommended region. The in-vehicle system according to any one of Items 1 to 4. The imaging unit includes a first imaging unit having a first optical axis direction, and a second imaging unit having a second optical axis direction,
The processing unit determines whether the passenger and the imaging object can be imaged based on the positional relationship between the first optical axis direction of the first imaging unit and the imaging object outside the vehicle. The in-vehicle system according to any one of claims 1 to 5, wherein a passenger and an imaging target are imaged by the first imaging unit, and the second imaging unit is also imaged. Acquire the position of the imaging object outside the vehicle, determine whether the passenger and the imaging object can be imaged based on the positional relationship between the optical axis direction of the imaging unit that acquires the image and the imaging object outside the vehicle, and capture the image A processing unit that causes the imaging unit to capture an image including a passenger and an imaging target in such a case,
A vehicle-mounted device comprising: Acquiring the position of the imaging object outside the vehicle;
Determining whether an image including the passenger and the imaging target can be captured based on the positional relationship between the optical axis direction of the imaging unit that acquires the image and the imaging target outside the vehicle;
A program that causes a processor to execute imaging of a passenger and an imaging object using the imaging unit when imaging is possible. Acquiring the position of the imaging object outside the vehicle;
Determining whether an image including the passenger and the imaging target can be captured based on the positional relationship between the optical axis direction of the imaging unit that acquires the image and the imaging target outside the vehicle;
When imaging is possible, taking an image including a passenger and an imaging object using the imaging unit,
A method comprising:

Images