JP2019095260A - Information output device - Google Patents

Abstract

To output information on photographing of a subject while taking into consideration the time recommended for photographing the subject and reducing a burden on a driver.SOLUTION: An information output device 10 includes: a determination part 14 which determines whether or not a vehicle is positioned within a range capable of photographing a subject in a recommended photograph time and also determines the condition of the vehicle driver; and an output part 15 which outputs photograph information on photographing of the subject on the basis of results determined by the determination part 14.SELECTED DRAWING: Figure 6

Description

  The present invention relates to an information output device.

  In the following Patent Document 1, an image acquisition unit that acquires an image, an image related position acquisition unit that acquires an image related position indicating a position related to the image acquired by the image acquisition unit, and a current position that acquires a current position An information output apparatus is disclosed which comprises: position acquisition means; and output means for outputting imaging target candidate information based on the image-related position information and the current position information.

JP, 2010-141432, A

  However, since the information output apparatus disclosed in Patent Document 1 does not output the imaging target candidate information in consideration of the time recommended for imaging the imaging target, the driver is recommended to the imaging target at the time recommended. Sometimes I can not shoot. In addition, the information output device disclosed in Patent Document 1 may impose an unnecessary burden on the driver because it outputs imaging target candidate information regardless of the situation of the driver of the vehicle.

  Therefore, the present invention provides an information output apparatus capable of outputting information related to imaging of an imaging target while considering the time recommended for imaging an imaging target and reducing the burden on the driver. The purpose is to

  The information output apparatus according to an aspect of the present invention determines whether the vehicle is positioned within a range in which the imaging target can be imaged at the imaging recommended time, and determines the driver's condition of the vehicle And an output unit that outputs imaging information related to imaging of the imaging target based on the result determined by the determination unit.

  According to the present invention, there is provided an information output apparatus capable of outputting information related to imaging of an object to be imaged while considering the time recommended for imaging the object to be imaged and reducing the burden on the driver. can do.

It is a figure showing an example of composition of an information output device concerning an embodiment, and a data center. It is a table | surface which shows the example of the presentation method of the imaging | photography state by the information output device which concerns on embodiment, and the specific imaging method of imaging | photography object. It is a figure which shows the example of the imaging | photography method which the information output apparatus which concerns on embodiment shows, and the specific condition where the said imaging | photography method is shown. It is a figure which shows the example of the imaging | photography information which the information output device which concerns on embodiment displays. It is a figure which shows the example of the imaging | photography information which the information output device which concerns on embodiment displays. It is a flowchart which shows the example of the process which the information output device which concerns on embodiment performs. It is a flowchart which shows the example of the process which the information output device which concerns on embodiment performs.

  Preferred embodiments of the present invention will be described with reference to the accompanying drawings. In addition, what attached the same code | symbol in each figure has the same or same structure.

[Embodiment]
The configurations of the information output device and the data center according to the embodiment will be described with reference to FIG.

  As shown in FIG. 1, the information output apparatus 10 includes an acquisition unit 11, a transmission / reception unit 12, a route proposal unit 13, a determination unit 14, an output unit 15, a voice recognition unit 16, and a photographing unit 17. Prepare. In addition, the information output device 1 includes at least the determination unit 14 and the output unit 15, and may include components other than these components. The information output device 10 is included in, for example, a car navigation system.

  The data center 20 includes a transmission / reception unit 21, an acquisition unit 22, a storage unit 23, and a learning unit 24.

  The acquisition unit 11 acquires information necessary for the process performed by the information output device 10. This information is, for example, information indicating destination information, the current position of the vehicle, and the state of the driver. Here, the destination information is, for example, information including the position of the destination, the name of the destination, and the route to the destination.

  The destination information may be acquired based on the information input to the information output device 10. The current position of the vehicle may be acquired by a GPS (Global Positioning System) receiver. The information indicating the driver's condition may be acquired using, for example, a camera, a biological sensor, or a solid object sensor. The camera is a camera that recognizes the movement and expression of the driver's line of sight, and is installed, for example, in front of the driver or at the top of the steering wheel. The biological sensor is a sensor that acquires biological information of the driver such as pulse and temperature, and is incorporated in, for example, a steering wheel or a seat belt. The three-dimensional object sensor is a sensor that acquires information indicating the movement and posture of the driver, and is installed, for example, on a rearview mirror. Further, the information indicating the driver's state may include information indicating that the driver is determined to be in conversation with the fellow passenger based on the voice acquired by the voice recognition unit 16.

  The transmission / reception unit 12 transmits / receives information to / from the data center 20. For example, the transmitting and receiving unit 12 transmits destination information, the determination result of the state of the driver, information indicating a photographing method, and an image to be photographed. Also, for example, the transmitting / receiving unit 12 receives the imaging target information and the imaging recommended time. Here, the imaging target information is information including the position of the imaging target and the name of the imaging target. Further, the recommended imaging time is a time suitable for imaging an object to be imaged, and may change depending on the season or month.

  In addition to the destination information acquired by the acquisition unit 11 and the current position of the vehicle, the route proposal unit 13 passes the range in which the object to be imaged can be photographed from the current position of the vehicle, taking into consideration the information to be photographed and the recommended imaging time. And propose a route to reach the destination. Alternatively, in consideration of these, the route proposal unit 13 proposes a route for reaching the range where the object to be photographed can be photographed from the current position of the vehicle. In addition, the route proposal unit 13 determines whether or not information for approving these routes has been input.

  The determination unit 14 determines whether the vehicle is positioned within a range in which the imaging target can be imaged at the imaging recommended time. Here, the range in which a subject to be photographed can be photographed means a range in which a subject to be photographed can be photographed using a vehicle-mounted camera or a camera possessed by the driver of the vehicle, and traffic other than a car, such as walking off the vehicle. After moving by means, it means the range in which the subject can be photographed.

  In addition, the determination unit 14 determines the state of the driver based on the information indicating the state of the driver acquired by the acquisition unit 11. The determination unit 14 grasps the driver's state based on parameters acquired using, for example, a camera, a biometric sensor, or a three-dimensional object sensor.

  Furthermore, the determination unit 14 can determine whether the current position of the vehicle acquired by the acquisition unit 11 is within the life of the driver.

  The output unit 15 outputs the imaging information based on the result determined by the determination unit 14. Here, the shooting information is information related to shooting of a shooting target, and includes, for example, information indicating a shooting method, a description of the shooting target, and a position of the shooting target. Here, the information indicating the position of the imaging target includes the distance from the vehicle to the imaging target and the direction of the imaging target based on the vehicle.

  Specifically, when it is determined that the vehicle is positioned within the range in which the imaging target can be imaged at the imaging recommended time, the output unit 15 presents imaging information according to the state of the driver, as shown in FIG. Change the method and specific shooting method. When the driving method is automatic driving, as shown in FIG. 2, the output unit 15 automatically shoots a shooting target without presenting a shooting state.

  When the driving method is manual driving, as shown in FIG. 2, the output unit 15 adopts the following method of presenting photographing information and a specific photographing method according to the state of the driver. When the driver's state is “normal” or “dissatisfaction”, the output unit 15 automatically shoots a shooting target without presenting a shooting state. When the driver's condition is "sleepiness", the output unit 15 may present shooting information including an instruction to manually shoot using an on-vehicle camera or another camera as an image or a sound. When the driver's state is "comfort" or "conversation with a passenger", the output unit 15 presents, by image or voice, shooting information including a prompt for manual shooting using a camera other than the on-vehicle camera. You may In addition, when the driver's state is "sleepiness", "comfort" or "conversation with a fellow passenger", the output unit 15 may automatically shoot a shooting target without presenting a shooting state.

  In addition, when the driving method is manual driving, the output unit 15 outputs the imaging information at the time of turning the lane, changing lanes, merging, parking, etc. in order to prevent the load on the driver from becoming too high. It can be stopped. The output unit 15 can detect right-left turn, lane change, merging, parking, and the like based on vehicle information such as speed and steering angle.

  As described above, the output unit 15 imposes a load on the driver more than necessary by changing the method of presenting the photographing information to be output and the specific photographing method in consideration of the driving method and the state of the driver. Can be suppressed.

  In addition, when it is preferable to have the driver look at the shooting target, if the output unit 15 has a target for shooting for the first time after getting off the vehicle and moving by transportation means other than the car, such as walking, etc. The guidance of the route from the position where the vehicle is parked to the shooting target may be transmitted to the terminal carried by the driver. Further, in these cases, the output unit 15 may output the guidance of the route based on the position where the other vehicle was parked and the route on which the terminal carried by the driver of the other vehicle traveled. .

  As shown in FIG. 3, the shooting by the on-vehicle camera is performed automatically or manually, and both are adopted when the shooting target is located in the range in which the on-vehicle camera can shoot. In addition, photographing performed manually has an advantage that it can be performed at the timing the driver likes.

  On the other hand, as shown in FIG. 3, photographing with a camera other than the on-vehicle camera is performed inside or outside the vehicle. The photographing performed in the car is adopted when the photographing target is not located in the range which can be photographed by the on-vehicle camera, when the passenger is present in the passenger seat, and when the camera is installed in the car. The imaging performed outside the vehicle is adopted when the driver can reach the imaging target within a range where imaging can be performed by transportation other than the car.

  The output unit 15 also displays, for example, the image G1 illustrated in FIG. 4 on the display when a route is proposed to reach the destination from the current position of the vehicle via the range in which the shooting target can be shot. As shown in FIG. 4, the image G1 includes a map M, an icon C, a pointer P, a display area R, and an icon A1. The map M indicates a vehicle whose position is indicated by an icon C, a road around the object to be photographed whose position is indicated by a pointer P, and the like. The display area R is located on the right side of the map M, and displays an image to be photographed. The icon A1 represents a button that is pressed when the route suggested by the route suggestion unit 13 is approved by the driver. In addition, a message “Would you like to go on shooting because there are stairs of a famous scene of a movie” is displayed between the region R and the icon A1. This message moves the imaging target to a range where imaging is possible at the imaging recommended time, and urges the driver to capture the imaging target.

  Furthermore, when outputting the shooting information, the output unit 15 displays, for example, the image G2 illustrated in FIG. 5 on the display. The image G2 includes the map M, the icon C, the pointer P, and the display area R as in the image G1, and includes the icon A2 instead of the icon A1. The icon A2 represents a button that is pressed when a shooting target is shot. In addition, between the area R and the icon A2, please say "Shoot with voice" or press the shutter button. "" Message is displayed. This message urges the driver to perform manual imaging. Further, the output unit 15 outputs the position and direction of the imaging target as imaging information by displaying the pointer P and the icon C, and outputs the imaging method as imaging information by displaying the message and the icon A2. It can be said.

  The voice recognition unit 16 obtains a voice emitted by the driver of the vehicle. The voice acquired by the voice recognition unit 16 is used as information from which a driver is determined to be talking with a fellow passenger, or used as a trigger to release the shutter of the camera when manually shooting a shooting target. Be done.

  The photographing unit 17 determines the photographing method of the photographing target. In addition, the imaging unit 17 acquires an image of an object to be captured, for example, from a camera that has captured an object to be captured.

  The transmission and reception unit 21 transmits and receives information to and from the information output device 10. For example, the transmission / reception unit 21 receives destination information, the determination result of the driver's state, information indicating a photographing method, and an image to be photographed, and transmits photographing target information and a photographing recommended time.

  The acquisition unit 22 acquires imaging target information using external information. Here, the external information is, for example, an image uploaded to the website of the social networking service and information attached thereto, a guidebook, and a poster. In addition, the acquisition unit 22 acquires the imaging target information and the imaging recommended time from the storage unit 23.

  The acquiring unit 22 may acquire imaging target information of an imaging target located around the current position of the vehicle. Alternatively, the acquisition unit 22 may acquire the imaging target information based on an image photographed using the on-vehicle camera or a camera possessed by the driver of the vehicle or a recorded moving image. In addition, the acquisition unit 22 acquires imaging target information using a web search history of a terminal carried by the driver of the vehicle and information registered in the social networking service used by the driver of the vehicle. May be

  The storage unit 23 includes imaging target information, imaging recommended time, time when the imaging target was imaged, image of the imaging target, imaging method, determination result of driver's state, driving method, learning result of the learning unit 24, vehicle is actually A traveled path, a position at which the vehicle is parked, and a path traveled by a terminal carried by the driver of the vehicle are stored. Further, among the images stored in the storage unit 23, the image photographed by itself and the popular image are appropriately displayed by the information output device 10.

  The learning unit 24 performs learning based on the information stored in the storage unit 23, and generates a more preferable determination of the driver's state, a photographing method, and a photographing recommended time for each photographing target. In addition, the learning unit 24 can extract an image determined to be preferable from among the images to be photographed.

  An example of a suitable process performed by the information output device 10 according to the embodiment will be described with reference to FIG.

  The acquisition unit 11 acquires destination information, and the transmission / reception unit 12 transmits the destination information (step S101).

  The transmitting and receiving unit 21 receives the destination information (step S102).

  The acquisition unit 22 acquires the imaging target information and the imaging recommended time, and the transmission / reception unit 21 transmits these (step S103).

  The transmission / reception unit 12 receives the imaging target information and the imaging recommended time (step S104).

  The route proposing unit 13 proposes a route for reaching the destination from the current position of the vehicle via the range capable of photographing the photographing object in consideration of the photographing object information and the photographing recommendation time (step S105).

  The route proposing unit 13 determines whether the route proposed in step S105 is approved (step S106). If the route proposal unit 13 determines that this route is approved (step S106: Yes), the process proceeds to step S107, and if this route is determined not to be approved (step S106: No), the process is ended. .

  The acquisition unit 11 acquires the current position of the vehicle (step S107).

  The determination unit 14 determines whether the vehicle is positioned within a range in which the imaging target can be imaged at the imaging recommended time (step S108). If the determination unit 14 determines that the vehicle is positioned in this range (step S108: Yes), the process proceeds to step S109, and if it is determined that the vehicle is not positioned in this range (step S108: No), the process is stepped It returns to S107.

  The acquisition unit 11 acquires information indicating the state of the driver (step S109).

  The determination unit 14 determines the state of the driver (step S110).

  The photographing unit 17 determines a photographing method (step S111).

  The output unit 15 outputs the photographing information (step S112).

  The photographing unit 17 acquires an image to be photographed (step S113).

  The transmission / reception unit 12 transmits the determination result of the driver's state, the information indicating the photographing method, and the image to be photographed (step S114).

  The transmission / reception unit 21 receives the determination result of the driver's state, the information indicating the photographing method, and the image to be photographed, stores these in the storage unit 23, and ends the process (step S115).

  An example of a suitable process performed by the information output device 10 according to the embodiment will be described with reference to FIG. 7.

  The acquisition unit 11 acquires the current position of the vehicle (step S201).

  The determination unit 14 determines whether or not the current position acquired in step S201 is within the life range of the driver (step S202). When it is determined that the current position is within the life range of the driver (Step S202: Yes), the determination unit 14 ends the process, and when it is determined that the current position is not within the life range of the driver (Step S202: No), the process proceeds to step S203.

  The transmission / reception unit 12 transmits information indicating the current position acquired in step S201 (step S203).

  The transmission / reception unit 21 receives the information indicating the current position acquired in step S201 (step S204).

  Steps S205 and S206 are the same as steps S103 and S104, respectively.

  The route proposing unit 13 proposes a route which reaches the range in which the object to be captured can be captured from the current position of the vehicle in consideration of the information to be captured and the recommended imaging time (step S208). If the route proposal unit 13 determines that the route is approved (step S208: Yes), the process proceeds to step S209. If the route proposal unit 13 determines that the route is not approved (No at step S208), the process ends. .

  Steps S209 to S217 are the same as steps S103 to S115, respectively.

  The embodiment which is an example of the present invention has been described above. The information output device 1 according to the embodiment determines whether or not the vehicle is positioned within the range in which the imaging target can be imaged at the imaging recommended time, and determines the determination unit 14 which determines the driver's condition of the vehicle And an output unit that outputs shooting information related to shooting of an object to be shot based on a result determined by the unit. For this reason, the information output device 1 can enable the driver to capture an image of an object to be captured by a preferred imaging method for the recommended imaging time, without placing an excessive burden on the driver.

  The present invention is not limited to the embodiments described above, and can be implemented in other various forms without departing from the scope of the present invention. For this reason, the embodiment described above is merely illustrative in every respect and is not to be construed as limiting. For example, the processing steps described above can be arbitrarily changed in order or performed in parallel as long as no contradiction occurs in the processing content.

  DESCRIPTION OF SYMBOLS 10 ... Information output device, 11 ... Acquisition part, 12 ... Transmission / reception part, 13 ... Route proposal part, 14 ... Determination part, 15 ... Output part, 16 ... Speech recognition part, 17 ... Photographing part, 20 ... Data center, 21 ... Transmission / reception unit, 22 ... acquisition unit, 23 ... storage unit, 24 ... learning unit, A1, A2, C ... icon, G1, G2 ... image, M ... map, P ... pointer, R ... area

Claims (1)

A determination unit that determines whether or not the vehicle is positioned within a range in which the object to be captured can be captured at the recommended imaging time, and determines the driver's condition of the vehicle;
An output unit that outputs shooting information related to shooting of the shooting target based on the result determined by the determination unit;
An information output device comprising:

Images