JP2014030092A - Information providing device, information providing method, and program of the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To guide a user toward an object and to provide information suitable to imaging of the object.SOLUTION: An information providing device comprises: an imaging unit for imaging an object; an imaging position estimation unit for estimating an imaging position; an imaging direction estimation unit for estimating an imaging direction; an object information acquisition unit for acquiring object information containing the position of the object; an object direction estimation unit for estimating the direction of the object on the basis of the imaging position, the imaging direction, and the position of the object; a notification processing unit for giving notification of the direction of the object; and an image quality parameter control unit for controlling an image quality parameter on the basis of the object information.

Description

  The present invention relates to an information providing apparatus, an information providing method, and a program.

  When photographing natural scenery or the like, it is preferable to know in advance the location and direction suitable for photographing. Furthermore, when taking a celestial photograph such as a constellation, it is necessary to calculate the direction in which the constellation of the object can be seen, based on the shooting location, date and time, and the like.

  Patent Document 1 discloses a portable terminal device that calculates the celestial motion of a constellation based on a geomagnetic sensor, GPS (Global Positioning System), and date / time information. And the portable terminal device indicated in patent documents 1 presents the name of the constellation according to the direction of a portable terminal device to a user based on the output of a geomagnetic sensor.

  Non-Patent Document 1 discloses an application that calculates a constellation, a nebula, and the like according to the orientation of the mobile terminal device based on the orientation of the mobile terminal and GPS. And in the application disclosed by the nonpatent literature 1, the image showing the calculated constellation is produced | generated, and the image and name of a constellation are displayed on a display part.

JP 2004-13066 A

"Sky Map Google Play Android App" [online], [Search July 9, 2012], Internet <URL: https: // play. Google. com / sote / apps / details? id = com. Google. android. starlid & hl = ja>

  The disclosures of the above prior art documents and the like are incorporated herein by reference. The following analysis has been made from the viewpoint of the present invention.

  As described above, when shooting a natural landscape or the like, it is preferable to know in advance the location and direction suitable for shooting. Furthermore, when taking astrophotography, it is necessary to consider the date and time. This is because the direction in which the constellation and the like are visible varies depending on the date and time.

  Furthermore, when photographing an object, it is preferable that the focal length, brightness, and the like differ depending on the object. For example, when taking an astrophotography, it is preferable to set the focal length to infinity. Further, when photographing a constellation, it is preferable to change the brightness or the like according to the brightness of the star or the like.

  In the techniques disclosed in Patent Document 1 and Non-Patent Document 1, information such as brightness suitable for photographing an object is not provided.

  Therefore, an information providing device, an information providing method, and a program that guide information toward the object and provide information suitable for photographing the object are desired.

  According to the first aspect of the present invention, an imaging unit that captures an object, an imaging position estimation unit that estimates an imaging position, an imaging direction estimation unit that estimates an imaging direction, and object information including the object position An object information acquisition unit that acquires the object direction, an object direction estimation unit that estimates the object direction based on the imaging position, the imaging direction, and the object position, and a notification process that notifies the object direction And an image quality parameter control unit that controls an image quality parameter based on the object information.

  According to a second aspect of the present invention, a step of photographing a target, a step of estimating a photographing position, a step of estimating a photographing direction, a step of acquiring target information including a target position, An object direction estimating step for estimating the object direction based on the shooting position, the shooting direction, and the object position, a notifying step for notifying the object direction, and an image quality based on the object information. And providing a method of providing information.

  According to a third aspect of the present invention, there is provided a program to be executed by a computer that controls the information providing apparatus, the process of shooting an object, the process of estimating a shooting position, and the process of estimating a shooting direction; A process for acquiring object information including an object position, an object direction estimating process for estimating an object direction based on the imaging position, the imaging direction, and the object position, and the object direction. A program is provided that performs a notification process for notification and a process for controlling an image quality parameter based on the object information. This program can be recorded on a computer-readable storage medium. The storage medium can be non-transient such as a semiconductor memory, a hard disk, a magnetic recording medium, an optical recording medium, or the like. The present invention can also be embodied as a computer program product.

  According to each viewpoint of the present invention, an information providing apparatus, an information providing method, and a program for guiding information in the direction of an object and providing information suitable for photographing the object are provided.

It is a figure for demonstrating one Embodiment. It is a top view which shows an example of the whole structure of the information provision apparatus 1 which concerns on 1st Embodiment. It is a figure which shows an example of the internal structure of the information provision apparatus 1 which concerns on 1st Embodiment. It is a figure which shows an example of a target object direction. It is a figure which shows an example of a target object direction and an alerting | reporting image. It is a figure which shows an example of a alerting | reporting image. It is a figure which shows an example of the relationship between the number of addition and the luminous intensity of a star. It is a flowchart which shows an example of the operation | movement regarding the alerting | reporting process of a target object direction. It is a flowchart which shows an example of the operation | movement regarding correction | amendment of a picked-up image. It is a figure which shows an example of a picked-up image and an addition image.

  First, an outline of an embodiment will be described with reference to FIG. Note that the reference numerals of the drawings attached to the outline are attached to the respective elements for convenience as an example for facilitating understanding, and the description of the outline is not intended to be any limitation.

  As described above, when shooting a natural landscape or the like, it is preferable to know in advance the location and direction suitable for shooting. Furthermore, the image quality parameter varies depending on the object. Therefore, an information providing apparatus that guides in the direction of the object and provides an image with an image quality corresponding to the object is desired.

  Therefore, the information providing apparatus 100 shown in FIG. 1 is provided as an example. The information providing apparatus 100 acquires an object information including an object position, an imaging unit 101 that images an object, an imaging position estimation unit 102 that estimates an imaging position, an imaging direction estimation unit 103 that estimates an imaging direction. A target object information acquisition unit 104, a target position estimation unit 105 that estimates a target direction based on a shooting position, a shooting direction, and a target position; a notification processing unit 106 that notifies the target direction; An image quality parameter control unit 107 that controls image quality parameters based on the object information.

  The information providing apparatus 100 notifies the direction in which the object exists (hereinafter referred to as the object direction). Furthermore, the information providing apparatus 100 controls the image quality parameter based on information related to the object (hereinafter referred to as object information).

  Specifically, first, the shooting position estimation unit 102 estimates the shooting position (step S1001). The shooting position means a position where the information providing apparatus 100 exists. Then, the shooting direction estimation unit 103 estimates the shooting direction (step S1002). The shooting direction means a direction in which the imaging unit 101 is facing. Next, the object information acquisition unit 104 acquires object information including the object position (step S1003). The object position means information related to the position of the object. Thereafter, the object direction estimation unit 105 estimates the object direction based on the imaging position, the imaging direction, and the object position (step S1004). The notification processing unit 106 notifies the object direction (step S1005). Therefore, even when the user does not know the direction of the object, the information providing apparatus 100 can present the direction of the object to the user. Further, the image quality parameter control unit 107 controls the image quality parameter based on the object information (step S1006). Therefore, the information providing apparatus 100 guides in the direction of the object and provides information suitable for photographing the object.

Hereinafter, specific embodiments will be described in more detail with reference to the drawings.
[First Embodiment]
The first embodiment will be described in more detail with reference to the drawings.

  FIG. 2 is a plan view showing an example of the overall configuration of the information providing apparatus 1 according to the present embodiment.

  The information providing apparatus 1 includes a display unit 10, an operation unit 20, and an imaging unit 30. The information providing apparatus 1 according to the present embodiment is not intended to be limited to the form shown in FIG. The information providing apparatus 1 corresponds to, for example, a smartphone, a mobile phone, a game machine, a tablet PC (Personal Computer), a slate PC, a PDA (Personal Digital Assistant), and the like.

  The user visually recognizes information (characters, images, etc.) displayed by the information providing apparatus 1 on the display unit 10. The display unit 10 is preferably a liquid crystal panel, an organic EL (Electro Luminescence) panel, or the like.

  The operation unit 20 receives a user operation on the information providing apparatus 1. In FIG. 2, a hardware key is illustrated as the operation unit 20, but operation means such as a touch panel may be employed.

  The imaging unit 30 captures an object. Specifically, the imaging unit 30 is arranged on a surface facing the display unit 10 and photographs an object in a direction facing the display unit 10.

  FIG. 3 is a diagram illustrating an example of the internal configuration of the information providing apparatus 1. The information providing apparatus 1 includes a display unit 10, an operation unit 20, an imaging unit 30, a control unit 40, a GPS antenna 50, an orientation sensor 60, an acceleration sensor 70, a clock 80, a storage unit 90, It is comprised including.

  The control unit 40 includes an object setting unit 41, an object information acquisition unit 42, an imaging position estimation unit 43, an imaging direction estimation unit 44, an object direction estimation unit 45, a notification processing unit 46, and an image quality parameter. A control unit 47, a noise removal processing unit 48, and an addition image generation unit 49 are included.

  The storage unit 90 includes a star data storage unit 91 and a captured image storage unit 92. In FIG. 3, for the sake of simplicity, modules related to the information providing apparatus 1 according to the present embodiment are mainly described. In the following description, the object is described as a constellation.

  The star data storage unit 91 stores data regarding stars. Specifically, the data relating to the star includes data relating to the position of the star (hereinafter referred to as star map data) and data relating to the constellation (hereinafter referred to as constellation data). The star map data includes star positions and celestial information associated with the date and time. The constellation data includes information such as the name of the constellation and the grade (luminosity) of the stars constituting the constellation. The constellation data may also include information on names of stars constituting the constellation and lines connecting the stars constituting the constellation (hereinafter referred to as constellation lines).

  The captured image storage unit 92 stores an image captured by the imaging unit 30 (hereinafter referred to as a captured image). The control unit 40 may store the captured image in the captured image storage unit 92 based on an operation on the operation unit 20. In FIG. 3, the captured image storage unit 92 is arranged inside the information providing apparatus 1, but may be an external storage medium. For example, the captured image storage unit 92 may be an external storage medium such as a memory card. There are various types of external storage media, but the type is not limited.

  The object setting unit 41 sets an object. The object setting unit 41 may set an object based on an operation detected by the operation unit 20.

  The object information acquisition unit 42 acquires object information including the object position. The object information includes information regarding the type of the object. When the object is a constellation, the object information acquisition unit 42 acquires the position of the constellation of the object as the object position. Furthermore, the target object information acquisition unit 42 refers to the star data storage unit 91 and acquires the constellation data of the target object.

  The shooting position estimation unit 43 estimates the shooting position. That is, the shooting position estimation unit 43 estimates the position of the information providing apparatus 1. The shooting position estimation unit 43 estimates information including the latitude and longitude of the information providing apparatus 1. Specifically, first, the GPS antenna 50 receives radio waves from GPS satellites. Then, the shooting position estimation unit 43 estimates the position of the information providing device 1 as the shooting position based on the radio wave received by the GPS antenna 50.

  The shooting direction estimation unit 44 estimates the shooting direction. That is, the shooting direction estimation unit 44 estimates the direction in which the imaging unit 30 is facing. At that time, the shooting direction estimation unit 44 estimates the shooting direction based on the outputs of the direction sensor 60 and the acceleration sensor 70.

  Specifically, the imaging direction estimation unit 44 estimates the orientation of the imaging unit 30 based on the output of the orientation sensor 60. Further, the shooting direction estimation unit 44 estimates the attitude (angle) of the imaging unit 30 based on the output of the acceleration sensor 70. Further, the shooting direction estimation unit 44 may estimate the posture of the imaging unit 30 based on the output of an angular velocity sensor (not shown).

  The target object direction estimation unit 45 estimates the target object direction based on the shooting position, the shooting direction, and the target object position. Specifically, first, the object direction estimation unit 45 determines an imaging surface having a predetermined focal length as the target imaging surface when a straight line including the imaging position and the object position is used as the optical axis. Then, the object direction estimating unit 45 estimates the direction from the center of the imaging surface to the center of the target imaging surface as the object direction. The focal distance from the information providing apparatus 1 to the target imaging surface and the focal distance from the information providing apparatus 1 to the imaging surface are the same.

  In the following description, a coordinate system is described in which the photographing position is the origin, the vertical direction is the Z axis, and the two axes orthogonal to the Z axis are the X axis and the Y axis.

  FIG. 4 is a diagram illustrating an example of the object direction. In the case of FIG. 4, the photographing position of the information providing apparatus 1 is set as the origin P401. Point P402 represents the object position.

  In FIG. 4, a broken line L1 represents the optical axis of the imaging unit 30. The imaging surface when the broken line L1 is the optical axis is the imaging surface 201. Furthermore, the broken line L2 is a straight line including the point P401 and the point P402. That is, the broken line L2 is a straight line including the shooting position and the object position. The target imaging plane when the broken line L2 is the optical axis is the target imaging plane 202. As described above, the focal lengths of the imaging surface 201 and the target imaging surface 202 are the same.

  Here, the arrow D <b> 1 represents a direction from the center of the imaging surface 201 to the center of the target imaging surface 202. Therefore, the object direction estimation unit 45 estimates the direction represented by the arrow D1 as the object direction.

  The notification processing unit 46 notifies the object direction. For example, the notification processing unit 46 may notify the object direction using at least one of image, sound, light, and vibration. When notifying the object direction using an image, the notification processing unit 46 may display an image or the like indicating the object direction on the display unit 10. Hereinafter, an image indicating the object direction is referred to as a notification image. Specifically, it is preferable that the notification processing unit 46 generates an arrow image or the like indicating the object direction as a notification image.

  Then, the notification processing unit 46 displays an image obtained by superimposing (combining) the notification image and the input image of the imaging unit 30 on the display unit 10. The notification image may include an image that emphasizes the target object. Specifically, the notification processing unit 46 generates an image obtained by combining the input image of the imaging unit 30 with an arrow image indicating the direction of the object. Then, the notification processing unit 46 displays the generated composite image on the display unit 10. Therefore, the input image of the imaging unit 30 and the object direction change according to the shooting position and shooting direction. That is, the composite image generated by the notification processing unit 46 changes according to the shooting position and the shooting direction. In addition, it is preferable that an object is displayed at the center of the display unit 10. This is because displaying an object at the center of the display unit 10 means that the object is located on the optical axis of the imaging unit 30. Therefore, it is preferable that the notification processing unit 46 notifies the object direction so that the display position of the object is at the center of the display unit 10.

  Further, the notification processing unit 46 may output a sound indicating the direction of the object. For example, in the case of FIG. 5A, a voice such as “There is a Cassiopeia seat in the left direction” may be output.

  Further, the notification processing unit 46 may notify the distance between the object direction and the information providing apparatus by light, vibration, or the like. In that case, it is preferable that the alerting | reporting process part 46 is equipped with LED (Light Emitting Diode, not shown) and a vibrator (not shown). For example, the notification processing unit 46 may make the light blink faster as the object approaches the position within the angle of view of the imaging unit 30. Further, the notification processing unit 46 may shorten the period of vibration as the object approaches a position that is within the angle of view of the imaging unit 30.

  FIG. 5 is a diagram illustrating an example of an object direction and a notification image. FIG. 5A shows an example of the object direction. Arrow D2 indicates the object direction. That is, in the case of FIG. 5A, the arrow D2 represents the direction from the center point P411 of the imaging surface 211 to the center of the target imaging surface.

  On the other hand, FIG. 5B shows an example of a display image on the display unit 10. In the case of FIG.5 (b), the imaging part 30 assumes that the image containing a mountain and a star was acquired as an input image. In that case, as illustrated in FIG. 5B, the notification processing unit 46 generates an image obtained by combining the arrow image 301 indicating the object direction D <b> 2 and the input image of the imaging unit 30.

  FIG. 6 is a diagram illustrating an example of a notification image. In FIG. 6, it is assumed that the object setting unit 41 sets “Cassiopeia” as an object. FIG. 6A is a diagram illustrating an example of a case in which no cassiopeia seat exists within the angle of view of the imaging unit 30. Here, it is assumed that the object direction estimation unit 45 estimates that the Cassiopeia locus exists in the left direction. In the case of FIG. 6A, the notification processing unit 46 generates a notification image including an arrow image 311 indicating the left direction and a constellation name 312. Then, the notification processing unit 46 generates an image obtained by combining the notification image and the input image of the imaging unit 30 and displays the image on the display unit 10. In the case of FIG. 6A, the notification processing unit 46 displays “Cassiopeia” as the constellation name 312.

  On the other hand, FIG. 6B is a diagram illustrating an example in which a Cassiopeia seat exists within the angle of view of the imaging unit 30. In the case of FIG. 6B, a star mark indicating a Cassiopeia locus and a constellation line are displayed. Here, in the case of FIG. 6B, the Cassiopeia seat is displayed on the upper left of the display unit 10. Therefore, in the case of FIG. 6B, the notification processing unit 46 generates an arrow image 313 indicating the upward direction and the left direction and displays it on the display unit 10. Therefore, the user preferably changes the position and angle of the information providing apparatus in the direction indicated by the arrow image 313. That is, in order for the user to guide the user to point the imaging unit 30 toward the target, the notification processing unit 46 notifies the target direction.

  The image quality parameter control unit 47 controls the image quality parameter based on the object information. The image quality parameters include the number of added sheets, focal length, brightness, color tone, saturation, exposure time, white balance, and the like. The added number will be described later.

  For example, when the type of the object is a constellation, the image quality parameter control unit 47 sets the focal length to infinity. Further, the image quality parameter control unit 47 may change the brightness, white balance, exposure time, etc. according to the luminous intensity of the stars constituting the constellation. For example, the image quality parameter control unit 47 preferably lengthens the exposure time as the luminous intensity of the stars constituting the constellation is lower. Alternatively, the image quality parameter control unit 47 may increase the brightness as the luminous intensity of the stars constituting the constellation is lower. Further, the image quality parameter control unit 47 may change the color tone based on the color of a star or a nebula constituting a constellation. In that case, the object information includes colors such as stars or nebulae constituting a constellation.

  As described above, the image quality parameter control unit 47 changes the image quality parameter based on the object information (for example, the luminous intensity of the star), so that the imaging unit 30 can capture an image suitable for the object.

  The noise removal processing unit 48 performs image processing for removing noise in the captured image. For example, the noise removal processing unit 48 may perform wavelet transform on the captured image and extract a high frequency component. And the noise removal process part 48 removes the extracted high frequency component, and performs inverse wavelet transformation. As a result, the noise removal processing unit 48 can generate an image from which noise has been removed. There are various types of image processing for removing noise, but the details are not limited.

  The added image generation unit 49 generates an image obtained by adding a predetermined number of photographed images. In the following description, the image generated by the added image generation unit 49 is referred to as an added image. Further, in the following description, the number to be added is referred to as an added number. Specifically, the addition image generation unit 49 adds the pixel values of the captured image to generate an addition image. Therefore, each pixel value of the added image is higher than each pixel value before addition. That is, the brightness of the added image is higher than the brightness of the captured image.

  Note that the addition image generation unit 49 may add pixels recursively. For example, when four captured images are added, first, the added image generation unit 49 duplicates the captured image. Then, the addition image generation unit 49 adds the original captured image and the duplicate image. Thereafter, the addition image generation unit 49 duplicates the generated image (referred to as a first addition image). Then, the addition image generation unit 49 may add the first addition image and the copied first addition image.

  The image quality parameter control unit 47 may determine the additional number based on the object information. For example, when the object is a constellation, the image quality parameter control unit 47 may determine the number of additions based on the luminous intensity of the stars constituting the constellation. Specifically, the image quality parameter control unit 47 calculates the average luminous intensity of the stars constituting the constellation. The image quality parameter control unit 47 may increase the number of added images as the calculated average luminous intensity is lower.

  Alternatively, the image quality parameter control unit 47 may determine the number of additions based on the luminous intensity of a predetermined star constituting the constellation. For example, the image quality parameter control unit 47 may select a star with the lowest luminous intensity from the stars constituting the constellation as the predetermined star to be selected. The image quality parameter control unit 47 preferably increases the number of added images as the luminous intensity of the selected predetermined star is lower.

  FIG. 7 is a diagram illustrating an example of the relationship between the added number of sheets and the luminous intensity of a star. A line D1 is a line representing the correspondence between the number of added sheets and the luminous intensity of the stars. Here, in the case of FIG. 7, the luminous intensity P1 is higher than the luminous intensity P2. In the case of FIG. 7, when the luminous intensity P1 is used as a reference, the image quality parameter control unit 47 sets the added number to four. On the other hand, when the luminous intensity P2 is used as a reference, the image quality parameter control unit 47 sets the added number to eight. The greater the added number, the higher the brightness of the added image. Therefore, in the case of FIG. 7, when the image quality parameter control unit 47 determines the number of additions, the lightness of the addition image is higher as the brightness of the reference star is lower.

  Next, the operation of the information providing apparatus 1 will be described.

  FIG. 8 is a flowchart illustrating an example of an operation related to the notification process of the object direction.

  In step S1, the object setting unit 41 sets an object. Then, the process proceeds to step S2.

  For example, the user inputs the name of a constellation as an object through the operation unit 20. The object setting unit 41 sets a constellation input via the operation unit 20 as an object. Alternatively, the storage unit 90 may store a plurality of predetermined constellations as object candidates in advance. Then, the control unit 40 may display the candidate object on the display unit 10. In that case, the user selects the constellation of the target object from the displayed target object candidates. The object setting unit 41 sets the selected constellation as the constellation of the object. There are various methods for setting the constellation of the object, but the details are not limited.

  In step S2, the object information acquisition unit 42 acquires object information including the object position. Specifically, first, the object information acquisition unit 42 refers to the clock 80 and acquires the current date and time. And the target object information acquisition part 42 calculates a target object position based on date, time, and star map data. The object information acquisition unit 42 acquires information including the elevation angle and depression angle of the constellation of the object as the object position.

  In step S3, the shooting position estimation unit 43 detects a shooting position. In step S4, the shooting direction estimation unit 44 estimates the shooting direction.

  In step S5, the imaging unit 30 acquires a background image. The background image corresponds to an input image for the imaging unit 30.

  In step S6, the object direction estimation unit 45 estimates the object direction based on the imaging position, the imaging direction, and the object position.

  In step S7, the notification processing unit 46 notifies the object direction. And it changes to step S8. Note that the control unit 40 may stop displaying the notification image based on an operation on the operation unit 20. Specifically, when the operation unit 20 detects a predetermined operation, the control unit 40 may perform processing such as hiding the notification image. For example, when the notification image and the display position of the object overlap, the user may hide the notification image after confirming the object direction.

  In step S <b> 8, the control unit 40 determines whether or not the operation unit 20 has detected a process end operation. For example, the control unit 40 may display a process end icon, menu, or the like on the display unit 10. When the operation on the process end icon or the like is detected, the operation unit 20 may detect the process end operation. There are various operations for finishing the process, but the details are not limited.

  When the process end operation is detected (Yes branch in step S8), the control unit 40 ends the notification process of the object direction. If an operation for ending the process is not detected (No branch in step S8), the process proceeds to step S3 and the process is continued. Note that the order of processing from step S1 to step S5 is not limited to the order shown in FIG.

  FIG. 9 is a flowchart illustrating an example of an operation related to correction of a captured image.

  In step S101, the control unit 40 determines whether or not the operation unit 20 has detected a shooting operation. For example, the information providing apparatus 1 may include a shutter button as the operation unit 20. Alternatively, a shooting icon, a menu, or the like may be displayed on the display unit 10. In this case, when an operation on a shooting icon or the like is detected, the operation unit 20 may detect a shooting operation.

  Here, when the object is displayed at a predetermined position, the notification processing unit 46 may notify that the state is suitable for photographing. For example, when the object is displayed at the center of the display unit 10, the notification processing unit 46 may notify that the state is suitable for shooting. When the notification processing unit 46 is in a state suitable for photographing, it is preferable to perform processing such as changing the color of the notification image. Or the alerting | reporting process part 46 may alert | report that it is a state suitable for imaging | photography with a character, an audio | voice, etc. FIG.

  When a photographing operation is detected (Yes branch in step S101), the process proceeds to step S102. When the photographing operation is not detected (No branch in step S101), the process proceeds to step S101 and the process is continued.

  In step S102, the image quality parameter control unit 47 determines an image quality parameter based on the object information. In step S103, the imaging unit 30 captures an object with the determined image quality parameter.

  In step S104, the noise removal processing unit 48 performs a process of removing noise from the captured image. In step S105, the addition image generation unit 49 adds a predetermined number of captured images from which noise has been removed. Thereafter, the control unit 40 displays the added image on the display unit 10 (step S106). And it changes to step S107.

  FIG. 10 is a diagram illustrating an example of a captured image and an added image. FIG. 10A is a diagram illustrating an example of a captured image. FIG. 10B is a diagram illustrating an example of the addition image. As shown in FIG. 10A, the brightness of the photographed image may be lowered. Therefore, the added image generation unit 49 generates an added image by superimposing the captured images. As a result, as shown in FIG. 10B, the addition image generation unit 49 can generate an image with high brightness.

  In step S107, the control unit 40 determines whether to save the added image. For example, when the operation unit 20 detects an operation for saving the added image, the control unit 40 may determine to save the added image. For example, the control unit 40 may display an image storage icon, menu, and the like on the display unit 10. When an operation for an image storage icon or the like is detected, the operation unit 20 may detect an image storage operation.

  When storing the added image (Yes branch in step S107), the control unit 40 stores the added image in the captured image storage unit 92 (step S108). When the addition image is not stored (No branch in step S107), the process returns to step S103 and the process is continued.

  As described above, the information providing apparatus 1 according to the present embodiment estimates the direction of the object based on the difference between the position of the object and the current position, and notifies the direction of the object. Therefore, the information providing apparatus 1 according to the present embodiment can guide the user in the direction of the object even when the user does not know the position of the object. Furthermore, in the information providing apparatus 1 according to the present embodiment, information related to the object is stored in advance. Therefore, the information providing apparatus 1 according to the present embodiment guides in the direction of the object and provides information suitable for photographing the object.

  In the above-described embodiment, an example in which the notification processing unit 46 notifies the user of the object direction using at least one of image, sound, light, and vibration has been described. However, the notification processing unit 46 may notify the user of the object direction using another method.

  A part or all of the above embodiments can be described as in the following supplementary notes, but is not limited thereto.

  (Supplementary Note 1) An imaging unit that captures an object, an imaging position estimation unit that estimates an imaging position, an imaging direction estimation unit that estimates an imaging direction, and object information acquisition that acquires object information including the object position A target direction estimating unit for estimating a target direction based on the shooting position, the shooting direction, and the target position, a notification processing unit for reporting the target direction, and the target information. And an image quality parameter control unit that controls the image quality parameter based on the information providing device.

  (Additional remark 2) The said object direction estimation part is an information provision apparatus which estimates the direction with respect to the center of an object imaging surface from the center of an imaging surface as the said object direction.

  (Additional remark 3) The information provision apparatus provided with the display part which displays an image, and the said alerting | reporting process part displays the image which overlap | superposed the alerting | reporting image and the input image of the said imaging part on the said display part.

  (Supplementary Note 4) The information providing apparatus, wherein the notification processing unit generates an image including an arrow image indicating the object direction as the notification image.

  (Additional remark 5) An information provision apparatus provided with the addition image production | generation part which produces | generates the image which added the predetermined addition number of the picked-up image.

(Appendix 6) A bearing sensor and an acceleration sensor are provided.
The imaging direction estimation unit is an information providing apparatus that estimates the imaging direction based on outputs of the direction sensor and the acceleration sensor.

  (Additional remark 7) The said image quality parameter is an information provision apparatus containing at least any one of the said addition number of sheets, a focal distance, brightness, a color tone, saturation, exposure time, and white balance.

  (Supplementary Note 8) When the object includes a constellation, the object information acquisition unit acquires constellation information as the object information when the object is a constellation, and the image quality parameter control unit includes the object An information providing device that sets the focal length to infinity when is a constellation.

  (Additional remark 9) The process of image | photographing a target object, the process of estimating a shooting position, the process of estimating a shooting direction, the process of acquiring the target object information containing a target object position, the said shooting position, and the said shooting direction And an object direction estimating step for estimating an object direction based on the object position, an informing step for notifying the object direction, a step of controlling an image quality parameter based on the object information, Information providing method including

  (Additional remark 10) The information provision method which estimates the direction with respect to the center of an object imaging surface from the center of an imaging surface as the said object direction in the said object direction estimation process.

  (Additional remark 11) The information provision method which produces | generates the image which overlap | superposed the alerting | reporting image and the input image of the said imaging part in the said alerting | reporting process.

  (Additional remark 12) The information provision method which produces | generates the image containing the arrow image which shows the said object direction as the said alerting | reporting image in the said alerting | reporting process.

  (Additional remark 13) The information provision method including the addition image production | generation process which produces | generates the image which added the image | photographed image the predetermined addition number of sheets.

  (Supplementary Note 14) A program that is executed by a computer that controls the information providing apparatus, and includes a process of photographing an object, a process of estimating a photographing position, a process of estimating a photographing direction, and an object including the position of the object A process for obtaining information, an object direction estimation process for estimating an object direction based on the imaging position, the imaging direction, and the object position; an informing process for informing the object direction; And a program for controlling the image quality parameter based on the object information.

  (Additional remark 15) The said target direction estimation process WHEREIN: The program which estimates the direction with respect to the center of a target imaging surface from the center of an imaging surface as said target object direction.

  (Additional remark 16) The said alerting | reporting process WHEREIN: The program which produces | generates the image which superimposed the alerting | reporting image and the input image of the said imaging part.

  (Additional remark 17) The said alerting | reporting process WHEREIN: The program which produces | generates the image containing the arrow image which shows the said object direction as said alerting | reporting image.

  (Additional remark 18) The program which performs the addition image production | generation process which produces | generates the image which added the photography image and the predetermined addition number of sheets.

  Each disclosure of the cited patent documents and the like cited above is incorporated herein by reference. Within the scope of the entire disclosure (including claims) of the present invention, the embodiments and examples can be changed and adjusted based on the basic technical concept. In addition, various combinations of various indication elements (including each element of each claim, each element of each embodiment or example, each element of each drawing, etc.) within the scope of the claims of the present invention, Selection is possible. That is, the present invention of course includes various variations and modifications that could be made by those skilled in the art according to the entire disclosure including the claims and the technical idea.

DESCRIPTION OF SYMBOLS 1,100 Information provision apparatus 10 Display part 20 Operation part 30,101 Imaging part 40 Control part 41 Object setting part 42,104 Object information acquisition part 43,102 Shooting position estimation part 44,103 Shooting direction estimation part 45,105 Object direction estimation unit 46, 106 Notification processing unit 47, 107 Image quality parameter control unit 48 Noise removal processing unit 49 Addition image generation unit 50 GPS antenna 60 Direction sensor 70 Acceleration sensor 80 Clock 90 Storage unit 91 Star data storage unit 92 Photographed image Storage unit 201, 211 Imaging surface 202 Target imaging surface 301, 311, 313 Arrow image 312 Constellation name

Claims (10)

An imaging unit for photographing an object;
A shooting position estimation unit for estimating the shooting position;
A shooting direction estimation unit for estimating a shooting direction;
An object information acquisition unit for acquiring object information including the object position;
An object direction estimation unit that estimates an object direction based on the imaging position, the imaging direction, and the object position;
A notification processing unit for reporting the direction of the object;
An image quality parameter control unit for controlling an image quality parameter based on the object information;
An information providing apparatus comprising:   The information providing apparatus according to claim 1, wherein the object direction estimation unit estimates a direction from the center of the imaging surface to the center of the target imaging surface as the object direction. A display unit for displaying images;
The information providing apparatus according to claim 1, wherein the notification processing unit displays an image obtained by superimposing a notification image and an input image of the imaging unit on the display unit.   The information providing apparatus according to claim 3, wherein the notification processing unit generates an image including an arrow image indicating the object direction as the notification image.   The information providing apparatus according to claim 1, further comprising an addition image generation unit that generates an image obtained by adding a predetermined number of captured images.   The information providing apparatus according to claim 5, wherein the image quality parameter includes at least one of the added number, focal length, brightness, color tone, saturation, exposure time, and white balance. It is equipped with an orientation sensor and an acceleration sensor,
The information providing apparatus according to claim 1, wherein the shooting direction estimation unit estimates the shooting direction based on outputs of the direction sensor and the acceleration sensor. The object includes a constellation;
The object information acquisition unit acquires constellation information as the object information when the object is a constellation,
The information providing apparatus according to any one of claims 1 to 7, wherein the image quality parameter control unit sets a focal length to infinity when the object is a constellation. A process of photographing the object;
Estimating the shooting position;
Estimating the shooting direction;
Acquiring object information including the object position;
An object direction estimation step for estimating an object direction based on the imaging position, the imaging direction, and the object position;
An informing step of informing the object direction;
Controlling image quality parameters based on the object information;
An information providing method comprising: A program for causing a computer that controls the information providing apparatus to execute the program,
Processing to photograph the object,
A process of estimating the shooting position;
A process of estimating the shooting direction;
Processing to obtain object information including the object position;
An object direction estimation process for estimating an object direction based on the imaging position, the imaging direction, and the object position;
An informing process for informing the object direction;
Processing for controlling image quality parameters based on the object information;
A program that executes.

Images