JP2016029862A - Portable device and map image display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portable device which allows a user to easily switch the display range of a map image even while holding the portable device in his or her hand.SOLUTION: When it is determined from an output from an acceleration detection unit 25 that a camera 1 is held sideways during display of a through image, it is determined from an output from the acceleration detection unit 25 whether acceleration in a direction parallel to the present orientation of the camera 1 has occurred or not. If it is determined that an acceleration in a direction parallel to the present orientation of the camera 1 has occurred, a map image of a predetermined range distant with respect to the present orientation of the camera 1 is displayed.SELECTED DRAWING: Figure 10

Description

  The present invention relates to a portable device capable of displaying a captured image and a map image and a map image display method.

  In recent years, a portable device such as a digital camera that can display a map image has been proposed. For example, the portable device proposed in Patent Document 1 includes a position detection unit such as a GPS (Global Positioning System) module, and displays a map image around the current position detected by the position detection unit. It is configured. In addition, the portable device proposed in Patent Document 1 can also display an electronic viewfinder (also referred to as a through image display), so that display switching between an electronic viewfinder image and a map image can be performed smoothly. The display is switched between the electronic viewfinder image and the map image in accordance with the change in posture of the mobile device.

Japanese Patent No. 4264099

  Here, in Patent Document 1, a map image around the current position of the mobile device is displayed. However, Patent Literature 1 does not particularly mention improvement in operability when switching the display range of the map image. For example, conventionally, as an operation for switching the display range of the map image, a method of switching the display range of the map image according to a finger slide operation on the touch panel is known. When such a method is applied to Patent Document 1, the user performs an operation of switching the display range of the map image while holding the portable device. In this case, it is particularly difficult to operate the portable device with both hands.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a mobile device and a map image display method capable of easily switching the display range of a map image even while holding the mobile device. And

  In order to achieve the above object, a portable device according to one aspect of the present invention is a portable device that shapes a map image into a predetermined shape and displays the resultant image combined with a captured image displayed on a display unit. An azimuth detecting unit that detects the azimuth of the sensor and an acceleration detecting unit that detects acceleration generated in the portable device, and the acceleration detecting unit detects acceleration in a direction parallel to the azimuth detected by the azimuth detecting unit. In this case, a map image farther than the map image shaped into the predetermined shape displayed on the display unit is displayed in the predetermined shape.

  In order to achieve the above object, a map image display method according to an aspect of the present invention includes a map image display method for a mobile device that combines a captured image with a map image and displays the map image on a display unit. A detecting step for detecting, a first determining step for determining whether the portable device is in a photographing posture in a direction parallel to the ground surface based on the detected first acceleration, and the portable device on the ground surface. A second determination step for determining whether or not a second acceleration indicating movement in a direction parallel to the ground surface is detected when the photographing posture is in a direction parallel to the surface; When a second acceleration indicating movement in a direction parallel to the ground surface is detected, a map image that is displayed superimposed on the captured image of the display unit is displayed as a map farther than the map image. Place to change to image And having an image changing step.

  ADVANTAGE OF THE INVENTION According to this invention, even if it has a portable apparatus, the portable apparatus and map image display method which can switch the display range of a map image easily can be provided.

It is a figure which shows the structure of the digital camera as an example of the portable apparatus which concerns on one Embodiment of this invention. It is the figure which showed the relationship between the direction of a captured image and a map image. It is the figure which showed the mode when the user is holding the digital camera. It is a figure which shows the example of a map image. It is a figure which shows the example of a display of the map image in the through image display in one Embodiment of this invention. It is the figure shown about operation for displaying a map image. It is the figure shown about the enlarged display of a map image. It is the figure shown about switching operation from the overlapping display of a map image to an enlarged display. It is the figure shown about switching operation from the enlarged display to the overlapping display of a map image. It is a flowchart shown about control of the imaging | photography mode of the digital camera which concerns on one Embodiment of this invention. It is a figure for demonstrating the acquisition process of map image data. It is a flowchart shown about control of map display mode. It is the figure shown about switching operation of the display range of the map image in map display mode. It is a flowchart shown about control of reproduction | regeneration mode. It is the figure shown about the display operation of the map image in reproduction | regeneration mode. It is a figure which shows the example of the map image data which has altitude information. It is the figure which showed the example of the acquisition process of the map image data in consideration of altitude information.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a diagram illustrating a configuration of a digital camera as an example of a portable device according to an embodiment of the present invention. A digital camera (hereinafter referred to as a camera) 1 according to the present embodiment includes a control unit 11, a data recording unit 12, a button operation unit 13, a touch panel 14, an imaging unit 15, a storage unit 16, and a display driving unit. 17, display unit 18, image processing unit 19, compression / decompression unit 20, recording / playback unit 21, image recording unit 22, orientation detection unit 23, position detection unit 24, and acceleration detection unit 25. ,have.

  The control unit 11 is composed of, for example, a CPU (Central Processing Unit), and comprehensively controls the operation of the camera 1. The control unit 11 has functions as a GUI (Graphical User Interface) control unit 11a, a function execution unit 11b, a display control unit 11c, a map image acquisition unit 11d, and an operation detection unit 11e. The function as the GUI control unit 11a receives GUI display data recorded in the GUI data recording unit 12a of the data recording unit 12, outputs the GUI display data to the display driving unit 17, and displays the GUI screen on the display unit 18. It is a function to let you. The function as the function execution unit 11b is a function for executing the operation of the camera 1 in accordance with the operation of the button operation unit 13 or the touch panel 14 detected by the function of the operation detection unit 11e. The function as the display control unit 11c is to display various images based on captured image data recorded in the image recording unit 22, map image data recorded in the map data recording unit 12c, and the like on the display unit 18. This function performs control. The function as the map image acquisition unit 11d is a function of acquiring a predetermined range of map image data from the map data recording unit 12c based on outputs from the azimuth detection unit 23, the position detection unit 24, and the like. The function as the operation detection unit 11 e is a function of detecting an operation of the button operation unit 13 or the touch panel 14 by detecting an operation signal from the button operation unit 13 or the touch panel 14.

  Further, the control unit 11 is connected to the imaging unit 15, the storage unit 16, the display driving unit 17, the image processing unit 19, the compression / decompression unit 20, the recording / reproducing unit 21, and the orientation via the bus line 30. The detector 23, the position detector 24, and the acceleration detector 25 are connected.

  The data recording unit 12 is configured by an electrically rewritable nonvolatile memory such as a flash memory. The data recording unit 12 has recording areas as a GUI data recording unit 12a, a program recording unit 12b, and a map data recording unit 12c. The GUI data recording unit 12a is a recording area for recording GUI display data. The GUI display data is information necessary for causing the display unit 18 to display a GUI screen for performing an operation on the display screen of the display unit 18. This GUI display data is composed of icon data and the like. The program recording unit 12b is a recording area for recording a control program for the camera 1 executed by the function execution unit 11b and control parameters necessary for executing the control program. The map data recording unit 12c is a recording area for recording map image data. Here, the map image data is associated with position (latitude / longitude) information.

  The button operation unit 13 is an operation member that is operated by a pressing operation such as a release button, a power button, a zoom button, a mode button, a cross button, and a determination button. Each button outputs a signal by a pressing operation. Here, the release button is a button for the user to instruct the photographing timing. The power button is a button for instructing to turn on or off the power of the camera 1. The zoom button is a button used for instructing zooming. The mode button is a button used to change the operation mode of the camera 1. The cross button is, for example, a button used for selecting an item on the GUI screen. The determination button is a button used for determining an item on the GUI screen, for example. The various buttons described above are not necessarily configured as a button-type operation unit.

  The touch panel 14 that functions as an example of the contact detection unit is disposed, for example, on the display screen of the display unit 18. The touch panel 14 outputs a signal from the contact position when a finger touches. This touch panel 14 detects a touch operation on an icon displayed on the GUI screen.

The imaging unit 15 includes a camera unit and an imaging processing unit.
The camera unit is for capturing a subject image, and includes an imaging optical system, an imaging element, an aperture, a shutter, an AF mechanism, an AF drive circuit, a zoom mechanism, a zoom drive circuit, and the like. The imaging optical system has a plurality of lenses such as a focus lens and a zoom lens, and collects a subject image and forms it on an imaging device. The imaging device is a two-dimensional solid-state imaging device such as a CCD sensor or a CMOS sensor, and photoelectrically converts a subject image incident through the imaging optical system and outputs it as an analog electrical signal. The diaphragm is disposed in, for example, the imaging optical system, and restricts the light beam incident on the imaging element through the imaging optical system by being narrowed down. For example, the shutter is configured to be movable back and forth with respect to the light receiving surface of the image sensor, and the light receiving surface of the image sensor is in a light shielding state or an exposed state. The AF mechanism is a function for driving the focus lens. By driving the focus lens, the focal position of the imaging optical system is adjusted. The AF drive circuit is a drive circuit for driving the AF mechanism. The zoom mechanism is a function for driving the zoom lens. By driving the zoom lens, the angle of view of the imaging optical system is adjusted. The zoom drive circuit is a drive circuit for driving the zoom mechanism.

  The imaging processing unit includes an imaging element driving circuit, an analog processing circuit, an A / D conversion circuit, and the like. The image sensor driving circuit drives the image sensor and reads an analog electric signal from the image sensor. The analog processing circuit performs analog signal processing such as AGC (Auto Gain Control) processing and CDS (Correlated Double Sampling) processing on the analog electric signal output from the image sensor. The AGC process is a process of amplifying an analog electric signal from the image sensor with a predetermined gain. The CDS process is a process for removing dark current noise and the like included in an analog electric signal. The A / D conversion circuit converts the analog electric signal analog-processed by the analog processing circuit into a digital electric signal and outputs the digital electric signal.

  The storage unit 16 is configured by, for example, SDRAM. The storage unit 16 is used as a working area when the control unit 11 or the like executes various processes. The storage unit 16 temporarily stores various data such as digital electrical signals (referred to as RAW data) obtained by the imaging unit 15 and captured image data obtained by processing in the image processing unit 19. Also used to keep.

  The display driving unit 17 has a D / A conversion circuit and the like. The D / A conversion circuit resizes the captured image data, map image data, and the like received from the control unit 11 according to the size of the display screen of the display unit 18, and displays the resized captured image data, map image data, and the like on the display unit. 18 to display an image on the display unit 18.

  The display unit 18 is connected to the display driving unit 17 and is a display unit such as an LCD (Liquid Crystal Display) or an ELD (Electroluminescence Display). For example, the display unit 18 is exposed on the back of the main body of the camera 1 and displays various images such as a captured image, a map image, and a through image based on the image data input from the display driving unit 17. The display unit 18 also displays a GUI screen based on the GUI display data input from the display driving unit 17.

  The image processing unit 19 performs image processing on the digital electrical signal output from the imaging unit 15 to obtain captured image data. Examples of the image processing include pixel interpolation processing, color correction processing, and gamma processing. The pixel interpolation process is a process of adding data of a plurality of adjacent pixels or creating new pixel data from a plurality of adjacent pixel data. The color correction process is a process for correcting the color of an image to be suitable for display or recording. The gamma processing is processing for correcting the gradation of an image to be suitable for display and recording. The image processing unit 19 performs image processing for recording at the time of recording (at the time of shooting), and performs simple image processing for display when displaying a through image.

  The compression / decompression unit 20 performs a compression process based on, for example, a well-known JPEG method on the captured image data obtained by the image processing unit 19 during recording (at the time of shooting). The compression / decompression unit 20 performs decompression processing based on a well-known JPEG method on the compressed captured image data recorded in the image recording unit 22 during reproduction.

  The recording / reproducing unit 21 is used for writing an image file to the image recording unit 22 and reading an image file from the image recording unit 22, and a unit corresponding to the type of the image recording unit 22 is used. The recording / playback unit 21 also deletes some image files recorded in the image recording unit 22 and initializes the recording state of the image recording unit 22 (all deletion of image files).

  The image recording unit 22 is a recording medium for recording an image file. The image recording unit 22 is, for example, a recording medium that is detachable from the camera body such as an SD card (registered trademark) or a compact flash (registered trademark) card, or a recording medium that is built into the camera body such as an HDD (Hard Disc Drive). It is.

  The azimuth detecting unit 23 detects the current azimuth of the camera 1 (for example, an azimuth based on the north). The azimuth detecting unit 23 is constituted by an electronic compass, for example. It is also possible to detect the orientation of the imaging optical system from the orientation detected by the orientation detection unit 23.

  The position detection unit 24 detects the current position (for example, latitude and longitude) of the camera 1. The position detector 24 is, for example, a GPS module, and detects the current position of the camera 1 by receiving signals from a plurality of GPS satellites (not shown).

  The acceleration detection unit 25 detects the acceleration generated in the camera 1. The acceleration detection unit 25 includes three acceleration detection units that respectively detect triaxial accelerations set in the main body of the camera 1 as shown in FIG. In the example of FIG. 2, when the user holds the camera 1 in the horizontal position, the direction parallel to the ground surface and perpendicular to the optical axis of the imaging optical system is taken as the X axis and perpendicular to the ground surface. The direction is set to the Y axis, and the direction parallel to the ground surface and parallel to the optical axis of the imaging optical system is set to the Z axis. The positive direction of the X axis is the left hand direction when the camera 1 is viewed from the front, the positive direction of the Y axis is the sky direction when the camera 1 is viewed from the front, and the positive direction of the Z axis is the camera direction. The direction toward the front of 1.

  Here, the posture of the camera 1 can also be detected depending on which of the acceleration detection units constituting the acceleration detection unit 25 detects gravity. In this case, the acceleration detection unit 25 also functions as a posture detection unit. Acceleration detection and posture detection may be performed by separate acceleration detection units, or posture detection may be performed using an angular velocity detection unit or the like.

  Next, the operation of the mobile device according to the present embodiment will be described. At the time of recording a captured image, the user 100 faces the subject (for example, a building) 200 while holding the camera 1 as shown in FIG. At this time, an image in a plane perpendicular to the ground surface including the subject 200 is acquired as a captured image. On the other hand, it is assumed that the map image data recorded in the map data recording unit 12c is image data indicating a map viewed from above as shown in FIG. In this case, the orientation of the captured image and the orientation of the map image are orthogonal to each other as shown in FIG.

  For example, it is assumed that through image display is performed with the camera 1 held as shown in FIG. In the live view display, a live view display captured image (hereinafter referred to as a live view image) 181 obtained via the image pickup unit 15 as shown in FIG. 5A is sequentially displayed on the display unit 18. With such a through image display, the display unit 18 can be used as a finder.

  In the present embodiment, as shown in FIG. 6, the map 1 is displayed while the through image is displayed by moving the camera 1 forward (operation for applying acceleration in the Z-axis direction). Here, during live view display, it is better to be able to identify what is in the direction in which the camera 1 is facing. Therefore, in the present embodiment, for example, a map of a predetermined range in a direction parallel to the current azimuth of the camera 1 detected by the azimuth detection unit 23 from the current position of the camera 1 detected by the position detection unit 24. An image is displayed. Here, if the map image as shown in FIG. 4 is displayed on the display unit 18 as it is, the display surface of the display unit 18 is perpendicular to the ground surface. Does not correspond to the landscape. Therefore, in this embodiment, the map image is shaped into a trapezoid as shown in FIG. In this trapezoidal shape, the width of the side far from the current position of the camera 1 (hereinafter referred to as the upper side) is shorter than the width of the side closer to the current position of the camera 1 (hereinafter referred to as the lower side). It is a trapezoid shape. Further, the orientation of the map image is such that the upper side of the map image is on the upper side of the display unit 18 as shown in FIG. Furthermore, an index indicating a place name in the map image, an index indicating the scale of the map image, an index indicating the current location, and the like may be displayed together with the map image.

  By superimposing the map image 182 as shown in FIG. 5B, the relationship between the through image and the map image corresponds to the relationship shown in FIG. For this reason, it becomes easy for the user to grasp the relationship between the through image and the map image. Further, the operation for displaying the map image is an operation for moving the camera 1 forward as shown in FIG. 6, so that the operation can be performed while the display surface of the display unit 18 is in a state perpendicular to the ground surface. Is possible. For this reason, the user can perform a map image display operation while holding the camera 1 with both hands and viewing the through image.

  In the present embodiment, after the map image 182 is displayed as shown in FIG. 5B, the display range of the map image is switched by moving the camera 1 forward again. At this time, as shown in FIG. 5C, a map image 182a in a predetermined range far from the current display range is superimposed on the through image 181. The switching operation of the display range of the map image can also be performed while the user holds the camera 1 with both hands and watching the through image.

  In the state where the display shown in FIG. 5B or FIG. 5C is made, the user can view both the through image and the map image at the same time. Further, when the user performs a predetermined operation while the display of FIG. 5B or 5C is being performed, the map image 182 is enlarged and displayed as shown in FIG. As a predetermined operation for performing this display, for example, an operation of touching the lower part of the map image 182 as shown in FIG. 8A, an operation of turning the camera 1 downward as shown in FIG. Can be considered. Operations other than those shown in FIGS. 8A and 8B may be performed. In the enlarged display as shown in FIG. 7, the display area of the map image can be widened as compared with the display in FIG. 5B or 5 </ b> C.

  Further, when an operation reverse to that in FIG. 8 is performed during the enlarged display shown in FIG. 7, the display is returned to the display shown in FIG. 5B or 5C. That is, the display is returned when an operation of touching the upper portion of the map image 182 as shown in FIG. 9A or an operation of turning the camera 1 upward as shown in FIG. 9B is performed. . In addition, as shown in FIG. 9C, the display may be returned to the display of FIG. 5 in response to an operation of sliding a finger so as to move the map image 182 to the outside of the screen. When the operation shown in FIG. 9 is performed, the display is not returned to the display of FIG. 5B or 5C, but the display of the through image shown in FIG. May be.

  Hereinafter, the details of the map image display described above will be further described. FIG. 10 is a flowchart illustrating the shooting mode control executed by the control unit 11 of the camera 1. When the power of the camera 1 is turned on, the control unit 11 reads the control program recorded in the program recording unit 12b and starts the control in FIG. Thereafter, the operations of the azimuth detecting unit 23, the position detecting unit 24, and the acceleration detecting unit 25 are started.

  In FIG. 10, the control unit 11 first determines whether or not the operation mode of the camera 1 is a shooting mode (step S101). The camera 1 according to the present embodiment has at least a shooting mode, a playback mode, and a map display mode as operation modes. The shooting mode is an operation mode for obtaining a captured image for recording. The reproduction mode is an operation mode for reproducing the captured image recorded in the image recording unit 22. The map display mode is an operation mode for displaying an enlarged map image as shown in FIG. Switching between these operation modes is performed, for example, by a user operating a mode button.

  When it is determined in step S101 that the operation mode is the shooting mode, the control unit 11 starts imaging for displaying a through image by the imaging unit 15 (step S102). And the control part 11 performs a through image display (step S103). When displaying a through image, the control unit 11 causes the image processing unit 19 to perform an image process for displaying the through image on the digital electric signal for displaying the through image obtained via the imaging unit 15, The obtained through image data is output to the display driving unit 17. In response to this, the display driving unit 17 causes the display unit 18 to display a through image as shown in FIG.

  After the through image display, the control unit 11 determines whether or not a map image is being displayed (step S104). If it is determined in step S104 that the map image is not being displayed, the control unit 11 indicates that the output of the acceleration detection unit 25 that detects acceleration in the Y-axis direction indicates gravitational acceleration (about 9.8 m / s2). It is determined whether or not (step S105).

  If it is determined in step S105 that the output of the acceleration detection unit 25 that detects acceleration in the Y-axis direction indicates gravitational acceleration, that is, the camera 1 is held as shown in FIG. When it is considered that the face is facing the user, the control unit 11 determines whether or not a face image is present in the central portion of the through image data obtained by the image processing unit 19 (step). S106). In step S106, for example, when the feature amount of the eyelid is not detected from the central portion of the through image data, it is determined that no face image exists. In addition, as a simple method, for example, when a substantially circular outline is not extracted at the center of the through image data, it may be determined that no face image exists. Note that the determination in step S106 is performed because it is considered that the display of the map image is mainly used for landscape photography. When displaying a map image regardless of the application, the determination in step S106 is omitted.

  If it is determined in step S106 that there is no haze image at the center of the through image data, that is, that landscape photography is being performed, the control unit 11 determines whether acceleration in the Z-axis direction has occurred. (Step S107). In step S107, it is determined that acceleration in the Z-axis direction has occurred, for example, when the output of the acceleration detection unit 25 that detects acceleration in the Z-axis direction is equal to or greater than a predetermined value. The acceleration threshold is recorded in advance in the program recording unit 12b as a control parameter, for example.

  When it is determined in step S105 that the output of the acceleration detection unit 25 that detects acceleration in the Y-axis direction does not indicate gravitational acceleration, it is determined in step S106 that there is a cocoon image at the center of the through image data Or when it determines with the output of the acceleration detection part 25 which detects the acceleration of a Z-axis direction not having become more than predetermined value in step S107, the control part 11 transfers a process to step S115.

  When it is determined in step S107 that the output of the acceleration detection unit 25 that detects acceleration in the Z-axis direction has become equal to or greater than a predetermined value, that is, when the forward movement of the camera 1 as shown in FIG. 6 is detected. In addition, the control unit 11 acquires map image data from the map data recording unit 12c (step S108).

Here, the map image data acquisition process in step S108 will be described. First, as a first example, map image data is acquired in consideration of the angle of view of the camera 1. For example, if the camera 1 exists at the position of FIG. 11A on the map and the imaging optical system of the camera 1 is oriented in the direction shown in FIG. 11A, the image of FIG. A captured image within a range defined by the angle φ is acquired. In the first example, a map image in a range corresponding to this angle of view φ is displayed. For example, as shown in FIG. 11A, the side in the direction perpendicular to the current direction of the camera 1 including the current position of the camera 1 is set as the lower side, and the direction from the lower side is parallel to the current direction of the camera 1. Map image data is acquired in a rectangular range having an upper side that is a side separated by an integral multiple of a predetermined distance L (for example, 1 km), the length of the upper side corresponding to the angle of view φ. More specifically, in the first example, the width in the direction parallel to the current direction of the camera 1 including the current position of the camera 1 is (n × L) (n = 1, 2,...) The map image data in a rectangular range in which the width in the direction orthogonal to the current azimuth of 1 is (2 × n × Ltan (φ / 2)) is acquired. The value of n is set to 1 as an initial value, and is incremented by 1 every time the acceleration in the positive direction of the Z axis is applied to the camera 1. In this case, in the process of step S108, the map image data indicated by the map range 1 in FIG. 11A is acquired, and when acceleration in the positive direction of the Z axis is detected again in step S111, FIG. The map image data indicated by the map range 2 in FIG. In such a first example, it is possible to display a map image in which landmarks that can be photographed can be known from the current position.
Note that there may be a case where the corresponding map image data cannot be acquired by the above-described map image data acquisition process. In such a case, it is desirable to warn the user that the corresponding map image data does not exist. At this time, the control unit 11 displays a warning on the display unit 18, for example. In addition, if an audio playback unit is provided, a warning may be given by voice.

  As a second example, map image data may be acquired without considering the angle of view of the camera 1. In the second example, as shown in FIG. 11B, a side having a predetermined width W in a direction orthogonal to the azimuth of the camera 1 including the current position of the camera 1 is set as a lower side, and the current of the camera 1 is determined from the lower side. Map image data of a rectangular range having a side with a predetermined width W separated by an integral multiple of a predetermined distance L (for example, 1 km on the map image) in a direction parallel to the azimuth is acquired. More specifically, in the second example, the width in the direction including the current position of the camera 1 and parallel to the current direction of the camera 1 is (n × L) (n = 1, 2,...) Map image data in a rectangular range in which the width of the side in the direction orthogonal to the direction of 1 is W is acquired. The value of n is set to 1 as an initial value, and is incremented by 1 every time the acceleration in the positive direction of the Z axis is applied to the camera 1. In this case, in the process of step S108, map image data indicated by the map range 1 in FIG. 11B is acquired, and when acceleration in the positive direction of the Z axis is detected again in step S111, FIG. The map image data indicated by the map range 2 in FIG. In such a second example, it is possible to display a map image that can tell what the camera 1 is facing. Further, in the second example, the calculation of the range of the map image data can be simplified as compared with the first example.

  Here, in the first example and the second example, the distant map image data is acquired by L each time the camera 1 is moved forward. On the other hand, L may be variable. For example, L may be set according to the magnitude of acceleration in the positive direction of the Z axis, or L may be set according to the focal length of the imaging optical system, that is, the zoom state of the zoom lens. Furthermore, L may be changed by combining these.

  For example, when L is set according to the magnitude of acceleration, the relationship between L and the magnitude of acceleration is defined. For example, L = (αZ / α0) × L0 is defined. ΑZ in this equation is the acceleration in the Z-axis direction. Α0 is a predetermined acceleration magnitude, for example, a gravitational acceleration or a maximum acceleration that can be detected by the acceleration detecting unit 25. L0 is a predetermined value (for example, 1 km on the map image). By making L variable according to the acceleration in this way, for example, it is not necessary to move the camera 1 many times in order to display a distant map image.

  When L is set according to the zoom state, the relationship between L and the zoom position is defined. This relationship is stored in the map data recording unit 12c as a table, for example. This table is set so that L when the zoom lens is on the wide-angle side is shorter than L when the zoom lens is on the telephoto side.

  Returning to the description of FIG. After acquiring the map image data, the control unit 11 displays a map image based on the acquired map image data on the through image (step S109). Thereafter, the control unit 11 shifts the process to step S115. Here, in step S <b> 109, the control unit 11 inputs the map image data to the display driving unit 17. The display driving unit 17 resizes the input map image data in accordance with the size of the display screen of the display unit 18 and shapes it into a trapezoidal shape, and displays the map image data shaped in a trapezoidal shape on the through image data. This is displayed on the unit 18. Here, the height of the trapezoidal map image data is, for example, 1/2 of the original. Further, the ratio of the length of the upper side and the lower side is, for example, 1: 2. These values are examples and can be changed as appropriate.

  If it is determined in step S104 that the map image is being displayed, the control unit 11 determines whether or not acceleration in the Z-axis direction has occurred again (step S110).

  If it is determined in step S110 that the acceleration in the Z-axis direction has occurred again, the control unit 11 displays a map image farther in the direction parallel to the current orientation of the camera 1 on the through image (step S111). ). Thereafter, the control unit 11 shifts the process to step S115. The process of step S111 is similar to the processes of steps S108 and S109, and is different in that map image data in a range obtained by adding 1 to the value of n is newly acquired and displayed on the display unit 18.

  If it is determined in step S110 that acceleration in the Z-axis direction has not occurred again, the control unit 11 performs a touch operation on the lower part of the map image displayed on the display unit 18 by the user from the output of the touch panel 14. And whether or not the output of the acceleration detection unit 25 that detects acceleration in the Z-axis direction indicates gravitational acceleration (step S112).

  If it is determined in step S112 that the user has performed a touch operation on the lower part of the map image, or if it is determined that the output of the acceleration detection unit 25 that detects acceleration in the Z-axis direction indicates gravitational acceleration, that is, the camera When it is considered that the posture of 1 has changed downward (a state in which the imaging optical system faces the ground surface), the control unit 11 performs control of a map display mode to be described later.

  If it is determined in step S112 that the user has not performed a touch operation on the map image, and it is determined that the output of the acceleration detection unit 25 that detects acceleration in the Z-axis direction does not indicate gravitational acceleration, the control unit 11 Then, it is determined whether or not the output of the acceleration detector 25 that detects the acceleration in the Z-axis direction indicates negative gravitational acceleration (step S113). The state in which the output of the acceleration detection unit 25 that detects acceleration in the Z-axis direction indicates negative gravitational acceleration indicates a state in which the posture of the camera 1 is upward and gravity is applied to the back side of the camera 1. ing.

  When determining in step S113 that the output of the acceleration detection unit 25 that detects acceleration in the Z-axis direction does not indicate negative gravitational acceleration, the control unit 11 shifts the processing to step S115. In Step S113, when it is determined that the output of the acceleration detection unit 25 that detects acceleration in the Z-axis direction indicates negative gravitational acceleration, that is, when it is considered that the posture of the camera 1 has changed upward. The control unit 11 instructs the display driving unit 17 to end the display of the map image (step S114). Then, the control part 11 returns a process to step S101.

In addition, when it is determined No in Steps S105, S106, 107, and S113, or after Steps S109 and S111, the control unit 11 has instructed execution of shooting by the user, that is, the user has pressed the release button. It is determined whether or not (step S115).
If it is determined in step S115 that an instruction to perform shooting has not been given, the control unit 11 returns the process to step S101. If it is determined in step S115 that an instruction to perform shooting has been issued, the control unit 11 performs a shooting operation and a recording operation (step S116). In the photographing operation, the control unit 11 controls the AF driving circuit to drive the AF mechanism, thereby driving the focus lens to adjust the focal position of the imaging optical system. Thereafter, the control unit 11 starts imaging by the imaging unit 15 while driving the aperture and the shutter. Subsequently, the control unit 11 performs image processing for recording on the digital digital signal for recording obtained via the imaging unit 15 by the image processing unit 19. Then, the control unit 11 compresses the captured image data obtained by the image processing by the compression / decompression unit 20. Thereafter, the control unit 11 adds header information to the compressed captured image data to generate an image file, and causes the image recording unit 22 to record the generated image file via the recording / playback unit 21. Here, as header information, a file name, shooting date / time information, shooting location longitude information K, latitude information I, and the like are recorded in addition to an aperture value, a shutter value, a zoom state, and the like.

  Here, during the recording operation, the map image data superimposed on the through image data immediately before the photographing operation may be recorded in the image recording unit 22 together with the image file. In this case, the captured image data and the map image data may be recorded in a single file, or may be recorded in separate files. Further, the map image data may be recorded after being shaped into a trapezoid, or may be recorded before being shaped into a trapezoid.

  If it is determined in step S101 that the operation mode is not the shooting mode, the control unit 11 determines whether or not the operation mode is the reproduction mode (step S117). If it is determined in step S117 that the operation mode is the reproduction mode, the control unit 11 performs a reproduction mode process described later. If it is determined in step S117 that the operation mode is not the playback mode, that is, if the operation mode is the map display mode, the control unit 11 acquires map image data from the map data recording unit 12c (step S118). . Then, the control part 11 performs the process of the map display mode mentioned later. Here, since the process of step S118 may be the same as that of step S108, description thereof is omitted.

  FIG. 12 is a flowchart showing the control of the map display mode. In the map display mode, the control unit 11 stops the through image display on the display unit 18. Then, the control part 11 displays the map image currently displayed on the display part 18 on the whole surface of the display part 18 as shown in FIG. 7 (step S201). It is not necessary to correct the map image data into a trapezoidal shape for full-screen display.

  After displaying the map image on the entire surface, the control unit 11 determines whether or not the output of the acceleration detection unit 25 that detects acceleration in the Z-axis direction indicates gravitational acceleration (step S202). In step S202, when it is determined that the output of the acceleration detection unit 25 that detects acceleration in the Z-axis direction does not indicate gravitational acceleration, for example, when it is considered that the camera 1 is held sideways, the control unit 11 Then, it is determined whether or not the mode button has been operated (step S203). If it is determined in step S203 that the mode button has not been operated, the control unit 11 returns the process to step S201. If it is determined in step S203 that the mode button has been operated, the control unit 11 returns the process to step S101.

  If it is determined in step S202 that the output of the acceleration detection unit 25 that detects acceleration in the Z-axis direction indicates gravitational acceleration, that is, the camera 1 is held downward, and the display surface of the display unit 18 is When it is thought that it is facing the upper surface, the control part 11 determines whether the output of the acceleration detection part 25 which detects the acceleration of a Y-axis direction has shown weight acceleration (step S204).

  In step S204, when it is determined that the output of the acceleration detection unit 25 that detects acceleration in the Y-axis direction does not indicate gravitational acceleration, that is, when it is considered that the posture of the camera 1 remains downward, the control unit 11 Determines from the output of the touch panel 14 whether or not the user has touched the top of the map image (step S205).

  When it is determined in step S204 that the output of the acceleration detection unit 25 that detects acceleration in the Y-axis direction indicates gravitational acceleration, that is, when it is considered that the posture of the camera 1 has changed from the downward direction to the horizontal direction, or by the user When determining that the touch operation on the upper part of the image has been performed, the control unit 11 shifts the processing to step S115. In this case, the display shown in FIG. 7 returns to the display shown in FIG. 5B or 5C.

  If it is determined in step S205 that the user has not performed a touch operation on the upper part of the map image, the control unit 11 determines whether or not acceleration in the Y-axis direction has occurred (step S206). In step S206, for example, when the output of the acceleration detection unit 25 that detects acceleration in the Y-axis direction is equal to or greater than a predetermined value, it is determined that acceleration in the Y-axis direction has occurred. The acceleration threshold is recorded in advance in the program recording unit 12b as a control parameter, for example.

  When determining in step S206 that acceleration in the Y-axis direction has not occurred, the control unit 11 returns the process to step S201. In this case, the enlarged display of the map image is continued. When it is determined in step S206 that acceleration in the Y-axis direction has occurred, that is, when it is considered that forward acceleration is applied with the camera 1 facing downward as shown in FIG. 11 detects the current orientation of the camera 1 from the output of the orientation detector 23 (step S207). Subsequently, the control unit 11 displays a further distant map image in a direction parallel to the current orientation of the camera 1 (step S208). Then, the control part 11 returns a process to step S201.

  FIG. 14 is a flowchart showing the control of the playback mode. In the playback mode, the control unit 11 controls the display driving unit 17 to display a list of image files recorded in the image recording unit 22 on the display unit 18 (step S301). Thereafter, the control unit 11 determines whether any of the image files displayed as a list has been selected by the user (step S302).

  If it is determined in step S302 that any of the image files has been selected, the control unit 11 reproduces the selected image file (step S303). At this time, the control unit 11 reads an image file via the recording / playback unit 21 and inputs the read image file to the compression / decompression unit 20 to decompress the captured image data. Thereafter, the control unit 11 inputs the expanded captured image data to the display driving unit 17 and causes the display unit 18 to display an enlarged image.

  After reproducing the image file, the control unit 11 determines whether or not the output of the acceleration detection unit 25 that detects acceleration in the Z-axis direction has increased from the gravitational acceleration (step S304).

  When determining in step S304 that the output of the acceleration detection unit 25 that detects acceleration in the Z-axis direction has not increased from the gravitational acceleration, the control unit 11 returns the process to step S302. If it is determined in step S304 that the output of the acceleration detection unit 25 that detects acceleration in the Z-axis direction has increased from the gravitational acceleration, that is, as shown in FIG. When it is considered that the information has been added, the control unit 11 acquires, from the header information of the selected image file, longitude information K and latitude information I indicating the position where the captured image is obtained at the time of shooting (step S305). ). Then, the control unit 11 searches the map data recording unit 12c for map image data including the acquired longitude information K and latitude information I (step S306).

  After retrieving the map image data, the control unit 11 determines whether or not the corresponding map image data exists (step S307). If it is determined in step S307 that the corresponding map image data exists, the control unit 11 reads the corresponding map image data from the map data recording unit 12c, and displays a map image based on the read map image data at present. The image is displayed so as to overlap the captured image being reproduced (step S308). At this time, for example, one of the captured image and the map image being reproduced is reduced and displayed.

  After displaying the map image, the control unit 11 determines whether or not to end the reproduction of the image file (step S309). Whether or not to end the reproduction of the image file is determined, for example, by determining whether or not a predetermined button for instructing the end of the image file is operated. If it is determined in step S309 that the reproduction of the image file is not terminated, the control unit 11 returns the process to step S308. If it is determined in step S309 that the reproduction of the image file is to be terminated, the control unit 11 returns the process to step S302.

  If it is determined in step S307 that the corresponding map image data does not exist, the control unit 11 warns the user that the corresponding map image data does not exist (step S310). At this time, the control unit 11 displays a warning on the display unit 18, for example. In addition, if an audio playback unit is provided, a warning may be given by voice.

  If it is determined in step S302 that no image file has been selected, the control unit 11 determines whether or not the mode button has been operated (step S311). In step S311, when it determines with the mode button not being operated, the control part 11 returns a process to step S301. If it is determined in step S311 that the mode button has been operated, the control unit 11 returns the process to step S101.

  As described above, according to the present embodiment, the display of the map image is started or the display range of the map image is switched in accordance with the acceleration (movement) in the direction parallel to the current orientation of the camera 1. I have to. Accordingly, the user can easily perform operations related to the display of the map image while holding the camera 1 with both hands.

  Further, in the present embodiment, when the camera 1 is set, that is, when the display surface of the display unit 18 faces the user, the map image is corrected to a trapezoidal shape and then displayed on the through image. I try to let them. This makes the user who has seen the map image feel a sense of depth, and makes it easier to grasp the relationship between the captured image (through image) and the map image. Further, when the camera 1 is held downward, that is, when the display surface of the display unit 18 faces upward, the map image is displayed on the entire surface. In the case of the map image as shown in FIG. 4, when the display surface of the display unit 18 faces upward, the map image and the actual landscape correspond to each other, so that the relationship between the two can be easily grasped.

Hereinafter, modifications of the present embodiment will be described.
In the example of FIG. 10, the operation of the azimuth detecting unit 23, the position detecting unit 24, and the acceleration detecting unit 25 is started when the camera 1 is turned on. On the other hand, for example, the direction detection unit 23, the position detection unit 24, and the acceleration detection unit 25 may be operated only while a specific button is operated. For example, the release button may be composed of a two-stage push button. In this case, the first button of the release button is pressed by executing AF or the like upon receiving the first press of the release button. During this time, the camera 1 can be provided with a so-called focus lock function for maintaining the focus of the focus lens. While the focus is locked, the azimuth detection unit 23, the position detection unit 24, and the acceleration detection unit 25 are operated, so that the azimuth detection unit 23 is at the timing when the map image is most needed at the time of photographing. And by operating the position detection part 24 and the acceleration detection part 25, it is possible to aim at reduction of power consumption compared with the case where these are always operated.

  In addition, when acquiring the map image data in step S108, the map image data in a range corresponding to the horizontal angle of view of the imaging optical system is extracted. However, since the angle of view actually exists in the vertical direction, depending on the elevation angle of the camera 1, there may be a landmark that cannot be imaged even within the horizontal angle of view φ shown in FIG. is there. Therefore, when the map image data has three-dimensional information (latitude / longitude / altitude), not only the angle of view of the camera 1 but also the range of map image data corresponding to the elevation angle of the camera 1 is acquired. It is desirable to make it. Note that the map image data having three-dimensional information is map image data in which the heights of landmarks as shown in FIG. 16 are indicated by contour lines, for example.

  For example, it is assumed that the user 100 holds the camera 1 at an elevation angle θ with respect to the ground surface as shown in FIG. At this time, the optical axis of the camera 1 is inclined by θ with respect to the ground surface, as shown in FIG. Therefore, the range that can be captured by the camera 1 when viewed in the direction of the altitude H is the range of the vertical angle of view φ around the optical axis. When the height of the landmark separated by the distance L1 is lower than the height defined by the vertical angle of view φ, the landmark cannot be photographed. Actually, the range in which the height H1 of the user 100 is taken into consideration is the range where photographing is possible when viewed in the direction of altitude H. Even if the height H1 is a fixed value (for example, 1.5 m), it does not cause a large error. Further, the elevation angle θ can be detected from the output of the acceleration detection unit 125. The landmarks determined not to be photographed from the relationship shown in FIG. 17B are removed as shown in FIG. For example, the altitude H is removed from the acquired map image data and displayed as a landmark where H <H1 + L1 tan (θ−φ / 2). As a result, landmarks that can be photographed in the direction in which the camera 1 is directed more accurately can be recognized on the map image.

  In the above-described embodiment, when the camera 1 as a portable device is moved forward while being held sideways, the display of the map image is started and the display range is switched. Actually, the camera 1 may be held vertically, and when the camera 1 is held vertically, the output of the acceleration detection unit that detects acceleration in the Y-axis direction does not become gravitational acceleration. The output of the acceleration detector that detects the acceleration in the X-axis direction is the gravitational acceleration. However, even when the camera 1 is held vertically, the display surface of the display unit 18 faces the user, so that the same control as when the camera 1 is held horizontally can be performed. . In this case, in step S105 in FIG. 10, the determination is not made only with the acceleration in the Y-axis direction, but when the gravitational acceleration is detected in either the Y-axis direction or the X-axis direction, step S105 is performed. To branch to.

Although the present invention has been described based on the above embodiments, the present invention is not limited to the above-described embodiments, and various modifications and applications are naturally possible within the scope of the gist of the present invention.
For example, in the above-described embodiment, a digital camera is exemplified as the mobile device. However, the technology of the present embodiment can be applied to various mobile devices that can display captured images and map images, such as mobile phones. is there.
Further, in the description of each operation flowchart described above, the operation is described using “first”, “next”, and the like for convenience, but this does not mean that it is essential to perform the operations in this order. Absent.
Further, the above-described embodiments include various stages of the invention, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some configuration requirements are deleted from all the configuration requirements shown in the embodiment, the above-described problem can be solved, and this configuration requirement is deleted when the above-described effects can be obtained. The configuration can also be extracted as an invention.

  DESCRIPTION OF SYMBOLS 1 ... Digital camera, 11 ... Control part, 11a ... GUI control part, 11b ... Function execution part, 11c ... Display control part, 11d ... Map image acquisition part, 11e ... Operation detection part, 12 ... Data recording part, 12a ... GUI Data recording unit, 12b ... Program recording unit, 12c ... Map data recording unit, 13 ... Button operation unit, 14 ... Touch panel, 15 ... Imaging unit, 16 ... Storage unit, 17 ... Display drive unit, 18 ... Display unit, 19 ... Image processing unit, 20 ... compression / decompression unit, 21 ... recording / reproducing unit, 22 ... image recording unit, 23 ... direction detecting unit, 24 ... position detecting unit, 25 ... acceleration detecting unit, 30 ... bus line

Claims (7)

A mobile device that shapes a map image into a predetermined shape and displays a composite image on a captured image displayed on a display unit,
An orientation detection unit for detecting the orientation of the mobile device;
An acceleration detection unit for detecting acceleration generated in the portable device,
When an acceleration in a direction parallel to the azimuth detected by the azimuth detection unit is detected by the acceleration detection unit, a map image farther than the map image shaped into a predetermined shape displayed on the display unit Is displayed in the predetermined shape.   The mobile device according to claim 1, further comprising a display control unit that enlarges and displays a map image displayed in the predetermined shape when a predetermined operation is performed by a user. . Furthermore, it further comprises a contact detection unit for detecting contact with the display surface of the display unit,
The portable device according to claim 2, wherein the enlarged display of the map image displayed in the predetermined shape is performed when a contact to a predetermined position of the contact detection unit is detected.   The mobile device according to claim 1, wherein the map image shaped into the predetermined shape has a trapezoidal shape. In a map image display method of a mobile device that combines a captured image with a map image and displays the map image on a display unit,
A detection step of detecting acceleration of the portable device;
A first determination step of determining whether the portable device is in a photographing posture in a direction parallel to the ground surface based on the detected first acceleration;
When the mobile device is in a photographing posture in a direction parallel to the ground surface, a second determination is made as to whether or not a second acceleration indicating that the mobile device has moved in a direction parallel to the ground surface is detected. A determination step of
When a second acceleration indicating movement in a direction parallel to the ground surface is detected, a map image displayed superimposed on the captured image of the display unit is distant from the map image. A map image changing step for changing to a map image;
A map image display method for a portable device, comprising: The map image changing step includes an image correction step of performing image correction for making the distant map image feel a sense of depth when displaying the distant map image superimposed on the captured image of the display unit,
The map image display method for a mobile device according to claim 5.   In the second determination step, when the second acceleration indicating that the robot has moved in a direction parallel to the ground surface is not detected, only the map image is displayed on the display unit and the map image is displayed. 6. The map image display method for a mobile device according to claim 5, wherein the map image display step without performing the map image change step is performed.