JP2013104973A - Map display device, and map display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a map display device and a map display method for presenting information relating to a photographic image in such a manner that a user can easily recognize the information.SOLUTION: A map display device includes an image obtaining unit 401 that receives image information including position information corresponding to an image and position information on an object in the image, and a map display control unit 407d that indicates a position corresponding to the image and a position of the object in the image on a map on the basis of the received image information.

Description

  Some embodiments according to the present invention relate to a map display device and a map display method.

  In recent years, for example, a portable terminal equipped with both position information and a camera function, such as a high-function mobile phone called a so-called smartphone having a function of acquiring position information from a GPS (Global Positioning System) and a camera function. Is spreading. Such a high-functional portable terminal can provide various functions when taking a picture.

  For example, in Patent Document 1, by acquiring subject information from a server or specifying a current position, the position after movement is predicted, a shooting mode is set, and a shooting position related to the subject information, A mobile phone that assists a user in a shooting direction or the like is disclosed. More specifically, the mobile phone described in Patent Document 1 assists the user in the shooting position by displaying a message such as “Please climb 50 m and 10 m in the direction of 310 °” on the screen. Displays a message about the shooting direction.

JP 2009-225279 A

  However, in the method described in Patent Document 1, the user moves to the shooting position after confirming the screen while paying attention to numerical values such as “310 ° direction” and “50 m”, and thereafter, information on the direction and the like is obtained at the shooting position. Must be confirmed. In other words, there is a problem that it is difficult for the user to grasp the shooting position and subject information regarding the shot image.

  Some aspects of the present invention have been made in view of the above-described problems, and provide a map display device and a map display method capable of presenting information related to a captured image in a form that is easy for a user to grasp. One of the purposes.

  The map display device of the present invention includes a receiving unit that receives image information including position information corresponding to an image and position information of an object of the image, and a position corresponding to the image based on the received image information. And map display means for indicating the position of the object of the image on a map.

  According to the map display method of the present invention, the map display device receives image information including position information corresponding to an image and position information of an object of the image, and the image based on the received image information. And a step of showing the position of the object of the image on the map.

  In the present invention, “unit” and “means” do not simply mean physical means, but also include cases where the functions of the “part” and “means” are realized by software. In addition, even if the function of one “unit” or “means” is realized by two or more physical means or devices, the function of two or more “units” or “means” can be one physical means or It may be realized by an apparatus.

  ADVANTAGE OF THE INVENTION According to this invention, the map display apparatus and map display method which can show the information regarding a picked-up image in the form which a user can grasp | ascertain easily can be provided.

It is a figure which shows the function structure of the information processing system in which the portable terminal in embodiment of this invention is used. It is a figure which shows the specific example of the display screen which the portable terminal shown in FIG. 1 displays. It is a figure which shows the specific example of the display screen which the portable terminal shown in FIG. 1 displays. It is a figure which shows the specific example of the display screen which the portable terminal shown in FIG. 1 displays. It is a figure which shows the specific example of the display screen which the portable terminal shown in FIG. 1 displays. It is a figure which shows the function structure of the application which the portable terminal shown in FIG. 1 can execute. It is a figure which shows the specific example of facility information DB of the server for applications. It is a figure which shows the specific example of image information DB of the server for applications. It is a flowchart which shows the flow at the time of displaying the imaging position etc. of the picked-up image of the portable terminal shown in FIG.

  Embodiments of the present invention will be described below. In the following description and the description of the drawings to be referred to, the same or similar components are denoted by the same or similar reference numerals.

(Embodiment)
1 to 9 are diagrams for explaining an embodiment of the present invention. Hereinafter, the present embodiment will be described along the following flow with reference to these drawings. First, “1” indicates an outline of the whole embodiment. Then, “2” describes the overall system configuration, “3” describes the software configuration, and “4” describes the database configuration. In “5”, the flow of processing will be described. Finally, the effects according to the present embodiment and other embodiments will be described after “6”.

(1 Overview)
FIG. 1 is a diagram showing a schematic configuration of an information processing system including a mobile terminal 100 according to an embodiment of a map display device according to the present invention. As shown in FIG. 1, the information processing system 1 includes a mobile terminal 100, an application server 200, and a base station 300. Application server 200 and base station 300 are each connected to network N.
In this embodiment, two types of notation “application” and “application” are used in some cases, but both have the same meaning.

  The mobile terminal 100 is a user terminal such as a mobile phone or a mobile information terminal, and can provide various functions to the user by executing the application 400 and other applications. In FIG. 1, only one portable terminal 100 is shown for the sake of simplicity, but a plurality of portable terminals 100 may exist. The detailed configuration of the mobile terminal 100 will be described later.

  Here, the application 400 executed by the mobile terminal 100 is, for example, a tourist application, and is provided with information on tourist spots, gourmet information, and the like visually with a photograph or the like in cooperation with the application server 200. Application. More specifically, a function that presents images such as photographs and illustrations (including paintings) of various tourist attractions to the user, and a function that presents photographs that the user is interested in and nearby tourist attractions. The application 400 has a function of providing a sightseeing route plan.

  Further, when the application 400 displays a captured image such as a tourist spot (for example, a photograph taken with a camera), setting conditions (aperture value, camera model, weather, etc.) used when the captured image is captured are displayed. Can be presented to the user. In addition, the map has a function of displaying information on the position of a subject such as a sightseeing spot as a subject and information on a shooting position (a position corresponding to a shot image) where the subject is shot on the map.

  As a result, the user can intuitively grasp the shooting location and the like, and can recognize the shooting condition of the captured image displayed by the application 400, so that it is completely different from the displayed image by matching with the condition. You will be able to take pictures under the same or similar conditions. This point will be described with reference to FIGS.

  As described above, the application 400 has a function of presenting an image such as a photograph (captured image) received from the application server 200. FIG. 2 is a diagram illustrating a specific example of the display screen 140a on which the application 400 displays an image of a sightseeing spot or the like.

  In the example of FIG. 2, an icon 141 is arranged on the display screen 140a. The icon 141 will be described later. When the “info” icon 141b is selected by the user, the application 400 acquires facility information of the facility related to the displayed image from the application server 200, and displays the display unit 140. Display above.

  FIG. 3 is an example of a display screen 140 b when the application 400 displays facility information on the display unit 140. In the example of the display screen 140b shown in FIG. 3, as the facility information, an image of the facility (sightseeing spot) is displayed in the image area 143 in addition to the name and description of the facility, a telephone number, an address, and the like. A plurality of images displayed in the image area 143 can be selected by a user operation. If the selected image is a captured image, a “shooting information” button 145 is displayed on the display screen 140b.

  FIG. 4 is an example of a display screen 140c displayed on the display unit 140 when the user selects display of shooting information. In the example of the display screen 140c shown in FIG. 4, shooting conditions (also referred to as setting information) such as the weather at the time of shooting, the type of camera used for shooting, and the aperture value are displayed on the display unit 140.

  In addition, in the example of the display screen 140c in FIG. 4, a “shooting point position” button 147 for confirming a shooting target (subject such as a facility / tourist spot) and a shooting point position related to the shot image is displayed. Yes. When the user selects the “shooting point position” button 147, the application 400 displays a display screen 140d showing the position of the shooting target and the shooting point on a map. FIG. 5 is an example of a display screen 140d showing the position of the photographing target and the photographing point on a map.

In the example of the display screen 140d in FIG. 5, the position of the shooting target is indicated by a position icon 149a, and the position of the shooting point is indicated by a position icon 149b. As a result, the user can intuitively know information such as the shooting position and the shooting point. In addition, information such as a shooting position can be obtained only by operating the mobile terminal 100 without intentionally moving.
The function and configuration of the application 400 will be described in detail later.

(2 System configuration)
The functional configuration of this embodiment will be described with reference to FIG.
As described above, the information processing system 1 according to the present embodiment includes the mobile terminal 100, the application server 200, and the base station 300. Hereinafter, these configurations will be described.

The application server 200 provides a function of transmitting an image (image information), transmitting facility information, or transmitting a map in response to a request from the application 400 executed on the mobile terminal 100. Information processing apparatus. The application server 200 includes a communication unit 210, a control unit 220, and a database 230.
The communication unit 210 can transmit and receive data to and from the mobile terminal 100 and other information processing apparatuses via the network N.

  The control unit 220 controls various processes in the application server 200. For example, in the present embodiment, in response to a request from the application 400, the control unit 220 acquires, from the image information DB 235, an image (image information including the image) that satisfies conditions such as a region specified in the image acquisition request. And transmitted to the mobile terminal 100 via the communication unit 310.

  Here, as described above, each image information managed on the image information DB 235 includes, in addition to an identifier such as an image ID, if the image is a captured image (photograph), a shooting position (latitude and longitude). Etc.), the position of the subject (similarly, coordinates such as latitude and longitude), setting information such as the photographing device and the weather, and the like are included. The image information DB 235 will be described in detail later with reference to FIG.

  When receiving a facility information acquisition request from the portable terminal 100 (for example, when displaying facility information related to an image designated by the user), the control unit 220 obtains the facility information of the designated facility from the facility information DB 233. Acquire and transmit to the mobile terminal 100 via the communication unit 210.

  Further, when the communication unit 210 receives a map acquisition request regarding the facility and the surroundings of the shooting position / subject position, etc. of the displayed captured image from the application 400, the control unit 220 displays the latitude and longitude ( A map that meets conditions such as (position) and scale is acquired from the map DB 231 and transmitted to the mobile terminal 100 via the communication unit 210.

  Next, the configuration of the mobile terminal 100 will be described. As shown in FIG. 1, the mobile terminal 100 includes a main control unit 110, a wireless communication unit 120, an input unit 130, a display unit 140, an audio output unit 150, and a sensor 160.

The main control unit 110 controls various processes in the portable terminal 100, and includes a CPU (Central Processing Unit) 111, a RAM (Random Access Memory) 113, a ROM (Read Only Memory) 115, and the like. In the main control unit 110, various functions provided by the mobile terminal 100 are realized by the CPU 111 executing programs such as the application 400 stored in the storage area while using a recording area such as the RAM 113 and the ROM 115. Can do.
The wireless communication unit 120 can transmit and receive data to and from other information processing apparatuses via the network N by performing wireless communication with the base station 300.

  The input unit 130 receives input from the user with respect to the mobile terminal 100, and is, for example, an input key or a touch panel. Note that the input unit 130 may have a function of receiving voice input from the user and outputting it as input information.

The display unit 140 is a display that presents various types of information to the user. In the present embodiment, the display unit 140 displays various information such as a map, an image, facility information, and shooting information.
The audio output unit 150 is a speaker that outputs audio information to the user. For example, the voice output unit 150 outputs voice guidance information accompanying route guidance.

  The sensor 160 outputs a detection signal that changes according to the movement state of the user of the mobile terminal 100, and includes, for example, an acceleration sensor 161, a GPS (Global Positioning System) receiver 163, and the like. Specifically, the detection signal output from the sensor 160 includes acceleration information indicating the acceleration output from the acceleration sensor 161 and information indicating the current position of the mobile terminal 100 output from the GPS receiver 163. It is.

(3 Software functions)
Next, the functional configuration of the application 400 will be described with reference to FIG. FIG. 6 is a functional block diagram showing the configuration of the application 400.
The application 400 includes an image acquisition unit 401, a facility information acquisition unit 403, a map acquisition unit 405, and a user interface unit 407.

  The image acquisition unit 401 acquires image information including an image from the application server 200 when displaying an image such as a tourist spot or an image such as an illustration. The acquired image is displayed on the full screen by the image information display control unit 407b as the display screen 140a as shown in FIG.

  Here, not only the acquired image but also an icon 141 is arranged on the display screen 140a. When the input processing unit 407a accepts an operation for selecting one of the icons 141, each component configuring the application 400 provides a function corresponding to the selected icon 141 to the user.

  When the input processing unit 407a receives a user operation to the input unit 130 for selecting the “map” icon 141a, the map acquisition unit 405 displays a map around the facility (point) related to the image displayed on the display screen 140b. Obtained from the application server 200 and displayed on the map display control unit 407d. At this time, the map acquisition unit 405 requests the application server 200 for a map by designating, for example, the latitude and longitude of the facility or point.

  When the input processing unit 407a accepts the selection operation of the “info” icon 141b, the facility information acquisition unit 403 acquires the facility information of the image associated with the image displayed on the display screen 140a, and displays the facility information display. The control unit 407c displays on the display screen 140b. The information displayed on the display screen 140b is a facility name, address, telephone number, and explanatory text as shown in FIG.

  Note that the image region 143 is provided on the display screen 140b illustrated in FIG. 3 as described above. In the image area 143, one or more images related to the facility acquired by the image acquisition unit 401 as image information from the application server 200 are displayed by the image information display control unit 407b or the facility information display control unit 407c. .

  One or more images displayed on the image area 143 can be selected by a user operation on the input unit 130. When the selected image is a captured image, the image information display control unit 407b (or the facility information display control unit 407c) displays a “shooting information” button 145 on the display screen 140b so as to be selectable. At this time, if the image selected by the user is not a captured image (an image such as an illustration or painting), the image information display control unit 407b does not display the “captured image” button 145 or Display in a state that cannot be selected.

  When displaying the shooting information, the image information display control unit 407b generates, for example, the display screen 140c shown in FIG. In the example of the display screen 140c of FIG. 4, shooting conditions (setting information) such as the weather at the time of shooting, the type of camera used for shooting, and the aperture value are displayed. These pieces of information are acquired from the application server 200 by the image acquisition unit 401 as part of image information including images.

  In the example of FIG. 4, only the camera type, aperture value, and the like are described as the setting information, but the present invention is not limited to this. For example, the image information display control unit 407b may display correction conditions such as shutter speed, focal length, and white balance, strobe light emission conditions, and the like on the display screen 140c. In that case, the image acquisition unit 401 can also acquire these pieces of information from the application server 200 as part of the image information.

  Furthermore, in the example of the display screen 140c in FIG. 4, “position of shooting point” for confirming the position and shooting point (shooting place) of the shooting target (object such as facility / tourist spot) related to the shot image on the map. "Button 147 is displayed on the image information display control unit 407b. When the input processing unit 407a receives an operation of selecting the “shooting point position” button 147, the map acquisition unit 405 includes information on the subject position (for example, latitude and longitude) and the shooting position (for example, latitude and longitude) included in the image information. Based on the application server 200, a map is acquired. At this time, the map acquired by the map acquisition unit 405 preferably has a range and scale including both the subject position and the shooting position.

  The map acquired by the map acquisition unit 405 is displayed on the display unit 140 by the map display control unit 407d as a display screen 140d as shown in FIG. On the display screen 140d, the map display control unit 407d displays position icons 149a and 149b for confirming the position of the subject (facility to be photographed or a sightseeing spot) related to the photographed image and the photographing position (photographing point). doing. Information on the position of the subject and information on the shooting position (respectively expressed in coordinates as latitude and longitude) are included in the image information together with the image acquired by the image acquisition unit 401 from the application server 200. Therefore, based on the information, the map display control unit 407d arranges the position icons 149a and 149b on the map.

(4 Database configuration)
Next, the contents of the database 230 of the application server 200 will be described with reference to FIGS. In addition, description is abbreviate | omitted about map DB231 here, and facility information DB233 and image information DB235 are demonstrated.

  The database 230 included in the application server 200 includes the map DB 231, the facility information DB 233, and the image information DB 235 as described above. FIG. 7 is a diagram illustrating a specific example of the facility information DB 233, and FIG. 8 is a diagram illustrating a specific example of the image information DB 235.

  The facility information DB 233 shown in a specific example in FIG. 7 includes various information such as a facility ID, a POI (Point Of Interest) ID, a facility coordinate, a name, an address, a telephone number, and a description for each facility.

  Facility ID and POIID are identifiers uniquely assigned to each facility. The POIID is used to link the facility information DB 233 and the image information DB 235.

  As shown in FIG. 8, the image information DB 235 stores information such as an image ID, POIID, subject position (latitude / longitude of the subject) and photographing position (latitude / longitude of the photographing point) uniquely assigned to each image, and photographing. The setting information such as the shooting device used for the shooting, the aperture value of the camera at the time of shooting, the weather at the time of shooting, and the like are managed. Note that these pieces of information can be acquired from the Exif additional information, for example, in the case of an Exif format image to which additional information is added.

  Since the POID is an ID assigned for cooperation with the facility information DB 233 as described above, the same ID is assigned to the same location (POI) both on the facility information DB 233 and on the image information DB 235.

  The application 400 can display the subject position and the photographing position on the display screen 140d described above by acquiring image information including information on the subject position and the photographing position managed on the image information DB 235.

(5 Flow of image display processing)
With reference to FIG. 9, the flow of processing until the application 400 displays a map indicating the shooting position of the shot image and the shooting target in the mobile terminal 100 will be described. FIG. 9 is a flowchart showing the flow of processing when the application 400 displays a map indicating the shooting position and shooting target of a shot image.

  When an event for displaying an image occurs in response to a user operation on the input unit 130 (Yes in S901), the image acquisition unit 401 transmits an image acquisition request from the wireless communication unit 120 to the application server 200. (S903). In response to the received image acquisition request, the control unit 220 of the application server 200 transmits image information (which may be plural) that matches the condition to the mobile terminal 100.

  When the image acquisition unit 401 of the application 400 receives image information via the wireless communication unit 120 (S905), the image information display control unit 407b generates, for example, the display screen 140a of FIG. 2, the display screen 140b of FIG. The image is displayed on the display unit 140 (S907).

  When the input processing unit 407a accepts an operation input for requesting display of shooting information during image display (Yes in S909), the image information display control unit 407b is setting information included in the image information acquired by the image acquisition unit 401. Information such as weather, camera type, aperture value, etc. is displayed as a display screen 140c (S911).

  When the input processing unit 407a accepts a user operation to the input unit 130 for instructing display of the shooting position (Yes in S913), the map acquisition unit 405 sends an acquisition request for a map around the shooting position and the subject position. Transmission is performed from the wireless communication unit 120 to the server 200 (S915). The control unit 220 of the application server 200 searches for a map that matches the conditions specified in the map acquisition request, and returns (transmits) the communication unit 210 to the mobile terminal 100.

  When the map acquisition unit 405 receives the map around the shooting position and the subject position via the wireless communication unit 120 (S917), the map display control unit 407d determines the position based on the shooting position and the subject position information included in the image information. The icons 149a and 149b are arranged on the map, and the display screen 140d is displayed on the display unit 140 (S919).

  When a user operation input for instructing other than shooting information display is received in S909 (No in S909), or in the case of a user operation input for instructing other than shooting point display in S913 (No in S913). The application 400 executes processing according to the user operation (S921).

(6 Effects of this embodiment)
As described above, in the mobile terminal 100 of the present embodiment, the shooting position (shooting point) and the position of the subject (position of the shooting target) related to the shot image displayed on the display unit 140 are shown on the map. The display screen 140d can be displayed. By checking the map, the user can visually and intuitively grasp the shooting position, the position of the subject, and the like related to the image, including their positional relationship.

  In addition, since it is possible to confirm the shooting position and the position of the subject at the same time, it is also possible to provide the user with a sightseeing route such as moving to the shooting position and taking a picture after visiting the sightseeing spot that is the subject. It becomes possible.

  For this purpose, for example, the following method can be considered. First, the input processing unit 407a accepts selection of a plurality of points including sightseeing spots, shooting positions, and moving means (for example, walking, bicycle, or car). Then, the map acquisition unit 405 transmits those conditions, and the application server 200 calculates (searches) an appropriate sightseeing route (sightseeing route recommended for the user) and sends it back. The map display control part 407d of the application 400 can consider the method of displaying the received recommended sightseeing route on the display part 140 and proposing it to the user. At this time, if the staying time required for each facility is managed in the facility information DB 233, the application 400 also displays the required time required for visiting the sightseeing route on the display unit 140 together with the sightseeing route. It becomes possible.

  Alternatively, when a shooting position is designated, a sightseeing route including not only the shooting position but also a sightseeing spot that is a shooting target may be provided to the user.

(7 Other embodiments)
In the above embodiment, an image is received as image information together with information such as a shooting position. However, the present invention is not limited to this and may be received separately.

  Further, in the above-described embodiment, the description has been given by taking a captured image taken by a camera or the like as an example, but the present invention is not limited to this. For example, the image displayed on the display screen 140a or the like is an illustration (picture), and the position of the object (corresponding to the subject in the case of the above-described photographed image) and the position where the image (illustration) is drawn (in the image) The above-described embodiment may be realized so that the corresponding position corresponds to the position to be photographed (position of the subject) and the photographing point.

  In the above embodiment, the case where an image is included in image information has been described as an example, but the present invention is not limited to this. For example, the image information and the image are managed separately. First, the mobile terminal 100 acquires one of the images or the image information from the application server 200, and then the other associated with it (if the image is acquired first, If the image information corresponding to the image is acquired first, the image corresponding to the image information may be acquired. In such a case, for example, both can be linked using an image ID or the like.

(8 Appendix)
Note that the configurations of the above-described embodiments may be combined or some of the components may be replaced. The configuration of the present invention is not limited to the above-described embodiment, and various modifications may be made without departing from the scope of the present invention.

  DESCRIPTION OF SYMBOLS 130 ... Input part, 140 ... Display part, 200 ... Application server, 400 ... Application, 401 ... Image acquisition part, 403 ... Facility information acquisition part, 405 ... Map Acquisition unit, 407 ... user interface unit, 407a ... input processing unit, 407b ... image information display control unit, 407c ... facility information display control unit, 407d ... map display control unit

Claims (5)

Receiving means for receiving image information including position information corresponding to the image and position information of the object of the image;
A map display device comprising map display means for displaying a position corresponding to the image and a position of an object of the image on a map based on the received image information. Image display means for displaying the image corresponding to the image information;
Input means for receiving input from the user,
The map display means shows the position corresponding to the image and the position of the object on the map based on the image information when the input means receives input.
The map display device according to claim 1. The map acquisition means which requests | requires the said map further based on at least one of the positional information corresponding to the said image among the said image information, or the positional information on the target object of the said image, The Claim 1 or Claim 2 Map display device. The image is a captured image;
Further comprising setting display means for displaying setting information relating to photographing of the image;
The map display apparatus of any one of Claim 1 thru | or 3. Map display device
Receiving image information including position information corresponding to the image and position information of an object of the image;
A map display method for performing, on the map, a position corresponding to the image and a position of an object of the image based on the received image information.