JP2013054509A - Information processing system, server and display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing system for presenting an appropriate meeting spot even in a place where a user visits for the first time.SOLUTION: A server of an information processing system includes: a request input part 301 for acquiring a photographic location and photographic direction of each of a plurality of portable terminals; a first determination part 303 for determining a landmark existing in a photographic range of each of the plurality of portable terminals by comparing the photographic location and direction with location information of the landmark; a second determination part 305 for determining the landmark existing in the photographic range of each of at least two portable terminals among the determined landmarks as a candidate of a meeting spot; and a transmission part 307 for transmitting image data indicating information for specifying the landmark determined as the candidate of the meeting spot to the portable terminal.

Description

  The present invention relates to an information processing system, a server, and a display method, and more particularly, to an information processing system, a server, and a display method that present candidates for meeting places.

  With the widespread use of mobile terminals such as mobile phones, a system has been proposed in which each user's mobile terminal is used to present the meeting place of these users.

  For example, Japanese Patent Laying-Open No. 2009-20732 (hereinafter referred to as Patent Document 1) discloses a system that determines the relativity of the movement history of each mobile terminal and searches for a meeting place based on the determination result.

JP 2009-20732 A

  However, since the technique of Patent Document 1 is based on the movement history of the mobile terminal, there is a problem that the meeting place is not presented at the place where the user who carried the mobile terminal first visited.

  The present invention has been made in view of such problems, and an object of the present invention is to provide an information processing system, a server, and a display method capable of presenting an appropriate meeting place even when a place is visited for the first time.

  In order to achieve the above object, according to an aspect of the present invention, an information processing system includes a plurality of portable terminals each including an imaging unit and a display unit, and a server capable of communicating with the portable terminal. The server compares the shooting position and the shooting direction with the landmark position information stored in the storage device, and the first acquisition means for acquiring the shooting position and shooting direction of each of the plurality of mobile terminals. A first determination means for determining a landmark present in the shooting range of each of the plurality of mobile terminals, and at least one of the plurality of mobile terminals among the landmarks present in the shooting range of each of the plurality of mobile terminals. Second determination means for determining a landmark present in the shooting range of the two portable terminals as a candidate for a meeting place, and image data representing information identifying the landmark determined as a candidate for a meeting place, at least Transmitting means for transmitting the landmark to a portable terminal including the shooting range. The portable terminal includes processing means for executing a process of combining the photographed image obtained by photographing with the photographing means and image data representing information for identifying the landmark, and displaying the synthesized image data on the display means.

  Preferably, the transmission unit specifies, for each of a plurality of mobile terminals, image data representing information for specifying a landmark determined as a meeting place candidate, and a landmark present in the shooting range of the mobile terminal. Image data representing information to be transmitted, and in the mobile terminal, an image representing information for identifying a landmark determined as a candidate for a meeting place is a land existing in a shooting range of the mobile terminal that is not a candidate for a meeting place. The image is displayed in a display mode different from the image representing the information specifying the mark.

  Preferably, the server determines priorities for the landmarks determined as a plurality of candidates for the meeting place based on the positions of the plurality of mobile terminals, the candidates for the meeting place, and the positions of the determined landmarks. The transmission means further transmits image data representing information identifying the landmarks determined as candidates for the meeting place, together with information representing the priority order.

  More preferably, the third determining means determines the priority order based on the sum of the distances from the positions of the plurality of mobile terminals to the landmarks determined as candidates for the meeting place or the sum of the movement costs.

  More preferably, the third determining means prioritizes based on a sum of distances from a position of a specific mobile terminal of the plurality of mobile terminals to a landmark determined as a candidate for a meeting place, or a sum of movement costs. Determine the ranking.

  Preferably, the second determining means determines a landmark present in the shooting range of all of the plurality of mobile terminals as a candidate for a meeting place.

  Preferably, the transmission means transmits image data representing information identifying the landmark determined as the candidate for the meeting place, together with information indicating the number of portable terminals including the landmark determined as the candidate for the meeting place in the shooting range. In the portable terminal, an image representing information for identifying the landmark determined as a candidate for the meeting place is displayed in a display mode according to the number of portable terminals including the landmark in the shooting range.

  Preferably, the server further includes a specifying unit for specifying a direction from the position of the mobile terminal to a landmark determined as a candidate for a meeting place, and the transmitting unit is a candidate for a waiting place among a plurality of mobile terminals. For mobile devices that do not include the determined landmark in the shooting range, the landmark that is determined as a candidate for the meeting place is replaced with image data that represents information that identifies the landmark that is determined as the candidate for the meeting place. The image data representing the direction toward is transmitted.

Preferably, the server further includes a registration unit for registering a plurality of portable terminals.
Preferably, the server receives selections from a plurality of mobile terminals for a plurality of landmarks determined as candidates for the meeting place, and selects a landmark having the largest number of selected mobile terminals from the plurality of landmarks as the meeting place. It further includes fourth determination means for determining.

  According to another aspect of the present invention, the server is a server that can mutually communicate with a plurality of portable terminals, each including a photographing unit and a display unit, and acquires a photographing position and a photographing direction of each of the plurality of portable terminals. The first acquisition means for determining the landmarks present in the respective photographing ranges of the plurality of portable terminals by comparing the photographing position and photographing direction with the landmark position information stored in the storage device And a candidate for a meeting place of the landmarks present in the photographing ranges of at least two of the plurality of portable terminals among the landmarks present in the photographing ranges of the plurality of portable terminals. Second determination means for determining the image data representing information for identifying the candidate for the meeting place and the determined landmark, Both and transmitting means for transmitting to the portable terminal including the landmark shooting range.

  According to still another aspect of the present invention, the display method is a method for displaying a candidate for a meeting place on a portable terminal including a photographing unit and a display unit, the step of photographing with the photographing unit, and the position and direction at the time of photographing Transmitting from the portable terminal to the server, and by comparing the position and direction at the time of shooting with the position information of the landmark stored in the storage device in the server, the landmark existing in the shooting range of the portable terminal is In the determining step, the server compares at least the landmarks determined in the shooting range of the mobile terminal other than the mobile terminal with at least another mobile phone among the determined landmarks. A step of determining a landmark present in the shooting range of the terminal as a candidate for a meeting place, and a determination of a candidate for a meeting place. Image data representing information for identifying the landmarks transmitted from the server to the portable terminal, and an image representing information for identifying the landmarks that have been determined to be images taken by the photographing means and candidates for the meeting place Synthesizing the data and displaying them on the display means.

  According to the present invention, an appropriate meeting place candidate can be presented even at a place visited for the first time.

It is a figure which shows the specific example of a structure of the information processing system concerning embodiment. It is a figure which shows the specific example of the hardware constitutions of the portable terminal contained in an information processing system. It is a figure which shows the specific example of the hardware constitutions of the server contained in an information processing system. It is a figure for demonstrating the operation | movement outline | summary concerning 1st Embodiment in the information processing system concerning embodiment. It is a figure for demonstrating the operation | movement outline | summary concerning 1st Embodiment in the information processing system concerning embodiment. It is a figure showing the operation | movement outline | summary concerning 1st Embodiment in an information processing system. It is a block diagram which shows the specific example of a function structure of a portable terminal. It is a block diagram which shows the specific example of the function structure of the server concerning 1st Embodiment. It is a flowchart showing the specific example of the flow of operation | movement with a portable terminal. It is a flowchart showing the specific example of the flow of operation | movement in a server. It is a figure showing an example of user information. It is a figure showing an example of user information. It is a figure showing another example of user information. It is a block diagram which shows the specific example of the function structure of the server concerning 2nd Embodiment. It is a figure which shows the specific example of the user information in 2nd Embodiment. It is a figure showing the example of a display of the portable terminal in 2nd Embodiment. It is a figure showing the mode of imaging | photography in the modification 2 of 1st Embodiment and 2nd Embodiment. It is a figure which shows the specific example of the user information in the modification 2 of 1st Embodiment and 2nd Embodiment. It is a figure showing the example of a display of the portable terminal in the modification 2 of 1st Embodiment and 2nd Embodiment. It is a figure showing the example of a display of the portable terminal in the modification 3 of 1st Embodiment and 2nd Embodiment. It is a block diagram which shows the specific example of a function structure of the server concerning the modification 4 of 1st Embodiment and 2nd Embodiment.

  Embodiments of the present invention will be described below with reference to the drawings. In the following description, the same parts and components are denoted by the same reference numerals. Their names and functions are also the same.

<System configuration>
FIG. 1 is a diagram illustrating a specific example of the configuration of the information processing system 1 according to the embodiment.

  Referring to FIG. 1, information processing system 1 includes a plurality of portable terminals 200A, 200B,... 200N, and a server 300 connected thereto via a network. Note that the portable terminals 200A, 200B,... 200N are representatively referred to as a portable terminal 200.

  The mobile terminal 200 may be a mobile phone, for example, and may be another device as long as it has at least a camera function, an instruction input function, and a communication function.

  The server may be anything configured from a general personal computer.

  The portable terminal 200 and the server 300 can communicate with each other via a network and exchange information. The network corresponds to the Internet or a LAN (Local Area Network).

<Device configuration>
FIG. 2 is a diagram illustrating a specific example of the hardware configuration of the mobile terminal 200.

  Referring to FIG. 2, mobile terminal 200 includes a CPU (Central Processing Unit) 20 that is an arithmetic device for controlling the whole, and a ROM (Read Only Memory) 21 for storing programs executed by CPU 20. A RAM (Random Access Memory) 22 for functioning as a work area when the program is executed by the CPU 20, an electronic compass 23 for detecting the orientation of the portable terminal 200 including a magnetic sensor, and a GPS (Global Positioning System) or a GPS controller 24 for receiving position signals from the base station and acquiring position information of the mobile terminal, and a touch panel for displaying information and receiving operation inputs to the mobile terminal 200 Via a telephone line by communicating with an operation panel 25 including a camera 26 and a base station (not shown). A communication controller 27 for controlling communication, and a memory 28 for storing a telephone directory data.

  The operation panel 25 includes, as an example, a touch panel configured by overlapping a display device such as a liquid crystal display device and a position indicating device such as an optical touch panel or a capacitive touch panel, and operation keys.

  CPU20 displays an operation screen on a touchscreen based on the data for displaying the screen memorize | stored beforehand. On the touch panel, an indicated position on the operation screen is specified, and an operation signal indicating the position is input to the CPU 20. An operation signal indicating the pressed key is input to the CPU 20. The CPU 20 specifies the operation content from the pressed key or the displayed operation screen and the indicated position, and executes processing based on the specified operation content.

  In addition, the electronic compass 23 and the GPS controller 24 input the acquired signal indicating the orientation and position information of the mobile terminal 200 to the CPU 20.

FIG. 3 is a diagram illustrating a specific example of the hardware configuration of the server 300.
Referring to FIG. 3, server 300 is configured by a general computer or the like as described above. As an example, CPU 30 that is an arithmetic device for overall control, a program executed by CPU 30, and the like ROM 31 for storing data, RAM 32 for functioning as a work area when CPU 30 executes a program, HD (Hard Disk) 33 for storing MFP information and the like to be described later, and communication via a telephone line And a communication controller 34 for controlling.

[First Embodiment]
<Overview of operation>
4 and 5 are diagrams for explaining an outline of the operation according to the first embodiment in the information processing system 1.

  The information processing system 1 is assumed to be used such that a plurality of portable terminals 200 are carried by a user, and the user carrying the portable terminal 200 waits. Here, for convenience of explanation, description will be made using the mobile terminal 200A as the first mobile terminal and the mobile terminal 200B as the second mobile terminal.

  That is, in the first embodiment, when the mobile terminals 200A and 200B included in the information processing system 1 perform shooting as shown in FIG. 4, each of the captured images is added as shown in FIG. Information is displayed overlaid. This additional information represents a landmark in the captured image, and a landmark suitable for waiting among the landmarks is displayed in a display mode different from other landmarks. In the case of the example in FIG. 5, “shop” in the photographed image is shown as additional information as a landmark.

  Specifically, referring to FIG. 4, stores 1, 2, and 4 exist in the shooting range of portable terminal 200A represented by the dotted line in FIG. Therefore, in the captured image of the mobile terminal 200A shown in FIG. 5A, stores 1, 2, and 4 are shown as additional information superimposed on the captured image.

  Similarly, stores 1, 3, and 4 exist in the shooting range of the mobile terminal 200B. Therefore, in the captured image of the portable terminal 200B shown in FIG. 5B, the stores 1, 3, and 4 are shown as additional information superimposed on the captured image.

  Further, stores 1 and 4 that are included in these captured images are represented in a different display form from the other stores by additional information in both captured images. In the example of FIG. 5, the image based on the additional information representing the stores 1 and 4 is represented by a double line, and is emphasized more than the images of other stores.

  Note that this image based on additional information displayed superimposed on the photographed image is referred to as a “tag” in the following description.

  By displaying such a tag, the user (user A) carrying the mobile terminal 200A also has stores 1 and 4 in the shooting range of the mobile terminal 200B, that is, the user carrying the mobile terminal 200B ( It can be understood from the user B) that the stores 1 and 4 are close to each other. The reverse is also true. And it can grasp | ascertain that these stores 1 and 4 are the positions (landmark) suitable for user A and B waiting.

  FIG. 6 is a diagram showing an outline of the operation according to the first embodiment in the information processing system 1 for realizing such display.

  Referring to FIG. 6, when an application for executing the process is started on the mobile terminal (step S11) and taken by camera 26 according to the shooting instruction (step S12), information indicating the position and orientation at the time of shooting is obtained. Is transmitted to the server, whereby tag data is requested from the server (step S13).

  The server stores information representing the received position and orientation of the mobile terminal (step S31). Then, referring to the database in which the location information of each store as a landmark is registered, a process of analyzing information representing the position and orientation at the time of shooting of the mobile terminal is executed (step S32). Here, a store that exists in the shooting range of the mobile terminal is specified, and an overlap with a store that exists in the shooting range of another mobile terminal is specified. Based on the analysis, the server updates a table to be described later (step S33), and transmits tag data as additional information to the mobile terminal based on the table (step S34).

  The portable terminal displays the tag based on the tag data superimposed on the captured image (step S14). Thereby, a tag as shown in FIG. 5 is displayed so as to overlap the photographed image, and based on this, the user can determine the meeting place.

<Functional configuration>
FIG. 7 is a block diagram illustrating a specific example of a functional configuration of the mobile terminal 200 for realizing the above-described operation. Each function shown in FIG. 7 is a function mainly formed in the CPU 20 when the CPU 20 reads a program stored in the ROM 21 and executes it on the RAM 22. However, at least a part of the functions may be formed by the hardware configuration shown in FIG.

  Referring to FIG. 7, as a function for realizing the above operation, portable terminal 200 includes an instruction input unit 201 for receiving an instruction input from operation panel 25, and a GPS controller in accordance with a shooting instruction from operation panel 25. 24, a position acquisition unit 202 for acquiring the position information of the mobile terminal 200, and a direction acquisition unit 203 for acquiring the direction of the mobile terminal 200 from the electronic compass 23 in response to a shooting instruction from the operation panel 25. In addition, the image acquisition unit 204 for acquiring the image data acquired by executing the shooting by the camera 26 according to the shooting instruction from the operation panel 25, and the position information acquired according to the shooting instruction from the operation panel 25 And orientation information are transmitted to the server 300 via the communication controller 27, and tag data is transmitted to the server 300. A server request unit 205 for requesting, a tag data input unit 206 for acquiring the tag data transmitted from the server 300 in response to the request via the communication controller 27, and image data obtained by photographing A display processing unit 207 for executing a process of combining the tag based on the tag data and displaying it on the operation panel 25, and a setting unit 209 for setting a user group to be described later according to an instruction input from the operation panel 25 Including.

  Note that the position acquisition unit 202 and the direction acquisition unit 203 acquire position information and direction information in response to a shooting instruction from the operation panel 25, respectively. Therefore, the information includes the shooting position information and the shooting direction, respectively. Information. Therefore, in the following description, the position information and the orientation information transmitted from the mobile terminal 200 to the server 300 according to the program are also referred to as shooting position information and shooting direction information, respectively.

  The server request unit 205 requests the server 300 for tag data by transmitting at least the shooting position information and the shooting direction information to the server 300. This request may include, as other information, for example, information specifying the mobile terminal 200 and / or login information of a user who is logged in to the mobile terminal 200.

  As an example, the setting unit 209 accepts an input operation (touch on the operation panel 25) on a setting screen capable of inputting a user group to wait for and a user belonging to the user group, thereby inputting the input information. The user group information is transmitted to the server 300 via the communication controller 27. In addition, the user group information that has already been registered is acquired from the server 300 and displayed on the setting screen so as to be selectable. By accepting the selection operation on the setting screen, the user group to which the login user of the mobile terminal 200 belongs The selection may be accepted, and the information may be transmitted to the server 300 via the communication controller 27 as user group information.

  The setting unit 209 is not limited to the function provided in the mobile terminal 200, and may be provided in the server 300 or may be provided in another device (not illustrated) that can communicate with the server 300.

  FIG. 8 is a block diagram illustrating a specific example of a functional configuration of the server 300. Each function shown in FIG. 8 is a function mainly formed in the CPU 30 when the CPU 30 reads a program stored in the ROM 31 and executes it on the RAM 32. However, at least a part of the functions may be formed by the hardware configuration shown in FIG.

  Referring to FIG. 8, HD 33 includes a store information storage unit 331 that is a storage area for storing location information of a store as a landmark, and group information that defines a user group to wait for as user information, And stores user information such as the number of stores that exist in the shooting range of the portable terminal carried by the user for each user belonging to the user group and the number of other users who carry portable terminals that have the store as the shooting range. And a user information storage unit 332 which is a storage area.

  Further, referring to FIG. 8, as a function for realizing the above operation, the server 300 receives a tag data request from the mobile terminal 200 or input of information for specifying the set user group via the communication controller 34. A request input unit 301 for receiving, a registration unit 310 for registering a user group based on information specifying the received user group, and the shooting position and shooting direction of the mobile terminal 200 included in the tag data request Analysis unit 302 for analyzing the shooting range based on the first determination unit 303 for determining a store existing in the shooting range, and a user related to the user who carries the mobile terminal 200 based on the determination Among the stores determined by the update unit 304 and the first determination unit 303 for updating information, the user -Determined by the second determination unit 305, the first determination unit 303, and the second determination unit 305 for determining a store that exists in the shooting range of portable terminals carried by all users belonging to the same user group based on the information A generation unit 306 for generating tag data representing the store, and a transmission unit 307 for transmitting the tag data to the portable terminal 200 via the communication controller 34.

  The generated tag data includes information for identifying the store (for example, a store name such as “Store 1”) and information indicating the display mode of the tag of the store. The generation unit 306 has a display mode of store tags existing only in the shooting range of the mobile terminal 200 and a display mode of store tags existing in the shooting range of mobile terminals carried by all users belonging to the user group. And the display mode of each store determined by the first determination unit 303 is specified based on the determination by the second determination unit 305. As a display mode, as shown in FIG. 5, the tag lines may be different, or the colors and sizes may be different. In addition, the moving image and its movement may be different.

  Note that information for identifying each store may be stored in advance in a storage device. In this case, the generation unit 306 reads necessary information from the storage device, specifies the display mode as described above, and generates tag data including these.

  Or the information which identifies each store may be memorize | stored in the apparatus with which the said store is provided, and you may make it acquire by the server 300 communicating with the said apparatus.

<Operation flow>
FIG. 9 is a flowchart showing a specific example of the flow of operations in portable terminal 200. The operation shown in the flowchart of FIG. 9 is realized by the CPU 20 reading a program stored in the ROM 21 and executing it on the RAM 22 to exhibit the functions shown in FIG.

  Referring to FIG. 9, CPU 20 of portable terminal 200 receives a shooting instruction from operation panel 25 (YES in step S101), executes a shooting operation in step S103, and in step S105, the position information and direction at that time Information is sent to the server 300 as the shooting position and shooting direction to request tag data.

  When the tag data is received from the server 300 in response to the request (YES in step S107), in step S109, the CPU 20 synthesizes the tag image based on the received tag data with the captured image obtained by the imaging in step S103. In step S111, a process for displaying the obtained image on the operation panel 25 is performed.

  FIG. 10 is a flowchart showing a specific example of the operation flow in server 300. The operation shown in the flowchart of FIG. 10 is realized by the CPU 30 reading out a program stored in the ROM 31 and executing it on the RAM 32 to exhibit each function shown in FIG.

  Referring to FIG. 10, when CPU 30 of server 300 receives a request for tag data from portable terminal 200 (YES in step S201), portable terminal based on the shooting position and shooting direction transmitted with the request in step S203. 200 shooting ranges are analyzed. In step S <b> 205, the CPU 30 refers to the location information of each store stored in advance and determines a store that exists in the shooting range. The CPU 30 stores the determination here for each user.

  FIG. 11 is a diagram illustrating an example of user information. As in the example shown in FIGS. 4 and 5, when the user 1 and the user B are registered as the user group A, here, the photographing included in the request for tag data from the portable terminal carried by each user The position and the shooting direction, and information for specifying a store included in the shooting range analyzed therefrom are stored as user information.

  Next, the CPU 30 determines whether or not each store determined in step S205 is within the shooting range of the mobile terminals of all users belonging to the user group to which the user carrying the mobile terminal 200 belongs, that is, Consider whether the tag representing the store is shared by all users. In the example of FIG. 11, when the mobile terminal currently being processed is the mobile terminal A carried by the user A, the CPU 30 determines that “Store 1”, “Store 2” and “ For each “shop 4”, the user information is referred to and it is confirmed whether or not it exists in the shooting range of the mobile terminal B of the user B.

  If the tag representing the store to be examined is shared by all users (YES in step S207), in step S209, CPU 30 determines the store as a candidate for a meeting place. And this examination is performed with respect to all the stores determined by said step S205 (step S211). In the case of the example in FIG. 11, “Store 1” and “Store 4” exist in the shooting range of all users' mobile terminals, so these stores are determined as candidates for the meeting place. The CPU 30 stores the determination here for each user.

  FIG. 12 is a diagram illustrating an example of user information. FIG. 12 may follow the user information of FIG.

  Referring to FIG. 12, the user information includes a store that is determined for each user belonging to the user group by the above examination and that exists in the shooting range of the mobile terminal as a store that displays the tag, and a tag that represents the store. The degree of sharing with other users of the user group is described. Here, the number of users sharing the tag is described as a sharing condition with other users.

  Note that the user information is not limited to the example of FIG. 12, and may be as shown in FIG. That is, as shown in FIG. 13, for each store determined to be in the shooting range, another user who shares a tag representing the store may be described as a sharing condition.

  When the review for all the stores determined in step S205 is completed (YES in step S1211), in step S213, the CPU 30 displays the display mode of each store tag determined in step S205 based on the result of the review. The tag data including the information for identifying and identifying these stores and the display mode of the tag is generated. In step S215, the CPU 30 transmits the tag data to the mobile terminal 200.

<Effect of the first embodiment>
In the example of FIG. 4, the display as shown in FIG. 5 is realized by combining the tag data and the captured image and displaying them on the portable terminal 200 in step S <b> 109.

  That is, as shown in FIG. 5, information (store name) for identifying a store existing in the shooting range of each of the mobile terminals of the user A and the user B belonging to the user group is displayed as a tag superimposed on the shot image. The tags representing the stores (store 1, store 4) belonging to the shooting range of all the users belonging to the user group are displayed in a display mode indicating that they are candidates for meeting places, which are different from other tags.

  In other words, even if it is the first place visited, each user only takes a picture with a mobile terminal, and a suitable place that exists in the range where all users point to the mobile terminal as a meeting place You can see at a glance above.

[Second Embodiment]
<Overview of operation>
In the second embodiment, when a plurality of stores are determined as candidates for the meeting place, priorities are determined for these stores, and the tags are displayed in a display mode corresponding to the priorities. Let

  As a first example of a criterion for giving priority, an example in which the sum of distances from each user belonging to a user group to the store is used. That is, there is a method in which a store having a smaller sum of distances, that is, a store closer to each user is given higher priority.

  As a second example of the criterion for assigning the priority order, there is an example using the sum of charges from the nearest station of each user belonging to the user group to the nearest station of the store. In other words, there is a method in which a store with a lower sum of charges, that is, a store that can be reached from each user at a low transportation cost is given a higher priority.

  As a modification of the first example and the second example, a priority user is set among the users belonging to the user group, and the distance from the priority user to the store or from the nearest station of the priority user to the store. An example of using the charge to the nearest station is given. In other words, there are a method in which a store with a smaller distance from the priority user, that is, a store closer to the priority user, has a higher priority, or a store in which the priority user can reach at a low transportation cost, a higher priority.

<Functional configuration>
FIG. 14 is a block diagram illustrating a specific example of a functional configuration of the server 300 for realizing the above operation. Referring to FIG. 14, the server 300 according to the second embodiment includes all the users belonging to the same user group determined by the second determination unit 305 in addition to the functional configuration illustrated in FIG. 8. It further includes a third determination unit 308 for determining priorities of a plurality of stores existing in the shooting range of the portable terminal that is carried.

  In the case of the first example, the third determination unit 308 calculates the distance based on the position information of each store determined by the second determination unit 305 and the position information of each mobile terminal carried by each user. Then, the sum of distances is calculated for each store. Then, priorities are determined in ascending order of the sum of the distances.

  In the case of the second example, the third determination unit 308 transmits the location information of each store determined by the second determination unit 305 and the location information of each mobile terminal carried by each user to a search server (not shown). Then, the search for the nearest station is instructed, and further, the search for the charge between the stations is instructed. Then, the sum of charges is calculated for each store, and the priority order is determined in ascending order of the sum.

  In addition, in the case of the modifications of the first example and the second example, as a premise, when registering a user group based on information specifying the user group received by the registration unit 310, a priority user is set. sign up. The priority user may be set in advance from another device such as the portable terminal 200, or the registration unit 310 determines one user from a plurality of users belonging to the user group based on a predetermined condition. You may do.

  In the case of the modification of the first example, the third determination unit 308 calculates the distance based on the position information of each store determined by the second determination unit 305 and the position information of the mobile terminal carried by the priority user. Calculate and compare distances for each store. Then, the priority order is determined in ascending order of the distance.

  In the case of the modification of the second example, the third determination unit 308 sends the position information of each store determined by the second determination unit 305 and the position information of the portable terminal carried by the priority user to a search server (not shown). Send and instruct the search for the nearest station, and further instruct the search for charges between the stations. Then, the charges for each store are compared, and the priority order is determined in ascending order of the area.

  The generation unit 306 stores a display mode corresponding to the priority order in advance. As a display mode, a number indicating a priority order may be added, or a size, display density, moving method of a moving image, or the like according to the priority order may be used.

<Effects of Second Embodiment>
For example, in the case of the example shown in FIG. 4, when the first example is adopted as the reference for assigning the priority, the third determination unit 308 uses the second determination unit 305 as shown in FIG. 15. For the determined “Store 1” and “Store 4”, the distance 70 from the mobile terminal A, the distance 80 from the mobile terminal B, the distance 80 from the mobile terminal A, and the distance 60 from the mobile terminal B are calculated. Then, the sum of the distances for “Store 1” and “Store 4” is calculated as 150 and 140, respectively. Therefore, priority 2 is determined for “Store 1”, and priority 1 is determined for “Store 4”.

  In this case, for example, as shown in FIG. 16, it is displayed on each of the mobile terminals A and B. That is, referring to FIG. 16, in mobile terminal A (FIG. 16A) and mobile terminal B (FIG. 16B), a tag “priority 2” is added to the tag “shop 1”. The “priority level 1” mark is added to the tag “shop 4” and displayed superimposed on the photographed image.

  The same applies to the case where the second example is adopted as the reference for assigning the priority order and the case where the modified example of the first example or the modified example of the second example is adopted.

  This allows you to see the priority of multiple meeting place candidates at a glance, so that even if it ’s the first time you ’ve visited, the user can choose the right (close to all users, cheap to all users) It is possible to easily determine a meeting place (a place that can be reached by a charge, a place that is closest to a specific user, and a place that can be reached by a specific user at the lowest price)

[Modification 1 of the first embodiment and the second embodiment]
In the above example, tags are also displayed for stores that are not in the shooting range of the mobile terminal of another user among stores that are in the shooting range of each mobile terminal. However, only tags for stores belonging to the shooting range of the mobile terminals of all users belonging to the user group may be displayed. That is, in the case of the above example, only the tags of “Store 1” and “Store 4” may be displayed.

By doing in this way, it becomes easier to confirm candidates for the meeting place.
[Modification 2 of the first embodiment and the second embodiment]
Also, in the above example, only stores where all users belonging to the user group share tags are candidates for meeting places, but if there are stores where tags are shared by two or more users, The store may also be a candidate for a meeting place. That is, when three or more users belong to a user group, the display mode of the tag is specified and displayed according to the number of users sharing the tag representing the store, that is, the number of mobile terminals having the store as the shooting range. You may make it do.

  As an example, when a user group to which three users A to C belong is photographed with the mobile terminals 200A to 200C as shown in FIG. 17, the server 300 represents a store as shown in FIG. Tag sharing is specified.

  In this case, as shown in FIG. 19, the tags representing “Store 1” and “Store 4” shared by all users are displayed with the most emphasized display mode. The tag representing “Store 2” shared by the two users is highlighted next.

By doing in this way, more candidates for the meeting place can be obtained.
[Modification 3 of the first embodiment and the second embodiment]
Note that there is no tag representing a store shared by all users belonging to the user group, and there is only a tag representing a store shared by at least a plurality of users, for example, the tag of “Store 2” in Modification 2 above. In this case, the server 300 may identify the store as a candidate for a meeting place and instruct a mobile terminal that is not in the shooting range to move to the corresponding mobile terminal so that the store is in the shooting range.

  At this time, the CPU 30 of the server 300 calculates the direction from the mobile terminal to the store based on the location information of the store that is a candidate for the meeting place and the shooting position and shooting direction of the mobile terminal that does not set the store as the shooting range. To do. Then, tag data for displaying an image representing the direction is generated and transmitted to the portable terminal.

  Thereby, the image of the arrow showing the direction as shown in FIG. 20 is displayed on the portable terminal.

  At this time, CPU30 may determine the length and thickness of an arrow according to the distance between the said store and a portable terminal, and may generate tag data.

  By displaying such a tag, the user carrying the mobile terminal can easily grasp the position of the store that is a candidate for a meeting place suitable for other users.

[Modification 4 of the first embodiment and the second embodiment]
In the above example, the candidate for the meeting place is displayed as a tag. However, the meeting place may be determined using this tag.

  In this case, the tag displayed on the operation panel 25 of the mobile terminal 200 can be selected by being touched, and information representing the touched tag is transmitted from the mobile terminal 200 to the server 300. Then, the server 300 counts the number of touches for each tag displayed on the mobile terminal of each user belonging to the user group, and displays tag data for displaying a tag representing the tag with the highest count as a meeting place. Generated and transmitted to the mobile terminal 200.

  FIG. 21 is a block diagram showing a specific example of a functional configuration of server 300 for performing this operation. In this case, the server 300 further includes a fourth determination unit 309 for determining a meeting place in addition to the functions shown in FIG.

  The fourth determination unit 309 includes a counter (not shown), and counts the number of touches for each tag displayed on the mobile terminal of each user belonging to the user group. Then, the store having the largest count number is determined as a meeting place, and the information is passed to the generation unit 306. The generation unit 306 specifies the display mode of the tag representing the store based on the display mode of the tag of the store determined as a predetermined meeting place, and generates tag data again.

Thereby, it is possible to determine an optimal meeting place.
Furthermore, a program for causing the server 300 and the mobile terminal 200 to execute the above-described operation can be provided. Such a program is recorded on a computer-readable recording medium such as a flexible disk attached to the computer, a CD-ROM (Compact Disk-Read Only Memory), a ROM, a RAM, and a memory card, and provided as a program product. You can also. Alternatively, the program can be provided by being recorded on a recording medium such as a hard disk built in the computer. A program can also be provided by downloading via a network.

  The program according to the present invention is a program module that is provided as a part of a computer operating system (OS) and calls necessary modules in a predetermined arrangement at a predetermined timing to execute processing. Also good. In that case, the program itself does not include the module, and the process is executed in cooperation with the OS. A program that does not include such a module can also be included in the program according to the present invention.

  The program according to the present invention may be provided by being incorporated in a part of another program. Even in this case, the program itself does not include the module included in the other program, and the process is executed in cooperation with the other program. Such a program incorporated in another program can also be included in the program according to the present invention.

  The provided program product is installed in a program storage unit such as a hard disk and executed. The program product includes the program itself and a recording medium on which the program is recorded.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  1 Information processing system, 20, 30 CPU, 21, 31 ROM, 22, 32 RAM, 23 Electronic compass, 24 GPS controller, 25 Operation panel, 26 Camera, 27, 34 Communication controller, 28 Memory, 33 HD, 200, 200A , 200A to 200C, portable terminal, 201 instruction input unit, 202 position acquisition unit, 203 orientation acquisition unit, 204 image acquisition unit, 205 server request unit, 206 tag data input unit, 207 display processing unit, 209 setting unit, 300 server, 301 request input unit 302 analysis unit 303 first determination unit 304 update unit 305 second determination unit 306 generation unit 307 transmission unit 308 third determination unit 309 fourth determination unit 310 registration unit 331 Store information storage unit, 332 User information storage unit.

Claims (12)

A plurality of portable terminals each including a photographing means and a display means;
A server capable of mutual communication with the mobile terminal,
The server
First acquisition means for acquiring the shooting position and shooting direction of each of the plurality of mobile terminals;
A first determination for determining landmarks present in the respective shooting ranges of the plurality of mobile terminals by comparing the shooting position and the shooting direction with position information of landmarks stored in a storage device. Means,
A second for determining a landmark present in a photographing range of at least two of the plurality of portable terminals as a candidate for a meeting place among landmarks present in a photographing range of each of the plurality of portable terminals. And means for determining
Transmission means for transmitting image data representing information identifying the landmark determined as a candidate for the meeting place to at least a portable terminal including the landmark in the imaging range;
The portable terminal includes processing means for executing processing for combining the photographed image obtained by photographing with the photographing means and image data representing information for specifying the landmark and displaying on the display means. Including an information processing system. The transmission means identifies image data representing information for identifying a landmark determined as a candidate for the meeting place and a landmark present in the shooting range of the portable terminal for each of the plurality of portable terminals. Image data representing information to be transmitted,
In the portable terminal, an image representing information for identifying a landmark determined as a candidate for the meeting place, an image representing information for identifying a landmark existing in the photographing range of the portable terminal that is not a candidate for the meeting place, and The information processing system according to claim 1, wherein the information is displayed in different display modes. The server assigns priorities to the landmarks determined as a plurality of candidates for the meeting place based on the positions of the respective mobile terminals and the positions of the landmarks determined as the candidates for the meeting place. Further comprising third determining means for determining,
3. The information processing system according to claim 1, wherein the transmission unit transmits image data representing information specifying a landmark determined as a candidate for the meeting place together with information representing the priority order. 4.   The third determining means determines the priority order based on a total distance from a position of each of the plurality of mobile terminals to a landmark determined as a candidate for the meeting place, or a total movement cost. Item 4. The information processing system according to Item 3.   The third determining unit is configured to select the priority based on a total distance from a position of a specific mobile terminal of the plurality of mobile terminals to a landmark determined as a candidate for the meeting place, or a total movement cost. The information processing system according to claim 3, wherein the order is determined.   The information processing system according to any one of claims 1 to 5, wherein the second determination unit determines a landmark existing in a shooting range of all of the plurality of mobile terminals as a candidate for the meeting place. The transmission means transmits image data representing information identifying the landmark determined as a candidate for the meeting place, together with information indicating the number of portable terminals including the landmark determined as the candidate for the meeting place in the shooting range. And
In the said portable terminal, the image showing the information which identifies the landmark determined as the candidate of the meeting place is displayed in the display mode according to the number of the portable terminals which include the said landmark in the imaging range. 6. The information processing system according to any one of 5. The server further includes specifying means for specifying a direction from the position of the mobile terminal to the landmark determined as a candidate for the meeting place,
The transmission means identifies the landmark determined as a candidate for the meeting place for a portable terminal that does not include the landmark determined as the candidate for the meeting place among the plurality of portable terminals in the shooting range. The information processing system according to any one of claims 1 to 5, wherein image data representing a direction toward a landmark determined as a candidate for the meeting place is transmitted instead of image data representing information.   The information processing system according to claim 1, wherein the server further includes registration means for registering the plurality of portable terminals.   The server accepts a selection from the plurality of mobile terminals for a plurality of landmarks determined as candidates for the meeting place, and a meeting place with a landmark having the largest number of selected mobile terminals among the plurality of landmarks. The information processing system according to any one of claims 1 to 9, further comprising a fourth determining means for determining the first to fourth. A server capable of mutual communication with a plurality of portable terminals, each including a photographing means and a display means,
First acquisition means for acquiring the shooting position and shooting direction of each of the plurality of mobile terminals;
A first determination for determining landmarks present in the respective shooting ranges of the plurality of mobile terminals by comparing the shooting position and the shooting direction with position information of landmarks stored in a storage device. Means,
A second for determining a landmark present in a photographing range of at least two of the plurality of portable terminals as a candidate for a meeting place among landmarks present in a photographing range of each of the plurality of portable terminals. And means for determining
A server comprising: transmission means for transmitting image data representing information identifying a landmark determined as a candidate for the meeting place to a portable terminal including at least the landmark in the photographing range. A method for displaying a candidate for a meeting place on a portable terminal including a photographing means and a display means,
Photographing with the photographing means;
Transmitting the position and direction at the time of shooting from the mobile terminal to a server;
In the server, by comparing the position and direction at the time of shooting with the position information of the landmark stored in a storage device, determining a landmark present in the shooting range of the mobile terminal;
In the server, the determined landmark is compared with a landmark existing in a shooting range of a mobile terminal other than the mobile terminal, so that at least the other mobile phone among the determined landmarks is compared. Determining landmarks present in the shooting range of the terminal as candidates for the meeting place;
Transmitting image data representing information identifying landmarks determined as candidates for the meeting place from the server to the mobile terminal;
A display method comprising: synthesizing a photographed image obtained by the photographing unit and image data representing information for identifying the landmark and the candidate for the meeting place, and displaying the synthesized image data on the display unit.

Images