JP2010019641A - Information providing device, method and program, and album producing device, method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide information relating a location which is suitable for future visits, according to the past behavior of a user. <P>SOLUTION: A photographic location and the time up to now, a time and the current location (location of a kiosk terminal 2 currently in operation) are shown on map data, and a location where a user can drop in by a user's current moving means within a prescribed time from the current location from now is also shown as a recommended unvisited spot. For example, an unvisited spot A which is reachable within 10 minutes on foot from the current location, an unvisited spot B reachable within 20 minutes, an unvisited spot C reachable within 35 minutes, and an unvisited spot D reachable within 45 minutes, are shown. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to provision of information according to a user's moving location.

  In Patent Document 1, by transmitting information such as destinations and waypoints visited by each user from the navigation unit and the mobile terminal at an appropriate timing, historical data such as the visited location of the service center as a history for each user. Accumulate in storage. When the vehicle occupant makes a route provision request to the service center, the navigation unit transmits the identification ID code of all the vehicle occupants to the service center as a route to the destination based on historical data such as the visited locations of all the vehicle occupants. Search for the best road for vehicle occupants. Then, the search result is transmitted from the service center to the navigation unit and provided to the vehicle occupant from the video output unit of the navigation unit.

In Patent Document 2, in an information distribution apparatus including an information display device, a communication unit that communicates with the information providing device, and a control unit that displays data from the information providing device on the information display device via the communication unit, The means displays only the information selected by the selecting means for selecting the data from the information providing apparatus, and the selecting means sets the data received from the information providing apparatus using unique information that changes according to the use situation of the user. The information sorted out by the first sorting means constituted by a plurality of sorting conditions including the selected sorting conditions and the information extracted by the first sorting means is displayed and output by the second sorting means constituted by the digitizing means and the comparing means. Sorted into possible states.
JP 2002-196665 A JP-A-2005-249606

  There have been devices and methods for providing information according to a user's current location and usage situation. However, these conventional techniques cannot predict a user's destination and provide necessary information accordingly.

  Further, according to the prior art, even if the user overlooks the sightseeing spot on the way and cannot take a commemorative photo, there is no way to rescue it.

  An object of the present invention is to provide information on a place suitable for a future visit according to a user's past behavior. Also, the user's travel route is acquired based on the user's photographed image information (such as the photographing time and location), and information related to “recommended spots to be visited” and “spots that have been missed” based on this is provided. It is to provide images.

  The information providing apparatus according to the present invention corresponds to an input unit that receives input of visited location information of a first user, visit information that is information about a desired visit location, and visit location information that is location information of the visit location The visit information recording unit to be recorded, and the visited location information of the first user input by the input unit and the visit position information of the recording unit are collated, so that the visit location suitable for the first user visit A visitable visit location estimation unit that estimates the preferred visit location location information that is location information, and an extraction unit that extracts from the recording unit visit information corresponding to the location information of the preferred visit location estimated by the visitable visit location estimation unit; An output unit that outputs the visit information extracted by the extraction unit.

  The visitable visit location estimation unit compares the visited location information input by the input unit with the visit location information of the recording unit, and the unvisited visit location that is the visit location information that does not match the visited location information input by the input unit The position information is estimated as the preferred visit location position information.

  The input unit receives input of visited location information of a second user who is one or a plurality of users excluding the first user, and sets visited location information that matches the visited location for each visited location of the recording unit. A visitor number visitor number management unit that counts the total number of second users input within the period of time, and records the total number counted in the recording unit in association with each visitor site, By comparing the visited location information of the first user input by the input unit with the visited location information of the recording unit, the visited location of the first user becomes the visited location of the majority of the second user. Whether the first user's visited location matches the second user's majority visited location, other than the first user's visited location information. The classic location that is the visited location of the second user's majority in the location information Visit location information corresponding to the Tsu door to estimate the preferred visit location position information.

  The visitable visited location estimation unit determines whether the visited location of the second user is a minority visited location according to whether the visited location of the first user matches the visited location of the minority of the second user. Position information corresponding to a certain spot spot is estimated as preferred visit location position information.

  The recording unit records route information indicating the route to the visited place in association with the visited place and the location information of the visited place. The route information corresponding to the visited location information input by the input unit is identified by comparing the location information with the visited location information, and the location information of the visited location that can be reached along the identified route information is determined as the preferred visit location. Estimate to location information.

  The visited location information includes shooting position information recorded as supplementary information of the shot image.

  The output unit outputs the visit information to a predetermined printing device or display device.

  The information providing method according to the present invention associates a step of receiving input of visited location information of a first user with visit information that is information about a desired visited location and visited location information that is location information of the visited location. The location information of the visit location suitable for the visit of the first user is obtained by comparing the step of recording in the recording device with the input visited location information of the first user and the visit location information of the recording device. The computer is caused to execute a step of estimating the preferred visit location information, a step of extracting visit information corresponding to the estimated location information of the preferred visit location from the recording device, and a step of outputting the extracted visit information.

  A program for causing a computer to execute this information providing method is also included in the present invention.

    The album creating apparatus according to the present invention receives the first photographed image of the first user, the photographing location information of the first photographed image and the photographing date and time of the first photographed image, and the first user An input unit that receives input of a second captured image that is a captured image of a second user who is one or a plurality of users, the shooting location information of the second captured image, and the shooting date and time of the second captured image; The shooting location information of the first shot image and the shooting date and time of the first shot image are recorded in association with each other, and the shooting location information of the second shot image, the second shot image and the shooting date and time of the second shot image are associated with each other. An image information recording unit for recording, a movement path estimation unit for estimating the movement path of the first user based on the shooting date and time of the first captured image recorded in the image information recording unit, and a plurality of images Place The second captured image corresponding to the shooting location information along the moving route of the first user estimated by the moving route estimation unit and not coincident with the shooting location information of the first shot image when creating the album arranged by the layout of A supplementary candidate image specifying unit for specifying the image information from the image information recording unit, an album creating unit capable of creating an album in which the first captured image and the second captured image specified by the supplemental candidate image specifying unit are arranged in a predetermined layout, Is provided.

  The input unit receives input of shooting conditions for the first captured image and also receives input of shooting conditions for the second captured image, and the image information recording unit associates the shooting conditions of the first captured image and the first captured image. And recording the second photographic image and the photographic condition of the second photographic image in association with each other, and the supplementary candidate image specifying unit creates the first photographic image when creating an album in which a plurality of images are arranged in a predetermined layout. The second shot image corresponding to the shooting location information along the moving route of the first user estimated by the moving route estimation unit and not matching the shooting location information of the first shot image and matching the shooting condition of the first shot image is displayed as an image. Specify from the information recording section.

  The shooting conditions include at least one of the season to which the shooting date / time belongs, the time zone, and the weather condition at the time of shooting.

  The album creating method according to the present invention accepts input of a first photographed image that is a photographed image of the first user, photographing location information of the first photographed image and photographing date and time of the first photographed image, and Receiving a second photographed image that is a photographed image of a second user who is one or a plurality of users excluding the photographing location information of the second photographed image and the photographing date and time of the second photographed image; The shooting location information of the first shot image and the shooting date and time of the first shot image are associated and recorded on a predetermined recording medium, and the second shot image, shooting location information of the second shot image and shooting date and time of the second shot image are recorded. Are recorded in a predetermined recording medium, a step of estimating the moving path of the first user based on the shooting date and time and the shooting location of the recorded first shot image, and a plurality of images When the album is arranged in a predetermined layout, the second corresponding to the shooting location information along the moving route of the first user, which is not coincident with the shooting location information of the first shot image and is estimated by the moving route estimation unit. The computer is caused to execute a step of specifying a shot image from a recording medium and a step of creating an album in which the first shot image and the specified second shot image are arranged in a predetermined layout.

  An album creating program for causing a computer to execute the above album creating method is also included in the present invention.

  According to the present invention, among spots that the user has not visited, information on spots that can be visited in the future, information on spots that the majority of other users are interested in or not, and spots that the user has missed while moving Can provide information on Also, even if there is a spot that the user missed while moving, and there was no shooting there, an album was created using images taken by other people and whose shooting conditions match those taken by the user it can.

[Summary of Invention]
FIG. 1 shows a schematic configuration of an information providing system according to a preferred embodiment of the present invention. This system includes a data center 1, one or a plurality of kiosk terminals 2. The kiosk terminal 2 can communicate with the data center 1 via a network of the Internet 5, etc., and can be a mobile phone, a portable media player, or the like. Communication with the information communication device 3 is possible. In FIG. 1, two kiosk terminals 2 a and 2 b are shown for convenience, but three or more kiosk terminals may be connected to the data center 1.

  The data center 1 includes a map database (for example, a DVD or hard disk or other large-capacity storage medium on which map data used in a car navigation system is recorded), spot position information, and the like, which stores map information and point information provided to each information communication device 3. (Some specific shrines and temples, restaurants, amusement facilities, mountains, rivers, sights, and other places where the public can visit or use "spots", spot classification information (when spots are classified according to their use, (Information indicating the classification), spot information (basic, secret spot, etc.), spot information including others, user information of each information communication device 3 (user ID, device ID, user personal information, etc.), or each information communication device 3 It has a spot database that accumulates sent photo information, location information, shooting date, and information registration date. That.

  The spot classification information may be a multilayer structure instead of a single layer structure. Here, the spot classification information includes major classifications such as shopping spots, meal spots, and sightseeing spots, and further includes minor classifications subordinate to the major classification. For example, a large classification of “shopping spots” is subordinate to a small classification such as a clothes store, a shoe store, a general store, and a bookstore. Or, the major classification of “meal spots” is subordinate to minor classifications such as Japanese, Chinese, Italian, stateless. Alternatively, the major classification of “sightseeing spots” is subordinate to minor classifications such as animal and botanical gardens, hot springs, and parks.

  The map information is image information or line segment information for representing an identification object such as a spot, building, road, or river associated with spot position information (spot identification information) in the spot database, and text information of the identification object name. have. In addition, this map data is based on the hierarchy in which the location information (latitude, longitude, altitude) of the identification objects defined along the roads in each location is recorded, and the routes and routes connecting the identification objects along the roads. Each of them includes a hierarchy in which distance information capable of calculating the user's moving distance is recorded. The spot data has address information associated with the spot position information on a one-to-one basis. In addition to the address information, the location information is associated with a telephone number, a postal code, and name information (spot name, company name, station name, bus stop name, etc.).

  Further, the spot database records image data having shooting location information that is the same as or close to the spot position information (for example, the distance error between them is within 5 m) in association with the spot position information. This image data is transmitted from the information communication device 3 to the data center 1 via the kiosk terminal 2. In the image data, various incidental information and the device ID or user ID of the information communication device 3 that is the transmission source are further associated with each other, and this is an image that is taken and sent under who and when and under what shooting conditions. Or, it can be identified in association with the spot information.

  Each kiosk terminal 2 is connected to the printer 4 and outputs print data to the printer 4. The print data generated at each kiosk terminal 2 can be output from the data center 1 to the printer 4c, or the data center 1 itself can generate print data and output it to the printer 4c.

  The kiosk terminal 2 communicates with the desired information communication device 3 by infrared communication, wireless communication such as Bluetooth, or wired communication via a USB cable or the like, and receives an image and its accompanying information. Further, the kiosk terminal 2 requests the data center 1 to search for desired spot information, receives the spot information searched and transmitted by the data center 1 in response thereto, and forwards it to the information communication device 3. provide.

  Each of the data center 1 and the kiosk terminal 2 includes an operation unit (keyboard, mouse and other pointing devices, a touch panel, etc.), a display unit (liquid crystal display and an on-board graphic card), a communication unit (network card, etc.), and an information processing unit. (CPU, microcomputer, etc.), storage unit (RAM, ROM, flash memory, hard disk, DVD, CD-RW or other computer-readable recording medium), information reading / writing unit (CD-RW drive, etc.) or all Consists of a personal computer with a part. The operation of each unit is centrally controlled by the information processing unit. A program that regulates the control of each unit by the information processing unit is stored in the storage unit.

  The kiosk terminal 2 is connected to the printer 4 via a print data communication unit such as a USB port or a LAN. The communication unit of the kiosk terminal 2 receives various information such as map information and recommended spot information associated with the map information from the data center 1. The display unit displays map information and recommended spot information received from the data center 1. Also, the map information and recommended spot information received from the data center 1 are converted into print data by the information processing unit, and can be output to the printer 4 for printing.

  The information communication device 3 includes an imaging unit (imaging lens, solid-state imaging device, image processing circuit) or image recording unit (flash memory), operation unit (such as a numeric keypad), display unit (such as a liquid crystal display), and communication unit (such as a network card). ), Information processing unit (CPU, microcomputer, etc.), storage unit (RAM, ROM, recording medium such as memory card), information reading / writing unit (memory card reader / writer, etc.) Consists of telephones. The information communication device 3 also includes an RTC (real-time clock) that outputs time information when a recording image is captured by the imaging unit and a GPS receiver that outputs position information when the recording image is captured by the imaging unit. Yes. The image data obtained by the imaging unit is recorded by associating the positional information obtained from the GPS receiver at the time of imaging and the time information obtained from the RTC as supplementary information. For example, GPS position information may be recorded as tag information (GPS IFD) of an EXIF file. In addition, various types of shooting time information (such as weather information) acquired from a data server connected via the network 5 can also be recorded as supplementary information of a shot image.

  FIG. 2 shows a flowchart of information providing processing executed in this system. Each step of this process is controlled by the kiosk terminal 2 or the information processing unit (CPU) of the data center 1. A program describing the processing contents is stored in the storage unit (memory) of the kiosk terminal 2 or the data center 1.

  In S <b> 1, the kiosk terminal 2 determines whether a request for accepting an image input from the information communication device 3 has been received. If YES, the process proceeds to S2, and if NO, the process proceeds to S6.

  In S <b> 2, the kiosk terminal 2 receives an input of an image arbitrarily shot by the user from the information communication device 3. At this time, user identification information (such as a MAC address) is also received from the information communication device 3.

  In S3, the kiosk terminal 2 determines whether or not the input of the image has been normally completed. If yes, then continue with S4, otherwise return to S2.

  In S4, the kiosk terminal 2 determines whether or not an instruction for requesting the data center 1 (online storage) to register the image received from the information communication device 3 is input by a touch panel operation or the like. If YES, the process proceeds to S5, and if NO, the process proceeds to S6.

  In S5, the data center 1 receives an image from the kiosk terminal 2 in response to a request from the kiosk terminal 2, and registers it in the database. At this time, the user ID of the user of the information communication device 3, the device ID of the information communication device 3, the personal information of the user, the photo information sent from the information communication device 3, the position information, the shooting date, the information registration date, the shooting condition Various attached information such as information is registered in association with images. In order to discriminate at least the registrant of an image, it is necessary to associate a user ID or a device ID (for example, a MAC address) as a substitute for the user ID.

  In S6, the kiosk terminal 2 accepts an input of spot search conditions through a touch panel operation or the like. There are three types of spot search conditions: conditions related to spots, conditions related to images, and conditions common to spots and images. Conditions related to the spot include, for example, “not visited”, “is a secret spot”, “related to the spot corresponding to the input image”, “within a specific area (specific range)”, “input It is located on the image capturing route ”and“ is on a route that can be visited from a specific place within a specific time ”. Examples of the conditions related to the image include “photographed under specific photographing conditions (season, weather, time, etc.)”, “photographed under photographing conditions close to the input image”, and “photographing position of the input image” “It is an image that interpolates time”. As a condition common to the spot and the image, for example, “recently used (information added / referenced) recently” can be cited. The kiosk terminal 2 sends the input search condition to the data center 1 and requests a search for spot information having a spot attribute that matches the search condition.

  In S7, the data center 1 searches the database for spot information corresponding to the search condition received from the kiosk terminal 2. And if there exists applicable spot information or an image, it will be transmitted to the kiosk terminal 2.

  In S8, the kiosk terminal 2 receives spot information or an image from the data center 1 and displays it on the display. Alternatively, the received spot information or image print data is created and output to the printer 4. The received image may be converted into print data alone or together with spot information and output to the printer 4.

  The search condition is not limited to one-dimensional information, and may be information processed by various processes such as a combination of information input from the user itself.

  For example, a certain image 1, image 2, image 3, and image 4, and the image location coordinates (X1, Y1) and shooting time (9: 10-9: 50) of image 1, image 2 Shooting location coordinates (X2, Y2) and shooting time (10: 30-10: 45), shooting location coordinates (X3, Y3) and shooting time (11: 00-11: 20) of image 3, and shooting of image 3 Assume that the location coordinates (X4, Y4) and the photographing time (11: 45-12: 30) are input to the kiosk terminal 2 and transmitted to the data center 1.

  In this case, the data center 1 moves from the shooting location and shooting time of the image 1, image 2, image 3, and image 4, and the location and operation time of the kiosk terminal 2 that is currently operated by the user. The route and the moving speed are grasped, and the subsequent moving route is predicted. The travel route can be predicted by comparing the road or rail route of the map information stored in the database in advance with the travel route traced so far. The moving speed can be estimated based on the distance between the shooting locations and the shooting time. In addition, based on the moving speed, it is possible to infer moving means such as walking, cars, and trains.

  Then, as shown in FIG. 3, the current shooting location, time, and current location (the location of the kiosk terminal 2 being operated) are displayed on the map data, and the current moving means of the user within a predetermined time from the current location. Shows the places where the user can stop as recommended unvisited spots. FIG. 3 shows an unvisited spot A that can be reached in 10 minutes on foot from the current location, an unvisited spot B that can arrive in 20 minutes, an unvisited spot C that can arrive in 35 minutes, and an unvisited spot D that can arrive in 45 minutes. Yes.

  Each recommended spot may be accompanied by an image or description of the spot. For example, in FIG. 3, a list of names of unvisited spots is shown on the left side of the map data. This data may be output and displayed on the display means, or may be output to the printer 4 and printed. Alternatively, the information may be transmitted to the information communication device 3, but at that time, the data itself flows out to the outside.

  For each recommended spot, not all of the spots registered in the database that can be reached within a predetermined time from the current location may be selected and output from those that meet the user's needs. .

  For example, if all of the visited spots are spots that are classified as “basic” in the database, the user determines that the spot is traveling around the regular spot and is classified as a regular spot among the spots that can be reached from the current location. Present only what you have. On the contrary, a spot classified as “a hole” may be presented to provide unexpectedness. Also, the spots classified as “scheduled to close” may not be presented. However, everything that can be reached within a predetermined time from the current location may be presented in response to the user's instruction to “present all”.

  Alternatively, as shown in FIG. 4, the current shooting location, time, and current location (location of the kiosk terminal 2 being operated) are displayed on the map and moved from the current location along the recommended route indicated by the arrow. Then, the predicted spot and the scheduled stay time at the spot are shown. In FIG. 4, based on the current location, the planned stay time of spot A is 13: 00-14: 00, the planned stay time of spot B is 14: 10-14: 30, and the planned stay time of spot C is 15:00. -15: 30. Note that the spot D is not predicted as a travel route from the current location, is displayed in a color different from the recommended spots A to B, and does not indicate the planned stay time.

  Each recommended spot may be accompanied by an image or description of the spot. For example, in FIG. 4, the name of each spot, the stay time there, and the itinerary end time are shown on the left side of the map data. This data may be output and displayed on the display unit, or may be output to the printer 4 and printed. Alternatively, the information may be transmitted to the information communication device 3, but at that time, the data itself flows out to the outside.

  In addition, if the predicted route is different from the route that the user actually wants to move, the route to be actually moved can be selected by the input operation from the user, and a recommended spot along the selected route can be presented. Good. For example, in the initial prediction, route I was a moving route, but when route II is selected as a moving route by the user's selection, recommended spots E and F along route II are presented. Not only the moving route but also the moving speed and moving means can be arbitrarily selected by the user, and the recommended spot to be presented may be changed according to the selected moving speed, moving means and moving route.

  In addition, the kiosk terminal 2 is input from the information communication device 3 and the location presented as the recommended spot when an instruction to create an image print with an image input by a certain user ID (= user A) is input. The shooting position information indicated by the attached information of the image is collated, and a spot that has not been shot despite being presented as a recommended spot is specified. And the kiosk terminal 2 arrange | positions the image which the user other than the user A, for example, the user B, for example, the user B photographed at the spot where the said photography was not carried out, and was registered into the database with the image input from the user A. By doing so, it is possible to supplement the album with images of recommended spots that the user did not stop by.

  At this time, it is preferable to search for an image that is not simply the same spot and is photographed under a photographing condition that matches or is similar to the photographing condition when the user A stops at the kiosk terminal 2. Shooting conditions include date, time, weather conditions, etc. Among the attached information corresponding to each image in the database, those that match or similar to these conditions are identified and the corresponding images are complemented. A candidate image is determined. The weather conditions can be received from a weather data providing server connected via the Internet 5.

  Of course, the user may freely select whether or not to add other people's images to the album. If the user's operation is set to “No”, the refilling is not performed. Only when it is set as “”, replenishment with another person's image is performed.

  The arrangement position of the image of another person in the album is determined based on the location actually visited by the user and the relationship with the route and time of visiting the location.

  For example, the user A selects the images I1, I2, I3, I4, and I5 as the images to be output to the album, but between the image I4 captured at 13:00 and the image I5 captured at 15:00. Assume that no image to be output to the album is selected.

  In this case, if there is a recommended spot where the user A did not visit on the route traveled between 13-15 o'clock or visited but did not take an image, the user A other than the user A having the location of the spot as attached information The image X registered in association with the user ID is extracted from the database. Then, the image X is laid out on the album board so as to be positioned between the image I4 and the image I5 taken at 15:00. In this way, the temporal and spatial continuity between images is maintained by the arrangement on the album, and there is little discomfort in appearance due to the insertion of images taken by other people.

  Alternatively, as in the case of 13:00 to 15:00, an image may be inserted between 10:00 and 12:00, where the shooting time interval is two hours away.

  In addition, when the distance between the shooting locations is longer than the distance interval between other shooting locations, an image shot at a spot positioned between them may be inserted. For example, if there are images taken at spots I1 and I2 as shown in FIG. 3, but there is no image taken at spot D, an image taken by another person at spot D is displayed between I1 and I2 on the album mount. Arrange.

  In other words, by interpolating a portion where the temporal distance between the visited spots is interpolated, it is possible to realize an image arrangement as if photographing was performed while maintaining temporal continuity.

  Note that map information as shown in FIGS. 3 and 4 may be inserted into the album.

[Information provision processing]
In the information providing process, the search conditions input from the kiosk terminal 2 and the recommended spot information that the data center 1 searches from the database and transmits to the kiosk terminal 2 in response to the input search conditions are specifically: Is provided, for example, as follows. For convenience of explanation, in the following example, the user of the information communication device 3 with the MAC address “000E0C” inputs the search condition to the kiosk terminal 2a. Of course, other MAC addresses and other kiosks Similar processing is possible at the terminal.

(1) When “unvisited spot” is input as a search condition The search condition input or designated from the operation unit of the kiosk terminal 2a is “unvisited spot” of the user of the information communication device 3 with the MAC address “000E0C”. The information processing unit of the kiosk terminal 2a receives information indicating that the search condition for “unvisited spot” is input from the user with the MAC address “000E0C” and the user with the MAC address “000E0C”. The transmission unit is controlled to transmit a search request including the shooting location information of the captured image to the data center 1 via the communication unit and the network 5.

  When the communication unit of the data center 1 receives the search request transmitted from the kiosk terminal 2a via the network 5, the information processing unit identifies the search condition “unvisited spot” included in the search request, and the MAC address “ Based on “000E0C”, creation of map data (guidance map) specifying the “unvisited spot” and “visited spot” of the user with the MAC address “000E0C” is started from the database.

  That is, first, the information processing unit of the data center 1 records the search condition “unvisited spot” received from the kiosk terminal 2, the MAC address “000E0C”, image data, shooting position information, shooting date / time, and information registration date / time in association with each other. The recording unit (database) is controlled so as to do so.

  Next, the information processing unit collates the shooting position information corresponding to the MAC address “000E0C” recorded in the database with the spot position information, and determines whether or not the user matches the MAC address “000E0C”. It is determined whether or not A has visited any spot registered in the database and photographed. However, it is not necessary to collate all spot position information registered in the database. For example, based on the terminal identification information of the kiosk terminal 2 that has sent the search request, a map that covers the peripheral area of the installation location of the kiosk terminal 2 (for example, an area within a circumference of 1000 meters in radius from the installation location of the kiosk terminal) Information (peripheral map information) is acquired from the map database, and the spot position information included in the peripheral area is collated with the shooting position information.

  If there is spot position information that does not match the shooting location information, the information processing section plots the position information as “unvisited spot” on the surrounding map information acquired from the map database. On the other hand, if there is spot position information that matches the shooting location information, the map information of the surrounding area acquired from the map database as the “visited spot” if there is spot position information that matches the shooting location information so that the user can easily grasp the past footprints You may plot on top of. Then, the information processing unit temporarily stores the map information (guidance map) on which the spot that matches the specified search condition (here, the unvisited spot) is stored in the storage unit (RAM), and then stores the stored map information. The communication unit is controlled to transmit the guidance map stored in the unit to the kiosk terminal 2 that has sent the search request.

  At this time, an image associated with an unvisited spot and having a device ID other than the MAC address “000E0C” as a transmission source may also be transmitted to the kiosk terminal 2. That is, the user A refers to an image (another image) taken by another person at a spot that the user A has not yet visited, imagines the actual site, and determines in advance whether the user is really worth going there. be able to.

  The guidance map is transmitted from the data center 1 to the kiosk terminal 2a via the network 5. When the information processing unit of the kiosk terminal 2a receives the guidance map via the communication unit, the information processing unit controls the display unit to display it. When a guide map print instruction is input from the operation unit, the guide map print data is output to the printer 4a to be printed. In addition to the guidance map, when another person's image is also received, it can be displayed or printed. It should be noted that the other person's image can be printed only when “printing permitted” is designated from the operation unit of the information communication device 3 of the user who has photographed the other person's image because of copyright protection.

(2) When “standard” or “unknown” is entered as a search condition As a premise of information providing processing according to this search condition, a spot attribute that determines whether the spot attribute is “standard” or “unknown” Management processing is performed.

  That is, when the information processing unit of the data center 1 receives an unspecified number of information search requests from the kiosk terminals 2a, b,... Via the communication unit, the information processing unit temporarily stores them in a storage unit (RAM). Then, the shooting date and time included in the search request of the storage unit is within the sampling period of the search request used for determining the spot attribute (for example, from 00:00 on April 1, 2008 to 24:30 on April 30, 2008). Judge whether it is included. If it is determined that the shooting date / time is included in the sampling period, the shooting date / time and shooting location information included in the search request are associated with each other and registered in the database as visit history information.

  Next, the information processing unit of the data center 1 counts the number of visit history information for each identical spot in accordance with the arrival of the spot attribute fixed date (for example, April 30, 2008, 24:00:00). To do. That is, the shooting location information included in each visit history information is collated with the spot information in the database, and if both match (or the error is within a predetermined range such as 1 to 2 m), the shooting location information Increment the number of visitors by one. By performing this for all the visit history information, the number of users who visited each spot and imaged during the sampling period is totaled. The total number of visitors is recorded in the database in association with each spot information.

  Next, the information processing unit of the data center 1 calculates the popularity of each spot based on the number of visitors corresponding to each spot. For example, a visit frequency is obtained by dividing the number of visitors corresponding to each spot by the total number of visit history information.

  Then, the information processing unit of the data center 1 compares the visit frequency of each spot with a predetermined standard threshold (for example, 0.70). As a result of the comparison, if the visit frequency exceeds the standard threshold, the spot attribute “standard” associated with the spot is registered in the database. If, as a result of the comparison, the visit frequency does not exceed the standard threshold value and does not fall below a predetermined hole threshold value (for example, 0.20), the spot attribute “normal” associated with the spot is registered in the database. To do. As a result of the comparison, if the visit frequency is below the hole threshold, the spot attribute “hole” associated with the spot is registered in the database.

  The spot attribute is registered for each spot by calculating the visit frequency and comparing the visit frequency with the standard threshold value / hole spot threshold value, and the attribute of each spot is determined. The sampling period can be arbitrarily set, and a long-term trend such as month or year, or a short-term trend such as day or week can be grasped. A plurality of different sampling periods may be set simultaneously.

  Only after the attribute management process as described above is performed, the input of the search condition of “standard” or “unknown” at the kiosk terminal 2 is validated.

  If “standard” is input as a search condition at the kiosk terminal 2, the information processing unit of the data center 1 plots the spot associated with the spot attribute “standard” on the peripheral map information.

  If “neck spot” is input as a search condition at the kiosk terminal 2, the information processing unit of the data center 1 plots the spot associated with the spot attribute “neck spot” on the surrounding map information.

  After that, as described above, the guidance map is sent to the kiosk terminal 2 and displayed or printed out. At this time, an image having a device ID other than the MAC address “000E0C” associated with the “standard” or “neck spot” spot may also be transmitted to the kiosk terminal 2. In the case of “standard”, it is not necessary to send all images, and composition analysis is performed as described later, and one image having a typical composition (composition common to a plurality of images) is selected and transmitted. In the case of “Hidden place”, an arbitrary image is selected and transmitted in order to have unexpectedness. In this way, it is possible to inform a user who has no prior information at all what the “standard” or “spot” spot is.

  Note that the composition of the image sent together with the search request may be used for determining the spot attribute. For example, composition analysis (for example, position detection of a main subject of a person or detection of a specific object) is performed on an image corresponding to a specific shooting location among images included in an unspecified number of information search requests, and different users are detected as a result of composition analysis. It is determined whether or not the composition of the captured images is common. For example, if the same object subject (for example, the whole image of a famous temple) is included in common to the majority of images, the spot attribute “standard” is associated and recorded in the database.

(3) When “related to a spot corresponding to the input image” is input as a search condition As a premise corresponding to this search condition, the database of the data center 1 has a relation that is a spot related to a desired spot. The spot information and the related spot position information are recorded in association with each other. This related spot is such that the desired spot and distance are within a certain range.

  The information processing unit of the data center 1 captures the shooting position information and spot position corresponding to the MAC address “000E0C” recorded in the database when “related to the spot corresponding to the input image” is input as the search condition. The related spot information and the related spot position information corresponding to the spot position information (visited spot) determined to match the shooting position information as a result of the comparison are extracted.

  In the database of the data center 1, if spot classification information is individually associated with each visited spot and related spot, the spot classification information is further verified. First, the small classifications corresponding to the visited spot and the related spot are compared and collated, and if they match, the related spot is extracted as related spot information corresponding to the visited spot. If the visited spots and related spots do not match, the major classifications corresponding to the visited spots and related spots are compared, and if they match, the related spots are the visited spots. Is extracted as related spot information corresponding to. When neither the small classification nor the large classification matches, the related spot information corresponding to the visited spot is not extracted.

  In this way, related spots that are close to the visited spot and have the same spot classification information as the visited spot are extracted. For example, if a user visits only a park, the park will be extracted as a related spot.

  The information processing unit of the data center 1 plots the position information of related spots on the peripheral map information.

  After that, as described above, the guidance map is sent to the kiosk terminal 2 and displayed or printed out. At this time, an image having the same shooting position information as the position information of the related spot and having an apparatus ID other than the MAC address “000E0C” as a transmission source may also be transmitted to the kiosk terminal 2.

(4) When “within a specific area” is input as a search condition This search condition is specified as “within a radius of 500 m from the current position”, “within a radius of 1000 m from the current position”, or on the operation unit of the kiosk terminal 2 The information processing unit of the data center 1 regards the range specified by the kiosk terminal 2 as an area covered by surrounding map information, and acquires map information from the map information database. Even if this search condition is specified alone, the surrounding map information is only displayed, but the convenience increases when combined with other search conditions. For example, if “500 m radius from current position” AND “standard” AND “unvisited” is specified as a search condition, spots associated with the spot attributes “standard” and “unvisited” are displayed as “500 m radius from current position”. "Is plotted on the surrounding map information, and a guide map is transmitted.

(5) When “Located on Input Image Shooting Route” is input as a search condition As a precondition, the map information database includes roads and routes that can reach a desired spot from a desired position Such a route (arrival route) is recorded, and when the arrival route is designated, a spot that can arrive at the designated arrival route from a desired position can be searched from the map information database. Assume that link information is added between each arrival route in the map information database and spot information located in the middle of each arrival route.

  For example, as shown in FIG. 3, in the surrounding map information centered on the installation position (current position G) of the kiosk terminal 2a, the route X facing the current position G first hits the spot A when proceeding in the west direction. It is assumed that the map branches to routes I and II when moving west along route X, and that it can reach spot C when moving along route I and reach spot B when moving along route II. .

  When “positioned on the shooting route of the input image” is input from the kiosk terminal 2a as the search condition, the information processing unit of the data center 1 uses the shooting location information included in the received search request as a corresponding shooting. Sorting along the chronological order of the date and time, specify the moving route of the past shooting location.

  For example, as shown in FIG. 4, from the first shooting location I1 to the second shooting location I2, the route α is moved northward to reach the branch point J of routes X, α, β, and γ, and then the route Go east to move to the second shooting location I2, then go west on route β to reach junction J, then go east on route γ to move to shooting location I3, then move west on route γ Returning to the branch point J, the route X is further moved westward to specify that the current location G has been reached.

  The information processing unit of the data center 1 predicts the route that the user will take from now on the basis of the movement route of the specified past shooting location. From now on, the prediction of the route taken by the user is performed by excluding the route that has already passed from the predicted travel route from the surrounding map information. For example, among the routes X, I, II, α, β, and γ that can be moved from the current location G in the peripheral map information, the route α, β, and γ that the user A has passed are excluded, and the remaining route is defined as a predicted route. To do.

  Specifically, for example, whether or not the route has been passed is determined based on whether or not the route has passed through a branch point of the route and has advanced to a route other than the route. For example, for the routes α, β, and γ in the surrounding map information of FIG. 4, the branch point is J, and for any of the routes α, β, and γ, the branch point J passes through another branch point (route α). To β, β to γ, and γ to X), and it is determined that the routes α, β, and γ have been passed. The branch points of the route X are J and K, and J has passed, but it has not reached any route other than the route X, and it is determined that the route X has not been passed. Therefore, the route X is included in the predicted route.

  In addition, the information processing unit of the data center 1 also determines the predicted moving direction of the predicted route. Specifically, the movement direction in the latest route until the current position is reached is determined as the predicted movement direction of the predicted route.

  In FIG. 4, the most recent route until the current position G is reached is the route X, and the moving direction is west. Therefore, the predicted moving direction of the predicted route X is determined to be west.

  The information processing unit of the data center 1 also determines a branch point, a route, and a spot that can be reached by the user from the combination of the predicted route and the predicted moving direction.

  For example, in FIG. 4, if the route X travels west from the current position G, it is determined that the branch point K can be reached, and that the route can proceed to the route I or II from the branch point K. Then, when the route X travels west from the current position G and proceeds to the route I or II, the spots that can be reached are the spot A that is located along the route X, the spot C that is located along the route I, and the route II. It is determined that the spots are B, E, and F located.

  Further, the information processing unit of the data center 1 calculates the user's past average moving speed based on the shooting date and time at the visited spots so far, and calculates the estimated arrival time at the reachable spot.

  For example, the distance from the spot I1 to I2 is 2000m, the distance from the spot I2 to I3 is 500m, the distance from the spot I3 to I4 is 500m, and the shooting date / time at the spots I1, I2, I3, and I4 is April 2008, respectively. In the case of 9:00, 10:00, 11:00, 12:00 on a day, the movement time and the movement distance are totaled, and the movement time is 3 hours and the movement distance is 3 km. The moving speed is calculated as 3 km / 3 hours = 1 km per hour. Although the time staying at the same spot without moving may be excluded from the travel time, it is necessary to record the stay time at each spot of each user in the data center 1 in this case.

  If the distance from the current position G to the reachable spot A is 300 m, the travel time from the current position G to the spot A is calculated as 60/1000 × 300 = 18 minutes. Therefore, if the current position G departs at the current time, for example, 13:00, the predicted arrival time at the spot A is calculated as 13:18, which is 18 minutes after 13:00. For easy understanding by the user, the unit of 1 minute may be rounded up to the unit of 10 minutes to be 13:20.

  The information processing unit of the data center 1 plots the arrival prediction spots on the surrounding map information, and displays arrival schedule information that lists the names of the spots, the estimated arrival time, the model staying time, the scheduled lap time, etc. A guidance map, which is graphic data obtained by combining the surrounding map information and the schedule information, is created by combining the surrounding map information with a predetermined position, for example, the left side. However, if the predicted arrival time does not fall within the predetermined range, it is excluded from the schedule information, and the predicted arrival time is within the predetermined range (for example, “one of the spot search conditions is“ within a specific time from a specific location ”). Only “Spots where the travel time from the current position G is within 15:30”) is listed in the schedule information as “on the route that can be visited” and plotted in the surrounding map information. This is because the spot opening time has passed or the insanely late time is not provided to the user as the spot visit scheduled time. The predetermined range may be designated as a spot search condition from the operation unit of the kiosk terminal 2.

  Thereafter, as described above, the guidance map is sent to the kiosk terminal 2 and displayed on the display unit or printed out. An image of another person having the same shooting location information as the position information of the arrival prediction spot may also be transmitted.

  The above search conditions can be specified alone or in combination. For example, if “standard” AND “unvisited” AND “located on the shooting route of the input image” AND “spot where the moving time from the current position G is within 15:00” is designated as a search condition. Of the spots associated with the spot attributes “standard” and “unvisited”, only those corresponding to the predicted arrival spots that can arrive by 15:00 are plotted on the peripheral map information, and the schedule information is synthesized. , Send the completed guidance map.

[Print processing]
When an album is printed out or electronically recorded with images received by the kiosk terminal 2 from a specific user, if the total number of input images is less than the number of images required for the album layout, the other user's image Added images (other people's images) to supplement the number of images that are missing.

  For example, if user A has input five images but the number of images required for the layout is six, the other person's image input by a user other than user A is registered in the database as described above. Select from visit history information.

  That is, after receiving an image input from the specific user to the kiosk terminal 2 and receiving an instruction to print the input image, it is determined whether or not the total number N1 of input images exceeds the number N0 necessary for the album layout. When it is determined that the total number N1 of input images is less than N0 (the number of images is insufficient), the kiosk terminal 2 attaches identification information (such as a MAC address) of a specific user and supplementary conditions to the data center 1 Send a complementary image request. When it is determined that the image is insufficient, a warning that the image is insufficient is displayed to the user in advance, and a complementary image request is transmitted only when an instruction to request completion by another person's image is received from the operation unit May be.

  Typically, the supplementary conditions are the shooting conditions (image shooting location, shooting date and time, weather conditions at the time of shooting, etc.) of an image shot by a specific user. In addition to this, provided from the data center 1 by information providing processing Various kinds of information included in the guidance map that has been made, for example, location information of unvisited spots of a specific user, and arrival times of unvisited spots may also be included. In addition, the user can arbitrarily specify the content of the supplementary condition from the operation unit.

  When the data center 1 receives the supplementary image request, the data center 1 displays an image that matches the supplementary conditions attached thereto and that is associated with user identification information different from the attached specific user identification information. Extract from And it transmits to the kiosk terminal 2 which transmitted the complement image request | requirement by making the extracted image into a complement image candidate. If there is a lot of history information, the candidate for supplementary images will be sent more than necessary, but the user selects a desired image via the operation unit and places only the selected supplementary image candidates in the album template. Output.

  For example, if the complementary condition corresponding to the identification information of the user A includes the position information of the unvisited spot, the image has the same shooting position information as the position information of the unvisited spot, and other than the user A An image corresponding to the user identification information is extracted from the history information.

  Alternatively, if the complementary condition corresponding to the identification information of the user A includes the location information of the visited spot, the information processing unit of the data center 1 uses the shooting location information included in the received search request as described above. Then, sorting is performed according to the time-series order of the corresponding shooting date and time, and the moving route of the user A's past shooting location is specified. And a spot having position information along the moving route of the user A's past shooting location, where the position information of the spot does not match the position information of the visited spot of the user A (missing spot) Is identified. Then, an image associated with identification information other than the user A having the same shooting location information as the location information of the overlooked spot is extracted from the history information.

  If the complementary condition corresponding to the identification information of the user A includes the position information of the visited spot, the shooting date and time of the shot image, and the shooting location, the information processing unit of the data center 1 Among them, a pair is formed by two shooting locations corresponding to shooting times adjacent to each other. Among the configured pairs, if the shooting location with the moving order earlier is called the departure spot, and the shooting location with the later movement order is called the arrival spot, it will intervene on the movement path between the departure spot and the arrival spot. Other person images taken at an overlooked spot, in which the shooting time of the other person's image is interposed between the shooting time at the departure spot and the shooting time at the arrival spot, are extracted from the history information as complementary image candidates. . In this way, an image along the movement path of the user A can be used as a candidate for complementation, and the shooting time is also close to the time that the user A could have actually shot, so an image shot by another person is inserted. Discomfort is reduced.

  Furthermore, when it is desired to narrow down the complementary image candidates, the distance and / or time interval between the departure spot and the arrival spot is larger than that of the other pairs (that is, the time / location between the pairs having a maximum value). The overlooked spot that intervenes is set as a complementary image candidate. In this way, it is possible to focus on a portion that could not be photographed at the same time interval / distance interval.

  In addition, in order to give a meaning to the album as a memorial, a spot name, a guidance map, etc. may be posted together with images. Also, the album does not necessarily have to be printed on a print medium, but may be stored as electronic data on a server so that it can be viewed on various communication terminals, or recorded as a video signal on a video recording medium such as a DVD. May be.

Schematic configuration diagram of information provision system Flow chart of information provision processing The figure which shows an example of the neighboring sightseeing map where the unvisited spot is plotted The figure which shows an example of the surrounding sightseeing map where the reachable spot is plotted and the arrival schedule information is synthesized The figure which shows an example of the 1st trimming range candidate

Explanation of symbols

1: data center, 2: kiosk terminal, 3: information communication equipment, 4: printer

Claims (14)

An input unit that receives input of visited location information of the first user;
A visit information recording unit that records visit information that is information related to a desired visit location and visit location information that is location information of the visit location in association with each other;
The preferred visit location which is the location information of the visit location suitable for the visit of the first user by collating the visited location information of the first user input by the input unit with the visit location information of the recording unit Visitable visit location estimation unit that estimates location information;
An extraction unit that extracts the visit information corresponding to the location information of the preferred visit location estimated by the visitable visit location estimation unit;
An output unit for outputting the visit information extracted by the extraction unit;
An information providing apparatus comprising:   The visitable visited location estimation unit is visited location information that matches the visited location information input by the input unit with the visited location information of the recording unit, and does not match the visited location information input by the input unit. The information providing apparatus according to claim 1, wherein unvisited visit location position information is estimated as preferred visit location position information. The input unit receives input of visited location information of a second user who is one or a plurality of users excluding the first user;
For each visited place of the recording unit, the total number of second users who entered visited place information that matches the visited place within a predetermined period is counted, and the total number counted is associated with each visited place. It has a visitor number management section to record in the recording section,
The visitable visited location estimation unit compares the visited location information of the first user input by the input unit with the visited location information of the recording unit, so that the visited location of the first user is the first Determining whether the second user's majority visited location matches, and depending on whether the first user's visited location matches the second user's majority visited location The visit position information corresponding to a standard spot that is a visited place of the majority of the second user among the position information other than the visited place information of the first user is estimated as the preferred visited place position information. The information providing device according to 1.   The visitable visit location estimation unit determines whether the second user visits the minority according to whether the visited location of the first user matches the visited location of the minority of the second user. The information providing apparatus according to claim 3, wherein position information corresponding to a spot spot that is a completed place is estimated as preferred visit place position information. The recording unit records route information indicating a route to the visited place in association with the visited place and the location information of the visited place,
The visitable visit location estimation unit compares route visited information input by the input unit with visit location information of the recording unit, thereby obtaining route information corresponding to the visited location information input by the input unit. The information providing apparatus according to claim 1, wherein the location information of the visited location that can be reached along the identified route information is estimated as the preferred visited location location information.   The information providing apparatus according to claim 1, wherein the visited location information includes shooting position information recorded as supplementary information of a shot image.   The information providing apparatus according to claim 1, wherein the output unit outputs the visit information to a predetermined printing device or display device. Receiving input of visited location information of the first user;
Associating the visit information, which is information about the desired visit location, with the visit location information, which is the location information of the visit location, in a recording device;
By comparing the input visited location information of the first user with the visited location information of the recording device, suitable visited location location information which is location information of a visited location suitable for the first user visit is obtained. Estimating, and
Extracting visit information corresponding to the estimated location information of the preferred visit location from the recording device;
Outputting the extracted visit information;
To provide information to a computer.   An information providing program for causing a computer to execute the information providing method according to claim 8. One or a plurality of users excluding the first user while receiving input of a first photographed image that is a photographed image of the first user, photographing location information of the first photographed image, and photographing date and time of the first photographed image An input unit that receives input of a second captured image that is a captured image of the second user, information on a shooting location of the second captured image, and a shooting date and time of the second captured image;
The first shot image, shooting location information of the first shot image, and shooting date and time of the first shot image are recorded in association with each other, and the second shot image, shooting location information of the second shot image, and the first An image information recording unit that records the shooting date and time of two shot images in association with each other;
A movement path estimation unit that estimates the movement path of the first user based on the shooting date and time and the shooting location of the first captured image recorded in the image information recording unit;
When creating an album in which a plurality of images are arranged according to a predetermined layout, shooting location information along the movement route of the first user that does not match the shooting location information of the first shot image and is estimated by the movement route estimation unit A supplementary candidate image specifying unit that specifies a second captured image corresponding to the image information recording unit;
An album creating unit capable of creating an album in which the first photographed image and the second photographed image specified by the supplement candidate image specifying unit are arranged in the predetermined layout;
An album creating apparatus comprising: The input unit receives an input of shooting conditions for the first shot image and receives an input of shooting conditions for the second shot image.
The image information recording unit records the first shooting image and the shooting condition of the first shooting image in association with each other, and records the second shooting image and the shooting condition of the second shooting image in association with each other,
The supplementary candidate image specifying unit does not match the shooting location information of the first shot image, but matches the shooting condition of the first shot image when creating an album in which a plurality of images are arranged in a predetermined layout, and The album creating apparatus according to claim 10, wherein a second photographed image corresponding to the photographing location information along the movement route of the first user estimated by the movement route estimation unit is specified from the image information recording unit.   The album creating apparatus according to claim 11, wherein the shooting condition includes at least one of a season, a time zone to which the shooting date / time belongs, and a weather situation at the time of shooting. One or a plurality of users excluding the first user while receiving input of a first photographed image that is a photographed image of the first user, photographing location information of the first photographed image, and photographing date and time of the first photographed image Receiving a second photographed image that is a photographed image of the second user, the photographing location information of the second photographed image, and the photographing date and time of the second photographed image;
The first captured image, the shooting location information of the first captured image, and the shooting date and time of the first captured image are recorded in association with each other on a predetermined recording medium, and the second captured image and the second captured image are captured. Associating the location information and the shooting date and time of the second shot image on a predetermined recording medium; and
Estimating the movement path of the first user based on the date and time of shooting and the shooting location of the recorded first shot image;
When creating an album in which a plurality of images are arranged according to a predetermined layout, shooting location information along the movement route of the first user that does not match the shooting location information of the first shot image and is estimated by the movement route estimation unit Identifying a second captured image corresponding to the recording medium;
Creating an album in which the first photographed image and the identified second photographed image are arranged in the predetermined layout;
To create an album that allows a computer to execute   An album creation program for causing a computer to execute the album creation method according to claim 13.

Images