JP5933913B2 - Information service system and information service method - Google Patents

Description

  The present invention relates to an information service system and an information service method using so-called AR technology.

Researched AR (Augmented Reality) technology that adds information to the real environment and displays it using mobile devices such as smartphones that have improved processing speed, storage capacity and communication bandwidth. Has been. For example, the mobile terminal acquires position information by a GPS (Global Positioning System) function or the like, and displays information (annotation) corresponding to the position superimposed on the image being captured. Thereby, store information, route guidance information, etc. can be provided visually and sensuously, for example.
By the way, Patent Document 1 discloses a technique for providing store information related to position information transmitted from a mobile terminal. Patent Document 2 discloses a technique for providing store information close to the preference of a user who uses a certain store based on the purchasing tendency of other users.

JP 2005-242459 A JP 2007-286974 A

  However, in the method of displaying information according to only the position information, the content of the information to be output is fixed, and it may not be possible to provide useful information for the user. Therefore, it is desirable to provide a variety of information more flexibly by using such AR technology according to the current situation of the user.

  The present invention has been made in view of such a situation. An information service system and an information service method for outputting a variety of information more flexibly according to a user's current situation or the like using AR technology. provide.

In order to solve the above-described problem, the present invention is an information service system including a plurality of users' portable terminals and a server device connected to the portable terminals via a network. an image feature point position information and the combinational by marker images defined to provide a predetermined output information to the user of the user, and the image identification information for identifying the image feature points are associated are in storage An image identification information storage unit that captures an image of a subject, generates an image, a display unit that sequentially displays the images captured by the imaging unit, and an image extracted from the image captured by the imaging unit An image identification information search unit that reads out the image identification information stored in the image identification information storage unit in association with the image feature point of the marker image that has been recorded; A position information generation unit that generates position information indicating a position, the image identification information read by the image identification information search unit, and the position information generated by the position information generation unit are transmitted to the server device. A condition transmitting unit that receives the output information transmitted from the server device in accordance with the image identification information and the position information transmitted by the condition transmitting unit, and the received output information is displayed on the display unit. And an image control unit that displays the image sequentially superimposed on the image, and the server device stores position information indicating a position of the user's mobile terminal in association with each of a plurality of users. According to the number of users in the vicinity of the position indicated by the position information, the position information indicating the determined position, the position information indicating the determined position, the weather forecast, the season, The output information storage unit in which the associated output information is stored, the weather information, the season, and the position information indicating the same position as the position indicated by the position information transmitted from the mobile terminal are associated with the position information. An output information search unit that reads out the output information corresponding to the search information including the number of users stored in the storage unit, the image identification information transmitted from the portable terminal, and the position information from the output information storage unit And an output information transmission unit that transmits the output information read by the output information search unit to the portable terminal.

Further, the present invention, the portable terminal includes an image feature point extraction unit which extracts the image feature points of the marker image from the image generated by the imaging unit, before Symbol image identification information retrieval section, before serial and wherein the marker image to read out the image identification information associated with the image feature points extracted by the image feature point extraction unit.

Further, according to the present invention, the server device includes a user information storage unit that stores user information including attribute information indicating an attribute of the user, and the output information storage unit corresponds to the output information. Attribute information is stored, the output information search unit reads the user information corresponding to the user of the mobile terminal that has transmitted the image identification information and the position information from the user information storage unit, The output information is read by including the read user information in the search information .

Further, the present invention includes an image feature points defined marker images in order to provide a predetermined output information to the user in combination with the position information of the user, and the image identification information for identifying the image feature point corresponding A mobile terminal of a user having an image identification information storage unit that is attached and stored, and a position that is connected to the mobile terminal via a network and indicates the position of the mobile terminal of the user in association with each of a plurality of users According to the position information storage unit for storing information, and the number of users in the vicinity of the position indicated by the position information, the determined image identification information, the position information indicating the determined position, the weather forecast, and the season An information service method for an information service system, comprising: a server device having an output information storage unit storing the associated output information, wherein the portable terminal A step of capturing a body to generate an image, a step of sequentially displaying the captured image on a display unit, and an image feature point of the marker image extracted from the image captured by the imaging unit. A step of reading the image identification information stored in the image identification information storage unit, a step of generating position information indicating the position of the terminal, the read image identification information, and the generated position information. Transmitting to the server device; the server device associates a weather forecast, a season, and position information indicating the same position as the position indicated by the position information transmitted from the mobile terminal; The output information corresponding to the number of stored users, the image identification information transmitted from the portable terminal, and the position information is the output information. A step of reading from the storage unit, a step of transmitting the read output information to the portable terminal, and the portable terminal receiving the output information transmitted from the server device, and receiving the received output information, And a step of superimposing and displaying the images sequentially displayed on the display unit.

  As described above, according to the present invention, a mobile terminal captures an image of a subject, generates an image, sequentially displays it on a display unit, generates position information indicating the position of the terminal itself, and identifies the captured image. The image identification information and the position information to be transmitted are transmitted to the server device, and the server device stores the output information associated with the determined image identification information and the position information indicating the determined position, and transmits from the portable terminal The output information corresponding to the received image identification information and position information is read, the read output information is transmitted to the mobile terminal, the mobile terminal receives the output information transmitted from the server device, and the received output information The information service system and information service method that flexibly outputs a variety of information according to the situation at the time of the user is provided. Rukoto can.

It is a block diagram which shows the structure of the information service system by one Embodiment of this invention. It is a figure explaining the outline | summary of the information service by one Embodiment of this invention. It is a figure which shows the example of data memorize | stored in the image ID memory | storage part by one Embodiment of this invention. It is a figure which shows the example of data memorize | stored in the output information storage part by one Embodiment of this invention. It is a flowchart which shows the operation example of the information provision process by the information service system by one Embodiment of this invention. It is a figure which shows the example of application of the information service system in the various industry forms by one Embodiment of this invention. It is a figure which shows the example of application of the pattern A by one Embodiment of this invention. It is a sequence diagram which shows the operation example of the information service system by one Embodiment of this invention. It is a figure which shows the example of application of the pattern B by one Embodiment of this invention. It is a figure which shows the example of application of the pattern C by one Embodiment of this invention. It is a figure which shows the example of application of the pattern D by one Embodiment of this invention. It is a figure which shows the example of application of the pattern E by one Embodiment of this invention. It is a figure which shows the example of application of the pattern F by one Embodiment of this invention. It is a figure which shows the example of application of the pattern G by one Embodiment of this invention.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing the configuration of the information service system 1 according to the present embodiment. The information service system 1 includes a mobile terminal 10 and a server device 20 connected to the mobile terminal 10 via a network. Here, an overview of the information service according to the present embodiment will be described with reference to FIG. For example, the user activates an application (hereinafter also referred to as an application) that executes the information service according to the present embodiment of his / her portable terminal 10 and images the logo of the railway installed at the railway station. 10 (symbol a).

  The mobile terminal 10 extracts a logo as shown by a symbol b from the captured image, and reads an image ID (identification information) stored in advance in association with the extracted logo. The portable terminal 10 transmits a condition between the read image ID and the current position information generated by the GPS function or the like to the server device 20. The server device 20 receives the condition, and the image ID of the logo image extracted by image recognition, the position information, the number of other users in the vicinity, the preference of the user registered in advance, the weather at that time, as shown by the symbol c・ Determine information to be provided to the user in consideration of various factors such as temperature. Here, for example, when a logo of an ice cream shop existing in the vicinity is detected, the logo of the ice cream shop (symbol e) is superimposed on the image displayed on the display of the mobile terminal 10 as indicated by the symbol d. Displayed (overlay). Thereby, the user can know useful information according to various factors indicating the current situation of the user.

Returning to FIG. 1, the mobile terminal 10 includes an imaging unit 11, a display unit 12, a position information generation unit 13, an image ID storage unit 14, an image feature point extraction unit 15, an image ID search unit 16, a condition A transmission unit 17 and an image control unit 18 are provided. The mobile terminal 10 stores a program (application) for controlling the AR operation described below.
The imaging unit 11 is a camera that images a subject and generates an image.
On the display unit 12, images captured by the imaging unit 11 are sequentially displayed. That is, the image captured by the imaging unit 11 is displayed on the display unit 12 in a moving image state.
The position information generation unit 13 generates position information indicating the position of the own terminal. For example, the position information generation unit 13 has a GPS receiver function, and generates latitude and longitude information indicating the position of the terminal itself based on radio waves transmitted from GPS satellites.

  The image ID storage unit 14 stores image feature points of a predetermined image in association with the image ID. FIG. 3 is a diagram illustrating an example of data stored in the image ID storage unit 14. An image feature point is information that uniquely characterizes an image (marker) such as a logo mark or a JAN (Japanese Article Number) code. Specifically, it is information for performing RGB conversion on images and identifying and comparing image corners and corners. For example, when it is determined from all pixels in the image that there is a certain difference or more in the luminance values of the upper, lower, left, and right pixels of the pixel, it can be determined that an edge exists in the pixel. By detecting such an edge from all the pixels included in the image, the corners and corners of the image can be detected. By comparing the image feature points based on such corners and corners while correcting the inclination of the image and performing pattern matching, it is possible to determine whether or not a plurality of images match. In the image ID storage unit 14, image feature points of an image such as a logo mark and a JAN code, which are conditions for providing output information, are extracted and stored in advance. In the present embodiment, the information stored in the image ID storage unit 14 is read from the server device 20 and stored when the application is activated.

The image feature point extraction unit 15 extracts predetermined image feature points from the image captured by the imaging unit 11. For example, the image feature point extraction unit 15 extracts the edges included in the image as described above, and extracts corner and corner information based on the extracted edges as image feature points.
The image ID search unit 16 detects an image feature point that matches the image feature point extracted by the image feature point extraction unit 15 from the image ID storage unit 14 and reads an image ID associated with the detected image feature point. .
The condition transmission unit 17 sets a condition between the image ID read by the image ID search unit 16 based on the image captured by the imaging unit 11 and the position information generated by the position information generation unit 13 to the server device 20. Send. Here, since the image picked up by the image pickup unit 11 and the position information generated by the position information generation unit 13 change every moment, the condition transmission unit 17 sequentially sets the image ID and the position information. It transmits to the server device 20.

  The image control unit 18 causes the display unit 12 to display an image captured by the imaging unit 11. Further, the image control unit 18 receives the output information transmitted from the server device 20 according to the image ID and the position information transmitted by the condition transmitting unit 17, and sequentially outputs the received output information to the display unit 12. Overlay the displayed image. Here, the output information is, for example, image information, moving image information, text information, and the like, and is information as indicated by a symbol e in FIG. Further, the output information is attached with a link (URL) for acquiring information related to the output information (such as detailed information of the store), and the details regarding the output information can be obtained by pressing the link. Information can be acquired.

The server device 20 includes an image ID storage unit 21, an image ID transmission unit 22, a condition reception unit 23, an output information storage unit 24, a user information storage unit 25, an external information acquisition unit 26, and an output information search unit. 27 and an output information transmission unit 28.
The image ID storage unit 21 stores data similar to the information stored in the image ID storage unit 14.
The image ID transmission unit 22 reads out information stored in the image ID storage unit 21 and transmits the information to the mobile terminal 10 when an application is activated on the mobile terminal 10.
The condition receiving unit 23 receives a condition transmitted from the mobile terminal 10.

  The output information storage unit 24 stores output information associated with the determined image and the position information indicating the determined position. Furthermore, the output information storage unit 24 stores conditions such as attribute information corresponding to the output information. FIG. 4 is a diagram illustrating an example of data stored in the output information storage unit 24. The output information storage unit 24 stores output information in association with conditions such as position information, image ID, external information (weather, time, etc.), user information (gender, favorites, etc.). . The position information is information indicating latitude and longitude. The image ID is information corresponding to the image feature points stored in the image ID storage unit 21. The external information is information such as weather and time, for example, and includes various types of information that are neither position information, image ID nor user information. User information is attribute information included in user information registered in advance. For example, the user information includes information such as sex, age, address, and various favorite genres. These pieces of information are conditions for detecting output information provided to the user. Information indicating these conditions may be a value having a certain range. For example, the latitude and longitude, which are position information, are not information indicating a single point but may be values having a certain range. The output information is information such as an image, a moving image, and text to be displayed by being overlaid on the display of the user's portable terminal 10 by the AR technology.

  Here, in the present embodiment, the image ID storage unit 21 stores the image ID and the image feature point in association with each other, and the output information storage unit 24 stores the image ID and the output information in association with each other. However, the output information storage unit 24 may store the image ID, the image feature point, the output information, and the like in association with each other.

  The user information storage unit 25 stores user information including attribute information indicating attributes of the user of the mobile terminal 10. The user information is information registered in advance by the user using a dedicated application, a website, or the like. In the user information, for example, attribute information such as a user's sex, age, address, and various favorite genres is stored in association with a user ID for identifying the user.

  The external information acquisition unit 26 acquires information such as weather and time. For example, by connecting to an external server or the like, current weather information or weather forecast information provided by an API (Application Program Interface) or the like is acquired and stored in its own storage area. Or the external information acquisition part 26 is provided with the time measuring function, and acquires the time which is the present time. In addition, the external information acquisition unit 26 can acquire information such as season and road traffic information and store it in its own storage area.

The output information search unit 27 reads output information corresponding to the image ID and the position information transmitted from the mobile terminal 10 from the output information storage unit 24. At this time, the output information search unit 27 reads the user information corresponding to the user of the mobile terminal 10 that has transmitted the image ID and the position information from the user information storage unit 25, and the read user information and the external information acquisition unit 26. The output information corresponding to these conditions is read out on the condition that the external information acquired by is.
The output information transmission unit 28 transmits the output information read by the output information search unit 27 to the mobile terminal 10.

Next, an operation example of the information service system 1 according to the present embodiment will be described. FIG. 5 is a flowchart showing an operation example of information providing processing by the information service system 1.
First, the mobile terminal 10 activates an application for controlling the AR operation according to the present embodiment, which is stored in advance, based on operation information input from the user. The image ID transmission unit 22 of the server device 20 transmits information stored in the image ID storage unit 21 to the mobile terminal 10 and causes the image ID storage unit 14 of the mobile terminal 10 to store the information. The imaging unit 11 of the mobile terminal 10 starts imaging the subject. The image control unit 18 sequentially displays images captured by the imaging unit 11 on the display unit 12 (step S1).

  The position information generation unit 13 generates position information based on the GPS function (step S2). The image feature point extraction unit 15 of the mobile terminal 10 extracts image feature points from the image captured by the imaging unit 11 (step S3). The image ID search unit 16 reads the image ID corresponding to the image feature point extracted by the image feature point extraction unit 15 from the image ID storage unit 14. The condition transmission part 17 transmits the conditions of image ID and position information to the server apparatus 20 (step S4). The condition receiving unit 23 of the server device 20 receives the condition transmitted from the mobile terminal 10. The server device 20 receives a user ID from the mobile terminal 10, for example, when the application in the mobile terminal 10 is activated, and reads user information corresponding to the received user ID from the user information storage unit 25. The external information acquisition unit 26 acquires external information.

  The output information search unit 27 is conditional on the image ID and position information transmitted from the mobile terminal 10, the user information read from the user information storage unit 25, and the external information acquired by the external information acquisition unit 26. The output information stored in the output information storage unit 24 is read (step S5). The output information transmission unit 28 transmits the output information read in step S4 to the mobile terminal 10 (step S6). When the portable terminal 10 receives the output information transmitted from the server device 20, the image control unit 18 causes the display unit 12 to display the received output information on the image captured by the imaging unit 11 (step S7). .

  Such a process of providing information according to an image captured by the mobile terminal 10 and position information can be applied to various scenes. For example, FIG. 6 is a diagram illustrating application examples of the information service system 1 in various business forms. Here, seven application patterns (pattern A, pattern B, pattern C, pattern D, pattern E, pattern F, and pattern G) that the application of this embodiment is considered to be particularly effective are shown. For example, when providing information on convenience stores (convenience stores), the patterns A and B are considered to be particularly effective.

  FIG. 7 is a diagram illustrating an application example of the pattern A. The pattern A is the same as that in the above-described embodiment. That is, (1) when the application of the mobile terminal 10 is activated and the imaging unit 11 is directed to the railway logo mark, (2) the mobile terminal 10 transmits the logo mark image ID and position information to the server device 20. To do. (3) When the server device 20 transmits output information corresponding to the received logo ID image ID and position information to the mobile terminal 10, the mobile terminal 10 displays the output information transmitted from the server device 20 on the display unit 12. To display. (4) When the output information displayed on the display unit 12 is touched, detailed information is acquired and displayed via the network.

  Such a service can provide useful information for consumers near landmarks (logo marks) and users of retail stores and restaurants. For example, it is useful when searching for nearby retail stores, restaurants, etc. when a user visits a landmark. As a result, the user can obtain information on nearby stores by simply pointing the camera of the mobile terminal 10 at the landmark without performing a complicated operation such as operating the mobile terminal 10 to use a search site or the like. Can do. For a store or the like, it is possible to expect a new customer acquisition or enclosure by displaying discounts and bargain information on retail stores and restaurants on the user's mobile terminal 10 as output information.

  Here, for example, when the communication company of the mobile terminal 10 provides a service for searching for location information of another user who is permitted in advance, the location information service is used to be in the same area. Information to be provided may be distributed according to the number of users. FIG. 8 is a sequence diagram showing such an application example. Here, the information service system 1 is connected via a network to a content provider system 30 that transmits discount information in a store as output information and a communication company system 40 that manages location information of the mobile terminal 10. Further, a terminal of a user who receives provision of output information will be described as a mobile terminal 10-1, and a terminal of another user who is a friend of the user of the mobile terminal 10-1 will be described as a mobile terminal 10-2.

  The communication company system 40 polls the portable terminal 10-2 to acquire position information, and provides it to the server device 20 (step S11). The portable terminal 10-1 makes an inquiry to the server device 20, and acquires the position information of the portable terminal 10-2. When the mobile terminal 10-1 images the marker (step S13), the marker is analyzed to extract an image feature point (step S14), and an image ID corresponding to the image feature point is acquired (step S15).

  The portable terminal 10-1 transmits its own user ID and image ID to the server device 20 (step S16). The server device 20 extracts the user ID of the user of the mobile terminal 10-2 stored in advance in association with the user ID of the mobile terminal 10-1 (step S17). The server device 20 classifies the number of other users present at the same position as the user of the mobile terminal 10-1 into a group (step S18). The server apparatus 20 extracts the image ID, position information (latitude, longitude), time, location and business type corresponding to the group (step S19), and transmits them to the content provider system 30 (step S20).

  The content provider system 30 extracts store information corresponding to the place and the business condition transmitted from the server device 20 (step S21), and transmits them to the server device 20 (step S22). The server device 20 converts the store information transmitted from the content provider system 30 into output information to be displayed by the AR technology (step S23), and transmits the output information to the mobile terminal 10-1 (step S24). The portable terminal 10-1 displays the received output information as an AR, and when the output information is clicked (step S25), it transmits a store detailed information acquisition request to the content provider system 30 (step S26). The content provider system 30 transmits the store detailed information to the mobile terminal 10-1 in response to the store detailed information acquisition request transmitted from the mobile terminal 10-1 (step S27).

  FIG. 9 is a diagram illustrating an application example of the pattern B. In Pattern B, (1) when the application of the mobile terminal 10 is activated and the imaging unit 11 is directed to the JAN code in the retail store, (2) the mobile terminal 10 displays the image ID and position information of the captured JAN code. It transmits to the server device 20. (3) When the server device 20 transmits output information corresponding to the received JAN code image ID and position information to the mobile terminal 10, the mobile terminal 10 displays the output information transmitted from the server device 20 on the display unit 12. To display. (4) When the output information displayed on the display unit 12 is touched, related product information is acquired and displayed via the network.

  Such a service can provide useful information for merchandise purchasers at retail stores. For example, when a user picks up a product, a product related to the product is displayed. Or the recipe relevant to goods is displayed and related goods are displayed. Thereby, for a user, forgetting to buy can be prevented by showing a related product. For a store or the like, a product corresponding to each store can be presented based on the position information. Thereby, it is possible to prompt the user to purchase additional items.

  FIG. 10 is a diagram illustrating an application example of the pattern C. In pattern C, (1) when the application of the mobile terminal 10 is activated and the imaging unit 11 is directed to the JAN code in the retail store, (2) the mobile terminal 10 displays the image ID and position information of the captured JAN code. It transmits to the server device 20. (3) When the server device 20 transmits output information corresponding to the received JAN code image ID and position information to the mobile terminal 10, the mobile terminal 10 displays the output information transmitted from the server device 20 on the display unit 12. To display.

  Such services can provide useful information for new purchasers and existing users of merchandise at retail stores. For example, when it is desired to confirm information about a product, information about the product and how to use the product are displayed. Thereby, for the user, when it is desired to confirm the information of the product, it can be confirmed immediately on the spot. Alternatively, when the used product is used up, it is possible to search for nearby stores where the product can be purchased based on the position information. For stores and the like, it is possible to promote the continuous use of stores and products by presenting stores that can be purchased.

  FIG. 11 is a diagram illustrating an application example of the pattern D. In the pattern D, (1) when the application of the mobile terminal 10 is activated and the imaging unit 11 is directed to the logo at the theme park, (2) the mobile terminal 10 displays the image ID and position information of the captured logo mark. It transmits to the server device 20. (3) When the server device 20 transmits output information corresponding to the received logo ID image ID and position information to the mobile terminal 10, the mobile terminal 10 transmits the facility congestion status transmitted from the server device 20. Is displayed on the display unit 12. (4) The users are distributed to the facilities based on the displayed information.

  Such services can provide useful information for theme park users. For example, when visiting a theme park, the congestion status of the facility can be confirmed. Thereby, the user can go around the facilities of the theme park efficiently. For a theme park, the facility utilization rate can be improved by providing information on the congestion situation.

  FIG. 12 is a diagram illustrating an application example of the pattern E. In the pattern E, (1) when the application of the mobile terminal 10 is activated and the imaging unit 11 is directed to the logo mark at the restaurant, (2) the mobile terminal 10 displays the image ID and position information of the captured logo mark. It transmits to the server device 20. (3) When the server device 20 transmits output information corresponding to the received logo ID image ID and position information to the mobile terminal 10, the mobile terminal 10 stores the information based on the output information transmitted from the server device 20. Display bulletin board information about.

  Such a service can provide useful information for a restaurant user. For example, when the bulletin board and word-of-mouth information regarding restaurants are displayed in AR, the user can immediately confirm the bulletin board and word-of-mouth information of restaurants to be visited on the spot. For the store, it becomes possible to grasp the opinions of the users.

  FIG. 13 is a diagram illustrating an application example of the pattern F. In FIG. In the pattern F, (1) when the application of the mobile terminal 10 is activated and the imaging unit 11 is directed to the JAN code of can juice, (2) the mobile terminal 10 displays the image ID and position information of the captured JAN code. It transmits to the server device 20. (3) When the server device 20 transmits the item information of the game, which is output information corresponding to the image ID and the position information of the received JAN code, to the mobile terminal 10, the mobile terminal 10 is transmitted from the server device 20. The output information is displayed on the display unit 12. (4) In this way, items in the game can be collected according to the AR technology, and the game can proceed.

  Such a service can provide useful information for merchandise purchasers at retail stores. For example, after a user purchases a product, a JAN code is imaged and a game item is acquired. Thereby, for the user, a prize or the like can be acquired according to the progress of the game. In addition, interaction between users can be performed on the game. For a store or the like, the user can continuously purchase the product. Furthermore, marketing information such as which can juice is preferred in each region can be acquired from the position information.

  FIG. 14 is a diagram illustrating an application example of the pattern G. In the pattern G, (1) when the application of the mobile terminal 10 is activated and the imaging unit 11 is pointed to the determined marker, (2) the mobile terminal 10 uses the image ID and the position information of the captured marker to the server device. 20 to send. (3) When the server device 20 transmits an image of furniture, which is output information corresponding to the received marker image ID and position information, to the mobile terminal 10, the mobile terminal 10 outputs the output information transmitted from the server device 20. Is displayed on the display unit 12. (4) Then, by touching the furniture image displayed in the AR on the screen, a store where the furniture can be purchased is displayed.

  Such a service can provide useful information for those who plan to purchase the product. For example, a product arrangement simulation can be performed by using an AR marker when a user purchases a product. Thereby, for the user, the unmatch after furniture purchase can be eliminated by the simulation of the product arrangement. For stores and the like, the return of merchandise can be reduced. Alternatively, the user can be guided to the store by adding store information to the product.

  The program for realizing the function of the processing unit in the present invention is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system and executed to provide information. May be. Here, the “computer system” includes an OS and hardware such as peripheral devices. The “computer system” includes a WWW system having a homepage providing environment (or display environment). The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Further, the “computer-readable recording medium” refers to a volatile memory (RAM) in a computer system that becomes a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. In addition, those holding programs for a certain period of time are also included.

  The program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, and what is called a difference file (difference program) may be sufficient.

DESCRIPTION OF SYMBOLS 1 Information service system 10 Portable terminal 11 Imaging part 12 Display part 13 Position information generation part 14 Image ID memory | storage part 15 Image feature point extraction part 16 Image ID search part 17 Condition transmission part 18 Image control part 20 Server apparatus 21 Image ID memory | storage part DESCRIPTION OF SYMBOLS 22 Image ID transmission part 23 Condition receiving part 24 Output information storage part 25 User information storage part 26 External information acquisition part 27 Output information search part 28 Output information transmission part 30 Content provider system 40 Communication company system

Claims (4)

An information service system comprising a plurality of user portable terminals and a server device connected to the portable terminals via a network,
The portable terminal is
An image feature point position information and the combinational by marker images defined to provide a predetermined output information to the user of the user, and the image identification information for identifying the image feature points are associated are in storage An image identification information storage unit;
An imaging unit that images a subject and generates an image;
A display unit for sequentially displaying the images captured by the imaging unit;
An image identification information search unit that reads out the image identification information stored in the image identification information storage unit in association with the image feature point of the marker image extracted from the image captured by the imaging unit;
A position information generation unit that generates position information indicating the position of the terminal;
A condition transmission unit that transmits the image identification information read by the image identification information search unit and the position information generated by the position information generation unit to the server device;
The output information transmitted from the server device is received according to the image identification information and the position information transmitted by the condition transmitting unit, and the received output information is sequentially displayed on the display unit. An image control unit that displays the image superimposed on the image,
The server device
A location information storage unit that stores location information indicating the location of the mobile terminal of the user in association with each of the plurality of users;
According to the number of users in the vicinity of the position indicated by the position information, predetermined image identification information, position information indicating the determined position, output information associated with the weather forecast and the season are stored. An output information storage unit;
The weather forecast, the season, and the location information indicating the same location as the location indicated by the location information transmitted from the mobile terminal are associated with each other and stored in the location information storage unit and transmitted from the mobile terminal. An output information search unit that reads out the output information corresponding to the search information including the image identification information and the position information from the output information storage unit;
An output information transmission unit that transmits the output information read by the output information search unit to the mobile terminal;
An information service system comprising: The portable terminal is
An image feature point extraction unit that extracts the image feature point of the marker image from the image generated by the imaging unit ;
Before Symbol image identification information retrieval section, before Symbol marker image according to claim 1, characterized in that reading the image identification information associated with the image feature points extracted by the image feature point extraction unit Information service system. The server device
A user information storage unit storing user information including attribute information indicating the attribute of the user;
In the output information storage unit, attribute information corresponding to the output information is stored,
The output information search unit reads the user information corresponding to the user of the portable terminal that has transmitted the image identification information and the position information from the user information storage unit, and reads the read user information as the search information. The information service system according to claim 1 or 2, wherein the output information is read out by including the output information. And image feature points of the marker image determined, and image identification information for identifying the image feature points are mapped are in store in order to provide a predetermined output information to the user in combination with the position information of the user A position where the mobile terminal of the user having the image identification information storage unit is connected to the mobile terminal via the network, and position information indicating the position of the mobile terminal of the user is stored in association with each of the plurality of users According to the number of users in the vicinity of the position indicated by the information storage unit and the position information, the output associated with the predetermined image identification information, the position information indicating the determined position, the weather forecast, and the season An information service method of an information service system comprising a server device having an output information storage unit in which information is stored,
The mobile terminal is
Imaging a subject to generate an image;
Sequentially displaying captured images on a display unit;
Reading the image identification information stored in the image identification information storage unit in association with the image feature points of the marker image extracted from the image captured by the imaging unit;
Generating position information indicating the position of the terminal;
Transmitting the read image identification information and the generated position information to the server device;
The server device is
The weather forecast, the season, and the location information indicating the same location as the location indicated by the location information transmitted from the mobile terminal are associated with each other and stored in the location information storage unit and transmitted from the mobile terminal. Reading the output information corresponding to the image identification information and the position information from the output information storage unit;
Transmitting the read output information to the mobile terminal;
The mobile terminal is
Receiving the output information transmitted from the server device, and displaying the received output information superimposed on the images sequentially displayed on the display unit;
An information service method comprising:

Images