JP2007095039A - Information providing server, client, processing method of information providing system, and recording medium recording program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information providing server, a client, a processing method for an information providing system, a recording medium in which a program is recorded, and an advertisement providing method, by which a free-of-charge three-dimensional aerial sightseeing is achieved by publishing advertisement information. <P>SOLUTION: This invention includes: a three-dimensional image conversion part 101 which converts aerial photographs A and B of one area taken at two different points into three-dimensional image data; a three-dimensional advertisement information database 105 which stores unit records of advertisement information added to the three-dimensional image data; a clock part 104 which manages the current date and time; a three-dimensional image composition part 102 which takes advertisement contents whose publication period includes the current date and time by referring to a three-dimensional advertisement information database 105, adds them to the three-dimensional image data, and outputs the composite three-dimensional image data; and a three-dimensional image browser 103 which receives the composite three-dimensional image data, presents three-dimensional image solid representation according to viewpoint position information from a user, and generates three-dimensional solid expression from a new viewpoint point again and presents it when the new viewpoint position is specified. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

The present invention relates to an information providing server, a client, a processing method of an information providing system, a recording medium recording a program, and an advertisement providing method. In particular, the present invention provides a three-dimensional stereoscopic image of a point desired by a user and The present invention relates to an information providing server that provides advertisement information in an image, a client, a processing method of an information providing system, a recording medium recording a program, and an advertisement providing method.

Conventionally, as a search for a WWW Web page or an i-mode page, a method of selecting a menu created in advance and following a link to a desired page, or giving a keyword to a search engine and hitting it A method for searching a page is generally known.

One of the features of these searches is that the page is searched completely independent of the physical location. For example, when searching for information relating to a florist, hit pages are provided regardless of the position where the searcher actually exists, such as a florist in Tokyo, a florist in Paris, and a florist in Sapporo. Such a search method is convenient when the location information is irrelevant, but for example, if you are standing in front of Shibuya Station and want to find a suitable florist, get only the florist page around Shibuya Station. This is what is desired, and it is inconvenient in the conventional method in which even pages of florists in Paris and Sapporo are searched.

As a method for solving this, two-dimensional map information is provided to the user, and when the user designates a certain location on the map, the store information is provided by following a link to the store information at the location. There is. Such things are very common. For example, a map of a certain country is displayed, and when a certain prefecture is specified, jump to the information of that prefecture.

For example, on the website of the French National Tourist Office (http://www.franceinformation.or.jp/oindex/index.html), a map of France appears and you click on a certain province with the mouse. Jump to information. This is used very frequently because it can be easily realized on a Web page by using a clickable map technique. Japanese Patent No. 2756483, “Advertising Information Supply Method and Registration Method”, restricts the information of the link destination to the advertising information and to the two-dimensional map.

However, the conventional method of providing two-dimensional map information and receiving input of position information from the user has the following problems.

The first problem is that it is difficult to update the map information. Especially in urban areas, rebuilding of buildings and construction of new roads are frequent, so maintenance and updating to quickly reflect these latest information on the map is a laborious task. For example, advertisements (banner advertisements, etc.) posted on two-dimensional map information may be manually deleted by the administrator at the end of the posting period instructed by the sponsor or contracted, and new advertisements may be posted. Similarly, the posting process is executed manually.

As a second problem, information retrieval from a planar map expressed in two dimensions is convenient as an operation of retrieval, but is not interesting when viewed from the user side. Searching from such a map is like searching for a station on the route using a timetable.

As a third problem, a general method for providing a service as described above to a user collects a fee from the user. However, there is an example of a successful business by collecting such a fee. not much.

Conventionally, in order to realize such a service, a database is prepared on a server using the Internet, while various media are used to advertise that there is a home page that provides a service at a specific URL. When the user designates the URL from a client terminal connected to the Internet, a mechanism is prepared for collecting the usage fee designated on the homepage. This can be done by entering a credit card number that has become common on sales sites using the Internet recently, or by using a prepaid card that is an electronic cash that is sold at a convenience store in advance for the purpose of settlement on the Internet. There are other methods.

When the usage fee is collected on the homepage, a program for using the service desired by the user is sent from the WWW server to the client terminal. The user can use the service by executing the program sent by the client terminal. However, when using a method that takes a usage fee in this way, there is a business success example on the Internet. Few.

The present invention has been made in view of the above problems, can reduce the work load required for the maintenance and update of map information and advertisement information, and obtain a visual effect that the user can enjoy while using, Information providing server, client, processing method of information providing system, and program for providing service (3D aerial sightseeing service) as if the user is enjoying the 3D space for free by posting advertisement information It is an object to provide a recording medium and an advertisement providing method.

In order to solve the above-mentioned problem, the invention according to claim 1 is characterized in that an advertisement information storage means for storing advertisement information including at least an advertisement insertion period for which advertisement insertion is desired, with an ID attached to each advertisement, and the advertisement Three-dimensional image data generated based on image information obtained by photographing the same region from different locations and having a clear physical position when the insertion period included in the advertisement information stored in the information storage means includes the current date and time; A three-dimensional image synthesizing unit that synthesizes the advertisement information to generate synthesized three-dimensional image data, an ID added to the advertisement information for which an advertisement is desired to be posted, and the name of an advertisement publisher who wishes to place an advertisement And an advertising contract storage means for storing advertising contract information including the contract amount, and upon receiving an advertising request from the advertising publisher, at least three-dimensional image data associated with a physical position in the real world The contract processing of the advertisement insertion request is executed based on the advertisement insertion fee set according to the display position in the storage, and stored in the advertisement information storage means based on the advertisement contract information stored in the advertisement contract storage means And advertising contract means for updating the advertisement information.

According to the second aspect of the present invention, 3D image data generated based on image information obtained by photographing the same region from different locations and having a clear physical position is stored in association with position information indicating the position of the 3D image data. Dimensional image data storage means, advertisement information storage means for storing advertisement information including at least an advertisement insertion period and an advertisement placement place for which advertisement is desired, with an ID for each advertisement, and based on browsing place designation information The three-dimensional image data is read from the three-dimensional image data storage means, and is included in the three-dimensional image data read out based on the insertion period including the current date and time data and the browsing location designation information in the advertisement information. The advertisement information having the placement location is read out from the advertisement information storage means, and the read out three-dimensional image data and the advertisement information are combined to generate a combined tertiary. Advertising contract information including three-dimensional image composition means for generating image data, an ID added to the advertisement information for which an advertisement is desired to be placed, the name of an advertisement publisher who wishes to place an advertisement, and a contract amount When an advertisement placement request is received from the advertisement publisher storing means, and the advertisement publisher is stored, contract processing of the advertisement placement request is executed based on at least an advertisement placement fee set according to a display location, and the advertisement contract storage Advertising contract means for updating the advertisement information stored in the advertisement information storage means based on the advertisement contract information stored in the means.

According to a third aspect of the present invention, in the first or second aspect of the present invention, a three-dimensional stereoscopic expression is generated from the combined three-dimensional image data output by the three-dimensional image combining unit based on desired viewpoint position information. It has 3D image browser means.

According to a fourth aspect of the present invention, there is provided the land according to the third aspect of the present invention, including a linguistic expression relating to a name and content corresponding to a landmark existing in the three-dimensional image data, and positional information relating to the position of the landmark. A landmark position storage means for storing mark information, and a search engine for searching page data including contents related to the keyword from a set of page data and generating link information to the page data when a keyword is given as an input When the related information presentation related to the position is instructed, the 3D image browser means responds by referring to the position information included in the landmark information of the landmark position storage means. Landmark information to be identified, and the language expression information of the landmark information is output to the search engine means. And, wherein the generate link information of the page data associated with the landmark information to the search engine unit.

According to a fifth aspect of the present invention, in the invention according to the fourth aspect, the user stay landmark storage means for storing a landmark stay history including the landmark where the user stayed and the stay time at the landmark. , All movement history storage means for recording a movement history including the user's viewpoint position and the time at that time, and around the landmark necessary to determine that the user is interested in the landmark A stay time threshold storage means for storing a stay time threshold indicating a stay time, and a range indicating the definition of the peripheral position from the position of the landmark necessary for determining that the user is interested in the landmark In-range / outside determination distance storage means for storing inside / outside determination distance information, and the landmark information is extracted from the landmark position storage means, and the position information of the landmark information And the inside / outside determination distance information stored in the range inside / outside determination distance storage means, the viewpoint position of the user is defined by the inside / outside determination distance information from the extracted landmark position. The movement history when it is within the range of the peripheral position is extracted from the all movement history storage means, and the first time when the user's viewpoint position passes the landmark using the extracted movement history. And the stay time calculation means for calculating the time of the second time, the stay time that is the difference between the last time and the first time calculated by the stay time calculation means, and the stay time threshold storage means Compared to the stay time threshold, and if the stay time is greater than or equal to the stay time threshold, the language expression information of the landmark information is used to And having a user stay landmark judgment means for storing the name and the time spent in the user stay landmark storage means.

According to a sixth aspect of the present invention, in the fifth aspect of the present invention, the all-information search instruction for recording the information presentation instruction history including the landmark name at which the user has instructed the presentation of the related information regarding the position and the time at that time. When the history storage means and the administrator give an instruction to present the counting result, the landmark stay history of the user stay landmark storage means or the information presentation instruction history of the all information search instruction history storage means is output. And a questionnaire total result presentation means.

The invention according to claim 7 is the invention according to any one of claims 1 to 6, wherein the advertisement information includes at least shape information indicating a shape of an advertisement medium and character information indicating a message or the like posted on the advertisement medium. It is characterized by including advertisement contents.

The invention according to claim 8 is the invention according to claims 1 to 7, wherein the three-dimensional image data converting means generates three-dimensional image data based on image information obtained by photographing the same region from different places and having a clear physical position. It is characterized by having.

According to the ninth aspect of the present invention, an information providing server storing at least an advertisement information including an advertisement insertion period for which an advertisement is desired to be placed with an ID for each advertisement is requested to provide information indicating viewpoint position information. When the posting period included in the stored advertisement information includes the current date and time, the information providing server is generated based on image information that is captured from the same area and has a clear physical position. The three-dimensional image data and the advertisement information are combined to generate combined three-dimensional image data, and the viewpoint position information is used to generate a three-dimensional image stereoscopic representation from the combined three-dimensional image data. The three-dimensional representation is received and displayed, and the information providing server displays a language representation regarding the name and content corresponding to the landmark existing in the three-dimensional image data and the position of the landmark. The landmark information including the location information is stored, the related information provision request indicating the position for requesting the provision of the related information is made to the information providing server, and the stored information is stored to the information providing server. Content related to the language expression information from a set of page data by referring to the position information included in the landmark information, identifying the corresponding landmark information, and using the language expression information of the landmark information A search is made for page data including "," and link information to the page data is generated.

The invention according to claim 10 stores three-dimensional image data generated based on image information obtained by photographing the same region from different places and having a clear physical position in association with position information indicating the position of the three-dimensional image data, Further, a browsing location for designating a location desired to be browsed for an information providing server that stores advertisement information including at least an advertisement posting period and a placement location for which an advertisement is desired with an ID for each advertisement. Performing the designation, causing the information providing server to read out the corresponding three-dimensional image data from the three-dimensional image data based on the browsing location designation, and the posting period including the current date and time data, The advertisement information having the placement location included in the read 3D image data is read from the advertisement information, and the read 3D image data and the A three-dimensional image browser that generates combined three-dimensional image data by combining the information, receives the combined three-dimensional image data, and generates a three-dimensional image stereoscopic representation based on viewpoint position information; The information providing server comprising: an input unit that outputs the viewpoint position information to the three-dimensional image browser; and a display unit that receives the three-dimensional image stereoscopic representation from the three-dimensional image browser and displays it to a user. Stores landmark information including a linguistic expression relating to a name and content corresponding to a landmark existing in the three-dimensional image data and position information relating to the position of the landmark, and provides related information to the information providing server. The related information providing request indicating the position for requesting the provision of the information is made, and the position information included in the stored landmark information is sent to the information providing server. The corresponding landmark information is specified, and the language expression information of the landmark information is used to search page data including contents related to the language expression information from a set of page data, and It is characterized by generating link information to page data.

The invention according to claim 11 is an advertisement insertion request for requesting an advertisement to be provided to an information providing server that stores at least advertisement information including an advertisement insertion period for which advertisement insertion is desired with an ID for each advertisement. And executes contract processing for the advertisement insertion request based on the advertisement insertion fee set in accordance with at least the display position in the three-dimensional image data associated with the physical position in the real world. And updating the stored advertisement information based on the content of the contract processing, and in response to a request for information provision from another client, the insertion period included in the stored advertisement information When the date and time are included, the advertisement information is combined with the three-dimensional image data generated based on the image information that is taken from different places in the same area and the physical position is clear, and combined three-dimensional To generate image data, characterized in that to transmit the synthesized three-dimensional image data to the other client.

The invention according to claim 12 is a processing method of an information providing system, wherein the information providing server stores advertisement information including at least a publication period of an advertisement desired to be placed with an ID for each advertisement. An information storage step, an information providing client requesting the information providing server to provide information indicating viewpoint position information, and an information providing server storing the advertisement information stored in the advertisement information storing step. When the included posting period includes the current date and time, the advertisement information is combined with 3D image data generated based on image information that is captured from different locations in the same region and has a clear physical position, and combined 3D A three-dimensional image that generates image data and generates a three-dimensional image stereoscopic representation from the synthesized three-dimensional image data using the viewpoint position information. A step of receiving, displaying the 3D image stereoscopic representation in the information providing client, and a request for placing an advertisement by the information providing client for providing an advertisement in the information providing server; An advertisement placement requesting step that is performed for the advertisement, and an advertisement set by the information providing server according to the display position in the three-dimensional image data associated with at least the physical position in the real world in response to the advertisement placement request An advertising contract step that executes contract processing of the advertisement posting request based on the posting fee, and updates the advertising information stored by the advertising information storage step based on the content of the contract processing, To do.

The invention according to claim 13 is a processing method of an information providing system, wherein the information providing server generates three-dimensional image data generated based on image information obtained by photographing the same area from different places and having a clear physical position. 3D image data storage step for storing in association with position information indicating the position of the 2D image data, and advertisement information including at least a publication period and a place where the advertisement is desired to be placed by the information providing server for each advertisement. An advertisement information storing step for storing information with an ID attached thereto, a browsing location designation step for performing browsing location designation for designating a location desired to be browsed by the information providing client to the information providing server, and the information provision The server reads out the corresponding 3D image data from the 3D image data based on the browsing location designation, The advertising information having the posting period including date and time data and the posting location included in the three-dimensional image data read based on the browsing location designation is read from the advertising information, and the read three-dimensional image data And the advertisement information are combined to generate combined three-dimensional image data and output to the information providing client, and the information providing client receives the combined three-dimensional image data. Based on the viewpoint position information, a three-dimensional image step for generating a three-dimensional image stereoscopic representation and an advertisement providing request for requesting an advertisement are made to the information providing server by the information providing client for providing the advertisement. An advertisement placement requesting step, and the information providing server receives the advertisement placement request, and at least the physical world physical Executing the contract processing of the advertisement insertion request based on the advertisement insertion fee set according to the display position in the 3D image data associated with the position, and storing the advertisement information based on the content of the contract processing And an advertising contract step of updating the advertisement information stored in the above.

According to a fourteenth aspect of the present invention, in the invention according to the twelfth or thirteenth aspect, the information providing server causes a linguistic expression relating to a name or content corresponding to a landmark present in the three-dimensional image data and the landmark. A landmark position storing step for storing landmark information including position information regarding the position, and a related information requesting step for making a related information provision request indicating a position for requesting provision of related information by the information providing client; , The information providing server refers to the position information included in the landmark information stored in the landmark position storage step, specifies corresponding landmark information, and the language expression information of the landmark information. Is used to include the content related to the language expression information from the set of page data. To search for Jideta, characterized in that it comprises a related information presenting step of generating link information to the page data.

The invention according to claim 15 is the invention according to claim 14, wherein the information providing server records a movement history storing step including a movement history including the viewpoint position of the user and the time at the time, and the information A staying time threshold storing step of storing a staying time threshold indicating a staying time around the landmark necessary for determining that the user is interested in the landmark by the providing server; and the information providing server A range inside / outside determination distance storing step for storing inside / outside determination distance information indicating a definition of a peripheral position from the position of the landmark necessary for determining that the user is interested in the landmark, and The landmark information stored in the landmark position storage step is extracted by the information providing server, and the landmark information The user's viewpoint position is defined from the extracted landmark position by the in-range / outside determination distance information using the position information and the in-range / outside determination distance information stored in the in-range / outside determination distance storage step. The movement history when it is within the range of the peripheral position is extracted from the information stored by the all movement history storage step, and the viewpoint position of the user is extracted from the landmark using the extracted movement history. A stay time calculation step of calculating a first time passing through and a second time, and a stay which is a difference between the last time calculated by the stay time calculation step and the first time by the information providing server Time is compared with the stay time threshold stored in the stay time threshold storing step, and the stay time is less than the stay time threshold. In this case, a user stay landmark determination step of storing a landmark stay history including the landmark name and the stay time using the language expression information of the landmark information, and the use of the use by the information providing server All information search instruction history storage step for recording the information presentation instruction history including the landmark name that the person has instructed to present related information regarding the position and the time at that time, and the information providing client instructs to present the total result A totaling result presentation request step for performing a totaling result presentation request, and when the information providing server receives the totaling result presentation request, the landmark stay history stored in the user stay landmark determination step or the whole The information presentation instruction history stored in the information search instruction history saving step is output. Including a step of presenting a questionnaire summary result.

According to a sixteenth aspect of the present invention, in the invention according to the twelfth to fifteenth aspects, the advertisement information includes at least shape information indicating a shape of an advertisement medium and character information indicating a message or the like posted on the advertisement medium. It is characterized by including advertisement contents.

The invention according to claim 17 is a recording medium in which a program for a client is recorded, and stores at least advertisement information including an advertisement insertion period for which advertisement insertion is desired, with an ID attached to each advertisement. A process for making an advertisement placement request for requesting advertisement placement to the information providing server, and a contract for the advertisement placement request based on an advertisement placement fee set according to at least the display location for the information providing server. The posting period included in the stored advertisement information in response to a request for information provision from another client, executing the process, updating the stored advertisement information based on the content of the contract process However, when the present date and time are included, the three-dimensional image data generated based on image information that is taken from different places in the same region and has a clear physical position, and the advertisement information Synthesized by generating a synthesized three-dimensional image data, characterized by recording the client program instructs a process of transmitting the synthesized three-dimensional image data to the other clients, to the computer.

As is clear from the above description, according to the information providing server and client, the advertisement providing system, the method and the recording medium recording the program of the present invention, the map information is provided and the input from the user is accepted. When providing related information, the following effects can be obtained.

As a first effect, for the problem that it is difficult to update the map information and the advertisement information, by using the artificial satellite image and the aerial photograph, the manual work of creating the map can be replaced with the mechanical work, and the advertisement information. Can be automatically synthesized and output, making updating easier. For example, with IKONOS, it is possible to update the entire earth surface every week.

In addition, many related information on weather and volcano information is provided / updated on the WWW, and the service provider does not update the related information because the user searches when the related information is needed. Both can provide the latest information. In the conventional method, since related information is linked to a map in advance, it has always been necessary to manually update the information to provide the latest information. However, it is not realistic considering actual operation. The present invention has a great effect of clearing the problem and always providing the latest information to the user.

As a second effect, for the problem that information retrieval from a map is not fun, if the user changes the viewpoint position, it is possible to change the 3D stereoscopic image in real time. It feels like an aerial tour, so you can get a visual effect that is much more fun than simply following the map. Moreover, even if the same area is seen, since the store situation and advertisement information that a new store is created or disappeared as described above are also realistically transmitted, there is an effect of further doubling the fun.

As a third effect, a three-dimensional aerial sightseeing service can be provided to the user on the Internet, but in order to become a business, a money flow must be created there. Of course, taking admission is the most direct, but on the Internet, there are few successful examples of businesses that accept admission directly from users. Therefore, in the present invention, a 3D aerial sightseeing service based on advertisement placement can be commercialized by taking in a form such as collection of advertisement placement fees from sponsors for advertisement placement used in commercial TV broadcasting stations. That is, there is an effect that it is possible to provide a user with free provision of an expensive three-dimensional aerial sightseeing service. In addition, it is possible to make a 3D aerial sightseeing user who searches for information through the 3D aerial sightseeing service see the advertisement regardless of his / her will, which has a great advantage for the advertisement provider. There is also.

As a fourth effect, when a user comes up with an unintentionally posted advertisement while taking a walk in the air with a three-dimensional aerial sightseeing service, he / she can use Internet shopping on the spot. Therefore, it is possible for all users to purchase the product on the client terminal without having to take action to purchase after confirming the advertising flyers posted in the past. Since it is easy and the process leading to purchase can be simplified, the willingness to purchase products can be improved.

Next, an information providing server, a client, an information providing system processing method, a recording medium on which a program is recorded, and an advertisement providing method according to embodiments of the present invention will be described in detail with reference to the accompanying drawings. Referring to FIGS. 1 to 18, there are shown embodiments of an information providing server, a client, an information providing system processing method, a recording medium recording a program, and an advertisement providing method according to the present invention.

FIG. 1 is a block diagram showing an outline of a system using an information providing server and a client terminal according to an embodiment of the present invention. 1, the system as an embodiment of the present invention is configured by connecting an information providing server 1, a client terminal 2, and a sponsor terminal 3 via a communication line 100 such as the Internet.

The information providing server 1 provides a three-dimensional aerial sightseeing service based on a three-dimensional image stereoscopic representation obtained by combining three-dimensional image data based on viewpoint position information input from the client terminal 2 and advertisement information provided by the sponsor terminal 3. Provide to users. The information providing server 1 receives the position information of the viewpoint transmitted from the client terminal 2 after the payment of the advertisement price from the sponsor terminal 3 is completed when an advertisement can be placed based on the advertisement placement information transmitted from the sponsor terminal 3 to be described later. When the 3D image data based on the above is generated, the advertisement placement information is referred to, and the “advertisement content” corresponding to “placement time” and “placement position information” is combined with the 3D image data and provided.

The client terminal 2 has a function of inputting viewpoint position information desired by the user, and a three-dimensional image three-dimensional image obtained by synthesizing three-dimensional image data based on the viewpoint position information transmitted from the information providing server 1 and advertisement information. A function of receiving and displaying an expression via the communication line 100 is provided.

The sponsor terminal 3 sends an advertisement placement request to the information providing server 1 via the communication line 100, and in which time zone (publishing period) the desired advertisement (advertisement content) is placed in which place (publishing position), The information providing server 1 transmits the 3D image stereoscopic representation in which the information providing server 1 combines the 3D image data based on the viewpoint position information and the advertisement information.

<Configuration of Information Providing Server According to First Embodiment of the Present Invention> FIG. 2 is a block diagram showing a schematic configuration of the information providing server according to the first embodiment of the present invention. The information providing server 1 according to the first embodiment of the present invention includes a 3D image conversion unit 101, a 3D image composition unit 102, a 3D image browser 103, a clock unit 104, and a 3D advertisement information database 105. And is configured.

The 3D image conversion unit 101 performs conversion processing from 2D image information to 3D image data. The three-dimensional image conversion unit 101 receives at least two aerial photographs (aerial photograph A and aerial photograph B) in which physical positions taken from different locations in the same region are input. Stereo processing, DEM processing, and polygon processing are performed, converted into three-dimensional image data, and output to the three-dimensional image composition unit 102.

In the present invention, an image obtained by periodically photographing the same area (the ground surface), such as a satellite image by a space satellite or an aerial photograph by an aircraft, is referred to as an aerial photograph. In addition, although two aerial photographs, aerial photograph A and aerial photograph B, are described, it is not always necessary to shoot these images from the left and right directions. It may be a direction.

FIG. 3 is a diagram illustrating each process of the three-dimensional image conversion unit in the first embodiment of the present invention. First, stereo processing is performed using at least two satellite images and aerial photographs taken from the same location (aerial photograph A and aerial photograph B), and the calculation is performed from the parallax of the two aerial photographs. Calculate height information. Next, an intermediate representation 31 obtained by converting the calculated value into an elevation mesh (DEM imaging: Digital Elevation Model) is reproduced, and converted into a polygon to automatically generate 3D image data 32, and the generated 3D image is generated. By gradually changing the data 32 based on the viewpoint position information from the user, a three-dimensional aerial sightseeing service is provided to the user as if it were aerial.

The aerial photograph as described above can already be generally purchased. For example, an artificial satellite IKONOS operated by Space Imaging, Inc. of the United States can be purchased from a Japanese subsidiary for several thousand yen (in the case of monochrome) per square kilometer. Since IKONOS can take pictures of the entire earth, it is possible to purchase the latest aerial photographs of the earth's surface every week. Since such aerial photographs are given accurate latitude and longitude information, it is possible to accurately grasp the physical position information such as which region was photographed.

In stereo processing, it is not possible to extract information about which is a building and which is a mountain from an aerial photograph, but only height information for each unit point can be calculated. For example, in the case of shooting with an airplane capable of flying low, the height can be calculated in units of 25 cm square on the ground surface. Compared to IKONOS, since it is taken from the sky, it is possible to calculate the height in units of 1 m square on the ground surface. This represents an intermediate expression 31 like a sword mountain used for ikebana.

The stereo processing is an established technology. The standpoint of the present invention is that any suitable existing stereo processing may be used. Accordingly, the present invention does not limit a specific stereo process.

FIG. 4 is a diagram illustrating a specific example of a DEM image as an intermediate representation. As shown in FIG. 4, height information for each element position is extracted from the DEM image and is shown in a rectangular parallelepiped shape. When the height information for each 1 m square unit is calculated, the description will be continued. In the case of a building with a height of 20 m square and a height of 30 m, the height of the building is 20 × 20 at a certain position and the height is 30 m at 400 points. If the surrounding area is flat, the height is calculated to be 0 m at other points. By applying the rule “one building if points of the same height are continuous”, it can be inferred that there is a building at this 20 × 20.

When the DEM image subjected to such stereo processing has the same element unit height by the polygon processing, the three-dimensional structure is estimated by assuming that the DEM image is a continuous surface.

When stereo processing is performed, so-called landmarks (marks) such as buildings and mountains are extracted as polygonal polygon data. In the present invention, the extracted polygon polygon data including one or more landmarks is called three-dimensional image data. In addition, since aerial photographs are given accurate position information of the reference points in the photograph, the position information of these landmarks is easily calculated based on the xy-axis distances from the reference points.

FIG. 5 is a diagram illustrating a specific example of a three-dimensional image stereoscopic expression. As shown in FIG. 5, a three-dimensional image stereoscopic representation 33 is created using the three-dimensional image data 32 generated by the above-described stereo processing, DEM processing, and polygon processing, and is provided to the user. In this case, it is necessary to provide viewpoint position information indicating from which viewpoint. When this viewpoint position information is changed, it changes to a three-dimensional representation viewed from a different position. When this viewpoint position information is gradually and continuously moved, it is reproduced as a stereoscopic image as if a sightseeing flight was performed in the air.

The three-dimensional image composition unit 102 performs composition processing of the three-dimensional image data converted by the three-dimensional image conversion unit 101 and the advertisement information. The three-dimensional image composition unit 102 refers to the clock unit 104 to acquire current date and time data, and uses the advertisement placement information (advertisement ID, place, placement period, advertisement content) stored in the three-dimensional advertisement information database 105. One by one is taken out, and it is determined whether or not the “post period” item of each record includes the current date and time data acquired previously. Next, the three-dimensional image composition unit 102 determines whether the “place” item of each record is a place included in the three-dimensional image data. Then, advertisement insertion information including the current date / time data and having a place included in the 3D image data is extracted, the data registered in the “advertising content” item is extracted, and the advertising content data is extracted as the above 3 The synthesized 3D image data is output to the 3D image browser 103 by combining with the 3D image data output from the 3D image conversion unit 101. Here, the position information of the three-dimensional image data can be calculated from the position of the aerial photograph. Since the 3D image data output from the 3D image conversion unit 101 is expressed as a set of polygonal polygon data such as a cylinder or a rectangular parallelepiped, when an ad balloon-shaped advertisement item is newly expressed as advertisement content, It is only necessary to add ad balloon-shaped polygon data.

The 3D image browser 103 generates a 3D image stereoscopic representation from the combined 3D image data output from the 3D image combining unit 102. When the 3D image browser 103 receives the combined 3D image data output from the 3D image combining unit 102, the 3D image browser 103 temporarily stores the data in the storage unit. Next, waiting for an instruction from the user, when specific viewpoint position information is input, a three-dimensional image stereoscopic representation viewed from the input viewpoint position information is created and provided to the user, and the user is again displayed. From the viewpoint position information. In the first embodiment of the present invention, the 3D image browser 103 may be provided in the client terminal 2.

The clock unit 104 manages and holds the current date / time data, and outputs the current date / time data based on an acquisition request for the current date / time data from the three-dimensional image composition unit 102.

The three-dimensional advertisement information database 105 is a database that stores advertisement information desired to be posted. In order to place a specific advertisement in the 3D image data converted by the 3D image conversion unit 101, the 3D advertisement information database 105 includes an advertisement ID, a place where the advertisement is placed, a publication period, All advertisement information to be posted is registered in units of internal representation bit string records. An advertisement ID that is a three-dimensional image representation for posting a specific advertisement in the three-dimensional image data converted by the three-dimensional image conversion unit 101, a placement location for placing the advertisement, a publication period, and an advertisement to be published This is a database in which all advertisement information to be posted is registered with a record of an internal representation bit string having at least contents as a unit.

The advertisement contents to be posted are shape information indicating the shape of the advertisement medium and character information such as a designated message to be posted on the advertisement medium, and have various shape patterns. For example, it may have a shape like a drum, and an object whose advertising content is written on its side may float in the air. Also, as shown in FIG. 6, animals such as ad balloons, airships, swallows, etc. In addition to the above, an airplane, a thunderhead, or a sandwich man holding a placard with advertisement contents may be floating.

For example, an advertisement (ID = ID1) that a sponsor wants to publish has an ad balloon shape and is scheduled to be posted for one month from September 2000. As text information in this ad balloon, “Invitation to The message “the Intenet: NEC” is written, and it floats over the NEC headquarters. In this case, in the three-dimensional advertisement information database 105, ID1 is input to the item of [Advertisement ID], and the latitude and longitude values that are the same as the latitude and longitude of the NEC headquarters are input to the [Location] item. A value of “Y2000M9D1T0: 0-Y2000M9D30T23: 59” is input in the [Posting Period] item, and information on the 3D polygon figure in the form of an ad balloon and the side of the ad balloon are displayed in the [Advertisement Content] item. A message “Invention to the Invent: NEC” of character information to be displayed is input.

FIG. 6 is a plan view showing a display example of a three-dimensional aerial sightseeing service screen that is actually provided to the client terminal by the information providing server according to the first embodiment of the present invention. As shown in FIG. 6, for example, as information that enters a field of view during a tour of a specific city in a three-dimensional image representation, the user enters a balloon-shaped “A car” and an airship-shaped “B” Advertisement information such as “C beer of food” and “E cosmetics of D medicine” having a swallow shape is displayed.

In the information providing server system according to the first embodiment of the present invention described above, an advertisement placed in the three-dimensional image stereoscopic representation provided to the client terminal 2 is managed by the sponsor terminal 3 that requested the placement of the advertisement. It is possible to paste link information to the homepage that is operated, and if the link destination is pasted on the advertisement that interests the advertisement displayed during the 3D aerial tour, By moving the mouse on the advertisement and clicking, it is possible to jump to the home page that is the link destination. Online shopping provided in the jumped home page can also be used as before. At this time, it is possible to post the jumped home page information on the client terminal in a state where the three-dimensional aerial sightseeing service screen is displayed.

As described above, when the user browses or searches the client terminal 2 as if he / she is enjoying the 3D space by using the 3D image stereoscopic representation, the user can move to a specific place in the 3D space. In the same way as a 3D object automatically generated from aerial photographs of other buildings or parks in 3D space, the advertisement is displayed in the vicinity of the specific place. Is displayed while you are flying.

Here, regarding the difference between a 3D-shaped advertisement and a 3D-shaped object such as another building or park, the 3D-shaped object was created from an aerial photograph that actually captured the ground surface. In contrast, advertisements having a three-dimensional shape are not taken at the time of taking an aerial photograph, that is, have a virtual shape that does not exist.

The information providing server 1 according to the first embodiment of the present invention has an effect that a three-dimensional space can be enjoyed and a three-dimensional aerial sightseeing user can perform a search operation happily. In addition, since the advertisement information stored in the three-dimensional advertisement information database 105 is posted in the three-dimensional image stereoscopic representation provided as the three-dimensional aerial sightseeing service, the three-dimensional aerial sightseeing user is irrelevant to his / her will. It becomes possible to make the advertisement visible to the eye, and there is an effect of giving a great merit to the advertisement provider.

<Configuration of Information Providing Server According to Second Embodiment of the Present Invention> FIG. 7 is a block diagram showing a schematic configuration of an information providing server according to the second embodiment of the present invention. The information providing server 1 according to the second embodiment of the present invention includes a three-dimensional image conversion unit 101, a three-dimensional image composition unit 102, a three-dimensional image browser 103, a clock unit 104, and a three-dimensional advertisement information database 105. And an advertising contract part 106 and an advertising contract description part 107. In addition, about the same component as the 1st Embodiment of this invention mentioned above, the same code | symbol is attached | subjected and description is abbreviate | omitted.

The advertising contract unit 106 executes an advertising contract process with the sponsor terminal 3. When a request for posting a new advertisement is transmitted from the sponsor terminal 3, the advertisement contract unit 106 adds three data of a sponsor name, a contract amount, and an advertisement ID of a new contract as a unit record of the advertisement contract description unit 107. Next, the advertisement ID of the data added to the three-dimensional advertisement information database 105 and the advertisement placement data, the publication period, and the advertisement content data agreed with the sponsor are added or updated in association with the advertisement ID.

The advertising contract description unit 107 stores the contents of the advertising contract with the sponsor terminal 3. As described above, the advertisement contract description unit 107 is a database that stores three data of a sponsor name, a contract amount, and an advertisement ID based on a request for advertisement placement from the sponsor terminal 3.

Various types of advertisements desired by the sponsor are prepared according to the posting fee. High-paid listings should be noticeable with a lot of exposure, such as the size of the display size and frequent presentations in good positions, while low-paying listings may have a small display size or number of presentations. For example, there are few. In the present invention, the user is provided with a three-dimensional space tour for the real earth. Therefore, in order to place an advertisement in a popular spot where people gather on the real earth, such as the Tokyo Tower or the Eiffel Tower, it is located in a less popular spot, such as the middle of the desert. It is self-evident that the advertising fee will be higher compared to placing an advertisement on. It can be said that the fictitious land price similar to the real world exists in the advertisement placement position. Furthermore, in the present invention, the advertisement provider is allowed to place an advertisement regardless of its own store position. Therefore, the advertisement provider purchases the advertising right of the position that was not popular at first from the 3D aerial administrator, and if the position becomes popular later (if the fictitious land price goes up), the advertising right will be increased. It becomes possible to transfer or lend to others at a higher price than the initial price. In addition, the three-dimensional aerial administrator can differentiate the advertising fee according to the fictitious land price and earn the operating cost of the three-dimensional aerial service.

Further, the advertising contract unit 106 asks the sponsor about which place the advertisement newly registered in the advertising contract description unit 107 is to be posted in which period, and what to do with the advertisement content. Register with The contract in the advertising contract unit 106 is automatically contracted with a sponsor terminal owned by the sponsor via a communication line (such as the Internet) based on a predetermined program.

For example, when an advertisement posting contract is automatically made with the sponsor terminal 3, the server program automatically accepts it in the form of a form on the WWW homepage managed and operated by the information providing server providing the three-dimensional aerial sightseeing service. Will be adopted.

Here, the advertising contract description unit 107 and the three-dimensional advertisement information database 105 can be managed as one database. However, in order to be established as a business, it is necessary to distinguish between the flow of payment such as the advertisement insertion fee and product purchase price, and the flow of service. Therefore, in the present invention, the advertising contract description unit 107 and the three-dimensional advertisement information The case where the database 105 is managed by a separate database has been described.

According to the information providing server according to the second embodiment of the present invention, the advertisement to be posted in the three-dimensional image stereoscopic representation provided to the user as the three-dimensional aerial sightseeing service is an advertisement provided by the sponsor terminal 3. The information providing server 1 can provide the user with a three-dimensional aerial sightseeing service free of charge by collecting the posting fee. In addition, according to the information providing server in the second embodiment, the advertising publication fee can be set according to the fictitious land price of the posting position, and the advertising publisher who has the advertising right or the three-dimensional aerial The service manager can acquire the advertising right according to the fictitious land price and conduct business. In the second embodiment of the present invention, the 3D image browser 103 may be provided in the client terminal 2.

FIG. 8 is a conceptual diagram showing a business model form using the advertisement providing system according to the embodiment of the present invention. The sponsor wants to publish an advertisement in order to promote product sales, and requests the 3D aerial sightseeing service provider to place an advertisement. An advertisement fee is paid from the sponsor to the 3D aerial tour service provider as a price for the advertisement placement.

The three-dimensional aerial sightseeing service provider provides the user with the three-dimensional aerial sightseeing service, but does not collect a service usage fee from the user. The reason is that the user is forced to present the advertisement at the same time as the service. The user sees the advertisement provided by the sponsor in exchange for receiving the service. By seeing this advertisement, the possibility of purchasing a product handled by the sponsor who has issued the advertisement increases. When the product is actually purchased, the product purchase price is paid from the user to the sponsor.

FIG. 9 is a sequence chart showing a first processing example in the advertisement providing system according to the embodiment of the present invention. First, the sponsor terminal 3 transmits an advertisement placement request to the effect that it is desired to place advertisement information to the information providing server 1 (step S101). When receiving the advertisement placement request, the information providing server 1 inquires about advertisement information such as what kind of content and shape of the advertisement will be placed in which place and for how long (step S102).

In response to the inquiry from the information providing server 1 in step S102, the sponsor terminal 3 transmits the desired advertisement information (step S103). Based on the advertisement information transmitted from the sponsor terminal 3, the information providing server 1 transmits confirmation of the contract content including the advertisement content, shape, placement location, placement period, advertisement placement fee, and the like (step S104).

After confirming the contract transmitted from the information providing server 1 in step S104, the sponsor terminal 3 requests the advertisement placement process (step S105), and then provides the presented advertisement placement fee by a predetermined payment method. Pay to server 1 (step S106).

The information providing server 1 that has approved the advertisement placement based on the above advertisement information registers the contents in the advertisement contract description part and the three-dimensional advertisement information database (step S107).

The client terminal 2 requests access to the information providing server 1 that provides the three-dimensional aerial sightseeing service based on an instruction from the user (step S108). If the information providing server 1 accepts the access, the information providing server 1 creates a three-dimensional image stereoscopic representation from the combined three-dimensional image data (step S109) and transmits it to the client terminal 2 (step S110).

When the viewpoint position information desired by the user is input from the client terminal 2 (step S111), a three-dimensional image stereoscopic representation based on the viewpoint position information is created by the information providing server 1 (step S112) and transmitted to the client terminal 2. (Step S113).

<Configuration of Information Providing Server According to Third Embodiment of the Present Invention> FIG. 10 is a block diagram showing a schematic configuration of an information providing server according to the third embodiment of the present invention. The information providing server 1 according to the third embodiment of the present invention includes a three-dimensional image conversion unit 101, a three-dimensional image composition unit 102, a clock unit 104, a three-dimensional advertisement information database 105, an advertisement contract unit 106, The advertising contract description unit 107, the three-dimensional image database 108, and the position input type three-dimensional image composition unit 109 are configured. In addition, about the same component as the 1st Embodiment of this invention mentioned above, the same code | symbol is attached | subjected and description is abbreviate | omitted.

When the 3D image data is automatically generated by the 3D image converter 101, the 3D image database 108 generates the generated 3D image data, an image ID for uniquely identifying the 3D image data, and this The position (latitude and longitude of the reference position) of the 3D image data is stored as a unit record. The three-dimensional image database 3 may be configured as a relational database or a normal file format. In the above items, the 3D image data includes one or more landmarks of polygonal polygon data, and the image ID is a number added to uniquely identify the generated 3D image data. The position indicates the location of the reference position on the ground surface of the three-dimensional image data generated based on the two aerial photographs A and B.

However, as the designation of this position, when the generated three-dimensional image data has a fixed size (both vertical, horizontal, and shape), it is only necessary to specify the latitude and longitude of the reference point. However, when the sizes of the individual three-dimensional image data are different, the data relating to the shape is also stored in the same record. For example, when it is determined that each three-dimensional image data indicates a rectangular area, and the length of each side in the rectangle is not determined, the position is specified diagonally in the rectangle. This is realized by configuring the two points to be designated.

The position input type three-dimensional image composition unit 109 synthesizes the three-dimensional image data based on the designated position information and the advertisement information. When the position information of the three-dimensional image data is designated, the position input type three-dimensional image composition unit 109 searches the three-dimensional image database 108 and compares the designated specific position with the value of the photographing position item. A record of 3D image data including the specified specific position is found, the 3D image data portion is extracted, and the current date / time data is obtained by referring to the clock unit 104, and stored in the 3D advertisement information database 105. The advertisement insertion information (advertisement ID, location, insertion period, advertisement content) is taken out one by one, and it is determined whether or not the “publication period” item of each record includes the current date / time data acquired previously. At the same time, it is determined whether or not the “publication place” item is included in the position information of the 3D image data. Here, the advertisement insertion information including the current date and time data and included in the position information of the three-dimensional image data is extracted, the data registered in the “advertising content” item is extracted, and the advertising content data is extracted from the above three-dimensional data. The synthesized 3D image data is delivered to the client terminal 2 by being synthesized with the 3D image data that is output from the image conversion unit 101.

The client terminal 2 is provided with a position output type 3D image browser 201, and the synthesized 3D image data distributed from the position input type 3D image synthesis unit 109 is based on a user instruction (viewpoint position, information presentation instruction). 3D image stereoscopic representation is provided to the user.

The position output type three-dimensional image browser 201 converts the combined three-dimensional image data into a three-dimensional image stereoscopic representation based on position designation information and viewpoint position information from the user. When the position output type 3D image browser 201 first receives data of a specific position desired to be aerial from the input unit 202 from the input unit 202, the position output type 3D image browser 201 passes the data to the position input type 3D image composition unit 109. As a result, the synthesized three-dimensional image data is received and stored inside. Next, when specific viewpoint position information is input from the input unit 202 by the user, the received three-dimensional image data is created into a three-dimensional image stereoscopic representation viewed from the viewpoint position information, and then displayed to the user. When new viewpoint position information is input from the user, the three-dimensional image stereoscopic representation viewed from the new viewpoint position information is repeatedly generated and presented. In the present embodiment, the position output type 3D image browser 201 is provided in the client terminal 2, but may be provided in the information providing server 1.

FIG. 11 is a plan view illustrating a first display example of a client terminal including a position output type 3D image browser. First, when the user requests the information providing server 1 for a “menu” screen for using the three-dimensional aerial sightseeing service, a screen as shown in FIG. 9 is displayed on the client terminal 2.

In this screen, the display contents of the menu 91 are displayed by listing the entire continent in the order of Asia, Africa, America, Europe in the lower layer, with the entire earth positioned at the top of the hierarchy. In the lower layer, further subdivided tree names such as “North America” and “Japan” are displayed, and in the lower layer of each country name, a tree structure such as a city name is displayed. This display format is similar to the Explorer format used in Windows and the like.

In addition, as shown in FIG. 12, this menu screen can be created in an image format. In FIG. 12, images such as a globe, a map of Japan, and a photograph of a specific area are pasted correspondingly. The image pasted here may be a two-dimensional bitmap format or a snapshot in a three-dimensional space. When the user clicks on any flag set on the globe map shown in FIG. 12 (a), the map is set up on a map of each country or each continent managed in the lower layer, for example, on Japan. When a flag is clicked, a map of Japan with a flag standing in each region or region as shown in FIG. Next, if you click on any flag among the flags standing in each region, a map of each region or region managed under the clicked flag, such as the flag that stands on Tokyo, is displayed. When clicked, a map of Tokyo with a flag standing in each city as shown in FIG. In addition, if you click on any flag among the flags standing in each city, if you click on each city managed under the clicked flag, for example, the flag that stands on Shinjuku, FIG. 12D displays a three-dimensional image stereoscopic representation over Shinjuku on the client terminal. It should be noted that the flag set up on the map described above is not necessarily limited to the shape of the flag, and may have other shapes.

As described above, the three-dimensional image stereoscopic representation is not presented to the user until the lowest-level menu item that can actually use the three-dimensional space sightseeing service is selected. For example, when Shinjuku is selected as a region desired by the user, when the user displays a 3D image representation of “Shinjuku” above the client terminal, he / she is just watching the sky above Shinjuku. Such a three-dimensional aerial sightseeing service can be used. In this case, it is conceivable to paste a still state snapshot of the three-dimensional space image to the lowest level menu item. Note that the service provider can freely set where the lowest level at which the user can actually use the aerial sightseeing service is set.

In this way, when the user is using the three-dimensional aerial sightseeing service and wants to enjoy the aerial sightseeing at another place, the following two methods can be considered.

As a first method, if the aerial tour is continued from the above-mentioned Tokyo, and the tour is continued to the place where the tour is desired, the three-dimensional image representation is switched in accordance with the movement of the user and sequentially moves. Is possible. For example, as in Tokaido 53, it moves from Tokyo to Osaka via 53 areas one after another.

As a second method, when the user wants to move instantaneously, the user can move instantaneously by launching the menu screen again and selecting a place (region) where he / she wants to enjoy. For example, when switching the image from above Tokyo to Osaka, start the menu screen, move to the “Japan” level, and select “Osaka”, so that 3D image representation over Osaka is displayed. Is displayed on the client terminal. In addition, this situation is not limited to the same country, it can be moved instantly over the world, and it can be moved instantaneously from Tokyo over the Amazon or over the Champs Elysees in Paris. You can enjoy aerial sightseeing as if you were doing it. For example, to move from Tokyo to the Champs-Elysees in Paris, move in order: “Japan”, “Asia”, “Earth”, “Europe”, “France” Then, “Paris” is selected.

According to the information providing server which is the third embodiment of the present invention, the three-dimensional image data created from the taken aerial photographs can be automatically stored in the three-dimensional image database 108 one after another. Therefore, assuming that aerial photographs of the earth's surface are taken all over the world and the 3D image data is stored in the 3D image database 108, the user designates a place where he / she wants to go. 3D image data including its location is retrieved from the 3D image database 108 and passed to the position output type 3D image browser 201 provided in the client terminal, whether it is a Champs-Elysees or the Siberian Great Plain. A three-dimensional image stereoscopic representation based on the viewpoint position designated by the person is generated and presented.

In addition, when the user designates a specific position (location), when the position information of the three-dimensional image data is expressed by latitude and longitude, for example, when the user wants to tour the vicinity of the Champs Elysees in Paris, The longitude and latitude information including the area of the Champs Elysees is checked with a map book or the like, and then input to the position output type 3D image browser 109.

In addition, as a method for the user to input a specific position (place), there is a method described below. For example, map information is displayed on the client terminal 2, and an arbitrary place (a place where the user wants to enjoy aerial viewing) is designated with a mouse or the like. Next, the client terminal 2 instantaneously determines the latitude and longitude information of the designated point, and transmits the latitude and longitude information to the position output type 3D image composition unit 109 of the information providing server 1. The position output type three-dimensional image composition unit 109 generates composite three-dimensional image data based on the latitude and longitude information and outputs it to the client terminal 2. When the client terminal 2 receives the synthesized 3D image data by the position output type 3D image browser 201, the client terminal 2 generates a 3D image stereoscopic representation based on the viewpoint position information from the input unit 202 and displays it on the display unit 203. It is also possible to do.

FIG. 13 is a sequence chart showing a second processing example in the advertisement providing system according to the embodiment of the present invention. First, the sponsor terminal 3 transmits an advertisement placement request to the effect that it is desired to place advertisement information to the information providing server 1 (step S201). When receiving the advertisement placement request, the information providing server 1 inquires about advertisement information such as what kind of content and shape of the advertisement will be placed in which place and for how long (step S202).

In response to the inquiry from the information providing server 1 in step S202, the sponsor terminal 3 returns desired advertisement information (step S203). Based on the returned advertisement information, the information providing server 1 transmits the confirmation confirmation of the contract contents together with the contract contents including the contents, shape, placement location, placement period, advertisement placement fee, etc. of the advertisement (step) S204).

In step S304, the sponsor terminal 3 that has approved the contract transmitted from the information providing server 1 requests the advertisement placement process (step S205), and then provides the presented advertisement placement fee by a predetermined payment method. Pay to server 1 (step S206).

The information providing server 1 that has approved the advertisement placement based on the above advertisement information registers the contents in the advertisement contract description part and the three-dimensional advertisement information database (step S207).

The client terminal 2 requests access to the information providing server 1 that provides the three-dimensional aerial sightseeing service based on an instruction from the user (step S208). When the information providing server 1 accepts the access, the information providing server 1 transmits a menu screen of the three-dimensional image aerial sightseeing service to the client terminal 2 (step S209).

The user selects position information desired for aerial viewing from the menu screen displayed on the client terminal 2, and transmits it to the information providing server 1 (step S210). The information providing server 1 creates synthesized three-dimensional image data based on the selected position information (step S211) and transmits it to the client terminal 2 (step S212).

When the viewpoint position information desired by the user is input, the client terminal 2 creates and displays a three-dimensional image stereoscopic representation based on the viewpoint position information from the transmitted combined three-dimensional image data (step S213).

<Configuration of Information Providing Server According to Fourth Embodiment of the Present Invention> FIG. 14 is a block diagram showing a schematic configuration of an information providing server according to the fourth embodiment of the present invention. The information providing server 1 according to the fourth embodiment of the present invention includes a 3D image conversion unit 101, a 3D image composition unit 102, a 3D image browser 103, a clock unit 104, and a 3D advertisement information database 105. And an advertising contract section 106, an advertising contract description section 107, a landmark position database 110, and a search engine 111. In addition, about the same component as each embodiment of this invention mentioned above, the same code | symbol is attached | subjected and description is abbreviate | omitted.

The landmark position database 110 is a database in which landmark information including language expression information relating to the names and contents of landmarks existing in areas photographed by aerial photographs and landmark position information is stored. The language expression information is a keyword that can be input by the search engine 111. The latitude / longitude representation is a two-dimensional array representation that the three-dimensional image browser 103 can accept. The storage medium for the landmark position database 110 may be a relational database or a normal file format, and is not particularly limited.

When a user gives a keyword as an input, the search engine 111 provides link information to page data including contents related to the given keyword from a set of page data released to many people such as WWW and i-mode. return. This is because a search engine widely used for WWW (see, for example, Altavista or Infoseek), a mobile phone information providing service, for example, for i-mode, a search engine for it may be used. There is no particularity.

The 3D image browser 103 generates a 3D image stereoscopic representation from the combined 3D image data output from the 3D image combining unit 102. When the 3D image browser 103 receives the combined 3D image data output from the 3D image combining unit 102, the 3D image browser 103 temporarily stores the data in the storage unit. Next, after waiting for an instruction from the user, when specific viewpoint position information is input, a three-dimensional image stereoscopic representation is generated and provided to the user, and the position information and viewpoint position information from the user are again indicated. Wait for input. Further, when the user designates a position where the 3D image stereoscopic expression is present and inputs an information presentation instruction during the aerial tour, the 3D image browser 103 refers to the landmark position database 110 and starts from the designated position. The related landmark information is specified, the language expression information of the landmark information is output to the search engine 111, the link information is searched using the language expression information, and the search result is displayed as a three-dimensional image. It is transmitted to the browser 103.

FIG. 15 is a flowchart showing a processing example of a 3D image browser in the fourth embodiment of the present invention. When the three-dimensional image data is received from the three-dimensional image conversion unit 101, the value is temporarily stored in the internal memory (step S301), and the process waits for an instruction from the user (step S302). When specific viewpoint position information is received from the user, a three-dimensional image stereoscopic image viewed from the viewpoint position is created and provided to the user (step S303). Then, the process returns to step S302 and again waits for a user instruction.

On the other hand, when the user is instructed to provide related information regarding a certain position in the three-dimensional image stereoscopic representation in step S302, the landmark position database 110 is referred to correspond to the certain position specified above. It is checked whether landmark information to be present exists (step S304). When the landmark information does not exist, the user is notified that there is no related information of the designated position (step S305), and the process returns to step S302.

When the landmark exists, the language expression information regarding the name and content of the corresponding landmark information is passed to the search engine 111 (step S306). The search engine 111 searches using language expression information related to the name and content of the landmark as a key. For example, assuming that Infoseek, which is a typical search engine of WWW, is used, when those language expressions are passed to Infoseek, Infoseek returns link information of the WWW home page related to those language expressions.

If there is no search result of the search engine 111, the user is notified of this (step S307), and the process returns to step S302. If there is a search result, the search result is provided to the user (step S308), and the process returns to step S302.

Thus, if there is a search result, the link information is provided to the user by the 3D image browser 103. For example, during a three-dimensional space tour using a three-dimensional image stereoscopic representation, a user thinks “This building looks like a park but what it is” over the Ueno Zoo, An instruction is issued to the image browser 103.

In response to this instruction, the three-dimensional image browser 103 checks the latitude and longitude and refers to the landmark position database 110. Then, it is checked whether or not there is landmark information having position information including the location of the latitude and longitude. If there is no such landmark information, the user is informed that “there is no related information”. If the landmark corresponding to a certain position designated with reference to the landmark position database 110 does not exist, the user is informed that there is no related landmark.

FIG. 16 is a conceptual diagram showing a state in which presentation of related information is requested by designating a specific landmark during a sightseeing flight on a three-dimensional image stereoscopic representation. The landmark position database 110 is a database in which landmark information including language expression information relating to the names and contents of landmarks existing in areas photographed by aerial photographs and landmark position information is stored. For example, if the landmark is Tokyo Big Sight, keywords such as accurate addresses such as “Tokyo International Exhibition Center”, “Tokyo Big Sight”, and “Tokyo XX Ward” are listed as language expression information.

When the user designates a specific position and requests provision of related information of the landmark, the landmark position database 110 is searched based on the designated position. When there is landmark information having corresponding position information, the language expression information or keyword of the name or content is passed to the search engine 111 for WWW on the Internet. The search result is provided as related information to the user. The search engine 111 to be used may be a general search engine such as Altavista. However, a search engine capable of more intelligent processing can provide more appropriate information for address information and the like. . The user can obtain information about a desired landmark from the normal web content 53 based on the link information obtained as a result of the search.

<Configuration of Information Providing Server According to Fifth Embodiment of the Present Invention> FIG. 17 is a block diagram showing a schematic configuration of an information providing server according to the fifth embodiment of the present invention. The information providing server 1 according to the fifth embodiment of the present invention includes a 3D image conversion unit 101, a 3D image composition unit 102, a 3D image browser 103, a clock unit 104, and a 3D advertisement information database 105. A landmark position database 110, a search engine 111, a user position display unit 112, another person maximum display threshold storage unit 113, a user database 114, and a dialog connection unit 115. Configured. In addition, about the same component as each embodiment of this invention mentioned above, the same code | symbol is attached | subjected and description is abbreviate | omitted.

The user position display unit 112 displays a user position mark indicating that the user is at the position of the viewpoint position designated by the user on the 3D image stereoscopic representation provided to the user by the 3D image browser 103. In addition, the viewpoint position information of the users other than the user is extracted from the user database 114, and other user position marks indicating other persons are displayed at the positions of the respective viewpoint positions.

The user position display unit 112 is naturally realized as an additional function on the three-dimensional image browser 103. As an implementation method, it is common to implement using a Java applet, ActiveX, or a plug-in function. The user's own viewpoint position information can be obtained from the client terminal 2, but the other user's viewpoint position information can be obtained from the user database 114 by issuing a request to the information providing server 1 side. There is a need to. At this time, if the area for aerial sightseeing is as narrow as 1 km square, or the total number of all users is small, it is sufficient to obtain the current positions of all others.

The other-user maximum display threshold value storage unit 113 displays the maximum number when the viewpoint position of another user is displayed in advance when the aerial sightseeing range is the whole world or the total number of users is very large. Determine and store. Based on the threshold value (maximum number of users displayed) stored here, the viewpoint positions of other users up to the maximum number in the order closest to the user's own position are returned.

The user database 114 stores a user ID for identifying each user and viewpoint position information of all users currently logged in and associated with the user ID. When providing a service using the present invention using the WWW, it is natural that the user database 114 is realized by a relational database on the information providing server 1. Each user performs an aerial tour on the client terminal 2 and inputs the current viewpoint position information to the 3D image browser 103. The input of the viewpoint position information is transferred to the user position display unit 112 and stored in the user database 114 in the relational database every moment.

The dialogue connection unit 115 establishes a connection for e-mail, telephone or chat to a designated other person when a user desires a dialogue by designating a certain other user position mark. This is because when the user designates a certain other user position mark on the client terminal 2, the information providing server 1 side is notified that a dialogue request has been made, the user ID of the other user is examined, An execution application of a predetermined dialog means such as e-mail, telephone or chat is activated for the user ID to establish a connection. Whether the dialogue is established or rejected by another user is performed in the activated execution application.

According to the information providing server which is the fifth embodiment of the present invention, it is possible to see what other people other than himself / herself are seeing in the air excursion. ”Will double the fun. People who are looking at the same place can travel around the famous landmarks and meet new people as well as “travel is a companion”. For example, if someone is looking around the Leonardo da Vinci Museum in the village of Vinci outside of Florence, Italy, another person will appear there and they will surely like Leonardo da Vinci. There is also a possibility that friendship starts from there.

<Configuration of Information Providing Server According to Sixth Embodiment of the Present Invention> FIG. 18 is a block diagram showing a schematic configuration of an information providing server according to the sixth embodiment of the present invention. The information providing server 1 according to the sixth embodiment of the present invention includes a three-dimensional image conversion unit 101, a three-dimensional image composition unit 102, a three-dimensional image browser 103, a clock unit 104, and a three-dimensional advertisement information database 105. A landmark location database 110, a search engine 111, a total movement history storage unit 121, a range inside / outside determination distance storage unit 122, a flight time threshold storage unit 123, a flight time calculation unit 124, a user stay land The mark determination unit 125, the user stay landmark storage database 126, the all information search instruction history storage unit 127, and the questionnaire count result presentation unit 128 are configured. In addition, about the same component as each embodiment of this invention mentioned above, the same code | symbol is attached | subjected and description is abbreviate | omitted.

The total movement history storage unit 121 records a movement history including the viewpoint position of the user and the time.

The inside / outside determination distance storage unit 122 defines a position around the landmark that is a determination criterion for determining that the user is interested in the landmark. For example, if a user is within a radius of 500 meters centered on a certain landmark, it is considered that he / she is interested in that landmark, but it is determined whether the numerical value of 500 meters is stored within or outside the range. This is a distance storage unit 22.

The stay time threshold storage unit 123 stores a stay time threshold indicating a minimum stay time staying in the vicinity of the landmark, which is a determination criterion for determining that the user is interested in the landmark. For example, if a user stays around the landmark for more than 1 minute, and if it is assumed that the user is interested in the landmark, the value of 1 minute is the stay time threshold. .

The stay time calculation unit 124 refers to the landmark position database 110 to extract the position and time of the landmark that has passed from the movement history stored in the total movement history storage unit 121, and the viewpoint position of the user is determined. The first time and the last time within the range of the peripheral position limited by the range inside / outside determination distance information of the range inside / outside determination distance storage unit 22 before and after the extracted landmark position are calculated.

In the user stay landmark determination unit 125, the difference between the last time and the first time calculated by the flight time calculation unit 124 is compared with the threshold value stored in the flight time threshold value storage unit 123. Determines that the user has stayed at the landmark, and adds the landmark name and the difference between the last time and the first time to the user stay landmark storage database 126.

The user stay landmark storage database 126 stores a landmark stay history including a landmark where the user stayed and the stay time.

The all-information search instruction history storage unit 127 records an information provision instruction history including the landmark name that the user has instructed to provide related information and the time at that time.

When the questionnaire total result providing unit 128 is instructed to provide the total result by the administrator, the landmark stay history of the user stay landmark storage database 126 or the information provision instruction history of the all information search instruction history storage unit 127 is displayed. Output.

According to the information providing server which is the sixth embodiment of the present invention, the effect of totaling social trends of what kind of people gather in what kind of place is recorded by recording all of which users have gone to where. There is. If you can understand all the information such as how many people came to see Yoshino cherry blossoms in Nara in 4/30 when the cherry blossoms in spring were in full bloom, or where they went after seeing cherry blossoms in Yoshino, it would be very powerful marketing information. There is an effect of becoming.

In addition, it is possible to give a range as a business by changing the advertisement posting fee according to the place where the advertisement is desired to be posted. For example, the sponsor side compares the posting fee determined by the posting location and the posting period with its own budget, selects the posting location that matches the budget, and requests the information providing server side.

In addition, by presenting the marketing results as described above to the sponsor side, we can propose more effective advertising placements and differentiate advertising fees in regions where users gather from other regions. As a part of the business, the virtual world displayed in the 3D image browser, which is a virtual space, is targeted at the real world. Since it is the same, it is possible to apply the concept of fictitious land prices to three-dimensional image stereoscopic representation.

Of course, from the user's perspective, it would be difficult for the service provider to know where they were wandering in a state where their presence was revealed, but it was difficult to admit that the user was anonymous. If the use is permitted, the users can use it with peace of mind. In fact, Yahoo and other search engines that are currently providing free services on the WWW also aggregate such search information and use it as marketing information.

In addition, as a reward for enjoying the 3D aerial sightseeing service free of charge, ad balloons and airships that contain advertisements that did not exist in nature will enter the field of view during the aerial sightseeing. . The information providing server on the side of the three-dimensional aerial sightseeing service provider can also report a report as to how many users saw the advertisement to the sponsor who is the advertisement publisher.

In the fourth to sixth embodiments of the present invention described above, a position input type 3D image synthesis unit instead of the 3D image synthesis unit 102 or a position output type 3 instead of the 3D image browser 103 is used. A configuration using a three-dimensional image browser is also possible.

The system configuration of each embodiment described above is a client / server type distributed processing system, but the present invention is not limited to these configurations and does not depart from the gist of the present invention. However, various modifications can be made. The information providing server and the client described above are realized by the configuration shown in FIG. 15 (FIG. 19).

Referring to FIG. 19, the information providing server in this embodiment includes a data processing device 301 configured by a CPU or the like, a storage device 302 configured by a memory having a short read / write time, and a recording having a large storage capacity such as a hard disk. The medium 303 includes an input device 304 and an output device 305 that control transmission / reception of data to / from an external device via a line. In this configuration, for example, for the information providing server shown in FIG. 2, the 3D image conversion unit 101, the 3D image composition unit 102, and the 3D image browser 103 are generated in the data processing device 301 and executed / operated. In addition, a program for generating, executing, and operating each of these units is stored in the recording medium 302.

Therefore, when the three-dimensional image conversion unit 101, the three-dimensional image composition unit 102, and the three-dimensional image browser 103 are generated and executed / operated, each program is read from the recording medium 302 and executed. . In addition, the input device 304 and the output device 305, for example, control communication with a client terminal, and control to output specified data and processing results in response to a request input via the client terminal or from the client terminal. I do. The three-dimensional advertisement information database 105, the advertisement contract description unit 107, the three-dimensional image database 108, and the like are stored in the recording medium 303.

Referring to FIG. 19, the client terminal in the present embodiment includes a data processing device 301 configured by a CPU, a storage device 302 configured by a memory having a short read / write time, and a large storage capacity such as a hard disk. The recording medium 303 includes an input device 304 and an output device 305 that control transmission / reception of data to / from an external device via a line. In this configuration, for example, with respect to the client terminal 2 shown in FIG. 10, the position output type 3D image browser 201 is generated in the data processing device 301 and executed / operated. Is stored in the recording medium 302.

Therefore, when the position output type 3D image browser 201 is generated and executed / operated, the program is read from the recording medium 302 by the data processing device 301 and executed. Moreover, the input device 304 and the output device 305 control communication with an information provision server, for example.

Each of the above-described embodiments is a preferred embodiment of the present invention, and various modifications can be made without departing from the scope of the present invention.

It is a block diagram which shows the system configuration | structure using this invention. It is a block diagram which shows schematic structure of the information provision server which is the 1st Embodiment of this invention. It is a figure explaining the detail of each process of the three-dimensional image conversion part in the 1st Embodiment of this invention. It is a figure which shows the specific example of the DEM image as an intermediate | middle expression. It is a figure which shows the specific example of a three-dimensional image solid expression. It is a top view which shows the example of a display of the three-dimensional aerial sightseeing service screen in which advertisement information was published. It is a block diagram which shows schematic structure of the information provision server which is the 2nd Embodiment of this invention. It is a conceptual diagram which shows the advertisement provision method which is embodiment of this invention. It is a sequence chart which shows the process example of the information provision server which is the 2nd Embodiment of this invention. It is a block diagram which shows schematic structure of the information provision server which is the 3rd Embodiment of this invention. It is a top view which shows the 1st display example of a client terminal provided with a position output type 3D image browser. It is a top view which shows the 2nd example of a display of a client terminal provided with a position output type 3D image browser. It is a sequence chart which shows the process example of the information provision server which is the 3rd Embodiment of this invention. It is a block diagram which shows schematic structure of the information provision server which is the 4th Embodiment of this invention. It is a flowchart which shows the process example of the three-dimensional image browser in the 4th Embodiment of this invention. It is a conceptual diagram which shows a mode that the presentation of related information was calculated | required by designating a specific landmark during sightseeing on a three-dimensional image three-dimensional expression. It is a block diagram which shows schematic structure of the information provision server which is the 5th Embodiment of this invention. It is a block diagram which shows schematic structure of the information provision server which is the 6th Embodiment of this invention. It is a block diagram which shows schematic structure of the data processor and recording medium in embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Information provision server 2 Client terminal 3 Sponsor terminal 100 Communication line 101 Three-dimensional image conversion part 102 Three-dimensional image composition part 103 Three-dimensional image browser 104 Clock part 105 Three-dimensional advertisement information database 106 Advertising contract part 107 Advertising contract description part 108 3 Three-dimensional image database 109 Position input type three-dimensional image composition unit 110 Landmark position database 111 Search engine 112 User position display unit 113 Other user maximum display threshold storage unit 114 User database 115 Dialog connection unit 121 All movement history storage Unit 122 Internal / external determination distance storage unit 123 Flight time threshold storage unit 124 Flight time calculation unit 125 User stay landmark determination unit 126 User stay landmark storage database 127 All information search instruction history storage unit 128 Questionnaire totalization result Providing unit 201 position output type three-dimensional image browser 202 input unit 203 display unit

Claims (17)

An advertisement information storage means for storing at least an advertisement information including an advertisement insertion period for which an advertisement is desired with an ID for each advertisement;
A three-dimensional image generated based on image information that is taken from the same area from a different location and has a clear physical position when the insertion period included in the advertisement information stored in the advertisement information storage means includes the current date and time. 3D image combining means for combining data and the advertisement information to generate combined 3D image data;
An advertisement contract storage means for storing advertisement contract information including an ID added to the advertisement information for which an advertisement is desired to be placed, the name of an advertisement publisher who wishes to place an advertisement, and a contract amount;
When receiving an advertisement insertion request from the advertisement publisher, contract processing of the advertisement insertion request based on an advertisement insertion fee set according to a display position in at least three-dimensional image data associated with a physical position in the real world An advertising contract means for updating the advertising information stored in the advertising information storage means based on the advertising contract information stored in the advertising contract storage means,
An information providing server characterized by comprising: Three-dimensional image data storage means for storing three-dimensional image data generated based on image information obtained by photographing the same region from different places and having a clear physical position in association with position information indicating the position of the three-dimensional image data;
An advertisement information storage means for storing at least an advertisement information including an advertisement publication period and a place where the advertisement is desired, with an ID for each advertisement;
Based on the browsing location designation information, 3D image data is read out from the 3D image data storage means, and in the advertisement information, the publication period including the current date / time data and the reading location based on the browsing location designation information are read out. The advertisement information having the placement location included in the three-dimensional image data is read out from the advertisement information storage unit, and the read-out three-dimensional image data and the advertisement information are combined to generate combined three-dimensional image data. Dimensional image composition means;
An advertisement contract storage means for storing advertisement contract information including an ID added to the advertisement information for which an advertisement is desired to be placed, the name of an advertisement publisher who wishes to place an advertisement, and a contract amount;
Upon receiving an advertisement placement request from the advertisement publisher, the advertisement contract stored in the advertisement contract storage means is executed by executing contract processing for the advertisement placement request based on at least an advertisement placement fee set according to a display location. Advertising contract means for updating the advertising information stored in the advertising information storage means based on information;
An information providing server characterized by comprising: 3. A three-dimensional image browser means for generating a three-dimensional stereoscopic expression from the synthesized three-dimensional image data output by the three-dimensional image synthesis means based on desired viewpoint position information. Information providing server. Landmark position storage means for storing landmark information including a linguistic expression relating to a name and content corresponding to a landmark existing in the three-dimensional image data and position information relating to the position of the landmark;
Search engine means for performing search of page data including contents related to the keyword from a set of page data when a keyword is given as an input, and generating link information to the page data;
When the three-dimensional image browser means is instructed to present related information related to a position, the corresponding landmark information is identified with reference to the position information included in the landmark information of the landmark position storage means. 4. The language expression information of the landmark information is output to the search engine unit, and the search engine unit is caused to generate link information of page data related to the landmark information. Information providing server described. User stay landmark storage means for storing a landmark stay history including the landmark where the user stayed and the stay time at the landmark;
All movement history storage means for recording a movement history including the user's viewpoint position and the time at that time;
A staying time threshold storing means for storing a staying time threshold indicating a time of staying around the landmark required to determine that the user is interested in the landmark;
A range internal / external determination distance storage means for storing range internal / external determination distance information indicating a definition of a peripheral position from the position of the landmark required to determine that the user is interested in the landmark;
The landmark information is extracted from the landmark position storage means, and using the position information of the landmark information and the range inside / outside determination distance information stored in the range inside / outside determination distance storage means, the user's The movement history when the viewpoint position is within the range of the peripheral position defined by the inside / outside determination distance information from the extracted landmark position is extracted from the all movement history storage means, and the extracted A stay time calculating means for calculating the first time when the user's viewpoint position passes the landmark and the second time using the movement history;
Comparing the stay time that is the difference between the last time and the first time calculated by the stay time calculating means with the stay time threshold stored in the stay time threshold storing means, A user stay landmark that stores the landmark name and the stay time in the user stay landmark storage means using the language expression information of the landmark information when the stay time is equal to or greater than the stay time threshold. Judgment means,
The information providing server according to claim 4, further comprising: All-information search instruction history storage means for recording an information presentation instruction history including a landmark name instructed by the user to present related information regarding a position and a time at that time;
When the administrator gives an instruction to present the total result, the questionnaire total result presentation that outputs the landmark stay history of the user stay landmark storage means or the information presentation instruction history of the all information search instruction history storage means Means,
The information providing server according to claim 5, further comprising: 7. The information according to claim 1, wherein the advertisement information includes advertisement content including at least shape information indicating a shape of an advertisement medium and character information indicating a message or the like to be posted on the advertisement medium. Provision server. 8. The information providing server according to claim 1, further comprising a three-dimensional image data conversion unit that generates three-dimensional image data based on image information obtained by photographing the same region from different places and having a clear physical position. At least information that includes an advertisement insertion period for which an advertisement is desired to be posted is attached to each information advertisement server, and the information provision server is requested to provide information indicating viewpoint position information. When the insertion period included in the stored advertisement information includes the current date and time, the three-dimensional image data generated based on image information that is taken from different places in the same region and has a clear physical position, and the advertisement Information is combined to generate combined three-dimensional image data, the viewpoint position information is used to generate a three-dimensional image stereoscopic representation from the combined three-dimensional image data, and the three-dimensional image stereoscopic representation is received and displayed. And
The information providing server stores landmark information including a linguistic expression relating to a name and content corresponding to a landmark existing in the three-dimensional image data and position information relating to a position of the landmark, and the information providing server stores the landmark information. A related information provision request indicating a position for requesting provision of related information is made, and the information providing server is referred to the position information included in the stored landmark information, so that the corresponding land is provided. Specify mark information, and use the language expression information of the landmark information to search page data including contents related to the language expression information from a set of page data and generate link information to the page data Information providing client characterized by letting Stores three-dimensional image data that is taken from the same area and is generated based on image information with a clear physical position in association with position information indicating the position of the three-dimensional image data, and at least wants to place an advertisement For the information providing server for storing the advertisement information including the advertisement posting period and the posting location with an ID attached to each advertisement, the browsing location designation for designating the desired location for browsing is performed, and the information providing server On the other hand, based on the browsing location designation, the corresponding 3D image data is read out from the 3D image data, the posting period including the current date and time data, and the read out 3D image The advertisement information having the placement location included in the data is read from the advertisement information, and the read three-dimensional image data and the advertisement information are combined and combined. To generate original image data, and receives the synthesized three-dimensional image data, based on the viewpoint position information, the three-dimensional image browser for generating a three-dimensional image stereoscopic representation,
An input unit that outputs the viewpoint position information from the user to the 3D image browser;
A display unit that receives the three-dimensional image stereoscopic representation from the three-dimensional image browser and displays it to a user;
The information providing server stores landmark information including a linguistic expression relating to a name and content corresponding to a landmark existing in the three-dimensional image data and position information relating to a position of the landmark, and the information providing server stores the landmark information. A related information provision request indicating a position for requesting provision of related information is made, and the information providing server is referred to the position information included in the stored landmark information, so that the corresponding land is provided. Specify mark information, and use the language expression information of the landmark information to search page data including contents related to the language expression information from a set of page data and generate link information to the page data Information providing client characterized by letting At least an advertisement information including an insertion period of an advertisement for which an advertisement is desired is placed with an ID for each advertisement, and an advertisement posting request for requesting an advertisement is sent to the information providing server. On the other hand, the contract processing of the advertisement insertion request is executed based on the advertisement insertion fee set according to the display position in the three-dimensional image data associated with at least the physical position in the real world, and the contents of the contract processing are The stored advertisement information is updated based on the information, and when the posting period included in the stored advertisement information includes the current date and time in response to an information provision request from another client, the same region 3D image data taken from different locations and generated based on image information with a clear physical position and the advertisement information are combined to generate combined 3D image data. Information providing clients, characterized in that to transmit the synthesized three-dimensional image data to another client. In the information providing server, an advertisement information storage step of storing advertisement information including at least an advertisement insertion period for which advertisement insertion is desired with an ID for each advertisement;
In the information providing client, requesting the information providing server to provide information indicating viewpoint position information;
In the information providing server, when the insertion period included in the advertisement information stored in the advertisement information storage step includes a current date and time, the same area is photographed from different places and based on image information with a clear physical position. A generated 3D image is generated by combining the generated 3D image data and the advertisement information, and a 3D image is generated from the combined 3D image data using the viewpoint position information. A synthesis step;
Receiving and displaying the three-dimensional image stereoscopic representation in the information providing client;
An advertisement placement requesting step for making an advertisement placement request to the information providing server for requesting an advertisement placement by an information provision client for advertisement provision;
Upon receiving the advertisement insertion request by the information providing server, the advertisement posting request is based on an advertisement insertion fee set according to a display position in the three-dimensional image data associated with at least a physical position in the real world. An advertising contract step for executing contract processing and updating the advertising information stored by the advertising information storage step based on the content of the contract processing;
The processing method of the information provision system characterized by including this. Three-dimensional image data for storing, in association with position information indicating the position of the three-dimensional image data, three-dimensional image data generated based on image information obtained by photographing the same region from different places and having a clear physical position by the information providing server A storage step;
An advertisement information storage step of storing, by the information providing server, at least an advertisement information including an insertion period and an insertion place of an advertisement for which advertisement insertion is desired with an ID for each advertisement;
A browsing location designation step of performing browsing location designation for designating a location desired to be browsed by the information providing client to the information providing server;
The information providing server reads out the corresponding 3D image data from the 3D image data based on the browsing location designation, and reads out the publication period including the current date and time data and the browsing location designation. The advertisement information having the placement location included in the 3D image data is read from the advertisement information, and the read 3D image data and the advertisement information are combined to generate combined 3D image data. 3D image synthesis step for outputting to the information providing client;
A three-dimensional image step of receiving the synthesized three-dimensional image data by the information providing client and generating a three-dimensional image stereoscopic representation based on the viewpoint position information;
An advertisement placement requesting step for making an advertisement placement request to the information providing server for requesting an advertisement placement by an information provision client for advertisement provision;
Upon receiving the advertisement insertion request by the information providing server, the advertisement posting request is based on an advertisement insertion fee set according to a display position in the three-dimensional image data associated with at least a physical position in the real world. An advertising contract step for executing contract processing and updating the advertising information stored by the advertising information storage step based on the content of the contract processing;
The processing method of the information provision system characterized by including this. A landmark position storing step of storing landmark information including a language expression relating to a name and content corresponding to a landmark present in the three-dimensional image data and position information relating to the position of the landmark by the information providing server; ,
A related information requesting step for making a related information providing request indicating a position for requesting the provision of related information by the information providing client;
The information providing server refers to the position information included in the landmark information stored in the landmark position storing step, identifies corresponding landmark information, and determines the language expression information of the landmark information. A related information presentation step of searching for page data including content related to the language expression information from a set of page data and generating link information to the page data;
The processing method of the information provision system according to claim 12 or 13, characterized by comprising: A total movement history storing step of recording a movement history including the viewpoint position of the user and the time at that time by the information providing server;
A staying time threshold storing step for storing a staying time threshold indicating a staying time around the landmark necessary to determine that the user is interested in the landmark by the information providing server;
A range internal / external determination distance storage for storing range internal / external determination distance information indicating the definition of a peripheral position from the landmark position necessary for determining that the user is interested in the landmark by the information providing server. Steps,
The information providing server extracts the landmark information stored in the landmark position storing step, and the position information of the landmark information and the range inside / outside determination distance information stored in the range inside / outside determination distance storing step The movement history storage step when the user's viewpoint position is within the range of the peripheral position defined by the inside / outside determination distance information from the extracted landmark position A stay time calculating step for calculating the first time when the user's viewpoint position passes through the landmark and the second time using the extracted movement history.
By the information providing server, a stay time that is a difference between the last time calculated by the stay time calculation step and the first time, and the stay time threshold stored by the stay time threshold storing step In comparison, when the stay time is equal to or greater than the stay time threshold, the user stay land that stores the landmark stay history including the landmark name and the stay time using the language expression information of the landmark information. A mark determination step;
All information search instruction history storage step for recording an information presentation instruction history including a landmark name and a time at which the user has instructed related information presentation regarding the position by the information providing server;
A totaling result presentation request step for performing a totaling result presentation request for instructing the information providing client to present the totaling result;
Upon receipt of the total result presentation request by the information providing server, the landmark stay history stored by the user stay landmark determination step or the information presentation instruction history stored by the all information search instruction history storage step Questionnaire summary result presentation step for outputting,
The processing method of the information provision system of Claim 14 characterized by the above-mentioned. 16. The information according to claim 12, wherein the advertisement information includes advertisement content including at least shape information indicating a shape of an advertisement medium and character information indicating a message or the like to be posted on the advertisement medium. Processing method of the providing system. A process of making an advertisement insertion request for requesting an advertisement to an information providing server for storing advertisement information including an advertisement insertion period at least for each advertisement with an ID for each advertisement;
The information providing server is caused to execute a contract process of the advertisement insertion request based on at least an advertisement insertion fee set according to a display location, and the stored advertisement information is determined based on the content of the contract process. When the posting period included in the stored advertisement information includes the current date and time in response to a request for information provision from another client, the same area is captured from a different location and the physical position is clear. A process of generating the combined 3D image data by combining the 3D image data generated based on the image information and the advertisement information, and transmitting the combined 3D image data to the other client;
A recording medium on which a program for a client for causing a computer to execute is recorded.

Images