WO2013108549A1

WO2013108549A1 - Ar information management device and method for managing ar information

Info

Publication number: WO2013108549A1
Application number: PCT/JP2012/083290
Authority: WO
Inventors: 伊原　正典
Original assignee: シャープ株式会社
Priority date: 2012-01-16
Filing date: 2012-12-21
Publication date: 2013-07-25

Abstract

The present invention is an augmented reality (AR) information management device for managing AR information to be prepared, on the basis of facility-specific feature information including an image feature generated from an image and location information for a planimetric feature within the image; wherein the AR information management device refers to AR permission condition information showing a permission condition for displaying an AR associated with a facility identification (ID) identifying the facility specified by the facility-specific information, and manages, on the basis of the AR permission condition information, the output of AR information to the facility specified by the facility identification (ID). In accordance therewith, there is provided an AR information management technique for managing the implementation of AR.

Description

AR information management apparatus and AR information management method

The present invention relates to augmented reality (hereinafter referred to as AR) information management technology.

AR is a technique that extends virtual “perceptual experience” by overlaying virtual information on the real world you are seeing, such as city views and displayed products.

With the recent expansion of the use of mobile terminals such as smartphones and tablet PCs, AR that superimposes virtual information on the real world and expands the real perceptual experience has become more familiar. For example, it has been proposed to provide services such as navigation by displaying and manipulating images drawn in CG in real space.

Virtual reality (VR) is not directly related to the physical position, but augmented reality (AR) is provided by combining information directly related to the actual physical position into a real image or a CG image close to the real image. .

The following Patent Document 1 proposes to provide AR information by matching the characteristics of computer graphics (CG) with the characteristics of captured images and the like. Patent Document 2 listed below proposes a technique for collecting and collecting image features according to time zone, weather, and season from captured images, including the case of using a three-dimensional map, and classifying and updating a map database.

Also, Patent Document 3 below discloses an apparatus that manages a virtual reality (VR) space so that an image different from the actual image is not displayed. For example, it is a device that provides an aerial sightseeing function in a 3D 3D map to a large number of users via the Internet. For 3D objects such as buildings and park monuments that exist in 3D space, Providing a modification application to users who have special rights such as the administrator of the building, that is, the administrator / owner of a specific building, to make changes via the Internet, and more realistic 3 A three-dimensional map is generated. As a result, when the aerial sightseeing service is performed as a business on the Internet, it is possible to provide a mechanism for improving defects in the generated image when automatically generating a three-dimensional image using the Internet or the like.

JP-A-11-66350 Japanese Patent Laid-Open No. 2002-27529 JP 2006-059362 A

In the conventional virtual reality technology, not only can you not take advantage of adding information to the real space by augmented reality, but also a third party intentionally adding or changing AR information that extends the real space Could not manage.

For this reason, in actual AR (Augmented Reality) operation, for example, an advertisement signboard of a station is intentionally replaced by a third party without permission by a third party, so that the intention of the advertiser and the possession of an advertisement medium such as a signboard It is possible to ignore the intentions of the property owners and the intentions of the land owners, and there is a problem that various property rights such as advertising revenue at the station may be infringed.

In the technique described in Patent Document 3, the virtual reality (VR) space is managed using a password or the like so that an image different from the actual image is not displayed. Virtual reality (VR) is not directly related to the physical position, but augmented reality (AR) does not solve the problem of providing information directly related to the physical position. It is not a mechanism for protecting various rights such as property rights of the space owner.

The present invention aims to solve the problem by protecting the rights of the land / building owner by providing AR information management technology for managing the implementation of AR information.

According to one aspect of the present invention, an AR information management apparatus that manages AR information to be created based on facility-specific feature information including image features generated from an image and position information of features in the image. And referring to AR permission condition information indicating permission conditions for displaying an AR associated with a facility identification ID for identifying the facility identified by the facility identification information, and based on the AR permission condition information, the facility An AR information management device that manages the output of AR display information to a facility specified by an identification ID is provided.

The AR permission condition information includes attribute information for narrowing a target for AR display and relation information between permission conditions.

Further, the billing is performed based on billing information of an AR information billing server that charges a fee for the output of the AR display information depending on the AR permission condition information.

Further, the present invention provides an AR information management apparatus that manages AR information to be created based on equipment specifying feature information including an image feature generated from an image and position information of a feature in the image, and the equipment AR registrar server holding AR permission condition information indicating permission conditions for displaying an AR associated with a facility identification ID for identifying a facility identified by the specific information, and AR display information depending on the AR permission condition information An AR information billing server that charges a fee for the output of the information, and the AR information management device manages the output of the AR display information to the facility specified by the facility identification ID based on the AR permission condition information AR information management system.

According to another aspect of the present invention, an AR information management method for managing AR information to be created based on facility specifying feature information including an image feature generated from an image and position information of a feature in the image. A step of referring to AR permission condition information indicating permission conditions for displaying an AR associated with a facility identification ID for identifying a facility specified by the facility specifying information, and based on the AR permission condition information And managing the output of the AR display information to the equipment specified by the equipment identification ID. Note that an SSID or a stochastic ID may be used as the ID used here.

The present invention may be a program for causing a computer to execute the AR information management method described above, or a computer-readable recording medium for recording the program.

This specification includes the contents described in the specification and / or drawings of Japanese Patent Application No. 2012-006560, which is the basis of the priority of the present application.

According to the present invention, it is possible to protect the rights of owners such as buildings in the operation of AR. AR information can be provided to a specific terminal or the like in consideration of the intention of the owner of the land / building, and charging conditions relating to the restriction can be set.

It is a figure which shows the outline | summary of the AR information management system by one embodiment of this invention, and its process. It is a functional block diagram which shows one structural example of AR terminal. It is a functional block diagram which shows one structural example of AR information delivery apparatus. It is a functional block diagram which shows one structural example of AR registrar server. It is a functional block diagram which shows one structural example of AR information charging server. It is a figure which shows one structural example of AR registrar DB. It is a figure which shows the example of 1 structure of a condition table (AR permission condition information). It is a figure which shows the other example of augmented reality (AR) information. It is a figure which shows an example of a rights table. It is a figure which shows the example of 1 structure of an accounting table. It is a flowchart figure which shows the flow of AR information management processing by this Embodiment. It is a figure which shows the example of a process outline | summary by the other example of a sequence different from FIG. 1 of this invention.

The AR information management technology according to the embodiment of the present invention accepts a registration application for a domain name corresponding to an address on the Internet, associates an IP address with location information, and associates a WiFi SSID with location information. In addition to operating the AR registrar server, by specifying the conditions for the AR advertisement and specifying the billing distribution when a third party performs the advertisement, it was possible to display only the specific advertisement on the station billboard in the past. The problem can be solved and the profit to the right holder can be guaranteed. The same applies to the AR advertisement for the outdoor advertising billboard. Further, when the advertisement signboard is a still image, the AR advertisement for the advertisement may be displayed as a moving image or a 3D CG.

Hereinafter, an AR information management technique according to an embodiment of the present invention will be described with reference to the drawings.

FIG. 1 is a diagram showing an outline of an AR information management system and its processing according to an embodiment of the present invention. A detailed processing flow will be described later with reference to a flowchart. The AR information management system according to the present embodiment includes an AR terminal 1, an AR information distribution device 3, an AR registrar server 5, and an AR information billing server 7. As an outline of the management process, first, the facility identification feature information (VQ code or the like based on the location information, the direction information, the captured image, the feature amount based on the captured image, or the VQ code) from the AR terminal 1 to the AR information distribution device 3. (Position information etc.) is transmitted (L1). The AR information distribution device 3 transmits the equipment ID specified by the equipment specifying feature information to the AR registrar server 5, and the AR registrar server 5 receives the equipment ID (L2). At this time, since the facility can be specified by the location information, location information such as latitude, longitude, altitude may be used as the ID, and the SSID as the access point of the building is used as the ID for confirming the AR condition setting It may be used, or an ID that is stochastically specified from an image feature or the like may be used.

Regarding the latitude, longitude, and altitude values as the acquired position information, the space obtained by processing the obtained value as a unit space in the three-dimensional map information as a unit space, and the owner of the space including the acquired position May be managed by DB. By managing in this way, the space can be managed finely. In addition, in spaces where ownership is not registered, it is possible to take measures such as prohibiting AR in advance, and in apartments, etc., on the appearance of the land and buildings subject to computers managed by representatives. The AR information management authority may be given.

The AR registrar server 5 acquires and transmits AR permission condition information associated with the information identified by the facility ID to the AR information distribution device 3 (L3), and the AR information device 3 receives information about the permitted AR. To the AR information billing server 7, and the AR information billing server 7 performs billing processing such as billing as a consideration for adding AR information (for example, advertisement information) to the AR information distribution device 3 (L4). Then, the AR information distribution device 3 sends data for displaying the AR information to the AR terminal 1, and causes the AR terminal 1 to display the AR information (for example, advertisement information).

At this time, the AR registrar server 5 can display AR information such as advertisement information in accordance with AR permission condition information associated with the information identified by the facility ID, for example, a permission condition for displaying advertisements by the AR. By doing so, AR display can be performed in accordance with restrictions such as permission / non-permission of AR display and conditional permission.

In addition, when the display of AR information is permitted, billing or the like can be a condition for the consideration, and the AR display can be made in accordance with the intention of the right holder. Therefore, for example, whether or not to permit the AR display with the advertisement added to the building or the like and under what conditions it is necessary to comply with the intention of the right holder of the building or the like. For this reason, it is possible to prevent an unfair profit from being obtained by a third party or the like adding AR information and distributing it without permission to the right holder.

Hereinafter, a more detailed description will be given of this embodiment.

FIG. 2 is a functional block diagram showing a configuration example of the AR terminal 1. As shown in FIG. 2, the AR terminal 1 includes a control unit (CPU) 1-1, a communication unit 1-2, a position information acquisition unit (GPS, etc.) 1-3, and an imaging unit (camera, movie) 1 -4 and a display unit (display) 1-5. The AR terminal 1 transmits facility specifying feature information and the like to the AR information distribution device 3. As described above, the facility specifying feature information may be, for example, position information of a feature such as a building.

FIG. 3 is a functional block diagram illustrating a configuration example of the AR information distribution apparatus 3. As shown in FIG. 3, the AR information distribution apparatus 3 includes a control unit (CPU) 3-1, a communication unit 3-2, a collation unit 3-3, an AR database 3-4, and AR permission condition information addition. A section 3-5 and a right information etc. acquiring section 3-6. The AR database 3-4 stores information (table, etc.) that is a pair of an AR image of equipment such as a building and its equipment ID, and extracts an AR image specified by equipment specifying feature information such as position information. The AR image can be extracted by the equipment ID.

The AR permission condition information adding unit 3-5 is specified in the AR registrar server 5 based on the equipment ID, and based on the provided AR permission condition information or adding the AR permission condition information, the AR terminal device 1 AR information to be displayed is provided to the AR terminal device 1. Note that the right information etc. acquiring unit 3-6 can acquire the information on the right relations (owner, user, etc.) of the building etc. from, for example, a register of the Legal Affairs Bureau. Information may be acquired from a server or the like that provides an information providing service that provides rights-related information such as the ownership of a feature.

FIG. 4 is a functional block diagram showing a configuration example of the AR registrar server 5. As shown in FIG. 4, the AR registrar server 5 according to this embodiment includes a control unit (CPU) 5-1, a communication unit 5-2, an AR permission condition information search unit 5-3, an AR registrar DB5- 4.

The AR permission condition information search unit 5-3 searches the AR registrar DB 5-4 based on the equipment ID for identifying the equipment specified by the equipment specifying feature information received from the AR distribution device 3, Extract AR permission condition information to be imposed.

FIG. 5 is a functional block diagram showing a configuration example of the AR information billing server 7. The AR information charging server 7 includes a control unit 7-1, a communication unit 7-2, a charging processing unit 7-3, and a charging DB 7-4. Based on the AR permission condition information from the AR information distribution apparatus 3, the charging processing unit 7-3 refers to the charging DB 7-4 and responds to the AR user who added the advertisement information or the like in the AR information. Perform billing process. You may make it pay the consideration to the right holder of a feature.

FIG. 6 is a diagram illustrating a configuration example of the AR registrar DB 5-4. FIG. 6A is a diagram illustrating an example of a building table. As shown in FIG. 6A, the building table includes, for example, a building ID that uniquely identifies the building, its physical position (latitude, longitude, height, etc.), and ownership of the building. Owner ID that uniquely identifies the person, AR advertisement ID that uniquely identifies the AR advertisement associated with the location of the building, and location type (such as a use area of the building, commercial land, station bull, etc.) is doing. From this building table, it is possible to know that the AR advertisement specified by the AR advertisement ID is provided at a position of a building where the owner (for example, Owner1) exists.

FIG. 6B is a table showing a configuration example of the 3D image table. As shown in FIG. 6B, the 3D image table includes a 3D object ID of an AR advertisement attached to a building or the like, an AR information for the AR advertisement, and an AR advertisement ID that uniquely identifies the AR advertisement. It is a table which shows. That is, the AR advertisement specified by the 3D object ID and the AR information shown in FIG. 6B is attached to the specific position of the building specified by the AR advertisement ID of FIG. It is. From these AR registrar DBs, the AR information distribution device 3 obtains an equipment identification ID such as a building ID from the physical position in the equipment specifying feature information received from the AR terminal 1, and sends this to the AR registrar server 5, The AR permission condition information shown in FIG. 7 is received, and this AR permission condition information is returned to the AR terminal 1.

FIG. 7 is a diagram illustrating a configuration example of a condition table (AR permission condition information). As shown in FIG. 7, the AR permission condition information table has a building ID and a condition item. Instead of the building ID, a physical position, an AR advertisement ID, or the like may be used. As shown in FIG. 7, a condition item is set for each building ID, and the condition item is, for example, attribute information such as an individual name, a group name, age, sex, occupation, and residence. In general, the condition item is an individual name or a group name, and indicates that an AR advertisement specified by the AR advertisement ID is permitted or permitted to a specified individual or group. Then, based on the AR advertisement ID specified by the building ID (FIG. 6A), 3D data (polygon, texture, UV map, etc.) specified by the 3D object ID shown in FIG. Are extracted and transmitted to the AR terminal 1 for display. Here, it is permitted to display advertisement information only for individual names and group names specified in the condition table (AR permission condition information). In FIG. 6B, the ID is a 3D object ID. This ID is not only implemented as an ID for referring to 3D object data (registered in the DB) but also the file name of the 3D object data or directly. 3D data (shape data directly registered in the DB) or the like.

Since AR display is not permitted to other persons who do not satisfy the AR permission condition, it is possible to restrict the third party from performing the AR display arbitrarily against the condition table which is the intention of the right holder. Here, the condition items may be limited by age, sex, occupation, address (residence), or the like. The condition items to be limited are arbitrary, and there may be an option that the conditions are not limited.

That is, as a condition item specified by the building ID, for example, the building ID2 has an attribute that a man of age 20-50, a profession and an address is in Kyushu, as shown in FIG. For those who have information, AR advertisement 2 is obtained as the AR advertisement ID of the building ID 2 shown in FIG. 6, and there is a loan permission as a permission condition for AR advertisement 2 described in the right table of FIG. From FIG. 10, it is possible to impose a condition that the charging condition is 300 $ / day. In this way, the relationship information for associating the permission condition information and the attribute information for setting the permission condition based on the attribute information can be constructed in the storage unit (on the DB).

The land use map provided by the Geographical Survey Institute based on the location information acquired from the location information acquisition unit such as GPS, the land ownership information managed by the Legal Affairs Bureau, and the physical location information based on the address / zip code are stored in the database. You may operate a database to provide the management authority to owners and users of land and buildings that are registered and specified by the AR terminal device, and there are various types of location specification for providing AR information from the AR terminal. Since the implementation is publicly known, any method may be used.

FIG. 8 is a diagram showing another example of augmented reality (AR) information. AR information includes related recommendations (recommendation) information, tourism information, area information such as maps and geographies, product information such as prices and product names, inventory information, sales information such as time sales, and various campaigns It may be advertising information, store information, disaster prevention information, traffic information, emergency medical information, entertainment information, geographic information, and the like. The AR information may be various information and content information that does not depend on the current time axis or space axis, and is not particularly limited.

FIG. 9 is a diagram showing an example of a rights table. The right table shown in FIG. 9 is a diagram showing the right holder and the lending permission information for the AR advertisement ID. By indicating the right holder of the AR advertisement and whether or not the loan is permitted, it can be used, for example, to check the current right relationship and whether the person who wants to use the AR advertisement can use it.

FIG. 10 is a diagram showing a configuration example of the accounting table. As shown in FIG. 10, the charging table is provided in the AR information charging server 7. The billing table describes, for each AR advertisement ID, billing conditions (for example, $ 300 / day), AR space lenders (for example, User21), and based on this, how much billing is to whom. Can be calculated. Further, based on the difference in the condition items of the AR permission condition information shown in FIG. For example, it may be 300 $ / day for 20-40 years old and 400 $ / day for 41-50 years old.

FIG. 11 is a flowchart showing the flow of AR information management processing according to the present embodiment. When the process of displaying the city scenery or the like on the AR terminal 1 is started (Start), in step S1, the AR terminal 1 sends the facility specifying feature information extracted from the city scenery or the like to the AR information distribution device 3. send. In step S <b> 2, the AR distribution device 3 transmits an equipment identification ID (a building ID in FIG. 6A) specified by the equipment specifying information to the AR registrar server 5.

In step S3, the AR registrar server 5 refers to the AR permission condition information associated with the information identified by the facility identification ID (see FIG. 7). In step S <b> 4, the AR registrar server 5 transmits AR permission condition information to the AR information distribution device 3. In step S5, the AR distribution device 3 uses the AR advertisement ID specified by the building ID (FIG. 6A) for the designated individual or group that permits the AR advertisement specified by the AR advertisement ID, as shown in FIG. AR information including 3D data specified by the 3D object ID shown in (b) is extracted, and these are transmitted to the AR terminal 1 and output to the user. Here, it is permitted to display advertisement information only for individual names and group names specified in the condition table (AR permission condition information). That is, in step S6, since the AR information can be displayed only for the AR terminal 1 that satisfies the condition items shown in FIG. 7, it is possible to display advertisements or the like while narrowing the conditions to some extent. Furthermore, the right table of FIG. 9 allows only the person authorized by the right holder to display the AR advertisement or the like, and as a price, referring to the billing table and charging the right holder, Profits can be provided and the provision of AR advertisements can be promoted. In this case, conditional branching and probability estimation evaluation that can be performed to reflect the intention of the right holder by providing a DB table that can be arbitrarily set in the provided information field including advertisements permitted by the right holder, It may be a statistical processing evaluation mechanism, and as a result of these tables and processing, the convenience in protecting the rights of the right holder is improved. In addition to the table managed by the building owner, a table that prohibits the provision of information that adversely affects the advertiser's advertisement can be further provided to protect the advertiser's right to advertise. You may comprise.

In addition, it is constructed using various items that can identify the person, such as various certificates including public certificates (including SIM cards, mobile phone SIMs, IC card membership books, etc.). You may make it identify the owner's right, such as a thing.

Note that the AR information in FIG. 8 is an example of additional information. By providing such information as AR information, it is possible to provide AR information including advertisements with more variety.

As described above, since the intention of the landowner, the building owner, the advertiser, etc. is registered in the AR registrar server, and AR information is provided according to the registered intention, the video added to the actual advertisement by the AR, etc. And the property rights of landowners and advertisers can be protected.

In addition, according to the AR permission conditions, it is possible to permit the display of advertisements of other products depending on the time of day, and arbitrarily change the contents of advertisements according to the season and weather. The contents of the advertisement can be changed according to the language setting of the terminal.

That is, it is possible to manage the implementation of augmented reality by those skilled in the art, such as landowners, building owners or their management agents.

Note that the AR information distribution apparatus 3 and the AR registrar server 5 may be configured integrally, or may be configured to be distributed to locations that can be connected by communication. In addition, it is possible to take measures such as inquiring information such as the Legal Affairs Bureau to identify landowners or inquiring administrative management area information to use designated advertising conditions. In addition, it may be possible to develop a law that obliges the AR system or service to authenticate to the registrar server, or attach these rights and obligations to the communication carrier.

Also, the augmented reality information provided may be changed or prohibited according to the set age of the terminal user based on the information registered at the time of the contract in advance.

Also, the augmented reality information provided may be changed or prohibited according to the language setting, gender setting, or religious setting.

Also, AR may be performed by discriminating between residential and commercial facilities by referring to location information using a land use map.

Also, the registrar server may be managed in multiple layers like DNS, or may be managed via a communication path like IP address.

Augmented reality information includes recommendation information, tourism information, regional information such as maps and geographies, product information such as prices and product names, inventory information, sales information such as time sales, advertising / advertisement information including various campaigns, and stores. It may be information, disaster prevention information, traffic information, emergency medical information, entertainment information, and the like.

Also, the augmented reality information may be content information including various information and fiction that do not depend on the current time axis or space axis.

In addition, AR display rights may be set according to polygon information according to actual conditions, or AR display rights may be set according to real space display conditions such as neon signs and videos. The AR may be performed only for a specific state such as a sign or a moving image.

Also, provision of AR information may be permitted or prohibited only during a specific period, time, or period.

In addition, AR display rights are set according to 3D information such as polygons and textures according to actual conditions, and AR display rights are set according to real space display conditions such as neon signs and videos. Alternatively, AR may be performed only for a specific state such as a neon sign or a moving image.

In addition, each device may be configured integrally with any part, the DB and various functions may be acquired from the outside via a communication unit or a removable storage medium, and the above description You may belong to a different device.

Also, any protocol such as HTTP may be used.

Also, a method of selecting augmented reality using an SSID that is an identifier of an access point in a wireless LAN is conceivable. For example, a base station table as shown in FIG. 6C is provided instead of a building table, and in the received SSID, augmented reality is not permitted in addition to an arbitrary SSID symbol such as “xyz”. For example, in the case of an SSID “xyz_non_AR” that includes “_non_AR” at the end, display is automatically prohibited at the location or building where the communication base station is installed, or the end of the SSID is “xyz_in_AR”. In the case of “_in_AR”, a configuration such as automatically permitting AR is conceivable. In this description, the illustrated character string is a character string to be evaluated regarding the presence or absence of AR implementation, and “xyz” in the first half is merely an example of an ID representing a communication base station installed in a building or the like. Not caught. Further, it may be included not only at the end but also at an arbitrary position such as the top. At this time, a DB that acquires position information by reverse lookup from the SSID is constructed, and the map DB may be configured so that it is possible to determine which building the SSID is by accessing these DBs. In this way, it can be configured so that permission and authorization can be set by SSID, and is described as an example that can be used as an ID for identifying a building or the like.

In addition to the AR permission information embedded in the SSID, as an identifier of an access point for performing communication such as WiFi installed in these buildings, for example, the latitude / longitude and altitude are directly displayed as physical coordinates in the SSID. The position information may be acquired by searching the database for latitude / longitude and altitude as physical position information using the SSID as a search key.

In addition, the target position such as the latitude and longitude of the AR information provision object is specified based on the latitude, longitude, line-of-sight direction, etc., and from the position of the specified AR information provision object, the Land Division Map of the Legal Affairs Bureau and the Geographical Survey Institute Identify the building etc. from the land use map, the design drawing of the building, etc., acquire the 3D shape data about the specified building etc., and use the altitude to AR information of the target building based on the 3D shape (model) data If there is a section possession DB, these orders may be configured so that the intention of the section owner or the building owner can be specified from the latitude / longitude and altitude. At this time, the eye gaze direction may be specified by eye gaze detection based on a pupil or eyeball direction in an HMD (head mounted display) or the like.

In addition, a land or building is identified using a hash tag generated from image feature group information based on an actual image obtained from the imaging unit of the terminal or an evaluation image obtained on the distribution device side, or various feature information groups When evaluating the frequency of appearance of VQ codes and feature values generated from, by evaluating the probability of being a specific land or building when a specific correlation is obtained at a certain physical position or temporal position, You may comprise so that ID for specifying AR information provision object may be given with respect to land or a building based on arbitrary calculations including a statistical process, a recognition process, a distance calculation method, a probabilistic method, etc.

In addition, when latitude and longitude are input, an IP address or a domain name may be provided as information for specifying a server that provides augmented reality space information. For example, a zip code may be used as an identifier, A means such as specifying a domain by using a station number as an identifier or specifying a latitude and longitude as an identifier or using it for a request query may be taken.

Also, as a method for implementing the sovereignty of the augmented reality space, the management apparatus may be operated by an organization related to the region such as the Legal Affairs Bureau, local governments, residents' associations, and shop associations.

In addition, augmented reality performed on a person may change the display position where AR is performed according to the position information output from the terminal of the person and the terminal identification ID, and the property right proxy of the person or the parent You may comprise so that AR may be implemented based on permission of an administrator.

It is also possible to use a method of managing ownership and property rights as 3D map information from the latitude, longitude, altitude, etc. of the augmented reality image display target calculated from the latitude and longitude and line of sight of the terminal. You may comprise so that an administrator may differ.

In addition, when the land is a place with a rapid change such as a road or a sidewalk, an allowable error may be given to the position estimation of the target AR information providing object.

Also, the billing amount for the AR information provider in the AR information may be determined by auction, or may be determined by the intention of the land owner or property rights manager.

In addition, augmented reality for people and objects can be obtained by obtaining the permission of law enforcement officials from any means such as a court or law for persons and objects specified by various recognition means such as image recognition and voice recognition. It can be obtained regardless of the consent or intention of the right holder and agent, or can be restricted.

Also, if content that slanders others or illegal content can be disclosed to third parties as augmented reality, it may be encrypted and managed so as to have legal proof ability.

Also, a usage confirmation process may be carried out so as to periodically confirm the intentions of the right holder, and various charges may be made to related parties regarding the AR information provision act together with the periodic confirmation.

In addition, when a terminal of a user who needs a parent such as a child is separated from a normal parent by a distance of a predetermined time or more than a predetermined time or at a predetermined time or a specific time zone, When deviating from the management area, a warning may be issued, or a temporary management request may be made to the other supervisor from the parental authority to cope with a change in the state of physical distance such as school or travel.

Also, there may be an AR registrar server for registering the intentions of not only landowners but also rental users.

In addition, a plurality of public notices and advertisements may be acquired for billing to realize some profit return service to users including services such as stamp rally. Of course, various settings may be made by password protection by the right holder, administrator, or supervisor.

Further, the billing amount may change depending on the distance between the AR information display position and the current position of the AR terminal.

More specifically, if people in the A-bomb bombing area do not want to be scribbled with AR in the sky, such as “Pika”, the display may be restricted by a prefectural vote, or restricted by the prefectural governor or mayor's authority. It is possible to secure the right not to be AR.

Also, the convenience of the present invention may be further improved by combining with a plurality of past patents and products.

FIG. 12 is a modification of FIG. The difference between FIG. 1 and FIG. 12 is that in FIG. 12, when the AR registrar server 5 receives the equipment ID (L2), the AR registrar server 5 requests the AR information charging server 7 to perform the charging process, The AR registrar server 5 that has received the reply of the charging process is different in that the AR permission condition information and the like are acquired and transmitted to the AR information distribution apparatus 3 (L3a). In this way, similar processing may be realized by changing the access order.

In the above-described embodiment, the configuration illustrated in the accompanying drawings is not limited to these, and can be appropriately changed within a range in which the effect of the present invention is exhibited. In addition, various modifications can be made without departing from the scope of the object of the present invention.

In addition, a program for realizing the functions described in the present embodiment is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system and executed to execute processing of each unit. May be performed. The “computer system” here includes an OS and hardware such as peripheral devices.

In addition, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.

Further, the “computer-readable recording medium” means a storage device such as a flexible disk, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case is also used to hold a program for a certain period of time. The program may be a program for realizing a part of the above-described functions, or may be a program that can realize the above-described functions in combination with a program already recorded in a computer system.

The present invention can be used as an AR information management device.

DESCRIPTION OF SYMBOLS 1 ... AR terminal, 1-1 ... Control part (CPU), 1-2 ... Communication part, 1-3 ... Position information acquisition part (GPS), 1-4 ... Imaging part (camera, movie), 1-5 ... Display unit (display), 3 ... AR information distribution device, 3-1 ... control unit (CPU), 3-2 ... communication unit, 3-3 ... collation unit, 3-4 ... AR database, 3-5 ... AR permission Condition information addition unit, 3-6... Rights information acquisition unit, 5... AR registrar server, 5-7... Control unit (CPU), 5-2. -4 ... AR registrar DB, 7 ... AR information billing server, 7-1 ... control unit, 7-2 ... communication unit, 7-3 ... billing unit, 7-4 ... billing DB.

All publications, patents and patent applications cited in this specification shall be incorporated into the present specification as they are.

Claims

An AR information management device that manages AR information created based on facility-specific feature information including image features generated from images and position information of features in the images,
Reference is made to AR permission condition information indicating permission conditions for displaying an AR associated with a facility identification ID for identifying a facility identified by the facility identification feature information, and the facility identification ID is based on the AR permission condition information. AR information management device that manages the output of AR information to the facility specified in.
The AR permission condition information is
The AR information management apparatus according to claim 1, further comprising relation information between attribute information and permission conditions for narrowing a target for AR display.
3. The AR information management apparatus according to claim 1, wherein charging is performed based on charging information of an AR information charging server that charges a fee for output of AR information depending on the AR permission condition information. .
An AR information management device that manages AR information created based on facility-specific feature information including image features generated from images and location information of features in the images;
An AR registrar server that holds AR permission condition information indicating permission conditions for displaying an AR associated with a facility identification ID that identifies a facility identified by the facility identification information;
An AR information charging server that charges a fee for the output of the AR information depending on the AR permission condition information,
The AR information management device is an AR information management system that manages output of AR information to a facility specified by the facility identification ID based on the AR permission condition information.
An AR information management method for managing AR information created based on facility-specific feature information including image features generated from an image and position information of features in the image,
Referring to AR permission condition information indicating permission conditions for displaying an AR associated with a facility identification ID for identifying a facility identified by the facility identification information;
Managing the output of AR information to the facility specified by the facility identification ID based on the AR permission condition information.
A program for causing a computer to execute the AR information management method according to claim 5.