JP7250308B2 - AR library system - Google Patents

Description

The present invention relates to an AR library system.

2. Description of the Related Art Conventionally, an AR system is known in which an image of an object acquired by a user terminal and additional information associated with the object are superimposed and displayed on the display screen of the user terminal (see Patent Document 1, for example). ).

In the AR system of Literature 1, the user himself/herself operates the user terminal to input information such as the name of the building as information to be associated with the position information and the video information of the object such as the building acquired by the user terminal. It can be sent to the server and stored in the server's database.

Then, in the AR system of Document 1, the user searches the database of the server based on the position information of the user terminal and the image information of the object acquired by the user terminal to identify the object in the image. Information associated with the object can be obtained from the server and displayed on the screen of the user terminal by superimposing it on the image of the object. And so on.

JP 2018-32381

However, according to the system of Patent Document 1, in order to specify an object acquired by the user terminal, it is necessary to use the location information of the user terminal acquired from GPS or the like. The system cannot be used indoors where it is difficult to obtain.

For objects with the same appearance, such as mass-produced automobiles, that can exist in multiple locations at the same time, or objects that can exist in different locations at different times, such as works of art, location information and object This makes the user feel inconvenient that related information may or may not be displayed for objects having the same appearance depending on the location.

Furthermore, the type of information that a user wants to obtain varies greatly depending on the user, or even for the same user, depending on the situation. Then the amount of information becomes enormous.

According to the system of Patent Literature 1, every time the user terminal recognizes an object, the entire database centrally managed by the server is searched.

As a result, the amount of communication between the user terminal and the server increases, and the search processing in the database of the server takes time. Inconvenience is caused, for example, that it takes a long time to superimpose and display information related to the object.

In addition, in order to display the information related to the object of interest to the user according to the scene without causing inconvenience to the user, sufficient information related to the object of interest to the user is stored. must be

According to the system of Patent Document 1, whether or not sufficient information related to an object that the user is interested in is stored depends on the motivation of each user. does not have

Therefore, as a result, it is not possible to sufficiently display information related to the object that the user is interested in, which causes the user to feel inconvenient.

As described above, according to the system of Patent Document 1, the user feels inconvenient that he or she cannot obtain sufficient information related to an object of interest to the user.

In view of the above problems of the prior art, it is an object of the present invention to display information related to an object that the user is interested in, regardless of where the system is used and without making the user feel inconvenient. It is to provide an AR library system capable of

The AR library system according to the present invention is
An AR library system comprising a plurality of user terminals for recognizing the appearance of an object and outputting descriptive data, which is data describing the object based on the appearance of the object, and one or more nodes communicating with the plurality of user terminals. and
The user terminal is
a camera unit that captures the appearance of the object;
an appearance data generation unit that recognizes the appearance of the object through the camera unit and generates appearance data that is data relating to the appearance of the object;
An object that receives an input of the description data about the object by a user, generates object data that is data that associates the appearance data of the object, the description data, and user identification information of the user, and transmits the object data to the node. a data generator;
a terminal storage unit that receives and stores a data library that is an aggregate of the object data distributed by the node;
Based on the appearance of the object captured by the camera, the explanation data associated with the appearance data matching the appearance of the object is acquired from the terminal storage, and the image captured by the camera. an image generation unit that generates and outputs an image in which the description data is superimposed on the image of the object included in
The node is
a library generating unit that classifies the object data received from the user terminal according to the type of the object data and stores them as the data library;
a library distribution unit that distributes the data library to the user terminal;
generating distribution cost data indicating a distribution cost for the user who received the distribution of the data library, and obtaining the user identification information from each of the object data included in the distributed data library; identifying each user who transmitted each piece of object data contained in the data library, counting the number of pieces of object data contained in the distributed data library for each user, and counting the number of pieces of object data for each user; Proportional distribution of all or part of the distribution cost to generate distribution reward data indicating a reward for each of the one or more users who transmitted the object data contained in the distributed data library. and a remuneration data generation unit.

According to the present invention, the user himself/herself takes an image of the appearance of an arbitrary object using the camera unit of the user terminal, causes the user terminal to generate the appearance data of the object, and associates the appearance data of each object with the description data. Generate object data and send it to the node.

After that, the user receives from the node a data library, which is a collection of object data classified by type of object, and stores it in the terminal storage unit of the user terminal.

Then, when the user captures an image of an object with the camera unit of the user terminal, information associated with the appearance of the object is obtained from the data library in the terminal storage unit, and each object included in the image captured by the camera unit is acquired. The description data is superimposed on the video of the display.

Thus, according to the present invention, object data does not require GPS position information, so the system can be used indoors where it is difficult to obtain position information using GPS.

Moreover, if an object has the same appearance, it is convenient because information related to the object can be displayed even if the object exists in multiple places at the same time or in different places depending on the time of year.

Furthermore, the user receives the data library distributed from the node in advance and stores it in the user terminal, and acquires the explanation data from the terminal storage unit. and information related to the object are superimposed on each other, there is no need to wait for communication with the node or search processing inside the node.

In addition, the data library is classified by type of object at the node and distributed, and the user can select and receive only the data library of the type of object that the user is interested in, and store it in the user terminal. Since the amount of data in the terminal storage can be minimized, the process of acquiring the explanation data from the terminal storage can be performed efficiently.

For these reasons, it is possible to minimize the time from when the user terminal recognizes an object to when the image of the object and information related to the object are superimposed and displayed on the screen of the user terminal. Convenient.

In addition, according to the present invention, when a data library containing the object data is distributed to the user who has transmitted the object data to the node, the user who received the distribution of the data library bears the distribution cost. can be distributed to the users who have sent the object data included in the data library and received as a reward.

Therefore, users are motivated to generate and transmit object data to nodes for objects that they are interested in and want other users to be interested in, or objects that the user thinks other users will be interested in. This increases the likelihood that sufficient information will be stored in the nodes relating to the objects of interest to each user.

As a result, as a result, it is possible to sufficiently display information related to the object that the user is interested in, so that the user does not feel inconvenient.

As described above, according to the present invention, an AR library system capable of displaying information related to an object of interest to the user regardless of the location where the system is used and without causing inconvenience to the user. can be provided.

In the AR library system of the present invention,
said node is plural,
generating block data based on the distribution cost data and the distribution reward data each time a certain number of the distribution cost data and the distribution reward data are generated; It is preferable to have a node and a block chain part for distributed management.

According to the present invention, there are a plurality of nodes, and each node includes a block chain unit that adds block data to the block chain generated each time a certain number of the distribution cost data and the distribution reward data are generated, Form a blockchain network that records and shares the blockchain as a distributed database that is synchronized between nodes.

Therefore, falsification of distribution cost data and distribution reward data can be easily prevented, and it is certain that a user who has transmitted object data to a node can receive a reward when a data library containing the object data is distributed to the user. Because of the increased volatility, there is more incentive to generate object data and send it to nodes.

As a result, as a result, it is possible to more reliably display sufficient information related to the object that the user is interested in, so that the user does not feel inconvenient.

Thus, according to the present invention, it is possible to more reliably provide an AR library system capable of displaying information related to an object of interest to the user without causing inconvenience to the user.

In the AR library system of the present invention,
It is preferable that the library generator analyzes the object data received from the user terminal, compresses the data volume, and stores the compressed data as the data library.

According to the present invention, since the data volume of the data library is reduced, the time required for the user to receive the data library from the node is shortened, thereby reducing inconvenience when the user receives more data libraries. can do.

Thus, according to the present invention, it is possible to provide an AR library system that can display information related to more objects that the user is interested in without causing inconvenience to the user.

In the AR library system of the present invention,
The video generation unit obtains, from the terminal storage unit, each description data associated with each appearance data that matches each of the appearances of the plurality of objects, based on the appearances of the plurality of objects captured by the camera unit. Preferably, it is configured to generate and output an image in which each description data is superimposed on each image of each object included in the image picked up by the camera unit.

According to the present invention, the video generation unit simultaneously acquires explanatory data of a plurality of objects captured by the camera unit by the user, and generates and outputs a video in which each explanatory data is superimposed on each video of each object. .

Therefore, the user can simultaneously display information related to a plurality of objects of interest to the user, thereby further improving convenience for the user.

Thus, according to the present invention, it is possible to provide an AR library system capable of displaying information related to an object of interest to the user while further improving user convenience.

1 is a schematic diagram showing an overview of the configuration of an AR library system according to one embodiment of the present invention; FIG. 4 is a flow chart showing the processing flow of the AR library system according to one embodiment of the present invention. 4 is a flow chart showing the processing flow of the AR library system according to one embodiment of the present invention. 4 is a flow chart showing the processing flow of the AR library system according to one embodiment of the present invention. FIG. 4 is a diagram showing a screen display of the AR library system according to one embodiment of the present invention; FIG. 4 is a diagram showing a screen display of the AR library system according to one embodiment of the present invention;

Embodiments of the present invention will be described below with reference to the drawings.

First, with reference to FIG. 1, an outline of the configuration of an AR library system according to one embodiment of the present invention will be described.

An AR library system according to an embodiment of the present invention is a network system comprising multiple user terminals 10 and one or more nodes 20 .

Between the user terminal 10 and the node 20 and between the nodes 20, for example, wireless communication such as mobile phone communication network, Wi-Fi (registered trademark), wired communication such as Ethernet, PLC (power line communication), etc. are connected by a communication network 30, such as the Internet, through which each user terminal 10 and each node 20 are assigned an IP address, an identification code, etc. to identify the other party and exchange various information with each other. can be done.

The user terminal 10 includes a camera unit 100, a terminal input unit 110, a terminal display unit 120, a terminal communication unit 130, a terminal control unit 140, an appearance data generation unit 141, an object data generation unit 142, an image generation unit 143, and a terminal storage unit 150. , such as smartphones, tablets, and personal computers.

The camera unit 100 is a camera capable of capturing the appearance of an object. When the appearance data generation unit 141 records the appearance of objects to create appearance data, generates object data in which the appearance data and description data of each object are associated with each other, and transmits the generated object data to the node 20, It is used when the image generation unit 143 causes the terminal display unit 120 of the user terminal 10 to superimpose and display the image of the object and information related to the object based on the appearance of the object.

The appearance of an object is information about the part visible to the user, such as the shape and color of the object. Appearance captured from a certain direction may be used, or a combination of appearances taken from a plurality of directions such as front, rear, upper, lower, oblique, etc. may be used.

The terminal input unit 110 is a portion that receives information input by the user, and is, for example, a touch panel, keyboard, mouse, touch pad, or other pointing device. The user uses the camera unit 100 to capture an image of the appearance of an arbitrary object, and uses the terminal input unit 110 to input explanatory data about the object.

The terminal display unit 120 is a part that displays information output by the user terminal 10, and is, for example, a liquid crystal display or an organic EL display.

The terminal display unit 120 displays an image of an object captured by the user using the camera unit 100 and an image in which the information related to the object and the object are superimposed.

The terminal communication unit 130 is configured to mutually communicate with the node 20 via wired communication or wireless communication according to a communication standard such as WiFi (registered trademark).

The terminal control unit 140 includes an arithmetic processing unit such as a CPU (Central Processing Unit), a memory, and the like.

The terminal control unit 140 functions as an appearance data generation unit 141, an object data generation unit 142, and an image generation unit 143 that execute processing described later by reading and executing predetermined programs.

The terminal control unit 140 recognizes the program to be read, reads it, and executes it, or terminates the execution of the program, in response to the user's operation on the terminal input unit 110 (for example, a touch or click of a button, or a swipe operation). do.

Appearance data generation section 141 generates appearance data from an image of an object recorded via camera section 100 . Appearance data is, for example, a set of information including the video and information about the angle and orientation of the user terminal 10 when the video was captured.

The object data generation unit 142 generates object data, which is a set of information that associates appearance data with description data input by the user using the terminal input unit 110 .

Thus, according to the present invention, the object data does not require GPS position information, so the user can use the system even indoors where it is difficult to obtain position information using GPS.

Further, according to the present invention, if an object has the same appearance, it is convenient because information related to the object can be displayed even if the object exists in multiple places at the same time or in different places depending on the time. .

The video generation unit 143 refers to the data library 151 in the terminal storage unit 150, and based on the appearance of the object captured by the camera unit 100, generates description data associated with appearance data that matches the appearance of the object. An image is generated by superimposing the explanation data on the image of the object included in the image captured by the camera unit 100 and displayed to the user via the terminal display unit 120 .

Note that the video generation unit 143 acquires from the data library 151 each description data associated with each appearance data that matches each appearance of the plurality of objects based on the appearance of the plurality of objects captured by the camera unit 100, It is preferable to generate and output an image in which each description data is superimposed on each image of each object included in the image captured by the camera unit 100 .

This allows the user to simultaneously display information relating to a plurality of objects of interest to the user, thereby further improving convenience for the user.

The terminal storage unit 150 is configured by storage devices such as ROM (Read Only Memory), RAM (Random Access Memory), and HDD (Hard Disk Drive).

The terminal storage unit 150 is configured to store the data library 151, the user ID 152, the processing result of the terminal control unit 140, or the data that the terminal control unit 140 receives from the node 20 via the terminal communication unit 130. there is

As a result, the user receives the data library distributed from the node in advance, stores it in the user terminal, and acquires the explanation data from the terminal storage section. When superimposing and displaying an image and information related to the object, there is no need to wait for communication with the node or search processing inside the node.

The data library 151 is a collection of object data distributed by the node 20 and includes one or more pieces of object data. User ID 152 is an ID for specifying a user.

The node 20 includes a node communication unit 200 , a node control unit 210 , a library generation unit 211 , a library distribution unit 212 , a reward data generation unit 213 , a blockchain unit 214 and a node storage unit 220 .

The node communication unit 200 is configured to mutually communicate with the user terminal 10 via wired communication or wireless communication according to a communication standard such as WiFi (registered trademark).

The node control unit 210 functions as a library generation unit 211, a library distribution unit 212, a remuneration data generation unit 213, and a block chain unit 214 that execute processing described later by reading and executing predetermined programs.

The library generation unit 211 classifies the object data received from the user terminal according to the type of the object data and stores them in the node storage unit 220 as a node data library 221 .

For example, in the user terminal 10, the object data generation unit 142 accepts input of description data for each object by the user together with the object data type.

The library generation unit 211 is preferably configured to analyze the object data received from the user terminal, compress the data volume, and store it as a data library.

As a result, the data capacity of the data library is reduced, and the time required for the user to receive the data library from the node 20 is shortened, thereby alleviating inconvenience when the user receives more data libraries. can be done.

The library distribution unit 212 distributes all or part of the node data library 221 in the node storage unit 220 to the user terminal 10 via the node communication unit 200 . The library distribution unit 212 receives, for example, a data library distribution request from the user terminal 10 and distributes the data library to the user terminal.

In this way, the data library is classified by object type at the node and distributed, and the user can select, receive, and store only the data library for the object type that the user is interested in, and store it in the user terminal. Therefore, since the amount of data in the terminal storage can be minimized, the process of acquiring the explanation data from the terminal storage can be performed efficiently.

Therefore, the user can minimize the time from recognizing an object on the user terminal to superimposing and displaying the image of the object and information related to the object on the screen of the user terminal. Convenient.

The remuneration data generation unit 213 generates distribution cost data indicating the distribution cost of the data library to the user who received the distribution of the data library, and identifies the user who transmitted the object data included in the distributed data library. , distributes all or part of the distribution fee, generates distribution reward data indicating a reward for the user, and stores the distribution reward data in the node storage unit 220 .

As a result, when a data library containing the object data is distributed to the user, the user who has transmitted the object data to the node can pay all or part of the distribution costs borne by the user who received the distribution of the data library. The object data contained in the data library can be distributed among the users who have sent it and received as a reward.

Therefore, users are motivated to generate and transmit object data to nodes for objects that they are interested in and want other users to be interested in, or objects that the user thinks other users will be interested in. Displaying sufficient information related to objects of interest to users as a result of enhanced likelihood that sufficient information related to the objects of interest to each user will be stored in the nodes. Therefore, the user does not feel inconvenient.

The blockchain unit 214 generates block data based on the distribution cost data and the distribution reward data each time a certain number of distribution cost data and distribution reward data is generated, adds the block data to the block chain, and adds the block data to the block chain. The chain is distributed and managed with other nodes 20.

As a result, falsification of distribution cost data and distribution reward data can be easily prevented, and a user who has transmitted object data to the node 20 can receive a reward when a data library containing the object data is distributed to the user. There is greater certainty that object data can be generated and the motivation to generate and transmit object data to node 20 is increased.

The node storage unit 220 is configured by a storage device such as a ROM (Read Only Memory), a RAM (Random Access Memory), and an HDD (Hard Disk Drive).

The node storage unit 220 stores a node data library 221, a user DB 222, a type DB 223, a block DB 224, a processing result of the node control unit 210, or data received by the node control unit 210 from the user terminal 10 via the node communication unit 200. is configured to store

The node data library 221 is a data library stored in the node 20 and stores all physical data received from the user terminal 10 .

The user DB 222 is a database that stores user IDs for specifying users of the AR library system.

The type DB 223 is a database that stores a type code for specifying the type of each object data included in the node data library 221 .

The block DB 224 is a database that stores a block chain composed of block data generated by the block chain unit 214 .

Next, the flow of processing by the AR library system according to one embodiment of the present invention will be described with reference to FIGS. 2A to 2C.

(data library generation processing)
FIG. 2A is a flowchart illustrating data library generation processing, which is a series of processing for generating a data library by the AR library system according to one embodiment of the present invention.

First, the appearance data generation unit 141 of the terminal input unit 110 records the appearance of the object through the camera unit 100 according to the user's operation (FIG. 2A/STEP 10).

When recording the appearance of an object, the appearance data generation unit 141 receives input of object designation information, which is information specifying an object for which the user wishes to generate appearance data.

For example, when the user terminal 10 is a smart phone or a tablet, the user traces the area where the object for which the user wishes to generate appearance data is displayed on the terminal display unit 120 with a finger, as shown in FIG. For example, the appearance data generation unit 141 starts processing for accepting input of object designation information.

The appearance data generation unit 141 recognizes an object within a range traced by the user's finger as an object for which the user wishes to generate appearance data, and records the appearance of the object.

Even if the user tilts or moves the user terminal in order to record the appearance of the object from various directions such as front, rear, upward, downward, oblique, etc., the external appearance data generation unit 141 As long as the object is within the range where the can recognize the position of the object, it will recognize the position of the object and follow it, and will continue to record the appearance of the object.

Then, the appearance data generation unit 141 generates appearance data of the object based on the recorded appearance of the object (FIG. 2A/STEP 20).

Appearance data generation unit 141 finishes creating the appearance data of the object when the user touches a recording end button or the like displayed in terminal display unit 120, for example.

Next, the object data generator 142 displays on the terminal display unit 120 a display prompting the user to input description data of the object, and accepts input of the description data by the user via the terminal input unit 110 (FIG. 2A). / STEP 30).

The object data generation unit 142 accepts input of character information such as "red sports car", "soy sauce dispenser", and "bamboo ruler" as description data. In addition to or instead of character information, input of still images, moving images, voices, etc. may be accepted.

In addition, the object data generation unit 142 receives input of information regarding the type of object as explanation data. For example, if the object is a ``red sports car'', the information about the type is ``car'' or ``sports car''; If it is a ruler, it is "stationery". Note that there may be only one piece of information about the type of object, or a plurality of pieces of information.

For example, the object data generation unit 142 periodically refers to the type DB of the node 20, acquires a list of types, stores it in the terminal storage unit 150, and when prompting the user to input description data of the object, generates the It is configured to display a list of types of objects to the user and allow the user to select from the list.

Then, the object data generation unit 142 generates object data, which is data in which the appearance data of the object and the description data are associated (FIG. 2A/STEP 40). Note that the object data includes the user ID of the user in addition to the appearance data and the description data of the object.

After that, the object data generator 142 transmits the object data to the node 20 (FIG. 2A/STEP 50).

The library generator 211 of the node 20 receives the object data transmitted by the user terminal 10 (FIG. 2A/STEP 100). Then, the library generation unit 211 classifies the object data received from the user terminal according to the type of the object data, stores them in the node storage unit 220 as the node data library 221 (FIG. 2A/STEP 110), and ends the processing. .

Note that the library generation unit 211 periodically repeats the process of accumulating the object data received from the user terminal 10 in the node storage unit 220 as a node data library (for example, every minute. The length of time can be changed as appropriate). be.).

The library generation unit 211 determines the type of object data based on information about the type of object included in the description data in the object data, and classifies the object data according to the information.

(data library delivery processing)
FIG. 2B is a flowchart illustrating data library distribution processing, which is a series of processing for distributing the data library by the AR library system according to one embodiment of the present invention.

The user terminal 10 transmits a data library distribution request to the node 20 based on the user's operation (FIG. 2B/STEP 200).

When the user terminal 10 transmits a data library distribution request to the node 20, the user terminal 10 accepts input of the type of object data that the user wishes to distribute, and transmits information about the type in the distribution request to be transmitted to the node 20. do. Note that the information regarding the type may be one for one distribution request, may be plural, or may be all types.

The node 20 library distribution unit 212 receives a data library distribution request from the user terminal 10 (FIG. 2B/STEP 300).

Upon receiving the data library distribution request, the library distribution unit 212 recognizes the type of object data that the user wishes to distribute from the distribution request, Object data of a desired type to be distributed is extracted, and a data library containing the extracted object data is generated (FIG. 2B/STEP 310).

The remuneration data generation unit 213 of the node 20 generates distribution cost data indicating the distribution cost for the user who receives the distribution of the data library (FIG. 2B/STEP 320).

The amount of distribution cost included in the distribution cost data may be varied according to the number of object data included in the data library, or may be a fixed amount. The user pays the delivery cost with currency, points that can be used within the AR library system, and the like.

The remuneration data generation unit 213 may transmit the distribution cost data for each user to the user each time the library distribution unit 212 distributes the data library, or aggregate the distribution cost data for a certain period of time (such as one month). may be sent to the user as

Then, the remuneration data generating unit 213 of the node 20 distributes all or part of the distribution cost of the distributed data library and generates distribution remuneration data indicating a remuneration for the user who transmitted the object data included in the distributed data library. Generate (FIG. 2B/STEP 330).

The remuneration data generation unit 213 first acquires a user ID in each piece of object data included in the distributed data library, and tallies the number of pieces of object data included in the distributed data library for each user.

Then, the remuneration data generation unit 213 distributes all or part of the distribution cost of the distributed data library according to the ratio of the object data for each user, and distributes the object data contained in the distributed data library to the user generate delivery reward data that indicates the reward for

The remuneration data generation unit 213 may transmit the distribution remuneration data for each user to the user each time the library distribution unit 212 distributes the data library, or aggregate the distribution remuneration data for a certain period of time (such as one month). may be sent to the user as

Next, the blockchain unit 214 determines whether a certain number of delivery cost data and delivery reward data have been generated (FIG. 2B/STEP 340).

If a certain number of distribution cost data and distribution reward data have been generated (FIG. 2B/STEP 340: YES), the blockchain unit 214 generates block data based on the distribution cost data and the distribution reward data, Add the block data to the blockchain (FIG. 2B/STEP 350).

The block chain unit 214 then transmits the block data to another node 20 (FIG. 2B/STEP 360).

Also, when block data is received from another node 20, the block chain unit 214 adds the block data to the block chain. Thereby, the blockchain unit 214 distributes and manages the other nodes 20 and the blockchain.

If a certain number of distribution cost data and distribution reward data have not been generated (FIG. 2B/STEP340: NO), the blockchain unit 214 does not perform STEP350 and STEP360.

Then, the library distribution unit 212 of the node 20 distributes the data library generated in STEP310 to the user terminal 10 that transmitted the distribution request (FIG. 2B/STEP370).

The user terminal 10 receives the data library distributed by the library distribution unit 212 of the node 20, stores it in the terminal storage unit 150 (FIG. 2B/STEP 400), and ends the process.

(Description data display processing)
FIG. 2C is a flowchart for explaining explanation data display processing, which is a series of processes for displaying explanation data related to articles to the user by the AR library system according to one embodiment of the present invention.

The terminal control unit 140 reads a predetermined program in response to the user's operation on the terminal input unit 110, starts functioning as the video generation unit 143, and recognizes the appearance of the object via the camera unit 100 (Fig. 2C/STEP500).

Note that the video generation unit 143 repeatedly executes the processing of STEP500 to STEP540 at very short time intervals.

The video generation unit 143 refers to the data library 151 stored in the terminal storage unit 150, and determines whether appearance data matching the appearance of the recognized object exists in the data library 151 based on the appearance of the recognized object. (FIG. 2C/STEP 510).

If appearance data matching the appearance does not exist in the data library 151 (FIG. 2C/STEP 510: NO), the video generation unit 143 repeats the processing from STEP 500 without executing subsequent processing.

If appearance data that matches the appearance exists in the data library 151 (FIG. 2C/STEP 510: YES), the video generation unit 143 acquires explanatory data associated with the appearance data from the data library 151 (FIG. 2C/ STEP 520).

It should be noted that "matching the appearance" does not necessarily mean that the appearance matches completely. may be determined to exist.

If there are a plurality of pieces of appearance data with a certain degree of matching or more, the video generation unit 143 may select the one with the highest degree of matching to acquire the explanation data, or may select all of them. Data may be acquired.

Then, using the data acquired in STEP 520, the image generation unit 143 generates an image in which the description data is superimposed on the image of each object included in the image captured by the camera unit 100, For example, in the format shown in FIG. 4, it is displayed on the terminal display unit 120 (FIG. 2C/STEP 530).

As described above, the video generation unit 143 repeatedly executes the explanation data display process at very short time intervals. 143 recognizes and follows the position of the object as long as the object is within the range where the position of the object can be recognized, generates an image in which the explanation data is superimposed on the image of each object, and displays the terminal display unit Continue to display at 120.

Then, the video generation unit 143 determines whether or not the user has performed an operation to end the process (FIG. 2C/STEP 540).

If the user has not performed an operation to end processing (FIG. 2C/STEP 540: NO), the video generation unit 143 repeats the processing from STEP 500 onwards. On the other hand, if the user has performed an operation to end the process (FIG. 2C/STEP 540: YES), the video generator 143 ends the process.

The present invention is not limited to the above-described embodiments, and various modified embodiments are possible within the scope of the present invention, and such embodiments are also included in the scope of the present invention.

DESCRIPTION OF SYMBOLS 10... User terminal, 20... Node, 30... Communication network, 100... Camera part, 110... Terminal input part, 120... Terminal display part, 130... Terminal communication part, 140... Terminal control part, 141... Appearance data generation part, DESCRIPTION OF SYMBOLS 142... Object data generation part 143... Video generation part 150... Terminal storage part 151... Data library 152... User ID 200... Node communication part 210... Node control part 211... Library generation part 212... Library Distribution unit 213 Reward data generation unit 214 Block chain unit 220 Node storage unit 221 Node data library 222 User DB 223 Class DB 224 Block DB

Claims (4)

An AR library system comprising a plurality of user terminals for recognizing the appearance of an object and outputting descriptive data, which is data describing the object based on the appearance of the object, and one or more nodes communicating with the plurality of user terminals. and
The user terminal is
a camera unit that captures the appearance of the object;
an appearance data generation unit that recognizes the appearance of the object through the camera unit and generates appearance data that is data relating to the appearance of the object;
An object that receives an input of the description data about the object by a user, generates object data that is data that associates the appearance data of the object, the description data, and user identification information of the user, and transmits the object data to the node. a data generator;
a terminal storage unit that receives and stores a data library that is an aggregate of the object data distributed by the node;
Based on the appearance of the object captured by the camera, the explanation data associated with the appearance data matching the appearance of the object is acquired from the terminal storage, and the image captured by the camera. an image generation unit that generates and outputs an image in which the description data is superimposed on the image of the object included in
The node is
a library generating unit that classifies the object data received from the user terminal according to the type of the object data and stores them as the data library;
a library distribution unit that distributes the data library to the user terminal;
generating distribution cost data indicating a distribution cost for the user who received the distribution of the data library, and obtaining the user identification information from each of the object data included in the distributed data library; identifying each user who transmitted each piece of object data contained in the data library, counting the number of pieces of object data contained in the distributed data library for each user, and counting the number of pieces of object data for each user; Proportional distribution of all or part of the distribution cost to generate distribution reward data indicating a reward for each of the one or more users who transmitted the object data contained in the distributed data library. An AR library system, comprising: a remuneration data generation unit. In the AR library system according to claim 1,
said node is plural,
generating block data based on the distribution cost data and the distribution reward data each time a certain number of the distribution cost data and the distribution reward data are generated; An AR library system characterized by comprising a node and a block chain unit for distributed management. In the AR library system according to claim 1 or 2,
The AR library system, wherein the library generator analyzes the object data received from the user terminal, compresses the data volume, and stores the data as the data library. In the AR library system according to any one of claims 1 to 3,
The video generation unit obtains, from the terminal storage unit, each description data associated with each appearance data that matches each of the appearances of the plurality of objects, based on the appearances of the plurality of objects captured by the camera unit. 1. An AR library system configured to generate and output an image in which each description data is superimposed on each image of each object contained in an image picked up by the camera unit.

Images