JPWO2019111811A1 - Object management system, object management method and object management program - Google Patents

Abstract

To identify the ownership of an object with a simple operation without including personal information. A registration unit that registers a point identifier extracted from a point written on an object with a writing tool and possession information of the object in association with each other, an imaging unit that captures a point, and a point identifier extracted from a point captured by the imaging unit. , A collation unit that collates the point identifier registered in the registration unit, and a distribution management unit that manages the distribution of the object based on the possession information of the object when the point identifiers match.

Description

The present invention relates to a technique for managing an object and the like.

In the above technical field, patent document 1 is lost by attaching a sticker having a member number unique to the member's belongings, registering it in the co-sponsored information center, and collating it with the member number of the sticker attached to the found item. The technology for discovering things is disclosed. Further, in Patent Document 2, a tag is attached to the property, the property is registered in the management server in association with the owner's e-mail address, and the owner is notified of the storage location of the lost property according to the tag number of the lost property. The technology to be used is disclosed.

Japanese Unexamined Patent Publication No. 2004-272886 Japanese Unexamined Patent Publication No. 2008-210197

However, in the technique described in the above document, complicated work is required for the sticker sticking operation and the tag attaching operation, and there is a possibility that personal information may be included in the sticker or tag.

An object of the present invention is to provide a technique for solving the above-mentioned problems.

In order to achieve the above object, the object management system according to one aspect of the present invention includes a registration means for registering a point identifier extracted from a point described by a writing tool on an object and possession information of the object in association with each other. When the image pickup means for imaging a point, the matching means for collating the point identifier extracted from the point imaged by the image pickup means with the point identifier registered in the registration means, and the point identifier match, the above-mentioned A distribution management means for managing the distribution of the object based on the possession information of the object is provided.

In order to achieve the above object, in the object management method according to one aspect of the present invention, a point identifier extracted from a point described by a writing tool on an object is registered in a memory in association with the possession information of the object, and the point is registered. Is collated with the imaging step of imaging with the imaging device, the point identifier extracted from the points captured by the imaging device, and the point identifier registered in the memory, and when the point identifiers match, the object The distribution of the object is managed based on the possession information.

In order to achieve the above object, the object management program according to one aspect of the present invention includes a registration process of associating a point identifier extracted from a point described with a writing tool on an object with possession information of the object and registering the object in a memory. , The collation process for collating the point identifier extracted from the points captured by the imaging means with the point identifier registered in the memory, and when the point identifiers match, the object is based on the possession information of the object. Let the computer execute the distribution management process that manages the distribution of.

In order to achieve the above object, the information processing apparatus according to one aspect of the present invention includes a registration means for registering a point identifier extracted from a point described by a writing tool on an object in association with the possession information of the object, and imaging. When the first receiving means for receiving the point identifier extracted from the point imaged by the means, the collating means for collating the received point identifier with the registered point identifier, and the point identifier match. , A distribution management means for managing the distribution of the object based on the possession information of the object.

In order to achieve the above object, in the information processing method according to one aspect of the present invention, a point identifier extracted from a point described by a writing tool on an object is registered in a registration means in association with the possession information of the object, and imaging is performed. The point identifier extracted from the point imaged by the means is received, the received point identifier is collated with the registered point identifier, and when the point identifier matches, it is based on the possession information of the object. To manage the distribution of the object.

In order to achieve the above object, the information processing program according to one aspect of the present invention is a registration process for registering a point identifier extracted from a point described by a writing tool on an object and possession information of the object in a registration means. The first reception process of receiving the point identifier extracted from the point imaged by the imaging means, the collation process of collating the received point identifier with the registered point identifier, and the point identifier match. In this case, the computer is made to execute the distribution management process for managing the distribution of the object based on the possession information of the object.

In order to achieve the above object, the communication terminal according to one aspect of the present invention processes a point identifier acquisition means for acquiring a first point identifier extracted from a point described on an object with a writing tool and information processing of the first point identifier. The second point notified from the information processing device when the point identifier transmitting means to be transmitted to the device and the second point identifier matching the first point identifier are registered in the registration means of the information processing device. It includes possession information receiving means for receiving possession information regarding possession of the object associated with an identifier, and notification means for notifying the delivery destination of the object based on the received possession information.

In order to achieve the above object, the communication terminal control method according to one aspect of the present invention acquires a first point identifier extracted from a point described on an object with a writing tool, and transmits the first point identifier to an information processing apparatus. Then, when a second point identifier matching the first point identifier is registered in the registration means of the information processing device, the object associated with the second point identifier is notified from the information processing device. The possession information regarding the possession of the object is received, and the delivery destination of the object is notified based on the received possession information.

In order to achieve the above object, the application program of the communication terminal according to one aspect of the present invention includes a point identifier acquisition process for acquiring a first point identifier extracted from a point described on an object with a writing tool, and the first point identifier. Is notified from the information processing device when the point identifier transmission process for transmitting the information to the information processing device and the second point identifier matching the first point identifier are registered in the registration means of the information processing device. The computer is made to execute the possession information receiving process for receiving the possession information related to the possession of the object associated with the second point identifier and the notification process for notifying the delivery destination of the object based on the received possession information. ..

One aspect of the present invention is also realized by the above-mentioned storage medium for storing the object management program, the information processing program, or the application program of the communication terminal.

According to the present invention, the possession of an object can be specified by a simple operation without including personal information.

It is a block diagram which shows the structure of the object management system which concerns on 1st Embodiment of this invention. It is a figure which shows the social model using the object management system which concerns on 2nd Embodiment of this invention. It is a figure which shows the outline of possession information registration of the object management system which concerns on 2nd Embodiment of this invention. It is a figure which shows the outline of the possession information notification of the object management system which concerns on 2nd Embodiment of this invention. It is a figure which shows the method of generating the point which can extract the point feature amount which becomes the point identifier used in the object management system which concerns on 2nd Embodiment of this invention. It is a sequence diagram which shows the procedure of the possession information registration operation of the object management system which concerns on 2nd Embodiment of this invention. It is a sequence diagram which shows the procedure of the possession information notification operation of the object management system which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the functional structure of the object management server as an information processing apparatus which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the functional structure of the point identifier acquisition part in the object management server which concerns on 2nd Embodiment of this invention. It is a figure which shows the structure of the object management database which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the functional structure of the sales management apparatus which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the functional structure of the point identifier acquisition part in the sales management apparatus which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the functional structure of the found property management apparatus which concerns on 2nd Embodiment of this invention. It is a block diagram which shows an example of the functional structure of the point identifier extraction part which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the procedure of an example of the point identifier extraction processing which concerns on 2nd Embodiment of this invention. It is a block diagram which shows an example of the functional structure of the coordinate determination part which concerns on 2nd Embodiment of this invention. It is a schematic diagram for demonstrating the operation of the coordinate determination part which concerns on 2nd Embodiment of this invention. It is a block diagram which shows another example of the functional structure of the coordinate determination part which concerns on 2nd Embodiment of this invention. It is a schematic diagram for demonstrating the operation of the coordinate determination part which concerns on 2nd Embodiment of this invention. It is a schematic diagram for demonstrating the operation of the normalized image generation part which concerns on 2nd Embodiment of this invention. It is a schematic diagram for demonstrating the operation of the fixed area determination part which concerns on 2nd Embodiment of this invention. It is a block diagram which shows another example of the functional structure of the point identifier extraction part which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the procedure of another example of the point identifier extraction processing which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the other example of the functional structure of the point identifier extraction part which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the procedure of still another example of the point identifier extraction processing which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the hardware structure of the object management server as an information processing apparatus which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the processing procedure of the object management server as an information processing apparatus which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the hardware structure of the sales management apparatus which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the processing procedure of the sales management apparatus which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the hardware structure of the found-and-found thing management apparatus which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the processing procedure of the found property management apparatus which concerns on 2nd Embodiment of this invention. It is a sequence diagram which shows the procedure of the possession information notification operation of the object management system which concerns on 3rd Embodiment of this invention. It is a figure which shows the social model using the object management system which concerns on 4th Embodiment of this invention. It is a figure which shows the outline of the object management system which concerns on 4th Embodiment of this invention. It is a sequence diagram which shows the procedure of the possession information registration operation of the object management system which concerns on 4th Embodiment of this invention. It is a sequence diagram which shows the procedure of the possession information update operation of the object management system which concerns on 4th Embodiment of this invention. It is a sequence diagram which shows the procedure of the possession information notification operation of the object management system which concerns on 4th Embodiment of this invention. It is a block diagram which shows the functional structure of the smartphone as a mobile terminal which concerns on 4th Embodiment of this invention. It is a block diagram which shows the hardware structure of the smartphone as a mobile terminal which concerns on 4th Embodiment of this invention. It is a flowchart which shows the processing procedure of the smartphone as a mobile terminal which concerns on 4th Embodiment of this invention. It is a figure which shows the social model using the object management system which concerns on 5th Embodiment of this invention. It is a sequence diagram which shows the procedure of the point management operation of the object management system which concerns on 5th Embodiment of this invention. It is a block diagram which shows the functional structure of the object management server as an information processing apparatus which concerns on 5th Embodiment of this invention. It is a figure which shows the structure of the point management database which concerns on 5th Embodiment of this invention. It is a block diagram which shows the hardware structure of the object management server as an information processing apparatus which concerns on 5th Embodiment of this invention. It is a flowchart which shows the procedure of the point management processing of the object management server as an information processing apparatus which concerns on 5th Embodiment of this invention.

Hereinafter, embodiments of the present invention will be described in detail exemplarily with reference to the drawings. However, the components described in the following embodiments are merely examples, and the technical scope of the present invention is not limited to them.

[First Embodiment]
The object management system 100 as the first embodiment of the present invention will be described with reference to FIG. The object management system 100 is a system that manages the distribution of objects.

As shown in FIG. 1, the object management system 100 includes a registration unit 101, an imaging unit 102, a collation unit 103, and a distribution management unit 104. The registration unit 101 registers the point identifier 111 extracted from the point 121 described by the writing instrument on the object 120 in association with the possession information 112 of the object 120. The imaging unit 102 images the point 121. The collation unit 103 collates the point identifier extracted from the point 121 imaged by the image pickup unit 102 with the point identifier 111 registered in the registration unit 101. The distribution management unit 104 manages the distribution of the object 120 based on the possession information 141 of the object 120 when the point identifiers match.

According to the present embodiment, since the possession of the object can be specified by a simple operation without including personal information, the distribution of the object can be efficiently managed.

[Second Embodiment]
Next, the object management system according to the second embodiment of the present invention will be described. The object management system according to the present embodiment associates the possession information of the owner who purchased the sold object with the point identifier described in the writing tool on the object at the time of selling the object and puts it in the object management database of the object management server. to register. In addition, the ownership information includes information on the owner, delivery address information when the object is lost, and ownership information indicating that the ownership of the object is relinquished when the object is lost. Then, the point identifier of the point described in the object of the found item found by the founder is acquired and collated with the point identifier registered in the object management database. If the point identifier of the found item matches the point identifier registered by the purchaser, the found object will be returned to the owner, delivered to the destination, or if the ownership has been relinquished, the founder or The handler who handles the found item disposes of the found item at his / her own discretion. As the point identifier, the fine grain distribution of points is used in the present embodiment, but the point identifier is not limited to this. Further, the point identifiers may be determined to match if the difference is within a predetermined threshold value.

《Object management system》
The configuration and operation of the object management system according to the present embodiment will be described with reference to FIGS. 2A to 3B.

(Social model)
FIG. 2A is a diagram showing a social model using the object management system 200 according to the present embodiment. In FIG. 2A, an umbrella or a bicycle will be described as an example of an object whose distribution is controlled, but the object is not limited thereto.

In the object management system 200, the object 201 as a product is sold at the object store 210 (sales base) and becomes the property of the owner. At this time, the point 202 described in advance with the writing instrument on the sold object 201 or the point 202 described with the writing instrument at the time of sale is imaged by an magnifying image pickup unit (camera), and each of the point images is taken. Extract the point identifier unique to the object. Then, the ownership information regarding the ownership of the sold object 201 is registered in association with the extracted point identifier. Ownership information includes information that identifies the owner, including contact information, information that identifies the destination if the object is found, information on whether or not the owner relinquishes ownership if the object is lost, Etc. are included. In addition, in the information for specifying the delivery destination, the donation destination, public facilities, manufacturers and distributors, recyclers and rental companies, and the like are specified.

If the owner loses the object 201 and the founder 290 finds it, the found item is brought to the found item handling office 230. At the found item handling office 230, a point described in the found item is imaged by an magnifying image pickup unit (camera), and a point identifier unique to each found item is extracted from the point image. Then, the point identifier extracted from the found item is collated with the point identifier registered at the time of sale, and if the point identifier matches, the possession information corresponding to the found item is notified. The found item handling office 230 determines the subsequent distribution process of the found item in response to the notified possession information of the found item. For example, as the destination 250 of the found item, if the ownership is not relinquished, it is delivered to the owner 251 based on the information that identifies the owner, and if the ownership is relinquished and the destination is specified, the destination (for example, the donation destination 252). ~ Delivered to either a recycler or a rental company 255). In addition, if the ownership is abandoned and the delivery address is not specified, the use of the founder is permitted (256), and if the ownership is not abandoned but the owner or delivery address is not specified, or the point identifier cannot be extracted. In that case, it is stored in the found item storage 240. Then, when the storage period of the found item storage 240 has expired, it is handed over to the founder or discarded (260).

Further, when the object that has reached the delivery destination 250 is lost again, the circulation of the object after the discovery by the finder 290 is realized as an efficient distribution of the object by the point identifier. That is, it is possible to connect a small amount of resources to a share society in which a small amount of resources can be effectively used by circulating goods without delay due to storage at the found item storage 240. In addition, by setting different transfer destinations for the objects found again, it is possible to carry out a variety of circulation. In this way, since the possession of the object can be specified by a simple operation without including personal information, the distribution of the object can be efficiently managed.

(Overview)
FIG. 2B is a diagram showing an outline of ownership information registration of the object management system 200 according to the present embodiment. Although the processing at one sales base will be described in FIG. 2B, the same processing is executed at a plurality of sales bases of the object management system 200. In addition, as an object sold, a folding umbrella in which dots are marked with a writing instrument will be described as an example.

The object management system 200 at the time of registration of possession information includes a sales management device 210 at a sales base and an object management server 220 as an information processing device. The reference number of the sales management device 210 is the same as that of the object store 210 (sales base) for simplification of the explanation. The sales management device 210 includes a sales management terminal 211 and a point image imaging unit 212 which is a high-resolution camera or a microscope camera.

In the sales management terminal 211, the point 202 described in the folding umbrella 201, which is a sold object, is read by the point image capturing unit 212, which is a high-resolution camera or a microscope camera. Then, the possession information related to the possession of these sold objects is set in association with the point identifier extracted from the point image, and is registered in the object management database 221 of the object management server 220.

For example, as the ownership information, whether or not the ownership is abandoned when the property is lost and found is input and registered from the screen 213 of the sales management terminal 211. Then, when the ownership maintenance is set, the contact data of the owner is input and registered from the screen 214 as the ownership information. Further, when the ownership waiver is set, the delivery address is specified and registered from the screen 215 as the ownership information.

It should be noted that the input of these possession information is read and registered from the IC (Integrated Circuit) card for payment held by the owner (purchaser), which simplifies the operation and conceals personal information. Is desirable.

FIG. 2C is a diagram showing an outline of possession information notification of the object management system 200 according to the present embodiment. Although the processing at one found item handling office will be described in FIG. 2C, the same processing is executed at a plurality of found item handling offices of the object management system 200. Further, as the found object, a folding umbrella in which dots are described with the same writing instrument as in FIG. 2B will be described as an example.

The object management system 200 at the time of notification of possession information includes a found item management device 230 at a found item handling office and an object management server 220 as an information processing device. The reference number of the found item management device 230 is the same as that of the found item handling office 230 for the sake of simplicity. The found item management device 230 includes a found item management terminal 231 and a point image capturing unit 232 which is a high-resolution camera or a microscope camera.

In the found item management terminal 231, the point 202 described in the folding umbrella 201 which is the found item is read by the point image imaging unit 232 which is a high-resolution camera or a microscope camera, and is associated with the point identifier extracted from the point image. , This point identifier is transmitted to the object management server 220. The object management server 220 collates the point identifier received from the found item management terminal 231 with the point identifier registered in the object management database 221. Then, if the received point identifier and the registered point identifier match, the possession information registered in association with the point identifier in the object management database 221 is read out and transmitted to the found item management terminal 231. ..

For example, on the screen 233 of the found item management terminal 231, the name and type of the object that matches the point identifier is displayed, and the collation result is confirmed. Then, based on the ownership information associated with the found item, the contact information of the owner is displayed on the screen 234 when there is a contact for maintaining the ownership, and on the screen 233 when there is no contact for maintaining the ownership. The found item storage is displayed as the storage location, and waits for the discovery of the lost person. On the other hand, if there is a delivery address due to the waiver of ownership, the delivery address is displayed on the screen 236, and if there is no delivery address due to the waiver of ownership, the screen 237 indicates that the founder may use it.

Note that the display examples in FIG. 2C are only a few examples, and the distribution process based on the possession information registered in association with the object is not limited to this. In addition, it is desirable that the personal information displayed on the screen of the found item management terminal 231 be kept secret.

(Point identifier extraction method)
FIG. 2D is a diagram showing a method of generating points that can extract point features that serve as point identifiers, which is used in the object management system 200 according to the present embodiment.

The upper figure of FIG. 2D is a schematic view of a state in which a point is drawn on an object (property) with a writing instrument in the present embodiment. The dimensional relationship of each element is not accurate. The object (property) is a folding umbrella 201. A point 202 containing fine grains 203 is described by a writing instrument 260 at an arbitrary surface position of the folding umbrella 201. The writing instrument 260 is filled with ink 261 containing fine particles 203. The medium on which the dots are described is not limited to ink. It may be a solid pencil lead or ink.

Point 202 described at an arbitrary surface position of the folding umbrella 201 contains minute grains 203 at random positions. As the fine particles 203, fine particles such as metal powder and glass powder, tagan, and the like can be used. It is desirable that the fine grains 203 are grains having different reflection characteristics from the material (excluding the fine grains 203) constituting the point 202. Further, it is desirable that the fine grains 203 are non-uniformly contained at the point 202. That is, it is desirable that the distribution of the fine grains 203 at the point 202 is non-uniform. Further, the planar shape of the point 202 is an indefinite shape. The planar shape of the point 202 is a shape seen from directly above the point 202. Such a point 202 is formed, for example, by dropping only one drop of printing ink, paint, or the like mixed with minute particles 203 onto the surface of an object using a writing instrument 260 such as a pen and solidifying it. Can be done. However, the method for forming the point 202 is not limited to such a method, and any other method such as applying a printing ink or paint mixed with fine particles 203 with a brush or the like may be used.

The lower part of FIG. 2D is a diagram showing an example of a method of describing a point from which a point identifier can be extracted and a method of extracting a point identifier with a writing instrument on an object (property) in this embodiment. The method of describing points from which point identifiers can be extracted is not limited to FIG. 2D.

Examples of the point description material 271 include a material containing fine particles, a material characterized by surface reflection and a color pattern, a material through which the pattern of the medium (paper) is transmitted, and a material in which bleeding occurs on the medium (paper). .. The limitation of the point description medium 272, the difference in the point imaging method 273, and the feature amount extraction method 274 of the point image as the point identifier are as shown in the figure. Hereinafter, in the present embodiment, as a material capable of describing points on which a point identifier can be extracted on a wide range of media, the imaging unit is portable, the captured image is stable, and an identifiable point identifier can be easily extracted. Use a material containing fine particles. However, the material of the point, the method of describing the point, the method of imaging the point, and the method of extracting the point identifier are not limited to this, and may be those described in FIG. 2B or other methods.

(Operation sequence)
FIG. 3A is a sequence diagram showing a procedure of possession information registration operation of the object management system 200 according to the present embodiment. In FIG. 3A, a point at which a point identifier can be extracted is given at a manufacturing site (manufacturing factory) of the object or a delivery place in distribution before the sale of the object, or a point at which the point identifier can be extracted is given at the time of selling the object. It is an operation sequence of the object management system 200.

In preparation for the operation of the object management system 200, in step S301, points that can extract point identifiers are added to the object. Then, in step S303, the object to which the point from which the point identifier can be extracted is given is shipped as a product.

The registration of ownership information at the time of sale will be described. In step S311 the POS (point of sale system) terminal 211 as a sales management terminal included in the sales management device 210 performs a settlement process for an object to which a point from which a point identifier can be extracted is assigned. Then, in step S313, the point image for extracting the point identifier is acquired by the camera as the connected point image imaging unit 212. The POS terminal 211 extracts the point identifier from the acquired point image in step S315. Then, in step S317, the POS terminal 211 acquires the possession information of the sold object as a response to the inquiry to the owner (purchaser). In step S319, the POS terminal 211 associates the generated point identifier with the possession information and transmits the generated point identifier to the object management server 220. In step S321, the object management server 220 associates the received point identifier with the possession information and registers it in the object management database 221. Then, upon receiving the notification of the registration completion from the object management server 220, the POS terminal 211 reports the registration completion of the possession information in step S323.

When describing a point on an object at the time of sale, in step S310, a point from which a point identifier can be extracted is added to the object. When the POS terminal 211 does not have the function of extracting the point identifier from the point image, the object management server 220 extracts the point identifier from the point image received from the POS terminal 211 in step S325.

FIG. 3B is a sequence diagram showing a procedure of possession information notification operation of the object management system 200 according to the present embodiment. FIG. 3B is an operation sequence of the object management system 200 for notifying the possession information corresponding to the found item when the lost item is found and delivered to the found item handling office.

In step S341, the found item management terminal 231 included in the found item management device 230 acquires a point image for extracting a point identifier by a camera as a connected point image imaging unit 232. In step S343, the found item management terminal 231 extracts a point identifier from the acquired point image. Then, in step S345, the found item management terminal 231 transmits the generated point identifier to the object management server 220. In step S347, the object management server 220 collates the point identifiers with reference to the object management database 221 and acquires the correspondingly registered possession information from the object management database 221 if there is a matching point identifier. The point identifiers may be determined to match if the difference is within a predetermined threshold. In step S349, the object management server 220 transmits the possession information to the found item management terminal 231 included in the found item management device 230. In step S351, the found item management terminal 231 notifies the operator of the found item handling office of the possession information. In step S353, the object management server 220 updates the object management database 221 upon receiving a notification from the found item management terminal 231 that the handling instruction for the found item has been completed. For example, the registered point identifier is deleted, or the possession information corresponding to the point identifier is updated.

When reducing the load on the sales management device 210 and the found item management device 230, the object management server 220 may be configured to extract the point identifier. In that case, the object management server 220 is the found item management terminal in step S355. The point identifier is extracted from the point image transmitted from 231.

In this way, the owner or the founder of the found item handling office, for example, delivers the found item whose ownership is not relinquished to the owner (purchaser), or delivers the found item whose ownership has been relinquished. You can deliver it to a designated destination without storing it in the found item storage, or you can decide to dispose of it yourself.

《Object management server》
FIG. 4A is a block diagram showing a functional configuration of an object management server 220 as an information processing device according to the present embodiment.

The object management server 220 includes a communication control unit 401, a sales information receiving unit 402, a sales information registration unit 403, an object management database 221, a found information receiving unit 404, a point identifier collating unit 405, and an possession information acquisition unit. It includes a 406 and an possession information transmission unit 407.

The communication control unit 401 controls communication between the sales management device 210 and the found item management device 230 via the network. The sales information receiving unit 402 acquires the point identifier acquisition unit 421 that acquires the point identifier transmitted from the sales management device 210 at the time of sale, and the ownership information corresponding to the object transmitted from the sales management device 210 at the time of sale. It has a possession information acquisition unit 422. The sales information registration unit 403 registers the point identifier received by the sales information reception unit 402 with the possession information in the object management database 221. The object management database 221 registers the point identifier and the possession information in association with each other, and the registered data is used for acquiring the possession information of the found item.

The found information receiving unit 404 has a point identifier acquisition unit 441, and receives a point identifier transmitted from the found item management device 230 at the time of found item management. The point identifier collation unit 405 collates the point identifier received by the found information receiving unit 404 with the point identifier registered in the object management database 221. Then, if there is a matching point identifier from the collation result of the point identifier collation unit 405, the possession information acquisition unit 406 acquires the possession information corresponding to the object having the point identifier transmitted from the found object management device 230. The point identifiers may be determined to match if the difference is within a predetermined threshold. The possession information transmission unit 407 transmits the possession information corresponding to the object having the point identifier transmitted from the found item management device 230 to the found item management device 230.

(Point identifier acquisition section)
FIG. 4B is a block diagram showing a functional configuration of point identifier acquisition units 421 and 441 in the object management server 220 according to the present embodiment.

When the object management server 220 extracts the point identifier, the point identifier acquisition units 421 and 441 include the point image acquisition unit 451 that acquires the point image via the communication control unit 401 and the point identifier that extracts the point identifier from the point image. It has an extraction unit 452 and. Further, the point identifier acquisition units 421 and 441 have a point identifier receiving unit 453 that receives the point identifier via the communication control unit 401 when the object management server 220 receives the point identifier.

(Object management database)
FIG. 5 is a diagram showing the configuration of the object management database 221 according to the present embodiment. The object management database 221 registers the point identifier of the sold object and the possession information of the object, and is used for managing the distribution of the object.

The object management database 221 stores the possession information 512 in association with the point identifier 511. Ownership information 512 includes owned object information such as object name and type, owner information such as address and contact information, information on whether the owner's ownership is abandoned or maintained, and information on the delivery address when the owner is lost and found. And so on.

<< Functional configuration of sales management equipment >>
FIG. 6A is a block diagram showing a functional configuration of the sales management device 210 according to the present embodiment.

The sales management device 210 includes a POS terminal 211 as a sales management terminal, a point image imaging unit 212 into which a point image based on a point identifier is input, a display unit 622, and an operation unit 623. Here, the point image capturing unit 212 includes a high-resolution camera such as a microscope camera that captures a point image that is the source of the point identifier. The POS terminal 211 includes a communication control unit 601, an input / output interface 602, a sales information acquisition unit 603, a sales information transmission unit 604, an ownership information registration completion reception unit 606, and an ownership information registration completion processing unit 607. Be prepared. The point image imaging unit 212, the display unit 622, and the operation unit 623 are connected to the input / output interface 602 of the POS terminal 211.

The communication control unit 601 controls communication with the object management server 220 via the network. The input / output interface 602 interfaces with the input / output device. The sales information acquisition unit 603 includes a point identifier acquisition unit 631 that acquires a point identifier that identifies a sold object, and an ownership information acquisition unit 632 that acquires possession information corresponding to the object. The sales information transmission unit 604 has a point identifier transmission unit 641 and an possession information transmission unit 642, and transmits the point identifier of the sold object and the possession information in association with each other to the object management server 220. The possession information registration completion receiving unit 606 receives from the object management server 220 that the point identifier and the possession information are registered in association with each other in the object management database 221. The ownership information registration completion processing unit 607 performs processing such as notification of completion of ownership information registration to the display unit 622.

In the POS terminal 211, the sales information acquisition unit 603, the sales information transmission unit 604, the ownership information registration completion reception unit 606, and the ownership information registration completion processing unit 607 may be included in the object management application 611. ..

(Point identifier acquisition section)
FIG. 6B is a block diagram showing a functional configuration of the point identifier acquisition unit 631 in the sales management device 210 according to the present embodiment.

The point identifier acquisition unit 631 has a point image acquisition unit 651 that acquires a point image from the point image imaging unit 212. When the sales management device 210 extracts and transmits the point identifier, the point identifier acquisition unit 631 has a point identifier extraction unit 652 that extracts the point identifier from the point image. On the other hand, when the sales management device 210 transmits the point image and the object management server 220 extracts the point identifier, the point identifier acquisition unit 631 transmits the point image receiving unit 653 that transmits the point image via the communication control unit 601. Have.

<< Functional configuration of found item management device >>
FIG. 7 is a block diagram showing a functional configuration of the found item management device 230 according to the present embodiment.

The found item management device 230 includes a found item management terminal 231, a point image imaging unit 232 into which a point image based on a point identifier is input, a display unit 722, and an operation unit 723. Here, the point image imaging unit 232 includes a high-resolution camera such as a microscope camera that captures a point image from which the point identifier is extracted. The found item management terminal 231 includes a communication control unit 701, an input / output interface 702, a found information acquisition unit 703, a found information transmitting unit 704, an owned information receiving unit 706, and an owned information notification unit 707. The point image imaging unit 232, the display unit 722, and the operation unit 723 are connected to the input / output interface 702 of the found item management terminal 231.

The communication control unit 701 controls communication with the object management server 220 via the network. The input / output interface 702 interfaces with the input / output device. The found information acquisition unit 703 has a point identifier acquisition unit 731, and acquires the point identifier of the found object. The found information transmitting unit 704 has a point identifier transmitting unit 741 and transmits the point identifier of the found object to the object management server 220. The possession information receiving unit 706 receives the possession information corresponding to the found item from the object management server 220. The possession information notification unit 707 performs processing such as notifying the distribution destination of the object corresponding to the possession information to the display unit 722.

In the found item management terminal 231, the found item management unit 703, the found information transmitting unit 704, the possessed information receiving unit 706, and the owned information notification unit 707 may be included in the found item management application 711.

(Point identifier acquisition section)
Since the functional configuration of the point identifier acquisition unit 731 in FIG. 7 is the same as that of the point identifier acquisition unit 631 in FIG. 6B, duplicate illustrations and explanations will be omitted.

<< Example of point identifier extraction unit >>
FIG. 8A is a block diagram showing an example of the functional configuration of the point identifier extraction units 452 and 652 according to the present embodiment. As is clear from the above description, each of the object management server 220, the sales management device 210, and the found item management device 230 includes any of the point identifier extraction units 452 and 652 whose functional configurations are shown in FIG. 8A. .. Referring to FIG. 8A, the point identifier extraction units 452 and 652 according to the present embodiment have a function of extracting the point identifier of the object 201.

In FIG. 8A, the object 201 as an object, the point 202 described by the writing instrument formed on the surface thereof, and the minute grain 203 included in the point 202 are the object 201 and the point described with reference to FIG. 2D. 202, the same as the fine grain 203.

The point image imaging unit 212, 232 (camera) has a function of optically acquiring an image of the point 202 on the object 201, that is, an imaging function. As the point image capturing unit 212, 232 (camera), for example, a camera using a CCD (Charge Coupled Devices) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor can be used.

The point image acquisition units 451 and 651 acquire point images from the sales management device 210 in the case of the object management server 220 and from the point image imaging units 212 and 232 (camera) in the case of the found object management device 230. To do. The point image acquisition units 451 and 651 have a function of acquiring an image of the point 202 of the object 201 using the point image imaging units 212 and 232 (camera) and storing the image in the image storage unit 832. The point image acquisition units 451 and 651 acquire an image showing the planar shape of the point 202 on the object 201. Further, the point image acquisition units 451 and 651 acquire images of quality capable of extracting the feature amount depending on the distribution of the grains 203 existing at the point 202.

The point identifier extraction units 452 and 652 have a function of extracting a point identifier from a point image. The point identifier extraction units 452 and 652, as main functional units, include an image storage unit 832, a coordinate system determination unit 833, a normalized image generation unit 834, a normalized image storage unit 835, a fixed area determination unit 836, and a feature quantity extraction unit. It has a part 837.

The point identifier extraction units 452 and 652 have, for example, one or more arithmetic processing units such as a microphone mouth processor, and a storage unit such as a memory or a hard disk used as an image storage unit 832 and a normalized image storage unit 835 or the like. It may be realized by the information processing unit and the program. The program is read into the memory from an external computer-readable recording medium at the time of starting up the information processing unit, and by controlling the operation of the arithmetic processing unit, the coordinate system determination unit 833, regular It realizes functional components such as a computerized image generation unit 834, a fixed area determination unit 836, and a feature amount extraction unit 837.

The coordinate system determination unit 833 has a function of determining a coordinate system unique to the image of the point 202 from the entire image of the point 202 stored in the image storage unit 832. The coordinate system unique to the image of point 202 is defined by three parameters: the position of the origin, the direction of the axis, and the scale. Since the coordinate system unique to the image of the point 202 is determined from the entire image of the point 202, it depends on the planar shape of the point 202.

The normalized image generation unit 834 has a function of normalizing the image of the point 202 stored in the image storage unit 832 to the normalized coordinate system and storing the normalized image in the normalized image storage unit 835. The normalized coordinate system is defined by three parameters: the position of the origin, the direction of the axis, and the scale.

The fixed area determination unit 836 has a function of defining a predetermined area in the normalized image of the point 202 stored in the normalized image storage unit 835 as the feature amount extraction area. As long as the predetermined region is a fixed region, the shape, size, and number of regions are arbitrary. As described above, since the coordinate system specific to the image of the point 202 depends on the planar shape of the point 202, the normalized image and the feature extraction region which is a fixed region in the normalized image depend on the planar shape of the point 202. It becomes the area to do.

Here, the coordinate system determination unit 833, the normalized image generation unit 834, and the fixed region determination unit 836 constitute a region determination unit 838 that determines a region depending on the planar shape of the layer from the image of the point 202. ..

The feature amount extraction unit 837 has a function of extracting and outputting a feature amount depending on the distribution of grains 203 in the feature amount extraction region in the normalized image of the point 202 stored in the normalized image storage unit 835 as a point identifier. Has.

(Point identifier extraction process)
FIG. 8B is a flowchart showing a procedure of an example of the point identifier extraction process according to the present embodiment. Hereinafter, the operations of the point identifier extraction units 452 and 652 will be described with reference to FIGS. 8A and 8B. Since the configurations and operations of the point identifier extraction units 452 and 652 are the same, the point identifier extraction units 652 will be described below as a representative.

The point image acquisition unit 651 acquires an image of the point 202 on the object 201 using an imaging unit (camera) (for example, the point image imaging unit 212 and 232), and the point identifier extraction unit 652 stores the point image in the image storage unit. It is stored in 832 (step S801).

Next, the coordinate system determination unit 833 of the point identifier extraction unit 652 inputs and analyzes the image of the point 202 from the image storage unit 832, determines the coordinate system unique to the image of the point 202, and determines the coordinate system unique to the image of the point 202. The position of the origin, the direction of the axis, and the scale are transmitted to the normalized image generation unit 834 (step S802).

Next, the normalized image generation unit 834 of the point identifier extraction unit 652 stores the image storage unit 832 based on the coordinate system and the normalized coordinate system specific to the image of the point 202 determined by the coordinate system determination unit 833. The image of the stored point 202 is normalized, and the normalized image is stored in the normalized image storage unit 835 (step S803).

Next, the fixed area determination unit 836 of the point identifier extraction unit 652 determines a predetermined fixed area in the normalized image stored in the normalized image storage unit 835 as the feature amount extraction area, and determines the feature amount extraction unit. It is transmitted to 837 (step S804).

Next, the feature amount extraction unit 837 of the point identifier extraction unit 652 determines the feature amount depending on the distribution of the grains 203 in the feature amount extraction region in the normalized image of the point 202 stored in the normalized image storage unit 835. It is extracted as a point identifier and output (step S805).

(Example of coordinate determination unit)
FIG. 9A is a block diagram showing an example of the functional configuration of the coordinate system determination unit 833 according to the present embodiment.

The coordinate system determination unit 833 of the present embodiment includes a low resolution unit 951, a low resolution image storage unit 952, a keypoint / scale detection unit 953, a direction detection unit 954, and a statistical processing unit 955.

The low resolution unit 951 has a function of reducing the resolution of the image of the point 202 stored in the image storage unit 832 according to a predetermined standard and storing it in the low resolution image storage unit 952. When the grain 203 is unevenly contained in the point 202 and the reflection characteristic of the grain 203 is different from that of the other materials of the point 202, when the image of the point 202 is reduced in resolution, a shading pattern corresponding to the density of the grain 203 is obtained. Appear. The low resolution unit 951 is a functional configuration unit for generating a shading pattern according to the density of the grain 203 from the image at the point 202.

The keypoint / scale detection unit 953 has a function of detecting the keypoint and the scale from an image having a shading pattern stored in the low-resolution image storage unit 952. Here, the keypoint means a point or region that appears characteristically on the image even if the scale changes, and the detected scale means the optimum scale that is most resistant to the scale change. The detection of the keypoint and the scale by the keypoint / scale detection unit 953 corresponds to the detection of the keypoint and the scale performed in the process of generating the SIFT (Scale-Invariant Feature Transform) descriptor. In general, SIFT is not suitable for images in which minute grains 203 are scattered, but it is possible to stably extract keypoints and scales from the shading pattern generated by reducing the resolution as described above. ..

The direction detection unit 954 has a function of determining the "direction" that characterizes the keypoint for each keypoint detected by the keypoint / scale detection unit 953. The direction detection by the direction detection unit 954 corresponds to the detection of the orientation performed in the process of generating the SIFT descriptor.

The statistical processing unit 955 is based on the keypoint and scale detected by the keypoint / scale detection unit 953 and the direction of each keypoint detected by the direction detection unit 954, and the origin, axis, and the origin of the unique coordinate system. It has a function to determine the scale. For example, the statistical processing unit 955 determines the origin of a unique coordinate system based on the distribution of a plurality of keypoints. Specifically, the statistical processing unit 955 sets the center of gravity of the detected plurality of keypoints as the origin of the unique coordinate system. In addition, the statistical processing unit 955 determines the scale and axis of the unique coordinate system based on the scales and direction distributions of the plurality of keypoints. Specifically, the statistical processing unit 955 sets the center of the distribution of the scales and directions of the plurality of keypoints as the scale and axis of the unique coordinate system. That is, the center of the distribution of the scales of the plurality of keypoints is set as the scale of the unique coordinate system, and the center of the distribution in the direction of the plurality of keypoints is set as the axis of the unique coordinate system. For example, the mode may be used as the center of the distribution. However, the value is not limited to the mode, and the average value or the median value may be used.

FIG. 9B is a schematic diagram for explaining the operation of the coordinate system determination unit 833 according to the present embodiment.

In FIG. 9B, image G911 shows an image of point 202 stored in image storage unit 832. The low resolution unit 951 generates an image from the image G911 having a shading pattern depending on the density of the grain 203 at the point 202 as shown in the image G912. In FIG. 9B, for convenience, the difference in shading is represented by the difference in the type of hatching. Next, the keypoint / scale detection unit 953 detects the keypoint and the scale from the image G912. The circle drawn on the image G912 is the scale, and the center of the circle is the keypoint. Next, the direction detection unit 954 detects the direction for each keypoint. The line segment in the circle drawn on the image G912 indicates the direction.

Next, the statistical processing unit 955 determines the scale of the detected keypoint, the scale of the unique coordinate system based on the distribution of directions, and the axis, so that the horizontal axis is the scale and the vertical axis is as shown in the histogram G913. A histogram in which the axis is the frequency and a histogram in which the horizontal axis is the direction and the vertical axis is the frequency are created as shown in the histogram G914. Next, the statistical processing unit 955 obtains the scale of the mode value from the histogram G913, and uses this as the scale of the unique coordinate system. Further, the statistical processing unit 955 obtains the direction of the mode from the histogram G914, and sets this direction as the direction of the axis of the unique coordinate system. Further, the statistical processing unit 955 obtains the center of gravity of the detected keypoint, and uses this as the origin of the unique coordinate system. In FIG. 9B, the circle drawn in the image G915 indicates the scale of the unique coordinate system, the center of the circle indicates the origin of the unique coordinate system, and the arrows in the circle indicate the directions of the axes of the unique coordinate system.

FIG. 9B shows another image G921 in which the planar shape of the points and the distribution of grains in the points are different from those of the image G911, a low-resolution image G922 generated from the image G921, and a detected keypoint. A scale, generated histograms G923, G924, and an image G925 depicting a determined unique coordinate system are described. As described above, the unique coordinate system is often different when the planar shape of the layer and the distribution of grains in the layer are different.

(Other examples of coordinate determination part)
FIG. 9C is a block diagram showing another example of the functional configuration of the coordinate system determination unit 833 according to the present embodiment.

The coordinate system determination unit 833 of the present embodiment includes a binarization unit 961, a binarization image storage unit 962, a fill image generation unit 963, a fill image storage unit 964, and a shape processing unit 965.

The binarization unit 961 has a function of binarizing the image of the point 202 stored in the image storage unit 832 and storing it in the binarized image storage unit 962. As a result, most of the pixels in the background area are white pixels (value 0), and in the area of the point 202, white pixels (value 0) and black pixels (value 1) are mixed according to the distribution of the grains 203. Is obtained.

The filled image generation unit 963 has the same shape as the planar shape of the point 202 from the binarized image stored in the binarized image storage unit 962, and the inside is completely filled with black pixels (filled image). It has a function of generating an image) and storing it in a filled image storage unit 964. The method of generating a filled image from the binarized image is arbitrary. For example, the filled image generation unit 963 may generate a filled image by performing a morphological calculation on the binarized image stored in the binarized image storage unit 962. Further, the filled image generation unit 963 may generate a filled image from the binarized image by setting a predetermined pixel length to n and executing an expansion process of n pixels and a contraction process of n pixels. Here, the n-pixel expansion process is an operation of setting the values of all the pixels existing within the length of n pixels from the pixel of interest to "1" when the value of the pixel of interest is "1". It means a process performed by paying attention to the entire surface of the digitized image. Further, the contraction process of n pixels means that the binary image after the expansion process of n pixels is present within n pixel length from the pixel of interest when the value of the pixel of interest is “0”. It means a process of setting the values of all pixels to "0" by paying attention to the entire surface of the binarized image.

The shape processing unit 965 has a function of determining a unique coordinate system from the features of the filled image stored in the filled image storage unit 964. For example, the shape processing unit 965 determines the center of gravity of the filled image as the origin of the unique coordinate system. Further, the shape processing unit 965 determines, for example, an axis that passes through the center of gravity and is parallel to the image plane and has a minimum or maximum secondary moment around the axis as an axis of the unique coordinate system. Further, the shape processing unit 965 determines, for example, the area of the filled image to the scale of the unique coordinate system.

FIG. 9D is a schematic diagram for explaining the operation of the coordinate determination unit according to the present embodiment.

In FIG. 9D, image G931 shows an image of point 202 stored in the image storage unit 832. The binarization unit 961 generates a binarized image G932 from the image G931. In FIG. 9D, for convenience, black pixels are indicated by hatching, and white pixels are indicated by white circles. Next, the filled image generation unit 963 generates a filled image G933 filled with black pixels from the binarized image G933. Next, the shape processing unit 965 extracts the center of gravity, the moment, and the area of the filled image G933, and sets them as the origin, axis, and scale of the unique coordinate system.

(Normalized image generator)
The normalized image generation unit 834 considers the origin of the coordinate system peculiar to the image of the point 202 determined by the coordinate system determination unit 833 as the origin of the normalized coordinate system. Further, the normalized image generation unit 834 rotates the image of the point 202 around the origin so that the axis of the unique coordinate system coincides with the axis of the normalized coordinate system. Further, the normalized image generation unit 834 enlarges or reduces the image of the point 202 so that the scale of the unique coordinate system matches the scale of the normalized coordinate system. In other words, the normalized image generation unit 834 normalizes the image at point 202 by performing coordinate conversion using the unique coordinate system as the coordinate system before conversion and the normalized coordinate system as the coordinate system after conversion. Generate an image.

FIG. 10A is a schematic diagram for explaining the operation of the normalized image generation unit 834 according to the present embodiment. In FIG. 10A, the images G1016 and G1026 are images depicting the coordinate system peculiar to the images G911 and G921 shown in FIG. 9B. That is, the circles drawn by solid lines in the images G1016 and G1026 indicate the scale of the unique coordinate system, the center of the circle indicates the origin of the unique coordinate system, and the arrows in the circle indicate the axes of the unique coordinate system. ..

The normalized image generation unit 834 has images G1016 and G1026 so that the axes of the unique coordinate system match the axes of the normalized coordinate system and the scale of the unique coordinate system matches the scale of the normalized coordinate system. Is rotated around the origin and enlarged or reduced to generate a normalized image. In FIG. 10A, images G1017 and G1027 show normalized images of the images G1016 and G1026 thus generated. The circles drawn in the images G1017 and G1027 indicate the scale of the normalized coordinate system, and the arrows in the circle indicate the axes of the normalized coordinate system.

(Fixed area determination unit)
The fixed area determination unit 836 uses the normalized coordinate system to define a fixed area in the normalized image. For example, the fixed region determination unit 836 uses the origin of the normalized coordinate system as the center of gravity, the scale of the normalized coordinate system as the size of the sides, and a square having two sides parallel to the axes of the normalized coordinate system as the fixed region. To do. Of course, the shape of the fixed region is not limited to a square, and may be another shape such as a rectangle. Moreover, the size of the side does not have to match the scale of the normalized coordinate system, and may be any fixed value.

FIG. 10B is a schematic diagram for explaining the operation of the fixed region determination unit 836 according to the present embodiment. In FIG. 10B, the images G1018 and G1028 are examples of images in which the feature amount extraction region is added to the images G1017 and G1027 shown in FIG. 10A. That is, the circles drawn in the images G1018 and G1028 indicate the scale of the normalized coordinate system, the center of the circle indicates the origin of the normalized coordinate system, and the arrows in the circle indicate the axes of the normalized coordinate system. The squares drawn by solid lines in the images G1018 and G1028 are fixed regions that serve as regions for extracting feature quantities.

(Feature quantity extraction unit)
The feature amount extraction unit 837 has a function of extracting and outputting a feature amount depending on the distribution of grains 203 in the feature amount extraction region in the normalized image of the point 202 stored in the normalized image storage unit 835 as a point identifier. Has.

As the feature amount extracted by the feature amount extraction unit 837, for example, the following fixed-dimensional vector can be considered.

Feature example 1: The feature extraction unit 837 divides the feature extraction region in the normalized image of the point 202 into n equal parts in the direction parallel to the axis of the normalized coordinate system, and m in the direction perpendicular to the axis. By dividing into equal parts, the feature amount extraction area is divided into (n × m) blocks. Next, the feature amount extraction unit 837 extracts the brightness of each block. Next, the feature amount extraction unit 837 compares the brightness of each block with the dark value, and if the brightness is equal to or higher than the dark value, for example, sets a value of 1, otherwise sets a value of 0, thereby setting the brightness of each block to 2. Quantize to a value. Then, the feature amount extraction unit 837 outputs a bit string in which the quantized values of each block are arranged in a predetermined order as a feature amount having (n × m) dimensions constituting the point identifier.

Feature quantity example 2: The feature quantity extraction unit 837 extracts a fixed bit length BRIEF (Binary Robust Independent Elementary Features) from the feature quantity extraction region in the normalized image of the point 202, and a fixed number of dimensions constituting the individual identifier. It is output as a feature amount of.

However, the feature amount extracted by the feature amount extraction unit 837 is not limited to the above example. For example, the feature amount extraction unit 837 may extract the SIFT feature amount as a point identifier from the feature amount extraction region in the normalized image of the point 202. In this case, when the SIFT feature amount is directly extracted from the image of the feature amount extraction region, one of the grains 203 becomes the minimum scale and the direction does not come out, and the descriptor becomes unstable. Therefore, it is desirable to reduce the resolution of the image in the feature amount extraction region to a predetermined standard to generate an image having a shading pattern, and to extract the SIFT feature amount from the image having the shading pattern. However, from the viewpoint of speeding up the discriminating power and the discriminating collation, it is preferable to extract the above-mentioned fixed-dimensional feature amount rather than the SIFT feature amount.

<< Other examples of point identifier extractor >>
FIG. 11A is a block diagram showing another example of the functional configuration of the point identifier extraction units 452 and 652 according to the present embodiment. As is clear from the above description, each of the object management server 220, the sales management device 210, and the found item management device 230 includes any of the point identifier extraction units 452 and 652 whose functional configurations are shown in FIG. 11A. Referring to FIG. 11A, the point identifier extraction units 452 and 652 according to the present embodiment have a function of extracting the point identifier of the object 201. In FIG. 11A, the same components as those in FIG. 8A are designated by the same reference numbers, and duplicate description will be omitted.

The point identifier extraction units 452 and 652 have a function of extracting a point identifier from a point image. The point identifier extraction units 452 and 652 of this example have a point region determination unit 1133 and a feature amount extraction unit 1134 as main functional units. The programs of the point identifier extraction units 452 and 652 are read into the memory from an external computer-readable recording medium at the time of starting up the information processing unit, and by controlling the operation of the arithmetic processing unit, the program is placed on the arithmetic processing unit. , A point region determination unit 1133, and a feature amount extraction unit 1134 are realized.

The point region determination unit 1133 has a function of determining the entire planar shape of the point 202 stored in the image storage unit 832 as the feature amount extraction region.

The feature amount extraction unit 1134 has a function of extracting a feature amount depending on the distribution of the grain 203 from the feature amount extraction region in the image of the point 202 stored in the image storage unit 832 and outputting it as a point identifier. ..

FIG. 11B is a flowchart showing a procedure of another example of the point identifier extraction process according to the present embodiment. Hereinafter, the operations of the point identifier extraction units 452 and 652 will be described with reference to FIGS. 11A and 11B, with reference to the operations of the point identifier extraction units 652. In FIG. 11B, the same steps as those in FIG. 8B are assigned the same step numbers, and duplicate description will be omitted.

The point region determination unit 1133 of the point identifier extraction unit 652 determines the entire planar shape of the point 202 as the feature amount extraction region (step S1102). The point region determination unit 1133 can extract the entire planar shape of the point 202 by, for example, binarizing the image of the point 202 and performing a morphological calculation on the binarized image.

Next, the feature amount extraction unit 1134 of the point identifier extraction unit 652 extracts the feature amount depending on the distribution of the grain 203 from the feature amount extraction region in the image of the point 202 stored in the image storage unit 832. , Is output as a point identifier (step S1103).

In the present embodiment, since the coordinate system is not normalized, the feature amount extraction unit 1134 extracts a feature amount that is robust to image rotation and the like, for example, a SIFT feature amount. However, the feature amount extracted by the feature amount extraction unit 1134 is not limited to the SIFT feature amount. Further, when the SIFT feature amount is extracted directly from the image, one of the grains 203 becomes the minimum scale and the direction does not come out, the descriptor becomes unstable, the aligner ratio becomes small, and matching becomes difficult. Therefore, in this example, the SIFT feature amount is extracted as follows.

First, the feature amount extraction unit 1134 lowers the resolution of the image of the feature amount extraction region at the point 202 by a predetermined reference. As a result, an image having a shading pattern depending on the density of the grain 203 at the point 202 is generated. Next, the feature amount extraction unit 1134 extracts the SIFT feature amount from the image having the above-mentioned shading pattern.

<< Further examples of the point identifier extraction unit >>
FIG. 12A is a block diagram showing still another example of the functional configuration of the point identifier extraction units 452 and 652 according to the present embodiment. As is clear from the above description, each of the object management server 220, the sales management device 210, and the found item management device 230 includes any of the point identifier extraction units 452 and 652 whose functional configurations are shown in FIG. 12A. Referring to FIG. 12A, the point identifier extraction units 452 and 652 according to the present embodiment have a function of extracting the point identifier of the object 201. In FIG. 12A, the same components as those in FIG. 8A or FIG. 11A are designated by the same reference numbers, and duplicate description will be omitted.

The point identifier extraction units 452 and 652 have a function of extracting a point identifier from a point image. The point identifier extraction units 452 and 652 of the present embodiment include an image storage unit 832, a first feature amount extraction unit 1233, a second feature amount extraction unit 1234, and a feature amount integration unit 1235 as main functional units. .. The programs of the point identifier extraction units 452 and 652 are read into the memory from an external computer-readable recording medium at the time of starting up the information processing unit, and by controlling the operation of the arithmetic processing unit, the program is placed on the arithmetic processing unit. , The first feature amount extraction unit 1233, the second feature amount extraction unit 1234, and the feature amount integration unit 1235 are realized.

The first feature amount extraction unit 1233 has a function of extracting a feature amount depending on the planar shape of the point 202 and the distribution of the grains 203 as the first feature amount from the image of the point 202. The first feature amount extraction unit 1233 includes, for example, the coordinate system determination unit 833, the normalized image generation unit 834, the normalized image storage unit 835, the fixed area determination unit 836, and the feature amount extraction unit described with reference to FIG. 8A. This can be achieved by unit 837. Alternatively, the first feature amount extraction unit 1233 can be realized by, for example, the point region determination unit 1133 and the feature amount extraction unit 1134 described with reference to FIG. 11A.

The second feature amount extraction unit 1234 has a function of extracting a feature amount depending on the planar shape of the point 202 as a second feature amount from the image of the point 202. For example, the second feature amount extraction unit 1234 has a function of extracting a feature amount that depends on the planar shape of the point 202 but does not depend on the distribution of the grains 203 as the second feature amount from the image of the point 202. The feature amount extracted by the second feature amount extraction unit 1234 is, for example, the minimum or maximum 2 calculated in the process of determining the axis of the unique coordinate system by the coordinate system determination unit 833 described with reference to FIG. 9C. You can use the following coordinates. However, the feature amount extracted by the second feature amount extraction unit 1234 is not limited to the above, and other feature amounts such as the area of the plane shape of the point 202 and the peripheral length may be used.

The feature amount integration unit 1235 has a function of extracting a point identifier from the first feature amount extracted by the first feature amount extraction unit 1233 and the second feature amount extracted by the second feature amount extraction unit 1234. Has. For example, the feature amount integration unit 1235 uses a feature amount obtained by connecting a first feature amount and a second feature amount as a point identifier.

FIG. 12B is a flowchart showing a procedure of still another example of the point identifier extraction process according to the present embodiment. Hereinafter, the operations of the point identifier extraction units 452 and 652 will be described with reference to FIGS. 12A and 12B, with reference to the operations of the point identifier extraction units 652. In FIG. 12B, the same steps as those in FIGS. 8B and 11B are given the same step numbers, and duplicate description will be omitted.

The first feature amount extraction unit 1233 of the point identifier extraction unit 652 extracts the first feature amount depending on the planar shape of the point 202 and the distribution of the grains 203 from the image of the point 202 (step S1202).

Next, the second feature amount extraction unit 1234 of the point identifier extraction unit 652 extracts the second feature amount depending on the planar shape of the point 202 from the image of the point 202 (step S1203).

Next, the feature amount integration unit 1235 of the point identifier extraction unit 652 extracts and outputs the point identifier by integrating the first feature amount and the second feature amount (step S1204).

As described above, in the present embodiment, the point identifier has a first feature amount and a second feature amount. Therefore, in the collation identification using the point identifiers extracted in the present embodiment, the comparison between the point identifiers is the comparison between the first feature quantities, the comparison between the second feature quantities, and the first feature quantity. It can be carried out by any one, two, or a combination of all three patterns of comparison of the whole with the second feature amount. Therefore, for example, it is possible to first compare the second features, exclude the same or dissimilar candidates, compare the first features with each other, and finally identify and collate the remaining candidates. become.

<< Hardware configuration of object management server >>
FIG. 13 is a block diagram showing a hardware configuration of the object management server 220 as the information processing device according to the present embodiment.

In FIG. 13, the CPU (Central Processing Unit) 1310 is a processor for arithmetic control, and the functional components of FIGS. 4A and 4B are realized by executing a program. The number of CPUs 1310 may be one or plural. The ROM (Read Only Memory) 1320 stores fixed data and programs such as initial data and programs. The network interface 1330 controls communication with the sales management device 210 and the found item management device 230 via the network.

The RAM (Random Access Memory) 1340 is a random access memory used by the CPU 1310 as a temporary storage work area. The RAM 1340 has an area for storing data necessary for realizing the present embodiment. The point identifier 1341 of the sales object is the point identifier data of the sales object transmitted from the sales management device 210. The ownership information 1342 of the sales object is the data of the ownership information associated with the point identifier 1341 transmitted from the sales management device 210. The point identifier 1343 of the found object is the data of the point identifier of the found object transmitted from the found item management device 230. The point identifier 1344 read from the object management database is data of the point identifier of the object for sale registered and read in the object management database 221. The point identifier collation result 1345 is the data of the collation result of the point identifier 1343 of the found object and the point identifier 1344 read from the object management database 221, and indicates whether or not there is a matching point identifier. The possession information 1346 corresponding to the point identifier is the data of the possession information associated with the point identifier when there is a matching point identifier. The transmission / reception data 1347 is data transmitted / received via the network interface 1330, and includes a point identifier, possession information, and the like in this example. When the object management server 220 collectively extracts the point identifiers, the point image for extracting the point identifier is received from the sales management device 210 or the found object management device 230, and the point identifier is extracted from the point image. It will be configured to.

The storage 1350 stores a database and various parameters used by the CPU 1310, or the following data or programs necessary for realizing the present embodiment. As shown in FIG. 5, the object management database 221 registers data in which the point identifier and the possession information are associated with each other. The following programs are stored in the storage 1350. The object management server control program 1351 is a program that controls the entire object management server 220. The sales information acquisition module 1352 includes a point identifier acquisition module and an ownership information acquisition module, and is a module that acquires ownership information related to an object at the time of sale from the sales management device 210 and registers it in the object management database 221. The found information acquisition module 1353 includes a point identifier acquisition module, and is a module for acquiring possession information related to an object at the time of found item management from the found item management device 230. The point identifier collation module 1354 is a module for collating the point identifier found from the found object management device 230 with the point identifier registered in the object management database 221. The possession information notification module 1355 is a module that reads the possession information registered in association with the point identifier in the object management database 221 and notifies the found object management device 230 if there is a matching point identifier in the collation result. ..

When the object management server 220 extracts the point identifier, the point identifier extraction algorithm and the point identifier extraction module are stored in the storage 1350. Further, the RAM 1340 and the storage 1350 of FIG. 13 do not show programs or data related to general-purpose functions and other feasible functions of the object management server 220.

<< Processing procedure of object management server >>
FIG. 14 is a flowchart showing a processing procedure of the object management server 220 as the information processing device according to the present embodiment. This flowchart is executed by the CPU 1310 of FIG. 13 using the RAM 1340 to realize the functional components of FIGS. 4A and 4B.

In step S1411, the object management server 220 determines whether or not the sales information is received from the sales management device 210. If it is determined that the sales information has been received, the object management server 220 acquires the point identifier of the item for sale from the sales information transmitted from the sales management device 210 in step S1413. In step S1415, the object management server 220 acquires the possession information associated with the point identifier from the sales information transmitted from the sales management device 210. Then, in step S1417, the object management server 220 associates the acquired point identifier with the possession information and registers it in the object management database 221. In step S1419, the object management server 220 transmits privilege information such as awarding points to the purchaser who has made settings including abandonment of ownership when the purchased object is lost and found. Is desirable.

If it is determined that the sales information is not received, the object management server 220 determines in step S1421 whether or not the found information is received from the found item management device 230. If it is determined that the found information has been received, the object management server 220 acquires the point identifier of the found item from the found information transmitted from the found item management device 230 in step S1423. Here, it is desirable that the object management server 220 transmits privilege information such as giving points to the founder in step S1425. In step S1427, the object management server 220 reads out the point identifier registered in the object management database 221. Then, in step S1429, the object management server 220 collates the point identifier of the found item from the found item management device 230 with the point identifier read from the object management database 221. In step S1431, the object management server 220 determines whether or not the point identifiers match from the collation result. The point identifiers may be determined to match when the difference is within a predetermined threshold value. When the point identifiers match, the object management server 220 acquires the possession information corresponding to the matched point identifiers from the object management database 221 in step S1433, and notifies the found object management device 230 of the possession information. On the other hand, if the point identifiers do not match, the object management server 220 determines in step S1435 whether or not the collation of the point identifiers is completed. When it is determined that the collation of the point identifier is not completed, the object management server 220 returns to step S1427 and reads the next point identifier from the object management database 221 and collates it. When it is determined that the collation of the point identifier is completed, the object management server 220 notifies the found item management device 230 that there is no possession information of the found item in step S1437.

<< Hardware configuration of sales management equipment >>
FIG. 15 is a block diagram showing a hardware configuration of the sales management device 210 according to the present embodiment.

In FIG. 15, the CPU 1510 is a processor for arithmetic control, and realizes the functional components of FIGS. 6A and 6B by executing a program. The number of CPUs 1510 may be one or plural. The ROM 1520 stores fixed data and programs such as initial data and programs. The network interface 1530 controls communication with the object management server 220 via the network.

The RAM 1540 is a random access memory used by the CPU 1510 as a temporary storage work area. The RAM 1540 secures an area for storing data necessary for realizing the present embodiment. The settlement result 1541 of the sales object is data indicating the settlement of the sales object by the sales management device 210. The point image 1542 of the selling object is the data of the point image on the selling object captured by the point image capturing unit 212. The point identifier 1543 of the object for sale is the data of the point identifier extracted from the point image 1542. The possession information 1544 of the sale object is the data of the possession information set in association with the point identifier 1543 of the sale object. The possession information setting completion information 1545 is data indicating that the possession information has been registered in the object management database 221 notified from the object management server 220. The transmission / reception data 1546 stores data transmitted / received via the network, and in this example, includes a point identifier, ownership information, ownership information setting completion information, and the like. The input / output data 1547 is data that is input / output to / from the input / output device via the input / output interface 602.

The storage 1550 stores a database and various parameters used by the CPU 1510, or the following data or programs necessary for realizing the present embodiment. The point identifier extraction algorithm 1551 is a point identifier extraction algorithm used by the sales management device 210 to perform the point identifier extraction function. The following programs are stored in the storage 1550. The sales management device control program 1552 is a program that controls the entire sales management device 210. The object management application 611 for the sales management device is an application program for managing the found items as the sales management device 210, and includes the sales information generation module 1553. The sales information generation module 1553 includes a point identifier extraction module that extracts a point identifier from the identification information acquired from the sale object, and an ownership information acquisition module that acquires the ownership information corresponding to the point identifier.

The input / output interface 602 provides an interface for controlling data input / output with an input / output device. In the present embodiment, as shown in FIG. 6A, the input / output interface 602 is connected to a point image imaging unit 212 such as a camera, a display unit 622, an operation unit 623, and the like.

The RAM 1540 and storage 1550 of FIG. 15 do not show programs or data related to general-purpose functions and other feasible functions of the sales management device 210.

<< Processing procedure of sales management device >>
FIG. 16 is a flowchart showing a processing procedure of the sales management device 210 according to the present embodiment. This flowchart is executed by the CPU 1510 of FIG. 15 using the RAM 1540 to realize the functional components of FIGS. 6A and 6B.

In step S1601, the sales management device 210 performs the settlement processing of the sales object. In step S1603, the sales management device 210 acquires a point image for extracting the point identifier from the sales object. Then, in step S1605, the sales management device 210 extracts the point identifier from the point image.

Subsequently, in step S1607, the sales management device 210 inquires of the purchaser of the sales object for ownership information including whether to waive the ownership of the sales object when the sales object is lost and found. It is determined whether or not the possession information is set. If the ownership information is set, the sales management device 210 acquires the ownership information in step S1609. In step S1611, the sales management device 210 transmits the point identifier and the ownership information in association with each other to the object management server 220. Then, in step S1613, the sales management device 210 waits for the ownership information registration completion notification from the object management server 220.

Upon receiving the possession information registration completion notification from the object management server 220, the sales management device 210 notifies in step S1615 that the ownership information has been registered by displaying or the like. Then, in step S1617, the sales management device 210 gives a privilege such as points to the purchaser who has set the ownership information including the waiver of the ownership of the object for sale.

On the other hand, if the possession information is not set in step S1607, the process ends.

Here, when the sales management device 210 does not have the point identifier extraction function, the sales management device 210 can extract the point identifier instead of the point identifier in step S1611 without extracting the point identifier in step S1605. The image is transmitted to the object management server 220 together with the possession information.

<< Hardware configuration of found item management device >>
FIG. 17 is a block diagram showing a hardware configuration of the found item management device 230 according to the present embodiment.

In FIG. 17, the CPU 1710 is a processor for arithmetic control, and the functional configuration unit of FIG. 7 is realized by executing a program. The number of CPUs 1710 may be one or plural. The ROM 1720 stores fixed data and programs such as initial data and programs. The network interface 1730 controls communication with the object management server 220 via the network.

The RAM 1740 is a random access memory used by the CPU 1710 as a temporary storage work area. The RAM 1740 has an area for storing data necessary for realizing the present embodiment. The point image 1741 of the found object is the data of the point image on the found object captured by the point image imaging unit 232. The point identifier 1742 of the found object is the data of the point identifier extracted from the point image 1741. The possession information 1743 of the found object is the data of the possession information registered in the object management database 221 of the object management server 220 in association with the point identifier of the sold object that matches the point identifier 1742 of the found object. The transmission / reception data 1744 stores data transmitted / received via the network, and includes a point identifier, possession information, and the like in this example. The input / output data 1745 is data that is input / output to / from the input / output device via the input / output interface 602.

The storage 1750 stores a database and various parameters used by the CPU 1710, or the following data or programs necessary for realizing the present embodiment. The point identifier extraction algorithm 1751 is a point identifier extraction algorithm used by the found object management device 230 to perform the point identifier extraction function. The following programs are stored in the storage 1750. The found item management device control program 1752 is a program that controls the entire found item management device 230. The found item management application 711 for the found item management device is an application program for performing found item management as the found item management device 230, and includes a found item information generation module 1753 and an possession information notification module 1754. The found object information generation module 1753 includes a point identifier extraction module that extracts a point identifier from the identification information acquired from the found object. The possession information notification module 1754 is a module that receives and notifies the possession information registered in the object management database 221 in association with the point identifier that matches the point identifier generated by the point identifier extraction module.

The input / output interface 702 provides an interface for controlling data input / output with an input / output device. In the present embodiment, as shown in FIG. 7, the input / output interface 702 is connected to a point image imaging unit 232 such as a camera, a display unit 722, an operation unit 723, and the like.

The RAM 1740 and the storage 1750 of FIG. 17 do not show programs or data related to the general-purpose function of the found item management device 230 or other feasible functions.

<< Processing procedure of found item management device >>
FIG. 18 is a flowchart showing a processing procedure of the found item management device 230 according to the present embodiment. This flowchart is executed by the CPU 1710 of FIG. 17 using the RAM 1740 to realize the functional configuration unit of FIG.

In step S1801, the found item management device 230 acquires a point image for extracting the point identifier from the found object. The found item management device 230 extracts the point identifier from the point image in step S1803. Then, the found item management device 230 transmits the extracted point identifier to the object management server 220 in step S1805.

Subsequently, in step S1807, the found item management device 230 waits for the possession information registered in association with the point identifier matching the point identifier of the found item from the object management server 220. If the possession information registered for the found item is received, the found item management device 230 notifies the found item of the possession information set by the purchaser in step S1809. On the other hand, if there is a reception that the matching point identifier is not registered or that the purchaser has not set the possession information for the found item, the found item management device 230 sets the found item for the found item in step S1811. Notify that there is no possession information.

Then, it is desirable that the found item management device 230 gives the founder a privilege such as points in step S1813.

According to the present embodiment, by writing a point on an object with a writing instrument, the possession of the object can be identified by a simple operation without including personal information, so that the distribution of the object can be efficiently managed.

For example, if the lost owner's information is notified, the found item can be easily returned. In addition, when a lost object is found, the delivery address is notified, so that the lost object can be easily delivered. In addition, if the ownership information indicating that the ownership of the sold object is relinquished if the purchaser loses the sold object is set at the time of sale, the time and cost for managing the found item can be reduced. be able to. That is, the found item can be easily disposed of at a found item handling office or the like, and efficient circulation of the object can be realized. Therefore, since the found item brought in is returned to the owner, the time and cost for finding the owner or the time and cost for storing the found item until the owner is found can be reduced. Further, it is possible to eliminate the waste of resources due to the found item being stored in the found item storage for a predetermined period without being used.

[Third Embodiment]
Next, the object management system according to the third embodiment of the present invention will be described. The object management system according to the present embodiment is different from the second embodiment in that it recognizes that the found item is the lost property of the owner. Since other configurations and operations are the same as those in the second embodiment, the same configurations and operations are designated by the same reference numerals and detailed description thereof will be omitted.

<< Ownership information notification operation sequence >>
FIG. 19 is a sequence diagram showing a procedure of possession information notification operation of the object management system 1900 according to the present embodiment. In FIG. 19, the same step numbers as those in FIG. 3B are assigned the same step numbers, and duplicate description will be omitted.

In step S1917, the object management server 1920 transmits the information of the found object to the owner's terminal 1950 based on the owner information registered in the object management database 221 to confirm the found object and confirm / set the possessed information. / Inquire about changes. In response to this inquiry, in step S1918 from the owner's terminal 1950, when there is a response such as confirmation of the found item or confirmation / setting / change of the owned information, the subsequent owned information to the found item management device 230. Proceed to send. If there is no response such as confirmation of the found item or confirmation / setting / change of the possession information, the possession information is not transmitted to the found item management device 230.

According to the present embodiment, since the personal information of the return destination of the found item is not disclosed by the found item management device without the consent of the owner, the confidentiality of the personal information is maintained. In addition, since the owner can confirm the found item, it can be easily determined whether the item is stolen or not. Furthermore, the processing of the found item can be flexibly changed at the time of finding.

[Fourth Embodiment]
Next, the object management system according to the fourth embodiment of the present invention will be described. In the object management system according to the present embodiment, as compared with the second and third embodiments, the owner registers the possession information of the object by a mobile terminal such as a smartphone or a communication terminal, and the founder finds the found item. It differs in that it can be processed. Since other configurations and operations are the same as those of the second embodiment or the third embodiment, the same configurations and operations are designated by the same reference numerals and detailed description thereof will be omitted.

《Object management system》
The configuration and operation of the object management system according to the present embodiment will be described with reference to FIGS. 20A to 21C.

(Social model)
FIG. 20A is a diagram showing a social model using the object management system 200 according to the present embodiment. In FIG. 20A, the same components as those in FIG. 2A are designated by the same reference numbers, and duplicate description will be omitted.

In FIG. 20A, the owner 251 registers the point identifier and the possession information of the possessed object at an arbitrary time and at an arbitrary place using a mobile terminal (smartphone or the like). In addition, the founder 2090 who has found the lost object decides to process the found item by using a mobile terminal (smartphone or the like) at an arbitrary time and at an arbitrary place. Therefore, if the point identifier of the point described in the found item and the point identifier of the point described in the property registered by the owner 251 match, the founder 2090 owns the item based on the associated ownership information. The found item can be delivered to the destination 250 including the return to the person 251 and the use of the founder 256. Then, when the ownership is not abandoned and the owner information and the delivery address information are not registered, the information is delivered to the found item handling office 230.

(Overview)
FIG. 20B is a diagram showing an outline of the object management system 2000 according to the present embodiment. In FIG. 20B, the same components as those in FIG. 2B or FIG. 2C are designated by the same reference numbers, and duplicate description will be omitted.

At the time of ownership information registration, the point identifier of the point 202 described in the property 201 is associated with the property information by the mobile terminal 2011 of the owner 251 and registered in the object management database 221 of the object management server 2020. The screen 2012 of the mobile terminal 2011 shows an example of the screen at the time of ownership information registration. Further, at the time of updating the possession information, the update possession information is registered in the object management database 221 of the object management server 2020 in association with the point identifier of the point 202 described in the possession 201 by the owner's mobile terminal 2011. The screen 2013 of the mobile terminal 2011 shows an example of the screen at the time of updating the possession information.

On the other hand, at the time of notification of possession information when an object is found, the point identifier of the point 202 described in the found item 201 is transmitted to the object management server 2020 by the mobile terminal 2091 of the founder 2090, and is registered corresponding to the matching point identifier. Get the owned information. The screen 2093 of the mobile terminal 2091 shows an example of a screen when inquiring about ownership information. Subsequently, when the finder's mobile terminal 2091 acquires the ownership information corresponding to the point identifier, for example, when there is no destination due to the waiver of ownership, the screen 2094 is displayed to notify that the finder can use it freely. In addition, if there is owner information due to maintenance of ownership, or if there is a delivery address due to waiver of ownership, the screen 2095 is displayed to notify the delivery address. In addition, if there is no delivery address due to maintenance of ownership, the screen changes to 2096 and a notification is given to the found item handling office. Notification information based on possession information is not limited to the above example.

In addition, the new point may be described and a new point identifier and possession information may be registered, or the possession information corresponding to the point identifier may be changed by the founder's mobile terminal 2091 or the destination device. Is also possible.

(Operation sequence)
FIG. 21A is a sequence diagram showing a procedure of possession information registration operation of the object management system 2000 according to the present embodiment. In FIG. 21A, the same steps as those in FIG. 3A are assigned the same step numbers, and duplicate description will be omitted.

In preparation for the operation of the object management system 2000, in step S2001, a point from which a point identifier can be extracted is assigned to the object. Then, in step S2013, the mobile terminal 2011 captures a point image for extracting the point identifier. The mobile terminal 2011 extracts the point identifier from the acquired point image in step S2015. Then, in step S2017, the mobile terminal 2011 acquires the possession information of the object to be registered as a response to the inquiry to the owner. In step S2019, the mobile terminal 2011 associates the extracted point identifier with the possession information and transmits the extracted point identifier to the object management server 2020. Then, upon receiving the notification of the registration completion from the object management server 2020, the mobile terminal 2011 reports the registration completion of the possession information in step S2023.

FIG. 21B is a sequence diagram showing a procedure of possession information update operation of the object management system 2000 according to the present embodiment.

In step S2121, the mobile terminal 2011 captures a point image for extracting a point identifier. In step S2123, the mobile terminal 2011 extracts the point identifier from the acquired point image and transmits it to the object management server 2020. In step S2125, the object management server 2020 determines whether or not the received point identifier has been registered in the object management database 221 and returns the determination result to the mobile terminal 2011.

In step S2127, the mobile terminal 2011 acquires the possession information of the object to be updated as a response to the inquiry to the owner. In step S2129, the mobile terminal 2011 associates the extracted point identifier with the update possession information and transmits it to the object management server 2020. In step S2131, the object management server 2020 updates the possession information corresponding to the point identifier. For example, the ownership information that has been set to maintain ownership may be updated to waiver ownership because it has been used for a predetermined period of time. Then, upon receiving the notification of the update completion from the object management server 2020, the mobile terminal 2011 reports the completion of the update of the possession information in step S2133.

When the mobile terminal 2011 does not have the function of extracting the point identifier from the point image, the object management server 2020 extracts the point identifier from the point image received from the mobile terminal 2011 in step S2135.

FIG. 21C is a sequence diagram showing a procedure of possession information notification operation of the object management system 2000 according to the present embodiment. In FIG. 21C, the same steps as in FIG. 3B are assigned the same step numbers, and duplicate description will be omitted.

In step S2141, the mobile terminal 2091 acquires a point image for extracting a point identifier. The mobile terminal 2091 extracts a point identifier from the acquired point image in step S2143. Then, the mobile terminal 2091 transmits the extracted point identifier to the object management server 2020 in step S2145.

Then, when the mobile terminal 2091 receives the possession information corresponding to the transmitted point identifier, in step S2151, the mobile terminal 2091 notifies the founder of the possession information and notifies the object management server 2020 of the completion of the notification.

When reducing the load on the mobile terminal 2091, the object management server 2020 may be configured to extract the point identifier. In that case, the object management server 2020 may be configured to extract points from the point image transmitted from the mobile terminal 2091 in step S2155. The identifier is extracted.

In this way, the founder, for example, delivers the found item whose ownership is not relinquished to the owner, or delivers the found item whose ownership has been relinquished to the designated destination, or by himself / herself. You can decide the disposal.

<< Smartphone function configuration >>
FIG. 22 is a block diagram showing a functional configuration of a smartphone as a mobile terminal 2011 according to the present embodiment. In FIG. 22, the functional component having the same name as that of FIG. 6A or FIG. 7 fulfills the same function.

The mobile terminal 2011 includes a communication control unit 2201, an object management application 2202, a point image imaging unit 2203 into which a point image that is a source of a point identifier is input, a display unit 2205, and an operation unit 2204.

The communication control unit 2201 controls communication with the object management server 2020 via the network. The point image imaging unit 2203 includes a high-resolution camera such as a microscope camera that captures a point image that is the source of the point identifier.

The object management application 2202 includes a point identifier acquisition unit 2221 that acquires a point identifier that identifies an object, and a point identifier transmission unit 2222 that transmits the point identifier to the object management server 2020. Further, the possession information acquisition unit 2223 for acquiring the possession information corresponding to the object and the possession information transmission unit 2224 for transmitting the possession information to the object management server 2020 in association with the point identifier are provided. The object management application 2202 further receives the fact that the point identifier and the ownership information are associated with the object management database 221 from the object management server 2020 and the registration is completed, or the update is completed. A completion receiving unit 2225 is provided. In addition, the ownership information registration (update) completion processing unit 2226 that processes the registration completion or the update completion is provided.

Further, the object management application 2202 includes an ownership information receiving unit 2227 that receives the possession information corresponding to the point identifier of the found object from the object management server 2020, and a notification of the distribution destination of the object corresponding to the possession information to the display unit 722. 2228 of the ownership information notification unit that performs the processing of the above.

(Point identifier acquisition section)
Since the functional configuration of the point identifier acquisition unit 2221 in FIG. 22 is the same as that of FIG. 6B, duplicate illustrations and explanations will be omitted.

《Smartphone hardware configuration》
FIG. 23 is a block diagram showing a hardware configuration of a smartphone as a mobile terminal 2011 according to the present embodiment.

In FIG. 23, the CPU 2310 is a processor for arithmetic control, and realizes the functional components of FIGS. 22 and 6B by executing a program. The number of CPUs 2310 may be one or plural. The ROM 2320 stores fixed data and programs such as initial data and programs. The network interface 2330 controls communication with the object management server 2020 via the network.

The RAM 2340 is a random access memory used by the CPU 2310 as a temporary storage work area. The RAM 2340 has an area for storing data necessary for realizing the present embodiment. The object registration information 2341 is data used for registering the point identifier extracted from the point image described on the object and the corresponding possession information. The registration information 2341 of the object includes a point image of the object, a point identifier of the object, and possession information of the object. The registration completion information 2342 is data indicating that the registration process in which the point identifier of the object and the possession information are associated with each other is completed. The found item management information 2343 is data used for acquiring the possession information corresponding to the found item. The found item management information 2343 includes a point identifier extracted from the point image described in the found item and possession information acquired in association with the point identifier. The distribution management information 2344 of the object is data indicating where to deliver the object. The distribution management information 2344 of the object includes the owner information, the object delivery destination information, and the ownership waiver flag.

The storage 2350 stores a database and various parameters used by the CPU 2310, or the following data or programs necessary for realizing the present embodiment. The point identifier extraction algorithm 2351 is a point identifier extraction algorithm used by the mobile terminal 2011 to perform the point identifier extraction function. The following programs are stored in the storage 2350. The mobile terminal control program 2352 is a program that controls the entire mobile terminal 2011. The object management application 2202 is a program for performing object registration and found item management as a mobile terminal 2011. The object management application 2202 includes a point identifier extraction module that extracts a point identifier from a point image, and an ownership information registration module for registering possession information in the object management database 221. Further, the object management application 2202 includes an possession information acquisition module for acquiring the possession information of the found object and an object distribution management module for managing the distribution of the object based on the acquired possession information.

The input / output interface 2360 provides an interface for controlling data input / output with an input / output device. In the present embodiment, as shown in FIG. 22, the input / output interface 2360 is connected to a point image imaging unit 2203 such as a camera, a display unit 2205, an operation unit 2204, and the like.

The RAM 2340 and the storage 2350 of FIG. 23 do not show programs or data related to general-purpose functions and other feasible functions of the mobile terminal 2011.

《Smartphone processing procedure》
FIG. 24 is a flowchart showing a processing procedure of a smartphone as a mobile terminal 2011 according to the present embodiment. This flowchart is executed by the CPU 2310 of FIG. 23 using the RAM 2340 to realize the functional configuration unit of FIG. 22.

In step S2411, the mobile terminal 2011 determines whether or not the possession information is registered. If it is determined that the possession information registration process is performed, the mobile terminal 2011 acquires a point image described on the object in step S2413. In step S2415, the mobile terminal 2011 extracts the point identifier from the point image. In step S2417, the mobile terminal 2011 acquires the possession information corresponding to the object. Then, in step S2419, the mobile terminal 2011 transmits the possession information to the object management server 2020 in association with the point identifier.

The mobile terminal 2011 waits for the completion of registration in step S2421, and when the registration is completed, notifies the completion of registration in step S2423.

If it is determined that it is not the possession information registration process, the mobile terminal 2011 determines in step S2431 whether or not it is the possession information notification process. If it is determined that the possession information notification process is performed, the mobile terminal 2011 captures a point image described on the object (found item) in step S2433. The mobile terminal 2011 extracts the point identifier from the point image in step S2435. In step S2437, the mobile terminal 2011 transmits the point identifier to the object management server 2020.

In steps S2439 and S2441, the mobile terminal 2011 waits for the reception of the possession information corresponding to the point identifier. When the possession information corresponding to the point identifier is received, the mobile terminal 2011 generates and notifies a predetermined distribution management message based on the received possession information in step S2443. If the possession information corresponding to the point identifier is not received, the mobile terminal 2011 determines the timeout in step S2441. When the possession information corresponding to the point identifier is not received and the time-out occurs, the mobile terminal 2011 notifies in step S2445 that the point identifier or the possession information is not registered.

In FIG. 24, the process of updating the possession information is basically similar to the process of registering the possession information, and therefore complicated illustrations and explanations will be omitted.

According to the present embodiment, the user can easily operate an individual at any place at any time without being limited to a fixed time at a fixed place such as an object sales place or a found item handling office. It is possible to register / update / notify the possession information without leaking the information.

[Fifth Embodiment]
Next, the object management system according to the fifth embodiment of the present invention will be described. The object management system according to the present embodiment is different from the second to fourth embodiments in that it efficiently manages points according to the circulating distribution of the object. Since other configurations and operations are the same as those in the second to fourth embodiments, the same configurations and operations are designated by the same reference numerals and detailed description thereof will be omitted.

《Object management system》
The configuration and operation of the object management system of the present embodiment will be described with reference to FIGS. 25 and 26.

(Social model)
FIG. 25 is a diagram showing a social model using the object management system 2500 according to the present embodiment. In FIG. 25, the same components as those in FIG. 2A are designated by the same reference numbers, and duplicate description will be omitted.

The elements constituting FIG. 25 are the same as those in FIG. 2A. However, in the processing of each component, points are given to the user to increase the incentive for the processing, and as a result, the object is circulated and used, so that the resource is left unused. Can be shortened.

For example, in the object store 210, in addition to the purchase points of the object, points when the ownership waiver is set, points corresponding to the provider when the provider is set, and the like are added. On the other hand, the accumulated points are deducted as the object purchase cost. Although not specified in FIG. 25 because it is complicated, the manufacturer, the distributor 254, the recycler, and the rental agent 255 can also function as the object dealer 210, and the object whose price has decreased is further circulated. It will be.

In the lost property finder 290, the found point and the found item delivery point are added by acquiring the possession information by the mobile terminal and delivering it to the destination. In addition, when the founder 290 of the lost item delivers the acquired item to the found item handling office 230, the found item is added.

Although only a limited number of points addition / subtraction is shown in FIG. 25, the point addition can be suitably managed so that the object does not stay unused.

(Operation sequence)
FIG. 26 is a sequence diagram showing a procedure of the point management operation of the object management system 2500 according to the present embodiment. The motion sequence of FIG. 26 is processed in conjunction with or independently of the motion sequences of FIGS. 3A and 3B to increase the incentive for the circulation processing of the object shown in FIG. 25. In FIG. 26, the operations having the same step number are related operations. Further, in FIG. 26, both the point management in which points are stored in the mobile terminal 2011 or the user card and the collective management of points by the object management server 2620 by the user ID are shown, but only one point management is shown. It may be.

In step S2601, the sales management device 210 subtracts the object purchase price. In step S2603, the object purchase points are added by the sales management device 210. In step S2605, points are added by the sales management device 210 corresponding to the registration of the ownership information. For example, if you register a waiver of ownership if it is lost and found, points will be added.

Further, in step S2611, if there is an inquiry about the possession information of the found item by the point identifier from the mobile terminal 2091 or the found item management device 230, points are added. Further, in step S2613, if there is a report that the found item has been delivered from the mobile terminal 2091 or the found item destination management device 2650, points are added.

Further, in step S2621, when, for example, a recycled object is purchased by the sales management device 210, the purchase price is subtracted. In step S2623, if the possession information is newly registered for the purchased recycled object, points are added.

<< Functional configuration of object management server >>
FIG. 27 is a block diagram showing a functional configuration of the object management server 2620 as the information processing device according to the present embodiment. In FIG. 27, the same functional components as those in FIG. 4A are designated by the same reference numbers, and duplicate description will be omitted.

The object management server 2620 includes an object purchase point addition / subtraction unit 2708 that adds or subtracts points at the time of object purchase, and an object acquisition point addition / subtraction unit 2709 that adds or subtracts points at the time of object acquisition. In addition, a point addition / subtraction unit 2710 for selling recycled objects is provided, which adds or subtracts points when selling recycled objects. Then, the object management server 2620 includes a point management database 2711 for managing points in association with each user ID.

(Point management database)
FIG. 28 is a diagram showing the configuration of the point management database 2711 according to the present embodiment. The point management database 2711 includes a point number setting table 2810 for setting the number of points to be provided to the user, and a point storage table 2820 for storing the points of each user.

The point number setting table 2810 stores the number of purchase points 2812 for each object, the number of ownership abandonment points 2813, the number of object acquisition points 2814, and the number of object delivery points 2815 in association with the object ID 2811.

The point storage table 2820 stores the current number of points 2822 in association with the user ID 2821.

<< Hardware configuration of object management server >>
FIG. 29 is a block diagram showing a hardware configuration of an object management server 2620 as an information processing device according to the present embodiment. In FIG. 29, the same components as those in FIG. 13 are designated by the same reference numbers, and duplicate description will be omitted.

The point management data 2948 is stored in the RAM 2940. The point management data 2948 includes a user ID and the number of addition / subtraction points.

The point management database 2711 and the point management module 2956 are stored in the storage 2950.

(Procedure of point management process)
FIG. 30 is a flowchart showing a procedure of point management processing of the object management server 2620 as an information processing device according to the present embodiment. This flowchart is executed by the CPU 1310 of FIG. 29 using the RAM 2940 to realize the functional configuration unit of FIG. 27.

In step S3001, the object management server 2620 determines whether or not it is point management. In the case of point management, the object management server 2620 acquires the object ID and the user ID in step S3003.

In step S3011, the object management server 2620 determines whether or not the object is purchased. At the time of purchasing the object, the object management server 2620 acquires the number of points corresponding to the object ID in step S3013. Then, the object management server 2620 adds the acquired object purchase points to the points of the user ID in step S3015. Further, in step S3017, the object management server 2620 adds the points corresponding to the acquired possession information to the points of the user ID.

If it is not the time when the object is purchased, the object management server 2620 determines in step S3021 whether or not the object is picked up. When the object is picked up, the object management server 2620 acquires the number of points corresponding to the object ID in step S3023. Then, the object management server 2620 adds the acquired object acquisition points to the points of the user ID in step S3025.

If it is not the time of purchasing the object but the time of picking up the object, the object management server 2620 determines in step S3031 whether or not the object is delivered to the destination. At the time of delivery of the object, the object management server 2620 acquires the number of points corresponding to the object ID in step S3033. Then, the object management server 2620 adds the acquired object delivery points to the points of the user ID in step S3035.

According to the present embodiment, by giving points to the user, the incentive for the circulation of the object is increased, and as a result, the time when the resource is left unused can be shortened, and the effective use of the resource is easy. It will be possible to realize it by various operations.

[Other Embodiments]
Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made within the scope of the present invention in terms of the structure and details of the present invention. Also included in the scope of the present invention are systems or devices in any combination of the different features contained in each embodiment.

Further, the present invention may be applied to a system composed of a plurality of devices, or may be applied to a single device. Furthermore, the present invention is also applicable when the information processing program that realizes the functions of the embodiment is supplied directly or remotely to the system or device. Therefore, in order to realize the functions of the present invention on a computer, a program installed on the computer, a medium containing the program, and a WWW (World Wide Web) server for downloading the program are also included in the scope of the present invention. .. In particular, at least a non-transitory computer readable medium containing a program that causes a computer to execute the processing steps included in the above-described embodiment is included in the scope of the present invention.

[Other expressions of the embodiment]
Some or all of the above embodiments may also be described, but not limited to:

(Appendix 1)
A registration means for registering a point identifier extracted from a point written on an object with a writing instrument and the possession information of the object in association with each other.
An imaging means for imaging the points and
A collation means for collating a point identifier extracted from a point imaged by the imaging means with a point identifier registered in the registration means.
A distribution management means that manages the distribution of the object based on the possession information of the object when the point identifiers match.
An object management system equipped with.

(Appendix 2)
As the place where the point is described on the object, the place where the object is manufactured, the place where the object is delivered, the place where the object is sold, or the point identifier associated with the object should be registered. The object management system according to Appendix 1, which is an arbitrary location.

(Appendix 3)
The object management system according to Appendix 1, wherein the place where the point identifier is registered in the registration means is a place where the object is sold or an arbitrary place where the point identifier associated with the object should be registered.

(Appendix 4)
The object management system according to Appendix 1, wherein the place where the point identifier is collated by the collation means is a place where the object is found or a place where the found object is managed.

(Appendix 5)
As the place where the point is described on the object, the place where the object is manufactured, the place where the object is delivered, the place where the object is sold, or the point identifier associated with the object should be registered. Any place,
The place where the point identifier is registered in the registration means is a place where the object is sold or an arbitrary place where the point identifier associated with the object should be registered.
The object management system according to Appendix 1, wherein the place where the point identifier is collated by the collation means is a place where the object is found or a place where the found object is managed.

(Appendix 6)
The point identifier extracted from the points written on the object with a writing instrument and the possession information of the object are associated and registered in the memory.
An imaging step of capturing the above points with an imaging device,
The point identifier extracted from the points imaged by the imaging device is collated with the point identifier registered in the memory.
When the point identifiers match, the distribution of the object is managed based on the possession information of the object.
Object management method.

(Appendix 7)
As the place where the point is described on the object, the place where the object is manufactured, the place where the object is delivered, the place where the object is sold, or the point identifier associated with the object should be registered. The object management method according to Appendix 6, which is an arbitrary location.

(Appendix 8)
The object management method according to Appendix 6, wherein the place where the point identifier is registered in the memory is a place where the object is sold or an arbitrary place where the point identifier associated with the object should be registered.

(Appendix 9)
The place where the point identifier is collated is the place where the object is found or the place where the found item is managed. The object management method according to Appendix 6.

(Appendix 10)
As the place where the point is described on the object, the place where the object is manufactured, the place where the object is delivered, the place where the object is sold, or the point identifier associated with the object should be registered. Any place,
The place where the point identifier is registered in the memory is a place where the object is sold or an arbitrary place where the point identifier associated with the object should be registered.
The place where the point identifier is collated is the place where the object is found or the place where the found item is managed. The object management method according to Appendix 6.

(Appendix 11)
A registration process of associating a point identifier extracted from a point written on an object with a writing instrument and possession information of the object and registering the object in a memory.
Collation processing for collating the point identifier extracted from the points captured by the imaging means with the point identifier registered in the memory.
A distribution management process that manages the distribution of the object based on the possession information of the object when the point identifiers match.
A storage medium that stores an object management program that causes a computer to execute.

(Appendix 12)
As the place where the point is described on the object, the place where the object is manufactured, the place where the object is delivered, the place where the object is sold, or the point identifier associated with the object should be registered. The storage medium according to Appendix 11, which is an arbitrary location.

(Appendix 13)
The storage medium according to Appendix 11, wherein the place where the point identifier is registered in the memory is a place where the object is sold or an arbitrary place where the point identifier associated with the object should be registered.

(Appendix 14)
The storage medium according to Appendix 11, wherein the place where the point identifier is collated is a place where the object is found or a place where the found item is managed.

(Appendix 15)
As the place where the point is described on the object, the place where the object is manufactured, the place where the object is delivered, the place where the object is sold, or the point identifier associated with the object should be registered. Any place,
The place where the point identifier is registered in the memory is a place where the object is sold or an arbitrary place where the point identifier associated with the object should be registered.
The storage medium according to Appendix 11, wherein the place where the point identifier is collated is a place where the object is found or a place where the found item is managed.

(Appendix 16)
A registration means for registering a point identifier extracted from a point written on an object with a writing instrument and the possession information of the object in a memory in association with each other.
The first receiving means for receiving the point identifier extracted from the points captured by the imaging means, and
A collation means for collating the received point identifier with the registered point identifier,
A distribution management means that manages the distribution of the object based on the possession information of the object when the point identifiers match.
Information processing device equipped with.

(Appendix 17)
The possession information of the object is information for identifying the owner of the object.
The information processing device according to Appendix 16, wherein the distribution management means instructs the owner to deliver the object.

(Appendix 18)
The possession information of the object is information for specifying the delivery destination of the object.
The information processing device according to Appendix 16 or 17, wherein the distribution control means instructs the object to be delivered to the destination.

(Appendix 19)
The ownership information of the object is information indicating that the owner of the object relinquishes ownership.
The information processing apparatus according to any one of Appendix 16 to 18, wherein the distribution management means manages the object on the assumption that the ownership of the owner has been abandoned.

(Appendix 20)
Appendix 16 to 16 to further include an update means for updating the possession information of the object registered in the registration means when the same point identifier as the point identifier received by the first receiving means is registered in the registration means. The information processing apparatus according to any one of 19.

(Appendix 21)
A second receiving means for receiving the point identifier and the possession information of the object in association with each other is further provided.
The information processing apparatus according to any one of Appendix 16 to 20, wherein the registration means registers the received point identifier and the possession information of the object in association with each other.

(Appendix 22)
The first receiving means and the second receiving means receive the point image of the point and receive the point image.
The information processing device according to Appendix 21, further comprising an extraction means for extracting the point identifier from the received point image.

(Appendix 23)
At least, when the possession information of the object is registered in the memory, when the point identifiers match by collation by the collation means, and when the object is delivered to the delivery destination based on the possession information of the object. The information processing apparatus according to any one of Appendix 16 to 22, further comprising a granting means for granting points to the user.

(Appendix 24)
The point identifier extracted from the points written on the object with a writing instrument and the possession information of the object are associated and registered in the memory.
Receives the point identifier extracted from the points captured by the image pickup device and receives
The received point identifier is collated with the registered point identifier, and the point identifier is collated.
When the point identifiers match, the distribution of the object is managed based on the possession information of the object.
Information processing method.

(Appendix 25)
The possession information of the object is information for identifying the owner of the object.
The information processing method according to Appendix 24, which instructs the owner to deliver the object.

(Appendix 26)
The possession information of the object is information for specifying the delivery destination of the object.
The information processing method according to Appendix 24 or 25, which instructs the object to be delivered to the destination.

(Appendix 27)
The ownership information of the object is information indicating that the owner of the object relinquishes ownership.
The information processing method according to any one of Appendix 24 to 26, which manages the object as if the ownership of the owner has been abandoned.

(Appendix 28)
The information processing method according to any one of Appendix 24 to 27, which updates the possession information of the object registered in the memory when the same point identifier as the received point identifier is registered in the memory.

(Appendix 29)
The point identifier and the possession information of the object are associated with each other and received.
The information processing method according to any one of Supplementary note 24 to 28, wherein the received point identifier and the possession information of the object are registered in association with each other.

(Appendix 30)
Receive the point image of the point and
The information processing method according to Appendix 29, which extracts the point identifier from the received point image.

(Appendix 31)
At least, points are given to the user when the possession information of the object is registered in the memory, when the point identifiers match by collation, and when the object delivers to the destination based on the possession information of the object. The information processing method according to any one of the appendices 24 to 30 to be given.

(Appendix 32)
A registration process of associating a point identifier extracted from a point written on an object with a writing instrument and possession information of the object and registering the object in a memory.
The first reception process for receiving the point identifier extracted from the points captured by the image pickup device, and
A collation process for collating the received point identifier with the registered point identifier,
A distribution management process that manages the distribution of the object based on the possession information of the object when the point identifiers match.
A storage medium that stores an information processing program that causes a computer to execute information processing programs.

(Appendix 33)
The possession information of the object is information for identifying the owner of the object.
The storage medium according to Appendix 32, wherein the distribution management process instructs the object to be delivered to the owner.

(Appendix 34)
The possession information of the object is information for specifying the delivery destination of the object.
The storage medium according to Appendix 32 or 33, wherein the distribution management process instructs the object to be delivered to the destination.

(Appendix 35)
The ownership information of the object is information indicating that the owner of the object relinquishes ownership.
The storage medium according to any one of Appendix 32 to 34, wherein the distribution management process manages the object as if the ownership of the owner has been abandoned.

(Appendix 36)
Addendums 32 to 35 further include an update process for updating the possession information of the object registered in the memory when the same point identifier as the point identifier received by the first reception process is registered in the memory. The storage medium according to any one of the items.

(Appendix 37)
The information processing program causes the computer to further execute a second reception process for receiving the point identifier and the possession information of the object in association with each other.
The storage medium according to any one of Supplementary note 32 to 36, wherein the registration process registers the received point identifier and the possession information of the object in association with each other.

(Appendix 38)
The first reception process and the second reception process receive the point image of the point and receive the point image.
The storage medium according to Appendix 37, wherein the information processing program further causes a computer to perform an extraction process for extracting the point identifier from the received point image.

(Appendix 39)
At least, when the possession information of the object is registered in the memory, when the point identifiers match by collation by the collation process, and when the object delivers to the delivery destination based on the possession information of the object. The storage medium according to any one of Supplementary note 32 to 38, wherein the computer further executes a granting process for granting points to the user.

(Appendix 40)
A point identifier acquisition means for acquiring a first point identifier extracted from a point written on an object with a writing instrument, and
A point identifier transmitting means for transmitting the first point identifier to the information processing device, and
Ownership of the object associated with the second point identifier, notified by the information processing device when a second point identifier matching the first point identifier is registered in the registration means of the information processing device. Ownership information receiving means for receiving ownership information about
A notification means for notifying the delivery destination of the object based on the received possession information, and
Communication terminal equipped with.

(Appendix 41)
The possession information includes at least one of information that identifies the owner of the object, information that identifies the destination of the object, and information that indicates that the owner of the object relinquishes ownership. The communication terminal according to 40.

(Appendix 42)
Obtain the first point identifier extracted from the points written on the object with a writing instrument,
The first point identifier is transmitted to the information processing device,
Regarding possession of the object associated with the second point identifier, which is notified from the information processing device when a second point identifier matching the first point identifier is registered in the memory of the information processing device. Receive ownership information,
Notify the delivery destination of the object based on the received possession information.
Communication terminal control method.

(Appendix 43)
The possession information includes at least one of information that identifies the owner of the object, information that identifies the destination of the object, and information that indicates that the owner of the object relinquishes ownership. 42. The communication terminal control method.

(Appendix 44)
Point identifier acquisition processing to acquire the first point identifier extracted from the points written on the object with a writing instrument, and
The point identifier transmission process for transmitting the first point identifier to the information processing device, and
Regarding possession of the object associated with the second point identifier, which is notified from the information processing device when a second point identifier matching the first point identifier is registered in the memory of the information processing device. Ownership information reception processing to receive ownership information,
Notification processing for notifying the delivery destination of the object based on the received possession information,
A storage medium that stores application programs of communication terminals that cause a computer to execute.

(Appendix 45)
The possession information includes at least one of information that identifies the owner of the object, information that identifies the destination of the object, and information that indicates that the owner of the object relinquishes ownership. 44. The storage medium.

Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made within the scope of the present invention in terms of the structure and details of the present invention.

This application claims priority on the basis of Japanese application Japanese Patent Application No. 2017-232793 filed on December 4, 2017, and incorporates all of its disclosures herein.

100 Object management system 101 Registration unit 102 Imaging unit 103 Matching unit 104 Distribution management unit 111 Point identifier 112 Ownership information 120 Object 121 point 141 Ownership information 200 Object management system 201 Object, found item, property, umbrella 202 point 203 grain 210 sale Management device, object store 211 Sales management terminal, POS terminal 212 Point image image capture unit 213 Screen 214 Screen 215 Screen 220 Object management server 221 Lost and found database 230 Found item management device, found item handling office 231 Found item management terminal 232 point image Imaging unit 233 Screen 234 Screen 236 Screen 237 Screen 240 Found item storage 250 Destination 251 Owner 252 Donor 254 Manufacturer / Distributor 255 Rental company 256 Use 260 Writing tool 261 Ink 271 Description material 272 Description medium 273 Imaging method 274 Feature extraction Method 290 Founder 401 Communication control unit 402 Sales information receiving unit 403 Sales information registration unit 404 Found information receiving unit 405 Point identifier collating unit 406 Owner information acquisition unit 407 Owner information transmission unit 421 Point identifier acquisition unit 422 Owner information acquisition unit 441 points Identifier acquisition unit 451 Point image acquisition unit 452 Point identifier extraction unit 453 Point identifier reception unit 511 Point identifier 512 Ownership information 601 Communication control unit 602 Input / output interface 603 Sales information acquisition unit 604 Sales information transmission unit 606 Ownership information registration completed reception unit 607 Ownership information registration completion processing unit 611 Object management application 622 Display unit 623 Operation unit 631 Point identifier acquisition unit 632 Ownership information acquisition unit 641 Point identifier transmission unit 642 Ownership information transmission unit 651 Point image acquisition unit 652 Point identifier extraction unit 653 Point image reception Unit 701 Communication control unit 702 I / O interface 703 Found information acquisition unit 704 Found information transmission unit 706 Lost and found information receiving unit 707 Lost and found information notification unit 711 Found item management application 722 Display unit 723 Operation unit 731 Point identifier acquisition unit 741 Point identifier transmission unit 832 Image storage unit 833 Coordinate system determination unit 834 Normalized image generation unit 835 Normalized image storage unit 836 Fixed area determination unit 837 Feature extraction unit 838 Area determination unit 951 Low resolution unit 952 Low resolution image storage unit 953 Keeppoint Scale detection unit 954 Direction detection unit 955 Statistical processing unit 961 Binarization unit 962 Binarization image storage unit 963 Image generation unit 964 Image Storage unit 965 Shape processing unit 1053 Sales information generation module 1133 Point area determination unit 1134 Feature amount extraction unit 1233 First feature amount extraction unit 1234 Second feature amount extraction unit 1235 Feature amount integration unit 1330 Network interface 1341 Point identifier 1342 Owned Information 1343 Point identifier 1344 Point identifier 1345 Matching result 1346 Ownership information 1347 Transmission / reception data 1350 Storage 1351 Object management server control program 1352 Sales information acquisition module 1353 Found information acquisition module 1354 Point identifier verification module 1355 Ownership information notification module 1530 Network interface 1541 Settlement result 1542 Point image 1543 Point identifier 1544 Ownership information 1545 Ownership information setting completion information 1546 Transmission / reception data 1547 Input / output data 1550 Storage 1551 Point identifier extraction algorithm 1552 Sales management device control program 1730 Network interface 1741 Point image 1742 Point identifier 1743 Ownership information 1744 Transmission / reception data 1745 Input / output data 1750 Storage 1715 Point identifier extraction algorithm 175 Found object management device control program 1753 Found information generation module 1754 Ownership information notification module 1900 Object management system 1920 Object management server 1950 Terminal 2000 Object management system 2011 Mobile terminal 2012 Screen 2013 Screen 2020 Object management server 2090 Founder 2091 Mobile terminal 2093 Screen 2094 Screen 2095 Screen 2096 Screen 2201 Communication control unit 2202 Object management application 2203 Point image imaging unit 2204 Operation unit 2205 Display unit 2221 Point identifier acquisition unit 2222 Point identifier transmission unit 2223 Ownership information acquisition Part 2224 Owner information transmission unit 2225 Owner information registration (update) completion Reception unit 2226 Owner information registration (update) completion Processing unit 2227 Owner information reception unit 2228 Owner information notification unit 2330 Network interface 2341 Registration information 2342 Registration completion information 2343 Management information 2344 Distribution management information 2350 Storage 2351 Point identifier extraction algorithm 2352 Mobile terminal control program 2360 Input / output interface 2500 Object management system 2620 Object management server 2650 Found item destination management device 2708 When purchasing an object Point addition / subtraction unit 2709 Point addition / subtraction unit when an object is picked up 2710 Point addition / subtraction unit when a recycled object is sold 2711 Point management database 2810 Point number setting table 2820 Point storage table 2948 Point management data 2950 Storage 2965 Point management module

Claims (45)

A registration means for registering a point identifier extracted from a point written on an object with a writing instrument and the possession information of the object in association with each other.
An imaging means for imaging the points and
A collation means for collating a point identifier extracted from a point imaged by the imaging means with a point identifier registered in the registration means.
A distribution management means that manages the distribution of the object based on the possession information of the object when the point identifiers match.
An object management system equipped with. As the place where the point is described on the object, the place where the object is manufactured, the place where the object is delivered, the place where the object is sold, or the point identifier associated with the object should be registered. The object management system according to claim 1, which is an arbitrary location. The object management system according to claim 1, wherein the place where the point identifier is registered in the registration means is a place where the object is sold or an arbitrary place where the point identifier associated with the object should be registered. The object management system according to claim 1, wherein the place where the point identifier is collated by the collation means is a place where the object is found or a place where the found object is managed. As the place where the point is described on the object, the place where the object is manufactured, the place where the object is delivered, the place where the object is sold, or the point identifier associated with the object should be registered. Any place,
The place where the point identifier is registered in the registration means is a place where the object is sold or an arbitrary place where the point identifier associated with the object should be registered.
The object management system according to claim 1, wherein the place where the point identifier is collated by the collation means is a place where the object is found or a place where the found object is managed. The point identifier extracted from the points written on the object with a writing instrument is associated with the possession information of the object and registered in the registration means.
The point is imaged by an imaging means,
The point identifier extracted from the points imaged by the imaging means is collated with the point identifier registered in the registration means, and the point identifier is collated.
When the point identifiers match, the distribution of the object is managed based on the possession information of the object.
Object management method. As the place where the point is described on the object, the place where the object is manufactured, the place where the object is delivered, the place where the object is sold, or the point identifier associated with the object should be registered. The object management method according to claim 6, which is an arbitrary place. The object management method according to claim 6, wherein the place where the point identifier is registered in the registration means is a place where the object is sold or an arbitrary place where the point identifier associated with the object should be registered. The object management method according to claim 6, wherein the place where the point identifier is collated is a place where the object is found or a place where the found item is managed. As the place where the point is described on the object, the place where the object is manufactured, the place where the object is delivered, the place where the object is sold, or the point identifier associated with the object should be registered. Any place,
The place where the point identifier is registered in the registration means is a place where the object is sold or an arbitrary place where the point identifier associated with the object should be registered.
The object management method according to claim 6, wherein the place where the point identifier is collated is a place where the object is found or a place where the found item is managed. A registration process of associating a point identifier extracted from a point written on an object with a writing instrument and possession information of the object and registering the object in a registration means.
Collation processing for collating the point identifier extracted from the points captured by the imaging means with the point identifier registered in the registration means.
A distribution management process that manages the distribution of the object based on the possession information of the object when the point identifiers match.
A storage medium that stores an object management program that causes a computer to execute. As the place where the point is described on the object, the place where the object is manufactured, the place where the object is delivered, the place where the object is sold, or the point identifier associated with the object should be registered. The storage medium according to claim 11, which is an arbitrary location. The storage medium according to claim 11, wherein the place where the point identifier is registered in the registration means is a place where the object is sold or an arbitrary place where the point identifier associated with the object should be registered. The storage medium according to claim 11, wherein the place where the point identifier is collated is a place where the object is found or a place where the found item is managed. As the place where the point is described on the object, the place where the object is manufactured, the place where the object is delivered, the place where the object is sold, or the point identifier associated with the object should be registered. Any place,
The place where the point identifier is registered in the registration means is a place where the object is sold or an arbitrary place where the point identifier associated with the object should be registered.
The storage medium according to claim 11, wherein the place where the point identifier is collated is a place where the object is found or a place where the found item is managed. A registration means for registering a point identifier extracted from a point written on an object with a writing instrument and the possession information of the object in association with each other.
The first receiving means for receiving the point identifier extracted from the points captured by the imaging means, and
A collation means for collating the received point identifier with the registered point identifier,
A distribution management means that manages the distribution of the object based on the possession information of the object when the point identifiers match.
Information processing device equipped with. The possession information of the object is information for identifying the owner of the object.
The information processing device according to claim 16, wherein the distribution management means instructs the owner to deliver the object. The possession information of the object is information for specifying the delivery destination of the object.
The information processing device according to claim 16 or 17, wherein the distribution management means instructs the object to be delivered to the destination. The ownership information of the object is information indicating that the owner of the object relinquishes ownership.
The information processing device according to any one of claims 16 to 18, wherein the distribution management means manages the object as if the ownership of the owner has been abandoned. 16. Claim 16 further comprising an updating means for updating the possession information of the object registered in the registration means when the same point identifier as the point identifier received by the first receiving means is registered in the registration means. The information processing apparatus according to any one of 19 to 19. A second receiving means for receiving the point identifier and the possession information of the object in association with each other is further provided.
The information processing device according to any one of claims 16 to 20, wherein the registration means registers the received point identifier and the possession information of the object in association with each other. The first receiving means and the second receiving means receive the point image of the point and receive the point image.
The information processing device according to claim 21, wherein the information processing device further includes an extraction means for extracting the point identifier from the received point image. At least, when the possession information of the object is registered in the registration means, when the point identifiers match by collation by the collation means, and when the object delivers to the destination based on the possession information of the object. The information processing apparatus according to any one of claims 16 to 22, further comprising a granting means for granting points to the user. The point identifier extracted from the points written on the object with a writing instrument is associated with the possession information of the object and registered in the registration means.
Receives the point identifier extracted from the points captured by the imaging means and receives
The received point identifier is collated with the registered point identifier, and the point identifier is collated.
When the point identifiers match, the distribution of the object is managed based on the possession information of the object.
Information processing method. The possession information of the object is information for identifying the owner of the object.
The information processing method according to claim 24, which instructs the owner to deliver the object. The possession information of the object is information for specifying the delivery destination of the object.
The information processing method according to claim 24 or 25, which instructs the object to be delivered to the destination. The ownership information of the object is information indicating that the owner of the object relinquishes ownership.
The information processing method according to any one of claims 24 to 26, wherein the object is managed as if the ownership of the owner has been abandoned. The information according to any one of claims 24 to 27, which updates the possession information of the object registered in the registration means when the same point identifier as the received point identifier is registered in the registration means. Processing method. The point identifier and the possession information of the object are associated with each other and received.
The information processing method according to any one of claims 24 to 28, wherein the received point identifier and the possession information of the object are registered in association with each other. Receive the point image of the point and
The information processing method according to claim 29, wherein the point identifier is extracted from the received point image. At least, points are given to the user when the possession information of the object is registered in the registration means, when the point identifiers match by collation, and when the object is delivered to the delivery destination based on the possession information of the object. The information processing method according to any one of claims 24 to 30. A registration process of associating a point identifier extracted from a point written on an object with a writing instrument and possession information of the object and registering the object in a registration means.
The first reception process of receiving the point identifier extracted from the points captured by the imaging means, and
A collation process for collating the received point identifier with the registered point identifier,
A distribution management process that manages the distribution of the object based on the possession information of the object when the point identifiers match.
A storage medium that stores an information processing program that causes a computer to execute information processing programs. The possession information of the object is information for identifying the owner of the object.
The storage medium according to claim 32, wherein the distribution management process instructs the object to be delivered to the owner. The possession information of the object is information for specifying the delivery destination of the object.
The storage medium according to claim 32 or 33, wherein the distribution management process instructs the object to be delivered to the destination. The ownership information of the object is information indicating that the owner of the object relinquishes ownership.
The storage medium according to any one of claims 32 to 34, wherein the distribution management process manages the object on the assumption that the ownership of the owner has been abandoned. 32. Claim 32 further comprising an update process for updating the possession information of the object registered in the registration means when the same point identifier as the point identifier received by the first reception process is registered in the registration means. The storage medium according to any one of 35 to 35. The information processing program causes the computer to further execute a second reception process for receiving the point identifier and the possession information of the object in association with each other.
The storage medium according to any one of claims 32 to 36, wherein the registration process registers the received point identifier and the possession information of the object in association with each other. The first reception process and the second reception process receive the point image of the point and receive the point image.
The storage medium according to claim 37, wherein the information processing program further causes a computer to perform an extraction process for extracting the point identifier from the received point image. At least, when the possession information of the object is registered in the registration means, when the point identifiers match by collation by the collation process, and when the object delivers to the delivery destination based on the possession information of the object. The storage medium according to any one of claims 32 to 38, wherein the computer further executes a granting process for granting points to the user. A point identifier acquisition means for acquiring a first point identifier extracted from a point written on an object with a writing instrument, and
A point identifier transmitting means for transmitting the first point identifier to the information processing device, and
Ownership of the object associated with the second point identifier, notified by the information processing device when a second point identifier matching the first point identifier is registered in the registration means of the information processing device. Ownership information receiving means for receiving ownership information about
A notification means for notifying the delivery destination of the object based on the received possession information, and
Communication terminal equipped with. The possession information includes at least one of information that identifies the owner of the object, information that identifies the destination of the object, and information that indicates that the owner of the object relinquishes ownership. Item 40. The communication terminal according to item 40. Obtain the first point identifier extracted from the points written on the object with a writing instrument,
The first point identifier is transmitted to the information processing device,
Ownership of the object associated with the second point identifier, notified by the information processing device when a second point identifier matching the first point identifier is registered in the registration means of the information processing device. Receives ownership information about
Notify the delivery destination of the object based on the received possession information.
Communication terminal control method. The possession information includes at least one of information that identifies the owner of the object, information that identifies the destination of the object, and information that indicates that the owner of the object relinquishes ownership. Item 42. The communication terminal control method according to Item 42. Point identifier acquisition processing to acquire the first point identifier extracted from the points written on the object with a writing instrument, and
The point identifier transmission process for transmitting the first point identifier to the information processing device, and
Ownership of the object associated with the second point identifier, notified by the information processing device when a second point identifier matching the first point identifier is registered in the registration means of the information processing device. Ownership information reception process to receive ownership information about
Notification processing for notifying the delivery destination of the object based on the received possession information,
A storage medium that stores application programs of communication terminals that cause a computer to execute. The possession information includes at least one of information that identifies the owner of the object, information that identifies the destination of the object, and information that indicates that the owner of the object relinquishes ownership. Item 44. The storage medium.

Images