JP2015173307A - Mobile terminal device, information processing system, information processing method for mobile terminal device, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing system, a mobile terminal device, an information processing method for the mobile terminal device and a program, capable of sharing most up-to-date information through information exchange, while mutually maintaining confidentiality among terminals.SOLUTION: A mobile terminal device 100 includes: a feature information acquisition unit 102 for acquiring feature information from photographed registration/collation images; a position time information acquisition unit 104 for acquiring position and time information related to the feature information on the registration image; a database 106 for linking and holding the feature information on the registration image with the corresponding position and time information, as diffusion information; an information exchange unit 108 for transmitting the diffusion information stored in the database 106 to another device, and for receiving the diffusion information held in the other device; an update unit 110 for newly registering the received diffusion information into the database 106; a collation unit 112 for identifying feature information which resembles the feature information on the collation image in the database 106; and an attribute detection unit 114 for acquiring position and time information linked with the identified feature information, as the attribute information on the collation image.

Description

  The present invention relates to a mobile terminal device, an information processing system, an information processing method for a mobile terminal device, and a program, and in particular, to exchange information between mobile terminals, a mobile terminal device, an information processing system, an information processing method for a mobile terminal device, And program.

DTN data that reduces the occupancy of the recording media of relay mobile terminals and relay fixed stations due to duplication of copy distribution in networks where delivery confirmation is difficult and transfer between nodes is uncertain, such as DTN (Delay, Disruption, Disconnection Tolerant Networking) An example of the transfer method is described in Patent Document 1.
Patent Document 2 discloses a data transfer method capable of selecting an appropriate route and reducing the load on the entire network when data is transferred between base stations using a mobile terminal as a data transfer medium. Have been described.

  Patent Document 3 describes an example of a safety information providing device. In the safety information providing apparatus described in Patent Literature 3, a safety confirmation target person who has become a victim inputs his / her safety information and registers it in the server. The face image of the safety confirmation target person is photographed as a subject, collated with a pre-registered collation face image, a collation image with matching characteristics is determined to be an image of the same person, and is extracted as a candidate. For face image collation, the degree of coincidence between the safety confirmation face image and the face image for collation is calculated from features such as the distance of the eyes, the contour, and the shape of the face portion such as the eyes and nose, and the degree of coincidence is calculated. If the predetermined threshold is exceeded for each, it is determined that they are the same person.

  Patent Literature 4 describes a shoplifting prevention system that reliably identifies shoplifting history persons from all the shoppers in a retail store group. The image taken with the surveillance camera of the store is collated with the registered shoplifting history face photo data.

JP 2010-68191 A JP 2008-16990 A JP 2006-243798 A JP 2005-196716 A

  However, in the technique described in the above document, it is possible to suppress the communication load of information transmission and to retrieve and obtain safety information by collating face images from pre-registered information. There was no idea of storing the latest information and exchanging information among multiple terminals in a situation where the communication environment was not established.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide an information processing system capable of sharing the latest information by exchanging information while maintaining confidentiality between terminals, a portable terminal device, an information processing method thereof, and To provide a program.

The portable terminal device of the present invention is
Feature information acquisition means for acquiring feature information from registered and collated captured images;
Position time information acquisition means for acquiring position information and time information related to the feature information acquired from the captured image for registration;
A database that associates the feature information acquired from the registered captured image with the corresponding position information and the time information, and holds it as diffusion information to be diffused;
Information exchange means for transmitting the spread information held in the database to another device and receiving the spread information held by the other device;
Update means for newly registering spreading information received from the other device in the database;
Collating means for collating the feature information acquired from the collated captured image with the feature information held as the diffusion information in the database, and identifying feature information similar to the feature information of the collated captured image;
Attribute detection means for acquiring position information and time information associated with feature information specified by the matching means in the database as attribute information of the captured image for matching;
Is provided.

The information processing system of the present invention
A plurality of portable terminal devices of the present invention,
The plurality of portable terminal devices exchange feature information in the database that each of the plurality of portable terminal devices has, position information and time information associated with the feature information,
Information processing system.

The computer program of the present invention is:
On the computer,
Procedure for acquiring feature information from captured images for registration and verification,
A procedure for acquiring position information and time information related to the feature information acquired from the registered captured image;
A procedure for associating the feature information acquired from the registered captured image with the corresponding position information and the time information, and holding them in a database as diffusion information to be diffused;
A procedure for transmitting the spreading information held in the database to another device and receiving the spreading information held by the other device;
A procedure for newly registering spreading information received from the other device in the database;
A procedure for collating the feature information acquired from the collated captured image with the feature information held as the diffusion information in the database, and identifying feature information similar to the feature information of the collated captured image;
It is a program for executing a procedure for acquiring position information and time information associated with feature information specified in the database as attribute information of the verification captured image.

An information processing method for a portable terminal device according to the present invention includes:
The mobile terminal device
Obtain feature information from the captured image for registration,
Obtaining position information and time information related to the feature information obtained from the registered captured image;
The feature information acquired from the registered captured image is associated with the corresponding position information and time information, and is registered in the database as diffusion information to be diffused.
While transmitting the spreading information held in the database, receiving spreading information held by other devices, exchanging spreading information,
Newly registering spreading information received from the other device in the database;
Obtain feature information from the captured image for verification,
Collating the feature information acquired from the collated captured image with the feature information held as the diffusion information in the database to identify feature information similar to the feature information of the collated captured image;
Position information and time information associated with the feature information specified in the database are acquired as attribute information of the verification captured image.

  It should be noted that any combination of the above-described constituent elements and a conversion of the expression of the present invention between a method, an apparatus, a system, a recording medium, a computer program, etc. are also effective as an aspect of the present invention.

  The various components of the present invention do not necessarily have to be independent of each other. A plurality of components are formed as a single member, and a single component is formed of a plurality of members. It may be that a certain component is a part of another component, a part of a certain component overlaps with a part of another component, or the like.

  Further, although a plurality of procedures are described in order in the information processing method and the computer program of the present invention, the described order does not limit the order in which the plurality of procedures are executed. For this reason, when the information processing method and the computer program of the present invention are implemented, the order of the plurality of procedures can be changed within a range that does not hinder the contents.

  Furthermore, the plurality of procedures of the information processing method and the computer program of the present invention are not limited to being executed at different timings. For this reason, another procedure may occur during the execution of a certain procedure, or some or all of the execution timing of a certain procedure and the execution timing of another procedure may overlap.

  ADVANTAGE OF THE INVENTION According to this invention, the information processing system which can share the newest information by information exchange, maintaining a confidentiality between terminals, a portable terminal device, its information processing method, and a program are provided.

It is a functional block diagram which shows the logical structure of the portable terminal device which concerns on embodiment of this invention. It is a figure which shows an example of the structure of the database constructed | assembled by the portable terminal device which concerns on embodiment of this invention. It is a flowchart which shows an example of operation | movement of the portable terminal device which concerns on embodiment of this invention. It is a flowchart which shows an example of operation | movement of the portable terminal device which concerns on embodiment of this invention. It is a flowchart which shows an example of operation | movement of the portable terminal device which concerns on embodiment of this invention. It is a functional block diagram which shows the logical structure of the portable terminal device which concerns on embodiment of this invention. It is a figure which shows an example of the structure of the database constructed | assembled by the portable terminal device which concerns on embodiment of this invention. It is a block diagram which shows an example of the hardware constitutions of the smart phone which implement | achieves the portable terminal device which concerns on embodiment of this invention. It is a figure for demonstrating the outline | summary of the information processing system which concerns on embodiment of this invention. It is a flowchart which shows an example of the communication procedure in the portable terminal device of this invention. It is a figure which shows an example of the menu screen of the portable terminal device which concerns on embodiment of this invention. It is a flowchart which shows an example of the process sequence when operating an application program in the portable terminal device which concerns on embodiment of this invention. It is a functional block diagram which shows the logical structure of the portable terminal device which concerns on embodiment of this invention. It is a figure which shows an example of the structure of the database constructed | assembled by the portable terminal device which concerns on embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, the same reference numerals are given to the same components, and the description will be omitted as appropriate.

(First embodiment)
FIG. 1 is a functional block diagram showing a logical configuration of mobile terminal apparatus 100 according to the embodiment of the present invention.
As illustrated in FIG. 1, the mobile terminal device 100 includes a feature information acquisition unit 102 that acquires feature information from registered and collated captured images, and position information and time information regarding the feature information acquired from the registered captured images. A position and time information acquisition unit 104 that acquires information, a database 106 that stores characteristic information acquired from a registered captured image, and corresponding position information and time information, and holds the information as diffusion information to be diffused, and a database 106 Information exchange unit 108 for transmitting the spreading information held in the other device and receiving the spreading information held by another device, and the updating unit 110 for newly registering the spreading information received from the other device in the database 106 And the feature information acquired from the captured image for verification and the feature information held as diffusion information in the database 106 The collation unit 112 that identifies feature information similar to the feature information of the image image, and the position information and time information associated with the feature information identified by the collation unit 112 in the database 106 as attribute information of the captured image for verification And an attribute detection unit 114 to be acquired.

  In the present invention, the mobile terminal device is a portable terminal device having a communication function. For example, a mobile phone, a smartphone, a tablet terminal, a PHS (Personal Handyphone System), a PDA (Personal Digital Assistants), a game machine, or It is a notebook personal computer.

FIG. 2 is a diagram showing an example of the structure of the database 106 constructed in the mobile terminal device 100 according to the embodiment of the present invention.
As shown in FIG. 2, in the database 106 of this embodiment, a plurality of feature information Dfn, position information Dln, and time information Dtn (n is a natural number) are associated and registered in at least one record.
The feature information Dfn is information obtained by extracting only the feature of the captured image and expressing it according to a predetermined rule. Since the feature information Dfn is smaller in data size than the image data (for example, about several hundred bytes), the memory capacity and the communication load can be reduced. Further, since the feature information Dfn is not an image itself, it can be difficult for an ordinary person to grasp an object that appears in the original image. Thereby, even if the diffusion information including the feature information is diffused and shared with others, the protection of the personal information can be observed as compared with the case where the image itself is used.

  As the position information Dln, the position information of the portable terminal device 100 at the time of spreading information registration, which is obtained by using a GPS (Global Positioning System) function described later, which the portable terminal device 100 has, can be used. Alternatively, in another example, information on the shooting location associated with the registered captured image may be used. Alternatively, the user designates a location on the map using an application having a map display function or the like, inputs an address, designates a registration location, and designates the designated information as position information of the registered captured image Also good.

The time information Dtn can be used by acquiring the time when the spread information is registered from a clock (not shown) built in the mobile terminal device 100 or the like. Or in another example, you may use the information of the imaging | photography time linked | related with the captured image for registration. Alternatively, the date and time specified by the user may be used as the time information of the registered captured image.
Note that the user may be able to select in advance or whenever the position information and time information to be registered are used.

  Each component of the mobile terminal device 100 of FIG. 1 includes a CPU (Central Processing Unit), a memory, a program that realizes the components of FIG. 1 loaded in the memory, an internal storage that stores the program, and the like (not shown) This is realized by an arbitrary combination of hardware and software of an arbitrary computer having a storage unit and a communication interface. It will be understood by those skilled in the art that there are various modifications to the implementation method and apparatus. The functional block diagram of FIG. 1 shows a logical block of functional units, not a configuration of hardware units.

In the mobile terminal device 100 according to the embodiment of the present invention, various units as described above are realized as various functions by the computer executing various processing operations corresponding to the computer program.
The computer program according to the embodiment of the present invention is a procedure for acquiring feature information from registered and collated captured images in a computer for realizing the portable terminal device 100, and feature information acquired from the registered captured images. A procedure for acquiring position information and time information relating to, a procedure for linking characteristic information acquired from a registered captured image and corresponding position information and time information, and holding the information as diffusion information to be diffused in the database 106; The spreading information held in the database 106 is transmitted to another apparatus, the procedure for receiving the spreading information held by the other apparatus, and the spreading information received from the other apparatus is newly registered in the database 106 Procedure, feature information acquired from the captured image for verification, and feature information held as diffusion information in the database 106 A procedure for collating and identifying feature information similar to the feature information of the captured image for collation, and position information and time information associated with the feature information identified in the database 106 are acquired as attribute information of the collated captured image. The procedure is described to be executed.

The information processing method by the portable terminal device 100 of the present embodiment configured as described above will be described below. 3-5 is a flowchart which shows an example of operation | movement of the portable terminal device 100 which concerns on embodiment of this invention.
First, FIG. 3 is a flowchart showing a procedure of processing for registering diffusion information.
In the information processing method of the mobile terminal device 100 according to the embodiment of the present invention, the mobile terminal device 100 acquires feature information from the registered captured image (step S101), and the feature information acquired from the registered captured image. (Step S103), the feature information acquired from the registered captured image is associated with the corresponding position information and time information, and registered in the database 106 as diffusion information to be diffused. (Step S105).
Next, FIG. 4 is a flowchart showing a procedure of processing for exchanging diffusion information with another device.
In the information processing method of portable terminal device 100 according to the embodiment of the present invention, portable terminal device 100 transmits spreading information held in database 106 and receives spreading information held by another device. Then, the spread information is exchanged (step S107), and the spread information received from another device is newly registered in the database 106 (step S109).
Further, FIG. 5 is a flowchart showing a processing procedure for searching for information desired by the user from the diffusion information stored in the mobile terminal device 100.
In the information processing method of the mobile terminal device 100 according to the embodiment of the present invention, the mobile terminal device 100 acquires feature information from the captured image for verification (step S111), and the feature information acquired from the captured image for verification. And feature information held as diffusion information in the database 106 (step S113), feature information similar to the feature information of the comparison captured image is identified (step S115), and the feature information identified in the database 106 Position information and time information associated with each other are acquired as attribute information of the captured image for verification (step S117).

Specifically, as shown in FIG. 3, in portable terminal device 100 according to the embodiment of the present invention, feature information acquisition unit 102 acquires feature information from a captured image for registration (step S101).
Then, the position time information acquisition unit 104 acquires position information and time information related to the feature information acquired from the registered captured image (step S103).
Then, the position / time information acquisition unit 104 associates the feature information acquired from the captured image for registration with the corresponding position information and time information, and registers and holds them in the database 106 as diffusion information to be diffused ( Step S105).

Then, as shown in FIG. 4, the information exchanging unit 108 transmits the spreading information held in the database 106, receives the spreading information held by another device, and exchanges the spreading information ( Step S107).
Then, the update unit 110 newly registers the diffusion information received from another device in the database 106 (step S109).

Furthermore, as shown in FIG. 5, in the mobile terminal device 100 according to the embodiment of the present invention, the feature information acquisition unit 102 acquires feature information from the captured image for verification (step S111).
Then, the collation unit 112 collates the feature information acquired from the collated captured image with the feature information held as diffusion information in the database 106 (step S113). When feature information similar to the feature information of the verification captured image is identified (YES in step S115), the attribute detection unit 114 uses the position information and time information associated with the feature information identified in the database 106. Acquired as attribute information of the captured image for verification (step S117).

  As described above, according to the mobile terminal device 100 according to the embodiment of the present invention, the feature information acquired by the feature information acquisition unit 102 from the captured image for registration and the registration information acquired by the location time information acquisition unit 104 The positional information and time information related to the captured image are linked and registered in the database 106 as diffusion information to be diffused, and the information exchange unit 108 transmits the diffusion information held in the database 106 to other devices, Since the spread information held by another device is received and the update unit 110 newly registers the received spread information in the database 106, the spread information can be shared with other devices without using a network such as the Internet. The database 106 can be constructed by exchanging information and sharing information.

  Then, the feature information acquisition unit 102 acquires feature information from the verification captured image, and the verification unit 112 compares the feature information acquired from the verification captured image with the feature information held as diffusion information in the database 106, Since the feature information similar to the matching captured image can be specified, and the position information and time information associated with the specified feature information can be acquired as the attribute information of the matching captured image, a network such as the Internet can be used. Even if it is not used, position information and time information related to a desired captured image can be searched from the database 106 built in the mobile terminal device 100.

  For example, in a situation where a network environment such as a disaster is not established, even if a network such as the Internet is not used, the feature information of a person's captured image is associated with position information and time information as safety confirmation information, and the database 106 can be constructed. The database is updated while exchanging information with other devices, so the latest information can be shared. And based on the captured image of the person you want to search, you can search the database where the latest information at that time is stored, and you can get the position information and time information related to the information similar to the feature information, so that It can be obtained as safety information of a person who is looking for a position and time. The obtained information is the latest information that can be acquired by the mobile terminal device at that time, and has high reliability.

  In addition, the mobile terminal device 100 according to the embodiment of the present invention registers not the captured image itself but the feature information of the captured image extracted by the feature information acquisition unit 102 in the database 106 as diffusion information, and the diffusion information Therefore, it is possible to comply with personal information as compared to exchanging personal information such as a captured image.

(Second Embodiment)
Hereinafter, in the present embodiment, an example in which the mobile terminal device is realized by the smartphone 10 will be described.
Further, the mobile terminal device 200 according to the embodiment of the present invention is different in that the mobile terminal device 200 according to the embodiment has a configuration for propagating stop of spreading of the spread information, whereas the embodiment has a configuration for spreading the spread information. To do.

  In the present invention, for example, in a situation where the network environment is not prepared in the event of a disaster, the survival information database 206 is constructed for the purpose of safety confirmation by using each user's mobile terminal, and information is shared between users. Applicable to systems that

FIG. 6 is a functional block diagram showing a logical configuration of mobile terminal apparatus 200 according to the embodiment of the present invention.
The mobile terminal device 200 according to the embodiment of the present invention includes a feature information acquisition unit 102 that acquires feature information from registered and collated captured images, and position information and time regarding feature information acquired from the registered captured images. A position / time information acquisition unit 104 that acquires information, a database 206 that stores characteristic information acquired from a registered captured image, and corresponding position information and time information as diffusion information to be diffused; The spread information held in the database 206 is transmitted to the device in FIG. 6 and the information exchange unit 208 that receives the spread information held in the other device and the spread information received from the other device are newly added to the database 206. Update unit 210 to be registered, feature information acquired from the captured image for verification, and feature information held as diffusion information in database 206 The collation unit 212 for identifying feature information similar to the feature information of the captured image for collation, and the position information and time information associated with the feature information identified by the collation unit 212 in the database 206 for collation. The attribute detection unit 114 acquired as attribute information of the captured image, the deletion reception unit 220 that receives a stop request indicating the diffusion stop of the feature information, and the diffusion stop feature information and database by the matching unit 212 in response to the stop request A flag setting unit 222 that sets a diffusion stop flag in the feature information in the database 206 that is identified as similar to the feature information of the diffusion stop by collating with the feature information held as diffusion information in 206;
In the present embodiment, the information exchanging unit 208 further excludes the feature information in which the diffusion stop flag is set from the diffusion information and transmits it to other devices.

FIG. 7 is a diagram showing an example of the structure of the database 206 constructed in the mobile terminal device 200 according to the embodiment of the present invention.
In the database 206 of the present embodiment, a diffusion stop flag is further linked to each record of the database 106 in FIG. 2 and registered. In the present embodiment, the flag of the record to stop spreading is set to 1. However, the flag setting method is not particularly limited, and the flag of the record to stop spreading may be set to 0, or other numerical values. Or a character string. Alternatively, in the present embodiment, the flag is set for each record, but the present invention is not limited to this. For example, the present invention is not limited to this as long as it can be registered in the database 206 with a structure capable of identifying diffusion information and diffusion stop information.

  Moreover, although the figure shows the example in which the feature information Dfn, the position information Dln, the time information Dtn, and the diffusion stop flag are included in one record, additional information can be further included. For example, at least one of gender, age (age), occupation (especially doctors, nurses, and other occupations whose location is to be confirmed in a disaster), and name (nickname) may be included as additional information.

  Of the additional information stored in the database 206, the information exchange unit 208 transmits to the other apparatus as spread information may include all additional information, or selectively transmitted from the additional information. It is good also as a structure which can be performed.

FIG. 8 is a block diagram illustrating an example of a hardware configuration of the smartphone 10 that implements the mobile terminal device 200 according to the embodiment of the present invention.
In FIG. 8, the configuration of parts not related to the essence of the present invention is omitted and is not shown. In addition, the portable terminal device 100 of the said embodiment can also be comprised with the smart phone 10 of this figure.

  As illustrated in FIG. 8, the smartphone 10 includes a CPU 12, a memory 14, an internal storage 16, a communication control unit 18, an operation unit 22, an operation reception unit 24, a display unit 26, and a display control unit 28. , An imaging unit 32, a GPS (Global Positioning System) function unit (shown as “GPS” in the figure) 34, and a clock 38.

  The CPU 12 is connected to each element of the smartphone 10 via the bus 40 and controls the entire smartphone 10 together with each element. The memory 14 includes a program (OS (Operating System), application, etc.) for operating the smartphone 10, an area in which various setting data used when these programs are operated, and a program for operating the programs. And a work area. The internal storage 16 stores an application program 50 that realizes the mobile terminal device of the present invention, and various user data such as other applications, mail, documents, images, music, and moving images. In addition to the internal storage 16, for example, an external storage (for example, a recording medium such as an SD (Secure Digital) memory card, a USB (Universal Serial Bus) memory, or an HDD (Hard Disk) that can be used by being attached to or connected to the smartphone 10). The smartphone 10 may be provided with a mechanism (a connection unit and a read / write unit) that enables access to a drive)).

The communication control unit 18 communicates with other mobile terminal devices. The communication control unit 18 realizes a function that enables communication based on at least any one of short-range wireless communication such as wireless LAN (Local Area Network) communication, infrared communication, or Bluetooth communication. If it is a unit, it will not specifically limit.
Although only one unit is shown in the figure, the smartphone 10 may have a plurality of different communication control units. And it is good also as a structure which can select an appropriate communication system according to the communication system which the other apparatus which communicates with the smart phone 10 can utilize. In addition, the communication control unit 18 performs communication using at least one communication method of wired communication and wireless communication via the antenna 20. The information exchange unit 208 of the present embodiment can communicate with other devices using the communication control unit 18.
In addition, as another communication function of the smartphone 10, a unit (not shown) having a function of connecting to a mobile communication network may be provided.

The operation unit 22 includes operation keys, operation buttons, switches, a jog dial, a touch pad, and the like. The operation reception unit 24 receives an operation of the operation unit 22 by the user and notifies the CPU 12 of the operation. The display unit 26 includes a liquid crystal display, an organic EL (ElectroLuminescence) display, an LED (Light Emitting Diode) display, and the like. The display control unit 28 displays various screens on the display unit 26 in accordance with instructions from the CPU 12.
Further, the smartphone 10 may include a touch panel 30 in which a part of the operation unit 22 and the display unit 26 are integrated.

Moreover, you may provide the audio | voice output control part, the speaker, the microphone, etc. which are not illustrated.
The imaging unit 32 is a unit that realizes the function of a digital camera using elements such as a CCD (Charge Coupled Devices) image sensor and a CMOS (Complementary Metal Oxide Semiconductor) image sensor. In addition, in this embodiment, although the smart phone 10 is set as the structure provided with the imaging part 32, it is not limited to this. You may image with the external camera connected to the smart phone 10, or you may acquire the image imaged with the other camera. In the present embodiment, the feature information acquisition unit 102 may acquire feature information from an image captured using the imaging unit 32. In the present embodiment, the file format of the captured image used by the feature information acquisition unit 102 is JPEG (Joint Photographic Experts Group), PNG (Portable Network Graphics), BMP (Bit MaP), TIFF (Tagged Image File Format), GIF ( Various types of image files such as (Graphic Interchange Format) can be used, and there is no particular limitation.

The GPS function unit 34 receives a signal from the GPS via the antenna 36 and acquires the current position of the smartphone 10. For example, a quasi-zenith satellite system is used for GPS in order to obtain highly accurate common time information.
The location time information acquisition unit 104 of the mobile terminal device 200 of the present embodiment may acquire location information from the GPS function unit 34.

  The clock 38 is a clock built in the smartphone 10 and measures the date and time. In addition, when the smart phone 10 is in a state where it can be connected to the network, it is desirable that the clock 38 is configured to be able to automatically correct the time by synchronizing with an Internet time server or the like periodically or at any time. The location time information acquisition unit 104 of the mobile terminal device 200 of this embodiment may acquire the time from the clock 38.

  6 includes a CPU 12, a memory 14, a program 50 that implements the components shown in FIG. 6 loaded in the memory 14, and a storage unit (not shown) such as a hard disk that stores the program. ), And an arbitrary combination of hardware and software of an arbitrary computer (smartphone 10) having a communication interface (communication control unit 18). It will be understood by those skilled in the art that there are various modifications to the implementation method and apparatus. The functional block diagram in FIG. 6 and each embodiment described below shows not a configuration in hardware units but logical blocks in functional units.

In the mobile terminal device 200 according to the embodiment of the present invention, various processing operations corresponding to the computer program 50 are executed by the computer (the CPU 12 of the smartphone 10), so that the various units as described above are realized as various functions. The
A computer program 50 according to an embodiment of the present invention is a procedure for acquiring feature information from a captured image for registration and verification in a computer (CPU 12 of the smartphone 10) for realizing the mobile terminal device 200, and imaging for registration. Procedure for acquiring position information and time information related to feature information acquired from an image, feature information acquired from a captured image for registration, and corresponding position information and time information are linked to a database as diffusion information to be diffused The procedure held in 206, the spread information held in the database 206 to the other device, the procedure for receiving the spread information held in the other device, the spread information received from the other device Procedure for newly registering in the database 206, feature information acquired from the captured image for verification, and the database 20 The feature information held as diffusion information is collated and the feature information similar to the feature information of the captured image for collation is specified, the position information and time information associated with the feature information specified in the database 206 Is acquired as attribute information of a captured image for verification, a procedure for receiving a stop request indicating diffusion stop of feature information, and feature information of diffusion stop and feature information held as diffusion information in the database 206 in response to the stop request The procedure for setting the diffusion stop flag to the feature information in the database 206, which is identified as similar to the feature information of the diffusion stop by the comparison, is described.

  The computer program 50 of this embodiment may be recorded on a computer-readable recording medium. The recording medium is not particularly limited, and various forms can be considered. The program 50 may be loaded from the recording medium into the computer memory 14 or may be downloaded to the computer via the network and loaded into the memory 14.

FIG. 9 is a diagram for explaining the outline of the information processing system according to the embodiment of the present invention.
As shown in FIG. 9, the present invention uses, for example, the communication function of the terminal carried by the user Ua1 to transfer the diffusion information held in the terminal of the user Ua1 to the other users Ua2 in the same area A, Ua3,. . . , And Uan (n is a natural number) to share. Thereafter, the user Ua1 moves to another area B, and the other users Ub1, Ub2,. . . , And Ubm (m is a natural number), the spreading information held by the user Ua1 is spread, and the other users Ub1, Ub2,. . . And the diffusion information held by Ubm is acquired. Further, the user Ua1 moves to another area C and repeats spreading and collection of spreading information, so that a database can be constructed in each user's terminal and the spreading information can be shared. In addition, for example, the user Ua2 and the user Uan who are in the area A or the user Ubm who is in the area B can move to another area and spread the diffusion information held in the terminal.

  For example, when a disaster occurs, an evacuee is photographed using the mobile terminal device 200 at an evacuation site, feature information is extracted, and the position information and time information are linked and registered in the database 206 as diffusion information. Then, after exchanging diffusion information with other portable terminals in the evacuation shelter, the information is further collected by moving to another evacuation shelter. In this way, information on the location of the evacuees is accumulated in the database 206. Then, the database 206 is searched based on the image of the person whose location is to be confirmed, the feature information similar to the captured image for collation is specified, and the position information and time information associated with the specified feature information Is acquired as attribute information.

  Here, the other device has a communication function for performing communication with the mobile terminal device of the present invention. For example, a mobile phone, a smartphone, a tablet terminal, a PHS (Personal Handyphone System), a PDA (Personal Digital Assistants), A portable terminal device such as a game machine or a notebook personal computer can be included. Also in these terminal devices, the program of the present invention that realizes the same function as the portable terminal device of the present invention is installed and executed. In addition, it is assumed that another device exists at a distance that allows wireless communication with the mobile terminal device of the present invention, or exists at a position where the mobile terminal device of the present invention can be connected to an available access point. Alternatively, the other device may be a portable or fixed terminal device having an access point function such as a router. In that case, the mobile terminal device or the access point of the present invention may move to a position where they can communicate with each other.

  Returning to FIG. 6, the feature information acquisition unit 102 acquires feature information from a captured image for registration or verification. Here, the registered photographed image is an image photographed including an object to be diffused to another device (user). Although the object is not particularly limited, in the present embodiment, it is assumed to be a human face. Feature information indicating the feature of the object included in the captured image is extracted by the feature information acquisition unit 102 using, for example, a face authentication system. In the present embodiment, when the object is a person, the feature information includes, for example, the facial features of the person, the outline of each part such as eyes, nose, and mouth, and the size, arrangement, and shape of each part, For example, the color of skin or hair is expressed as a relative difference value from a standard value. The registered captured image may be already held by the mobile terminal device 100 or may be captured using the imaging unit 32 of the smartphone 10. Alternatively, it may be obtained from the outside. For example, the captured image may be read from an external memory, may be received by infrared communication with another device, or may be read from another device connected by a cable. Good.

Various timings for registering the captured image are conceivable and exemplified below, but are not limited thereto.
(A1) Before a disaster or the like occurs, an application is installed and registered with a registration menu described later.
(A2) Before a disaster or the like occurs, access a website related to the system, log in by user authentication, and register on the registration page. After registration, the registration information is downloaded to the mobile terminal device. At this time, registration information by other users already registered may be downloaded together.
(A3) After a disaster or the like occurs, an application is installed and registered with a registration menu described later.

  The collated captured image is an image that is captured including an object for which relevant information is to be searched from the diffusion information registered in the database 206. For example, when it is desired to confirm the safety of an acquaintance, the database 206 can be searched using an image obtained by capturing an acquaintance as a captured image for verification. The extraction of the feature information of the verification captured image can be performed in the same manner as the extraction of the feature information of the registration captured image. The captured image for collation may be already held by the mobile terminal device 100 or may be captured using the imaging unit 32 of the mobile terminal device 100. Alternatively, it may be obtained from the outside. For example, the captured image may be read from an external memory, may be received by infrared communication with another device, or may be read from another device connected by a cable. Good.

  The position time information acquisition unit 104 acquires position information and time information related to the feature information acquired from the registered captured image. For example, when the user himself images and registers his / her face using the imaging function of the mobile terminal device 100 (imaging unit 32 of the smartphone 10), the imaging function and time information are obtained from the GPS function unit 34 and the clock 38 of the smartphone 10. May be obtained from Or when registering using the captured image of an acquaintance, a user may specify a position and time information. When registering, a configuration in which a predetermined authentication procedure is performed may prevent unauthorized registration.

  The deletion accepting unit 220 accepts a stop request indicating stop of diffusion of feature information. There are various ways to accept a stop request. For example, spreading information registered by the mobile terminal device 200 at its own terminal is stored in the memory 14 or the internal storage 16 as a separate file so that it can be distinguished from other spreading information and referred to by the own terminal. desirable. Since the diffusion information itself is information that cannot identify an individual, the diffusion information registered by the terminal itself is stored as a management file with information that can identify the object of the captured image, for example, a name (such as a nickname). It is desirable to keep it. This management file is configured to be viewable on its own terminal, and is configured to be able to confirm and manage information registered by itself.

  Then, the stop request in the deletion receiving unit 220 is, for example, using the above-described management file, displaying a list of diffusion information registered by the mobile terminal device 200 on its own terminal, and receiving selection of information to stop spreading. be able to. Alternatively, the feature information is acquired by the feature information acquisition unit 102 using the captured image captured including the object whose diffusion is to be stopped, and the feature information similar to the feature information is verified from the database 206 by the verification unit 212. The diffusion information having the specified feature information may be a target to stop the diffusion. At this time, attribute information related to the feature information specified by the user may be presented to confirm whether or not the diffusion may be stopped, and the stop request process may be continued when the stop is accepted.

  In response to the stop request, the flag setting unit 222 is identified as similar to the diffusion stop feature information by the collation unit 212 by collating the diffusion stop feature information with the feature information held as diffusion information in the database 206. A diffusion stop flag is set in the feature information in the database 206. For example, as shown in FIG. 7, the diffusion stop flag is registered in the database 206 in association with each record of diffusion information.

The information exchange unit 208 transmits the spreading information held in the database 206 to other devices, receives the spreading information held by the other devices, and further has feature information in which the spreading stop flag is set. Are excluded from the spread information and transmitted to other devices.
The information exchange unit 208 communicates with other devices using the communication control unit 18 of the smartphone 10. As described above, the communication method is not particularly limited, and various methods can be employed.

Here, a communication method in the mobile terminal device of the present invention will be described.
The present invention can be realized, for example, by communication using a so-called delay tolerant network (DTN).
In the communication system of the present invention, for example, data can be transmitted in a passing manner when approaching within a distance range where communication with other nodes is possible.

FIG. 10 is a flowchart showing an example of a communication procedure in the mobile terminal device of the present invention.
In the present invention, in an OSI (Open Systems Interconnection) reference model, a bundle layer that controls end-to-end transfer of bundles (variable length data) is provided between the transport layer and the application layer. The bundle layer has persistent storage that stores data permanently, stores the bundle temporarily in the persistent storage, contacts the next node, and bundles when the communication link for transfer becomes available give.
Although not shown in the figure, it is preferable that the receiving node transmits a receipt notification to the transmitting node after receiving the bundle. It is desirable that the transmission node that has received the receipt notification is configured to be able to discard the transmitted bundle according to a predetermined condition.

Further, in the present invention, data transfer can be performed in units of bundles in which spread information to be transmitted is divided into a plurality of blocks having a predetermined capacity (for example, several tens of kilobytes). However, if the communication environment is in place, data transfer may be performed in a lump without dividing the spread information using TCP (Transmission Control Protocol). When the communication environment is bad and communication is unstable, it is more efficient to transmit the bundle in units of bundles every time connection is established, because it is not necessary to retransmit the transmitted bundle. In addition, if the configuration is such that the bundle size can be adjusted according to the communication status, even if the bandwidth is small, data can be transferred little by little, and data loss tolerance can be improved.
As a premise, a program for realizing the mobile terminal device 200 of the present invention is executed in each node, and the reception node waits to receive a communication control message that declares the start of communication transmitted by UDP (User Datagram Protocol). It shall be in the state.

  In such a state, when the information exchange unit 208 transmits spread information to other nodes in the transmission node, the following operation is performed. First, the transmission node broadcasts a communication control message declaring the start of communication by UDP (step S251). If there is another node on the transmission node side, the message is received (YES in step S253), and a response message is returned to the transmission node (step S255). When the transmission node receives the response message from the reception node (YES in step S257), the transmission node establishes a link with the reception node that has transmitted the response message, and the content list of the diffusion information in the database 206 held by the transmission node Is transmitted to the receiving node that has sent the response message (step S259).

  Here, the content list is a list of diffusion information held in the database 206 by each node. For example, a list can be created by digitizing diffusion information using a hash function or the like for each record.

The receiving node receives the content list (step S261), compares the received content list with the content list of the diffusion information stored in the database 206 held by the own device, and sets the diffusion information not held by the own device as differential content. Then, a request is made to the transmission node (step S263). When the transmission node accepts the request from the reception node (YES in step S265), based on the request, the transmission node extracts the diffusion information from the database 206 as the difference content and transmits it to the reception node (step S267). The receiving node receives the differential content transmitted from the transmitting node and stores it in the database 206 (step S269).
In step S257 or step S265, when the predetermined time has passed in the response waiting state (YES in step S271 or YES in step S273), the present process is terminated. During the predetermined time (NO in step S271 or NO in step S273), the standby is continued.

In addition, this process shall be performed repeatedly at all times, when each portable terminal device is in the mode which performs information exchange.
Here, the procedure for exchanging diffusion information between two portable terminal devices has been described separately for a transmission side node (transmission node) and a reception side node (reception node). However, in the present invention, each mobile terminal device can be both a transmission node and a reception node. The transmission node may request the content list from another node, and may request and receive the difference content from the other node, and store it in the database 206. Further, the receiving node may become a transmitting node based on the received spreading information and further transfer the spreading information to another node. Based on the effective lifetime of the bundle, it is desirable that the sending node is configured to be able to discard the bundle that has expired.

  In the above example, the push-type data transfer procedure has been described. However, pull-type data transfer that requests data from the receiving node side may be used. In addition, TTL (Time To Live) may be set to manage the expiration date of the bundle.

In addition to the spread information, the bundle may include, for example, at least one information such as source and destination information, validity period, and data length. Note that the destination information is not necessary when a method of exchanging a copy of a bundle between nodes in contact is adopted.
In addition, an absorption layer may be further provided in the OSI reference model. Assuming communication with various transport layers or nodes that directly use the data link layer, the difference is absorbed and a common interface is used. May be defined.

  Also, in the example of the figure, the case where the transmission node and the reception node are one-to-one is shown, but the same applies to the case of one-to-multiple, and the spread information can be distributed to a plurality of reception nodes by multicast. Good.

  In the above example, the content list is transmitted to the receiving node before the transmitting node distributes the spread information. However, when the capacity of the distributed information to be distributed is not large, or broadcast distribution to a plurality of receiving nodes. In such a case, the content list may be distributed together with the diffusion information. Then, on the receiving node side, based on the received content list, it is possible to select diffusion information that is not owned by itself, update the database 206, and discard unnecessary information.

  Further, when data distribution is performed to a plurality of receiving nodes, it is also possible to distribute all the spreading information held by the transmitting node without exchanging the content list. Such a procedure is particularly effective when the transmitting node spreads the spreading information in an area where there are a plurality of nodes that do not yet hold the spreading information.

Alternatively, a plurality of content lists may be received from a plurality of receiving nodes, the content lists may be compared, and spread information to be transmitted may be selected and distributed. Various selection conditions are conceivable and exemplified below, but are not limited thereto.
(B1) The difference content is determined so as to include all the diffusion information not held by each node and distributed (b2) Among the nodes having the difference content, distribution is performed in order from the common difference content (b3) Among the difference contents New distribution (b4) Content is determined for each node or group based on the diffusion conditions described later. The above (b1) to (b4) may be combined as long as there is no contradiction as appropriate. .

Returning to FIG. 6, the update unit 210 newly registers diffusion information received from another device in the database 206.
The collation unit 212 collates the feature information acquired from the collated captured image with the feature information held as diffusion information in the database 206, and identifies feature information similar to the feature information of the collated captured image.
Here, “similar” includes matching (identical). For example, if the similarity of the feature information is equal to or greater than a predetermined threshold, it is determined that they are similar.

  Further, the feature information held in the database 206 may include information indicating the accuracy of the original registered captured image. Further, the accuracy of the operation image for collation may be similarly obtained and used at the time of collation. The accuracy of the image can be a value indicating how accurately the object to be registered or verified is clearly shown in the image and the feature information indicates the object to be registered or verified. The feature information acquisition unit 102 can determine the accuracy based on the quality of the original image, for example, the focus condition, the contrast level, the size of the target object, and the like.

  And the collation part 212 may change the threshold value used when comparing a similarity based on the information of accuracy. For example, in the case of feature information of an image with low accuracy, the feature of the object may not be accurately indicated in the feature information. Therefore, if the threshold value is high, similar information may not be found. . On the other hand, in the case of feature information of an image with high accuracy, there is a possibility that the feature information accurately indicates the feature of the object. Therefore, if the threshold value is increased, the possibility that more correct information can be acquired increases.

  Furthermore, the portable terminal device 200 according to the embodiment of the present invention transmits the diffusion stop information indicating the feature information to stop spreading, and receives the diffusion stop information held by another device. An exchange unit 224 may be further provided. The flag setting unit 222 compares the feature information indicated by the diffusion stop information received by the diffusion stop information exchange unit 224 with the feature information held as diffusion information in the database 206 by the matching unit 212, and the feature indicated by the diffusion stop information. A diffusion stop flag may be set in the feature information in the database 206 identified as being similar to the information.

  Furthermore, in the mobile terminal device 200 according to the embodiment of the present invention, the update unit 210 updates the feature information in which the diffusion stop flag is set after a predetermined period of time has elapsed from the setting of the diffusion stop flag or at a specified time. It may be deleted from the database 206.

The time for executing the deletion may be a time predetermined by the application or every certain period, or may be a time or a period specified by the user when the diffusion stop request is made.
For example, if the spread information is deleted immediately after receiving the spread stop request or after receiving the spread stop information, the spread information is received from another device that has not yet received the spread stop information. When received, there is a possibility that the diffusion information is registered as new diffusion information in the database 206, and the diffusion of the diffusion information cannot be stopped for a long time. Therefore, after spreading stop information is distributed to other devices, the corresponding spreading information can be deleted from the database 206 at once by deleting the corresponding spreading information in each device.

  Furthermore, the mobile terminal device 200 according to the embodiment of the present invention further includes a presentation unit 226 that presents the attribute information of the verification captured image acquired by the attribute detection unit 114.

The attribute detection unit 114 acquires position information and time information associated with the identified feature information as the attribute information of the verification captured image by matching with the verification captured image in the database 206, and presents the presentation unit. 226 displays the acquired attribute information on the display unit 26 of the smartphone 10. In addition to the display on the display unit 26, the presentation unit 226 saves the search result in a text file, prints it out to a printer, or transmits it to another device. You may go.
Although the case where a plurality of feature information is specified by the collation unit 212 is considered, in that case, attribute information of the plurality of feature information may be presented.

  Furthermore, in portable terminal device 200 according to the embodiment of the present invention, collation unit 212 resembles the feature information of the collated captured image and the feature information having a similarity equal to or greater than a predetermined threshold with the collated captured image. The feature information is specified and the similarity is output, and the presentation unit 226 presents the similarity output by the matching unit 212 together with the attribute information of the matching captured image.

For example, when feature information similar to a matching captured image is specified, the attribute information and the degree of similarity indicate that the object (for example, a person) shown in the matching captured image is “similar with a probability of what percentage. The presenting unit 226 can present information such as “where and where an object (for example, a person) may exist”.
According to this configuration, even when a plurality of feature information is specified, the similarity of each feature information is presented. Therefore, the user can compare each information and estimate reliable information by referring to the similarity. can do.

As described above, the mobile terminal device 200 according to the embodiment of the present invention is realized by the mobile terminal device 200 (the CPU 12 of the smartphone 10) executing the computer program of the present invention. For example, the computer program of the present invention can be provided as an application that can be installed on the smartphone 10, installed in the memory 14 of the smartphone 10, and activated in accordance with a user instruction.
When the application is executed, a menu for accepting the user's operation instruction is presented. When the user instructs the operation along the menu, the portable terminal device 100 of the present invention can operate according to the instruction.

As an example, a menu screen 230 as shown in FIG. 11 may be displayed. FIG. 11 is a diagram illustrating an example of the menu screen 230 of the mobile terminal device 200 according to the present embodiment.
The menu screen 230 includes a diffusion registration button 232, a diffusion stop button 234, a search button 236, a diffusion button 238, and an end button 240.

FIG. 12 is a flowchart illustrating an example of a processing procedure when the application program 50 is operated in the mobile terminal device 200 of the present embodiment.
First, the application program 50 is installed in the mobile terminal device 200 (step S201). The application program 50 is stored in the internal storage 16. When the application program 50 is activated (step S203), the menu screen 230 in FIG. 11 is displayed on the display unit 26 of the smartphone 10. When the diffusion registration button 232 is operated by the user, the operation unit 22 of the smartphone 10 accepts the operation of the diffusion registration button 232 (“diffusion registration” in step S205), and shifts to a registration form screen (not shown). Then, the user is prompted to select a registered captured image or to capture an image (step S207).

When the registered captured image is designated by the user, the operation unit 22 accepts the designation operation, the feature information acquisition unit 102 acquires the feature information, and the position time information acquisition unit 104 acquires the position information and time. The information is linked and registered as diffusion information in the database 206 (step S209). And it returns to step S205 and the menu screen 230 of FIG. 11 is displayed.
Note that the registration form may be provided with an input field for receiving input and designation of additional information.

  Further, when the diffusion stop button 234 is operated by the user, the operation unit 22 receives an operation of the diffusion stop button 234 (“Diffusion stop” in step S205), and the deletion reception unit 220 stops the feature information diffusion stop. Is received (step S217). Then, in response to the stop request, information for stopping diffusion is specified by collating with the feature information of the stop request (step S219). Then, the flag setting unit 222 sets a diffusion stop flag in the specified feature information in the database 206 (step S221). And it returns to step S205 and the menu screen 230 of FIG. 11 is displayed.

  Further, when the search button 236 is operated by the user, the operation unit 22 receives an operation of the search button 236 (“search” in step S205), and a screen (not shown) that prompts the user to select a captured image for comparison or to capture an image. (Step S211). When a collated captured image is designated by the user, the operation unit 22 accepts a designation operation, the feature information acquisition unit 102 acquires feature information, and the collation unit 212 uses feature information similar to the acquired feature information. Is searched in the database 206 (step S213). When similar feature information is specified, corresponding attribute information such as position information and time information is acquired by the attribute detection unit 114 and displayed on the display unit 26 (step S215).

With respect to this search menu, it is also possible to search the database 206 for other verification captured images. When an operation of a search end button (not shown) is accepted, the process returns to step S205, and the menu screen 230 of FIG. 11 is displayed.
For example, the user can search the database 206 by designating a captured image of an acquaintance possessed as a collated captured image in order to confirm the survival information of family members and acquaintances.

  Further, when the user operates the diffusion button 238, the operation unit 22 accepts the operation of the diffusion button 238 ("Diffusion" in Step S205), and the information exchange unit 208 performs a process of exchanging diffusion information with other devices. This is performed (step S223). The information exchange unit 208 transmits the spreading information held in the database 206 to other devices and receives the spreading information held by other devices. Further, at this time, the information exchanging unit 208 excludes the feature information for which the diffusion stop flag is set from the diffusion information and transmits it to another device.

In the present embodiment, various timings for exchanging diffusion information can be considered as follows.
(C1) Declaring the start of data transfer to other devices within the communicable distance range after the portable terminal device 200 holding the spread information transitions to the information spread mode triggered by pressing of the spread button 238 (C2) The mobile terminal device 200 holding the spread information can always communicate (regularly or periodically) while executing the program of the present invention. When a communication control message declaring the start of data transfer is transmitted to another device within the distance range and there is a response, the above (c1) and (c2) may be combined within a consistent range as appropriate Good.

When the operation of the diffusion end button (not shown) is accepted, the process returns to step S205, and the menu screen 230 of FIG. 11 is displayed.
In this way, the information exchange unit 208 exchanges the diffusion information held in the database 206 with other users, so that the diffusion information can be accumulated in the database 206.

  Further, when the end button 240 is operated by the user, the operation unit 22 accepts an operation of the end button 240 (“End” in step S205), and the process ends.

  Furthermore, in the mobile terminal device 200 of the present embodiment, the database 206 associates the feature information acquired from the captured image of the user of the mobile terminal device 200 as the registered captured image with the position information and the time information, and spreads the database 206. The update unit 210 stores the position information and the time information associated with the feature information acquired from the captured image of the user without changing the diffusion information other than the user in the database 206 as the information exchange unit. Before being transmitted by 208, it can be acquired by the location time information acquisition unit 104 and updated to the latest information.

  In this embodiment, with this configuration, in the database 206, the position information and time information of the spread information registered in the own terminal can be updated and distributed to the latest information before spreading. For example, as described with reference to FIG. 9, when the user moves the area and spreads the information, the user's own location moves and the spread information is also updated and updated. Can continue.

  The old diffusion information may be left without being deleted, and a plurality of records may be retained in the database 206 historically. The attribute detection unit 114 may be configured to acquire and present a plurality of attribute information corresponding to the verification captured image, or may be configured to present only the latest attribute information. Alternatively, the database 206 may be updated by leaving only the latest record.

  As described above, according to the mobile terminal device 200 of the embodiment of the present invention, the same effect as that of the above embodiment can be obtained, and further, it is possible to stop spreading by designating information to stop spreading. Therefore, information that is no longer needed will never be spread forever. As a result, the communication efficiency is improved, the consumption of storage capacity by the database of the mobile terminal device can be reduced, and further, the load of the database search process can be reduced.

(Third embodiment)
FIG. 13 is a functional block diagram showing a logical configuration of mobile terminal apparatus 300 according to the embodiment of the present invention.
The mobile terminal device 300 according to the embodiment of the present invention is different from the above-described embodiment in that diffusion of diffusion information is controlled according to conditions. Another difference is that when information is retrieved from the database 306, the level of detail of disclosure can be controlled.
In FIG. 13, only the configuration related to the description of the present embodiment is shown. The mobile terminal device 300 of this embodiment includes a feature information acquisition unit 102, a position time information acquisition unit 104, a collation unit 212, an attribute detection unit 114, and a presentation unit 226 similar to those of the above embodiment. Furthermore, a database 306, an information exchange unit 308, an update unit 310, a condition acquisition unit 332, a selection unit 334, and a priority acquisition unit 336 are provided. The mobile terminal device 300 of this embodiment may further include a configuration similar to that of the mobile terminal device 200 of the above-described embodiment of FIG.

The mobile terminal device 300 according to the embodiment of the present invention includes a condition acquisition unit 332 that acquires designation of conditions for information transmission to other devices, and a selection unit that selects diffusion information in the database 306 according to the acquired conditions. 334.
The information exchange unit 308 transmits the selected diffusion information among the diffusion information in the database 306 to another device.

Furthermore, the mobile terminal device 300 according to the embodiment of the present invention further includes a priority acquisition unit 336 that acquires designation of priority for the feature information in the database 306.
The update unit 310 associates the acquired priority with the feature information and registers it in the database 306, and the condition acquisition unit 332 acquires the specification of the condition related to the priority.

FIG. 14 is a diagram showing an example of the structure of the database 306 constructed in the mobile terminal device 300 according to the embodiment of the present invention.
In the database 306 of the present embodiment, information relating to the priority is further registered and registered in each record of the database 106 in FIG. In this embodiment, the priority information includes a plurality of levels L0, L1,. . . And Li (i is an integer). The priority information may be a numerical value, a character string, or information necessary for determining the priority order. Simply, the priority level of a small numerical value may be increased, or the priority level of a large numerical value may be increased. Alternatively, a plurality of priority information may be associated with the feature information, and the priority order of each feature information may be determined based on the information.

In this embodiment, the conditions for transmitting information to other devices and the designation of priority may be determined in advance, may be obtained from the outside, or may be designated by the user.
Various examples of conditions are conceivable and are exemplified below, but are not limited thereto.
(D1) The feature information is registered by linking the type of portable terminal device that registered the feature information as priority information (kids' mobile phone, senior's mobile phone, etc.). Feature information associated with mobile phone etc.) is filtered. As a result, information on children and the elderly can be preferentially spread.
(D2) Priority level associated with feature information Diffusion can be performed simply from the highest priority level.
(D3) In the feature information, a diffusion area or a diffusion stop area is designated and specified as priority information. The area designated and designated may be a wide area such as the Kanto region or a narrow area such as a facility designated. Before the transmission, the position where the mobile terminal device 300 exists is confirmed using the GPS function unit 34, and the information to be transmitted is filtered based on whether or not it is within the designated area.
(D4) The registration information in the database is linked as the priority information to the feature information, and the diffusion information is filtered according to the registration registration time. For example, it can spread preferentially from those registered recently.
(D5) Content of additional information linked to feature information For example, filtering by occupation type allows the occupation to preferentially spread information on doctors and nurses.
(D6) Communication status When the communication status is poor, it is possible to spread gradually from the highest priority.
The above (d1) to (d6) may be appropriately combined within a consistent range.

The data selection based on the priority may be performed on the receiving side. The received data may be selected and registered in the database 306 according to conditions instead of all.
Further, as described above, when the receiving node requests the difference content from the transmitting node, an instruction indicating which condition should be used for information selection may be included in the requester.

  By registering the priority-related information as priority information in the database 306 in association with the feature information, it is possible to diffuse the feature information with a higher priority. As described above, the present invention assumes that communication is performed in a situation where the communication environment is poor. For this reason, it is possible to easily devise such as distributing information with high urgency first, and distributing information with low urgency later.

In addition, the mobile terminal device 300 according to the embodiment of the present invention may further include a control unit 338 that controls the level of detail of disclosure of position information or time information in the presentation unit 226 according to a predetermined condition.
If the level of detail is location information, it is possible to divide the level from wide area information to a specific location. For example, world level regions (Asia, Europe, etc.), country names (Japan, etc.), regions (Kanto) , Tohoku, etc.), prefectures, municipalities, addresses (up to street number), facilities and building names, floors, rooms, etc. are assumed.
If it is time information, year, month (including last month, this month, etc.), date (including last week, this week, etc.), date, date (including am, etc.), date Level division can be considered. Here, it is assumed that the more detailed information, the higher the degree of detail.

  Further, in portable terminal device 300 according to the embodiment of the present invention, control unit 338 provides presentation unit 226 according to the similarity between the feature information specified by matching unit 212 and the feature information of the captured image for verification. Controls the level of detail of disclosure of position information or time information.

Various relations between the conditions and the level of detail of information disclosure are conceivable and are exemplified below, but are not limited thereto.
(E1) When a pre-registered captured image is used as a verification captured image, the level of detail of disclosure of the attribute information of the specified feature information is increased, and otherwise the level is decreased.
By registering family members and the like as verification images, family information can be viewed in detail. Note that by performing a predetermined authentication procedure at the time of registration, unauthorized registration can be prevented and security can be ensured. Detailed information is not disclosed to others, but only to the extent that “I was in Shinjuku in March”.
(E2) The higher the degree of similarity between the collated captured image and the identified feature information, the higher the level of detail of information disclosure.
(E3) At the time of feature information registration, a level of detail of information disclosure can be designated, and the information is disclosed at the designated level of detail.
The above (e1) to (e3) may be appropriately combined within a consistent range.

  As described above, according to the mobile terminal device 300 according to the embodiment of the present invention, the same effect as the above embodiment can be obtained, and furthermore, the diffusion of diffusion information can be controlled according to the condition and priority. Since the level of detail of information disclosed at the time of information search can be controlled according to conditions, necessary information can be provided to necessary users appropriately and efficiently. For example, information can be prevented from being disclosed and misused unprotected.

As mentioned above, although embodiment of this invention was described with reference to drawings, these are the illustrations of this invention, Various structures other than the above are also employable.
<Safety confirmation system>
For example, you may further provide the safety information acquisition part (not shown) which acquires the safety information of the person reflected in the captured image for registration.
The safety information acquisition unit registers the acquired safety information in the database in association with the feature information of the captured image for registration, and the attribute detection unit 114 displays the safety information associated with the feature information specified by the collation. Obtained as attribute information of the captured image for verification.
According to this configuration, the safety confirmation information can be acquired.
The safety information can include, for example, at least any one of survival information, presence / absence or degree of injury (hospital destination hospital name), and the like.
For these pieces of information, as described in the above embodiment, the information provision destination and the detailed level of information disclosure may be controlled by conditions and priorities.

  In the above embodiment, for example, a system sharing safety confirmation information at the time of a disaster has been described as an example. However, application examples of the present invention are not limited to this, and various applications can be applied. For example, the present invention can be applied to entrance / exit management such as amusement parks, lost child search, and search for a specific person (such as a person who is searching or searching) using a captured image such as a security camera.

While the present invention has been described with reference to the embodiments and examples, the present invention is not limited to the above embodiments and examples. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.
In addition, when acquiring and using the information regarding a user in this invention, this shall be done legally.

Hereinafter, examples of the reference form will be added.
1. In a computer that realizes a mobile terminal device,
Procedure for acquiring feature information from captured images for registration and verification,
A procedure for acquiring position information and time information related to the feature information acquired from the registered captured image;
A procedure for associating the feature information acquired from the registered captured image with the corresponding position information and the time information, and holding them in a database as diffusion information to be diffused;
A spreading information exchange procedure for transmitting the spreading information held in the database to another device and receiving the spreading information held by the other device;
An update procedure for newly registering spreading information received from the other device in the database;
A collation procedure for collating the feature information acquired from the collated captured image with the feature information held as the diffusion information in the database, and identifying feature information similar to the feature information of the collated captured image;
The program for performing the attribute detection procedure which acquires the positional information and time information linked | related with the characteristic information specified in the said database as attribute information of the said captured image for collation.
2. 1. In the program described in
A procedure for accepting a stop request indicating a stop of diffusion of feature information;
In response to the stop request, the collation procedure specifies that the feature information of the diffusion stop is similar to the feature information of the diffusion stop by collating the feature information of the diffusion stop and the feature information held as the diffusion information in the database. In addition, the computer further executes a procedure for setting a diffusion stop flag in the feature information in the database,
In the spreading information exchange procedure, a procedure for excluding the feature information in which the spreading stop flag is set from the spreading information and transmitting to the other device,
A program that causes a computer to execute.
3. 2. In the program described in
Transmitting the diffusion stop information indicating the feature information to stop the diffusion, and causing the computer to further execute a diffusion stop information exchange procedure for receiving the diffusion stop information held by the other device,
In the procedure for setting the spreading stop flag, by matching the feature information indicated by the spreading stop information received by the spreading stop information exchange procedure and the feature information held as the spreading information in the database by the matching procedure, A procedure for setting the diffusion stop flag in the feature information in the database, identified as being similar to the feature information indicated by the diffusion stop information;
A program that causes a computer to execute.
4). 2. Or 3. In the program described in
In the update procedure, a procedure for deleting the feature information in which the diffusion stop flag is set from the database after a predetermined period of time has elapsed from the setting of the diffusion stop flag or at a specified time;
A program that causes a computer to execute.
5. 1. To 4. In the program described in any one of the above,
The database associates the feature information acquired from the captured image of the user of the mobile terminal device as the captured image for registration with the position information and time information, and holds it as the diffusion information,
In the update procedure, the location information and the time information associated with the feature information acquired from the captured image of the user are transmitted by the information exchange procedure while the diffusion information other than the user in the database is left as it is. Before getting and updating the latest information,
A program that causes a computer to execute.
6). 1. To 5. In the program described in any one of the above,
Condition acquisition procedure for acquiring specification of conditions for sending information to other devices,
A procedure for selecting the diffusion information in the database according to the acquired condition;
Is further executed on the computer,
In the information exchange procedure, a procedure for transmitting the selected spread information among the spread information in the database to the other device;
A program that causes a computer to execute.
7). 6). In the program described in
A step of acquiring a designation of priority for the feature information in the database;
In the update procedure, a procedure of registering the acquired priority in the database in association with the feature information;
In the condition acquisition procedure, a procedure for acquiring designation of a condition related to the priority,
A program that causes a computer to execute.
8). 1. To 7. In the program described in any one of the above,
A program for causing a computer to further execute a procedure for presenting the attribute information of the captured image for verification acquired by the attribute detection procedure.
9. 8). In the program described in
In the matching procedure, the feature information of the matching captured image and the feature information having a similarity greater than or equal to a predetermined threshold are identified as feature information similar to the matching captured image, and the similarity is output.
In the procedure of presenting the attribute information, a procedure of presenting the similarity output by the collation procedure together with the attribute information of the captured image for collation,
A program that causes a computer to execute further.
10. 8). Or 9. In the program described in
A procedure for controlling a level of detail of disclosure of the position information or the time information in the procedure of presenting the attribute information according to a predetermined condition;
A program that causes a computer to execute further.
11. 10. In the program described in
In the controlling procedure, the position information or the time presented in the procedure of presenting the attribute information according to the similarity between the feature information specified by the matching procedure and the feature information of the captured image for matching Procedures to control the level of detail of information disclosure;
A program that causes a computer to execute further.
12 1. To 11. In the program described in any one of the above,
Obtaining the safety information of the person shown in the captured image for registration;
In the procedure of acquiring the safety information, the acquired safety information is registered in the database in association with the feature information of the registered captured image,
In the attribute detection procedure, a procedure for acquiring safety information associated with the feature information specified by the verification as attribute information of the verification captured image;
A program that causes a computer to execute.

13. The mobile terminal device
Have a database to hold the spreading information to be spread,
Obtain feature information from the captured image for registration,
Obtaining position information and time information related to the feature information obtained from the registered captured image;
The feature information acquired from the registered captured image is associated with the corresponding position information and time information, and is registered in the database as diffusion information to be diffused.
While transmitting the spreading information held in the database, receiving spreading information held by other devices, exchanging spreading information,
Newly registering spreading information received from the other device in the database;
Obtain feature information from the captured image for verification,
Collating the feature information acquired from the collated captured image with the feature information held as the diffusion information in the database to identify feature information similar to the feature information of the collated captured image;
Obtaining position information and time information associated with the feature information specified in the database as attribute information of the verification captured image;
Information processing method for portable terminal device.
14 13. In the information processing method of the mobile terminal device described in
further,
The portable terminal device is
Accepts a stop request indicating stop of feature information diffusion,
In response to the stop request, in the database identified as similar to the feature information of the diffusion stop by collating the feature information of the diffusion stop with the feature information held as the diffusion information in the database Set the diffusion stop flag in the feature information of
When transmitting the spreading information held in the database, the feature information in which the spreading stop flag is set is excluded from the spreading information and sent to the other device.
Information processing method for portable terminal device.
15. 14 In the information processing method of the mobile terminal device described in
further,
The portable terminal device is
While transmitting spreading stop information indicating the feature information to stop the spreading, and receiving the spreading stop information held by the other device,
The database specified as similar to the feature information indicated by the diffusion stop information by collating the feature information indicated by the diffusion stop information received from the other device with the feature information held as the diffusion information in the database. The diffusion stop flag is set in the feature information in
Information processing method for portable terminal device.
16. 14 Or 15. In the information processing method of the mobile terminal device described in
further,
The portable terminal device is
An information processing method for a mobile terminal device, wherein the feature information in which the diffusion stop flag is set is deleted from the database after a predetermined period of time has elapsed from the setting of the diffusion stop flag or at a specified time.
17. 13. To 16. In the information processing method of the mobile terminal device according to any one of the above,
further,
The database of the mobile terminal device associates the feature information acquired from the captured image of the user of the mobile terminal device as the captured image for registration with the position information and time information, and holds the information as the diffusion information. And
The portable terminal device is
Before transmitting the position information and the time information associated with the feature information acquired from the captured image of the user to the other device, without diffusing information other than the user in the database, Update to the latest information,
Information processing method for portable terminal device.
18. 13. To 17. In the information processing method of the mobile terminal device according to any one of the above,
further,
The portable terminal device is
Get specification of conditions for sending information to other devices,
According to the acquired condition, the diffusion information in the database is selected,
The spread information selected from the spread information in the database is transmitted to the other device.
Information processing method for portable terminal device.
19. 18. In the information processing method of the mobile terminal device described in
further,
The portable terminal device is
Obtaining a priority designation for the feature information in the database;
The obtained priority is associated with the feature information and registered in the database,
Obtaining a specification of a condition relating to the priority;
Information processing method for portable terminal device.
20. 13. Thru 19. In the information processing method of the mobile terminal device according to any one of the above,
further,
The portable terminal device is
An information processing method of a mobile terminal device that presents the attribute information of the verification captured image acquired from the database.
21. 20. In the information processing method of the mobile terminal device described in
further,
The portable terminal device is
When the feature information acquired from the collated captured image is collated with the feature information held as the diffusion information in the database, the feature information of the collated captured image has a similarity equal to or higher than a predetermined threshold. Identifying feature information as feature information similar to the matching captured image, and outputting the similarity,
Presenting the output degree of similarity together with the attribute information of the captured image for verification,
Information processing method for portable terminal device.
22. 20. Or 21. In the information processing method of the mobile terminal device described in
further,
The portable terminal device is
When presenting the attribute information of the verification captured image, control the level of detail of disclosure of the position information or the time information according to a predetermined condition,
Information processing method for portable terminal device.
23. 22. In the information processing method of the mobile terminal device described in
further,
The portable terminal device is
Details of disclosure of the position information or the time information according to the degree of similarity between the feature information specified by the collation and the feature information of the collation captured image when presenting the attribute information of the collation captured image Control the degree level,
Information processing method for portable terminal device.
24. 13. Thru 23. In the information processing method of the mobile terminal device according to any one of the above,
further,
The portable terminal device is
Obtaining the safety information of the person shown in the captured image for registration,
The acquired safety information is registered in the database in association with the feature information of the registered captured image,
Obtaining the safety information associated with the feature information identified by the collation as attribute information of the collated captured image;
Information processing method for portable terminal device.

10 Smartphone 12 CPU
14 memory 16 internal storage 18 communication control unit 20 antenna 22 operation unit 24 operation reception unit 26 display unit 28 display control unit 30 touch panel 32 imaging unit 34 GPS function unit 36 antenna 38 clock 40 bus 50 program 100 portable terminal device 102 characteristic information acquisition Unit 104 location time information acquisition unit 106 database 108 information exchange unit 110 update unit 112 collation unit 114 attribute detection unit 200 portable terminal device 206 database 208 information exchange unit 210 update unit 212 collation unit 220 deletion reception unit 222 flag setting unit 224 diffusion stop Information exchange unit 226 Presentation unit 230 Menu screen 232 Diffusion registration button 234 Diffusion stop button 236 Search button 238 Diffusion button 240 End button 300 Mobile terminal device 306 Database 308 Information exchange unit 310 Update unit 32 condition obtaining unit 334 selecting unit 336 priority acquisition unit 338 control unit

Claims (15)

Feature information acquisition means for acquiring feature information from registered and collated captured images;
Position time information acquisition means for acquiring position information and time information related to the feature information acquired from the captured image for registration;
A database that associates the feature information acquired from the registered captured image with the corresponding position information and the time information, and holds it as diffusion information to be diffused;
Information exchange means for transmitting the spread information held in the database to another device and receiving the spread information held by the other device;
Update means for newly registering spreading information received from the other device in the database;
Collating means for collating the feature information acquired from the collated captured image with the feature information held as the diffusion information in the database, and identifying feature information similar to the feature information of the collated captured image;
Attribute detection means for acquiring position information and time information associated with feature information specified by the matching means in the database as attribute information of the captured image for matching;
A mobile terminal device comprising: The mobile terminal device according to claim 1,
Deletion accepting means for accepting a stop request indicating stop spreading of feature information;
In response to the stop request, the collating means specifies that the feature information of the diffusion stop is similar to the feature information of the diffusion stop by comparing the feature information of the diffusion stop with the feature information held as the diffusion information in the database. Flag setting means for setting a diffusion stop flag in the feature information in the database;
Further comprising
The information exchanging means excludes the feature information in which the diffusion stop flag is set from the diffusion information and transmits it to the other device;
Mobile terminal device. The mobile terminal device according to claim 2,
The transmission apparatus further comprises diffusion stop information exchange means for transmitting the diffusion stop information indicating the feature information to stop the diffusion and receiving the diffusion stop information held by the other device,
The flag setting unit is configured to collate the diffusion stop information by comparing the feature information indicated by the diffusion stop information received by the diffusion stop information exchanging unit and the feature information held as the diffusion information in the database. The diffusion stop flag is set in the feature information in the database that is identified as similar to the feature information indicated by
Mobile terminal device. In the portable terminal device according to claim 2 or 3,
The update means is a portable terminal device that deletes the feature information in which the diffusion stop flag is set from the database after a predetermined period of time has elapsed from the setting of the diffusion stop flag or at a specified time. The portable terminal device according to any one of claims 1 to 4,
further,
The database associates the feature information acquired from the captured image of the user of the mobile terminal device as the captured image for registration with the position information and time information, and holds it as the diffusion information,
The update means transmits the position information and time information associated with the feature information acquired from the captured image of the user by the information exchanging means, with the diffusion information other than the user in the database as it is. Before, acquired by the position time information acquisition means, and updated to the latest information,
Mobile terminal device. The portable terminal device according to any one of claims 1 to 5,
Condition acquisition means for acquiring specification of conditions for information transmission to other devices;
Screening means for screening the diffusion information in the database according to the acquired condition;
Further comprising
The information exchange means transmits the spread information selected from the spread information in the database to the other device.
Mobile terminal device. The mobile terminal device according to claim 6,
Priority acquisition means for acquiring priority designation for the feature information in the database,
The update means registers the acquired priority in the database in association with the feature information,
The condition acquisition means acquires a specification of a condition related to the priority;
Mobile terminal device. The portable terminal device according to any one of claims 1 to 7,
A portable terminal device further comprising a presentation unit that presents the attribute information of the captured image for verification acquired by the attribute detection unit. The mobile terminal device according to claim 8, wherein
further,
The collation means identifies feature information of the captured image for collation and feature information having a similarity greater than or equal to a predetermined threshold as feature information similar to the captured image for collation, and outputs the similarity.
The presenting means presents the similarity output from the collation means together with the attribute information of the captured image for collation.
Mobile terminal device. In the portable terminal device according to claim 8 or 9,
A portable terminal device further comprising control means for controlling a level of detail of disclosure of the position information or the time information in the presenting means according to a predetermined condition. The mobile terminal device according to claim 10,
further,
The control means sets a level of detail of disclosure of the position information or the time information in the presentation means according to the similarity between the feature information specified by the matching means and the feature information of the captured image for matching. A mobile terminal device to be controlled. The mobile terminal device according to any one of claims 1 to 11,
A safety information acquisition means for acquiring safety information of a person shown in the captured image for registration;
The safety information acquisition means registers the acquired safety information in the database in association with the feature information of the captured image for registration,
The said attribute detection means is a portable terminal device which acquires the safety information linked | related with the characteristic information specified by collation as attribute information of the said captured image for collation. A plurality of portable terminal devices according to any one of claims 1 to 12,
The plurality of portable terminal devices exchange the feature information in the database respectively possessed by the plurality of portable terminal devices, and the position information and time information associated with the feature information.
Information processing system. On the computer,
Procedure for acquiring feature information from captured images for registration and verification,
A procedure for acquiring position information and time information related to the feature information acquired from the registered captured image;
A procedure for associating the feature information acquired from the registered captured image with the corresponding position information and the time information, and holding them in a database as diffusion information to be diffused;
A procedure for transmitting the spreading information held in the database to another device and receiving the spreading information held by the other device;
A procedure for newly registering spreading information received from the other device in the database;
A procedure for collating the feature information acquired from the collated captured image with the feature information held as the diffusion information in the database, and identifying feature information similar to the feature information of the collated captured image;
The program for performing the procedure which acquires the positional information and time information linked | related with the characteristic information specified in the said database as attribute information of the said captured image for collation. The mobile terminal device
Obtain feature information from the captured image for registration,
Obtaining position information and time information related to the feature information obtained from the registered captured image;
The feature information acquired from the registered captured image is associated with the corresponding position information and time information, and is registered in the database as diffusion information to be diffused.
While transmitting the spreading information held in the database, receiving spreading information held by other devices, exchanging spreading information,
Newly registering spreading information received from the other device in the database;
Obtain feature information from the captured image for verification,
Collating the feature information acquired from the collated captured image with the feature information held as the diffusion information in the database to identify feature information similar to the feature information of the collated captured image;
Obtaining position information and time information associated with the feature information specified in the database as attribute information of the verification captured image;
Information processing method for portable terminal device.

Images