JP2019095872A - Search system, search device, terminal device, search method, and program - Google Patents

Abstract

To provide a search system, search device, terminal device, search method and program that, even when information is leaked, rule out identification of a personal behavior.SOLUTION: A search system 10 comprises: a terminal device 20; and a search device 30. The terminal device 20 comprises: an image detection unit 21 that detects images of a search object; a hash value generation unit 22 that encrypts the image of the search object with a unique method, and generates a first hash value; and a transmission unit 23 that transmits the first hash value to the search device 30. The search device 30 comprises: an accumulation unit 31 that accumulates the first hash value transmitted; a hash value generation unit 32 that generates a second hash value corresponding to each terminal device 20 from data identifying an exterior appearance of a person, using a unique method of each terminal device 20; and a search processing unit 33 that collates each of the second hash values with the first hash value, and identifies the terminal device 20 transmitting the first hash value agreeing with or similar to the second hash value.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a search system, a search device constituting the same, a terminal device and a search method for searching for a search object such as a person, and a program for realizing the same.

  In recent years, a system for searching for a person or the like using image processing has been proposed (see, for example, Patent Documents 1 and 2). Specifically, Patent Document 1 proposes a system configured by a plurality of monitoring cameras disposed in a facility, a terminal device, and a server device. In the system disclosed in Patent Document 1, when a search target, for example, a face image of a lost child is input to the terminal device, the server collates the input face image with the image captured by the monitoring camera, The person of the face image is extracted, and the result is transmitted to the terminal device.

  Moreover, although patent document 2 is disclosing the system similar to patent document 1, in the system currently disclosed by patent document 2, the movement path | route of a person can also be estimated. Specifically, in the system disclosed in Patent Document 2, the server extracts the face image of a person from the video captured by the management camera, and associates the extracted face image with the location information of the imaging location. sign up. Therefore, when the face image to be searched is sent from the terminal device, the server identifies a face image similar to the sent face image from the registered face images, and further identifies the face image. The position information linked to the face image is also specified. Then, the server estimates the travel path of the search target using the identified position information.

  With such a system, a person can be searched quickly without relying on the human hand. In addition, if such a system is developed not only in a specific facility but also in the city, it is considered effective for searching for missing people, which has been increasing in recent years.

Unexamined-Japanese-Patent No. 2004-126711 JP, 2009-075916, A

  However, in the systems disclosed in Patent Documents 1 and 2, since personal information such as a face image for which a monitoring camera is photographed is stored in the server, hacking or unauthorized acquisition by a malicious third party There is a risk that personal information may leak out and individual behavior may be identified. On the other hand, it is conceivable to encrypt personal information stored in the server, but even if it is encrypted, if it leaks, it may be illegally decrypted.

  An example of the object of the present invention is a search system, a search device, a terminal device, a search method, and a program, which can solve the above problems and make it impossible to identify an individual's behavior even if information leaks. It is to provide.

In order to achieve the above object, a search system according to one aspect of the present invention is
Equipped with a plurality of terminals and a search device,
Each of the plurality of terminal devices is
An image detection unit that detects an image to be searched from images output from imaging devices corresponding to the respective images;
A hash value generation unit that encrypts the detected image to be searched according to a method specific to the terminal device to generate a first hash value;
A transmitter configured to transmit the generated first hash value to the search device;
Equipped with
The search device is
An accumulation unit for accumulating the first hash value transmitted for each of the plurality of terminal devices;
The data specifying the appearance of the search target is acquired, and the second hash corresponding to each of the plurality of terminal devices is obtained from the acquired data using the unique method of each of the plurality of terminal devices. A hash value generator that generates a value;
Each of the second hash values generated by the hash value generation unit is compared with the first hash value stored in the storage unit, and the first hash value matches or is similar to the second hash value. A search processing unit that specifies a terminal device that is transmitting a hash value of
It is characterized by having.

In order to achieve the above object, the search device in one aspect of the present invention is
A search device connected to a plurality of terminal devices, which transmits a first hash value generated by encrypting an image to be searched for, the search device comprising:
An accumulation unit for accumulating the first hash value transmitted for each of the plurality of terminal devices;
The data specifying the appearance of the search target is acquired, and the second hash corresponding to each of the plurality of terminal devices is obtained from the acquired data using the unique method of each of the plurality of terminal devices. A hash value generator that generates a value;
Each of the second hash values generated by the hash value generation unit is compared with the first hash value stored in the storage unit, and the first hash value matches or is similar to the second hash value. A search processing unit that specifies a terminal device that is transmitting a hash value of
It is characterized by having.

In order to achieve the above object, a terminal device in one aspect of the present invention is:
An image detection unit that detects an image to be searched from an image output from the imaging device;
A hash value generation unit that encrypts the detected image to be searched according to a unique method to generate a hash value;
A transmitting unit that transmits the generated hash value to an external device;
It is characterized by having.

In addition, in order to achieve the above object, a search method according to one aspect of the present invention is a method for searching for a search target using a plurality of terminal devices and a search device,
Implemented by each of the plurality of terminal devices,
A search target image detection step of detecting the search target image from the images output from the corresponding imaging devices;
A first hash value generation step of encrypting the detected image to be searched according to a method specific to the terminal device to generate a first hash value;
Sending the generated first hash value to the search device.
Furthermore, implemented by the search device,
Storing the first hash value transmitted for each of the plurality of terminal devices;
The data specifying the appearance of the search target is acquired, and the second hash corresponding to each of the plurality of terminal devices is obtained from the acquired data using the unique method of each of the plurality of terminal devices. Generating a second hash value generating step;
A terminal apparatus transmitting the first hash value that matches or is similar to the second hash value by comparing each of the generated second hash values with the stored first hash value Identifying a search processing step;
It is characterized by

Furthermore, to achieve the above object, a first program according to an aspect of the present invention transmits to a computer connected to a plurality of terminal devices that transmits a first hash value generated by encrypting an image to be searched. ,
Storing the first hash value transmitted for each of the plurality of terminal devices;
The data specifying the appearance of the search target is acquired, and the second hash corresponding to each of the plurality of terminal devices is obtained from the acquired data using the unique method of each of the plurality of terminal devices. Generating a second hash value generating step;
Each of the second hash values generated in the second hash value generation step is compared with the first hash value stored, and the first hash value matches or is similar to the second hash value. A search processing step of identifying a terminal device transmitting a hash value;
To execute.

Furthermore, in order to achieve the above object, a second program according to one aspect of the present invention is a computer including:
A search target image detection step of detecting a search target image from an image output from the imaging device;
A hash value generation step of encrypting the detected image to be searched according to a unique method to generate a hash value;
Transmitting the generated hash value to an external device;
To execute.

  As described above, according to the present invention, even when information is leaked, it is possible to make it impossible to specify the behavior of an individual.

FIG. 1 is a block diagram showing a schematic configuration of a search system, a search device, and a terminal device according to an embodiment of the present invention. FIG. 2 is a diagram showing a specific example of a search system in the embodiment of the present invention. FIG. 3 is a diagram showing hash value generation processing performed by the search device in the embodiment of the present invention. FIG. 4 is a diagram showing a process of generating a hash value performed by the search device in the embodiment of the present invention. FIG. 5 is a diagram showing hash value generation processing performed by the search device in the embodiment of the present invention. FIG. 6 is a diagram showing hash value generation processing performed by the search device in the embodiment of the present invention. FIG. 7 is a flowchart showing the operation of the terminal device 20 according to the embodiment of the present invention. FIG. 8 is a flow chart showing the operation of the search device 30 in the embodiment of the present invention. FIG. 9 is a block diagram showing an example of a computer for realizing the terminal device and the search device in the embodiment of the present invention.

Embodiment
Hereinafter, a search system, a search device, a terminal device, a search method, and a program according to an embodiment of the present invention will be described with reference to FIGS. 1 to 9.

[Device configuration]
First, schematic configurations of a search system, a search device, and a terminal device in the present embodiment will be described. FIG. 1 is a block diagram showing a schematic configuration of a search system, a search device, and a terminal device according to an embodiment of the present invention.

  A search system 10 in the present embodiment shown in FIG. 1 is a system for searching for a specific object. As shown in FIG. 1, the search system 10 includes a plurality of terminal devices 20 and a search device 30. Each terminal device 20 and the search device 30 are connected so as to be capable of data communication. Note that, in FIG. 1, with regard to the terminal device 20, only the configuration of one terminal device 20 is illustrated, and the configuration of the other terminal device 20 is omitted.

  Further, as shown in FIG. 1, each terminal device 20 includes an image detection unit 21, a hash value generation unit 22, and a transmission unit 23. The image detection unit 21 detects an image to be searched from an image output from an imaging device corresponding to each terminal device 20.

  The hash value generation unit 22 encrypts the detected image to be searched according to a method specific to the terminal device 20 to generate a first hash value. The transmission unit 23 transmits the generated first hash value to the search device 30.

  Further, as shown in FIG. 1, the search device 30 includes an accumulation unit 31, a hash value generation unit 32, and a search processing unit 33. The accumulation unit 31 accumulates the transmitted first hash value for each of the plurality of terminal devices 20.

  The hash value generation unit 32 acquires data for specifying the appearance of the search target, and from the acquired data, using the method specific to each terminal device 20, the terminal device 20 corresponds to each terminal device 20 Generate a hash value of 2.

  The search processing unit 33 collates each of the second hash values generated by the hash value generation unit 32 with the first hash value stored in the storage unit. Then, the search processing unit 33 specifies the terminal device 20 that is transmitting the first hash value that matches or is similar to the second hash value, from the result of the comparison.

  As described above, in the present embodiment, the search device 30 compares the search target data transmitted from each terminal device 20 with the data to be searched and specifies the terminal device 20 that has transmitted the data. Search for a search target by Then, the data transmitted by the terminal device 20 is encrypted by a method different for each terminal device 20. Therefore, for example, when the search target is a person, according to the present embodiment, even if the data leaks, identification of the individual's action becomes impossible.

Subsequently, configurations and functions of the search system 10, the search device 30, and the terminal device 20 in the present embodiment will be more specifically described using FIGS. FIG. 2 is a diagram showing a specific example of a search system in the embodiment of the present invention. 3 to 6 are diagrams showing hash value generation processing performed by the search device in the embodiment of the present invention. 3 to 6 show a series of flows of hash value generation processing.

  As shown in FIG. 2, in the present embodiment, the terminal device 20 also functions as a guide plate at the stop of the bus 50 and is disposed along the route of the bus 50. Below, the case where a search object is a person is explained. Furthermore, an imaging device 24 is attached to the top of the terminal device 20. The imaging device 24 captures an image of the person 40 in the vicinity, and outputs the image data of the captured image to the terminal device 20 to which it is attached.

  Further, at this time, the imaging device 24 includes, in the image data, data specifying the imaging time (hereinafter referred to as “time data”) and data indicating the imaging position (hereinafter referred to as “imaging position data”). Add The imaging position information may be information indicating latitude and longitude, or may be an identifier of the imaging device 24 or an identifier of the terminal device 20 linked to the coordinates.

  Further, when the imaging device 24 has a function of performing imaging only when a moving body is detected in the imaging area, imaging is performed only when the moving body is detected, and the image data is output. Further, when such a function is not provided, the imaging device 24 periodically performs photographing and output of image data.

  Further, in the terminal device 20, in the present embodiment, when the image data is first output from the imaging device 24, the image detection unit 21 acquires this and extracts the part of the person from the acquired image data. Do.

  Specifically, the image detection unit 21 first specifies, from the image specified by the image data, a region having a feature amount identical or similar to the feature amount of the background portion, and removes the specified region. Next, the image detection unit 21 compares the feature amount of the remaining area with the feature amount representing the person prepared in advance, and from the remaining area, a portion representing the person, that is, an image to be searched for To detect.

  In the present embodiment, first, the hash value generation unit 22 divides the search target image detected by the image detection unit 21 into a plurality of blocks, and an image forming each block for each of the plurality of blocks. Quantify the features of to create a bit string. Next, the hash value generation unit 22 generates a first hash value by encrypting each generated bit string according to a method specific to the terminal device 20 including the bit string.

  Specifically, as shown in FIG. 3, the hash value generation unit 22 divides the image of the person to be searched into a plurality of blocks along the horizontal direction. In the example of FIG. 3, the image to be searched is divided into six blocks. Then, as shown in FIG. 4, for each block of the image to be searched, the hash value generation unit 22 digitizes the hue distribution and saturation distribution of the image constituting each block, and uses the obtained numerical value. Create a bit string.

  In the example of FIG. 4, the hash value generation unit 22 uses the following equation 1 to calculate distribution rates for eight hues from hue 1 to hue 8 for the hue, and for the saturation, the saturation: The distribution rate is calculated for four types of saturation from 1 to saturation 4. Furthermore, the hash value generation unit 22 converts each distribution rate into a bit string (4-digit hexadecimal number) using the following Equation 2, and concatenates the obtained bit strings to form a block bit string.

(1)
Distribution rate = distribution number 総 数 total number of pixels (except for black pixels)

(2)
Bit string ₍₁₆₎ = 2 ^{[16 x distribution rate]} -1

  Subsequently, as shown in FIG. 5, the hash value generation unit 22 links the generated bit string of each block into one bit string, and the obtained bit string for each block is a method unique to each terminal device 20 Hash by

  In the example of FIG. 5, the hash value generation unit 22 shuffles the generated bit string in units of bits for each block, and binarizes the bit string after the shuffle. Further, in the present embodiment, the method of shuffle at this time is unique to each terminal device 20.

  Further, the hash value generation unit 22 scans the obtained bit string from the left end, and holds “0” if the position of the bit where “1” appears for the first time is even, and holds “1” if it is odd. In addition, the hash value generation unit 22 repeats the shuffle and scan N times, and sets the bit value held in the n (1 ≦ n ≦ N) -th shuffle as the n-th bit value from the left to the hash of N bits. Generate a value In the example of FIG. 5, N = 192.

  Subsequently, as shown in FIG. 6, the hash value generation unit 22 uses the hash value obtained for each block as the first hash value. In the example of FIG. 6, the hash value generation unit 22 generates the first hash value by concatenating the hash values obtained for each block.

  The transmission unit 23 transmits the first hash value generated by the hash value generation unit 22 to the search device 30, but in this embodiment, the time data and the photographing position described above are added to the first hash value at that time. Also add data.

  When the transmitting unit 23 transmits the first hash value to which the time data and the photographing position data are added, the search device 30 receives the first hash value to which the time data and the photographing position data are added. Then, in the present embodiment, the accumulation unit 31 associates the first hash value with the time data and the photographing position data added thereto, and accumulates them.

  In the present embodiment, the search device 30 acquires, from the external terminal device 60, data specifying the appearance of the search object. Further, since the terminal device 60 is a smartphone and has a function of executing an application program, the terminal device 60 is divided into blocks shown in FIG. 3 and calculation of bit strings in block units shown in FIG. And do. In this case, the search device 30 acquires a bit string obtained from the image to be searched as data specifying the appearance of the search object.

  Further, in the present embodiment, the external terminal device 60 may transmit image data indicating the appearance of the person who is the search target. In this case, the search device 30 acquires image data of the person as data for specifying the appearance of the person to be searched, and divides the image data of the person into blocks shown in FIG. And calculating the bit string in block units shown in FIG.

  In the present embodiment, the hash value generation unit 32 generates a block generated by dividing into blocks shown in FIG. 3 and calculating a bit string in block units shown in FIG. 4 as data for specifying the appearance of the search target. Get each bit string.

In addition, the hash value generation unit 32 encrypts each acquired bit string for each terminal device 20 according to the unique method, and generates a second hash value corresponding to each terminal device 20. Specifically, the generation of the second hash value by the hash value generation unit 32 is performed by the generation of the hash value for each block shown in FIG. 5 and the generation of the first hash value shown in FIG. . In addition, the hash value generation unit 32 sends the second hash value generated for each terminal device 20 to the search processing unit 33.

  As described above, the search processing unit 33 collates each of the second hash values with the first hash value stored in the storage unit 31 so that the first hash value matches or is similar to the second hash value. The terminal device 20 transmitting the hash value of

  Specifically, the search processing unit 33 performs two types of logical operators on the second hash value and the first hash value, and based on the result of each of the obtained logical operations, the second processing is performed. Calculate the similarity of the hash value to the first hash value. Then, the search processing unit 33 determines that the second hash value is similar to the first hash value when the calculated similarity is equal to or more than the threshold.

  Here, the method of calculating the degree of similarity will be described more specifically. In the present embodiment, the similarity can be calculated using, for example, the Jaccard coefficient according to the following equation 3. In the following Equation 3, the first hash value and the second hash value are used as A and B.

(Number 3)
J (A, B) = | A∩B | / | A∪B |

For example, it is assumed that A = “60663E2573DCC490BB948B503FE068521136F5CA0F45CB47 ₍₁₆₎ ” and B = “40642EA1FBDDD89EFDB41D403FA068521114D0CB4F550B44 ₍₁₆₎ ”. In this case, | A∩B | and | A∪B | are as follows.
| A∩B | = 40642E2173DCC090B99409403FA068521114D0CA0F450B44 ₍₁₆₎ |
| A∪B | = 60663EA5FBDDDC9EFFB49F503FE068521136F5CB4F55CB47 ₍₁₆₎

  Then, the degree of similarity J (A, B) is obtained by dividing the number of 1s when | A∩B | is expressed in binary numbers by the number of 1s when | A∪B | is expressed in binary numbers. It will be 0.66 ... (about 66.7%).

  When the search processing unit 33 specifies the terminal device 20, the search processing unit 33 extracts time data and shooting position data associated with the first hash value transmitted by the specified terminal device 20, and extracts the extracted time data and shooting position data. The movement trajectory of the search object can also be estimated using this.

[Device operation]
Next, operations of the search system 10, the search device 30, and the terminal device 20 in the present embodiment will be described with reference to FIGS. 7 and 8. FIG. Refer to Figure 1 as appropriate. In the first embodiment, the person searching method is implemented by operating the person searching stem. Therefore, the explanation of the search method in the present embodiment is replaced with the following explanation of the operation of the search device 30.

  First, the operation of the terminal device 20 in the present embodiment will be described using FIG. 7. FIG. 7 is a flowchart showing the operation of the terminal device 20 according to the embodiment of the present invention.

  First, as shown in FIG. 7, in the terminal device 20, when the imaging device 24 outputs image data, the image detection unit 21 acquires the output image data (step A1). Further, time data and photographing position data are added to the image data acquired at this time.

  Next, the image detection unit 21 removes a background portion from the image specified by the image data acquired in step A1, and further detects an image to be searched from a portion remaining without being removed (step A2) ).

  Next, the hash value generation unit 22 divides the search target image detected in step A2 into a plurality of blocks, digitizes the feature of the image for each block to create a bit string, and generates each bit string The first hash value is generated by encryption according to a method unique to the terminal device 20 provided (step A3).

  Next, the transmitting unit 23 adds to the first hash value generated in step A3 and transmits the first hash value to which these data are added to the search device 30 (step A4).

  After the execution of step A4, the processing in the terminal device 20 is temporarily ended, but when the imaging device 24 outputs the image data again, step A1 is executed again. Further, in the present embodiment, steps A1 to A4 may be repeatedly executed at constant intervals.

  Subsequently, the operation of the search device 30 in the present embodiment will be described using FIG. FIG. 8 is a flow chart showing the operation of the search device 30 in the embodiment of the present invention.

  First, as a premise, it is assumed that one of the terminal devices 20 executes steps A1 to A4 and transmits a first hash value to which time data and shooting position data are added. In addition, in the search device 30, it is assumed that the storage unit 31 stores the received first hash value in association with time data and imaging data.

  First, as shown in FIG. 8, when data for specifying the appearance of a search target is input from the external terminal device 60 to the search device 30, the hash value generation unit 32 receives the input data. Acquire (step B1).

  Next, the hash value generation unit 32 generates a second hash value corresponding to the terminal device 20 for each terminal device 20 from the acquired data, using a method unique to each terminal device (step B2). ).

  Next, the search processing unit 33 collates each of the second hash values with the first hash value stored in the storage unit 31 to obtain a first hash that matches or is similar to the second hash value. The terminal device 20 transmitting the value is specified (step B3).

  Thereafter, the search processing unit 33 extracts, from the storage unit 31, time data and photographing position data associated with the first hash value transmitted by the terminal device 20 specified in step B3, and extracts the extracted time data and photographing The movement trajectory of the search object is estimated using the position data (step B4).

  As described above, in the present embodiment, the image data captured by the imaging device 24 in each terminal device 20 is converted into a hash value created by a method different for each terminal device 20. For this reason, in order to specify the action of the person who is the search target, it is necessary to know the method for each terminal device 20, and even if the data leaks, it is impossible for the third party to specify the action of the person It is. Further, in the above-described example, the search target is a person, but in the present embodiment, the search target may be an object other than a person, for example, a car, an animal or the like.

[program]
The first program in the present embodiment may be a program that causes a computer to execute steps A1 to A4 shown in FIG. The terminal device 20 according to the present embodiment can be realized by installing this program in a computer and executing it. In this case, the processor of the computer includes the image detection unit 21 and the hash value generation unit 22.
, And functions as the transmission unit 23, and performs processing.

  Further, the second program in the present embodiment may be a program which causes a computer to execute steps B1 to B4 shown in FIG. By installing this program on a computer and executing it, the search device 30 in the present embodiment can be realized. In this case, the processor of the computer functions as the hash value generation unit 32 and the search processing unit 33 to perform processing. The storage unit 31 can be realized by a storage device such as a hard disk provided in a computer.

  Further, the second program in the present embodiment may be executed by a computer system constructed by a plurality of computers. In this case, for example, each computer may function as either the hash value generation unit 32 or the search processing unit 33. The storage unit 31 may be constructed on a computer different from the computer that executes the second program in the present embodiment.

Physical configuration
Here, a computer for realizing the terminal device 20 and the search device 30 by executing the program in the present embodiment will be described with reference to FIG. FIG. 9 is a block diagram showing an example of a computer for realizing the terminal device and the search device in the embodiment of the present invention.

  As shown in FIG. 9, the computer 110 includes a CPU 111, a main memory 112, a storage device 113, an input interface 114, a display controller 115, a data reader / writer 116, and a communication interface 117. These units are communicably connected to each other via a bus 121.

  The CPU 111 develops the program (code) in the present embodiment stored in the storage device 113 in the main memory 112 and executes various operations by executing these in a predetermined order. The main memory 112 is typically a volatile storage device such as a dynamic random access memory (DRAM). In addition, the program in the present embodiment is provided in the state of being stored in computer readable recording medium 120. The program in the present embodiment may be distributed on the Internet connected via communication interface 117.

  Further, as a specific example of the storage device 113, besides a hard disk drive, a semiconductor storage device such as a flash memory may be mentioned. The input interface 114 mediates data transmission between the CPU 111 and an input device 118 such as a keyboard and a mouse. The display controller 115 is connected to the display device 119 and controls the display on the display device 119.

  The data reader / writer 116 mediates data transmission between the CPU 111 and the recording medium 120, and executes reading of a program from the recording medium 120 and writing of the processing result in the computer 110 to the recording medium 120. The communication interface 117 mediates data transmission between the CPU 111 and another computer.

  In addition, specific examples of the recording medium 120 include general-purpose semiconductor storage devices such as CF (Compact Flash (registered trademark) and SD (Secure Digital), magnetic recording media such as flexible disk (Flexible Disk), or CD- An optical recording medium such as a ROM (Compact Disk Read Only Memory) may be mentioned.

  The terminal device 20 and the search device 30 in the present embodiment can also be realized by using hardware corresponding to each unit, not a computer on which a program is installed. Furthermore, the terminal device 20 and the search device 30 may be partially realized by a program, and the remaining portions may be realized by hardware.

  A part or all of the embodiment described above can be expressed by (Appendix 1) to (Appendix 20) described below, but is not limited to the following description.

(Supplementary Note 1)
Equipped with a plurality of terminals and a search device,
Each of the plurality of terminal devices is
An image detection unit that detects an image to be searched from images output from imaging devices corresponding to the respective images;
A hash value generation unit that encrypts the detected image to be searched according to a method specific to the terminal device to generate a first hash value;
A transmitter configured to transmit the generated first hash value to the search device;
Equipped with
The search device is
An accumulation unit for accumulating the first hash value transmitted for each of the plurality of terminal devices;
The data specifying the appearance of the search target is acquired, and the second hash corresponding to each of the plurality of terminal devices is obtained from the acquired data using the unique method of each of the plurality of terminal devices. A hash value generator that generates a value;
Each of the second hash values generated by the hash value generation unit is compared with the first hash value stored in the storage unit, and the first hash value matches or is similar to the second hash value. A search processing unit that specifies a terminal device that is transmitting a hash value of
The search system characterized by having.

(Supplementary Note 2)
In each of the plurality of terminal devices, the hash value generation unit divides the image to be searched into a plurality of blocks, and for each of the plurality of blocks, digitizes the feature of the image constituting the block. Generating a bit string, and encrypting each bit string generated according to a method specific to the terminal apparatus to generate a first hash value;
In the search device, the hash value generation unit digitizes the feature of the image constituting each block obtained by dividing the image of the search target into a plurality of pieces as data for specifying the appearance of the search target. Obtaining the bit string obtained in step S106, and encrypting each obtained bit string in each of the plurality of terminal devices according to the unique method to generate a second hash value corresponding to each of the plurality of terminal devices;
The search system according to appendix 1.

(Supplementary Note 3)
In each of the plurality of terminal devices, the hash value generation unit digitizes the hue distribution and the saturation distribution of the image forming the block for each of the plurality of blocks of the image to be searched for, thereby generating a bit string To create
The search system according to appendix 2.

(Supplementary Note 4)
In the search device, the search processing unit performs two types of logical operators on the second hash value and the first hash value, and based on the result of each logical operation obtained, The similarity between the second hash value and the first hash value is calculated, and it is determined that the second hash value is similar to the first hash value if the calculated similarity is equal to or greater than a threshold. The search system according to any one of 1 to 3.

(Supplementary Note 5)
A search device connected to a plurality of terminal devices, which transmits a first hash value generated by encrypting an image to be searched for, the search device comprising:
An accumulation unit for accumulating the first hash value transmitted for each of the plurality of terminal devices;
The data specifying the appearance of the search target is acquired, and the second hash corresponding to each of the plurality of terminal devices is obtained from the acquired data using the unique method of each of the plurality of terminal devices. A hash value generator that generates a value;
Each of the second hash values generated by the hash value generation unit is compared with the first hash value stored in the storage unit, and the first hash value matches or is similar to the second hash value. A search processing unit that specifies a terminal device that is transmitting a hash value of
The search device characterized by having.

(Supplementary Note 6)
Each of the plurality of terminal devices divides the image to be searched into a plurality of blocks, and for each of the plurality of blocks, the feature of the image constituting the block is digitized to create a bit string, and created In the case where each bit string is encrypted according to a method specific to the terminal device to generate a first hash value,
A bit string obtained by digitizing a feature of an image constituting each block obtained by dividing the image to be searched into a plurality of pieces as data for specifying the appearance of the search object, the hash value generation unit specifying the appearance of the search object , And encrypts each acquired bit string for each of the plurality of terminal devices according to the unique method, and generates a second hash value corresponding to each of the plurality of terminal devices.
The search device according to appendix 5.

(Appendix 7)
The search processing unit performs two types of logical operators on the second hash value and the first hash value, and based on the result of each logical operation obtained, the second hash value Calculating the degree of similarity to the first hash value, and determining that the second hash value is similar to the first hash value if the calculated degree of similarity is greater than or equal to a threshold value;
The search device according to Appendix 5 or 6.

(Supplementary Note 8)
An image detection unit that detects an image to be searched from an image output from the imaging device;
A hash value generation unit that encrypts the detected image to be searched according to a unique method to generate a hash value;
A transmitting unit that transmits the generated hash value to an external device;
The terminal device characterized by having.

(Appendix 9)
The hash value generation unit divides the search target image into a plurality of blocks, and for each of the plurality of blocks, digitizes features of the image constituting the block to create a bit string, and creates Each bit string is encrypted according to a method specific to the terminal device to generate the hash value.
The terminal device according to appendix 8.

(Supplementary Note 10)
The hash value generation unit digitizes the hue distribution and the saturation distribution of the image forming the block for each of the plurality of blocks of the search target image, and generates a bit string.
The terminal device according to appendix 9.

(Supplementary Note 11)
A method for searching a search target using a plurality of terminals and a search device, the method comprising:
Implemented by each of the plurality of terminal devices,
A search target image detection step of detecting the search target image from the images output from the corresponding imaging devices;
A first hash value generation step of encrypting the detected image to be searched according to a method specific to the terminal device to generate a first hash value;
Sending the generated first hash value to the search device.
Furthermore, implemented by the search device,
Storing the first hash value transmitted for each of the plurality of terminal devices;
The data specifying the appearance of the search target is acquired, and the second hash corresponding to each of the plurality of terminal devices is obtained from the acquired data using the unique method of each of the plurality of terminal devices. Generating a second hash value generating step;
A terminal apparatus transmitting the first hash value that matches or is similar to the second hash value by comparing each of the generated second hash values with the stored first hash value Identifying a search processing step;
Search method characterized by

(Supplementary Note 12)
In the first hash value generation step by each of the plurality of terminal devices,
The image to be searched is divided into a plurality of blocks, and for each of the plurality of blocks, the feature of the image constituting the block is digitized to create a bit string, and each bit string created is the corresponding terminal device Encrypt by the method unique to the first hash value,
In the second hash value generation step by the search device,
For each block obtained by dividing the search target image into plural pieces as data for specifying the appearance of the search target, a bit string obtained by digitizing features of the image constituting the block is acquired, and each acquired The bit string is encrypted for each of the plurality of terminal devices in its own unique scheme, and a second hash value corresponding to each of the plurality of terminal devices is generated.
The search method according to appendix 11.

(Supplementary Note 13)
In the first hash value generation step by each of the plurality of terminal devices,
For each of the plurality of blocks of the search target image, the hue distribution and saturation distribution of the image forming the block are quantified to create a bit string.
The search method according to appendix 12.

(Supplementary Note 14)
In the search processing step by the search device,
Two types of logical operators are performed on the second hash value and the first hash value, and the first hash of the second hash value is calculated based on the result of each obtained logical operation. Calculating a similarity to a value, and determining that the second hash value is similar to the first hash value if the calculated similarity is greater than or equal to a threshold;
The search method according to any one of appendices 11-13.

(Supplementary Note 15)
A computer connected to a plurality of terminal devices that transmits a first hash value generated by encrypting an image to be searched;
Storing the first hash value transmitted for each of the plurality of terminal devices;
The data specifying the appearance of the search target is acquired, and the second hash corresponding to each of the plurality of terminal devices is obtained from the acquired data using the unique method of each of the plurality of terminal devices. Generating a second hash value generating step;
Each of the second hash values generated in the second hash value generation step is compared with the first hash value stored, and the first hash value matches or is similar to the second hash value. A search processing step of identifying a terminal device transmitting a hash value;
A program that runs

(Supplementary Note 16)
Each of the plurality of terminal devices divides the image to be searched into a plurality of blocks, and for each of the plurality of blocks, the feature of the image constituting the block is digitized to create a bit string, and created In the case where each bit string is encrypted according to a method specific to the terminal device to generate a first hash value,
In the second hash value generation step, as data for specifying the appearance of the search target, the feature of the image constituting the block is obtained by digitizing each of the blocks obtained by dividing the image of the search target into a plurality. Acquiring the acquired bit string, and encrypting each acquired bit string for each of the plurality of terminal devices by its own unique method, and generating a second hash value corresponding to each of the plurality of terminal devices;
The program according to appendix 15.

(Supplementary Note 17)
In the search processing step, two types of logical operators are performed on the second hash value and the first hash value, and based on the result of each logical operation obtained, the second hash value Calculating the degree of similarity to the first hash value, and determining that the second hash value is similar to the first hash value if the calculated degree of similarity is greater than or equal to a threshold value;
The program according to appendix 15 or 16.

(Appendix 18)
On the computer
A search target image detection step of detecting a search target image from an image output from the imaging device;
A hash value generation step of encrypting the detected image to be searched according to a unique method to generate a hash value;
Transmitting the generated hash value to an external device;
A program that runs

(Appendix 19)
In the hash value generation step, the search target image is divided into a plurality of blocks, and for each of the plurality of blocks, the feature of the image constituting the block is digitized to create a bit string, and created Each bit string is encrypted by a method specific to the computer to generate the hash value.
The program according to appendix 18.

(Supplementary Note 20)
In the hash value generation step, for each of the plurality of blocks of the search target image, the hue distribution and saturation distribution of the image constituting the block are quantified to create a bit string.
The program according to appendix 19.

  As described above, according to the present invention, even when information is leaked, it is possible to make it impossible to specify the behavior of an individual. The present invention is useful in a field where it is required to prevent the leakage of information identifying a movement trajectory of an individual, for example, a service for monitoring the behavior of a child.

DESCRIPTION OF SYMBOLS 10 Search system 20 Terminal device 21 Image detection part 22 Hash value generation part 23 Transmission part 24 Imaging device 30 Search apparatus 31 Accumulator 32 Hash value generation part 33 Search processing part 40 Person 50 Bus 60 Terminal device 110 Computer 111 CPU
112 main memory 113 storage device 114 input interface 115 display controller 116 data reader / writer 117 communication interface 118 input device 119 display device 120 recording medium 121 bus

Claims (20)

Equipped with a plurality of terminals and a search device,
Each of the plurality of terminal devices is
An image detection unit that detects an image to be searched from images output from imaging devices corresponding to the respective images;
A hash value generation unit that encrypts the detected image to be searched according to a method specific to the terminal device to generate a first hash value;
A transmitter configured to transmit the generated first hash value to the search device;
Equipped with
The search device is
An accumulation unit for accumulating the first hash value transmitted for each of the plurality of terminal devices;
The data specifying the appearance of the search target is acquired, and the second hash corresponding to each of the plurality of terminal devices is obtained from the acquired data using the unique method of each of the plurality of terminal devices. A hash value generator that generates a value;
Each of the second hash values generated by the hash value generation unit is compared with the first hash value stored in the storage unit, and the first hash value matches or is similar to the second hash value. A search processing unit that specifies a terminal device that is transmitting a hash value of
The search system characterized by having. In each of the plurality of terminal devices, the hash value generation unit divides the image to be searched into a plurality of blocks, and for each of the plurality of blocks, digitizes the feature of the image constituting the block. Generating a bit string, and encrypting each bit string generated according to a method specific to the terminal apparatus to generate a first hash value;
In the search device, the hash value generation unit digitizes the feature of the image constituting each block obtained by dividing the image of the search target into a plurality of pieces as data for specifying the appearance of the search target. Obtaining the bit string obtained in step S106, and encrypting each obtained bit string in each of the plurality of terminal devices according to the unique method to generate a second hash value corresponding to each of the plurality of terminal devices;
The search system according to claim 1. In each of the plurality of terminal devices, the hash value generation unit digitizes the hue distribution and the saturation distribution of the image forming the block for each of the plurality of blocks of the image to be searched for, thereby generating a bit string To create
The search system according to claim 2.   In the search device, the search processing unit performs two types of logical operators on the second hash value and the first hash value, and based on the result of each logical operation obtained, The similarity between the second hash value and the first hash value is calculated, and it is determined that the second hash value is similar to the first hash value if the calculated similarity is greater than or equal to a threshold. The search system according to any one of Items 1 to 3. A search device connected to a plurality of terminal devices, which transmits a first hash value generated by encrypting an image to be searched for, the search device comprising:
An accumulation unit for accumulating the first hash value transmitted for each of the plurality of terminal devices;
The data specifying the appearance of the search target is acquired, and the second hash corresponding to each of the plurality of terminal devices is obtained from the acquired data using the unique method of each of the plurality of terminal devices. A hash value generator that generates a value;
Each of the second hash values generated by the hash value generation unit is compared with the first hash value stored in the storage unit, and the first hash value matches or is similar to the second hash value. A search processing unit that specifies a terminal device that is transmitting a hash value of
The search device characterized by having. Each of the plurality of terminal devices divides the image to be searched into a plurality of blocks, and for each of the plurality of blocks, the feature of the image constituting the block is digitized to create a bit string, and created In the case where each bit string is encrypted according to a method specific to the terminal device to generate a first hash value,
A bit string obtained by digitizing a feature of an image constituting each block obtained by dividing the image to be searched into a plurality of pieces as data for specifying the appearance of the search object, the hash value generation unit specifying the appearance of the search object , And encrypts each acquired bit string for each of the plurality of terminal devices according to the unique method, and generates a second hash value corresponding to each of the plurality of terminal devices.
The search device according to claim 5. The search processing unit performs two types of logical operators on the second hash value and the first hash value, and based on the result of each logical operation obtained, the second hash value Calculating the degree of similarity to the first hash value, and determining that the second hash value is similar to the first hash value if the calculated degree of similarity is greater than or equal to a threshold value;
The search device according to claim 5 or 6. An image detection unit that detects an image to be searched from an image output from the imaging device;
A hash value generation unit that encrypts the detected image to be searched according to a unique method to generate a hash value;
A transmitting unit that transmits the generated hash value to an external device;
The terminal device characterized by having. The hash value generation unit divides the search target image into a plurality of blocks, and for each of the plurality of blocks, digitizes features of the image constituting the block to create a bit string, and creates Each bit string is encrypted according to a method specific to the terminal device to generate the hash value.
The terminal device according to claim 8. The hash value generation unit digitizes the hue distribution and the saturation distribution of the image forming the block for each of the plurality of blocks of the search target image, and generates a bit string.
The terminal device according to claim 9. A method for searching a search target using a plurality of terminals and a search device, the method comprising:
Implemented by each of the plurality of terminal devices,
A search target image detection step of detecting the search target image from the images output from the corresponding imaging devices;
A first hash value generation step of encrypting the detected image to be searched according to a method specific to the terminal device to generate a first hash value;
Sending the generated first hash value to the search device.
Furthermore, implemented by the search device,
Storing the first hash value transmitted for each of the plurality of terminal devices;
The data specifying the appearance of the search target is acquired, and the second hash corresponding to each of the plurality of terminal devices is obtained from the acquired data using the unique method of each of the plurality of terminal devices. Generating a second hash value generating step;
A terminal apparatus transmitting the first hash value that matches or is similar to the second hash value by comparing each of the generated second hash values with the stored first hash value Identifying a search processing step;
Search method characterized by In the first hash value generation step by each of the plurality of terminal devices,
The image to be searched is divided into a plurality of blocks, and for each of the plurality of blocks, the feature of the image constituting the block is digitized to create a bit string, and each bit string created is the corresponding terminal device Encrypt by the method unique to the first hash value,
In the second hash value generation step by the search device,
For each block obtained by dividing the search target image into plural pieces as data for specifying the appearance of the search target, a bit string obtained by digitizing features of the image constituting the block is acquired, and each acquired The bit string is encrypted for each of the plurality of terminal devices in its own unique scheme, and a second hash value corresponding to each of the plurality of terminal devices is generated.
The search method according to claim 11. In the first hash value generation step by each of the plurality of terminal devices,
For each of the plurality of blocks of the search target image, the hue distribution and saturation distribution of the image forming the block are quantified to create a bit string.
A search method according to claim 12. In the search processing step by the search device,
Two types of logical operators are performed on the second hash value and the first hash value, and the first hash of the second hash value is calculated based on the result of each obtained logical operation. Calculating a similarity to a value, and determining that the second hash value is similar to the first hash value if the calculated similarity is greater than or equal to a threshold;
The search method according to any one of claims 11 to 13. A computer connected to a plurality of terminal devices that transmits a first hash value generated by encrypting an image to be searched;
Storing the first hash value transmitted for each of the plurality of terminal devices;
The data specifying the appearance of the search target is acquired, and the second hash corresponding to each of the plurality of terminal devices is obtained from the acquired data using the unique method of each of the plurality of terminal devices. Generating a second hash value generating step;
Each of the second hash values generated in the second hash value generation step is compared with the first hash value stored, and the first hash value matches or is similar to the second hash value. A search processing step of identifying a terminal device transmitting a hash value;
A program that runs Each of the plurality of terminal devices divides the image to be searched into a plurality of blocks, and for each of the plurality of blocks, the feature of the image constituting the block is digitized to create a bit string, and created In the case where each bit string is encrypted according to a method specific to the terminal device to generate a first hash value,
In the second hash value generation step, as data for specifying the appearance of the search target, the feature of the image constituting the block is obtained by digitizing each of the blocks obtained by dividing the image of the search target into a plurality. The acquired bit string, and encrypting each of the acquired bit strings for each of the plurality of terminal devices according to its own unique method, the second corresponding to each of the plurality of terminal devices
Generate a hash value for
The program according to claim 15. In the search processing step, two types of logical operators are performed on the second hash value and the first hash value, and based on the result of each logical operation obtained, the second hash value Calculating the degree of similarity to the first hash value, and determining that the second hash value is similar to the first hash value if the calculated degree of similarity is greater than or equal to a threshold value;
The program according to claim 15 or 16. On the computer
A search target image detection step of detecting a search target image from an image output from the imaging device;
A hash value generation step of encrypting the detected image to be searched according to a unique method to generate a hash value;
Transmitting the generated hash value to an external device;
A program that runs In the hash value generation step, the search target image is divided into a plurality of blocks, and for each of the plurality of blocks, the feature of the image constituting the block is digitized to create a bit string, and created Each bit string is encrypted by a method specific to the computer to generate the hash value.
The program according to claim 18. In the hash value generation step, for each of the plurality of blocks of the search target image, the hue distribution and saturation distribution of the image constituting the block are quantified to create a bit string.
The program according to claim 19.

Images