WO2019095221A1

WO2019095221A1 - Method for searching for person, apparatus, terminal and cloud server

Info

Publication number: WO2019095221A1
Application number: PCT/CN2017/111400
Authority: WO
Inventors: 骆磊
Original assignee: 深圳前海达闼云端智能科技有限公司
Priority date: 2017-11-16
Filing date: 2017-11-16
Publication date: 2019-05-23
Also published as: CN108064388A

Abstract

The present disclosure relates to a method for searching for a person, an apparatus, a terminal, and a cloud server, which may better search for people to be found, increasing the efficiency of searching for people. The method comprises: receiving facial feature information of a person to be found that is sent by a cloud server, a terminal being located within a search range corresponding to the person to be found; detecting whether an image captured by the terminal contains a sub-image matching the facial feature information; when detected that the image captured by the terminal contains the sub-image, determining a person corresponding to the sub-image to be the person to be found.

Description

Character search method, device, terminal and cloud server

Technical field

The present disclosure relates to the field of communications technologies, and in particular, to a person search method, device, terminal, and cloud server.

Background technique

In a scene, in a scenic spot, a station, an airport, or other public areas, it is often the case that no peers can be found, family members can be found, and so on. In another scenario, the Public Security Bureau needs to search for suspects nationwide and search for lost elderly children.

In response to the first scenario above, people must first find the staff and then let the staff broadcast throughout the area. If the searcher hears the broadcast, they need to go to the location mentioned in the broadcast to meet the searcher, but the loser It is often the elderly and children and other people with weaker abilities, so it is more difficult to find someone. Or if someone hears the broadcast and happens to find the person being searched, the discoverer may contact the staff, which is more passive and less efficient.

For the second scenario mentioned above, usually through video surveillance in the city, or someone happens to see the wanted or tracing notice, and just happens to see the person being searched, it may provide clues to the public security department, such a tracing The method is less efficient.

Summary of the invention

In order to overcome the problems in the related art, the present disclosure provides a person search method, device, terminal, and cloud server, which can better search for a person to be sought and improve the efficiency of searching for people.

According to a first aspect of the embodiments of the present disclosure, a person search method is provided, which is applied to a terminal, and the method includes:

Receiving facial feature information of the person to be sought sent by the cloud server, where the terminal is located Within the search range corresponding to the person to be sought;

Detecting whether an image captured by the terminal includes a sub-image that matches the facial feature information;

When it is detected that the image captured by the terminal includes the sub-image, the person corresponding to the sub-image is determined as the person to be sought.

According to a second aspect of the embodiments of the present disclosure, a person search method is provided, which is applied to a cloud server, and the method includes:

Receiving facial feature information and search range of the person to be sought provided by the information publisher;

Determining a plurality of terminals in the search range that assist the tracing function in an open state;

Sending facial feature information of the person to be sought to the plurality of terminals respectively.

According to a third aspect of the embodiments of the present disclosure, there is provided a person search device, which is applied to a terminal, the device comprising:

The receiving module is configured to receive facial feature information of the person to be sought sent by the cloud server, where the terminal is in a search range corresponding to the person to be sought;

a detecting module configured to detect whether an image captured by the terminal includes a sub-image that matches the facial feature information;

The determining module is configured to determine, when the image captured by the terminal includes the sub-image, the person corresponding to the sub-image as the person to be sought.

According to a fourth aspect of the embodiments of the present disclosure, there is provided a person search device, which is applied to a cloud server, the device comprising:

The receiving module is configured to receive facial feature information and a search range of the person to be sought provided by the information publisher;

a determining module configured to determine a plurality of terminals in the search range that assist the tracing function in an open state;

a sending module, configured to separately send the face of the person to be sought to the plurality of terminals Sign the information.

According to a fifth aspect of an embodiment of the present disclosure, there is provided a computer program product comprising a computer program executable by a programmable device, the computer program having when executed by the programmable device The code portion of the method of any of the first and second aspects described above.

According to a sixth aspect of the embodiments of the present disclosure, there is provided a non-transitory computer readable storage medium comprising one or more programs for performing The method of any of the first aspect and the second aspect described above.

According to a seventh aspect of the embodiments of the present disclosure, there is provided a terminal comprising a non-transitory computer readable storage medium; and one or more processors for executing a program in the non-transitory computer readable storage medium; The non-transitory computer readable storage medium stores instructions for performing the method of the above first aspect of the claims.

According to an eighth aspect of the embodiments of the present disclosure, there is provided a server comprising a non-transitory computer readable storage medium; and one or more processors for executing a program in the non-transitory computer readable storage medium; The non-transitory computer readable storage medium stores instructions for performing the method of the second aspect described above.

The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

In the embodiment of the present disclosure, the terminal may receive facial feature information of the person to be sought sent by the cloud server, and the facial feature information of the person to be sought may be published by the tracing person to the cloud server. The terminal may perform face recognition on the captured image, and further detect whether the captured image includes a sub-image that matches the received facial feature information. If it is detected that the image captured by the terminal includes the sub-image, the sub-image may be used. The person corresponding to the image is determined to be the person to be sought. In this way, the efficiency of the character search is improved, new functions are added to the terminal, and the degree of intelligence of the terminal is improved. At the same time, since the face matching process is completed at the terminal, the terminal information is not leaked.

DRAWINGS

The drawings are intended to provide a further understanding of the disclosure, and are in the In the drawing:

FIG. 1 is a flowchart of a character searching method applied to a terminal according to an exemplary embodiment;

FIG. 2 is a flowchart of a person search method applied to a cloud server according to an exemplary embodiment;

FIG. 3 is a block diagram of a person search device according to an exemplary embodiment;

FIG. 4 is a block diagram of a person search device according to an exemplary embodiment.

Detailed ways

The specific embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. It is to be understood that the specific embodiments described herein are not to be construed

In addition, the term "and/or" herein is merely an association relationship describing an associated object, indicating that there may be three relationships, for example, A and/or B, which may indicate that A exists separately, and A and B exist at the same time. There are three cases of B alone.

Please refer to FIG. 1. FIG. 1 is a flowchart of a person searching method applied to a terminal according to an exemplary embodiment. As shown in Figure 1, the method includes the following steps.

Step S11: Receive facial feature information of the person to be sought sent by the cloud server.

Step S12: It is detected whether the image photographed by the terminal includes a sub image matching the facial feature information.

Step S13: When it is detected that the image captured by the terminal includes the sub-image, the person corresponding to the sub-image is determined as the person to be sought.

In the embodiment of the present disclosure, the terminal can be connected to the cloud server through the network, and can communicate with the cloud server. The terminal can be any smart device, such as a smart phone, a PC (Personal Computer), a PAD (Personal Digital Assistant), a smart wearable device, and the like.

In the embodiment of the present disclosure, the terminal capable of receiving the facial feature information for searching for the person pushed by the cloud server may be the terminal registered by the cloud server. The registered terminal allows for some non-perceived extra operations during photo or video recording for public interest purposes or for certain profit or reward, and automatically shares the comparison results and some additional information.

The information publisher who needs to perform the person search may publish the facial feature information of the person to be sought to the cloud server, for example, the facial feature information may be directly sent to the cloud server, or the photo of the person to be sought may be sent to the cloud server, and the cloud server Face recognition of photos, extracting facial feature information of the person to be sought, and the like.

When the information publisher publishes the facial feature information of the person to be sought, the information publisher can also publish the search range, that is, the range that the person to be sought may appear, such as a range of areas where the position to be searched for is lost, and the like. After receiving the facial feature information and the search range of the person to be sought published by the information publisher, the cloud server may send the facial feature information of the person to be sought to the terminal in the search range. Of course, you can also post some other information about the person to be found, such as gender, age, name, phone number, and so on.

The terminal may receive facial feature information of the person to be sought sent by the cloud server. Of course, the terminal may simultaneously receive and store facial feature information of the plurality of persons to be sought, and may also have multiple facial feature information for the same person to be sought. The embodiment does not limit this.

For any terminal that receives the facial feature information, it may be detected whether the image captured by the terminal includes a sub-image that matches the facial feature information, and if so, the person corresponding to the sub-image may be determined as a person to be sought. The image may be an image of a subject person in the image or an image of a background person. Through such a party that assists in finding people by the terminals in the search range The method can improve the efficiency of the character search, and the detection process of the terminal can be run in the background if the user allows, and can be non-perceived to the user and does not affect the user.

Optionally, detecting whether the image captured by the terminal includes a sub-image that matches the facial feature information, may be, when the terminal performs image capturing preview, detecting whether the previewed image includes a sub-image matching the facial feature information; or at the terminal Each time an image is taken, it is detected whether the captured image includes a sub-image matching the facial feature information; and each time the terminal captures a video, detecting whether each frame image included in the captured video includes facial features The sub-image that the information matches.

That is, after the terminal receives the facial feature information of the person to be sought sent by the cloud server, the user of the terminal can still use the terminal to perform photographing or video recording, and then the terminal can perform shooting, and face recognition is directly performed in the preview image. Face recognition can be performed for each frame image included in the image captured by the terminal or the video. The process of face recognition can be completed in the background of the terminal, so that the information publisher can be assisted in the character search without the perception of the end user, and the efficiency of the person search can be improved without affecting the end user.

Optionally, detecting whether the image captured by the terminal includes a sub-image that matches the facial feature information, or acquiring all the images captured by the terminal within a preset duration before the time when the facial feature information is received, and then detecting all the images. Whether each image contains a sub-image.

The terminal user may also capture the person to be sought in a period of time before receiving the facial feature information of the person to be sought. Therefore, the preset time length before the time when the terminal receives the facial feature information may be set (for example, set to 30 minutes). , 20 minutes, etc.) all the images captured in the face are recognized, and it is detected whether or not the person to be found is photographed. Of course, it is also possible to detect all of the preset time lengths before the time when the terminal receives the facial feature information. Whether each frame image included in the video is photographed by the person to be sought.

Optionally, after the person corresponding to the sub image is determined as the person to be sought, the location range of the terminal when the terminal captures the target image including the sub image may be sent to the cloud server. Passing the cloud server to notify the information publisher of the facial feature information of the person to be sought; and/or transmitting the contact information of the user of the terminal to the cloud server to notify the information publisher of the user of the terminal through the cloud server; and/or according to The received contact information of the information publisher sent by the cloud server outputs a prompt message to prompt the user of the terminal to notify the information publisher.

That is to say, after determining the person to be found, the terminal may notify the cloud server, and the cloud server may notify the information publisher, or the user of the terminal may actively contact the information publisher according to the contact information of the information publisher sent by the cloud server. ,and many more. In this way, the search result of the person to be sought can be notified to the information publisher more conveniently and quickly.

In the embodiment of the present disclosure, the terminal user notifies the cloud server, or the contact information publisher can mark the character search work as completed, and the terminal can delete the information stored in the character search work (such as the facial features of the person to be sought). Information, search scope, contact information, etc.). Alternatively, the information publisher may notify the cloud server to mark the character search work as completed after contacting the terminal user or the person to be found, and then the cloud server may send an instruction to the terminal that receives the search task, and delete the command. Corresponding information.

Optionally, the terminal may receive the facial feature information of the to-be-searched person sent by the cloud server, and the identity information of the to-be-searched person, so that the user of the terminal confirms the identity of the person, where The identity information includes at least one of a name, a gender, an age, an identity card number, and a cell phone number.

The information that the cloud server pushes to the terminal in the search range is not limited to the facial feature information of the person to be sought, and may also include other identity information, so that the terminal user can directly treat the person looking for the identity when searching for the person to be found. Further confirmation, the information publisher can be notified after confirmation, and the accuracy of the person search is improved.

Optionally, before receiving the facial feature information of the to-be-searched person sent by the cloud server, the opening operation may also be acquired, and then according to the opening operation, the assisting tracing function is turned on to receive the information for searching for the person sent by the cloud server.

In the embodiment of the present disclosure, for the terminal, the user of the terminal can set the assisted tracing function to be turned off and not notified at any time point, and the notification is allowed to be turned on, always on, etc. when requested. For the shutdown and not to notify the setting, it is equivalent to the terminal ignoring all the tracing requests, which is the same as the unregistered terminal; if the notification is allowed when the request is enabled, the cloud server will prompt the terminal when the search range includes the location of the terminal. There are new searched people, the current possible range, and whether to enable the photo-seeking function, the user can accept or reject according to their current situation; for the way that the cloud server is always open, the cloud server will directly find the person's face after requesting. The feature information is pushed to the terminal, and the notification to the user depends on the specific implementation, which is not limited herein. That is, the user can select whether to enable the help finding function, and only when the user selects the function of assisting the search, the terminal performs the above-mentioned person search method, and then receives the facial feature information of the person to be sought pushed by the cloud server. The user's operability is strong. In an actual application, the information publisher can use the cloud server to issue a reward to encourage the terminal to use the help-seeking function, which is not limited in the embodiment of the present disclosure.

Please refer to FIG. 2. FIG. 2 is a flowchart of a character searching method applied to a cloud server according to an exemplary embodiment. As shown in FIG. 2, the method includes the following steps.

Step S21: Receive facial feature information and a search range of the person to be sought provided by the information publisher.

Step S22: determining a plurality of terminals in the search range that assist the tracing function is in an open state.

Step S23: Send facial feature information of the person to be sought to the plurality of terminals respectively.

That is to say, the information publisher can publish the facial feature information and the search range of the person to be sought to the cloud server, and then the cloud server pushes the facial feature information of the person to be sought to the terminal in the search range, and then passes the search range. The terminal assists in finding the person to be sought. In this way, the efficiency of the character search can be improved.

Certainly, in the embodiment of the present disclosure, after receiving the facial feature information of the person to be sought, the terminal may also send the captured image or video to the cloud server, and the cloud server completes the facial recognition. The step of detecting a sub-image that matches the facial feature information of the person to be sought is not limited in this embodiment of the present disclosure.

Based on the same inventive concept, an embodiment of the present disclosure provides a person search device. As shown in FIG. 3, FIG. 3 is a block diagram of a person search device 300 according to an exemplary embodiment, where the device 300 can be applied. Terminal, the device 300 can include:

The receiving module 301 is configured to receive facial feature information of the person to be sought sent by the cloud server, where the terminal is in a search range corresponding to the person to be sought;

The detecting module 302 is configured to detect whether an image captured by the terminal includes a sub-image that matches the facial feature information;

The determining module 303 is configured to determine, when the image captured by the terminal includes the sub-image, the person corresponding to the sub-image as the person to be sought.

Optionally, the detecting module 302 includes at least one of the following submodules:

a first detecting submodule configured to detect whether the previewed image includes the sub image when the terminal performs an image capturing preview;

a second detecting submodule configured to detect, when the terminal captures an image, whether the captured image includes a sub image that matches the facial feature information;

The third detecting submodule is configured to detect, when the terminal captures a video, whether each frame image included in the captured video includes the sub image.

Optionally, the detecting module 302 includes:

Obtaining a sub-module configured to acquire all images captured by the terminal within a preset duration before the moment when the facial feature information is received;

A fourth detection sub-module configured to detect whether each of the images includes the sub-image.

Optionally, the apparatus 300 further includes at least one of the following modules:

a first sending module configured to determine a person corresponding to the sub image as the to-be-find And sending, by the cloud server, the location range of the terminal when the terminal captures the target image including the sub-image, to notify the publishing of the facial feature information of the person to be sought by the cloud server Information publisher

a second sending module, configured to: after the person corresponding to the sub-image is determined to be the person to be sought, send the contact information of the user of the terminal to the cloud server, to notify the cloud server by using the cloud server The information publisher contacts the user of the terminal;

a third sending module, configured to output prompt information according to the contact information of the information publisher sent by the cloud server after determining the person corresponding to the sub image as the to-be-find person, to prompt The user of the terminal notifies the information publisher.

Optionally, the receiving module 301 includes:

The receiving submodule is configured to receive the facial feature information of the to-be-find person sent by the cloud server, and the identity information of the to-be-searched person, so that the user of the terminal confirms the identity of the person, wherein The identity information includes at least one of a name, a gender, an age, an ID number, and a mobile phone number.

Optionally, the device 300 further includes:

The obtaining module is configured to obtain an open operation;

The opening module is configured to, according to the opening operation, enable an assisting tracing function to receive information sent by the cloud server for tracing.

Based on the same inventive concept, an embodiment of the present disclosure provides a person search device. As shown in FIG. 4, FIG. 4 is a block diagram of a person search device 400 according to an exemplary embodiment, where the device 400 can be applied. The cloud server, the device 400 can include:

The receiving module 401 is configured to receive facial feature information and a search range of the person to be sought provided by the information publisher;

The determining module 402 is configured to determine, in the search range, a plurality of terminals that assist the tracing function in an open state;

The sending module 403 is configured to separately send facial feature information of the to-be-find person to the plurality of terminals.

With regard to the apparatus in the above embodiments, the specific manner in which the respective modules perform the operations has been described in detail in the embodiment relating to the method, and will not be explained in detail herein.

In another exemplary embodiment, there is also provided a computer program product comprising a computer program executable by a programmable device, the computer program having when executed by the programmable device A portion of the code used to perform the character search method described above.

In another exemplary embodiment, there is also provided a non-transitory computer readable storage medium comprising instructions, the non-transitory computer readable storage medium comprising one or more programs, the one or more The program is used to execute the character search method described above.

In another exemplary embodiment, there is also provided a terminal comprising: a non-transitory computer readable storage medium; and one or more processors for executing in the non-transitory computer readable storage medium a program; the non-transitory computer readable storage medium storing instructions for executing the above-described character search method applied to the terminal.

In another exemplary embodiment, there is also provided a cloud server, comprising: a non-transitory computer readable storage medium; and one or more processors for executing in the non-transitory computer readable storage medium A program for executing the above-described character search method applied to the cloud server is stored in the non-transitory computer readable storage medium.

In the embodiments provided by the present disclosure, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be used. Combinations can be integrated into another system, or some features can be ignored or not executed.

The functional modules in various embodiments of the present application may be integrated into one processing unit, It may be that each module exists physically separately, or two or more modules may be integrated in one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application, in essence or the contribution to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium. A number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) or a processor to perform all or part of the steps of the methods described in various embodiments of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a ROM (Read-Only Memory), a RAM (Random Access Memory), a disk or an optical disk, and the like, which can store program codes. .

The above embodiments are only used to describe the technical solutions of the present disclosure in detail, but the description of the above embodiments is only for helping to understand the method of the present disclosure and its core ideas, and should not be construed as limiting the disclosure. Those skilled in the art will be able to devise changes or substitutions that are conceivable within the scope of the present disclosure.

Claims

A character searching method is applied to a terminal, which is characterized in that:

Receiving facial feature information of the person to be sought sent by the cloud server, where the terminal is in a search range corresponding to the person to be sought;

Detecting whether an image captured by the terminal includes a sub-image that matches the facial feature information;

When it is detected that the image captured by the terminal includes the sub-image, the person corresponding to the sub-image is determined as the person to be sought.
The person search method according to claim 1, wherein detecting whether the image captured by the terminal includes a sub-image matching the facial feature information comprises:

When the terminal performs an image capturing preview, detecting whether the previewed image includes the sub-image; or

Detecting whether the captured image includes the sub-image every time the terminal captures an image; or

Each time the terminal captures a video, it is detected whether each frame image included in the captured video contains the sub-image.
The person search method according to claim 1, wherein detecting whether the image captured by the terminal includes a sub-image matching the facial feature information comprises:

Acquiring all images captured by the terminal within a preset duration before the time when the facial feature information is received;

Detecting whether each of the images includes the sub-image.
The character searching method according to claim 1, wherein said subpicture is After the corresponding person is determined to be the person to be sought, the method further includes:

Sending, to the cloud server, a location range in which the terminal is located when the terminal captures a target image including the sub-image, to notify an information publisher that publishes facial feature information of the person to be sought through the cloud server ;and / or,

Sending contact information of the user of the terminal to the cloud server, to notify the information publisher of contacting the user of the terminal by the cloud server; and/or,

And displaying the prompt information according to the received contact information of the information publisher sent by the cloud server, to prompt the user of the terminal to notify the information publisher.
The character searching method according to any one of claims 1 to 4, wherein receiving the facial feature information of the person to be sought sent by the cloud server comprises:

Receiving facial feature information of the person to be sought sent by the cloud server, and identity information of the person to be sought, so that the user of the terminal confirms the identity of the person, wherein the identity information includes a name At least one of gender, age, ID number, and mobile number.
The character searching method according to any one of claims 1 to 4, further comprising: before receiving the facial feature information of the person to be sought sent by the cloud server, the method further comprising:

Get open operation;

According to the opening operation, the assisting tracing function is turned on to receive the information sent by the cloud server for searching for people.
A character search method is applied to a cloud server, and is characterized in that:

Receiving facial feature information and search range of the person to be sought provided by the information publisher;

Determining a plurality of terminals in the search range that assist the tracing function in an open state;

Sending facial feature information of the person to be sought to the plurality of terminals respectively.
A character searching device is applied to a terminal, and includes:

The receiving module is configured to receive facial feature information of the person to be sought sent by the cloud server, where the terminal is in a search range corresponding to the person to be sought;

a detecting module configured to detect whether an image captured by the terminal includes a sub-image that matches the facial feature information;

The determining module is configured to determine, when the image captured by the terminal includes the sub-image, the person corresponding to the sub-image as the person to be sought.
The person search device according to claim 8, wherein the detection module comprises at least one of the following sub-modules:

a first detecting submodule configured to detect whether the previewed image includes the sub image when the terminal performs an image capturing preview;

a second detecting submodule configured to detect, when the terminal captures an image, whether the captured image includes the sub image;

The third detecting submodule is configured to detect, when the terminal captures a video, whether each frame image included in the captured video includes the sub image.
The person search device according to claim 8, wherein the detecting module comprises:

Obtaining a sub-module configured to acquire all images captured by the terminal within a preset duration before the moment when the facial feature information is received;

A fourth detection sub-module configured to detect whether each of the images includes the sub-image.
The person search device according to claim 8, wherein the device further comprises at least one of the following modules:

a first sending module, configured to: after the person corresponding to the sub-image is determined as the person to be sought, send the terminal to the cloud server, when the terminal captures a target image including the sub-image, the terminal a location range at which the information publisher of the facial feature information of the person to be sought is posted by the cloud server;

a second sending module, configured to: after the person corresponding to the sub-image is determined to be the person to be sought, send the contact information of the user of the terminal to the cloud server, to notify the cloud server by using the cloud server The information publisher contacts the user of the terminal;

a third sending module, configured to output prompt information according to the contact information of the information publisher sent by the cloud server after determining the person corresponding to the sub image as the to-be-find person, to prompt The user of the terminal notifies the information publisher.
The person search device according to any one of claims 8-11, wherein the receiving module comprises:

The receiving submodule is configured to receive the facial feature information of the to-be-find person sent by the cloud server, and the identity information of the to-be-searched person, so that the user of the terminal confirms the identity of the person, wherein The identity information includes at least one of a name, a gender, an age, an ID number, and a mobile phone number.
The character search device according to any one of claims 8-11, wherein the device further comprises:

The obtaining module is configured to obtain an open operation;

The opening module is configured to, according to the opening operation, enable an assisting tracing function to receive information sent by the cloud server for tracing.
A character search device is applied to a cloud server, and includes:

The receiving module is configured to receive facial feature information and a search range of the person to be sought provided by the information publisher;

a determining module configured to determine a plurality of terminals in the search range that assist the tracing function in an open state;

And a sending module, configured to separately send facial feature information of the to-be-find person to the plurality of terminals.
A computer program product, comprising: a computer program executable by a programmable device, the computer program having when executed by the programmable device for performing claims 1 to 7 The code portion of the method of any of the preceding claims.
A non-transitory computer readable storage medium, characterized in that the non-transitory computer readable storage medium comprises one or more programs for performing any of claims 1 to 7. One of the methods described.
A terminal, comprising:

Non-transitory computer readable storage medium;

One or more processors for executing a program in the non-transitory computer readable storage medium; the non-transitory computer readable storage medium storing for performing the method of any of claims 1-6 Method of instruction.
A cloud server, comprising:

Non-transitory computer readable storage medium;

One or more processors for executing the non-transitory computer readable storage medium The program of the non-transitory computer readable storage medium storing instructions for performing the method of claim 7.