CN113473452A

CN113473452A - Internet of things-based terminal information and terminal image matching method and equipment

Info

Publication number: CN113473452A
Application number: CN202110767811.4A
Authority: CN
Inventors: 陈建江; 曹军峰
Original assignee: Shanghai Shuncom Smart Technology Co ltd
Current assignee: Shanghai Shuncom Smart Technology Co ltd
Priority date: 2021-07-07
Filing date: 2021-07-07
Publication date: 2021-10-01

Abstract

The embodiment of the invention discloses a method and equipment for matching terminal information and a terminal image based on the Internet of things. The method specifically comprises the following steps: under the condition that a mobile terminal is not connected with a wireless signal receiving module of the intelligent terminal, acquiring a target wireless signal sent to the surrounding environment by the mobile terminal in an unconnected state; determining unique identification information of the mobile terminal according to the target wireless signal; acquiring terminal image information of the mobile terminal; and establishing and storing a matching relation between the unique identification information and the terminal image information. According to the technical scheme of the embodiment of the invention, the terminal information and the terminal image can be quickly and accurately matched through the intelligent terminal under the condition that the handheld mobile terminal of the user is not connected with the intelligent terminal.

Description

Internet of things-based terminal information and terminal image matching method and equipment

Technical Field

The embodiment of the invention relates to the technical field of application of the Internet of things, in particular to a method and a device for matching terminal information and a terminal image, intelligent terminal equipment and a storage medium.

Background

The intelligent terminal refers to an intelligent device with a multimedia function, and the devices support audio, video, data and other functions. The intelligent terminal can be widely applied to numerous technical fields, such as the intelligent transportation field, the intelligent home field, the intelligent medical field, the intelligent monitoring field, the intelligent agriculture and the intelligent city, and the intelligent management and control requirements of different technical fields are met.

By taking intelligent terminals such as intelligent lamp poles and intelligent cameras as examples, the intelligent terminals are applied to the field of intelligent monitoring, and the purposes of intelligent identification, positioning, tracking, monitoring and management can be achieved. For example, when the mobile terminal passes through the intelligent lamp pole, the intelligent lamp pole can collect information of the mobile terminal and terminal images, and the collected information is matched with the terminal images. Specifically, the mobile terminal can log in the intelligent lamp pole and communicate with the intelligent lamp pole. At the moment, the intelligent lamp pole can acquire the identification information of the mobile terminal, and the information of the mobile terminal is acquired through the camera so as to be matched with the identification information of the mobile terminal according to the information of the mobile terminal, so that the intelligent identification, positioning, tracking, monitoring and management of the mobile terminal are realized.

The inventor finds that when the existing intelligent terminal realizes the intelligent management and control function, effective communication connection is often required to be established between the intelligent terminal and a management and control object, for example, the intelligent lamp pole can complete intelligent identification, positioning, tracking, monitoring and management functions of the mobile terminal only when the mobile terminal logs in the intelligent lamp pole.

Disclosure of Invention

The embodiment of the invention provides a method and a device for matching terminal information and a terminal image, intelligent terminal equipment and a storage medium, so that the terminal information and the terminal image can be quickly and accurately matched through an intelligent terminal under the condition that the mobile terminal is not connected with the intelligent terminal.

In a first aspect, an embodiment of the present invention provides a method for matching terminal information and a terminal image, which is applied to an intelligent terminal configured with a wireless signal receiving module, and includes:

under the condition that a mobile terminal is not connected with a wireless signal receiving module of the intelligent terminal, acquiring a target wireless signal sent to the surrounding environment by the mobile terminal in an unconnected state;

determining unique identification information of the mobile terminal according to the target wireless signal;

acquiring terminal image information of the mobile terminal;

and establishing and storing a matching relation between the unique identification information and the terminal image information.

In a second aspect, an embodiment of the present invention further provides a device for matching terminal information and a terminal image, configured in an intelligent terminal configured with a wireless signal receiving module, including:

the target wireless signal acquisition module is used for acquiring a target wireless signal sent to the surrounding environment by the mobile terminal in an unconnected state under the condition that the mobile terminal is not connected with the wireless signal receiving module of the intelligent terminal;

the unique identification information determining module is used for determining the unique identification information of the mobile terminal according to the target wireless signal;

the terminal image information acquisition module is used for acquiring terminal image information of the mobile terminal;

and the matching relation establishing module is used for establishing and storing the matching relation between the unique identification information and the terminal image information.

In a third aspect, an embodiment of the present invention further provides an intelligent terminal device, where the intelligent terminal device includes:

one or more processors;

storage means for storing one or more programs;

when the one or more programs are executed by the one or more processors, the one or more processors implement the method for matching between terminal information and a terminal image provided by any embodiment of the present invention.

In a fourth aspect, an embodiment of the present invention further provides a computer storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the method for matching between terminal information and a terminal image provided in any embodiment of the present invention.

According to the embodiment of the invention, under the condition that the mobile terminal is not connected with a wireless signal receiving module of the intelligent terminal, the intelligent terminal acquires the target wireless signal sent by the mobile terminal to the surrounding environment, determines the unique identification information of the mobile terminal according to the target wireless signal, and simultaneously acquires the terminal image information to establish and store the matching relation between the unique identification information of the mobile terminal and the terminal image information, so that the problem that the terminal information and the terminal image can be matched only under the condition that the existing intelligent terminal is in communication connection with the mobile terminal is solved, and the terminal information and the terminal image can be quickly and accurately matched through the intelligent terminal under the condition that the mobile terminal is not connected with the intelligent terminal.

Drawings

Fig. 1 is a flowchart of a method for matching terminal information and a terminal image according to an embodiment of the present invention;

fig. 2a is a flowchart of a method for matching terminal information and a terminal image according to a second embodiment of the present invention;

fig. 2b is a flowchart of another method for matching terminal information and a terminal image according to a second embodiment of the present invention;

fig. 2c is a flowchart of another method for matching terminal information and a terminal image according to the second embodiment of the present invention;

fig. 2d is a flowchart of another method for matching terminal information and a terminal image according to the second embodiment of the present invention;

fig. 3 is a schematic diagram of a matching device for terminal information and a terminal image according to a third embodiment of the present invention;

fig. 4 is a schematic structural diagram of an intelligent terminal device according to a fourth embodiment of the present invention.

Detailed Description

The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention.

It should be further noted that, for the convenience of description, only some but not all of the relevant aspects of the present invention are shown in the drawings. Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.

The terms "first" and "second," and the like in the description and claims of embodiments of the invention and in the drawings, are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "comprising" and "having," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not set forth for a listed step or element but may include steps or elements not listed.

Example one

Fig. 1 is a flowchart of a method for matching terminal information and a terminal image according to an embodiment of the present invention, where the embodiment is applicable to a situation where an intelligent terminal collects terminal image information and matches the terminal image information with a mobile terminal device on the premise that the intelligent terminal is not connected to the mobile terminal when the mobile terminal is located near the intelligent terminal, the method may be executed by a device for matching terminal information and a terminal image, the device may be implemented in a software and/or hardware manner, and may generally be directly integrated into an intelligent terminal device for executing the method, and the intelligent terminal device for executing the method in the embodiment may be any intelligent terminal configured with a wireless signal receiving module for executing a matching operation between terminal information and a terminal image. Specifically, referring to fig. 1, the method specifically includes the following steps:

and step 110, under the condition that the mobile terminal is not connected with the wireless signal receiving module of the intelligent terminal, acquiring a target wireless signal sent to the surrounding environment by the mobile terminal in an unconnected state.

The mobile terminal may be any terminal device having a wireless signal transmission function, may be a terminal device operating independently, or may be a terminal device requiring user operation, such as a handheld mobile terminal of a target user. For example, the mobile terminal may include, but is not limited to, a drone, a mobile phone, a tablet computer, and the like, and the specific type of the mobile terminal is not limited in the embodiments of the present invention. The target users may be people who pass through the intelligent terminal or people who stay beside the intelligent terminal, and the number of the target users may be at least one.

The Wireless signal receiving module may be configured to receive a Wireless signal sent by the handheld mobile terminal, for example, the Wireless signal receiving module may be an AP (Wireless Access Point) module, which is not limited in this embodiment of the present invention. The target Wireless signal may be any Wireless signal transmitted by the handheld mobile terminal, which may include terminal unique identification information, and may be, for example, a bluetooth signal, a data traffic signal, a WiFi (Wireless-local area network) signal, or the like. Furthermore, the target wireless signal may also be a signal directly including terminal unique identification information, such as a Probe Request (frame listen) frame signal in a WiFi signal, and the specific type of the target wireless signal is not limited in the embodiment of the present invention.

Specifically, before the mobile terminal is connected with the intelligent terminal, the mobile terminal can continuously send a target wireless signal to the surrounding environment to search for a wireless signal receiving module in the surrounding environment, so that the connection with the intelligent terminal is realized.

In the embodiment of the invention, in an application scenario that the mobile terminal is not connected with the wireless signal receiving module of the intelligent terminal, the wireless signal receiving module of the intelligent terminal can acquire a target wireless signal sent by the mobile terminal to the surrounding environment so as to acquire the identification information of the mobile terminal.

In a specific example, the wireless signal receiving module of the intelligent terminal may obtain a Probe Request frame signal sent by a WiFi module of the mobile terminal, so as to further obtain the identification information of the mobile terminal according to the Probe Request frame signal.

And step 120, determining the unique identification information of the mobile terminal according to the target wireless signal.

The unique identification information may be used to uniquely identify the Mobile terminal, and may be, for example, a MAC address, an IMEI number (International Mobile Equipment Identity), an IMSI number (International Mobile Equipment Identity), a serial number, or the like, which is not limited in this embodiment of the present invention.

In the embodiment of the invention, the intelligent terminal can determine the unique identification information of the mobile terminal after acquiring the target wireless signal sent by the mobile terminal to the surrounding environment, so as to realize the identification of the mobile terminal, and further execute the operation of matching the terminal information with the terminal image. It should be understood that the target wireless signal of the mobile terminal contains unique identification information for the mobile terminal.

In a specific example, the wireless signal receiving module of the intelligent terminal may determine the MAC address carried in the Probe Request frame signal after acquiring the Probe Request frame signal sent by the WiFi module of the mobile terminal, so as to acquire the unique identifier of the mobile terminal.

And step 130, acquiring terminal image information of the mobile terminal.

The terminal image information refers to image information shot by the intelligent terminal on the mobile terminal, and may be image information of a terminal device that operates independently, such as image information of the mobile terminal, or image information of an operation user of the terminal device, such as image information of a target user.

In the embodiment of the invention, the intelligent terminal can acquire the terminal image information of the mobile terminal so as to realize the identification of the mobile terminal, thereby executing the operation of matching the terminal information with the terminal image. It can be understood that the intelligent terminal may acquire the terminal image information through a camera device, for example, the camera device may include, but is not limited to, a monocular two-dimensional camera, a binocular two-dimensional camera, a three-dimensional depth camera, a laser camera, or the like, and the specific type of the camera device is not limited in the embodiment of the present invention.

And 140, establishing and storing a matching relation between the unique identification information and the terminal image information.

Specifically, the intelligent terminal may match the unique identification information of the mobile terminal with the terminal image information of the mobile terminal.

Correspondingly, the intelligent terminal can match the unique identification information of the mobile terminal with the terminal image information, so that the matching relation between the unique identification information and the terminal image information is obtained.

Example two

The embodiment is a further refinement of the above technical solutions, and provides a plurality of specific optional implementation manners for acquiring a target wireless signal sent by the handheld mobile terminal to the surrounding environment in an unconnected state, determining unique identification information matched with the handheld mobile terminal according to the target wireless signal, and matching the unique identification information with terminal image information. The solution in this embodiment may be combined with the individual alternatives in one or more of the embodiments described above.

Fig. 2a is a flowchart of a method for matching terminal information and a terminal image according to a second embodiment of the present invention, and as shown in fig. 2a, the method may include the following steps:

step 210a, when the mobile terminal is not connected to the wireless signal receiving module of the intelligent terminal and the number of the mobile terminals is a first number, acquiring a target single wireless signal sent to the surrounding environment by the mobile terminal in the unconnected state.

The first number may be a number for identifying the mobile terminal, for example, the number may be 1, that is, in the embodiment of the present invention, the number of the mobile terminals may be 1. The target single wireless signal may be a wireless signal transmitted by the single mobile terminal when the number of the mobile terminals is 1, for example, the target single wireless signal may be a single bluetooth signal, a single data traffic signal, or a single WiFi signal, and the specific type of the target single wireless signal is not limited in the embodiment of the present invention.

Specifically, when the number of the mobile terminals is 1, the single mobile terminal may continuously send the target single wireless signal to the surrounding environment to search for the wireless signal receiving module in the surrounding environment, so as to implement connection with the intelligent terminal. In the embodiment of the present invention, under the condition that the mobile terminal and the wireless signal receiving module of the intelligent terminal are not connected, if the number of the mobile terminals is 1, the wireless signal receiving module of the intelligent terminal may obtain the target single wireless signal sent by the single mobile terminal. Illustratively, the wireless signal receiving module of the intelligent terminal obtains a Probe Request frame signal sent by the WiFi module of the single mobile terminal to obtain the identification information of the single mobile terminal. Optionally, if the mobile terminal is a terminal device that needs to be operated by a user, such as a handheld mobile terminal of a target user, the number of the mobile terminals is 1, that is, the number of the handheld mobile terminals of the target user is 1, and it can be understood that the number of the target user is also 1.

And step 220a, determining the single unique identification information matched with the mobile terminal according to the target single wireless signal.

The single unique identification information may be information that can uniquely identify the single mobile terminal when the number of mobile terminals is 1. For example, the single unique identification information may be a MAC address, an IMEI number, an IMSI number, or a serial number of the single mobile terminal, which is not limited in this embodiment of the present invention.

In the embodiment of the present invention, in a case that the mobile terminal and the wireless signal receiving module of the intelligent terminal are not connected, if the number of the mobile terminals is 1, the intelligent terminal may obtain a single wireless signal of a target sent by the single mobile terminal to a surrounding environment, and determine single unique identification information of the single mobile terminal, so as to perform a matching operation between the terminal information of the single mobile terminal and a terminal image by using an identification of the single mobile terminal.

And step 230a, acquiring terminal image information of the mobile terminal.

In the embodiment of the invention, under the condition that the number of the mobile terminals is 1, the intelligent terminal can only acquire the terminal image information of 1 mobile terminal so as to realize the identification of the single mobile terminal, thereby executing the matching operation of the terminal information of the mobile terminal and the terminal image.

And step 240a, establishing and storing a one-to-one matching relationship between the single unique identification information and the terminal image information.

In the embodiment of the present invention, under the condition that the mobile terminal and the wireless signal receiving module of the intelligent terminal are not connected and the mobile terminal is a terminal operating independently, if the number of the mobile terminals is 1, the wireless signal receiving module of the intelligent terminal can obtain a target single wireless signal of a single mobile terminal when obtaining the target wireless signal of the mobile terminal, and then can obtain single unique identification information of the single mobile terminal. Meanwhile, the camera device of the intelligent terminal can acquire single terminal image information of a single mobile terminal when acquiring the terminal image information of the mobile terminal, and the single terminal image information can be the image information of the mobile terminal. Under the scene, the intelligent terminal can directly match the collected single unique identification information with the single terminal image information, so that the single terminal information and the single terminal image are matched one by one. It can be understood that when only one mobile terminal is provided, the intelligent terminal only collects one piece of terminal image information and one piece of identification information of the mobile terminal, and then the terminal information of the mobile terminal and the terminal image can be directly and quickly matched.

In an optional implementation manner of the embodiment of the present invention, in a case that the handheld mobile terminal of the target user is not connected to the wireless signal receiving module of the intelligent terminal, if the number of the target user and the number of the handheld mobile terminals are both 1, the wireless signal receiving module of the intelligent terminal may obtain a target single wireless signal of a single handheld mobile terminal when obtaining the target wireless signal of the handheld mobile terminal, and may further obtain single unique identification information of the single handheld mobile terminal. Meanwhile, the camera device of the intelligent terminal can acquire single terminal image information of a single target user when acquiring the image information of the target user, and the single terminal image information can be user image information, such as a face image or a whole body image of the target user. Under the scene, the intelligent terminal can directly match the collected single unique identification information with the single terminal image information, so that a single target user is matched with a single handheld mobile terminal one by one. It can be understood that when only one user and one handheld mobile terminal are provided, the intelligent terminal only collects one piece of terminal image information and one piece of identification information of the handheld mobile terminal, and then the target user and the handheld mobile terminal can be directly and quickly matched.

According to the technical scheme, in an application scene of a single mobile terminal, if the mobile terminal is not connected with the intelligent terminal, the intelligent terminal can acquire a target single wireless signal sent by the mobile terminal to the surrounding environment in an unconnected state through the wireless signal receiving module, determine single unique identification information matched with the mobile terminal according to the target single wireless signal, acquire terminal image information, establish and store a one-to-one matching relation between the single unique identification information of the mobile terminal and the terminal image information, and therefore the terminal information of the mobile terminal and the terminal image can be matched quickly and accurately.

Step 250a, under the condition that the number of the mobile terminals is determined to be the second number, acquiring the signal strength of a plurality of target wireless signals transmitted to the surrounding environment by the mobile terminals in an unconnected state.

The second number may be another number for identifying the user or the handheld mobile terminal, and may be, for example, any number greater than or equal to 2, that is, in this scenario, the number of the mobile terminals may be any number greater than 2 or greater than 2, and the specific number of the mobile terminals is not limited in the embodiment of the present invention.

In the embodiment of the invention, if the number of the mobile terminals is multiple, the signal strength of a plurality of target wireless signals transmitted to the surrounding environment by each mobile terminal in an unconnected state is acquired.

And step 260a, determining the unique identification information of the mobile terminal according to the target wireless signal.

And 270a, acquiring terminal image information of the mobile terminal.

And step 260a, determining the predicted distance between each mobile terminal and the intelligent terminal according to the terminal image information.

And 270a, matching the unique identification information with the terminal image information according to the signal intensity and the prediction distance, and establishing a one-to-one matching relationship according to a matching result.

According to the technical scheme, in an application scene with a plurality of mobile terminals, if the mobile terminals are not connected with the intelligent terminals, the intelligent terminals can acquire the signal intensity of a plurality of target wireless signals sent to the surrounding environment by each mobile terminal in an unconnected state through the wireless signal receiving module, so that the unique identification information of each mobile terminal is respectively determined according to the plurality of target wireless signals, after the image information of each terminal is collected, the prediction distance between each mobile terminal and each intelligent terminal is determined according to the image information of each terminal, the unique identification information and the image information of each terminal are matched according to the signal intensity and the prediction distance, and the matching relation is established according to the matching result, so that the terminal information of the mobile terminal and the terminal image are quickly and accurately matched.

For example, when a plurality of unmanned aerial vehicles appear near the intelligent lamp pole, the intelligent lamp pole can acquire the image of each unmanned aerial vehicle and the unique identification information of each unmanned aerial vehicle in sequence, and establish a one-to-one matching relationship between the image of each unmanned aerial vehicle and the unique identification information of the unmanned aerial vehicle respectively. Optionally, the intelligent lamp pole can be matched according to the signal intensity degree of the target wireless signal reflected by the unmanned aerial vehicle and the distance between the unmanned aerial vehicle and the intelligent lamp pole predicted by the images of the unmanned aerial vehicles.

It should be noted that, the order of steps 210a to 240a and steps 250a to 270a is not limited in the embodiments of the present invention, that is, steps 210a to 240a and steps 250a to 270a may be performed synchronously.

Fig. 2b is a flowchart of another method for matching terminal information and a terminal image according to a second embodiment of the present invention, and as shown in fig. 2b, the method may include the following steps:

step 210b, when the handheld mobile terminals of the target users are not connected with the wireless signal receiving module of the intelligent terminal, the number of the target users is a first number, and the number of the handheld mobile terminals is a second number, acquiring a plurality of target wireless signals sent to the surrounding environment by each handheld mobile terminal of the target users in the unconnected state.

Firstly, the technical scheme of the embodiment of the invention is mainly suitable for the application scene of the handheld mobile terminal of which the mobile terminal is a target user. In the application scenario, the number of target users may be 1, and the number of handheld mobile terminals may be 2 or any number greater than 2, and the number of handheld mobile terminals is not limited in the embodiment of the present invention.

It can be understood that, under the condition that the number of the target users is 1 and the number of the handheld mobile terminals is 2 or more than 2, that is, one target user may hold a plurality of handheld mobile terminals, each handheld mobile terminal may continuously send a target wireless signal to the surrounding environment, that is, the wireless signal receiving module of the intelligent terminal may obtain 2 or more than 2 of the plurality of target wireless signals.

In the embodiment of the present invention, under the condition that the handheld mobile terminal of the target user is not connected to the wireless signal receiving module of the intelligent terminal, if the number of the target users is 1 and the number of the handheld mobile terminals is 2 or more than 2, the wireless signal receiving module of the intelligent terminal may obtain a plurality of target wireless signals of 2 or more than 2. Illustratively, the wireless signal receiving module of the intelligent terminal acquires Probe Request frame signals sent by WiFi modules of a plurality of handheld mobile terminals, so as to acquire identification information of the plurality of handheld mobile terminals.

And step 220b, respectively determining the matched unique identification information of each handheld mobile terminal according to each target wireless signal sent by each handheld mobile terminal.

In the embodiment of the invention, after the wireless signal receiving module of the intelligent terminal acquires a plurality of target wireless signals, the unique identification information of the handheld mobile terminal corresponding to each target wireless signal can be respectively determined according to each target wireless signal.

And step 230b, acquiring terminal image information of the target user.

In the embodiment of the invention, under the condition that the number of the target users is 1, the intelligent terminal can only acquire the terminal image information of 1 target user so as to realize the identification of the single target user, thereby executing the operation of matching the handheld mobile terminal with the target users.

And 240b, establishing and storing a many-to-one matching relation between each unique identification information of the target user and the terminal image information.

In the embodiment of the invention, under the condition that the handheld mobile terminal of the target user is not connected with the wireless signal receiving module of the intelligent terminal, if the number of the target users is 1 and the number of the handheld mobile terminals is more than one, the intelligent terminal can acquire a plurality of target wireless signals of the handheld mobile terminals, and then can acquire a plurality of unique identification information matched with the handheld mobile terminals. Meanwhile, the camera device of the intelligent terminal can acquire single terminal image information of a single target user when acquiring the terminal image information of the target user. Under the scene, the intelligent terminal can directly match the collected unique identification information with the image information of the single terminal, so that one-to-many matching is carried out on a single target user and a plurality of handheld mobile terminals. It can be understood that when only one user and a plurality of handheld mobile terminals exist, the intelligent terminal only collects one piece of terminal image information and identification information of the plurality of handheld mobile terminals, and then the plurality of handheld mobile terminals can be directly and quickly matched with a single target user.

According to the technical scheme, in an application scene that a single target user holds a plurality of handheld mobile terminals, if the handheld mobile terminal of the target user is not connected with an intelligent terminal, the intelligent terminal can acquire a plurality of target wireless signals sent by each handheld mobile terminal of the target user to the surrounding environment in an unconnected state through a wireless signal receiving module, so that the unique identification information matched with each handheld mobile terminal is respectively determined according to each target wireless signal sent by each handheld mobile terminal, the terminal image information of the target user is collected, a many-to-one matching relation between each unique identification information of the target user and the terminal image information is established and stored, and therefore the target user and the handheld mobile terminals are quickly and accurately matched.

Fig. 2c is a flowchart of another method for matching terminal information and a terminal image according to a second embodiment of the present invention, and as shown in fig. 2c, the method may include the following steps:

and step 210c, under the condition that the handheld mobile terminal of the target user is not connected with the wireless signal receiving module of the intelligent terminal, acquiring a target wireless signal sent to the surrounding environment by the handheld mobile terminal in an unconnected state.

Firstly, the technical scheme of the embodiment of the invention is mainly suitable for the application scene of the handheld mobile terminal of which the mobile terminal is a target user.

Step 220c, acquiring the signal strength of a plurality of target wireless signals sent to the surrounding environment by each handheld mobile terminal of each target user in an unconnected state under the condition that the number of the target users is determined to be the second number and the number of the handheld mobile terminals is determined to be the second number.

In the embodiment of the present invention, under the condition that the handheld mobile terminal of the target user is not connected to the wireless signal receiving module of the intelligent terminal, if the number of the target users is 2 or more than 2, and the number of the handheld mobile terminals is also 2 or more than 2, the wireless signal receiving module of the intelligent terminal may obtain the signal strength of the target wireless signal sent by the handheld mobile terminal. For example, the wireless signal receiving module of the intelligent terminal may acquire the signal strength of the Probe Request frame signal sent by the WiFi module of the handheld mobile terminal to acquire the identification information of the handheld mobile terminal and the strength of each identification information.

And 230c, determining the unique identification information of the handheld mobile terminal according to the target wireless signal.

In the embodiment of the invention, if the handheld mobile terminals of the target users are not connected with the wireless signal receiving modules of the intelligent terminals, the number of the target users is 2 or more than 2, and the number of the handheld mobile terminals is also 2 or more than 2, the intelligent terminals can determine the unique identification information of each handheld mobile terminal after acquiring the target wireless signals sent by the handheld mobile terminals to the surrounding environment, so as to execute the operation of each handheld mobile terminal matched with each target user by utilizing the identification of each handheld mobile terminal.

And 240c, acquiring the terminal image information of the target user.

In the embodiment of the invention, if the number of the target users is 2 or more than 2, the intelligent terminal can collect the terminal image information of a plurality of target users to realize the identification of the plurality of target users, so that the operation of matching the plurality of handheld mobile terminals with the plurality of target users is executed.

And step 250c, determining the predicted distance between each target user and the intelligent terminal according to the terminal image information.

The predicted distance may be a distance between the target user and the intelligent terminal, which is determined according to the acquired terminal image information after the camera device of the intelligent terminal acquires the terminal image information.

In the embodiment of the invention, the intelligent terminal can determine the predicted distance between the target user and the intelligent terminal through the acquired terminal image information. For example, the distance between the target user and the intelligent terminal can be determined by adjusting the shooting parameters of the camera device and according to the obtained shooting parameters of the terminal image information by using the imaging principle of geometric optics; the two images can be shot through a binocular camera device, and a disparity map is obtained by using a stereo matching algorithm, so that the distance between a target user and the intelligent terminal is determined.

And step 260c, matching the unique identification information with the terminal image information according to the signal intensity and the prediction distance, and establishing the matching relationship according to the matching result.

In the embodiment of the invention, the intelligent terminal can match the unique identification information with the terminal image information according to the signal strength and the predicted distance of the target wireless signal sent by the handheld mobile terminal. It can be understood that the stronger the signal strength of the target wireless signal acquired by the intelligent terminal is, the closer the distance between the handheld mobile terminal and the intelligent terminal is, that is, the closer the distance between the target user matched with the handheld mobile terminal and the intelligent terminal is. Correspondingly, the weaker the signal strength of the target wireless signal acquired by the intelligent terminal is, the longer the distance between the handheld mobile terminal and the intelligent terminal is, that is, the longer the distance between the target user matched with the handheld mobile terminal and the intelligent terminal is.

Specifically, after the unique identification information is matched with the terminal image information, the matching relationship between the handheld mobile terminal corresponding to the unique identification information and the target user corresponding to the target image information can be obtained.

In the technical scheme, under the application scene that a plurality of target users and a plurality of handheld mobile terminals are provided, if the handheld mobile terminal of the target user is not connected with the intelligent terminal, the intelligent terminal can acquire the signal intensity of a plurality of target wireless signals transmitted to the surrounding environment by each handheld mobile terminal of each target user in an unconnected state through the wireless signal receiving module, respectively determining the unique identification information of each handheld mobile terminal according to a plurality of target wireless signals, and after acquiring the terminal image information of each target user, determining the predicted distance between each target user and each intelligent terminal according to the image information of each terminal so as to match the unique identification information with the image information of each terminal according to the signal intensity and the predicted distance, and a matching relationship is established according to the matching result, so that the target user and the handheld mobile terminal are quickly and accurately matched.

It should be noted that, the embodiment of the present invention does not limit the order of the step 210c and the step 220c, that is, the step 210c and the step 220c may be performed synchronously.

Fig. 2d is a flowchart of another method for matching terminal information and a terminal image according to a second embodiment of the present invention, and as shown in fig. 2d, the method may include the following steps:

step 210d, when the handheld mobile terminals of the target users are connected to the wireless signal receiving modules of the intelligent terminals, and the number of the target users is determined to be a second number, and the number of the handheld mobile terminals is determined to be the second number, determining the unique identification information of each handheld mobile terminal and the signal strength corresponding to each wireless connection according to the wireless connection between the wireless signal receiving modules and each handheld mobile terminal.

Firstly, the technical scheme of the embodiment of the invention is mainly suitable for the application scene of the handheld mobile terminal of which the mobile terminal is a target user. In the embodiment of the present invention, when the handheld mobile terminal of the target user is connected to the wireless signal receiving module of the intelligent terminal, if the number of the target users is 2 or more than 2, and the number of the handheld mobile terminals is also 2 or more than 2, the intelligent terminal may determine the unique identification information of the handheld mobile terminal and the signal strength corresponding to the wireless connection according to the wireless connection between the wireless signal receiving module and the handheld mobile terminal.

And step 220d, acquiring the terminal image information of the target user.

And step 230d, determining the predicted distance between each target user and the intelligent terminal according to the terminal image information of the target user.

And 240d, matching the unique identification information with the terminal image information according to the signal intensity and the prediction distance, and establishing the matching relationship according to a matching result.

In the embodiment of the invention, the intelligent terminal can match the unique identification information with the terminal image information according to the signal intensity and the prediction distance corresponding to the wireless connection, and establish the matching relationship according to the matching result.

In an optional implementation manner of the embodiment of the present invention, matching the unique identification information with the terminal image information according to the signal strength and the predicted distance may include: with the intelligent terminal as a reference, sequencing the signal intensity in a sequence from strong to weak to obtain a first sequencing result of the unique identification information; sorting the predicted distances in the sequence from near to far by taking the intelligent terminal as a reference to obtain a second sorting result of the terminal image information; and matching the first sequencing result and the second sequencing result to establish a matching relation between the unique identification information and the terminal image information.

The first sorting result may be a sorting result of the unique identification information of the handheld mobile terminal obtained by sorting according to the strength of the signal from strong to weak. For example, the signal strength of handheld mobile terminal a is-60 dbm, the signal strength of handheld mobile terminal B is-70 dbm, and the signal strength of handheld mobile terminal C is-80 dbm, then the first ranking result is shown in table 1.

TABLE 1 first order results List

Signal strength	First order result
		-60dbm	Unique identification information of handheld mobile terminal A
-70dbm	Unique identification information of handheld mobile terminal B
		-80dbm	Unique identification information of handheld mobile terminal C

The second sorting result may be a sorting result of the terminal image information obtained by sorting according to the predicted distance from near to far. For example, if the predicted distance between the target user X and the smart terminal is 3m, the predicted distance between the target user Y and the smart terminal is 5m, and the predicted distance between the target user Z and the smart terminal is 1m, the second sorting result is shown in table 2.

TABLE 2 second sort results List

Predicting distance	Second sorting result
		1m	Terminal image information of target user Z
3m	Terminal image information of target user X
		5m	Terminal image information of target user Y

In the embodiment of the present invention, when the intelligent terminal matches the first sorting result and the second sorting result, the first sorting result and the second sorting result may be sequentially matched according to a sequence. For example, the first unique identification information in the first sorting result is matched with the first terminal image information in the second sorting result, the second unique identification information in the first sorting result is matched with the second terminal image information in the second sorting result, and so on, and the matching relationship between the established unique identification information and the terminal image information is shown in table 3.

TABLE 3 matching relationship List

In the embodiment of the present invention, if one of the target users holds a plurality of handheld mobile terminals, when the intelligent terminal matches the first sorting result and the second sorting result, the intelligent terminal may also perform matching according to a threshold of the signal strength in the first sorting result. For example, the unique identification information of the handheld mobile terminal B having a signal strength of-70 dbm and the unique identification information of the handheld mobile terminal D having a signal strength of-73 dbm are both matched with the terminal image information of the target user X having a predicted distance of 3m, as shown in table 4.

Table 4 list of matching relationships

In this alternative embodiment, the signal strength may be the signal strength of a target wireless signal transmitted to the surrounding environment by the handheld mobile terminal in an unconnected state, or may be the signal strength corresponding to the wireless connection between the wireless signal receiving module and each handheld mobile terminal. The scheme for matching the unique identification information with the terminal image information according to the signal strength and the predicted distance may also be applicable to a scenario in which a plurality of mobile terminals are provided and the mobile terminals operate independently, and will not be described in detail.

In the technical scheme, under the application scene that a plurality of target users and a plurality of handheld mobile terminals are provided, if the handheld mobile terminal of the target user is wirelessly connected with the intelligent terminal, the intelligent terminal can determine the unique identification information of each handheld mobile terminal and the signal intensity corresponding to each wireless connection through the wireless connection between the wireless signal receiving module and each handheld mobile terminal, so as to determine the unique identification information of each handheld mobile terminal according to each target wireless signal, and after collecting the image information of each terminal of each target user, determining the predicted distance between each target user and each intelligent terminal according to the image information of each terminal so as to match the unique identification information with the image information of each terminal according to the signal intensity and the predicted distance, and a matching relationship is established according to the matching result, so that the target user and the handheld mobile terminal are quickly and accurately matched.

According to the technical scheme, the terminal information and the terminal image can be rapidly and accurately matched through the intelligent terminal in various application scenes.

EXAMPLE III

Fig. 3 is a schematic diagram of an apparatus for matching terminal information and a terminal image according to a third embodiment of the present invention, and as shown in fig. 3, the apparatus includes: a target wireless signal acquisition module 310, a target wireless signal acquisition module 320, a terminal image information acquisition module 330, and a matching relationship establishment module 340, wherein:

a target wireless signal obtaining module 310, configured to obtain a target wireless signal sent by a mobile terminal to a surrounding environment in an unconnected state when the mobile terminal is not connected to a wireless signal receiving module of the intelligent terminal;

a unique identification information determining module 320, configured to determine unique identification information of the mobile terminal according to the target wireless signal;

a terminal image information collecting module 330, configured to collect terminal image information of the mobile terminal;

a matching relationship establishing module 340, configured to establish and store a matching relationship between the unique identification information and the terminal image information.

Optionally, the target wireless signal acquiring module 310 may be further configured to: under the condition that the number of the mobile terminals is determined to be the first number, acquiring a target single wireless signal sent to the surrounding environment by the mobile terminals in an unconnected state;

the unique identification information determination module 320 may be further configured to: determining single unique identification information matched with the mobile terminal according to the target single wireless signal;

the matching relationship establishing module 340 may be further configured to: and establishing and storing a one-to-one matching relation between the single unique identification information and the terminal image information.

The target wireless signal acquiring module 310 may further be configured to: under the condition that the number of the mobile terminals is determined to be the second number, acquiring the signal intensity of a plurality of target wireless signals sent to the surrounding environment by the mobile terminals in an unconnected state;

the device further comprises: the prediction distance determining module is used for determining the prediction distance between each mobile terminal and the intelligent terminal according to the terminal image information;

the matching relationship establishing module 340 may be further configured to: and matching the unique identification information with the terminal image information according to the signal intensity and the prediction distance, and establishing a one-to-one matching relationship according to a matching result.

Optionally, the mobile terminal may be a handheld mobile terminal of a target user; the target wireless signal acquiring module 310 may further be configured to: under the condition that the number of the target users is determined to be a first number and the number of the handheld mobile terminals is determined to be a second number, acquiring a plurality of target wireless signals sent to the surrounding environment by each handheld mobile terminal of the target users in an unconnected state;

the unique identification information determination module 320 may be further configured to: respectively determining unique identification information matched with each handheld mobile terminal according to each target wireless signal sent by each handheld mobile terminal;

the matching relationship establishing module 340 may be further configured to: and establishing and storing a many-to-one matching relation between each unique identification information of the target user and the terminal image information.

Optionally, the mobile terminal is a handheld mobile terminal of a target user; the target wireless signal acquiring module 310 may further be configured to: under the condition that the number of the target users is determined to be a second number and the number of the handheld mobile terminals is determined to be the second number, the signal strength of a plurality of target wireless signals sent to the surrounding environment by each handheld mobile terminal of each target user in an unconnected state is obtained;

the predicted distance determination module may be further operable to: determining a prediction distance between each target user and the intelligent terminal according to the terminal image information;

the matching relationship establishing module 340 may be further configured to: and matching the unique identification information with the terminal image information according to the signal intensity and the prediction distance, and establishing the matching relation according to a matching result.

Optionally, the mobile terminal is a handheld mobile terminal of a target user; the target wireless signal acquiring module 310 may further be configured to: when the handheld mobile terminals of the target users are connected with the wireless signal receiving modules of the intelligent terminals, the number of the target users is determined to be a second number, and the number of the handheld mobile terminals is determined to be the second number, the unique identification information of each handheld mobile terminal and the signal intensity corresponding to each wireless connection are determined according to the wireless connection between the wireless signal receiving modules and each handheld mobile terminal;

the predicted distance determination module may be to: determining a prediction distance between each target user and the intelligent terminal according to the terminal image information;

Optionally, the matching relationship establishing module 340 may be further specifically configured to: with the intelligent terminal as a reference, sequencing the signal intensity in a sequence from strong to weak to obtain a first sequencing result of the unique identification information; sorting the predicted distances in a sequence from near to far by taking the intelligent terminal as a reference to obtain a second sorting result of the terminal image information; and matching the first sequencing result and the second sequencing result to establish a matching relation between the unique identification information and the terminal image information.

Optionally, the wireless signal receiving module may be a wireless access point AP module, the target wireless signal may be a frame monitoring Probe Request frame signal sent by a wireless local area network WiFi module, and the unique identification information may be a media access control MAC address of the mobile terminal.

The terminal information and terminal image matching device can execute the terminal information and terminal image matching method provided by any embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method. For details of the technology that are not described in detail in this embodiment, reference may be made to the terminal information and the terminal image matching method provided in any embodiment of the present invention.

Since the terminal information and terminal image matching apparatus described above is an apparatus capable of executing the terminal information and terminal image matching method in the embodiment of the present invention, based on the terminal information and terminal image matching method described in the embodiment of the present invention, those skilled in the art can understand the specific implementation of the terminal information and terminal image matching apparatus of the embodiment and various variations thereof, and therefore, how the terminal information and terminal image matching apparatus implements the terminal information and terminal image matching method in the embodiment of the present invention is not described in detail herein. The device used by those skilled in the art to implement the method for matching terminal information and terminal image in the embodiments of the present invention is within the scope of the present application.

Example four

Fig. 4 is a schematic structural diagram of an intelligent terminal device according to a fourth embodiment of the present invention. As shown in fig. 4, the intelligent terminal apparatus includes a processor 410, a memory 420, an input device 430, and an output device 440; the number of the processors 410 in the intelligent terminal device can be one or more, and one processor 410 is taken as an example in fig. 4; the processor 410, the memory 420, the input device 430 and the output device 440 in the intelligent terminal apparatus may be connected by a bus or other means, and the connection by the bus is exemplified in fig. 4.

The memory 420 serves as a computer-readable storage medium, and may be used to store software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the terminal information and terminal image matching method in the embodiment of the present invention (for example, the target wireless signal acquisition module 310, the unique identification information determination module 320, the terminal image information acquisition module 330, and the matching relationship establishment module 340 in the terminal information and terminal image matching apparatus). The processor 410 executes various functional applications and data processing of the intelligent terminal device by running the software programs, instructions and modules stored in the memory 420, that is, the terminal information and terminal image matching method according to any of the above embodiments is implemented: under the condition that a mobile terminal is not connected with a wireless signal receiving module of the intelligent terminal, acquiring a target wireless signal sent to the surrounding environment by the mobile terminal in an unconnected state; determining unique identification information of the mobile terminal according to the target wireless signal; acquiring terminal image information of the mobile terminal; and establishing and storing a matching relation between the unique identification information and the terminal image information.

The memory 420 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal, and the like. Further, the memory 420 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the memory 420 may further include memory located remotely from the processor 410, which may be connected to the intelligent terminal device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The input means 430 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the intelligent terminal device. The output device 440 may include a display device such as a display screen.

In addition to the above components, optionally, the intelligent terminal device may further include a wireless signal receiving module, configured to acquire a target wireless signal sent by the mobile terminal, so as to acquire unique identification information of the mobile terminal according to the target wireless signal, and then implement matching between terminal information of the mobile terminal and a terminal image. The wireless signal receiving module can also be used for acquiring the signal intensity of a target wireless signal sent by the mobile terminal, so that the matching of the terminal information of the mobile terminal and the terminal image is realized.

EXAMPLE five

An embodiment five of the present invention further provides a computer storage medium storing a computer program, which when executed by a computer processor is configured to execute the method for terminal information and terminal image according to any one of the above embodiments of the present invention: under the condition that a mobile terminal is not connected with a wireless signal receiving module of the intelligent terminal, acquiring a target wireless signal sent to the surrounding environment by the mobile terminal in an unconnected state; determining unique identification information of the mobile terminal according to the target wireless signal; acquiring terminal image information of the mobile terminal; and establishing and storing a matching relation between the unique identification information and the terminal image information.

Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a Read-Only Memory (ROM), an Erasable Programmable Read-Only Memory (EPROM) or flash Memory), an optical fiber, a portable compact disc Read-Only Memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, Radio Frequency (RF), etc., or any suitable combination of the foregoing.

Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A method for matching terminal information and a terminal image is applied to an intelligent terminal configured with a wireless signal receiving module, and comprises the following steps:

acquiring terminal image information of the mobile terminal;

2. The method of claim 1, wherein the obtaining the target wireless signal transmitted by the mobile terminal to the surrounding environment in the unconnected state comprises:

under the condition that the number of the mobile terminals is determined to be the first number, acquiring a target single wireless signal sent to the surrounding environment by the mobile terminals in an unconnected state;

determining the unique identification information of the mobile terminal according to the target wireless signal, including:

determining single unique identification information matched with the mobile terminal according to the target single wireless signal;

the establishing and storing of the matching relationship between the unique identification information and the terminal image information includes:

establishing and storing a one-to-one matching relation between the single unique identification information and the terminal image information;

under the condition that the number of the mobile terminals is determined to be the second number, acquiring the signal intensity of a plurality of target wireless signals sent to the surrounding environment by the mobile terminals in an unconnected state;

after the acquiring the terminal image information of the mobile terminal, the method further comprises the following steps:

determining a prediction distance between each mobile terminal and the intelligent terminal according to the terminal image information;

and matching the unique identification information with the terminal image information according to the signal intensity and the prediction distance, and establishing a one-to-one matching relationship according to a matching result.

3. The method of claim 1, wherein the mobile terminal is a handheld mobile terminal of a target user;

the acquiring of the target wireless signal sent by the mobile terminal to the surrounding environment in the unconnected state includes:

under the condition that the number of the target users is determined to be a first number and the number of the handheld mobile terminals is determined to be a second number, acquiring a plurality of target wireless signals sent to the surrounding environment by each handheld mobile terminal of the target users in an unconnected state;

respectively determining unique identification information matched with each handheld mobile terminal according to each target wireless signal sent by each handheld mobile terminal;

and establishing and storing a many-to-one matching relation between each unique identification information of the target user and the terminal image information.

4. The method of claim 1, wherein the mobile terminal is a handheld mobile terminal of a target user;

simultaneously with or after the acquiring of the target wireless signal sent by the mobile terminal to the surrounding environment in the unconnected state, the method further includes:

under the condition that the number of the target users is determined to be a second number and the number of the handheld mobile terminals is determined to be the second number, the signal strength of a plurality of target wireless signals sent to the surrounding environment by each handheld mobile terminal of each target user in an unconnected state is obtained;

determining a prediction distance between each target user and the intelligent terminal according to the terminal image information;

and matching the unique identification information with the terminal image information according to the signal intensity and the prediction distance, and establishing the matching relation according to a matching result.

5. The method of claim 1, wherein the mobile terminal is a handheld mobile terminal of a target user;

the method further comprises the following steps:

when the handheld mobile terminals of the target users are connected with the wireless signal receiving modules of the intelligent terminals, the number of the target users is determined to be a second number, and the number of the handheld mobile terminals is determined to be the second number, the unique identification information of each handheld mobile terminal and the signal intensity corresponding to each wireless connection are determined according to the wireless connection between the wireless signal receiving modules and each handheld mobile terminal;

6. The method according to any one of claims 2, 4 or 5, wherein the matching the unique identification information with the terminal image information according to the signal strength and the predicted distance comprises:

with the intelligent terminal as a reference, sequencing the signal intensity in a sequence from strong to weak to obtain a first sequencing result of the unique identification information;

sorting the predicted distances in a sequence from near to far by taking the intelligent terminal as a reference to obtain a second sorting result of the terminal image information;

and matching the first sequencing result and the second sequencing result to establish a matching relation between the unique identification information and the terminal image information.

7. The method according to claim 1, wherein the wireless signal receiving module is a wireless Access Point (AP) module, the target wireless signal is a frame monitoring Probe Request frame signal sent by a wireless local area network (WiFi) module, and the unique identification information is a Media Access Control (MAC) address of the mobile terminal.

8. A device for matching terminal information with a terminal image is configured in an intelligent terminal configured with a wireless signal receiving module, and comprises:

9. An intelligent terminal device, characterized in that the device comprises:

one or more processors;

storage means for storing one or more programs;

when executed by the one or more processors, cause the one or more processors to implement the method of matching terminal information and terminal image as claimed in any one of claims 1 to 7.

10. A computer storage medium on which a computer program is stored, characterized in that the program, when executed by a processor, implements the method of matching terminal information and terminal image according to any one of claims 1 to 7.