WO2018235975A1

WO2018235975A1 - Terminal device and remote control method therefor

Info

Publication number: WO2018235975A1
Application number: PCT/KR2017/006615
Authority: WO
Inventors: 조민환
Original assignee: 조민환
Priority date: 2017-06-22
Filing date: 2017-06-22
Publication date: 2018-12-27

Abstract

The present invention relates to a terminal device and a control method therefor and, more specifically, is characterized in that a function, such as screen lock, personal information deletion, initialization, or collection support, of a lost terminal device or the like can be simply controlled by using a terminal device such as a smartphone owned by a third party to transmit a character string and an image when a terminal device such as a smartphone is needed to be remotely controlled due to loss and the like.

Description

Terminal device and its remote control method

The present invention relates to a terminal device for preventing the leakage of personal information and preventing the recovery of a lost terminal device by remotely controlling a lost terminal device such as a smart phone using a terminal device such as another smart phone And a remote control method thereof.

A terminal device called a smart phone is an integrated device of data communication function such as internet connection to a mobile phone function. Unlike a conventional mobile phone which was released as a finished product and used only predetermined functions, a terminal device It is a terminal device that has spread widely throughout the world because it can be installed, added or deleted as desired by users, which is a great advantage over existing mobile phones. These smartphones have greatly changed the paradigm of our everyday life by allowing us to work in the personal computer in the palm of my hand.

However, with the rapid spread of such smartphones, the number of lost users due to criminal acts such as user mistakes, carelessness, and theft has also increased rapidly. In particular, unlike general personal items, smart phone stores personal information such as phone book, official certificate, password, etc., so that if it is lost, it can cause financial damages as well as secondary damage caused by leakage of personal information. There is a problem.

Disclosure of Invention Technical Problem [8] Accordingly, the present invention has been made keeping in mind the above problems occurring in the prior art, and an object of the present invention is to provide a terminal device and a remote control method thereof that can remotely control a smartphone or the like that has been lost or the like.

Also, a terminal device and a remote control method thereof that can prevent personal information or privacy information from being exposed to the outside through such remote control are provided.

The present invention also provides a terminal device and a remote control method thereof that can block an unauthorized access of a third party while performing authentication of a person simply through transmission of a character string, face, or ear photo.

In order to achieve the above object, the present invention provides a method for a terminal device, comprising: receiving a string and an image from a second terminal device; Confirming whether the first terminal device has a portion of the received character string matching the first authentication string from the second terminal device; Confirming whether the image received from the second terminal device by the first terminal device matches the authentication image of the user; When the character string received from the second terminal device coincides with the identity verification string and the image received from the second terminal device matches the authentication image of the user, Confirming whether or not there is a portion of the received string that coincides with a predetermined command; And a step in which the first terminal device performs a function for the predetermined command if there is a portion of the character string received from the second terminal device that matches the predetermined command word, The remote control method of the present invention.

The present invention also provides a method for a terminal device, comprising: receiving a character string and an image from a second terminal device; Confirming whether the first terminal device manipulates the image received from the second terminal device; When it is confirmed that the image received from the second terminal device is not operated, whether the first terminal device matches a portion of the character string received from the second terminal device matching the principal authentication string step; Confirming whether the image received from the second terminal device by the first terminal device matches the authentication image of the user when it is confirmed that the image received from the second terminal device is not operated; When the character string received from the second terminal device coincides with the identity verification string and the image received from the second terminal device matches the authentication image of the user, Confirming whether or not there is a portion of the received string that coincides with a predetermined command; And a step in which the first terminal device performs a function for the predetermined command if there is a portion of the character string received from the second terminal device that matches the predetermined command word, The remote control method of the present invention.

The step of confirming whether or not the image of the image received by the first terminal device from the second terminal device is operated may include storing the time at which the first terminal device received the character string from the second terminal device as a first time ; Storing the time when the first terminal device received the image from the second terminal device as a second time; And when the time difference between the first time and the second time is equal to or greater than a predetermined time difference, the first terminal device determines that the image received from the second terminal device has been operated A remote control method of a terminal apparatus is provided.

In addition, the step of confirming whether or not the image of the image received from the second terminal device by the first terminal device is manipulated may include the step of capturing the image taken at the image capturing time, Acquiring the time of day; Confirming whether or not the first terminal device coincides with the shooting time, the generation time, and the modified time; Wherein the first terminal device determines that the image received from the second terminal device is operated when the shooting time, the generation time, and the modified time do not match with each other A remote control method of the terminal device is provided.

The step of confirming whether or not the image of the image received from the second terminal device by the first terminal device is operated may include the steps of: confirming the location information of the image received from the second terminal device by the first terminal device; And the first terminal device determines that the image received from the second terminal device has been operated when location information is not confirmed in the image received from the second terminal device A remote control method of the terminal device is provided.

The method may further include the step of the first terminal acquiring the identification information of the second terminal device before the first terminal device receives the character string and the image from the second terminal device. And provides a remote control method of the apparatus.

The step of the first terminal device performing the function for the pre-set command may include: if the first terminal device performs a function for the pre-set command, if the first character string received from the second terminal device matches a portion of the pre- And executes only when the second terminal device confirms the identification information of the second terminal device and the terminal device is authorized to perform the predetermined command.

If there is a portion of the character string received from the second terminal device that coincides with the predetermined command word, after the first terminal device executes the function for the predetermined command word, the first terminal device And transmitting an execution result of the function for the predetermined command to the second terminal device.

The step of confirming whether or not the image received from the first terminal device by the first terminal device matches the authentication image of the first terminal device may further include checking whether the image received from the second terminal device Performing image correction including the image correction; Extracting a feature point of the image received by the first terminal device from the second terminal device and calculating a correlation between the feature points; Confirming whether a correlation between minutiae points of the image received by the first terminal device from the second terminal device is matched with a correlation between minutiae points of the authentication image of the principal; When the correlation between the minutiae points of the image received from the second terminal device is matched with the correlation between the minutiae points of the first authentication image, The remote control method comprising the steps of: receiving a remote control signal from the terminal device;

And confirming whether the image received from the second terminal device by the first terminal device matches the authentication image of the user when it is confirmed that the image received from the second terminal device is not operated Performing image correction including the illumination adjustment of the image received by the first terminal device from the second terminal device; Extracting a feature point of the image received by the first terminal device from the second terminal device and calculating a correlation between the feature points; Confirming whether a correlation between minutiae points of the image received from the second terminal device by the first terminal device matches a correlation between minutiae points of the authenticated image of the principal; When the correlation between the minutiae points of the image received from the second terminal device is matched with the correlation between the minutiae points of the first authentication image, The remote control method comprising the steps of: receiving a remote control signal from the terminal device;

Further, the present invention provides a remote control method of a terminal device, wherein the authentication image is a face photograph of the owner of the first terminal device or a photograph of the user's ear.

The authentication string may include at least one of a unique character and a number that can be known only to the owner, such as the name of the owner of the first terminal device, a date of birth, a day to memorize, a password, a memory location, a resident registration number, The remote control method of a terminal device according to claim 1,

The predetermined command may be a command for performing a screen locking of the first terminal device, a personal information deletion execution, an application deletion execution, a device initialization execution, a character notification function execution, a voice notification function execution, a phone book e- a backup function, a camera photographing function, a light-emitting sound sending function, and a position information transmission function.

Further, the present invention provides a remote control method for a terminal device, wherein the identification information is a telephone number.

Further, the present invention provides a remote control method for a terminal device, wherein the first terminal device is a smartphone.

Also, the present invention provides a remote control method for a terminal device, wherein the second terminal device is a smart phone.

Also, the step of confirming whether or not the image of the image received from the second terminal device is manipulated by the first terminal device is confirmed by using an exchanged image file format (exif) of the received image And a remote control method of the terminal device.

In addition, the present invention provides a method of authenticating a user, comprising: a personal authentication string storing module for storing a personal authentication string; An authentication image storage module for storing the authentication image; A command storage module for storing a predetermined command; A receiving module that receives information including at least one of a character string, an image, identification information, a principal authentication string, and a principal authentication image; An authentication string verifying module for verifying whether or not there is a portion of the character string received by the receiving module that matches the user authentication string stored in the user authentication string storage module; An authentication image verification module for verifying whether the image received by the reception module matches the authentication image stored in the authentication image storage module; A command check module for checking whether or not a part of the string received by the receiving module matches a predetermined command stored in the command storage module when it is determined that the authentication string verifying module matches the authentication verification image verification module; And a command execution module that calls and executes a predetermined command from the command storage module when it is determined that the command check module matches.

Further, the present invention further provides an image manipulation confirmation module for confirming whether or not an image received by the reception module has been manipulated.

The terminal device may further include a transmission module for transmitting the result of execution of the command by the command execution module to the outside.

The apparatus may further include an identification information acquisition module that stores identification information received by the reception module, and a permission setting storage module that stores predetermined command execution permission information according to the identification information acquired by the identification information acquisition module, And a terminal device.

In addition, the present invention provides a method comprising: confirming that a collection confirmation button is selected by a first terminal device; When the first confirmation button of the first terminal device is selected, the first terminal device confirms the identification information of the second terminal device that has executed the predetermined command, and the second terminal device can perform the predetermined command And removing the authority of the terminal device from the terminal device.

According to another aspect of the present invention, Receiving the authentication image of the first terminal device; And extracting and storing the minutiae points in the binarized confirmation image by the first terminal device.

In addition, the step of extracting and storing the feature points in the binarization confirmation image by the first terminal device may include the steps of: the first terminal device performing image correction including illumination adjustment of the authentication image; And the first terminal extracts minutiae points of the authentication image of the user and calculates and stores a correlation between the minutiae points, thereby providing a remote control method of the terminal device.

According to another aspect of the present invention, there is provided a method of transmitting a character string, the method comprising: transmitting a string and an image to a first terminal device; And receiving the execution result of the function for the predetermined command from the first terminal device by the second terminal device.

The terminal device of the present invention and its remote control method have the following effects.

First, the terminal device of the lost smartphone is remotely controlled by using the terminal device of the smartphone of another person, thereby preventing leakage of personal information or privacy information.

Second, convenience is maximized in that a lost smartphone can be remotely controlled by simply transmitting a string and an image without installing a separate program or application on a phone owned by another person. In addition, since a separate program is not installed, it is possible to minimize a sense of rejection of a person who lends a terminal device such as a smart phone.

Third, it is possible to prevent abnormal control of a lost smartphone by a third party who does not have an authority, by performing authentication of the identity using the authentication string of the user and the authentication image of the user. Particularly, since the face image or the ear image is used as the authentication image of the user, the authentication process of the user can be further enhanced.

Fourth, since the information that is always stored by the owner of the terminal device such as a lost smartphone or the like is set as the authentication string of the user, there is an effect that there is no need to perform an excessive effort to memorize the password for the remote control. For example, since the name, the telephone number, the date of birth, and a unique character or number that can be known only to the user are set as the authentication string of the user, the remote control process can be easily performed without excessive effort for remembering the password have.

Fifth, it is possible to remotely control the terminal device easily and safely by confirming whether or not the received image is manipulated by comparing the time recorded in the meta data, the position information or the string reception time with the time recorded in the image.

Sixth, there is an effect that the terminal device can be remotely controlled without a procedure such as pre-registration, because the terminal device requiring remote control is controlled for a reason such as loss or the like directly from a third party terminal device without a separate application or server. Therefore, it is highly utilized in an emergency situation and the system is also designed to be simple.

Seventh, the identification information of the terminal device transmitting the character string and the image can be grasped, and the function that can be performed for each terminal device can be differentiated, so that it is possible to effectively prevent remote control from being attempted unauthorized after the retrieval.

Eighth, the remotely controlled result is transmitted to the terminal device that has transmitted the character string and the image again or the terminal device already set in the first terminal device by using e-mail or text, so that whether the remote control is normally performed can be confirmed in real time Can be confirmed.

Ninthly, it is possible to provide a simple and more reliable authentication process by checking whether the received image is manipulated by using various methods such as a metadata check.

The remote control of the terminal device is allowed only after the confirmation process of the authentication string of the user and the verification of the authentication image of the user is performed before the operation of checking the image is performed for the tenth time, But it can provide complete security functions.

1 is a view showing a terminal device called a smart phone.

2 is a diagram showing an example of a situation where a terminal device such as a smart phone is lost.

FIG. 3 is a view schematically showing a conventional technology for synchronizing and storing personal information such as a phone number or a photograph stored in a smart phone or the like.

4 is a schematic view illustrating a process of controlling a user terminal device using a terminal device of a third party in a terminal device and a remote control method thereof according to the present invention.

5 is a view showing a photograph of a face of a person himself / herself in order to perform authentication for remotely controlling a lost terminal or the like in the terminal device and the remote control method of the present invention.

FIG. 6 is a diagram showing a screen for remotely controlling a terminal device using a terminal device of a third party.

FIG. 7 is a diagram illustrating a process of confirming whether or not the user is using a face photograph in a terminal device and a remote control method thereof according to the present invention.

8 is a diagram illustrating a process of extracting a feature point from a face photograph and checking whether the user is a person in the terminal device and the remote control method thereof according to the present invention.

FIG. 9 is a diagram showing a process of authenticating the user using his / her photograph as the authentication image of the user.

FIG. 10 is a view showing a process of extracting minutiae from the photograph of the user and authenticating the user as the authenticated image of the user.

FIG. 11 is a flowchart showing a remote control method of a terminal device according to the present invention in a flowchart.

FIG. 12 is a diagram illustrating a first example of confirming whether or not an image received is manipulated in a terminal device and a remote control method thereof according to the present invention.

FIG. 13 is a diagram illustrating a second example of confirming whether or not the received image is manipulated in the terminal device and the remote control method thereof according to the present invention.

FIG. 14 is a view showing a time tag table of metadata used for confirming whether or not the received image is manipulated by the terminal device and its remote control method according to the present invention.

FIG. 15 is a diagram illustrating a third example of confirming whether or not the received image is operated in the terminal device and the remote control method thereof according to the present invention.

FIG. 16 is a diagram showing metadata including location information used by a terminal apparatus and a remote control method of the present invention to confirm whether or not the received image is manipulated.

FIG. 17 is a flowchart showing a process of checking whether or not an image received in the terminal device and its control method according to the present invention matches the authentication image of the user.

FIG. 18 is a flowchart illustrating a process of controlling a remote control right of a terminal device that transmits a character string and an image when a lost terminal device is retrieved in the terminal device and the remote control method thereof according to the present invention.

FIG. 19 is a flowchart illustrating a process of a user inputting a user authentication string and a user authentication image in a terminal device of the present invention and a remote control method thereof.

20 is a flowchart illustrating a process of receiving an execution result of a terminal device or a terminal device that has transmitted a character string and an image to a terminal device that has been lost in the terminal device or the remote control method of the present invention, Fig.

FIG. 21 is a block diagram showing an internal configuration of a terminal device according to the present invention.

FIG. 22 is a diagram showing an example of functions performed in accordance with a predetermined command when the authentication string of the user and the authentication image of the user are matched in the terminal device of the present invention and the first terminal device of the remote control method thereof.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and are herein described in detail. It should be understood, however, that the invention is not intended to be limited to the particular forms disclosed, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

1 is a view showing a terminal device called a smart phone.

The smartphone 10 is an intelligent terminal that adds a computer support function such as internet communication and information search to a mobile phone, and can install and use an application desired by the user. The number of users of the smartphone 10 has increased exponentially due to its high scalability and the work using the smartphone 10 is also limited to the initial text, fax, e-mail, Such as stock trading, money transfer, and bank account establishment, and the amount of personal information stored in the smartphone 10 is gradually increasing.

FIG. 2 is a view showing an example of a situation in which a terminal device such as a smart phone is lost.

When the smartphone 10 is used, there is a case where the smartphone 10 is lost in various situations and environments. FIG. 2 shows an example of such a lost situation. When the smart phone 10 is removed from a taxi, (10) flows out and is lost. In addition to this situation, smartphones (10) are being lost in various situations such as places to shop and restrooms. In the US, about 9 million smartphones (10) are lost during the year, and the loss is only 30 billion dollars It is reported to reach. This is also the case in Korea, and it is reported that about 2.5 million smartphones (10) are lost annually. Furthermore, in addition to the loss due to the carelessness of such individuals, the number of thefts is increasing every year in order to sell smart phones 10 to overseas.

A person who lost a smartphone (10) experiences more anxiety than a lost expensive item, and experiences various worries about leakage of a large amount of personal information stored in the smartphone (10) in addition to the loss of a phone book . Also, data such as financial information stored in the smartphone 10 is likely to be abused for another crime. According to a survey conducted by the British Physiological Society, it is also found that when the smartphone 10 is lost, the intensity of the stress is similar to the threat of terrorism.

However, when the smartphone 10 is lost, the conventional technologies for protecting the telephone number and the personal information stored therein are only at an initial level, and the authentication portion of the user is very weak in the process of remote control, hacking), and the like.

As described above, unlike the loss of general property, the loss of the smartphone 10 causes a lot of stress to the lost person due to various information stored therein.

In order to overcome such a problem, a synchronization technology for synchronously storing personal information such as a phone number or a photograph stored in a smart phone, a computer, or a tablet PC owned by an individual has been used.

However, in the conventional synchronization technique, when one of the devices is lost, it is possible to acquire and reuse information by using other devices that are synchronized. However, when a third party uses personal information such as personal information in a lost device, To prevent illegal use of the system.

Due to such a problem, it is possible to perform remote locking of a screen of a terminal device such as a smart phone beyond a synchronization technology, an application supporting a remote initialization function, or a function of initializing a terminal installed in an operating system or firmware of a smart phone However, in the case of the kill switch, there has been a problem that the manufacturer or the communication company of the smart phone has to register for using the kill switch in advance, and in case of the application, in addition to the terminal device of the lost user There has been a problem that a corresponding application must be installed in a terminal device of a third party who wishes to perform a remote control function. In addition, in the conventional technologies, there is a server, which acts as a mediator between a terminal device performing a remote control and a terminal device to be remotely controlled, There was also a problem. In addition, in order to perform the kill switch function, it is necessary to access a web page of a manufacturer or a communication company of the smartphone, or to install and register the application in a third party smartphone, , The process takes a considerable time, and valuable personal information is exposed before the remote function is activated.

First, in the description of the present invention, the term terminal refers to a broad concept including a device such as a smart phone, a tablet PC, and the like. The terminal includes a telephone number, It should be noted that any device can be included in the concept of the terminal device of the present invention regardless of the term. In order to facilitate the distinction, a terminal device such as a smart phone to be remote controlled as a terminal device of the owner lost in the description of the present invention is referred to as a first terminal device 100, A terminal device such as a smart phone that plays a role of remotely controlling the first terminal device 100 by transmitting the principal authentication string and the principal authentication image in order to lock the screen of the terminal 100, 2 terminal apparatus 200 as shown in FIG. Normally, the second terminal device 200 does not need to store the identification information in advance in the first terminal device 100, but in order to execute some functions such as deletion, As shown in FIG.

If the first terminal device 100 needs to be lost or controlled remotely, the owner of the first terminal device 100 to which the present invention is applied can borrow the second terminal device 200 from a third party . Here, the second terminal device 200 may be a smart phone, but it is not limited thereto, and it is not limited to a type of a feature phone, a tablet PC, or the like, provided that it is a device capable of transferring a character or a photograph.

Next, the owner of the first terminal device 100 can transmit a character string and an image to the first terminal device 100 using the second terminal device 200 owned by a third party, When the first terminal device 100 analyzes the received character string and image and confirms that the character string is an image sent from the owner of the first terminal device 100, the first terminal device 100 can perform a function according to a predetermined command included in the character string . For example, when the predetermined command included in the transmitted string is a location information transmission command of the first terminal device 100, a Global Positioning System (GPS) module of the first terminal device 100 is used To acquire the location information of the location where the first terminal device 100 is located and to transmit the information to the second terminal device 200 again.

The terminal device and the remote control method thereof according to the present invention perform authentication of the first terminal device 100 by simply transmitting a character string and an image without installing any program or application in the second terminal device 200 owned by another person, It is possible to achieve the effect of maximizing the convenience in terms of controllability.

The process of authenticating the user using the character string and the image transmitted by the second terminal device 200 and controlling the first terminal device 100 remotely will be described in more detail with reference to the drawings.

In the terminal device of the present invention and the remote control method thereof, when the user is set to use his / her face image as the authenticated image, the owner of the first terminal device 100 uses the second terminal device 200 owned by the third person You can take pictures of your face. In this case, the face photograph may be a photograph showing both ears like passport photographs.

The terminal device and the remote control method of the present invention have the effect of blocking the unauthorized access of the third party even more while allowing the remote access to the terminal device by utilizing the face photograph as the authentication image of the user.

When the owner of the first terminal device 100 needs to remotely control the first terminal device 100 he / she has used for reasons such as loss or the like, the second terminal device 200 owned by the third person is used So that an image such as a face photograph of the user can be transmitted along with a character string as shown in the drawing.

The transmitted string may include a predetermined command for performing a function of the first terminal device 100, together with a character string matching the authentication string set in the first terminal device 100. For example, " John Smith ", " 010-9999-0000 " may be a part of a string for authentication, and " lock " may be a part of a command for performing functions of the first terminal device 100. Also, in the drawings, an image is shown as being transmitted after a character string is transmitted, but is not limited thereto, and may be transmitted before transmission of a character string.

The first terminal device 100 receiving the character string and the image from the second terminal device 200 performs the user authentication process using the received character string and the image, performs the requested function when it is determined that the user is the user, The result can be transmitted to the second terminal device 200 as " the lock function is set " as shown in the figure.

As described above, according to the terminal device and the remote control method of the present invention, it is possible to easily and remotely control the terminal device by simply transferring characters and images, and to perform authentication of the terminal device by duplicating the identity of the terminal device It is possible to prevent the lost smartphone from being abnormally controlled by the third party who does not have the third party.

7 and 8 are views showing a process of confirming whether or not the user is a person using a face photograph in a terminal device and a remote control method thereof according to the present invention.

A terminal device and a remote control method thereof according to the present invention can use a face photograph as an authenticated image of the user. Such a face photograph may be a photograph of a face photographed by exposing the ears for recognition accuracy.

The method of recognizing received face photographs can be applied by using various techniques. However, the terminal device and its remote control method of the present invention typically separates only the face region from the received image, , Jaw lines, and the like, and then the correlation between the extracted feature points is calculated and stored as numerical data, thereby recognizing the face. That is, the first terminal device 100 can acquire data on the minutiae from the received facial photograph, and compare the data with the data of the authentication image stored in the first terminal device 100, thereby confirming whether or not the user is authentic.

9 and 10 illustrate a process of authenticating the user using his / her photograph as the authentication image of the user.

The terminal device and the remote control method of the present invention can confirm whether or not the user is using the ear photograph together with the face photograph in the process of confirming or authenticating the user. Such ear photograph can be used alone or in combination with the face photograph.

The process of confirming the user's identity by using the user's area can be performed through a process similar to the face recognition process described above. First, the first terminal device 100 may receive an image of the ear canal portion of the ear canal that collects sound waves and enters the ear canal, and extracts feature points in the ear canal from the image . Then, it is possible to acquire distances and angles between the minutiae points and confirm whether or not such data matches the authentication image stored in the first terminal device 100.

Human ears, like other biometric information, have persistence, uniqueness, and universality. In addition, unlike facial photographs, photographs of your area are not readily available on social networks or the Internet.

Therefore, the terminal device and the remote control method according to the present invention can achieve a much stronger effect of the strong authentication process by utilizing such ear photographs.

First, the first terminal device 100 may receive a character string and an image from the second terminal device 200 (S11-2). At the same time or at the same time as this process, the first terminal device 100 It is possible to perform the process of acquiring the identification information including the telephone number of the second terminal device 200. (S11-1)

After receiving the character string and the image from the second terminal device 200, the first terminal device 100 can first confirm whether the received image has been operated (S11-3), and if the second terminal device 200 It is possible to check whether or not there is a portion of the next received character string that matches the personal identification string previously stored in the first terminal device 100. If the image received from the first terminal device 100 is not operated, -4) The personal identification string used here can be stored as a personal identification string that is easy for the owner of the first terminal device 100 to memorize. Examples of the personal identification string include the owner's name, birth date, memorized day, Address, and so on.

If there is a portion of the string received in the previous step that matches the authentication string of the user, then the first terminal device 100 confirms whether the received image matches the photograph of the face, (S11-5). If the received image matches the authentication image of the user, it is determined whether or not there is a portion of the received string that matches the predetermined command for remotely controlling the first terminal device 100 (S11-6). When it is determined that there is a portion that matches the predetermined command in this process, the first terminal device 100 confirms the identification information of the second terminal device 200, (S11-7). If the second terminal device 200 is a terminal device capable of executing a command requested by the second terminal device 200, It is possible to execute the functions of the set command and performs a process for transmitting the execution result to the (S11-8), the second terminal device (200). (S11-9)

In the terminal device and the remote control method thereof according to the present invention, the first terminal device 100 acquires identification information such as the telephone number of the second terminal device 200 and confirms whether or not it is authorized to perform a predetermined command The reason is as follows.

The predefined commands to be executed by the first terminal device 100 include a screen locking operation, a personal information deletion operation, an application deletion execution, a device initialization operation, a character notification function execution, a voice notification function execution, Execution of a camera function, execution of a light emitting sound function, execution of a position information transmission function, and the like. In this case, for the commands that affect the first terminal device 100 such that the first terminal device 100 can not recover the first terminal device 100 when the first terminal device 100 performs its functions, such as executing personal information deletion and device initialization, It may be necessary to perform a corresponding function only through the terminal device 200. [ To this end, the terminal device and the remote control method thereof according to the present invention may allow a predetermined command to be executed by setting a difference in authority according to the identification information of the second terminal device 200. For example, functions such as device initialization and personal information deletion may be performed only by the second terminal device 200 belonging to the family, and the second terminal device 200 owned by the friend may be set to perform only the screen lock function .

The reason why the terminal apparatus and the remote control method according to the present invention grant execution authority to a predetermined command based on the identification information is as follows.

The owner of the first terminal device 100 borrows the second terminal device 200 from the third party and the first terminal device 100 can not access the first terminal device 100, A remote lock function, and a camera shooting function can be performed. Even after the first terminal devices 100 have been recovered by performing such a function, the owner of the second terminal device 200 can use the character string and the image stored in the second terminal device 200, There may occur a case where the device 100 is to be remotely controlled unauthorized. Of course, the terminal device and its remote control method according to the present invention have a function of checking whether or not an image is manipulated to be examined to prevent such a case, and to prevent the image from being manipulated in detail. In order to further prevent such an approach, The authority of the second terminal device 200 may be lowered after the first terminal device 100 is recovered, thereby enhancing the blocking effect on illegal access and execution.

First, the first terminal device 100 stores the time at which the character string is received from the second terminal device 200 as a first time (S12-2), and stores a new image received from the second terminal device 200 (S12-2). Next, it can be checked whether or not the time difference between the first time and the second time stored is equal to or greater than a preset time difference (S12-3 If it is determined that the time difference between the first time and the second time is longer than the preset time difference, it is determined that the image received from the second terminal device 200 has been operated (S12-4) So that the first terminal device 100 does not perform its function. That is, when it is determined that the time difference between the character string and the image received by the first terminal device 100 from the second terminal device 200 is longer than the time required for general transmission, the first terminal device 100 receives The second terminal device 200 may refuse the authentication of the character string and the image transmitted by the second terminal device 200 and may not perform the function corresponding to the predetermined command.

The first terminal device 100 of the terminal device and the remote control method of the present invention can confirm whether the received image is manipulated by using the time information obtained from the meta data of the received image. To this end, the first terminal device 100 may acquire the shooting time, the generation time, and the modified time of the received image (S13-1). Then, the acquired shooting time, the generation time, (S13-2). If the acquired photographing time, the generation time, and the corrected time do not coincide with each other, it can be determined that the image has been manipulated. (S13-3 ) In general, when a photograph taken using a camera or a smart phone is transmitted as it is, the photographing time, creation time, and corrected time stored in the metadata of the photograph coincide with each other. , It is determined that the received image has been manipulated since the possibility that the received image has been manipulated is large.

Metadata refers to data describing other data as structured data about the data. The metadata stored together with the photographs includes information such as the time, position, camera type, aperture speed, etc., Data provided.

Although there are various types of metadata for providing such information, recent smart phones and cameras have been developed in exchangeable image file format (Exif, exchangeable image file format) format developed by Japan Electronics Industry Development Association Is widely used. The Exif metadata includes a thumbnail image, GPS information, photographing environment information, and time information as shown in the drawing.

The terminal device and the remote control method of the present invention can confirm whether or not the photograph is manipulated by checking such tags of Exif metadata. It should be noted, however, that this does not limit the use of other metadata.

The terminal device and its remote control method of the present invention can confirm whether or not the location information is present in the metadata by checking the metadata of the received image as another method of confirming whether the received image is operated (S15-1) (S15-2), it is judged that the image has been manipulated (S15-3). In other words, when copying or capturing is performed, The terminal device and the remote control method of the present invention do not check the value of the received image and judge that the image is an operated image. If the first terminal device 100 determines that the received character string To ignore the function of the pre-set command included in the command.

In the terminal device and the remote control method of the present invention, the method of confirming whether or not the image is manipulated as described above may be separately applied, but it may be applied in a cross check method in combination with other methods. By applying such a cross check method, the terminal device of the present invention and its remote control method can achieve the effect of confirming whether or not the user is authenticated easily and more reliably.

The Exif metadata of the image normally photographed and transmitted through the second terminal device 200 contains a lot of location information as shown in the figure. However, the image captured or copied from the Internet stores no location information in the Exif metadata I do not. Accordingly, by confirming such information, the first terminal device 100 can confirm whether or not the image transmitted by the second terminal device 200 is manipulated.

When it is confirmed that the image received by the first terminal device 100 is not an operated image, the first terminal device 100 performs an image correction process including illumination adjustment for smooth analysis of the received image (S17-1). Then, the feature points of the received image are extracted, and the correlation between the feature points is computed (S17-2). Then, (S17-3). When the correlation between the minutiae points of the received image and the minutiae points of the authentication image of the user coincide with each other, The terminal device 100 determines that the received image matches the authentication image of the user (S17-4). Then, the first terminal device 100 performs the function according to the preset command You can go through the process.

The terminal device and the remote control method of the present invention permit the remote control of the terminal device after the duplicate verification procedure is performed after the verification of the authentication string of the user and the authentication image of the user even after the operation of the image is confirmed, It is possible to provide a simple remote control function and a perfect security function.

The owner may remotely control the first terminal device 100 for reasons such as a loss or the like by selecting the recovery confirmation button of the first terminal device 100 in step S18-1, The process of remotely controlling the first terminal device 100 can be terminated.

When the recovery confirmation button is selected in the first terminal device 100, the first terminal device 100 transmits a character string and an image to remotely control the first terminal device 100, (Step S18-2). Then, by removing the execution authority for the predetermined command of the corresponding second terminal devices 200 (S18-3), the owner of the first terminal device 100 You can prevent unauthorized access by a third party other than yourself. However, this function can be modified through the setting change of the first terminal device. In this case, the existing second terminal device 200 storing the identification information by performing the remote control of the first terminal device 100 is also continuously 1 terminal device 100 can be changed.

In the terminal device and remote control method thereof according to the present invention, in order for the first terminal device 100 to be remotely controlled by the third terminal device 200, first, the information of the owner of the first terminal device 100 Must be stored in the first terminal device 100. To this end, the first terminal device 100 first receives the authentication string (S19-1), and receives a user identification image such as the owner's face or ear image of the first terminal device 100 (S19-2) Next, the first terminal device 100 performs an image correction process including adjustment of illuminance of the identity verification image (S19-3), extracts the characteristic points of the authentication image of the user, (S19-4). &Lt; RTI ID = 0.0 >

The personal identification string stored in the first terminal device 100 includes at least one of the name, date of birth, date of memorization, password, memory location, resident registration number, and address of the owner of the first terminal device 100 By storing the authentication string with this easy-to-remember information, the terminal device of the present invention and its remote control method can prevent an excessive effort to think about a specific password to implement the function of the present invention.

When the second terminal device 200 transmits a character string and an image to remotely control the first terminal device 100 in step S20-1, If there is a part of the transmitted string that matches the authentication string of the user and the transmitted image matches the authentication image of the user, the function according to the previously set command contained in the received string is performed, To the terminal device that is preset in the first terminal device 100 to receive the execution result of the second terminal device 200 by a method such as a character. Then, the second terminal device 200 or the previously set terminal device can receive the execution result and display it through the display unit of the second terminal device 200. (S20-2) In other words, The terminal device receiving the remote control result from the device 100 may be the same terminal device as the terminal device that transmitted the authentication string of the user and the authentication image for remote control, And may be a terminal device in which the first terminal device 100 stores the information.

Through this function, the terminal device and the remote control method of the present invention can confirm in real time whether or not the first terminal device 100 using the second terminal device 200 is normally controlled.

The first terminal device 100 of the terminal device and the remote control method of the present invention includes a receiving module 111, a user authentication string storage module 142, a user authentication image storage module 143, a command storage module 145, An authentication string verification module 121, a user authentication image verification module 122, an instruction verification module 131, and a command execution module 132. In addition, it may further include an image manipulation confirmation module 123, a transmission module 112, an identification information acquisition storage module 141, and a rights setting storage module 144. Here, the first terminal device 100 may be a physical device, or may be a program such as an application that is stored and operated on a physical device. In addition, the module constituting the first terminal device 100 may be a physically realized component or the like, but is not limited thereto and may be a module functionally programmed.

The role and operation of each component of the first terminal device 100 will be described below.

The authentication authentication character string storage module 142 may be a part for storing a user authentication character string such as the name and the resident registration number of the owner of the first terminal device 100, It may be a module that numerically stores the correlation between the feature point extracted from the face of the owner of the terminal device 100 or the ear photograph and the feature point. The command storage module 145 may store instructions for a function that can be performed remotely from the first terminal device 100. The receiving module 111 of the first terminal device 100 may be a part for receiving and distributing the character string, the image, the identification information, the user authentication string, and the authentication image of the user.

The personal identification string confirmation module 121 of the first terminal device 100 determines whether or not there is a portion of the character string received from the second terminal device 200 that matches the personal identification string stored in the personal identification character string storage module 142 It can play a role of checking. In addition to the authentication string verification module 121, the authentication image verification module 122 analyzes the image received from the reception module 111 and matches the authentication image stored in the authentication image storage module 143 Whether or not it is possible to perform the role of checking. If the authentication image verification module 122 determines that the received authentication image matches the received authentication image and that there is a portion of the character string received by the authentication character string verification module 121 that matches the authentication character string, It checks whether or not there is a part of the string received through the reception module 111 that matches the previously set command stored in the command storage module 145. The command execution module 132 executes a function according to a predetermined command from the command storage module 145 and transmits the result to the external device such as the second terminal device 200 through the transmission module 112. [ As shown in FIG. In addition to this configuration, the image operation confirmation module 123 can check whether or not the received image has been manipulated through an algorithm for checking whether or not the image manipulation has been performed, To the image confirmation module 122.

The identification information acquisition and storage module 141 of the first terminal device 100 stores the identification information received from the reception module 111, May be stored in the storage module 144.

Through such a configuration, the terminal device and its remote control method according to the present invention can perform a desired function such as screen locking and device initialization to a terminal device that has been lost or the like by simply receiving a character string and an image, And ensure that the equipment is recovered early.

The drawing shows a state in which a text notification is displayed on the screen by receiving a command for executing a text notification function from the second terminal device 200 among various functions that the first terminal device 100 can execute. When the character notification is displayed on the screen, the person who currently holds the lost first terminal device 100 can communicate with the displayed number in the text notification window and can securely transmit the first terminal device 100. In addition to the text notification function, the first terminal device 100 executes a voice notification function, a vibration function, a photographing function, a light-emitting sound function, and the like, repeatedly indicating that the terminal device is lost, The terminal device of the present invention and its remote control method are capable of detecting the recovery rate of the first terminal device 100 which has been lost due to loss or the like . Also, as described above, the location of the first terminal device 100, the built-in phone number, and the like are transmitted to the second terminal device 200 or the previously stored terminal device by e-mail or text, It is possible to prevent personal information from being leaked to the outside by performing the initialization function or the like.

Although the preferred embodiments of the present invention have been disclosed for illustrative purposes, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims. And changes may be made without departing from the spirit and scope of the invention.

(Explanation of Symbols)

10: Smartphone

100: a first terminal device

111: receiving module

112: Transmission module

121: Identity verification string verification module

122: Self-authentication image verification module

123: Image manipulation confirmation module

131: Command check module

132: command execution module

141: Identification information acquisition storage module

142: Personal authentication string storage module

143: Self-authentication image storage module

144: Permission setting storage module

145: Command storage module

200: second terminal device

Claims

The first terminal device receiving a character string and an image from the second terminal device;

Confirming whether the first terminal device has a portion of the received character string matching the first authentication string from the second terminal device;

Confirming whether the image received from the second terminal device by the first terminal device matches the authentication image of the user;

When the character string received from the second terminal device coincides with the identity verification string and the image received from the second terminal device matches the authentication image of the user, Confirming whether or not there is a portion of the received string that coincides with a predetermined command;

And a step in which the first terminal device performs a function for the predetermined command if there is a portion of the character string received from the second terminal device that matches the predetermined command word, / RTI >
The first terminal device receiving a character string and an image from the second terminal device;

Confirming whether the first terminal device manipulates the image received from the second terminal device;

When it is confirmed that the image received from the second terminal device is not operated, whether the first terminal device matches a portion of the character string received from the second terminal device matching the principal authentication string step;

Confirming whether the image received from the second terminal device by the first terminal device matches the authentication image of the user when it is confirmed that the image received from the second terminal device is not operated;

When the character string received from the second terminal device coincides with the identity verification string and the image received from the second terminal device matches the authentication image of the user, Confirming whether or not there is a portion of the received string that coincides with a predetermined command;

And a step in which the first terminal device performs a function for the predetermined command if there is a portion of the character string received from the second terminal device that matches the predetermined command word, / RTI >
3. The method of claim 2,

Wherein the step of confirming whether or not the image of the image received from the second terminal device by the first terminal device

Storing a time at which the first terminal device received the character string from the second terminal device as a first time;

Storing the time when the first terminal device received the image from the second terminal device as a second time;

And when the time difference between the first time and the second time is equal to or greater than a predetermined time difference, the first terminal device determines that the image received from the second terminal device has been operated A remote control method of a terminal device.
3. The method of claim 2,

Wherein the step of confirming whether or not the image of the image received from the second terminal device by the first terminal device

Acquiring a shooting time, a generation time, and a modified time of the image received by the first terminal device from the second terminal device;

Confirming whether or not the first terminal device coincides with the shooting time, the generation time, and the modified time;

Wherein the first terminal device determines that the image received from the second terminal device is operated when the shooting time, the generation time, and the modified time do not match with each other A remote control method of the terminal device.
3. The method of claim 2,

Wherein the step of confirming whether or not the image of the image received from the second terminal device by the first terminal device

Confirming location information of the image received by the first terminal device from the second terminal device;

And the first terminal device determines that the image received from the second terminal device has been operated when location information is not confirmed in the image received from the second terminal device A remote control method of the terminal device.
3. The method according to claim 1 or 2,

Before the first terminal device receives the string and the image from the second terminal device,

Further comprising the step of the first terminal acquiring the identification information of the second terminal device.
The method according to claim 6,

The step of the first terminal device performing the function for the pre-set command when there is a portion of the character string received from the second terminal device coinciding with the preset command word

And executes only when the first terminal device confirms the identification information of the second terminal device and the second terminal device is an authorized terminal device capable of executing the preset command. Remote control method.
3. The method according to claim 1 or 2,

After the step of the first terminal device performing the function for the pre-set command word when there is a portion of the character string received from the second terminal device that matches the preset command word,

And transmitting the execution result of the function for the predetermined command word to the second terminal device by the first terminal device.
The method according to claim 1,

Wherein the step of verifying whether the image received by the first terminal device from the second terminal device matches the identity authentication image

Performing image correction including the illumination adjustment of the image received by the first terminal device from the second terminal device;

Extracting a feature point of the image received by the first terminal device from the second terminal device and calculating a correlation between the feature points;

Confirming whether a correlation between minutiae points of the image received by the first terminal device from the second terminal device is matched with a correlation between minutiae points of the authentication image of the principal;

When the correlation between the minutiae points of the image received from the second terminal device is matched with the correlation between the minutiae points of the first authentication image, And a step of determining that the terminal device matches the terminal device.
3. The method of claim 2,

Wherein the step of verifying whether the image received from the second terminal device by the first terminal device matches the authentication image of the user is confirmed when it is confirmed that the image received from the second terminal device is not operated

Performing image correction including the illumination adjustment of the image received by the first terminal device from the second terminal device;

Extracting a feature point of the image received by the first terminal device from the second terminal device and calculating a correlation between the feature points;

Confirming whether a correlation between minutiae points of the image received from the second terminal device by the first terminal device matches a correlation between minutiae points of the authenticated image of the principal;

When the correlation between the minutiae points of the image received from the second terminal device is matched with the correlation between the minutiae points of the first authentication image, And a step of determining that the terminal device matches the terminal device.
3. The method according to claim 1 or 2,

The authentication image

And a photograph of the face of the owner of the first terminal device or a picture of the ear of the terminal device.
3. The method according to claim 1 or 2,

The authentication string

Wherein the first terminal device includes at least one of a name, a date of birth, a date to memorize, a password, a memory location, a resident registration number, and an address of the owner of the first terminal device.
3. The method according to claim 1 or 2,

The pre-set command

Executing the initialization of the device, executing the voice notification function, executing the backup function of the phone book e-mail, and executing the backup function of the first terminal device, a function of executing a camera photographing function, a function of transmitting a light-emitting sound, and a function of transmitting a position information.
The method according to claim 6,

The identification information

And the telephone number is a telephone number.
3. The method according to claim 1 or 2,

Wherein the first terminal device is a smartphone.
3. The method according to claim 1 or 2,

Wherein the second terminal device is a smartphone.
3. The method of claim 2,

Wherein the step of confirming whether or not the image of the image received from the second terminal device by the first terminal device

(Exif, exchangeable image file format) of the received image.
A personal authentication string storage module for storing a personal authentication string;

An authentication image storage module for storing the authentication image;

A command storage module for storing a predetermined command;

A receiving module that receives information including at least one of a character string, an image, identification information, a principal authentication string, and a principal authentication image;

An authentication string verifying module for verifying whether or not there is a portion of the character string received by the receiving module that matches the user authentication string stored in the user authentication string storage module;

An authentication image verification module for verifying whether the image received by the reception module matches the authentication image stored in the authentication image storage module;

A command check module for checking whether or not a part of the string received by the receiving module matches a predetermined command stored in the command storage module when it is determined that the authentication string verifying module matches the authentication verification image verification module;

And a command execution module that calls and executes a predetermined command from the command storage module when it is determined that the command check module matches.
19. The method of claim 18,

And an image manipulation confirmation module for confirming whether or not the image received by the reception module has been manipulated.
19. The method of claim 18,

Further comprising: a transmission module that transmits the result of execution of the command by the command execution module to the outside.
19. The method of claim 18,

An identification information acquisition module that stores identification information received by the reception module;

And a rights setting storage module for storing preset command execution authority information according to the identification information acquired by the identification information acquisition and storage module.