JP6543691B2 - Mobile terminal and operation method thereof - Google Patents

Description

  The present invention relates to a mobile terminal and an operation method thereof.

  The mobile terminal is portable and has at least one function capable of voice and video calls, a function capable of inputting and outputting information, and a function capable of storing data. Equipment. Such mobile terminals, such as photography and video shooting, playing music files and video files, playing games, receiving broadcasts, such complex functions as wireless Internet, and a comprehensive multimedia player (multimedia player) form It is embodied in

  Also, as various types of wearable devices wearable to the user's body are developed, there is a need for a technology that enables the mobile terminal to be used more conveniently.

  The problem to be solved by the present invention is a technique for enabling a user to more conveniently use a mobile terminal while using a portable terminal with a wearable device.

  Embodiments address at least the aforementioned problems, disadvantages and other disadvantages not mentioned above. Also, embodiments are not required to overcome the aforementioned shortcomings, and some of the aforementioned issues may not be overcome.

  The present invention releases the locking mode of the mobile terminal when the movement of the mobile terminal and the movement of the wearable device are identical using the movement of the mobile terminal and the movement of the wearable device. A mobile terminal and an operation method of the mobile terminal are disclosed.

  A variety of operations may be performed according to the user's command using the movement of the mobile terminal and the movement of the wearable device.

5 is a diagram illustrating interaction of a mobile terminal with a wearable device, according to one embodiment. 11 is a diagram illustrating an operation of releasing a locking mode of the mobile terminal if the movement of the mobile terminal and the movement of the wearable device are the same according to an embodiment of the present invention. 5 is a flowchart illustrating an operation method of a mobile terminal according to an embodiment of the present invention. FIG. 10 is a diagram referred to in the description of a method of determining the same movement of the wearable device and the movement of the mobile terminal according to an embodiment of the present invention. 5 is a flowchart illustrating interaction of a mobile terminal with a wearable device, according to one embodiment of the present invention. 5 is a flowchart illustrating an interaction between a mobile terminal and a wearable device to perform an unlocking operation of the mobile terminal according to an embodiment of the present invention. FIG. 7 is a diagram illustrating an example of whether the wearable device is in a locking mode or in a locking mode release depending on wear of the wearable device according to an embodiment of the present invention. 5 is a diagram illustrating an example in which a motion locking release function notification message is displayed on a mobile terminal according to an embodiment of the present invention; 7 is a diagram illustrating an operation of releasing a locking mode of a mobile terminal when the mobile terminal user and the wearable device wearer are the same according to an exemplary embodiment of the present invention. 7 is a diagram illustrating an operation of releasing a locking mode of a mobile terminal when the mobile terminal user and the wearable device wearer are the same according to an exemplary embodiment of the present invention. 7 is a diagram illustrating an operation of releasing a locking mode of a mobile terminal when the mobile terminal user and the wearable device wearer are the same according to an exemplary embodiment of the present invention. 7 is a diagram illustrating an operation of releasing a locking mode of a mobile terminal when the mobile terminal user and the wearable device wearer are the same according to an exemplary embodiment of the present invention. 7 is a flowchart illustrating a method of performing user authentication in a mobile terminal when user authentication is performed in a wearable device according to an embodiment of the present invention. It is drawing for demonstrating the method of FIG. 5 is a flowchart illustrating a method of displaying a web page displayed on a wearable device on a mobile terminal according to an embodiment of the present invention. It is drawing for demonstrating the method of FIG. 5 is a flowchart illustrating a method of performing call connection by a mobile terminal when a wearable device receives a call connection request according to an embodiment of the present invention; It is drawing for demonstrating the method of FIG. 5 is a flowchart illustrating a method of communicating with an external device using a mobile terminal while communicating with an external device using a wearable device according to an embodiment of the present invention. It is drawing for demonstrating the method of FIG. 5 is a flowchart illustrating a method of executing an application related to a notification message in a mobile terminal when the wearable device receives the notification message according to an embodiment of the present invention. It is drawing for demonstrating the method of FIG. It is drawing for demonstrating the method of FIG. 5 is a flowchart illustrating a method of displaying a received message at a mobile terminal when the wearable device receives a message, according to an embodiment of the present invention. It is drawing for demonstrating the method of FIG. 5 is a flowchart illustrating a method of playing content being played on a wearable device on a mobile terminal according to an embodiment of the present invention. It is drawing for demonstrating the method of FIG. 5 illustrates a method of displaying content displayed on a wearable device on a mobile terminal according to an embodiment of the present invention. 5 is a diagram illustrating a method of transmitting wearable device data to a mobile terminal according to an embodiment of the present invention. FIG. 10 is a flowchart illustrating a method of performing a preset operation when a biological signal sensed by a mobile terminal and a biological signal sensed by a wearable device are identical according to an embodiment of the present invention. is there. It is drawing referred to by the explanation of FIG. 11 is a flowchart illustrating a method of performing a preset operation in a mobile terminal when a touch pattern sensed by a mobile terminal and a pattern captured by a wearable device are identical according to an embodiment of the present invention; . It is drawing for demonstrating the method of FIG. 8 is a flowchart illustrating a method of performing a preset operation in a mobile terminal when a user image captured by a mobile terminal and a user image captured by a wearable device according to an embodiment of the present invention are identical. . It is drawing for demonstrating the method of FIG. 5 is a flowchart illustrating an operation method of a mobile terminal according to an embodiment of the present invention. FIG. 7 is a flowchart illustrating a method of converting a sharing mode to a personal mode by determining whether a wearable device connected to a mobile terminal is worn by a mobile terminal user according to an embodiment of the present invention. FIG. 7 is a flowchart illustrating a method of converting a sharing mode to a personal mode by determining whether a wearable device connected to a mobile terminal is worn by a mobile terminal user according to an embodiment of the present invention. FIG. 7 is a flowchart illustrating a method of converting a sharing mode to a personal mode by determining whether a wearable device connected to a mobile terminal is worn by a mobile terminal user according to an embodiment of the present invention. FIG. 7 is a flowchart illustrating a method of converting a sharing mode to a personal mode by determining whether a wearable device connected to a mobile terminal is worn by a mobile terminal user according to an embodiment of the present invention. 5 is a diagram illustrating a common mode and a personal mode of a mobile terminal according to an embodiment of the present invention. 5 illustrates a method of operating a mobile terminal in a shared mode according to an embodiment of the present invention. 5 illustrates a method of operating a mobile terminal in a personal mode according to an embodiment of the present invention. 5 is a diagram illustrating a common mode and a personal mode of a mobile terminal according to an embodiment of the present invention. FIG. 2 is a block diagram illustrating the configuration of a mobile terminal according to an embodiment of the present invention. FIG. 2 is a block diagram illustrating the configuration of a mobile terminal according to an embodiment of the present invention. It is a block diagram for explaining the composition of a wearable device according to one embodiment of the present invention. FIG. 7 is a diagram illustrating the interaction between a smart door lock and a wearable device, according to one embodiment of the present invention. 5 is a view illustrating a method of displaying detailed information of a notification message received by a mobile terminal if the movement of the mobile terminal and the movement of the wearable device are the same according to an embodiment of the present invention;

  A mobile terminal according to an embodiment of the present invention comprises a sensing unit for sensing movement of the mobile terminal, the mobile terminal sensed during a predetermined time period from a start time requested by the mobile terminal. Communication unit for receiving information related to the movement of the wearable device corresponding to the machine from the wearable device, and whether the movement of the mobile terminal and the movement of the wearable device have correlation of a predetermined level or more Determining whether the movement of the mobile terminal and the movement of the wearable device are correlated with the predetermined level or more, the control unit unlocking the mobile terminal is included. May be.

  The sensing unit may sense a motion of the mobile terminal during a same time interval as a time interval in which the motion of the wearable device is sensed.

  The wearable device according to an embodiment of the present invention is characterized by being in the unlocked state.

  The control unit according to an embodiment of the present invention determines whether the movement of the mobile terminal and the preset movement have a correlation of a predetermined level or more, and the communication unit is configured to perform the movement. When the movement of the terminal and the preset movement have a correlation greater than or equal to the predetermined reference, information related to the movement of the wearable device may be received from the wearable device.

  The mobile terminal according to an embodiment of the present invention further includes a display unit, and the control unit recognizes that a wearable device is present within a predetermined distance from the mobile terminal, and the display unit is configured to receive the wearable device. If it is recognized that the device is within the predetermined distance range, then the movement of the mobile terminal and the movement of the wearable device are identical or similar. A message can be displayed informing that it is unlocked.

  The controller according to an embodiment of the present invention may be configured such that the mobile terminal is operated by the wearable device when the movement of the mobile terminal and the movement of the wearable device have a correlation between the predetermined level or more. Control to execute an operation corresponding to the operation.

  When the movement of the mobile terminal and the movement of the wearable device have a correlation between the predetermined level or more, the communication unit according to an embodiment of the present invention is in the middle of playing on the wearable device from the wearable device. The mobile communication terminal may receive certain content information, and the control unit may control the mobile terminal to reproduce the content based on the content information.

  The communication unit according to one embodiment of the present invention may be configured to display the wearable device from the wearable device when the movement of the mobile terminal and the movement of the wearable device have a correlation between the predetermined level or more. The mobile terminal may further include a display unit configured to display the web page based on the web page information.

  The communication unit according to an embodiment of the present invention may be connected from the wearable device to the wearable device when the movement of the mobile terminal and the movement of the wearable device have a correlation higher than the predetermined level. The mobile communication terminal may be configured to receive certain call information, and the control unit may control that the mobile terminal connects the call based on the call information.

  The communication unit according to an embodiment of the present invention, when the movement of the mobile terminal and the movement of the wearable device have a correlation higher than the predetermined level, a message received by the wearable device from the wearable device Receiving the application information corresponding to the control information, and controlling the mobile terminal to execute the application based on the application information.

  According to an embodiment of the present invention, there is provided a method of operating a mobile terminal, comprising: sensing a motion of the mobile terminal; sensing the mobile terminal during a predetermined time interval from a start time requested by the mobile terminal; Information from the wearable device corresponding to the movement of the wearable device corresponding to the step of determining whether the movement of the mobile terminal and the movement of the wearable device have a correlation of a predetermined level or more And the step of unlocking the mobile terminal if the movement of the mobile terminal and the movement of the wearable device are correlated with the predetermined level or more.

  The sensing may include sensing a motion of the mobile terminal during a same time interval as a time interval in which the motion of the wearable device is sensed.

  The method of operating a mobile terminal according to an embodiment of the present invention may further include determining whether the movement of the mobile terminal and the preset movement have a correlation between a predetermined level or more. The receiving may receive information related to the movement of the wearable device from the wearable device if the movement of the mobile terminal and the preset movement have a correlation between the predetermined reference and the predetermined reference. It may include steps.

  According to one embodiment of the present invention, there is provided a method of operating a mobile terminal, comprising: recognizing that the wearable device is present within a predetermined distance from the mobile terminal; and the wearable device is within the predetermined distance. If it is recognized that the movement of the mobile terminal and the movement of the wearable device are identical or similar, then the mobile terminal is unlocked. It may include the step of displaying an informing message.

  A method of operating a mobile terminal according to an embodiment of the present invention is performed in the wearable device when the movement of the mobile terminal and the movement of the wearable device have a correlation between the predetermined level or more. The method may further include performing an operation corresponding to the operation.

  In the operation method according to one embodiment of the present invention, when the movement of the mobile terminal and the movement of the wearable device have a correlation greater than or equal to the predetermined reference, reproduction from the wearable device by the wearable device is in progress. The method may further include receiving certain content information, and playing the content based on the content information.

  In the method of operating a mobile terminal according to an embodiment of the present invention, when the movement of the mobile terminal and the movement of the wearable device have a correlation greater than or equal to the predetermined reference, the wearable device The method may further include receiving web page information being displayed by the device, and displaying the web page based on the web page information.

  In the method of operating a mobile terminal according to an embodiment of the present invention, in the case where the movement of the mobile terminal and the movement of the wearable device have a correlation between the predetermined level or more, the wearable device The method may further include receiving call information being connected by a device, and connecting the call based on the call information by the mobile terminal.

  In the method of operating a mobile terminal according to an embodiment of the present invention, in the case where the movement of the mobile terminal and the movement of the wearable device have a correlation between the predetermined level or more, the wearable device The method may further include receiving application information corresponding to a received message by the device, and the mobile terminal executing the application based on the application information.

  A mobile terminal according to an embodiment of the present invention may have an input for unlocking the mobile terminal and a sensing unit for sensing a motion of the mobile terminal, and a wearable corresponding to the mobile terminal if the user input is sensed. A communication unit configured to request movement information from the device and receive movement information of the wearable device from the wearable device, the movement information being sensed during a predetermined time interval from the start time requested by the mobile terminal, and the sensing unit The movement information of the mobile terminal sensed and the movement information of the wearable device received by the communication unit are compared, and the movement information of the mobile terminal and the movement information of the wearable device are greater than or equal to a predetermined reference Release the locking mode of the mobile terminal if there is a correlation of Control unit may also include a.

  According to an embodiment of the present invention, the user input for unlocking may include at least one of a home button input, a power button input, and an input for holding the mobile terminal.

  The mobile terminal according to an embodiment of the present invention may be configured to determine whether the first data of the mobile terminal and the second data of the wearable device connected to the mobile terminal have a correlation higher than a predetermined level. Wherein the first data and the second data are the same type of data, the first data and the second data are acquired during the same time interval, and the control unit If the first data and the second data have a correlation higher than a predetermined level, an operation corresponding to an operation performed in the wearable device can be performed.

  A mobile terminal according to one embodiment receives a biosignal of a user of the mobile terminal as first data, and a communication part receiving information related to a biosignal of a wearable device user as second data from the wearable device. May be further included.

  A mobile terminal according to an embodiment of the present invention comprises a sensing unit for sensing a touch pattern on a mobile terminal as first data, and information on a touch pattern on a mobile terminal taken by a wearable device from a wearable device as second data May further include a communication unit that receives

  The mobile terminal according to an embodiment may further include a camera that captures an image of the mobile terminal user as the first data, and a communication unit that receives the image of the wearable device user as the second data from the wearable device.

  The operations to be performed according to one embodiment include unlocking the mobile terminal, mobile terminal user authentication, displaying a web page, telephone connection, application execution, message display, content playback, and sharing mode from the mobile terminal to the personal mode It may also include at least one of the conversions.

  Embodiments will be more specifically described with reference to the accompanying drawings.

  In the following description, the same drawing reference numbers are used for the same elements in the other drawings. As with the detailed constructions and elements, the matters defined in the description are provided to aid in the understanding of the embodiments. However, it is clear that the embodiment is carried out without specifically defined cases. Also, well-known functions and configurations are not described in detail in order to obscure the description in unnecessary detailed description.

  The terms "comprise" and / or "wherein" as used herein embody the presence of the recited feature or component and preclude the addition or presence of one or more other features or components. It will be understood not to Further, terms such as "part" and "module" described in the specification mean elements performing at least one function or operation, and also hardware, software, or a combination of hardware and software. Be embodied.

  The term "and / or" as used herein includes any or all of one or more combinations of the listed items. If an expression such as "at least one" precedes the list of components, it does not limit the entire list of components, and does not limit the individual components of the list.

  FIG. 1 is a diagram illustrating an interaction between a mobile terminal and a wearable device according to an embodiment.

  The mobile terminal 100 according to an embodiment of the present invention may be embodied in various forms. For example, the mobile terminal 100 may be a mobile phone, a smart phone (smart phone), a laptop computer (laptop computer), a tablet PC (personal computer), an electronic book reader, a terminal for digital broadcasting, a PDA (personal digital assistant), PMP (portable multimedia player), navigation, MP3 player, digital camera, IPTV (internet protocol television), DTV (digital television), CE equipment (for example, refrigerator with display device, air conditioner), but it is limited to them It is not a thing.

  Also, the wearable device (200) according to an embodiment of the present invention may include, but is not limited to, a watch, a band, a bracelet, etc. that can be worn on the user's wrist, glasses, helmets, Hats, rings, footwear, earrings, hair bands, clothes, gloves, thimbles and the like may be included.

  The mobile terminal 100 and the wearable device 200 may communicate with each other according to an embodiment of the present invention. For example, the mobile terminal 100 can transmit and receive data with the wearable device 200 using near field communication. At this time, the short distance communication is a Wi-Fi (wireless fidelity) method, an NFC (near field communication) method, a Bluetooth (registered trademark, the same in the following) (Bluetooth (registered trademark)) method, an infrared ray method, a Zigbee method And the like, but is not limited thereto.

Also, the wearable device 200 according to an embodiment of the present invention transmits user authentication information or device identification information of the wearable device 200 to the mobile terminal 100, and the mobile terminal 100 transmits user authentication information or information to the wearable device 200. Terminal identification information may be transmitted.
At this time, the user authentication information may include a user ID (identification), a user password, a user account, and the like. The device identification information or the terminal identification information is unique information for distinguishing the device from other devices, and may include, for example, a device model, a device serial number, and the like.

  Also, the mobile terminal 100 can store user identification information or device identification information of the wearable device 200 and can register the wearable device 200 in the mobile terminal 100.

  Also, the wearable device 200 according to an embodiment of the present invention can periodically transmit only device identification information in one direction, and broadcast identification information to the outside through BLE (Bluetooth low energy) communication. be able to.

  Meanwhile, the mobile terminal 100 can recognize the presence of the wearable device 200 present around the mobile terminal 100 based on the received identification information. The wearable device 200 can also recognize the presence of the mobile terminal 100 present around the wearable device 200 based on the received identification information.

  Also, the mobile terminal 100 compares the recognized user identification information or device identification information of the wearable device 200 with the registered user identification information or device identification information of the wearable device, and the recognized wearable device is a mobile terminal. It can be determined whether or not it is a wearable device coupled to. At this time, that the wearable device is connected to the mobile terminal means that the wearable device is registered in the mobile terminal.

  In addition, the mobile terminal 100 according to an embodiment of the present invention may sense motion of the mobile terminal 100 and obtain motion information of the mobile terminal 100.

  At this time, the movement information of the mobile terminal 100 is a value obtained by sensing the movement of the mobile terminal 100 using a geomagnetic sensor, a position sensor, an acceleration sensor, a proximity sensor, a gyroscope sensor, etc. May include, but is not limited to, direction values, velocity values, acceleration values, etc.

  Also, the wearable device 200 according to an embodiment of the present invention may sense the movement of the wearable device 200. For example, the wearable device 200 senses the movement of the wearable device 200 using a geomagnetic sensor, a position sensor, an acceleration sensor, a proximity sensor, a gyroscope sensor, etc., and the direction value, velocity value, acceleration value in which the wearable device 200 moves. And the like can be acquired.

  In addition, the mobile terminal 100 according to an embodiment of the present invention may sense a touch input to the mobile terminal 100. In addition, the mobile terminal 100 can sense a biological signal of the mobile terminal 100 user. In addition, the mobile terminal 100 may sense various signals transmitted from an external device (for example, the wearable device 200) present around the mobile terminal. This will be described in detail later.

  Also, the wearable device 200 according to an embodiment of the present invention may include a camera and capture an image. Also, the wearable device 200 can sense a biological signal of the wearable device 200 wearer. Also, the wearable device 200 can sense various signals transmitted from an external device (for example, the mobile terminal 100) present around the wearable device 200. This will be described in detail later.

  Also, the wearable device 200 according to an exemplary embodiment of the present invention may transmit information sensed by the wearable device 200 to the mobile terminal 100 connected to the wearable device 200.

  For example, motion information of the wearable device 200 sensed by the wearable device 200 may be transmitted to the mobile terminal 100 coupled to the wearable device 200.

  Alternatively, the wearable device 200 is a mobile terminal connected to the wearable device 200 with biosignal information of the wearable device 200 wearer, image information captured by the wearable device 200, and signal information of an external device sensed by the wearable device 200. It can be transmitted to the machine 100.

  Accordingly, the mobile terminal 100 according to an embodiment of the present invention compares the information sensed by the mobile terminal 100 with the information sensed by the wearable device 200, and compares the information sensed by the mobile terminal 100 with the information sensed by the mobile terminal 100. If the information sensed by the wearable device 200 is the same, a preset operation may be performed.

  In addition, when the information sensed by the mobile terminal 100 is the same as the information sensed by the wearable device 200, the mobile terminal 100 determines that the user of the mobile terminal 100 wears the wearable device 200. can do.

  The preset operation is also an operation related to the operation performed by the wearable device 200. For example, when the locking mode of the wearable device 200 is released, the locking mode of the mobile terminal 100 is released. When the wearable device 200 is displaying a web page, the mobile terminal 100 can display the same web page. Alternatively, when the wearable device 200 is playing content, the mobile terminal 100 can continuously play the same content. Alternatively, when the wearable device 200 receives a call connection request, the mobile terminal 100 can perform call connection. Alternatively, when the wearable device 200 receives a notification message, the mobile terminal 100 may execute an application related to the notification message. However, various operations are performed without being limited to them.

  FIG. 2 is a diagram illustrating an operation of releasing the locking mode of the mobile terminal when the movement of the mobile terminal and the movement of the wearable device are the same according to an embodiment of the present invention.

  FIG. 2 shows a state in which the user of the mobile terminal 100 picks up the mobile terminal 100 and wears the wearable device 200 on the wrist of the user. Although FIG. 2 illustrates that the wearable device 200 is configured as a watch that can be worn on the wrist, it is not limited thereto.

  As shown in FIG. 2, the mobile terminal 100 user takes the mobile terminal 100 and wears the wearable device 200 on the user's wrist (the wrist of the hand holding the mobile terminal 100). When moving the hand holding the mobile terminal 100, the movement of the mobile terminal and the movement of the wearable device are identical.

  The meaning that the movement of the mobile terminal 100 and the movement of the wearable device are the same means that movement information of the mobile terminal 100 and the wearable device 200 (for example, movement direction, size, speed of the mobile terminal and wearable device) , Or the same movement pattern), or the difference between the movement information of the mobile terminal 100 and the movement information of the wearable device 200 is within a predetermined range.

  For example, the movement pattern of the mobile terminal 100 and the movement pattern of the wearable device 200 are the same. As illustrated in FIG. 2, when the user holds the mobile terminal 100 in the hand wearing the wearable device 200 and lifts the mobile terminal 100, the movement pattern (first motion pattern m1) of the mobile terminal 100 is in the counterclockwise direction. Can be shown a movement pattern that rotates a predetermined angle.

  In addition, the movement of the wearable device 200 (second motion m2) sensed by the wearable device 200 can also indicate a movement pattern that rotates a predetermined angle in the counterclockwise direction.

  Also, in the mobile terminal 100 according to an embodiment of the present invention, the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same, and the wearable device 200 releases the locking mode through a predetermined authentication process. If the mobile terminal 100 is in the locked state, the locking mode of the mobile terminal 100 can be released.

  For example, when the wearable device 200 is in the locking mode release state, the wearable device 200 can transmit a signal to the mobile terminal 100 to notify the mobile terminal 100 that the locking mode release state is in progress. In addition, the wearable device 100 may transmit motion information of the wearable device 100 to the mobile terminal 100.

  However, the present invention is not limited thereto, and according to an embodiment of the present invention, regardless of the locking release state of the wearable device 200, the mobile terminal 100 can receive motion information of the mobile terminal 100 and the wearable device 200. If the motion information is the same as the motion information, the locking mode of the mobile terminal 100 can be released.

  FIG. 2 illustrates a state in which the display unit of the wearable device 200 is activated in order to indicate the state in which the locking mode of the wearable device 200 is released. However, the present invention is not limited to this, and the display unit of the wearable device 200 may be inactivated (the display unit is turned off). Although FIG. 2 illustrates that the display units of the wearable device 200 and the mobile terminal 100 are located in the same direction based on the user's hand, the display unit of the mobile terminal 100 and the wearable device 200 are illustrated. The display unit can also be positioned in the opposite direction with respect to the user's hand.

  Accordingly, when the first motion pattern m1 sensed by the mobile terminal 100 and the second motion pattern m2 sensed by the wearable device 200 indicate the same motion pattern, the mobile terminal 100 determines the first motion and the first motion It can be determined that the two motions are the same, and the mobile terminal 100 can determine that the mobile terminal 100 user and the wearable device 200 wearer are the same user.

  Accordingly, the mobile terminal 100 according to an embodiment of the present invention compares the first motion pattern of the mobile terminal 100 with the second motion pattern of the wearable device 200, thereby the user of the mobile terminal 100 wears the wearable device. It can be determined whether or not 200 is worn.

  Also, in the mobile terminal 100 according to an embodiment of the present invention, the movement information of the mobile terminal 100 and the movement information of the wearable device 200 are identical, and the wearable device 200 performs a locking mode through a predetermined authentication process. Can be released, the locking mode of the mobile terminal 100 can be released. For example, as shown in FIG. 2, the home screen may be displayed on the display unit of the mobile terminal 100 in the inactive state.

  That is, the user can unlock and use the mobile terminal 100 with motion alone without the need to directly input a code to the mobile terminal 100 in order to release the locking mode of the mobile terminal. .

  FIG. 3A is a flowchart illustrating a method of operating a mobile terminal according to an embodiment of the present invention, and FIG. 3B is a flow chart of a mobile terminal operating wearable device and a mobile terminal according to an embodiment of the present invention. It is drawing referred to the explanation about the method of judging the same thing with movement.

  The mobile terminal 100 according to an exemplary embodiment of the present invention may sense motion of the mobile terminal 100 and may obtain motion information of the mobile terminal (S310).

  For example, the mobile terminal 100 measures changes in the moving direction, speed, and velocity of the mobile terminal 100 using a geomagnetic sensor, a position sensor, an acceleration sensor, a proximity sensor, a gyroscope sensor, etc. It can sense 100 movements.

  The mobile terminal 100 may receive movement information of the wearable device sensed by the wearable device 200 from the wearable device 200 connected to the mobile terminal 100 (S320).

  For example, the wearable device 200 coupled to the mobile terminal 100 may use geomagnetic sensors, position sensors, acceleration sensors, proximity sensors, gyroscope sensors, etc. It is possible to measure and sense the movement of the wearable device 200.

  The mobile terminal 100 may also receive time information related to movement information of the wearable device.

  In addition, the mobile terminal 100 may request the wearable device 200 for movement information, and the wearable device 200 may transmit the movement information of the wearable device 200 sensed by the wearable device 200 to the mobile terminal 100. it can.

  The mobile terminal 100 may determine whether the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same (S330).

  At this time, the meaning that the movement of the mobile terminal 100 is the same as the movement of the wearable device does not mean that the movement is physically completely the same, but the movement information of the mobile terminal 100 (for example, Means that the movement direction, size, speed, etc. of the mobile terminal 100 and movement information of the wearable device 200 (eg, movement direction, size, speed, etc. of the wearable device 200) coincide within a predetermined range Do.

  Also, the meaning that the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same means that the movement information of the mobile terminal and the movement information of the wearable device have a correlation higher than a predetermined reference. means.

The mobile terminal 100 may compare movement information of the mobile terminal 100 sensed at the same time with movement information of the wearable device 200 based on time information related to movement information of the wearable device 200.
Hereinafter, this will be described in detail with reference to FIG. 3B.

  Referring to FIG. 3B, an acceleration value according to time sensed by the wearable device 200 is illustrated as a first graph 310, and the first graph 310 is generated based on the coordinate system 315 of the wearable device 200. It is also a graph.

  Also, an acceleration value according to time sensed by the mobile terminal 100 is shown as a second graph 320, and at this time, the second graph 320 is also a graph generated based on the coordinate system 325 of the mobile terminal 100. .

  Meanwhile, since the coordinate system 315 of the wearable device 200 and the coordinate system 325 of the mobile terminal 100 are different, it is necessary to convert the acceleration value of the wearable device 200 and the acceleration value of the mobile terminal 100 into the same coordinate system. is there.

  For example, the wearable device 200 converts an acceleration value in the coordinate system 315 of the wearable device 200 into an acceleration value in the reference coordinate system 335 using a geomagnetic sensor, and based on the converted acceleration value, a third graph 340 can be generated. Alternatively, the mobile terminal 100 may receive the acceleration value sensed by the acceleration sensor of the wearable device 200 and the geomagnetic value sensed by the geomagnetic sensor, and convert the first graph 310 into a third graph 340. Also, the mobile terminal 100 can convert an acceleration value in the coordinate system 325 of the mobile terminal into an acceleration value in the reference coordinate system 335 using a geomagnetic sensor, and based on the converted acceleration value. The fourth graph 350 can be generated.

  Here, the reference coordinate system 335 means a coordinate system that is applied independently to the type of device. For example, the reference coordinate system may include three axes (X-axis, Y-axis, Z-axis), where the X-axis is a reference axis passing back and forth through the user and the Y-axis is relative to the user The Z-axis is a reference axis passing left and right, and the Z-axis is also a reference passing up and down the user, and the X-axis, the Y-axis and the Z-axis can be perpendicular. However, it is not limited to it.

  The mobile terminal 100 may compare the movement value of the mobile terminal 100 by comparing the acceleration value related to the constant time section 360 of the third graph 340 and the fourth graph 350 shown in the same reference coordinate system 335, and the wearable device 200. It can be determined whether the movement is the same or not.

  For example, when the difference between the acceleration value of the wearable device 200 in the predetermined time interval 360 and the acceleration value of the mobile terminal 100 is equal to or less than a preset value, the mobile terminal 100 may It is possible to determine that there is a correlation between the acceleration value of the mobile terminal) and the movement information of the wearable device (for example, the acceleration value of the wearable device) or more than a predetermined reference. That is, the mobile terminal 100 may determine that the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same.

  In addition, the mobile terminal 100 may use the wearable device 200 according to the type of wearable device 200 (that is, the movement information of the wearable device varies according to the type of wearable device because the wearing state and the position differ according to the type of wearable device). The motion information received from may be scaled up or down at a preset ratio, and the scaled motion information of the wearable device may be compared with the motion information of the mobile terminal to determine the identity of the motion.

  For example, if the wearable device 200 is a smart watch, the position at which the mobile terminal 100 is held and the position at which the smart watch is worn are separated by about 5 cm, and the movement information of the smart watch is In consideration of the distance (5 cm), it can be enlarged at a preset ratio.

  Referring back to FIG. 3A, the mobile terminal 100 unlocks the mobile terminal 100 if the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same or similar. (S340).

  The unlocked state of the mobile terminal 100 is also a state in which the home screen is displayed on the display unit of the mobile terminal 100. Alternatively, when the application menu installed in the mobile terminal 100 is displayed on the display unit of the mobile terminal 100 and the application menu is selected, the selected application can be executed. However, it is not limited to it.

  FIG. 4 is a flow chart illustrating the interaction of a mobile terminal with a wearable device, according to one embodiment of the present invention.

  Referring to FIG. 4, the wearable device 200 according to an embodiment of the present invention is also in a state in which the locking mode is released (S410).

  For example, the state in which the locking mode of wearable device 200 is released is also the state in which the home screen is displayed on the display unit of wearable device 200. Alternatively, an application menu installed in the wearable device 200 is displayed on the display unit of the wearable device 200, and selecting the application menu means that the selected application can be executed.

  The locking mode state of the wearable device 200 is also a state in which the display unit of the wearable device 200 is inactivated. Alternatively, when the wearable device 200 is configured as a watch, only time information is displayed on the display unit. Alternatively, among the applications installed in the wearable device, only some application menus may be displayed, and the applications not displayed may not be able to be executed.

  Meanwhile, the wearable device 200 according to an exemplary embodiment of the present invention may transmit identification information to the mobile terminal 100 existing within a preset distance range (S420).

  For example, when the mobile terminal 100 and the wearable device 200 exist within a preset distance range, the mobile terminal 100 and the wearable device 200 use the short distance communication to mutually communicate the user identification information or the device identification information. Can be sent and received.

  The mobile terminal 100 can recognize, from the mobile terminal 100, the wearable device 200 existing within the preset distance range (S430).

  The mobile terminal 100 may determine whether the recognized wearable device 200 is a wearable device connected to the mobile terminal 100 (S440).

  For example, the mobile terminal 100 compares the identification information received from the wearable device 200 with the identification information of the wearable device 200 registered in the mobile terminal 100, and the recognized wearable device 200 is connected to the mobile terminal 100. It can be determined whether or not the wearable device 200 has been

  If the recognized wearable device is a wearable device connected to the mobile terminal, the mobile terminal 100 may sense movement of the mobile terminal 100 and obtain movement information (S450).

  For example, the mobile terminal 100 can measure the direction, the speed, and the change in the speed of the mobile terminal 100 using a geomagnetic sensor, a position sensor, an acceleration sensor, a proximity sensor, a gyroscope sensor, and the like.

  Step 450 of FIG. 4 (S450) corresponds to step 310 of FIG. 3 (S310), and thus detailed description will be omitted.

  Meanwhile, the wearable device 200 may sense movement of the wearable device 200 and acquire movement information (S455). At this time, the wearable device 200 may sense the movement of the wearable device 200 at the same time as the mobile terminal 100 senses the movement of the mobile terminal 100 (S450).

  For example, the wearable device 200 can measure changes in the direction, speed, and velocity in which the wearable device 200 moves, using a geomagnetic sensor, a position sensor, an acceleration sensor, a proximity sensor, a gyroscope sensor, and the like.

  Meanwhile, the mobile terminal 100 may request the wearable device 200 for movement information of the wearable device 200 (S460).

  The mobile terminal 100 can set a time range and request motion information. The mobile terminal 100 may set start time and end time of motion information, and request motion information of the wearable device 200. For example, if the mobile terminal 100 compares the motion information sensed from the first time to the second time with the motion information of the wearable device 200 in the mobile terminal 100, the wearable device 200 causes the wearable device 200 to The motion information sensed by the wearable device 200 for up to two hours may be requested.

  The wearable device 200 may transmit the movement information of the wearable device 200 sensed by the wearable device 200 to the mobile terminal 100 (S470).

  Also, the mobile terminal 100 and the wearable device 200 can set the time range in advance, and the mobile terminal 100 transmits the start time of the motion information to the wearable device 200, and the wearable device 200 receives the reception Motion information corresponding to a preset time range from the start time may be transmitted to the mobile terminal 100.

  For example, if the preset time range is 100 ms, transmitting the start time information (13:30: 50.10) to the wearable device causes the wearable device to receive the received start time information (13:30: 50). Motion information within 100 ms from 10) can be sensed and transmitted to the mobile terminal.

  Step 470 (S470) of FIG. 4 corresponds to step 320 (S320) of FIG. 3, and thus detailed description will be omitted.

  The mobile terminal 100 compares the movement of the mobile terminal 100 with the movement of the received wearable device 200, and determines whether the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same. It can be determined (S480).

  Step 480 of FIG. 4 (S480) corresponds to step 330 of FIG. 3 (S330), so a detailed description will be omitted.

  The mobile terminal 100 may release the locking mode of the mobile terminal 100 if it is determined that the movement of the mobile terminal 100 and the movement of the wearable device 200 are identical or similar. (S490).

  Step 490 of FIG. 4 (S 490) corresponds to step 340 of FIG. 3 (S 340), so a detailed description will be omitted.

  FIG. 5 is a flowchart illustrating an interaction between a mobile terminal and a wearable device to perform a locking mode release operation of the mobile terminal according to an embodiment of the present invention.

  Steps 510 to 555 of FIG. 5 correspond to steps 410 to 455 of FIG. 4 and thus detailed description thereof will be omitted.

  Referring to FIG. 5, the mobile terminal 100 determines whether the sensed movement of the mobile terminal 100 is the same as the preset movement (eg, the sensed movement of the mobile terminal 100 is: It is possible to determine whether or not there is a correlation between the preset movement and the preset level (S 560).

  For example, the preset movement may be moving the mobile terminal 100 by hand, lifting the mobile terminal 100 laterally, shaking the mobile terminal 100 up and down, moving the mobile terminal 100 to the right, The movement may be moving the mobile terminal 100 to the left, moving the mobile terminal 100 upward, or the like. However, it is not limited to them.

  If the movement of the mobile terminal 100 sensed by the mobile terminal 100 is the same as the preset movement, the mobile terminal 100 causes the wearable device 200 to transmit the motion information of the wearable device 200 sensed by the wearable device 200. A request can be made (S 565).

  Steps 570 to 590 of FIG. 5 correspond to steps 470 to 490 of FIG. 4 and thus the detailed description thereof will be omitted.

  FIG. 6 is a diagram illustrating an example of whether the user enters the locking mode or the locking mode depending on how the user wears the wearable device according to an embodiment.

  Although FIG. 6 illustrates the case where the wearable device 200 is a watch, the present invention is not limited thereto, and the wearable device 200 according to an embodiment of the present invention may be a band, bracelet, glasses, helmet, hat, ring , Footwear, earrings, hair bands, clothes, gloves, thimbles and the like.

  The wearable device 200 according to an embodiment of the present invention is unlocked by the wearing grip. For example, when the wearable device 200 is sensed by the user and the wearable device 200 is worn by the user, the wearable device 200 is also in the locking mode.

  On the other hand, when the wearable device 200 is not worn by the user, the wearable device 200 is released from the locking mode.

  For example, as illustrated in FIG. 6, when the wearable device 200 is configured as a watch, the wearing state can be sensed by the connection of the watch buckle. At this time, the wearable device 200 senses the connection state of the watch buckle using a pressure sensor or the like, and can recognize that the user wears the watch buckle when the watch buckle is connected. On the other hand, when the watch buckle is not coupled, it can be recognized that the user is not wearing it.

  Alternatively, the wearable device 200 can sense the wearing state of the wearable device 200 using a ground sensor. For example, as illustrated in FIG. 6, when the wearable device 200 is configured as a watch, the watchband includes a ground sensor, and the wearable device 200 is worn by the user if the watchband touches the user's wrist. It can be recognized that the

  Also, if the wearable device 200 is configured with glasses, if the user wears the glasses and the glasses touch the user's ear or nose, including a ground sensor on the end of the glasses temple or on the nose pad, It can be recognized that the wearable device is worn by the user.

  Also, when the wearable device 200 is configured of a ring, if the user wears the ring and touches the finger including the ground sensor in the inner part of the ring, the wearable device 200 is in a state worn by the user Can be recognized.

  For example, as illustrated in FIG. 6 (a), if the user does not wear the wearable device 200 (eg, a watch), the wearable device 200 can operate in a locking mode. Also, as illustrated in FIG. 6B, when the user wears the wearable device 200, the wearable device 200 is released from the locking mode. The locking mode of the wearable device 200 is similar to the locking mode of the mobile terminal 100, and the locking mode release is similar to the locking mode release state of the mobile terminal 100, but is not limited thereto.

  Referring to FIG. 6A, when the wearable device 200 operates in the locking mode, only simple information such as time and weather is displayed on the display unit of the wearable device 200.

  On the other hand, referring to FIG. 6B, when the wearable device 200 is released from the locking mode, the home screen is displayed on the display unit of the wearable device 200. Alternatively, an application menu installed in the wearable device 200 is displayed on the display unit of the wearable device 200, and when the application menu is selected, the selected application is executed. However, it is not limited to it.

  FIG. 7 is a view illustrating an example of displaying a motion cancellation function notification message on a mobile terminal according to an embodiment of the present invention.

  Referring to FIG. 7, when it is determined that the wearable device 200 connected to the mobile terminal 100 is within a preset range, the mobile terminal 100 according to an exemplary embodiment of the present invention receives a motion cancellation function notification message. Can be displayed.

  For example, the mobile terminal 100 recognizes a wearable device existing in the vicinity using near-field communication and the like, and determines whether the recognized wearable device is a device connected to the mobile terminal. It can be judged. At this time, if the recognized wearable device is a device connected to the mobile terminal and the locking mode of the wearable device 200 is released, the mobile terminal 100 may display a motion release function notification message 720. it can.

  The motion release function notification message 720 indicates that the locking mode of the mobile terminal 100 is released when the same motion is sensed in the mobile terminal 100 and the wearable device 200 connected to the mobile terminal. It is also.

  Alternatively, the motion release function notification message 720 may be a message indicating that the mobile terminal is released from the locking mode when the preset motion is displayed and the preset motion is performed.

  For example, as shown in FIG. 7, the motion cancellation function notification message 720 may be displayed as text or image in the pop-up window, but is not limited thereto, and may also be output as sound. Accordingly, when the user wears the wearable device 200 connected to the mobile terminal 100 and the mobile terminal 100 together, the locking mode of the mobile terminal 100 is released if the same movement is sensed. You can easily understand that you can do it.

  FIGS. 8A through 9B illustrate an operation of releasing a locking mode of a mobile terminal when the mobile terminal user and the wearable device wearer are the same according to an exemplary embodiment of the present invention.

  FIGS. 8A to 9B show a state in which the user of the mobile terminal 100 picks up the mobile terminal 100 and wears the wearable device 200 on the wrist. 8A-9B illustrate that the wearable device 200 is configured as a watch that can be worn on the wrist, but is not limited thereto.

  The mobile terminal 100 according to an embodiment of the present invention may sense movement of the mobile terminal 100, and the wearable device 200 according to an embodiment of the present invention may sense movement of the wearable device 200.

  For example, as illustrated in FIGS. 8A, 8B, 9A, and 9B, when the user lifts the mobile terminal 100 by hand (the hand holding the mobile terminal 100 is fixed in the counterclockwise direction). In the case of angular rotation), the mobile terminal 100 senses the direction in which the mobile terminal 100 moved, the movement distance of the mobile terminal 100, the rotation angle of the mobile terminal 100, the distance to the wearable device 200 before and after movement, etc. be able to.

  Further, when the wearable device 200 wearer raises the hand wearing the wearable device 200 (when rotating the wrist wearing the wearable device 200 by a certain angle in a counterclockwise direction), the wearable device 200 moves the wearable device 200 The movement direction of the wearable device 200, the rotation angle of the wearable device 200, the distance to the mobile terminal 100 before and after movement, and the like can be sensed. Also, the wearable device 200 may transmit the sensed movement information of the wearable device 200 to the mobile terminal 100.

  The mobile terminal 100 may compare movement information of the mobile terminal 100 with movement information of the wearable device 200. At this time, the mobile terminal 100 may transmit motion information of the mobile terminal 100 (e.g., a direction in which the mobile terminal 100 moved, a distance moved, an angle moved, a speed, a change in speed, and the wearable device 200 before and after movement) Distance, etc.) and movement information of the wearable device 200 (eg, movement direction of the wearable device 200, movement distance, movement angle, speed, change in speed, distance to the mobile terminal 100 before and after movement, etc.) are predetermined If they match within the range, it can be determined that the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same.

  Meanwhile, when the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same and the locking mode of the wearable device 200 is released, the mobile terminal 100 displays the home screen 820 on the display unit of the mobile terminal 100. Can be displayed.

  For example, as illustrated in FIG. 8A, the display unit of the mobile terminal 100 is also in the inactive state 810. For example, the inactive state 810 indicates that the display unit of the mobile terminal 100 is turned off. On the other hand, the display unit of the wearable device 200 is also turned on (activated). In the inactive state, when the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same in the inactive state and the locking mode of the wearable device 200 is released, the display unit of the mobile terminal 100 is displayed. , Home screen 820 can be displayed.

  The home screen 820 displays an icon corresponding to a set application, or a set image. However, it is not limited to them.

  Alternatively, as illustrated in FIG. 8B, when the display unit of the mobile terminal 100 and the display unit of the wearable device 200 are both turned off (in an inactive state), the movement of the mobile terminal 100 and the wearable device 200. The mobile terminal 100 may display the home screen 820 on the display unit of the mobile terminal 100 if the locking mode of the wearable device 200 is released.

  Alternatively, as illustrated in FIG. 9A, the mobile terminal 100 may display a locking mode screen 910 on the display unit. The locking mode screen 910 may include a screen on which a code for releasing the locking mode can be input. For example, the encryption for releasing the locking mode is also a line pattern connecting a plurality of buttons, and is also an encryption composed of numerals and characters. However, it is not limited to them. The display unit of the wearable device 200 is also in the turn-on state (activated state).

  When the locking mode screen 910 is displayed, the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same, and the locking mode of the wearable device 200 is released. The home screen 920 can be displayed on the display unit of the machine 100.

  Alternatively, as illustrated in FIG. 9B, the locking mode screen 910 is displayed on the mobile terminal 100, and the display unit of the wearable device 200 moves in the turn-off state (inactive state). If the movement of the wearable device 200 is the same and the locking mode of the wearable device 200 is released, the mobile terminal 100 can display the home screen 820 on the display unit of the mobile terminal 100.

  The mobile terminal 100 according to an embodiment of the present invention may lock the mobile terminal 100 if it recognizes that the locking mode of the wearable device 200 is released and the user of the mobile terminal 100 wears the wearable device 200. The locking mode can be released without requiring a separate encryption input for releasing the mode.

  Accordingly, when the user wears the wearable device 200 on the wrist and uses the mobile terminal 100 with the same hand, if the locking mode of the wearable device 200 is released, In order to release the locking mode, it is possible to release the locking mode of the mobile terminal 100 only by movement without passing through a predetermined authentication procedure (for example, password or pattern input).

  FIG. 10 is a flowchart showing a method of performing user authentication on a mobile terminal when user authentication is performed on a wearable device according to an embodiment of the present invention, and FIG. 11 illustrates the method of FIG. It is a drawing for.

  The mobile terminal 100 according to an embodiment of the present invention has the same movement of the mobile terminal sensed by the mobile terminal 100 and the movement of the wearable device sensed by the wearable device 200 connected to the mobile terminal. In some cases, if user authentication has already been performed in the wearable device 200, user authentication is performed in the mobile terminal 100 without having to input user authentication information. Details will be described below.

  Referring to FIG. 10, the wearable device 200 can perform user authentication (S1010).

  The wearable device 200 user can input user authentication information (for example, a user ID, a password, and the like) and perform user authentication on a network, a system, and the like. User authentication means being authenticated as a valid user who can access a network, a system, etc.

  For example, the wearable device 200 user can log in to a site that provides a service or the like using the user authentication information.

  Referring again to FIG. 10, the wearable device 200 can transmit identification information to the mobile terminal 100 existing within the preset distance range (S1020).

  The mobile terminal 100 can recognize, from the mobile terminal 100, the wearable device 200 existing within the preset distance range (S1030).

  Also, the mobile terminal 100 may determine whether the recognized wearable device is a wearable device connected to the mobile terminal (S1040).

  On the other hand, the flowchart of FIG. 10 illustrates that the step (S1010) in which the wearable device 200 displays the web page precedes the steps 1020 (S1020) to 1040 (S1040), but is limited thereto Instead, step 1010 (S1010) is also performed between steps 1020 (S1020) to 1040 (S1040), and is also performed between step 1040 (S1040) and 1050 (S1050).

  The mobile terminal 100 may sense movement of the mobile terminal 100 and acquire movement information of the mobile terminal 100 if the recognized wearable device 200 is a wearable device connected to the mobile terminal 100. It is possible (S1050).

  Meanwhile, the wearable device 200 can sense the movement of the wearable device 200 and acquire movement information of the wearable device 200 (S1055). At this time, the wearable device 200 may sense the movement of the wearable device 200 at the same time as the mobile terminal 100 senses the movement of the mobile terminal 100 (S1050).

  The mobile terminal 100 may request the wearable device 200 for movement information of the wearable device 200 (S1060).

  The wearable device 200 may transmit the movement information of the wearable device 200 sensed by the wearable device 200 to the mobile terminal 100 (S1065).

  The mobile terminal 100 may determine whether the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same (S 1070).

  Since steps 1020 to 1070 of FIG. 10 correspond to steps 420 to 480 of FIG. 4 in FIG.

  If it is determined that the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same, the mobile terminal 100 can receive user authentication information from the wearable device 200 (S1080).

  The mobile terminal 100 can access the network, system, etc. authenticated by the wearable device 200 based on the received user authentication information (S1090).

  For example, referring to FIG. 11, the wearable device 200 has already performed user authentication on a social network service (SNS) page and logged in, and the mobile terminal 100 performs user authentication for logging in to the SNS page. A screen 1110 for inputting information can be displayed. At this time, if the movement of the mobile terminal and the movement of the wearable device are the same, the mobile terminal can log in to the SNS page and display the page 1120.

  Thereby, if the user is already authenticated to the site in the wearable device 200, a motion (for example, a motion for holding and lifting the mobile terminal, etc.) without the need to further input user authentication information to the mobile terminal 100. You can only do user authentication on your site.

  12 is a flowchart showing a method of displaying a web page displayed on a wearable device on a mobile terminal according to an embodiment of the present invention, and FIG. 13 is a view for explaining a method of FIG. .

  The mobile terminal 100 according to an embodiment of the present invention has the same movement of the mobile terminal sensed by the mobile terminal 100 and the movement of the wearable device sensed by the wearable device 200 connected to the mobile terminal. In some cases, the web page displayed on the wearable device 200 can be displayed on the mobile terminal 100. Details will be described below.

  A web application capable of web browsing is installed in the mobile terminal 100 and the wearable device 200 according to an embodiment of the present invention.

  Referring to FIG. 12, the wearable device 200 can display a web page (S1210).

  For example, the user can use the wearable device 200 to execute a web application, and when the web application is executed, the display unit of the wearable device 200 displays a web page, as illustrated in FIG. 13. 1310 is displayed. The web page 1310 is a page for displaying a web document on the Internet, and various contents are displayed.

  Referring again to FIG. 12, the wearable device 200 can transmit identification information to the mobile terminal 100 existing within the preset distance range (S1220).

  The mobile terminal 100 can recognize, from the mobile terminal 100, the wearable device 200 existing within the preset distance range (S1230).

  Also, the mobile terminal 100 may determine whether the recognized wearable device is a wearable device coupled to the mobile terminal (S1240).

  On the other hand, the flowchart of FIG. 12 illustrates that the step (S1210) in which the wearable device 200 displays the web page precedes the steps 1220 (S1220) to 1240 (S1240), but is limited thereto Instead, step 1210 (S1210) is performed between steps 1220 (S1220) and 1240 (S1240), and is also performed between steps 1240 (S1240) and 1250 (S1250).

  The mobile terminal 100 may sense movement of the mobile terminal 100 and acquire movement information of the mobile terminal 100 if the recognized wearable device 200 is a wearable device connected to the mobile terminal 100. Yes (S1250).

  Meanwhile, the wearable device 200 can sense the movement of the wearable device 200 and obtain movement information of the wearable device 200 (S1255). At this time, the wearable device 200 may sense the movement of the wearable device 200 at the same time as the mobile terminal 100 senses the movement of the mobile terminal 100 (S1250).

  The mobile terminal 100 may request the wearable device 200 for movement information of the wearable device 200 (S1260).

  The wearable device 200 may transmit the movement information of the wearable device 200 sensed by the wearable device 200 to the mobile terminal 100 (S1265).

  The mobile terminal 100 may determine whether the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same (S1270).

  Since steps 1220 (S1230) to 1270 (S1270) of FIG. 12 correspond to steps 420 (S420) to 480 (S480) of FIG. 4, the specific description will be omitted.

  The mobile terminal 100 receives web page information being displayed on the wearable device 200 from the wearable device 200 when it is determined that the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same. Can be done (S1280).

  For example, the mobile terminal 100 can receive web page address information being displayed on the wearable device 200.

  The mobile terminal 100 can display the same web page as the web page displayed on the display unit of the wearable device 200 on the display unit of the mobile terminal 100 based on the received web page information (S1290).

  For example, referring to FIG. 13, the mobile terminal 100 in the inactive state 1320 executes the web application based on the received web page information and is identical to the web page displayed on the display unit of the wearable device 200. A web page 1330 can be displayed.

  At this time, the web page displayed on the mobile terminal 100 and the web page displayed on the wearable device 200 are also web pages displayed differently depending on the type of device. For example, the mobile terminal 100 may display a web page of the mobile terminal 100 version, and the wearable device 200 may display a web page of the wearable device 200 version.

  On the other hand, the wearable device 200 can switch the display unit to the inactive state or can display a screen including information (for example, a clock, weather, etc.) on the display unit. However, it is not limited to them.

  Thereby, when the user is browsing web using wearable device 200 and browsing web using mobile terminal 100, the user does not need to further input a web page address to mobile terminal 100, The web page displayed on the wearable device 200 can be displayed on the mobile terminal 100 only by a motion (for example, a motion of holding and lifting the mobile terminal).

  Also, the mobile terminal 100 may receive the web browsing history data performed by the wearable device 200 together. Accordingly, the mobile terminal 100 not only displays the same web page as the web page currently displayed on the wearable device 200, but also performs back button input (input for moving to the previous page of the currently displayed web page). When receiving, in the wearable device 200, the web page displayed before the current page is displayed can be displayed on the mobile terminal 100.

  FIG. 14 is a flowchart illustrating a method of performing call connection by a mobile terminal when a wearable device receives a call connection request according to an embodiment of the present invention, and FIG. 15 is a view for explaining the method of FIG. Of the

  The mobile terminal 100 according to an embodiment of the present invention has the same movement of the mobile terminal sensed by the mobile terminal 100 and the movement of the wearable device sensed by the wearable device 200 connected to the mobile terminal. In some cases, in response to the call connection request received by the wearable device 200, a call can be made using the mobile terminal 100. Details will be described below.

  The mobile terminal 100 and the wearable device 200 according to an embodiment of the present invention have a call application installed that can make a call with an external device.

  Referring to FIG. 14, the wearable device may receive a call connection request from an external device (S1410).

  For example, when the wearable device 200 receives a call connection request, as shown in FIG. 15, a call connection request screen 1510 is displayed.

  At this time, the call connection request screen 1510 displays the identification information of the other device that has requested the call connection. The identification information of the other device may include the other device's telephone number, the other user's first and last name, a nickname, and the like. Also, the call connection request screen may include a call connection button and a call rejection button.

  Meanwhile, when the wearable device 200 receives the call connection request, the mobile terminal 100 may also receive the call connection request from the same external device. However, it is not limited to it.

  Referring again to FIG. 14, the wearable device 200 can transmit identification information to the mobile terminal 100 existing within the preset distance range (S1420).

  The mobile terminal 100 can recognize, from the mobile terminal 100, the wearable device 200 existing within the preset distance range (S1430).

  In addition, the mobile terminal 100 may determine whether the recognized wearable device is a wearable device connected to the mobile terminal (S1440).

  Meanwhile, the flowchart of FIG. 14 illustrates that the step (S1410) in which the wearable device 200 receives the call connection request precedes the steps 1420 (S1420) to 1440 (S1440), but is limited thereto. Alternatively, step 1410 (S 1410) may be performed between steps 1420 (S 1420) to 1440 (S 1440), and may also be performed between step 1440 (S 1440) and step 1450 (S 1450).

  The mobile terminal 100 may sense movement of the mobile terminal 100 and acquire movement information of the mobile terminal 100 if the recognized wearable device 200 is a wearable device connected to the mobile terminal 100. It can do (S1450).

  Meanwhile, the wearable device 200 may sense the movement of the wearable device 200 and acquire movement information of the wearable device 200 (S1455). At this time, the wearable device 200 may sense the movement of the wearable device 200 at the same time as the mobile terminal 100 senses the movement of the mobile terminal 100 (S1450).

  The mobile terminal 100 may request the wearable device 200 for movement information of the wearable device 200 (S1460).

  The wearable device 200 may transmit the movement information of the wearable device 200 sensed by the wearable device 200 to the mobile terminal 100 (S1465).

  The mobile terminal 100 may determine whether the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same (S1470).

  Since steps 1420 (S1420) to 1470 (S1470) of FIG. 14 correspond to steps 420 (S420) to 480 (S480) of FIG. 4, the specific description will be omitted.

  If the mobile terminal 100 determines that the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same, the wearable device 200 transmits the call connection information corresponding to the received call connection request to the mobile terminal. It can be transmitted to the machine 100 (S1480).

  For example, identification information and the like of the other party device which has requested the call connection to the wearable device 200 can be received, and as shown in FIG. 15, the call connection request screen 1530 can be displayed.

  The mobile terminal 100 can perform call connection with the other device that has requested the wear connection to the wearable device 200 based on the received call connection information (S1490).

  As a result, when the call connection request screen is displayed on the wearable device 200, the user does not have to input the call connection button separately on the mobile terminal, but only by the motion (for example, the motion of holding the mobile terminal and lifting it). Call connection can be performed.

  16 is a flowchart illustrating a method of making a call with an external device using a mobile terminal while making a call with an external device using a wearable device according to an embodiment of the present invention; FIG. 17 is a drawing for explaining the method of FIG.

  The mobile terminal 100 according to an embodiment of the present invention has the same movement of the mobile terminal sensed by the mobile terminal 100 and the movement of the wearable device sensed by the wearable device 200 connected to the mobile terminal. If there is, the mobile terminal 100 can make a call made with the wearable device 200. Details will be described below.

  Referring to FIG. 16, the wearable device 200 may receive a call connection request from an external device (S1610).

  For example, when the wearable device receives a call connection request, as shown in FIG. 17, the call connection request screen 1710 is displayed, and the user selects the call connection button included in the call connection request screen 1710. , And call connection can be performed with an external device (S1615).

  Referring back to FIG. 16, the wearable device 200 can transmit identification information to the mobile terminal 100 existing within the preset distance range (S1620).

  The mobile terminal 100 can recognize, from the mobile terminal 100, the wearable device 200 existing within the preset distance range (S1630).

  In addition, the mobile terminal 100 may determine whether the recognized wearable device is a wearable device coupled to the mobile terminal (S1640).

  On the other hand, the flowchart of FIG. 16 illustrates that the step of displaying the web page by the wearable device 200 (S1610) precedes the steps of 1620 (S1620) to 1640 (S1640). Alternatively, step 1610 (S1610) may be performed between steps 1620 (S1620) to 1640 (S1640), and between step 1640 (S1640) and 1650 (S1650).

  The mobile terminal 100 may sense movement of the mobile terminal 100 and acquire movement information of the mobile terminal 100 if the recognized wearable device 200 is a wearable device connected to the mobile terminal 100. It can do (S1650).

  Meanwhile, the wearable device 200 may sense the movement of the wearable device 200 and acquire movement information of the wearable device 200 (S1655). At this time, the wearable device 200 may sense the movement of the wearable device 200 at the same time as the mobile terminal 100 senses the movement of the mobile terminal 100 (S1650).

  The mobile terminal 100 may request the wearable device 200 for movement information of the wearable device 200 (S1660).

  The wearable device 200 may transmit the movement information of the wearable device 200 sensed by the wearable device 200 to the mobile terminal 100 (S1665).

  The mobile terminal 100 may determine whether the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same (S1670).

  Since steps 1620 (S1630) to 1670 (S1670) of FIG. 16 correspond to steps 420 (S420) to 480 (S480) of FIG. 4, the specific description will be omitted.

  If it is determined that the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same, the wearable device 200 may transmit call connection information to the mobile terminal 100 (S1680).

  For example, identification information or the like of a partner device in a call with the wearable device 200 can be received.

  The mobile terminal 100 can perform call connection with the other device in communication with the wearable device 200 based on the received call connection information (S1690). At this time, if the call connection between the mobile terminal and the other device is established, the call connection between the wearable device 200 and the other device ends. For example, the mobile terminal 100 transmits call connection information to a base station or communication provider server, and the base station or communication server communicates with the wearable device 200 based on the received call connection information. Call connection (e.g., routing) between the other party's device and the mobile terminal 100.

  Alternatively, the mobile terminal 100 is used as a call interface while maintaining call connection between the wearable device 200 and the other device. For example, the wearable device 200 can transmit the voice signal received from the other device to the mobile terminal 100 via the base station or the communication company server. The mobile terminal 100 can output an audio signal received from the wearable device 200, and can transmit an audio signal input to the mobile terminal 100 to the wearable device 200. The wearable device 200 can transmit an audio signal to the other device via the base station or the carrier server.

  Thus, when the user uses the wearable device 200 to make a call using the mobile terminal 100 instead of the wearable device 200 while talking with the other party (user of the external device), the user The call connection with the external device can be performed only by the motion (for example, the motion of holding and lifting the mobile terminal). Therefore, the user does not have to perform a call operation to the other party who is talking on the wearable device 200 and to connect the call using the mobile terminal.

  FIG. 18 is a flowchart illustrating a method of executing an application related to a notification message in a mobile terminal when the wearable device receives the notification message according to an embodiment of the present invention, and FIGS. 18 is a drawing for explaining 18 methods.

  The mobile terminal 100 according to an embodiment of the present invention has the same movement of the mobile terminal sensed by the mobile terminal 100 and the movement of the wearable device sensed by the wearable device 200 connected to the mobile terminal. In some cases, the wearable device 200 can be made to execute an application associated with the received notification message. Details will be described below.

  Referring to FIG. 18, the wearable device may display a notification message (S1810).

  For example, as illustrated in FIG. 19A, the wearable device 200 can receive the game application related notification message 1910 and can display it on the display unit. Alternatively, as illustrated in FIG. 20A, the SNS application related notification message 2010 can be received and displayed on the display unit. However, the present invention is not limited thereto, and the wearable device 200 can receive and display various application related notification messages. Notification messages are also displayed in pop-up windows.

  Referring back to FIG. 18, the wearable device 200 can transmit identification information to the mobile terminal 100 existing within the preset distance range (S1820).

  The mobile terminal 100 can recognize, from the mobile terminal 100, the wearable device 200 existing within the preset distance range (S1830).

  Also, the mobile terminal 100 may determine whether the recognized wearable device is a wearable device connected to the mobile terminal (S1840).

  Meanwhile, the flowchart of FIG. 18 illustrates that the step (S1810) in which the wearable device 200 receives the call connection request precedes the steps 1820 (S1820) to 1840 (S1840), but is limited thereto Instead, step 1810 (S1810) is performed between steps 1820 (S1820) and 1840 (S1840), and is also performed between steps 1840 (S1840) and 1850 (S1850).

  The mobile terminal 100 may sense movement of the mobile terminal 100 and acquire movement information of the mobile terminal 100 if the recognized wearable device 200 is a wearable device connected to the mobile terminal 100. It can do (S1850).

  Meanwhile, the wearable device 200 may sense the movement of the wearable device 200 and acquire movement information of the wearable device 200 (S1855). At this time, the wearable device 200 may sense the movement of the wearable device 200 at the same time as the mobile terminal 100 senses the movement of the mobile terminal 100 (S1850).

  The mobile terminal 100 may request the wearable device 200 for movement information of the wearable device 200 (S1860).

  The wearable device 200 may transmit the movement information of the wearable device 200 sensed by the wearable device 200 to the mobile terminal 100 (S1865).

  The mobile terminal 100 may determine whether the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same (S1870).

  Since steps 1820 (S1820) to 1870 (S1870) of FIG. 18 correspond to steps 420 (S420) to 480 (S480) of FIG. 4, the detailed description will be omitted.

  If it is determined that the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same, the wearable device 200 may transmit application information related to the notification message to the mobile terminal 100 (S1880). .

  For example, the application information related to the notification message may include an application name, an application type, application version information, application execution information (information for executing the application), and the like.

  The mobile terminal 100 may execute an application corresponding to the notification message displayed on the wearable device 200 based on the notification message related application information received from the wearable device 200 (S1890).

  At this time, the notification message related application displayed on the wearable device 200 is also an application previously installed on the mobile terminal 100.

  For example, as illustrated in FIG. 19, the mobile terminal 100 may execute a game application related to the game notification message 1910 displayed on the wearable device 200.

  As a result, when the user causes the mobile terminal 100 to execute an application related to the notification message displayed on the wearable device 200, a motion (for example, not necessary to cause the mobile terminal 100 to select and execute the application) An application related to a notification message displayed on the wearable device 200 can be executed on the mobile terminal 100 only by a motion such as lifting the mobile terminal in hand and lifting it.

  FIG. 20 is a view illustrating a method of executing an SNS application on a mobile terminal when an SNS application related notification message is displayed on a wearable device according to an embodiment of the present invention.

  As illustrated in FIG. 20, the wearable device 200 can receive and display the SNS application related notification message 2010.

  For example, a message indicating that a social friend included in the same social group as the wearable device 200 user uploaded a new photo to the SNS is displayed.

  If it is determined that the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same, as described in steps 1850 (S1850) to 1870 (S1870) of FIG. The mobile terminal 100 may receive the SNS application information and the SNS notification message information from the wearable device 200.

  The SNS application information may include the SNS application name, SNS application type, SNS application version information, SNS application execution information (information for executing the SNS application), etc. The SNS notification message information is displayed on the wearable device 200 Social page information related to the notification message 2010 (for example, if the content of the social friend page is updated is included in the notification message, the page address information of the social friend) may be included.

  The mobile terminal 100 may execute an application 2030 related to the SNS notification message 2010 displayed on the wearable device 200 based on the received SNS application information and SNS notification message information.

  For example, as illustrated in FIG. 20, the notification message 2010 displayed on the wearable device 200 is a message indicating that a social friend included in the same social group as the wearable device user has uploaded a new photo to the SNS. In some cases, as illustrated in FIG. 20, the mobile terminal 100 can execute the SNS application 2030 to display a page of the social friend or a page including a photo uploaded by the social friend. However, it is not limited to it.

  Accordingly, when the user tries to confirm the content related to the SNS notification message 2010 displayed on the wearable device 200 with the mobile terminal 100, the motion without the need for the mobile terminal 100 to select and execute the SNS application. The content relating to the notification message 2010 displayed on the wearable device 200 can be confirmed on the mobile terminal 100 only by a motion (for example, a hand lifting the mobile terminal in hand and the like).

  FIG. 21 is a flowchart illustrating a method of displaying a received message at a mobile terminal when a wearable device receives a message according to an embodiment of the present invention, and FIG. 22 illustrates the method of FIG. It is a drawing for.

  The mobile terminal 100 according to an embodiment of the present invention has the same movement of the mobile terminal sensed by the mobile terminal 100 and the movement of the wearable device sensed by the wearable device 200 connected to the mobile terminal. In one case, the wearable device 200 can display the received message. Details will be described below.

  Referring to FIG. 21, the wearable device 200 may receive a message (S2110).

  The message may include a text message received from an external device, an instant message, a chat message, an email, and the like. Also, when the wearable device 200 receives a message, it can output a notification. For example, as illustrated in FIG. 22, a notification message 2210 for message reception can be displayed on the display unit. Or, an alarm or vibration can be output. However, it is not limited to them.

  Referring back to FIG. 21, the wearable device 200 can transmit identification information to the mobile terminal 100 existing within the preset distance range (S2120).

  The mobile terminal 100 can recognize, from the mobile terminal 100, the wearable device 200 existing within the preset distance range (S2130).

  In addition, the mobile terminal 100 may determine whether the recognized wearable device is a wearable device coupled to the mobile terminal (S2140).

  Meanwhile, the flowchart of FIG. 21 illustrates that the step (S2110) in which the wearable device 200 receives a message precedes the steps 2120 (S2120) to 2140 (S2140), but is not limited thereto. Step 2110 (S2110) is also performed between steps 2120 (S2120) and 2140 (S2140), and is also performed between steps 2140 (S2140) and 2150 (S2150).

  The mobile terminal 100 may sense movement of the mobile terminal 100 and acquire movement information of the mobile terminal 100 if the recognized wearable device 200 is a wearable device connected to the mobile terminal 100. It can do (S2150).

  Meanwhile, the wearable device 200 can sense the movement of the wearable device 200 and acquire movement information of the wearable device 200 (S2155). At this time, the wearable device 200 may sense the movement of the wearable device 200 at the same time as the mobile terminal 100 senses the movement of the mobile terminal 100 (S2150).

  The mobile terminal 100 may request the wearable device 200 for movement information of the wearable device 200 (S2160).

  The wearable device 200 may transmit the motion information of the wearable device 200 sensed by the wearable device 200 to the mobile terminal 100 (S2165).

  The mobile terminal 100 may determine whether the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same (S2170).

  The steps 2120 (S2130) to 2170 (S2170) of FIG. 21 correspond to the steps 420 (S420) to 480 (S480) of FIG.

  If it is determined that the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same, the wearable device 200 may transmit message information to the mobile terminal 100 (S2180).

  The mobile terminal 100 can display the message received by the wearable device 200 based on the message information received from the wearable device 200 (S2190).

  Referring to FIG. 22, the message-related application received by the wearable device 200 is also a message application 2230 pre-installed on the mobile terminal 100, and the mobile terminal 100 executes the message application 2230. The received message can be displayed.

  Thereby, when the user tries to confirm the message received by the wearable device 200 with the mobile terminal 100, the user can easily execute simple motion (e.g., move) without having to select and execute the message application in the mobile terminal 100. It is possible to confirm the message received by the wearable device 200 only by a motion such as lifting the terminal by hand.

  FIG. 23 is a flowchart showing a method of reproducing on a mobile terminal a content being reproduced by a wearable device according to an embodiment of the present invention, and FIG. 24 is a view for explaining the method of FIG. is there.

  The mobile terminal 100 according to an embodiment of the present invention has the same movement of the mobile terminal sensed by the mobile terminal 100 and the movement of the wearable device sensed by the wearable device 200 connected to the mobile terminal. In some cases, the content being reproduced by the wearable device 200 can be continuously reproduced by the mobile terminal 100. Details will be described below.

  Referring to FIG. 23, the wearable device 200 can reproduce content (S2310).

  The wearable device 200 can play back content stored in the wearable device 200 or can play back content uploaded to an external server such as a web server or an SNS server. At this time, the content may include text, images, audio, moving pictures, and the like.

  For example, as illustrated in FIG. 24, the wearable device 200 can download and play the moving image 2410 stored in the wearable device 200 or the moving image stored in the web server.

  Referring again to FIG. 23, the wearable device 200 can transmit identification information to the mobile terminal 100 existing within the preset distance range (S2320).

  The mobile terminal 100 can recognize, from the mobile terminal 100, the wearable device 200 existing within the preset distance range (S2330).

  Also, the mobile terminal 100 may determine whether the recognized wearable device is a wearable device connected to the mobile terminal (S2340).

  On the other hand, the flowchart of FIG. 23 illustrates that the step of displaying the web page by the wearable device 200 (S2310) precedes the steps of 2320 (S2320) to 2340 (S2340). Alternatively, step 2310 (S2310) may be performed between steps 2320 (S2320) and 2340 (S2340), and between step 2340 (S2340) and 2350 (S2350).

  The mobile terminal 100 may sense movement of the mobile terminal 100 and acquire movement information of the mobile terminal 100 if the recognized wearable device 200 is a wearable device connected to the mobile terminal 100. It can do (S2350).

  Meanwhile, the wearable device 200 can sense the movement of the wearable device 200 and acquire movement information of the wearable device 200 (S2355). At this time, the wearable device 200 may sense the movement of the wearable device 200 at the same time as the mobile terminal 100 senses the movement of the mobile terminal 100 (S2350).

  The mobile terminal 100 may request the wearable device 200 for movement information of the wearable device 200 (S2360).

  The wearable device 200 may transmit the movement information of the wearable device 200 sensed by the wearable device 200 to the mobile terminal 100 (S2365).

  The mobile terminal 100 may determine whether the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same (S2370).

  Since steps 2320 (S2330) to 2370 (S2370) of FIG. 23 correspond to steps 420 (S420) to 480 (S480) of FIG. 4, the specific description will be omitted.

  If it is determined that the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same, the wearable device 200 can receive the content reproduction information of the content being reproduced by the mobile terminal 100 ( S2380).

  At this time, the content reproduction information is information for reproducing the content, and the content type, content name, content reproduction program information, content reproduction program version information, capacity information, content reproduction time information, position where the content is stored Information (for example, storage location information on the mobile terminal 100, server address information where content is stored, etc.) may be included.

  The mobile terminal 100 can subsequently reproduce the content being reproduced by the wearable device 200 based on the received content reproduction information (S2390).

  For example, as illustrated in FIG. 24, the mobile terminal 100 can play back, on the mobile terminal 100, the same moving image 2430 as the moving image 2410 that was being reproduced by the wearable device 200. At this time, based on the content reproduction time information (for example, moving image reproduction time information) received from the wearable device 200, the mobile terminal 100 can continuously reproduce the part reproduced from the wearable device 200 last time.

  Accordingly, when the user views the moving image using the wearable device 200 and then desires to view the moving image using the mobile terminal 100, the mobile terminal 100 searches for the moving image and causes the video to be further reproduced. It is possible to cause the mobile terminal to play the moving image that was being played on the wearable device only by the motion (for example, the motion of handing and lifting the mobile terminal) without necessity.

  FIG. 25 is a view illustrating a method of displaying content displayed on a wearable device on a mobile terminal according to an embodiment of the present invention.

  As illustrated in FIG. 25, the wearable device 200 can display an image.

  If it is determined that the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same as described in steps 2350 (S2350) to 2370 (S2370) of FIG. The mobile terminal 100 may receive, from the wearable device 200, image information being displayed on the wearable device 200.

  The mobile terminal 100 may display an image being displayed on the wearable device 200 based on the received image information. For example, as illustrated in FIG. 25, the image 2510 being displayed by the wearable device 200 may be enlarged, and the enlarged image 2530 may be displayed on the mobile terminal 100.

  Thereby, if the user desires that the image displayed on the wearable device 200 be displayed on the mobile terminal 100, the motion (eg, The image displayed on the wearable device 200 can be enlarged and displayed on the display unit of the mobile terminal 100 only by the motion (hand-lifting) of the mobile terminal.

  FIG. 26 is a diagram illustrating a method of transmitting wearable device data to a mobile terminal according to an embodiment of the present invention.

  The wearable device 200 according to an embodiment of the present invention may receive user input to select text, images, movies, audio, etc. to be transmitted to the mobile terminal 100.

  At this time, the text, image, video, audio, etc. transmitted to the mobile terminal 100 may be text, image, video, audio, etc. stored in the wearable device 200, and an image captured using the wearable device 200 or , And an audio file recorded using the wearable device 200.

  For example, as illustrated in FIG. 26, the wearable device 200 user can select the image 2610 to be transmitted to the mobile terminal 100, and the wearable device 200 displays the selected image 2610 on the display unit. be able to.

  When it is determined that the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same, the mobile terminal 100 transmits data of the wearable device to the mobile terminal.

  The mobile terminal 100 may determine the position to save the received data based on the type of the received data. For example, as shown in FIG. 26, when receiving the image 2610 data, the mobile terminal 100 may store the received image 2630 in a photo application (eg, a gallery). At this time, data received from the wearable device 200 may be automatically saved or may be saved according to a save request of the user.

  27 illustrates a method in which a mobile terminal performs a preset operation when a biological signal sensed by a mobile terminal and a biological signal sensed by a wearable device are identical according to an embodiment of the present invention. Is a flowchart showing FIG. 28 is a drawing for explaining the method of FIG.

  Referring to FIG. 27, the wearable device 200 can transmit identification information to the mobile terminal 100 existing within the preset distance range (S 2710).

  The mobile terminal 100 can recognize, from the mobile terminal 100, the wearable device 200 existing within the preset distance range (S2720).

  Also, the mobile terminal 100 may determine whether the recognized wearable device is a wearable device coupled to the mobile terminal (S2730).

  Steps 2710 (S 2710) to 2730 (S 2730) of FIG. 27 correspond to steps 420 (S 420) to 440 (S 440) of FIG.

  When the recognized wearable device 200 is the wearable device 200 connected to the mobile terminal 100, the mobile terminal 100 can sense the biological signal of the user of the mobile terminal 100 and acquire biological information ( S2740).

  For example, the mobile terminal 100 may include a biological signal sensor capable of sensing a biological signal of the mobile terminal 100 user. At this time, as illustrated in FIG. 28, when the user holds the mobile terminal 100, the biosignal sensor is included in the portion touched by the user's hand, and the user can connect the mobile terminal 100. In the case of hand, it is configured to automatically sense a biological signal.

  Accordingly, the mobile terminal 100 can measure the user's body temperature, pulse, electrocardiogram, heart rate, blood pressure and the like using the biosignal sensor.

  Also, the wearable device 200 connected to the mobile terminal 100 may sense the biological signal of the wearable device 200 wearer and acquire biological information (S2745).

  For example, the wearable device 200 may include a biological signal sensor capable of sensing a biological signal of the user. At this time, as illustrated in FIG. 28, when the user wears the wearable device 200, the biological signal sensor is included in a portion in contact with the user's body, and the user wears the wearable device 200 , Is configured to automatically measure the biological signal.

  Thereby, the wearable device 200 can measure the user's body temperature, pulse, electrocardiogram, heart rate, blood pressure and the like using the biosignal sensor.

  Meanwhile, the mobile terminal 100 may request the wearable device 200 for biological information of the wearable device 200 wearer (S2750).

  The wearable device 200 can transmit biological information of the wearable device 200 wearer to the mobile terminal 100 (S2760). For example, the wearable device 200 can transmit the biosignal information sensed by the wearable device 200 to the mobile terminal 100 using near field communication. At this time, the short distance communication may include a Wi-Fi method, an NFC method, a Bluetooth method, an infrared method, a ZigBee method, and the like, but is not limited thereto.

  The mobile terminal 100 compares the biological information of the mobile terminal 100 user with the biological information of the wearable device 200 wearer, and the biological signal of the mobile terminal 100 user is the same as the biological signal of the wearable device 200 wearer. It can be determined whether or not (S2770).

  At this time, the biological information of the mobile terminal 100 user and the biological information of the wearable device 200 wearer are also the same type of biological information. For example, when the biological information of the mobile terminal 100 user is a value obtained by measuring the pulse of the mobile terminal 100 user, the biological information of the wearable device 200 wearer is also a value obtained by measuring the pulse of the wearable device 200 wearer . Further, when the biological information of the mobile terminal 100 user is a value obtained by measuring the electrocardiogram of the mobile terminal 100 user, the biological information of the wearable device 200 wearer is also a value obtained by measuring the electrocardiogram of the wearable device 200 wearer.

  In addition, the fact that the biological signal of the mobile terminal 100 user and the biological signal of the wearable device 200 wearer are identical does not mean physically the same, and the biological information of the mobile terminal 100 user, and It means that the biological information of the wearable device 200 wearer matches within a predetermined range.

  For example, when the mobile terminal 100 measures the biometric information of the user of the mobile terminal 100 as the first value, the biometric information of the wearable device 200 wearer is within the range of the first value ± the preset error value. In this case, it can be determined that the biological information of the mobile terminal 100 user and the biological information of the wearable device 200 wearer are the same.

  At this time, if the biometric information of the mobile terminal 100 user and the biometric information of the wearable device 200 wearer are identical, as shown in FIG. It can be determined that the user wears the wearable device 200 coupled to the mobile terminal 100 on the wrist.

  When the mobile terminal 100 determines that the biological information of the mobile terminal 100 user and the biological information of the wearable device 200 wearer are the same, the mobile terminal 100 can perform the preset operation. (S2780). At this time, the preset operation is also an operation related to the operation being performed by the wearable device.

  For example, the operations as described in FIGS. 10 to 26 can be performed. When the locking mode of the wearable device 200 is released, the mobile terminal 100 may release the locking mode of the mobile terminal 100. Alternatively, when user authentication is performed by the wearable device 200, user authentication is also performed by the mobile terminal 100. Alternatively, if the wearable device 200 is displaying a web page, the mobile terminal 100 can display the same web page as the web page displayed on the wearable device 200. Alternatively, when the wearable device 200 receives a call connection request, the mobile terminal 100 can perform call connection. Alternatively, when a call is in progress using the wearable device 200, the mobile terminal 100 can be used to make a call. Alternatively, when the content is reproduced by the wearable device 200, the mobile terminal 100 can continuously reproduce the content being reproduced by the wearable device 200.

  FIG. 29 illustrates a method of performing a preset operation on a mobile terminal when a touch pattern sensed by a mobile terminal and a pattern captured by a wearable device are identical according to an embodiment of the present invention. It is a flowchart shown. FIG. 30 is a drawing for explaining the method of FIG.

  Referring to FIG. 29, the wearable device 200 can transmit identification information to the mobile terminal 100 existing within the preset distance range (S2910).

  The mobile terminal 100 can recognize, from the mobile terminal 100, the wearable device 200 existing within the preset distance range (S2920).

  Also, the mobile terminal 100 may determine whether the recognized wearable device is a wearable device coupled to the mobile terminal (S2730).

  Steps 2910 (S2910) to 2930 (S2930) of FIG. 29 correspond to steps 420 (S420) to 440 (S440) of FIG. 4, and thus detailed descriptions thereof will be omitted.

  When the recognized wearable device 200 is the wearable device 200 connected to the mobile terminal 100, the mobile terminal 100 senses a touch pattern input by the user and acquires touch pattern information. (S2940).

  The mobile terminal 100 may include a touch screen module, and may sense touch gestures on the touch screen and sense an input touch pattern (hereinafter, referred to as a first pattern). At this time, the mobile terminal 100 may include various sensors inside or near the touch screen to sense touch or proximity touch of the touch screen.

  As illustrated in FIG. 30, the user may input a touch pattern (first pattern) to a display unit configured with a touch screen of the mobile terminal 100 using a finger, a touch tool, or the like. it can.

  For example, when the user inputs a star pattern on the display unit of the mobile terminal 100, the mobile terminal 100 receives information related to the form, size, etc. of the touch pattern input by the user (for example, the touch pattern input by the user) It is possible to obtain touch pattern information (first pattern information) including information that “is a star pattern”.

  Referring back to FIG. 29, when the user of the mobile terminal 100 wears the wearable device 200 including a camera, when the user inputs a touch pattern to the mobile terminal 100, the wearable device 200 detects the touch of the user of the mobile terminal 100. A gesture or touch pattern (first pattern) displayed on the mobile terminal 100 can be captured or photographed (S2945).

  For example, referring to FIG. 30, the wearable device 200 is also configured as a head mounted display (HMD) that can be worn on the head portion, but is not limited thereto. The head mounted display may also include, but is not limited to, glasses, a helmet, a hat, and the like.

  In addition, the wearable device 200 includes a camera on the front of the wearable device, and when the user wears the wearable device 200, when the mobile terminal 100 is viewed, the touch gesture of the mobile terminal user is displayed on the mobile terminal It is configured to capture a touch pattern.

  For example, the wearable device 200 includes imaging pattern information (second pattern) including information related to the form, size, and the like of the pattern captured by the wearable device 200 (for example, information that the pattern captured by the wearable device 200 is a star pattern) Information) can be obtained.

  Meanwhile, the mobile terminal 100 may request the wearable device 200 for captured or captured pattern information (second pattern information) (S2950).

  The wearable device 200 may transmit the imaging pattern information (second pattern information) to the mobile terminal 100 (S2960). For example, the wearable device 200 can transmit shooting pattern information to the mobile terminal 100 using near field communication. At this time, the short distance communication may include a Wi-Fi method, an NFC method, a Bluetooth method, an infrared method, a ZigBee method, and the like, but is not limited thereto.

  The mobile terminal 100 compares the first pattern information acquired by the mobile terminal 100 with the second pattern information received from the wearable device 200, and detects the touch pattern (first pattern) of the mobile terminal 100, and the wearable device. Whether or not 200 captured or photographed patterns (second pattern) are identical can be determined (S2970)

  The fact that the touch pattern (first pattern) of the mobile terminal 100 and the imaging pattern (second pattern) of the wearable device 200 are the same does not mean that they are physically the same, and the mobile terminal This means that the 100 touch pattern (first pattern) and the wearable device 200 imaging pattern (second pattern) match within a predetermined range.

  At this time, if the first pattern and the second pattern are the same, as shown in FIG. 30, the mobile terminal 100 takes the mobile terminal 100 by the same user, and It can be determined that the coupled wearable device 200 is worn on the head portion.

  If the mobile terminal 100 determines that the first pattern and the second pattern are the same, the mobile terminal 100 can perform a preset operation (S2980).

  Step 2980 (S2980) of FIG. 29 corresponds to step 2780 (S2780) of FIG.

  FIG. 31 illustrates that the mobile terminal performs a preset operation when the user image captured by the mobile terminal and the user image captured by the wearable device are the same according to an embodiment of the present invention. It is a flowchart which shows a method. FIG. 32 is a drawing for explaining the method of FIG.

  Referring to FIG. 31, the wearable device 200 may transmit identification information to the mobile terminal 100 existing within the preset distance range (S3110).

  The mobile terminal 100 can recognize, from the mobile terminal 100, the wearable device 200 existing within the preset distance range (S3120).

  In addition, the mobile terminal 100 may determine whether the recognized wearable device is a wearable device connected to the mobile terminal (S3130).

  Steps 3110 (S3110) to 3130 (S3130) of FIG. 31 correspond to steps 420 (S420) to 440 (S440) of FIG.

  When the recognized wearable device 200 is the wearable device 200 connected to the mobile terminal 100, the mobile terminal 100 captures a face of the user of the mobile terminal 100 and acquires a user image (first image). (S3140).

  For example, the mobile terminal 100 may include a camera capable of capturing the face of the mobile terminal 100 user, the camera being disposed on the front of the mobile terminal 100 as illustrated in FIG. And configured to easily capture the face of the user holding the mobile terminal 100.

  Referring back to FIG. 31, the wearable device 200 connected to the mobile terminal 100 also captures the face of the user wearing the wearable device 200 using a camera or the like, and a user image (second image) (S3145).

  At this time, the wearable device 200 can capture the wearable device 200 user at the same time as the mobile terminal 100 captures the user of the mobile terminal 100 (S3140).

  Meanwhile, the mobile terminal 100 may request the wearable device 200 for a user image captured by the wearable device 200 (S3150).

  The wearable device 200 may transmit the captured user image (second image) to the mobile terminal (S3160). For example, the wearable device 200 may transmit the second image to the mobile terminal 100 using near field communication (S3160). For example, the wearable device 200 can transmit the user image (second image) sensed by the wearable device 200 to the mobile terminal 100 using short distance communication. At this time, the short distance communication may include a Wi-Fi method, an NFC method, a Bluetooth method, an infrared method, a ZigBee method, and the like, but is not limited thereto.

  The mobile terminal 100 compares the user image (first image) captured by the mobile terminal with the second image received from the wearable device, and the user of the mobile terminal 100 and the user of the wearable device 200 are identical. It can be determined whether it is a person (S3170).

  The mobile terminal 100 may determine whether the face of the user included in the first video and the face of the user included in the second video are faces of the same person. For example, the mobile terminal 100 analyzes the symmetrical composition of the face of the user included in the first image and the second image, the distance and the state of the eyes, the nose and the mouth which are the main parts of the face, the hue of the eyes, etc. It can be determined whether the face included in the first video and the face included in the second video are identical.

  At this time, if it is determined that the user of the mobile terminal 100 and the wearable device 200 user are the same person, as shown in FIG. It can be determined that the wearable device 200 connected to the mobile terminal 100 is worn.

  For example, as illustrated in FIG. 32, when the wearable device 200 is configured by a watch that can be worn on the user's wrist, the user holding the mobile terminal 100 can wear the wearable device 200 on the wrist. If worn, the same user is photographed in the mobile terminal 100 and the wearable device 200.

  If it is determined that the user of the mobile terminal 100 and the user of the wearable device 200 are the same person, the mobile terminal 100 can perform the preset operation in the mobile terminal 100 (S3180).

  Step 3180 of FIG. 31 (S3180) corresponds to step 2780 of FIG. 27 (S2780), and thus detailed description will be omitted.

  FIG. 33 is a flowchart illustrating an operation method of a mobile terminal according to an embodiment of the present invention.

  Referring to FIG. 33, a mobile terminal according to an embodiment of the present invention may operate in a shared mode (S3310). For example, the sharing mode is a mode in which only preset applications are displayed on the home screen and execution of some applications (eg, gallery application, contact application, message application, etc.) is restricted.

  In addition, when the application is executed, only a part of functions can be performed or a part of contents can be displayed. This will be described in detail later with reference to FIGS. 38 to 41.

  The mobile terminal 100 may determine whether the wearable device 200 connected to the mobile terminal 100 is worn by the mobile terminal 100 user (S3320).

  If it is determined that the wearable device 200 connected to the mobile terminal 100 is worn by the mobile terminal 100 user, the mobile terminal 100 converts the operation mode of the mobile terminal 100 from the common mode to the personal mode. (S3330).

  For example, the personal mode can display an application that has not been displayed in the shared mode on the home screen, and is also a mode in which execution of some applications whose execution is restricted in the shared mode is possible.

  In addition, at the time of application execution, a function limited in the sharing mode can be performed, and the mode is also a mode in which the content whose display is limited in the sharing mode is displayed. This will be described in detail later with reference to FIGS. 38 to 41.

  FIGS. 34 to 37 illustrate a method of switching the sharing mode to the personal mode according to whether the wearable device connected to the mobile terminal is worn by the mobile terminal user according to an embodiment of the present invention. Is a flowchart showing

  FIG. 34 shows that the operation state of the mobile terminal is converted from the shared mode to the individual mode when the movement sensed by the mobile terminal and the movement sensed by the wearable device are the same according to an embodiment of the present invention Is a flow chart showing a method of

  Referring to FIG. 34, the mobile terminal 100 is also in the sharing mode (S3410). As described in FIG. 33, the sharing mode is also a mode in which only preset applications are displayed on the home screen, and execution of some applications (eg, gallery application, phonebook application, message application, etc.) is restricted. In addition, when the application is executed, only a part of functions can be performed or a part of contents can be displayed.

  Meanwhile, the wearable device 200 according to an exemplary embodiment of the present invention may transmit identification information to the mobile terminal 100 existing within the preset distance range (S3420).

  For example, when the mobile terminal 100 and the wearable device 200 exist within a preset distance range, the mobile terminal 100 and the wearable device 200 use the short distance communication to mutually communicate the user identification information or the device identification information. Can be sent and received.

  Accordingly, the mobile terminal 100 can recognize from the mobile terminal 100 the wearable device 200 existing within the preset distance range (S3430).

  The mobile terminal 100 may determine whether the recognized wearable device 200 is a wearable device coupled to the mobile terminal 100 (S3440).

  For example, the mobile terminal 100 compares the identification information received from the wearable device 200 with the identification information of the wearable device 200 registered in the mobile terminal 100, and the recognized wearable device 200 is connected to the mobile terminal 100. It can be determined whether or not the wearable device 200 has been

  If the recognized wearable device is a wearable device connected to the mobile terminal, the mobile terminal 100 may sense the movement of the mobile terminal 100 and obtain movement information (S3450).

  For example, the mobile terminal 100 can measure the direction, the speed, and the change in the speed of the mobile terminal 100 using a geomagnetic sensor, a position sensor, an acceleration sensor, a proximity sensor, a gyroscope sensor, and the like.

  Meanwhile, the wearable device 200 may sense the movement of the wearable device 200 and acquire movement information (S3455). At this time, the wearable device 200 senses the motion of the wearable device 200 at the same time as the mobile terminal 100 senses the motion of the mobile terminal 100 (S3450), and acquires motion information of the wearable device 200. Can.

  For example, the wearable device 200 can measure changes in the direction, speed, and velocity in which the wearable device 200 moves, using a geomagnetic sensor, a position sensor, an acceleration sensor, a proximity sensor, a gyroscope sensor, and the like.

  Meanwhile, the mobile terminal 100 may request the wearable device 200 for movement information of the wearable device 200 (S3460).

  The wearable device 200 may transmit the movement information of the wearable device 200 sensed by the wearable device 200 to the mobile terminal 100 (S3470).

  The mobile terminal 100 compares the movement information of the mobile terminal 100 with the movement information of the received wearable device 200, and the movement of the mobile terminal 100 and the movement of the wearable device 200 are identical or similar. It can be determined whether it is done (S3480).

  At this time, the meaning that the movement of the mobile terminal 100 is the same as the movement of the wearable device does not mean that the movement is physically completely the same, but the movement information of the mobile terminal 100 (for example, , That the movement direction, size, speed, etc. of the mobile terminal 100 and movement information of the wearable device 200 (eg, movement direction, size, speed, etc. of the wearable device 200) coincide within a predetermined range means.

  If it is determined that the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same, the mobile terminal 100 determines that the mobile terminal 100 user and the wearable device 200 wearer are the same user. The operation state of the mobile terminal can be switched from the shared mode to the personal mode (S3490).

  As described in FIG. 33, the personal mode can display an application that was not displayed in the shared mode on the home screen, and is also a mode in which execution of some applications whose execution is limited in the shared mode is possible. . In addition, at the time of application execution, a function limited in the sharing mode can be performed, and the mode is also a mode in which the content whose display is limited in the sharing mode is displayed.

  FIG. 35 illustrates an operation state of the mobile terminal according to an embodiment of the present invention, when the biological signal sensed by the mobile terminal and the biological signal sensed by the wearable device are identical according to an embodiment of the present invention; It is a flowchart which shows the method of changing to a mode.

  Referring to FIG. 35, the mobile terminal 100 is also in the sharing mode (S3510).

  Referring to FIG. 35, the wearable device 200 can transmit identification information to the mobile terminal 100 existing within the preset distance range (S3520).

  The mobile terminal 100 can recognize, from the mobile terminal 100, the wearable device 200 existing within the preset distance range (S3530).

  The mobile terminal 100 may determine whether the recognized wearable device 200 is a wearable device connected to the mobile terminal 100 (S3540).

  Steps 3510 (S3510) to 3540 (S3540) of FIG. 35 correspond to steps 3410 (S3410) to 3440 (S3440) of FIG. 34, and thus detailed descriptions thereof will be omitted.

  When the recognized wearable device 200 is the wearable device 200 connected to the mobile terminal 100, the mobile terminal 100 can sense the biological signal of the user of the mobile terminal 100 and acquire biological information ( S3550).

  For example, the mobile terminal 100 may include a biological signal sensor capable of sensing a biological signal of the mobile terminal 100 user. At this time, the biosignal sensor is included in the portion touched by the user's hand when the user holds the mobile terminal 100, and automatically biosignal when the user holds the mobile terminal 100. Are configured to be sensed.

  Accordingly, the mobile terminal 100 can measure the user's body temperature, pulse, electrocardiogram, heart rate, blood pressure and the like using the biosignal sensor.

  Also, the wearable device 200 connected to the mobile terminal 100 may sense the biological signal of the wearable device 200 wearer and acquire biological information (S3555).

  For example, the wearable device 200 may include a biological signal sensor capable of sensing a biological signal of the user. At this time, the biological signal sensor is included in a portion in contact with the user's body when the user wears the wearable device 200, and the biological signal is automatically measured when the user wears the wearable device 200. Configured as.

  Thereby, the wearable device 200 can measure the user's body temperature, pulse, electrocardiogram, heart rate, blood pressure and the like using the biosignal sensor.

  Meanwhile, the mobile terminal 100 may request the wearable device 200 for biological information of the wearable device 200 wearer (S 3560).

  The wearable device 200 may transmit biological information of the wearable device 200 wearer to the mobile terminal 100 (S3570).

  The mobile terminal 100 compares the biological information of the mobile terminal 100 user with the biological information of the wearable device 200 wearer, and the biological signal of the mobile terminal 100 user is the same as the biological signal of the wearable device 200 wearer. It can be determined whether or not (S3580).

  At this time, the biological information of the mobile terminal 100 user and the biological information of the wearable device 200 wearer are also the same type of biological information. For example, when the biological information of the mobile terminal 100 user is a value obtained by measuring the pulse of the mobile terminal 100 user, the biological information of the wearable device 200 wearer is also a value obtained by measuring the pulse of the wearable device 200 wearer . In addition, when the biological information of the mobile terminal 100 user is a value obtained by measuring the electrocardiogram of the mobile terminal 100 user, the biological information of the wearable device 200 wearer is also a value obtained by measuring the electrogram of the wearable device 200 wearer .

  In addition, that the biological signal of the mobile terminal 100 user and the biological signal of the wearable device 200 wearer are identical does not mean that they are physically the same, and the mobile terminal 100 user's It means that the biological information and the biological information of the wearable device 200 wearer match within a predetermined range.

  For example, when the mobile terminal 100 measures the biometric information of the user of the mobile terminal 100 as the first value, the biometric information of the wearable device 200 wearer is within the range of the first value ± the preset error value. In this case, it can be determined that the biological information of the mobile terminal 100 user and the biological information of the wearable device 200 wearer are the same.

  If the mobile terminal 100 determines that the biological signal of the mobile terminal 100 user and the biological signal of the wearable device 200 wearer are the same, the mobile terminal 100 user and the wearable device 200 wearer are the same user It can be determined that the mobile terminal is in operation mode from the shared mode to the personal mode (S3590).

  Step 3590 of FIG. 35 (S3590) corresponds to step 3490 of FIG. 34 (S3490), and thus detailed description will be omitted.

  FIG. 36 illustrates the operation state of the mobile terminal from the common mode to the personal mode when the touch pattern sensed by the mobile terminal and the pattern captured by the wearable device are identical according to an embodiment of the present invention Is a flowchart showing a method of converting to

  Referring to FIG. 36, the mobile terminal 100 is also in the sharing mode (S3610).

  Referring to FIG. 36, the wearable device 200 can transmit identification information to the mobile terminal 100 existing within the preset distance range (S3620).

  The mobile terminal 100 can recognize, from the mobile terminal 100, the wearable device 200 existing within the preset distance range (S3630).

  The mobile terminal 100 may determine whether the recognized wearable device 200 is the wearable device 200 connected to the mobile terminal 100 (S3640).

  Steps 3610 (S3610) to 3640 (S3640) of FIG. 36 correspond to steps 3410 (S3410) to 3440 (S3440) of FIG. 34, and thus detailed descriptions thereof will be omitted.

  When the recognized wearable device 200 is the wearable device 200 connected to the mobile terminal 100, the mobile terminal 100 senses a touch pattern input by the user and acquires touch pattern information. (S3650).

  The mobile terminal 100 may include a touch screen module, and may sense touch gestures on the touch screen and sense an input touch pattern (hereinafter, referred to as a first pattern). At this time, the mobile terminal 100 may include various sensors inside or near the touch screen to sense touch or proximity touch of the touch screen.

  Also, the user can input a touch pattern (first pattern) to the display unit configured with the touch screen of the mobile terminal 100 using a finger, a touch tool, or the like.

  For example, when the user inputs a star pattern on the display unit of the mobile terminal 100, the mobile terminal 100 receives information related to the form, size, etc. of the touch pattern input by the user (for example, the touch pattern input by the user) It is possible to obtain touch pattern information (first pattern information) including information that “is a star pattern”.

  When the user of the mobile terminal 100 wears the wearable device 200 including a camera and inputs a touch pattern to the mobile terminal 100, the wearable device 200 performs the touch gesture of the user of the mobile terminal 100, the mobile terminal The touch pattern (first pattern) displayed on the screen 100 can be photographed (S3655).

  For example, the wearable device 200 is also configured by a head mounted display (HMD) that can be worn on the head portion, but is not limited thereto. The head mounted display may also include, but is not limited to, glasses, a helmet, a hat, and the like.

  Also, the wearable device 200 includes a camera on the front of the wearable device, and when the user wears the wearable device 200 and views the mobile terminal 100, the touch gesture of the mobile terminal user is displayed on the mobile terminal To capture a touch pattern.

  For example, the wearable device 200 includes imaging pattern information (second pattern) including information related to the form, size, and the like of the pattern captured by the wearable device 200 (for example, information that the pattern captured by the wearable device 200 is a star pattern) Information) can be obtained.

  Meanwhile, the mobile terminal 100 can request the wearable device 200 for the imaging pattern information (second pattern information) (S3660).

  The wearable device 200 may transmit the imaging pattern information (second pattern information) to the mobile terminal 100 (S3670).

  The mobile terminal 100 compares the first pattern information acquired by the mobile terminal 100 with the second pattern information received from the wearable device 200, and detects the touch pattern (first pattern) of the mobile terminal 100, and the wearable device. It can be determined whether or not the shooting pattern (second pattern) of 200 is the same (S3680)

  The fact that the touch pattern (first pattern) of the mobile terminal 100 and the shooting pattern (second pattern) of the wearable device 200 are the same does not mean physically the same, and the mobile terminal 100 touch This means that the pattern (first pattern) and the wearable device 200 imaging pattern (second pattern) coincide within a predetermined range.

  If the mobile terminal 100 determines that the first pattern and the second pattern are the same, it can determine that the mobile terminal 100 user and the wearable device 200 wearer are the same user, and the mobile terminal 100 The operating state of the machine can be switched from the shared mode to the personal mode (S3690).

  Step 3690 of FIG. 36 (S3690) corresponds to step 3490 of FIG. 34 (S3490), and thus detailed description will be omitted.

  FIG. 37 illustrates an operation state of the mobile terminal according to an embodiment of the present invention, when the user image captured by the mobile terminal and the user image captured by the wearable device are identical according to an embodiment of the present invention; It is a flowchart which shows the method of changing to a mode.

  Referring to FIG. 37, the mobile terminal 100 is also in the sharing mode (S3710).

  Referring to FIG. 37, the wearable device 200 can transmit identification information to the mobile terminal 100 existing within the preset distance range (S3720).

  The mobile terminal 100 can recognize, from the mobile terminal 100, the wearable device 200 existing within the preset distance range (S3730).

  The mobile terminal 100 may determine whether the recognized wearable device 200 is a wearable device coupled to the mobile terminal 100 (S3740).

  Steps 3710 (S3710) to 3740 (S3740) of FIG. 37 correspond to steps 3410 (S3410) to 3440 (S3440) of FIG. 34, and thus detailed descriptions thereof will be omitted.

  When the recognized wearable device 200 is the wearable device 200 connected to the mobile terminal 100, the mobile terminal 100 captures a face of the user of the mobile terminal 100 and acquires a user image (first image). Can be done (S3750).

  For example, the mobile terminal 100 may include a camera capable of capturing the face of the mobile terminal 100 user, the camera being disposed on the front of the mobile terminal 100 and holding the mobile terminal 100 in hand. It is configured to easily capture the face of a certain user.

  In addition, the wearable device 200 connected to the mobile terminal 100 can also capture a user image (second image) by capturing the face of the user wearing the wearable device 200 using a camera or the like. (S3755).

  Meanwhile, the mobile terminal 100 may request the wearable device 200 to receive the wearable device 200 user image (S3760).

  The wearable device 200 may transmit the photographed user image of the user wearing the wearable device 200 to the mobile terminal 100 (S3770).

  The mobile terminal 100 compares the user image (first image) captured by the mobile terminal with the second image received from the wearable device, and the user of the mobile terminal 100 and the user of the wearable device 200 are identical. It can be judged whether it is a person (S3780).

  The mobile terminal 100 may determine whether the face of the user included in the first video and the face of the user included in the second video are faces of the same person. For example, the mobile terminal 100 analyzes the symmetrical composition of the face of the user included in the first image and the second image, the distance or pattern of the eyes, the nose, the mouth which is the main part of the face, the hue of the eyes, etc. It can be determined whether the face included in the first video and the face included in the second video are identical.

  When the mobile terminal 100 determines that the mobile terminal 100 user and the wearable device 200 wearer are the same, it determines that the mobile terminal 100 user and the wearable device 200 wearer are the same user The operation state of the mobile terminal can be switched from the shared mode to the personal mode (S3790).

  Step 3790 of FIG. 37 (S3790) corresponds to step 3490 of FIG. 34 (S3490), and thus detailed description will be omitted.

  FIG. 38 is a view illustrating a common mode and a personal mode of a mobile terminal according to an embodiment of the present invention.

  Referring to FIG. 38A, in the sharing mode of the mobile terminal 100 according to an embodiment of the present invention, a portion of the application menu is not displayed.

  At this time, some applications not displayed in the sharing mode may include applications (for example, a message application, a gallery application, a contact application, etc.) including personal information of the mobile terminal user. Or, it is also an application set by the user.

  Meanwhile, when it is determined that the mobile terminal user and the wearable device user are the same person, the mobile terminal 100 may switch the operation mode of the mobile terminal 100 to the personal mode.

  For example, when it is determined that the mobile terminal 100 user and the wearable device 200 user are the same person, the mobile terminal 100 moves with the movement of the mobile terminal 100 as described in FIGS. 34 to 37. When the movement of the wearable device 200 is the same, when the biological signal of the mobile terminal 100 user and the biological signal of the wearable device 200 wearer are the same, the touch pattern of the mobile terminal 100 and the wearable device 200 If the photographed pattern is the same, the case where the mobile terminal 100 user image and the wearable device 200 user image are the same may be included. However, it is not limited to them.

  Meanwhile, in the personal mode of the mobile terminal 100 according to an exemplary embodiment of the present invention, as illustrated in FIG. 38B, an application menu which has not been displayed in the common mode may be displayed.

  Also, the mobile terminal may execute the selected application when an application menu not displayed in the sharing mode is selected based on the user input.

  Accordingly, the mobile terminal 100 according to an exemplary embodiment of the present invention may only partially apply (eg, move) the mobile terminal 100 when the user wears the wearable device 200 connected to the mobile terminal 100. An application including personal life information of the terminal user can be displayed and executed, and privacy of the mobile terminal 100 user can be protected.

  39 illustrates a method of operating a mobile terminal in a shared mode according to an embodiment of the present invention, and FIG. 40 illustrates a method of operating a mobile terminal in an individual mode according to an embodiment of the present invention. FIG.

  Referring to FIG. 39A, in the sharing mode of the mobile terminal 100 according to an embodiment of the present invention, an application menu installed on the mobile terminal 100 is displayed.

  At this time, when the user of the mobile terminal 100 selects a part of the application menu displayed on the display unit, execution of the selected application is restricted.

  Some applications whose execution is limited may include applications (for example, a message application, a gallery application, a contact application, etc.) including personal information of the mobile terminal 100 user. Or, it is also an application set by the user.

  In addition, when the user selects a partial application whose execution is limited, the mobile terminal 100 can display a message that the application can not be executed. For example, as shown in FIG. 39 (a), when the mobile terminal user selects a gallery application, the mobile terminal 100 executes the gallery application as shown in FIG. 39 (b). It can display a message 3920 that it can not be done.

  Meanwhile, if it is determined that the mobile terminal 100 user and the wearable device 200 user are the same person, the mobile terminal 100 may switch the operation mode of the mobile terminal 100 to the personal mode.

  Referring to FIG. 40A, the application menu installed on the mobile terminal 100 may be displayed even in the personal mode of the mobile terminal 100 according to an embodiment of the present invention.

  At this time, in the case where the mobile terminal 100 user selects a partial application (for example, an application including personal life information of the mobile terminal user) whose execution is limited in the shared mode from the application menu displayed on the display unit, The selected application can be run.

  For example, as shown in FIG. 40 (a), when the mobile terminal user selects a gallery application, as shown in FIG. 40 (b), the mobile terminal 100 executes the gallery application. Screen 4020 can be displayed.

  Accordingly, the mobile terminal 100 according to an exemplary embodiment of the present invention may be configured to perform a partial application (eg, the mobile terminal user) only when the user of the mobile terminal 100 wears a wearable device coupled to the mobile terminal. Applications that include personal life information) can be performed, and privacy of the mobile terminal user can be protected.

  FIG. 41 is a view illustrating a common mode and a personal mode of a mobile terminal according to an embodiment of the present invention.

  Referring to FIG. 41, in the sharing mode of the mobile terminal 100 according to an embodiment of the present invention, some functions of the application are limited.

  For example, as illustrated in FIG. 41 (a), when the gallery application is executed in the sharing mode of the mobile terminal 100, a partial image stored in the gallery application is not displayed. At this time, the partial image which is not displayed in the sharing mode is also an image set by the user.

  Meanwhile, if it is determined that the mobile terminal 100 user and the wearable device user are the same person, the mobile terminal 100 may switch the operation mode of the mobile terminal 100 to the personal mode.

  In the personal mode of the mobile terminal 100 according to an embodiment of the present invention, as shown in FIG. 41B, when the gallery application is executed, the image 4120 not displayed in the shared mode is displayed. be able to.

  Accordingly, the mobile terminal 100 according to an embodiment of the present invention may be configured to perform only part of the application (eg, when the mobile terminal 100 user wears a wearable device coupled to the mobile terminal 100). (Restricted image display) can be performed, and the privacy of the mobile terminal user can be protected.

  42 and 43 are block diagrams showing the configuration of a mobile terminal according to an embodiment of the present invention.

  Referring to FIG. 42, according to an embodiment of the present invention, the mobile terminal 100 may include a communication unit 110, a control unit 130, and a sensing unit 150. However, none of the illustrated components are essential components. The device 100 may be embodied by more components than those illustrated, and the device 100 may also be embodied by fewer components.

For example, as shown in FIG. 43, the mobile terminal 100 according to an embodiment of the present invention includes an output unit 120, a user input unit 140, and an A / A in addition to the communication unit 110, the control unit 130, and the sensing unit 150. A V (audio / video) input unit 160 and a storage unit 170 may be further included.
Hereinafter, the components will be described in order.

  The communication unit 110 may include one or more components for communicating with the mobile terminal 100 and the wearable device 200 or with an external device. For example, the communication unit 110 may include a short-range wireless communication unit 111, a mobile communication unit 112, and a broadcast reception unit 113.

  The near field communication unit 111 includes a Bluetooth communication unit, a near field communication unit (WNA), a wireless local area network (WLAN) (Wi-Fi) communication unit, a Zigbee communication unit, an infrared data association (IrDA). A communication unit, a WFD (Wi-Fi direct) communication unit, a UWB (ultra wideband) communication unit, an Ant + communication unit, and the like may be included, but the present invention is not limited thereto.

  The mobile communication unit 112 transmits / receives a radio signal to / from at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various forms of data by voice call signal, video call signal, or text / multimedia message transmission / reception.

  The broadcast reception unit 113 receives a broadcast signal and / or broadcast related information from the outside via a broadcast channel. The broadcast channels may include satellite channels and terrestrial channels. According to the embodiment, the mobile terminal 100 may not include the broadcast receiver 113.

  The communication unit 110 can transmit and receive data and the like with the wearable device 200. In addition, the communication unit 110 can receive user authentication information or device identification information of the wearable device 200 from the wearable device 200, and transmits the user authentication information or terminal identification information of the mobile terminal 100 to the wearable device 200. It can be transmitted.

  In addition, the communication unit 110 may use the wearable device 200 connected to the mobile terminal 100, movement information of the wearable device 200, biometric information of the wearable device 200 wearer, pattern information captured by the wearable device 200, and the wearable device 200 user. It can receive video and so on.

  The output unit 120 is for outputting an audio signal, a video signal or a vibration signal, and includes a display unit 121, a speaker 122, a vibration motor 123 and the like.

  The display unit 121 displays and outputs information processed by the mobile terminal 100. For example, when the wearable device 200 connected to the mobile terminal 100 is within the preset range, the display unit 121 may display a motion cancellation function notification message, and the locking mode of the mobile terminal 100 is released. If it is, you can display the home screen.

  Further, the display unit 121 can display a web page, content, and the like being displayed on the wearable device 200, and can display a message received by the wearable device 200.

  On the other hand, when the display unit 121 and the touch pad have a layer structure and are configured as a touch screen, the display unit 121 is also used as an input device other than the output device. The display unit 121 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display (3D display). And at least one of electrophoretic display. And, according to the embodiment of the first device 100, the mobile terminal 100 may include two or more display units 121.

  The speaker 122 outputs audio data received from the communication unit 110 or stored in the memory 170. In addition, the speaker 122 outputs an acoustic signal related to a function performed by the first device 100 (for example, a call signal reception sound, a message reception sound, and a notification sound). Such a speaker 122 may include a buzzer and the like.

  The vibration motor 123 can output a vibration signal. For example, the vibration motor 123 can output a vibration signal corresponding to the output of audio data or video data (for example, a call signal received sound, a message received sound, etc.). The vibration motor 123 can also output a vibration signal when a touch is input on the touch screen.

  The controller 130 controls the general operation of the mobile terminal 100. For example, the control unit 130 may control the communication unit 110, the output unit 120, the user input unit 140, the sensing unit 150, the A / V input unit 160, and the like by executing the program stored in the storage unit 170. it can.

  The control unit 130 compares the movement information of the mobile terminal 100 with the movement information of the wearable device 200, and if the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same, The locking mode can be released.

  The controller 130 may determine whether the wearable device 200 is connected to the mobile terminal 100. The control unit 130 compares the movement of the mobile terminal 100 with the preset movement, and if the movement of the mobile terminal 100 and the preset movement are identical, the communication unit 110 moves the wearable device 200. It can be controlled to receive information.

  If the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same, the control unit 130 may control to perform an operation related to an operation being performed by the wearable device 200.

  The control unit 130 continuously reproduces the content being reproduced by the wearable device 200 when the content is reproduced by the wearable device 200 and the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same. Can be controlled.

  The control unit 130 displays the web page on the wearable device 200, and when the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same, the same web as the web page being displayed on the wearable device 200. It can be controlled to display a page.

  The control unit 130 may control the call connection to be performed when the call connection request is received by the wearable device 200 and the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same.

  If the notification message is received by the wearable device 200 and the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same, the control unit 130 may control to execute an application related to the notification message. .

  The user input unit 140 means a means for the user to input data for controlling the mobile terminal 100. For example, the user input unit 140 may be a key pad (key pad), a dome switch (dome switch), a touch pad (contact capacitive type, pressure type resistive film type, infrared sensing type, surface ultrasonic conduction type, integration) There is a tension measurement method, a piezo effect method, etc.), a jog wheel, a jog switch, etc., but it is not limited thereto.

  The sensing unit 150 may sense a state of the mobile terminal 100 or a state around the mobile terminal 100, and may transmit the sensed information to the control unit 130.

  The sensing unit 150 includes a geomagnetic sensor 151, an acceleration sensor 152, a temperature / humidity sensor 153, an infrared sensor 154, a gyroscope sensor 155, and a position sensor (for example, a GPS (global position system)) 156, At least one of the barometric pressure sensor 157, the proximity sensor 158, and the RGB sensor (luminance sensor) 159 may be included, but is not limited thereto. Since the function of each sensor can be intuitively inferred from the name by those skilled in the art, a specific description is omitted.

  The sensing unit 150 may sense movement of the mobile terminal 100, a biological signal of the mobile terminal user, a touch signal input to the mobile terminal, and the like.

  An A / V (audio / video) input unit 160 is for inputting an audio signal or a video signal, and includes a camera 161, a microphone 162, and the like. The camera 161 can obtain an image frame such as a still image or a moving image through the image sensor in the image call mode or the shooting mode. An image captured through the image sensor may be processed through the control unit 120 or a separate image processing unit (not shown).

  The image frame processed by the camera 161 may be stored in the storage unit 170 or may be transmitted to the outside via the communication unit 150. Two or more cameras 161 may be provided depending on the configuration of the mobile terminal 100.

  The microphone 162 receives an external acoustic signal and processes it into electrical audio data. For example, the microphone 162 can receive an acoustic signal from an external device or a speaker. The microphone 162 may use various noise removal algorithms to remove noise generated in the process of receiving an external sound signal.

  The storage unit 170 may store a program for processing and control of the control unit 130, and may store input and output data (for example, application, content, time zone information of an external device, address book, etc.) You can also.

  The storage unit 170 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, an SD memory or an XD memory, etc.), a RAM Of random access memory (SRAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read only memory (PROM), magnetic memory, magnetic disk, optical disk At least one type of recording medium may be included. The device 100 may also operate a web storage or a cloud server that performs the storage function of the memory 170 over the Internet.

  The programs stored in the memory 170 can be classified into a plurality of modules according to their functions, and are classified into, for example, a UI (user interface) module 171, a touch screen module 172, an alarm module 173, and the like.

  The UI module 171 may provide a specialized user interface (GUI), a graphic user interface (GUI), etc., linked to the mobile terminal 100 according to application. The touch screen module 172 may sense touch gestures on the touch screen of the user and may transmit information related to the touch gestures to the control unit 130. The touch screen module 172 according to an embodiment of the present invention may recognize and analyze a touch code. The touch screen module 172 may also be configured as additional hardware including a controller.

  Various sensors may be provided in or near the touch screen to sense touch or proximity touch on the touch screen. A tactile sensor is an example of a sensor for sensing a touch on a touch screen. A tactile sensor is a sensor that senses the touch of a specific object to the extent that a person feels or more. The tactile sensor can sense various information such as the roughness of the touch surface, the hardness of the touch object, and the temperature of the touch point.

  A proximity sensor is an example of a sensor for sensing a touch on a touch screen.

  The proximity sensor is a sensor that detects the presence or absence of an object approaching or near the predetermined detection surface using mechanical force or infrared rays of an electronic system without mechanical contact. Examples of proximity sensors include transmissive photoelectric sensors, direct reflection photoelectric sensors, mirror reflective photoelectric sensors, high frequency oscillation proximity sensors, electrostatic capacitance proximity sensors, magnetic proximity sensors, infrared proximity sensors, and the like. The user's touch gestures include tap, touch and hold, double tap, drag, pan, flick, drag and drop, and swipe.

  The alarm module 173 may emit a signal to notify occurrence of an event of the mobile terminal 100. Examples of events occurring in the mobile terminal 100 include call signal reception, message reception, key signal input, and schedule notification. The alarm module 173 can also output an alarm signal in the form of a video signal through the display unit 121, can output an alarm signal in the form of an audio signal through the speaker 122, and can output an alarm signal through the vibration motor 123. Alarm signals can also be output in the form of vibration signals.

  FIG. 44 is a block diagram for describing a configuration of a wearable device according to an embodiment of the present invention.

As illustrated in FIG. 44, the wearable device 200 according to an embodiment of the present invention may include a communication unit 210, a control unit 230, a sensing unit 250, a photographing unit 260, and a display unit 270. However, none of the illustrated components are essential components. The wearable device 200 may be embodied by more components than the illustrated components, and the wearable device 200 may be embodied by fewer components.
Hereinafter, the components will be described in order.

  The communication unit 210 may include one or more components for communication between the wearable device 200 and the mobile terminal 100 or communication with an external device. For example, the communication unit 210 may include a short distance communication unit, a mobile communication unit, a broadcast reception unit, and the like. The short distance communication unit, the mobile communication unit, and the broadcast reception unit are replaced with the description related to the short distance communication unit 111, the mobile communication unit 112, and the broadcast reception unit 113 in FIG.

  The sensing unit 250 may sense a state of the wearable device 200 or a state around the wearable device 200, and may transmit the sensed information to the control unit 230.

  The sensing unit 150 may sense movement of the wearable device 200, a biological signal of the wearable device 200 user, and the like.

  In addition, the sensing unit 250 can sense the wear of the wearable device 200. For example, the sensing unit 250 can sense the wear of the wearable device 200 using a pressure sensor, a ground sensor, or the like. This has been described in detail with reference to FIG.

  In addition, the sensing unit 250 may be at least one of a geomagnetic sensor, an acceleration sensor, a temperature / humidity sensor, an infrared sensor, a gyroscope sensor, a position sensor (for example, GPS), an air pressure sensor, a proximity sensor, and an RGB sensor. Although it may contain, it is not limited to them.

  The imaging unit 260 may include a camera, may capture a touch pattern input to the mobile terminal 100, and may capture the wearable device 200 user.

  The camera can obtain an image frame such as a still image or a moving image through an image sensor in an image call mode or a shooting mode. The image captured through the image sensor may be processed through the control unit 230 or a separate image processing unit (not shown). The image frame processed by the camera may be stored in the memory or may be transmitted to the outside via the communication unit 210. Two or more cameras may be provided depending on the configuration of the wearable device 200.

  The display unit 270 may display a web page, various contents, and the like, and may display an application menu installed in the wearable device 200.

  The control unit 230 controls the general operation of the wearable device 200. For example, the control unit 230 can control the communication unit 210, the sensing unit 220, the imaging unit 260, the display unit 270, and the like.

  FIG. 45 is a diagram showing the interaction between the smart door lock and the wearable device according to one embodiment of the present invention.

  The smart door lock 300 according to an embodiment of the present invention is also an embodiment of the mobile terminal 100 described in FIG. 42, and may include a communication unit 110, a control unit 130, and a sensing unit 150.

  The wearable device 200 according to an embodiment of the present invention is also in a state in which the locking mode is released. For example, the state in which the locking mode of wearable device 200 is released is also the state in which the home screen is displayed on the display unit of wearable device 200. Alternatively, an application menu installed in the wearable device 200 is displayed on the display unit of the wearable device 200, and selecting the application menu means that the selected application can be executed.

  Also, the wearable device 200 can transmit the identification information to the smart door lock 300 existing within the preset distance range. For example, when the smart door lock 300 and the wearable device 200 exist within a preset distance range, the smart door lock 300 and the wearable device 200 use the short distance communication to mutually identify the user identification information or the device identification information. Can be sent and received. Accordingly, the smart door lock 300 can recognize the wearable device 200 existing within the preset distance range from the smart door lock 300.

  The smart door lock 300 may determine whether the recognized wearable device 200 is a wearable device coupled to the smart door lock 300. For example, the smart door lock 300 compares the identification information received from the wearable device 200 with the identification information of the wearable device 200 registered in the smart door lock 300, and the recognized wearable device 200 is connected to the smart door lock 300. It can be determined whether or not the wearable device 200 has been

  If the smart door lock 300 is a recognized wearable device 200 connected to the smart door lock 300, the smart door lock 300 may request the wearable device 200 for movement information of the wearable device 200. it can. In response to the request, the wearable device 200 can measure changes in the direction, speed, and velocity in which the wearable device 200 moves, using a geomagnetic sensor, a position sensor, an acceleration sensor, a proximity sensor, a gyroscope sensor, and the like. . In addition, the wearable device 200 can transmit the movement information of the wearable device 200 sensed by the wearable device 200 to the smart door lock 300.

  The smart door lock 300 moves based on the received movement information of the wearable device 200, the movement of the wearable device 200 causes the user of the wearable device 200 to rotate the handle of the smart door lock 300 (a movement that rotates the smart door lock) It can be determined whether or not For example, the smart door lock 300 determines whether the movement information of the wearable device 200 and the stored movement information (for example, movement information for turning the handle of the smart door lock) have a correlation equal to or more than a predetermined reference. It can be judged.

  The smart door lock 300 can release the locking of the smart door lock when there is a correlation between the movement information of the wearable device 200 and the stored movement information that is equal to or greater than a predetermined reference.

  FIG. 46 is a view illustrating a method of displaying detailed information of a notification message received by a mobile terminal when the movement of the mobile terminal and the movement of the wearable device are the same according to an embodiment.

  Referring to FIG. 46, when the mobile terminal 100 receives the notification message 4610 in the locking mode and the movement of the mobile terminal 100 and the movement of the wearable device 200 are the same, the mobile terminal 100 receives The application associated with the notified notification message 4610 can be run.

  For example, in the locking mode, the mobile terminal 100 may receive various notification messages such as an SNS application related notification message, a message notifying of message reception, a game application related notification message, and display the notification message on the display unit. Also, the notification message is displayed in a pop-up window.

  If the movement information sensed by the wearable device 200 connected to the mobile terminal 100 is the same as the movement information sensed by the mobile terminal 100 at the same time, the mobile terminal 100 The locking mode can be released and the notification message 4610 associated application can be run.

  For example, as illustrated in FIG. 46, when the notification message 4610 indicates that the message (eg, text message, instant message, chat message, e-mail, etc.) has been received, the mobile terminal 100 relates to the message association. The application can be executed and the received message 4620 can be displayed on the display unit.

  Accordingly, when the notification message 4610 is received in the locking mode of the mobile terminal 100, the locking mode of the mobile terminal 100 is released and the motion (eg, the mobile terminal is not required to be selected and executed). It is possible to confirm the notification message 4610 related details only by a motion such as lifting the machine in hand.

  Also, an embodiment is directed to a medium (eg, a non-transitory computer readable medium) having computer readable code and / or instructions recorded thereon for implementing at least one of the embodiments described above. It is embodied to control the processing elements. The medium corresponds to a medium capable of transmitting or providing computer readable code as storage.

  The computer readable code may be recorded and transmitted on the medium in various ways. For example, the medium may be a recording medium, a magnetic recording medium (eg, ROM, floppy disk, hard disk, etc.), an optical recording medium (eg, CD-ROM (compact disc read only memory), DVD (digital versatile disc)), the Internet Transmission media (eg, transmission media). Thus, the medium may, according to one or more embodiments, have a structure suitable for storing or transmitting signals or information, such as a device for transmitting a bit stream. The medium may reside on a distributed network, such that computer readable code is stored on or transmitted across the medium and executed in a distributed fashion. Also, the processing element may include a processor, a computer processor, wherein the processing element is distributed or included in one device.

  The above embodiments and effects are merely examples, and are not construed as being limited thereto. The present application is easily applied to other types of devices. Also, the description according to the embodiments is for the purpose of explanation, and does not limit the scope of the claims, and many alternatives, modifications and variations will be apparent to those skilled in the art. I will.

Reference Signs List 100 mobile terminal 110 communication unit 111 short range communication unit 112 mobile communication unit 113 broadcast receiving unit 120 output unit 121 display unit 122 display unit 122 speaker 123 vibration motor 130 control unit 140 user input unit 150 sensing unit 151 geomagnetic sensor 152 acceleration sensor 153 temperature / Humidity sensor 154 UV sensor 155 Gyroscope sensor 157 Air pressure sensor 158 Proximity sensor 160 Input part 161 Camera 162 Microphone 170 Storage part 171 UI module 172 Touch screen module 173 Alarm module 200 Wearable device 210 Communication part 220 Sensing part 230 Control part 250 Sensing part 250 260 shooting unit 270 display unit 300 smart door lock 820 home screen 910 locking mode screen 20 Home screen

Claims (13)

A display unit for displaying a notification message received for at least one application provided on the mobile terminal when the mobile terminal is in a locking state;
A sensing unit for sensing movement of the mobile terminal,
The first information related to the movement of the wearable device corresponding to the mobile terminal and the second information indicating the state of the wearable device, which are sensed during a predetermined time interval from the start time requested by the mobile terminal, A communication unit to receive from the wearable device;
It is determined based on the first information that the degree of correlation between the movement of the mobile terminal and the movement of the wearable device (a degree of correlation) is greater than a first threshold, and based on the second information If the state of the wearable device is determined to be unlocking state, a state of the mobile terminal to change from the locking state to the unlocking state, the unlocking condition state of said mobile terminal from said locking condition A control unit that automatically executes the at least one application associated with the notification message displayed on the display unit in the unlocked state when being changed. The sensing unit is
The mobile terminal according to claim 1, wherein the motion of the mobile terminal is sensed during the same time interval as the time interval in which the motion of the wearable device is sensed. The control unit
Determining whether the degree of correlation between the movement of the mobile terminal and the preset movement is greater than a second threshold;
The communication unit is
Information related to the movement of the wearable device may be received from the wearable device if the degree of correlation between the movement of the mobile terminal and the preset movement is greater than the second threshold. The mobile terminal according to Item 1. Before SL control unit recognizes that the wearable device is present within a predetermined distance range from the mobile terminal,
When the display unit recognizes that the wearable device is present within the predetermined distance range, the movement of the mobile terminal and the movement of the wearable device are identical or similar. The mobile terminal according to claim 1, further comprising displaying a message indicating that the mobile terminal is unlocked. The control unit
If the degree of correlation between the movement of the mobile terminal and the movement of the wearable device is greater than the first threshold, the mobile terminal performs an operation corresponding to the operation performed by the wearable device. The mobile terminal according to claim 1, wherein the control is performed as follows. The communication unit is
When the degree of correlation between the movement of the mobile terminal and the movement of the wearable device is greater than the first threshold, content information being reproduced by the wearable device is received from the wearable device,
The control unit
The mobile terminal according to claim 1, wherein the mobile terminal controls to reproduce content based on the content information. The communication unit is
When the degree of correlation between the movement of the mobile terminal and the movement of the wearable device is greater than the first threshold, web page information being displayed by the wearable device is received from the wearable device,
The display unit is
On the basis of the web page information, the mobile terminal according to claim 1, wherein the benzalkonium to further display the web page. A display unit for displaying a notification message received for at least one application provided on the mobile terminal when the mobile terminal is in a locking state;
A method for sensing movement of the mobile terminal,
The first information related to the movement of the wearable device corresponding to the mobile terminal and the second information indicating the state of the wearable device, which are sensed during a predetermined time interval from the start time requested by the mobile terminal, Receiving from the wearable device,
Determining whether the degree of correlation between the movement of the mobile terminal and the movement of the wearable device is greater than a first threshold based on the first information;
It is determined that the degree of correlation between the movement of the mobile terminal and the movement of the wearable device is greater than the first threshold, and the state of the wearable device is determined to be a locking release state based on the second information If it is, and changing the state of the mobile station to the locking release state from the locking state,
Automatically executing the at least one application associated with the notification message displayed on the display unit in the unlocked state when the state of the mobile terminal is changed from the locked state to the unlocked state; Method of operation of the mobile terminal including: The step of sensing is
The method of claim 8, further comprising sensing a motion of the mobile terminal during a same time interval as a time interval in which the motion of the wearable device is sensed. The receiving step is
Determining whether the degree of correlation between the movement of the mobile terminal and the preset movement is greater than the first threshold;
Receiving information related to the movement of the wearable device from the wearable device if the degree of correlation between the movement of the mobile terminal and the preset movement is greater than a second threshold; A method of operating a mobile terminal according to claim 8. The operation method is
Recognizing the presence of the wearable device within a predetermined distance range from the mobile terminal, and the movement of the mobile terminal if it is recognized that the wearable device is present within the predetermined distance range Displaying a message informing that the mobile terminal is unlocked when the movement of the wearable device is identical or similar to the movement of the wearable device. The operating method of the mobile terminal according to 8. The operation method is
The method may further include performing an operation corresponding to an operation performed by the wearable device if the degree of correlation between the movement of the mobile terminal and the movement of the wearable device is greater than the first threshold. A method of operating a mobile terminal according to claim 8, characterized in. The operation method is
Receiving content information being reproduced by the wearable device from the wearable device if the degree of correlation between the movement of the mobile terminal and the movement of the wearable device is greater than the first threshold;
9. The method of claim 8, further comprising: reproducing content based on the content information.