KR20170004589A - A insole, a mobile terminal and method for controlling the same - Google Patents

Abstract

The present invention relates to an insole allowing insole movement information to be provided based on an insole-sensed signal, a mobile terminal, and a method for controlling the same. The insole according to the present invention includes: a first sensing unit sensing a first movement; a second sensing unit sensing a second movement; a third sensing unit sensing a third movement; a communication unit transmitting the movement information; and a control unit calculating first information with respect to a shoe movement direction based on the sensed first information, calculating second information with respect to a shoe rotation speed based on the sensed second movement, calculating third information with respect to a shoe bottom pressure magnitude based on the sensed third movement, generating and transmitting shoe movement information based on the calculated first, second, and third information, and controlling a movement of an image displayed on an external display screen.

Description

TECHNICAL FIELD [0001] The present invention relates to an insole, a mobile terminal, and a control method thereof,

The present invention relates to an insole capable of providing motion information of an insole based on a signal sensed by an insole, a mobile terminal, and a control method thereof.

A terminal can be divided into a mobile terminal (mobile / portable terminal) and a stationary terminal according to whether the terminal can be moved. The mobile terminal can be divided into a handheld terminal and a vehicle mounted terminal according to whether the user can directly carry the mobile terminal.

The functions of mobile terminals are diversified. For example, there are data and voice communication, photographing and video shooting through a camera, voice recording, music file playback through a speaker system, and outputting an image or video on a display unit. Some terminals are equipped with an electronic game play function or a multimedia player function. In particular, modern mobile terminals can receive multicast signals that provide visual content such as broadcast and video or television programs.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

Conventionally, when a user plays sports and car games, DDR, and a pump game, a game controller is used by using a stick-shaped mechanical controller, a steering wheel and an accelerator pedal mechanical controller, I controlled the motion of the screen.

These mechanical controllers increase the installation cost of game devices, require a wide installation site, and cause an increase in repair costs due to frequent failures.

Therefore, it is required to develop a controller that can be applied to various game devices such as a virtual reality game without a mechanical controller.

The present invention is directed to solving the above-mentioned problems and other problems. Another object of the present invention is to provide an insole, a mobile terminal, and a control method thereof that can provide user's motion information based on a signal sensed in an insole.

Another object of the present invention is to provide an insole, a mobile terminal, and a control method thereof, which can control the motion of an image provided on a display screen based on a signal sensed by an insole.

According to an aspect of the present invention, there is provided an insole comprising: a first sensing unit sensing a first motion; a second sensing unit sensing a second motion; Based on the sensed first movement, based on the first information on the direction of movement of the shoe, and the sensed second motion, the third sensing unit for sensing the rotation speed of the shoe based on the sensed first movement, The third information on the bottom pressure strength of the shoe based on the first information, the second information, and the sensed third motion, and generates and transmits motion information of the shoe based on the calculated first, second, and third information And a control unit for controlling the movement of an image displayed on an external display screen.

According to another aspect of the present invention, there is provided a mobile terminal for receiving an input signal from an insole, the mobile terminal including a display unit, a communication unit for receiving an input signal from the insole, And controlling the movement of the image displayed on the screen of the display unit according to the movement signal of the shoe if the movement signal of the shoe is a motion signal of the shoe.

Effects of the shoe, the mobile terminal and the control method according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, there is provided an advantage of providing convenience in that an external device can be easily controlled based on motion of a shoe, by providing motion information of a user based on a signal sensed by an insole .

In addition, the present invention can control the motion of a game image provided on a display screen based on a signal sensed by an insole, so that the present invention can be applied to various virtual reality games, It is effective.

Further, the present invention controls the movement of the game screen through the motion of the shoe, so that the installation cost of the game apparatus can be reduced, the installation can be performed in a narrow place, and the increase in repair costs due to frequent failures There is an effect that can be blocked.

Further scope of applicability of the present invention will become apparent from the following detailed description. It should be understood, however, that the detailed description and specific examples, such as the preferred embodiments of the invention, are given by way of illustration only, since various changes and modifications within the spirit and scope of the invention will become apparent to those skilled in the art.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram illustrating insole associated with the present invention. FIG.
2 is a diagram showing an example of an insol in relation to the present invention.
3 is a block diagram illustrating a mobile terminal according to the present invention.
4 is a diagram illustrating a method of communicating motion information between an insole and an external terminal according to the present invention.
5 is a diagram for explaining a method of sensing the movement of the insole.
6 is a diagram for explaining a method of calculating motion information of an insole.
Fig. 7 is a diagram for explaining a method of calculating the movement direction of the insole.
8 and 9 are flowcharts illustrating a process of transmitting motion information of an insole.
10 is a view showing a game screen which can be controlled by the movement of the insole.
11 to 15 are diagrams for explaining a method of controlling a game screen using an insole.
16 is a flowchart illustrating an image control method of a mobile terminal according to the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present application, the terms "comprises", "having", and the like are used to specify that a feature, a number, a step, an operation, an element, a component, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

The mobile terminal described in this specification includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, a slate PC A tablet PC, an ultrabook, a wearable device such as a smartwatch, a smart glass, and a head mounted display (HMD). have.

However, it will be appreciated by those skilled in the art that the configuration according to the embodiments described herein may be applied to fixed terminals such as a digital TV, a desktop computer, a digital signage, and the like, will be.

FIG. 1 is a block diagram for explaining a smart insole related to the present invention, and FIG. 2 is a conceptual view of smart insole related to the present invention viewed from different directions.

The smart insole 100 may include a sensing unit 110, a communication unit 120, a haptic module 130, a memory 140, and a control unit 150. The components shown in FIG. 1 are not essential for implementing a smart insole, so that the smart insole described herein may have more or less components than the components described above.

The sensing unit 110 senses the environment of various inputs and insoles of the user and can transmit the sensing result so that the controller 150 can perform an operation corresponding thereto. In addition, the sensing unit 110 may include at least one sensor for sensing at least one of in-solu- tion information, surrounding environment information surrounding the insole, and user information. For example, the sensing unit 110 may include various sensors capable of sensing through the feet, unlike the sensing unit of the mobile terminal. For example, in the present invention, the sensing unit 110 may include a pressure sensor, a motion sensor, an air pressure sensor, a photoplethysmogram (PPG) sensor, and the like. Here, a plurality of pressure sensors and motion sensors may be provided. In this regard, FIG. 2 will be described again.

First, the motion sensor can sense the movement of the insole. For example, the motion sensor may include a sensor capable of detecting motion such as a gyro sensor and an acceleration sensor. The gyro sensor can detect the angular velocity and sense the inclination of the insole. In addition, the acceleration sensor can sense the moving direction and the acceleration of the insole. The pressure sensor is a device that senses the pressure applied to the insole, and the pressure sensor is a sensor that measures the change in pressure. It can sense the height of the current position. The PPG sensor can measure the heartbeat by measuring the light transmittance using the optical sensor.

In one embodiment, the sensing unit 110 senses the gesture input of the insole and may transmit the sensed gesture input to the control unit 150. [ In another embodiment, the sensing unit 110 senses signals such as pressure and inclination in the insole, and transmits the sensed signals to the control unit 150.

The communication unit 120 can communicate with the mobile terminal and the external device using various protocols and transmit / receive data. In addition, the communication unit 120 can connect to a network by wire or wireless and send / receive digital data such as contents. For example, the communication unit 120 may include a wireless Internet module, a local area communication module, a location information module, and the like.

The wireless Internet module refers to a module for wireless Internet access, and may be built in or enclosed in the mobile terminal 100. The wireless Internet module is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, wireless LAN (WLAN), wireless fidelity (Wi-Fi), wireless fidelity (Wi-Fi) Direct, DLNA (Digital Living Network Alliance), WiBro Interoperability for Microwave Access, High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), and Long Term Evolution-Advanced (LTE-A) And transmits and receives data according to at least one wireless Internet technology in a range including internet technologies not listed above.

The wireless Internet module for performing a wireless Internet connection through the mobile communication network may include a wireless Internet access module, such as a WiBro module, a HSDPA module, a HSUPA module, a GSM module, a CDMA module, a WCDMA module, an LTE module, It may be understood as a kind of mobile communication module.

The short-range communication module is for short range communication, and includes Bluetooth (registered trademark), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Communication, Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. Such a short range communication module may support wireless communication between an insole and a wireless communication system, between an insole and another insole, or between a network in which the insole and another insole are located, via a wireless area network. The short-range wireless communication network may be a short-range wireless personal area network.

The position information module is a module for obtaining the position (or current position) of the insole, and representative examples thereof include a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, using the GPS module, the insole can acquire the position of the insole by using the signal sent from the GPS satellite. As another example, an insole may utilize a Wi-Fi module to obtain the location of the insole based on information from a wireless access point (wireless AP) that transmits or receives wireless signals with the Wi-Fi module. Optionally, the location information module may perform any of the other modules of the communication unit to obtain data regarding the location of the insole, in addition or alternatively. The location information module is a module used to obtain the location (or current location) of the insole, and is not limited to modules that directly calculate or obtain the location of the insole.

In one embodiment, the communication unit 120 may transmit an input signal sensed in the insole to a mobile terminal or an external device. In another embodiment, the communication unit 120 may receive a control signal from the mobile terminal.

The haptic module 130 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 130 may be vibration. The intensity and pattern of the vibration generated in the haptic module 130 can be controlled by the user's selection or the setting of the controller 150. For example, the haptic module 130 may combine and output different vibrations or sequentially output the vibrations.

In addition to vibration, the haptic module 130 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a spray on the skin surface, an electrode contact, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 130 can transmit a tactile effect through direct contact, and can also be implemented so that a user can feel a tactile effect through a muscular sense such as a finger or an arm. At least two haptic modules 130 may be provided according to the configuration of the mobile terminal 100. In one embodiment, the haptic module 130 may provide haptic feedback to the user.

The memory 140 stores data that supports various functions of the insole 100. The memory 140 may store a plurality of application programs (application programs or applications) driven by the insole 100, data for operation of the insole 100, and instructions.

Although not shown in FIG. 1, the insole 100 may include a power supply unit (not shown). Under the control of the control unit 150, the power supply unit receives external power and internal power, and supplies power to the components included in the insole 100. The power supply includes a battery, and the battery can be an internal battery or a replaceable battery. As an example, the power supply may have a connection port. Also, as another example, the power supply unit may be configured to charge the battery in a wireless manner. In this case, the power supply unit may transmit power from an external wireless power transmission apparatus using at least one of an inductive coupling based on the magnetic induction phenomenon and a magnetic resonance coupling based on the electromagnetic resonance phenomenon Can receive.

At least some of the components may operate in cooperation with one another to implement the method of operation, control, or control of the insole 100 according to various embodiments described below. Also, the method of operation, control, or control of the insole 100 may be implemented on the insole by driving at least one application program stored in the memory 140.

As an embodiment of the present invention, operations performed in the insole may be controlled by the control unit 150. [ For convenience, the drawings and the following description collectively refer to these operations as performing / controlling the insole.

2 is a diagram showing an example of an insol in relation to the present invention. More specifically, FIG. 2 (a) shows the front view of the insole and various units provided on the insole, and FIG. 2 (b) shows a side view of the insole.

The insole 100 is provided in the user's shoe so as to provide comfort to the user's foot. Insole 100 may include a left insole and a right insole. The embodiment of Fig. 2 (a) represents the left insole. In general, the insole 100 can be manufactured in various sizes based on the user's foot size, and the user's soles and the insole 100 are made to abut against each other. The present invention is based on this point and provides a method of providing various functions to at least one of an insole, a mobile terminal and an external device by applying an input signal to the insole 100 using the foot.

1, the sensing unit of the insole 100 may include various sensors. 2 (b), the insole 100 may include motion sensors 11 and 12, pressure sensors 21 to 28, an air pressure sensor 30, and a photoplethysmogram (PPG) sensor 30 . 2 (b), the insole 100 may include a global positioning system (GPS) sensor or the like. As shown in FIG. 2 (b), the motion sensors 11 and 12 may be distributed one each on the forefoot and the heel. Further, the pressure sensors 21 to 28 can be distributed over the insole 100 as a whole. The air pressure sensor 30 and the PPG sensor 30 may be disposed at the center position of the insole 100. [

In addition, the insole 100 itself may include a control unit 40, a communication unit 40, and a memory 40. 2 (b), the control unit 40, the communication unit 40, and the control unit 40 may be disposed at the central position of the insole 100. [

3 is a block diagram illustrating a mobile terminal according to the present invention.

The mobile terminal 200 may include a display unit 210, a sensing unit 220, a communication unit 230, a memory 240, and a control unit 250. The components shown in FIG. 3 are not essential to implementing the mobile terminal 200, so that the mobile terminal 100 described herein may have more or fewer components than the components described above .

The display unit 210 displays (outputs) information processed by the mobile terminal 200. For example, the display unit 210 may display execution screen information of an application program driven by the mobile terminal 200 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information . In one embodiment, the display portion 210 may display a predetermined function that is controlled based on the input signal sensed in the insole.

The sensing unit 220 may include one or more sensors for sensing at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 220 may include a proximity sensor, an illumination sensor, a touch sensor, an acceleration sensor, a magnetic sensor, a gravity sensor G- sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor, a finger scan sensor, an ultrasonic sensor, an optical sensor optical sensors, such as cameras), microphones, battery gauges, environmental sensors (e.g., barometers, hygrometers, thermometers, radiation sensors, thermal sensors, A sensor (e. G., An electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the mobile terminal disclosed in the present specification can combine and utilize information sensed by at least two of the sensors.

The communication unit 230 may include at least one of a mobile communication module, a wireless Internet module, a short distance communication module, and a location information module.

The mobile communication module may be a mobile communication module, a mobile communication module, a mobile communication module, a mobile communication module, a mobile communication module, a mobile communication module, (Wideband CDMA), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), and the like on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module refers to a module for wireless Internet access, and may be built in or enclosed in the mobile terminal 100. The wireless Internet module is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, wireless LAN (WLAN), wireless fidelity (Wi-Fi), wireless fidelity (Wi-Fi) Direct, DLNA (Digital Living Network Alliance), WiBro Interoperability for Microwave Access, High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), and Long Term Evolution-Advanced (LTE-A) And transmits and receives data according to at least one wireless Internet technology in a range including internet technologies not listed above.

The wireless Internet module for performing a wireless Internet connection through the mobile communication network may include a wireless Internet access module, such as a WiBro module, a HSDPA module, a HSUPA module, a GSM module, a CDMA module, a WCDMA module, an LTE module, It may be understood as a kind of mobile communication module.

The short-range communication module is for short range communication, and includes Bluetooth (registered trademark), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Communication, Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. The short-range communication module may be connected to the mobile terminal 200 and the wireless communication system through the wireless area networks, between the mobile terminal 200 and another mobile terminal, or between the mobile terminal 200 and another mobile terminal Or an external server) may be supported. The short-range wireless communication network may be a short-range wireless personal area network.

Here, another mobile terminal may be a wearable device (e.g., a smartwatch, a smart glass, etc.) capable of interchanging data with the mobile terminal 200 according to the present invention ), Head mounted display (HMD)). The short-range communication module may detect (or recognize) a wearable device capable of communicating with the mobile terminal 200 around the mobile terminal 200. [ If the detected wearable device is a device authenticated to communicate with the mobile terminal 200 according to the present invention, the control unit 250 may transmit at least a part of the data processed by the mobile terminal 200 to the short- To the wearable device. Therefore, the user of the wearable device can use the data processed by the mobile terminal 200 through the wearable device. For example, according to this, when a phone is received in the mobile terminal 200, the user performs a phone call through the wearable device, or when a message is received in the mobile terminal 200, It is possible to check the message.

The position information module is a module for obtaining the position (or current position) of the mobile terminal, and a representative example thereof is a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, when the mobile terminal utilizes the GPS module, it can acquire the position of the mobile terminal by using a signal transmitted from the GPS satellite. As another example, when the mobile terminal utilizes the Wi-Fi module, it can acquire the position of the mobile terminal based on information of a wireless access point (AP) that transmits or receives the wireless signal with the Wi-Fi module. Optionally, the location information module may replace or, in addition, perform any of the other modules of the communication unit 230 to obtain data regarding the location of the mobile terminal. The location information module is a module used to obtain the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or obtains the location of the mobile terminal.

In one embodiment, the communication unit 230 may receive an input signal from an insole or an external device. Also, the communication unit 230 can transmit a control signal to the insole or the external device.

In addition, the memory 240 stores data supporting various functions of the mobile terminal 200. The memory 240 may store a plurality of application programs or applications driven by the mobile terminal 200, data for operation of the mobile terminal 200, and commands. At least some of these applications may be downloaded from an external server via wireless communication. At least some of these application programs may exist on the mobile terminal 200 from the time of shipment for the basic functions (e.g., phone call incoming, calling, message receiving, and calling functions) of the mobile terminal 200 . Meanwhile, the application program may be stored in the memory 240, installed on the mobile terminal 200, and may be operated by the control unit 250 to perform the operation (or function) of the mobile terminal.

The memory 240 may be a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), a multimedia card micro type ), Card type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read memory, a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and / or an optical disk. The mobile terminal 200 may operate in association with a web storage that performs a storage function of the memory 240 on the Internet.

In addition to the operations related to the application program, the control unit 250 typically controls the overall operation of the mobile terminal 200. The control unit 250 can provide or process appropriate information or functions to the user by processing signals, data, information or the like inputted or outputted through the above-mentioned components, or by driving an application program stored in the memory 240.

In addition, the control unit 250 may control at least some of the components described above with reference to FIG. 1 in order to drive an application program stored in the memory 240. In addition, the controller 250 can operate at least two of the components included in the mobile terminal 200 in combination with each other for driving the application program.

In one embodiment, the control unit 250 may generate a control signal based on the received input signal so that the insole or the external device can perform a predetermined function. In addition, the control unit 250 may control the mobile terminal to perform a predetermined function based on the received input signal.

At least some of the components may operate in cooperation with one another to implement a method of operation, control, or control of a mobile terminal according to various embodiments described below. In addition, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 240. [

In one embodiment of the present invention, the operations performed by the mobile terminal may be controlled by the control unit 150. For convenience, the drawings and the following description are collectively referred to as performing / controlling the mobile terminal.

4 is a diagram illustrating a method of communicating motion information between an insole and an external terminal according to the present invention.

As shown in FIG. 4, the external terminal may be the mobile terminal 200, or may be a fixed terminal such as a digital TV, a desktop computer, a digital signage, a game machine, and the like.

The insole 100 may be a controller capable of controlling the movement of the display screen of the mobile terminal 200 and the fixed terminal. In this case, a signal sensed by the insole 100 is transmitted to the mobile terminal 200, and the mobile terminal 200 can control the movement of the display screen based on the signal.

To this end, the insole 100 and the mobile terminal 200 may perform pairing. Here, the pairing indicates a connection for transmitting / receiving data between the insole 100 and the mobile terminal 200. When the pairing is performed, the insole 100 and the mobile terminal 200 perform communication connection and can transmit / receive data bidirectionally. The pairing can be performed through Bluetooth, NFC (Near Field Communication), or the like.

For example, when a game such as a DDR is performed on a display screen, the mobile terminal 200 receives motion information from an insole 100 of a shoe worn by a user and, based on motion information of the insole 100, You can control the screen.

5 is a diagram for explaining a method of sensing the movement of the insole.

As shown in Fig. 5 (a), the insole 100 can sense the moving direction of the foot, and the insole 100 can sense the rotational speed of the foot as shown in Fig. 5 (b) ), The insole 100 can sense the strength with which the foot presses the ground, and the like.

Therefore, the insole 100 acts as a controller for controlling movement of the image displayed on the display screen of the external terminal by combining the moving direction of the foot, the rotational speed, the pressure intensity, etc. based on the sensed input signal .

For example, the sensing unit of the insole 100 may include various sensors, for example, the sensor 100 may include a motion sensor, a pressure sensor, a pressure sensor, a photoplethysmogram (PPG) sensor, Accordingly, it may include a global positioning system (GPS) sensor or the like.

Here, the motion sensor may be distributed to each of the forefoot and the heel of the insole 100, and the pressure sensor may be uniformly distributed over the entire area of the insole 100, (Not shown).

5 (a), the insole 100 receives an input signal sensed by an acceleration sensor disposed at the forefront end and the trailing end of the insole 100, and determines whether the movement direction of the foot is a forward movement, It is possible to recognize whether the movement direction is the backward movement, the movement direction of the foot is the rightward movement, the movement direction of the foot is the leftward movement, and the movement of the foot movement direction is the diagonal movement.

5 (b), the insole 100 receives an input signal sensed by a gyro sensor disposed at the forefront end and the trailing end of the insole 100, and can recognize the rotational speed of the foot.

5C, the insole 100 receives an input signal sensed by a plurality of pressure sensors disposed on the front portion and the rear portion of the insole 100, and recognizes the strength of the foot pressed on the ground surface .

Therefore, the insole 100 can recognize the movement path of the foot from the acceleration sensor, the gyro sensor, and the pressure sensor, and transmits the recognized movement path information to the external terminal, And, in some cases, may control a specific function of the external terminal.

In addition, the external terminal can control the video motion of the display screen or control a specific function according to a control signal received from the insole 100.

Alternatively, the external terminal analyzes the foot movement path based on the input signal received from the insole 100, and the control unit of the external terminal directly controls the video movement of the display screen according to the analyzed foot movement path, You can also control certain functions.

6 is a diagram for explaining a method of calculating motion information of an insole.

As shown in Fig. 6 (a), the insole 100 can sense the moving direction of the foot, and the insole 100 can sense the rotational speed of the foot as shown in Fig. 6 (b) , The insole 100 can sense the strength of the foot pressing the ground surface 102 and the like.

The insole 100 may include first, second, and third sensing units, a communication unit, and a control unit.

Here, the first sensing unit may sense the first motion of the insole 100.

For example, the first sensing unit may be an acceleration sensor, and the acceleration sensor may be disposed at the foremost end and the rearmost end of the insole 100, respectively.

Here, the acceleration sensor can sense the foot moving direction in accordance with the acceleration change occurring in at least one of the X-axis, Y-axis, and Z-axis directions.

The second sensing unit can sense the second movement of the insole 100. [

For example, the second sensing unit may be a gyro sensor, and the gyro sensor may be disposed at the foremost end and the rearmost end of the insole 100, respectively.

Here, the gyro sensor can sense the rotational speed of the foot according to the amount of change of the angular velocity w, which means an angle at which the foot rotates during a unit time.

Then, the third sensing unit can sense the third motion.

For example, the third sensing portion may be a pressure sensor, and a plurality of pressure sensors may be disposed on the front portion and the rear portion of the insole 100, respectively.

Here, the pressure sensor can sense the foot strength according to the intensity of the pressure.

Then, based on the sensed first motion, based on the first information on the movement direction of the shoe, the sensed second motion, second information on the rotation speed of the shoe, and the sensed third motion, The third information on the bottom pressure strength of the shoe is calculated, and the motion information of the shoe can be generated based on the calculated first, second, and third information.

The control unit may transmit the motion information of the shoe to the external terminal through the communication unit to control the motion of the image displayed on the display screen of the external terminal.

In some cases, the control unit of the insole transmits only the signals sensed from the first, second, and third sensing units to the external terminal, calculates the motion information of the shoes at the external terminal, Motion can also be controlled.

Fig. 7 is a diagram for explaining a method of calculating the movement direction of the insole.

As shown in FIG. 7, the control unit of the insole 100 can calculate the first information on the moving direction of the shoe, based on the input signal sensed by the acceleration sensor, which is the first sensing unit.

For example, if the user has stepped forward with one foot, the control unit of the insole 100 firstly detects acceleration in the positive direction of the X axis and the Z axis by the acceleration sensor as shown in Fig. 7 (a) And there is no acceleration change in the Y-axis direction, it can be recognized that the foot is lifted toward the front direction.

7 (b), the acceleration sensor shows an acceleration increase in the negative direction of the Z-axis and an acceleration increase in the positive direction of the X-axis by the acceleration sensor. In the control unit of the insole 100, If there is no change, it can be recognized that the foot is descending toward the front direction from the peak height.

7 (c), when the pressure is increased by the pressure sensor and the acceleration does not change in the X-axis, Y-axis, and Z-axis directions, the control unit of the insole 100 determines that the foot is in contact with the ground .

In this manner, the control unit of the insole 100 can recognize the left and right movement, the front movement, the back movement, and the diagonal movement of the foot based on the sensed input signal.

8 and 9 are flowcharts illustrating a process of transmitting motion information of an insole.

8, the sensing unit of the insole may sense the first movement, the second movement, and the third movement of the insole. (S10)

Here, the first movement of the insole means the movement direction of the foot sensed according to the acceleration change occurring in at least one of the X-axis, Y-axis, and Z-axis directions.

The second movement of the insole means the rotational speed of the foot sensed according to the change amount of the angular velocity w.

Then, the third movement of the insole means the sensed foot strength according to the intensity of the pressure.

Next, the control unit of the insole calculates first information on the movement direction of the shoe based on the sensed first movement, calculates second information on the rotation speed of the shoe based on the sensed second movement, and Based on the sensed third movement, the third information on the bottom pressure strength of the shoe can be calculated. (S20)

Then, the control unit of the insole can generate the motion information of the shoe based on the calculated first, second, and third information. (S30)

Then, the control unit of the insole transmits the motion information of the shoe to the external terminal through the communication unit to control the movement of the image displayed on the display screen of the external terminal. (S40)

Next, the controller of the insole confirms whether the end request signal from the external terminal is received or the end request signal according to the selection of the end button of the insulator by the user is received (S50). When the end request signal is received, Can be terminated.

For example, a method of calculating the first information on the moving direction of the shoe will be described in more detail as follows.

9, the controller of the insole first confirms whether the first movement of the shoe has an acceleration change only in the X-axis and Z-axis directions and there is no acceleration change in the Y-axis direction. (S22)

Then, if it is confirmed that the first movement of the insole has an acceleration change only in the X-axis and Z-axis directions and that there is no acceleration change in the Y-axis direction, the controller of the insole determines whether the acceleration change in the X- (S23)

Next, the control unit of the insole can recognize the direction of movement of the shoe forward if the first movement of the shoe is the positive change amount of the acceleration change in the X-axis direction.

However, if the first movement of the shoe is not a positive change amount but a negative change amount in the X-axis direction, the control unit of the insole can recognize the movement direction of the shoe backward.

The control unit of the insole confirms whether the first movement of the shoe has an acceleration change only in the Y-axis and Z-axis directions and that there is no acceleration change in the X-axis direction. (S24)

Then, the controller of the insole confirms that the first movement of the shoe has an acceleration change only in the Y-axis and Z-axis directions and that there is no acceleration change in the X-axis direction. If the acceleration change in the Y- (S25).

Next, the control unit of the insole can recognize the movement direction of the shoe to the right when the first movement of the shoe is a positive change amount of the acceleration change in the Y-axis direction.

However, the control unit of the insole can recognize the movement direction of the shoe to the left when the first movement of the shoe is a negative change amount, not the positive change amount, in the acceleration change in the Y-axis direction.

Further, the control unit of the insole confirms whether the first movement of the shoe has all of the acceleration changes in the X-axis, Y-axis, and Z-axis directions (S26)

Next, when it is determined that the first movement of the shoe has all of the acceleration changes in the X-axis, Y-axis, and Z-axis directions, the control unit of the insole shifts the shoe movement Direction in the diagonal direction (S27)

However, if the controller of the insole confirms that the first movement of the shoe has no change in the acceleration in the X-axis, Y-axis, and Z-axis directions, it can be recognized that the shoe is in the correct position without movement.

10 is a view showing a game screen which can be controlled by the movement of the insole.

As shown in Fig. 10, the image that can control the insole by the controller is applicable to a game image such as a virtual sports game using the center of gravity and foot.

FIG. 10 (a) shows a virtual ski game image, and the movement of the ski can be controlled in various directions by using the movement of the insole.

10 (b) shows the virtual snowboard game image, and the movement of the snowboard can be controlled in various directions by using the movement of the insole.

10 (c) shows a virtual soccer game image, and the movement of the soccer ball can be controlled in various directions by using the movement of the insole.

Next, FIG. 10 (d) shows the virtual golf game image, and the movement of the golf ball can be controlled in various directions by using the movement of the insole.

11 to 15 are diagrams for explaining a method of controlling a game screen using an insole.

FIG. 11 shows control of a virtual ski game image, and the movement of the ski can be controlled in various directions by using the movement of the insole.

For example, as shown in Fig. 11 (a), depending on the intensity of the pressure applied to the left insole 100a, the skiing movement may make a long turn to the right or a short turn have.

As shown in FIG. 11 (b), when the pressure intensities are evenly distributed to the left and right insole 100a and 100b, the skiing motion proceeds straight and, depending on the intensity of the pressure applied to the front of the insole, Can be determined.

That is, as the intensity of the pressure applied to the front of the insole increases, the forward speed of the ski may increase in proportion to the intensity of the pressure.

11 (c), according to the intensity of the pressure applied to the right insole 100b, the movement of the ski may make a long turn to the left or a short turn.

FIG. 12 shows control of the virtual snowboard game image, and the movement of the snowboard can be controlled in various directions by using the movement of the insole.

For example, as shown in Fig. 12 (a), by the pressure applied to the heel of the left and right insole 100a, 100b, the movement of the snowboard turns opposite to the direction of the valley viewed, The snowboard moves in the direction of the valley in which the movement of the snowboard is turned by the pressure applied to the front of the vehicle 100a or 100b and a long turn or a short turn .

12B, when the pressure intensities are uniformly distributed to the left and right insole 100a, 100b, the movement of the snowboard proceeds straightly, and depending on the intensity of the pressure applied to the front of the insole, The straight forward speed of the snowboard can be determined.

That is, as the intensity of the pressure applied to the front of the insole increases, the linear velocity of the snowboard may increase in proportion to the intensity of the pressure.

Then, as shown in Fig. 12 (c), by the pressure applied to the heel of the left and right insole 100a, 100b, the movement of the snowboard turns opposite to the direction of the valley viewed, The snowboard moves in the direction of the valley viewed by the pressure applied to the front of the snowboard 100b and can make a long turn or a short turn depending on the intensity of the pressure .

FIG. 13 shows control of a virtual soccer game image, and the movement of the soccer ball can be controlled in various directions by using the movement of the insole.

For example, as shown in Fig. 13 (a), the pressure of the left insole 100a is sensed as a first movement for catching the soccer ball, and it is recognized that the left foot is a fixed axis.

Next, as shown in Fig. 13 (b), as the next movement for kicking the soccer ball, the acceleration of the right insole 100b is sensed, and the intensity of the shot can be determined according to the acceleration.

Next, as shown in Fig. 13 (c), as a final movement for catching the soccer ball, vibration of the haptic module is applied to the right insole 100b at the moment when the right insole 100b contacts the virtual soccer ball, It is possible to give a sense of reality to a virtual soccer ball.

Here, with the acceleration sensor of the insole, the virtual soccer ball car can distinguish whether the shot is an inside kick or an outside kick.

Therefore, as shown in FIG. 13, the present invention can be applied to a virtual soccer game image that realizes a moment of shooting, such as a penalty kick, using the movement of the insole.

14 is a view showing control of a virtual game image supporting the positioning and movement of the body through the movement of the insole, and it controls the switching of the screen image according to the direction change by using the movement of the insole .

For example, the user wears a display 210 that provides a virtual reality image to the head, and the image moving direction of the screen can be controlled according to the rotational direction of the left and right inlets 100a and 100b.

15 shows control of a virtual game image supporting the positioning and movement of the body through the movement of the insole. By using the movement of the insole, walking, running, Can be reflected.

For example, the user wears the display 210 that provides the virtual reality image to the head, and uses the acceleration sensor and the pressure sensor of the left and right insole 100a, 100b to perform walking, running, The movement of the screen image with respect to the gear shifting operation can be controlled.

16 is a flowchart illustrating an image control method of a mobile terminal according to the present invention.

As shown in Figure 16, the mobile terminal may receive an input signal from the insole (S101)

Here, the mobile terminal may receive an input signal from the insole after transmitting an insole motion control request signal before receiving the input signal from the insole, receiving an approval response signal for the motion control request signal from the insole have.

Then, the mobile terminal confirms whether the received input signal is a movement signal of the shoe (S103)

Then, if the received input signal is a motion signal of the shoe, the mobile terminal can control the movement of the image displayed on the screen of the display unit according to the movement signal of the shoe (S111)

Here, the motion signal of the shoe received from the insole includes, based on the sensing signal, first information on the moving direction of the shoe, second information on the rotational speed of the shoe, And generates motion information of the shoe based on the calculated first, second, and third information.

However, if the mobile terminal confirms that the received input signal is not a movement signal of the shoe, it confirms whether the received input signal is a sensing signal (S105)

If it is determined that the received input signal is a sensing signal, based on the received input signal, first information on the moving direction of the shoe, second information on the rotational speed of the shoe, (S107). ≪ / RTI > < RTI ID = 0.0 >

For example, when calculating the first information on the shoe moving direction, the shoe movement has acceleration change only in the X-axis and Z-axis directions, and when the acceleration change in the X-axis direction is a positive change amount, When the shoe movement direction is recognized forward and the shoe movement has an acceleration change only in the X and Z axis directions and the acceleration change in the X axis direction is a negative change amount, have.

If the shoe movement has an acceleration change only in the Y-axis and Z-axis directions, and the acceleration change in the Y-axis direction is a positive change amount, the mobile terminal recognizes the shoe moving direction to the right, If there is an acceleration change only in the axis and Z axis direction and the acceleration change in the Y axis direction is a negative change amount, the movement direction of the shoe can be recognized as the left side.

If there is an acceleration change in the X-axis, Y-axis, and Z-axis directions, the mobile terminal compares the acceleration variation amounts in the X-axis, Y-axis, and Z-axis directions and recognizes the moving direction of the shoe in the diagonal direction .

Next, the mobile terminal can generate motion information of the shoe based on the calculated first, second, and third information (S109)

Then, the mobile terminal can control the movement of the image displayed on the screen of the display unit according to the generated motion signal of the shoe (S111)

Here, when the image displayed on the screen of the display unit is a game-related image, the mobile terminal can control the motion of the image displayed on the screen of the display unit according to the motion signal of the shoe.

Next, the mobile terminal confirms whether the end request signal from the insole is received or the end request signal according to the selection of the end button of the mobile terminal by the user is received (S112). When the end request signal is received, Can be terminated.

Therefore, the present invention can easily control the external device based on the motion of the shoe, by providing the motion information of the user based on the signal sensed by the insole.

In addition, the present invention can control the motion of a game image provided on a display screen based on a signal sensed by an insole, so that it can be applied to various virtual reality games, thereby causing a variety of fun and interest to the user .

Further, the present invention controls the movement of the game screen through the motion of the shoe, so that the installation cost of the game apparatus can be reduced, the installation can be performed in a narrow place, and the increase in repair costs due to frequent failures Can be blocked.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). Also, the computer may include a control unit 180 of the terminal. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

100: Insole 110: Sensing part
120: Communication unit 130: Haptic module
140: memory 150:
200: mobile terminal 210:
220: sensing unit 230: communication unit
240: memory 250:

Claims (10)

In an insole,
A first sensing unit sensing a first motion;
A second sensing unit sensing a second motion;
A third sensing unit sensing a third movement;
A communication unit for transmitting motion information; And,
Based on the sensed first movement, first information on the movement direction of the shoe, second information on the rotation speed of the shoe based on the sensed second movement, and the sensed third movement, Calculating third information on the bottom pressure intensity of the shoe and generating and transmitting motion information of the shoe based on the calculated first, second, and third information to determine motion of the image displayed on an external display screen And a control unit for controlling the insole. The apparatus of claim 1, wherein the first sensing unit comprises:
Acceleration sensor,
The acceleration sensor includes:
Wherein the insole is disposed at the foremost end and the foremost end of the insole, respectively. The apparatus of claim 1, wherein the second sensing unit comprises:
A gyro sensor,
The gyro sensor includes:
Wherein the insole is disposed at the foremost end and the foremost end of the insole, respectively. The apparatus of claim 1, wherein the third sensing unit comprises:
Pressure sensor,
The pressure sensor includes:
Wherein a plurality of the insole are disposed at the front portion and the rear portion of the insole, respectively. The apparatus of claim 1,
When calculating the first information on the moving direction of the shoe,
If the first movement has an acceleration change only in the X and Z axis directions and the acceleration change in the X axis direction is a positive change amount,
When the first movement has an acceleration change only in the X-axis and Z-axis directions and the acceleration change in the X-axis direction is a negative change, the movement direction of the shoe is recognized as rearward,
If the first movement has an acceleration change only in the Y and Z axis directions and the acceleration change in the Y axis direction is a positive change amount,
The first movement recognizes the movement direction of the shoe as the left side if there is an acceleration change only in the Y and Z axis directions and the acceleration change in the Y axis direction is a negative change amount,
The first movement recognizes the movement direction of the shoe in the diagonal direction by comparing the amount of change in acceleration in the X-axis, Y-axis, and Z-axis directions when there is an acceleration change in the X-axis, Insole. A mobile terminal for receiving an input signal from an insole,
A display unit;
A communication unit for receiving an input signal from the insoles; And,
And a controller for controlling movement of an image displayed on a screen of the display unit according to a motion signal of the shoe if the received input signal is a motion signal of the shoe. 7. The apparatus of claim 6,
Wherein the control unit transmits the insole motion control request signal and receives an approval response signal for a motion control request signal from the insolator and then receives an input signal from the insole. 7. The apparatus of claim 6,
A second information on the rotational speed of the shoe, and a second information on the rotational speed of the shoe, based on the received input signal, if the received input signal is a sensing signal, 3 information, and generates motion information of the shoe based on the calculated first, second, and third information. 9. The apparatus according to claim 8,
When calculating the first information on the moving direction of the shoe,
When the shoe movement has an acceleration change only in the X-axis and Z-axis directions and the acceleration change in the X-axis direction is a positive change amount,
If the shoe movement has an acceleration change only in the X and Z axis directions and the acceleration change in the X axis direction is a negative change amount,
If the shoe movement has an acceleration change only in the Y and Z axis directions and the acceleration change in the Y axis direction is a positive change amount,
If the shoe movement has an acceleration change only in the Y and Z axis directions and the acceleration change in the Y axis direction is a negative change amount,
Wherein when the shoe movement has an acceleration change in the X-axis, Y-axis, and Z-axis directions, the movement direction of the shoe is recognized in a diagonal direction by comparing the amounts of change in acceleration in the X-, Y- and Z- . 7. The apparatus of claim 6,
Wherein the control unit controls the motion of the image displayed on the screen of the display unit according to a motion signal of the shoe when the image displayed on the display unit is a game related image.

Images