KR102423494B1 - Smart shoes system and mobile terminal processing data of smart shoes - Google Patents

Abstract

In the present specification, a smart shoe system according to the present invention and a mobile terminal for processing smart shoe data are disclosed. Here, an embodiment of the smart shoe system according to the present invention is a smart shoe including a left (L) smart shoe and a right (R) smart shoe pair - Among the left (L) smart shoe and the right (R) smart shoe at least one includes a sensor module, and a memory, a communication unit that sends and receives signals to and from the smart shoe, controls execution of a smart shoe application, and pairs with the smart shoe when the smart shoe application is executed, and after the pairing, the smart shoe a control unit for receiving movement data of a smart shoe wearer sensed by the smart shoe from the smart shoe, analyzing the received motion data, and outputting the analysis result, the application execution screen, UX for pairing with the smart shoe, and the and a mobile terminal configured to include an output unit for outputting an analysis result.

Description

SMART SHOES SYSTEM AND MOBILE TERMINAL PROCESSING DATA OF SMART SHOES

The present invention relates to a smart shoe system for detecting motion and a mobile terminal for processing smart shoe data.

A mobile terminal is implemented as a multimedia device having complex functions in addition to a conventional simple communication function. A typical example of such a mobile terminal is a smart phone, which has been expanded or developed into a form that can be worn by other users, for example, a wearable device. Here, the wearable device includes devices such as smart watches, smart glasses, and head mounted displays (HMDs), and products such as clothes and shoes worn by users. .

On the other hand, the mobile terminal is also leading the implementation of the Internet of Things (IoT) through data communication with various surrounding things together or individually with a conventional stationary terminal.

As such, in recent digital environments, various attempts are being made to satisfy user needs or enhance convenience through data communication between devices. However, a smooth service has not yet been achieved due to a related standard (specification) or system inadequacy for data communication between a plurality of devices. In particular, a preliminary process for data communication between the plurality of devices, for example, a connection or pairing process between the devices, should be preceded, but this process is complicated and requires several steps or depths. There is a problem that causes inconvenience to users. In addition, this problem may limit the user's frequency or frequency of use or interest in use, which is recognized as an obstacle to service activation and may hinder the development of the overall system or environment.

SUMMARY OF THE INVENTION The present invention is to solve the above-mentioned problems or to eliminate obstacles.

An object of the present invention is to enable a simple and quick preliminary process such as data communication between a plurality of terminals and pairing therefor.

Another task of the present invention is to expand the functions of terminals such as smart shoes and mobile terminals and to improve performance, as well as to improve product satisfaction by enhancing usability.

The technical problems to be achieved in the present invention are not limited to the above-mentioned technical problems, and other technical problems not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the description below. .

In the present specification, a smart shoe system according to the present invention and a mobile terminal for processing smart shoe data are disclosed.

According to an embodiment of the mobile terminal performing data communication with the smart shoe according to the present invention, a memory, a communication unit for sending and receiving signals to and from the smart shoe, and controlling the execution of a smart shoe application, and when the smart shoe application is executed, the smart shoe and a control unit for controlling to receive movement data of a smart shoe wearer sensed by the smart shoe from the smart shoe after pairing, analyze the received motion data, and output the analysis result, and the application execution screen; and an output unit for outputting UX for pairing with the smart shoe and the analysis result.

An embodiment of the smart shoe system according to the present invention is an embodiment of the smart shoe system according to the present invention, a smart shoe including a left (L) smart shoe and a right (R) smart shoe pair - the left (L) ) at least one of the smart shoe and the right (R) smart shoe includes a sensor module - and a memory, a communication unit that sends and receives signals to and from the smart shoe, controls execution of a smart shoe application, and when the smart shoe application is executed, the smart shoe application A control unit for pairing with a shoe, receiving motion data of a smart shoe wearer sensed by the smart shoe from the smart shoe after pairing, analyzing the received motion data, and outputting the analysis result; and the application execution screen , and a mobile terminal configured to include an output unit for outputting a UX for pairing with the smart shoe and the analysis result.

The technical solutions obtainable in the present invention are not limited to the above-mentioned solutions, and other solutions that are not mentioned are clearly to those of ordinary skill in the art to which the present invention belongs from the description below. can be understood

According to the present invention, there are the following effects.

According to at least one of the embodiments of the present invention, data communication between a plurality of devices and a preliminary process therefor can be easily and quickly performed.

According to at least one of the embodiments of the present invention, it is possible to expand the functions of terminals such as smart shoes and mobile terminals and improve performance, and there is an effect of improving product satisfaction by enhancing usability.

According to at least one of the embodiments of the present invention, there is an effect of minimizing power consumption and maximizing efficiency of the smart shoe system including the circuit or module for the smart shoe tracking algorithm.

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned may be clearly understood by those of ordinary skill in the art from the following description. will be.

1 is a view schematically showing a service system including smart shoes according to an embodiment of the present invention;
2 is a block diagram for explaining a smart shoe sensor module 200 according to an embodiment of the present invention;
3 is a yz plane cross-sectional view of a smart shoe 110 provided with a smart shoe sensor module 200 according to an embodiment of the present invention;
4 is a view showing in time series the gait of the smart shoe wearer 400 equipped with the smart shoe sensor module 200 according to an embodiment of the present invention and the response to signals generated accordingly;
5 is an operation flowchart of the smart shoe sensor module 200 according to an embodiment of the present invention;
6 is a view showing a system or circuit configuration of a smart shoe sensor module 200 according to an embodiment of the present invention;
7 is a view showing an example of the appearance of the smart shoe sensor module 200 including the circuit configuration of FIG.
8 is a view showing an individual configuration diagram of a smart shoe sensor module 200 according to an embodiment of the present invention;
9 is a cross-sectional view taken along the A-A' direction of FIG. 7;
FIG. 10 is a diagram illustrating a time difference between the time of the on signal measured by the motion sensor 243 of the smart shoe 100 and the time difference of the on signal measured by the pressure sensor 246 according to an embodiment of the present invention. one drawing,
11 and 12 are, respectively, an algorithm and a flowchart for correcting the smart shoe on signal time measurement value through the pressure sensor 246 to the smart shoe on signal time through the motion sensor 243 according to an embodiment of the present invention;
13 is a block diagram showing a configuration for a tracking algorithm in a smart shoe system according to an embodiment of the present invention;
14 is a view showing a smart shoe tracking data graph according to an embodiment of the present invention;
15 and 16 are diagrams showing smart shoe tracking data graphs according to another embodiment of the present invention;
17 is a UX diagram for an example of a service scenario according to an embodiment of the present invention;
18 is a flowchart illustrating a data processing method using a tracking algorithm in a smart shoe system according to an embodiment of the present invention;
19 and 20 are diagrams illustrating a pairing process between a smart shoe and a mobile terminal according to the present invention;
21 and 22 are diagrams illustrating a sequence diagram for explaining a process of automatically pairing a smart shoe with a plurality of mobile terminals according to an embodiment of the present invention; and
23 is a diagram illustrating a service scenario according to an embodiment of the present invention.

Hereinafter, the embodiment (s) disclosed in the present specification will be described in detail with reference to the accompanying drawings, but the same or similar components are assigned the same reference numbers regardless of reference numerals, and redundant description thereof will be omitted.

The suffixes "module" and "part" for components used in the following description are given or mixed in consideration of only the ease of writing the specification, and do not have distinct meanings or roles by themselves.

In addition, in describing the embodiments disclosed in the present specification, if it is determined that a detailed description of a related known technology may obscure the gist of the embodiment disclosed in the present specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in this specification, and the technical idea disclosed herein is not limited by the accompanying drawings, and all changes included in the spirit and scope of the present invention , should be understood to include equivalents or substitutes.

A mobile terminal is expanding from a smart phone that performs a function of producing and consuming content in a communication function to a form of performing various functions by interworking with various things. Examples of such a mobile terminal include things that a user can wear, that is, a wearable device, such as a smart watch, smart glass, head mounted display (HMD), and eye mounted display (EMD). The wearable device may include devices such as etc. and products such as clothes and shoes worn by the user.

Hereinafter, for better understanding of the present invention and for convenience of explanation, in particular, shoes among wearable devices, so-called smart shoes, will be described as an example. The smart shoe analyzes information on the wearer's activity or movement, and provides a user with various information such as the analysis result and related recommendation information and feedback on the analysis result and the user through a mobile terminal such as a smart phone or a smart watch or by itself. (feedback) can be provided. Here, the smart shoe senses, traces, analyzes, and records information on the movement of the user wearing the smart shoe, for example, activity time, activity distance, activity trajectory, and the like. ), a recommendation function, and the like. Such information on the wearer's movement is sensed using, for example, a motion sensor, and the motion sensor may include a global positioning system (GPS), an acceleration sensor, a gyro sensor, and the like. have.

An embodiment of the smart shoe system according to the present invention is an embodiment of the smart shoe system according to the present invention, a smart shoe including a left (L) smart shoe and a right (R) smart shoe pair - the left (L) ) at least one of the smart shoe and the right (R) smart shoe includes a sensor module - and a memory, a communication unit that sends and receives signals to and from the smart shoe, controls execution of a smart shoe application, and when the smart shoe application is executed, the smart shoe application A control unit for pairing with a shoe, receiving motion data of a smart shoe wearer sensed by the smart shoe from the smart shoe after pairing, analyzing the received motion data, and outputting the analysis result; and the application execution screen , and a mobile terminal configured to include an output unit for outputting a UX for pairing with the smart shoe and the analysis result.

According to an embodiment of the mobile terminal performing data communication with the smart shoe according to the present invention, a memory, a communication unit for sending and receiving signals to and from the smart shoe, and controlling the execution of a smart shoe application, and when the smart shoe application is executed, the smart shoe and a control unit for controlling to receive movement data of a smart shoe wearer sensed by the smart shoe from the smart shoe after pairing, analyze the received motion data, and output the analysis result, and the application execution screen; and an output unit for outputting UX for pairing with the smart shoe and the analysis result.

When the smart shoe application is executed, for pairing with the smart shoe, the control unit outputs a list of pairable terminals according to a specific communication protocol on the screen or a UX related to a specific method predefined for the smart shoe. By controlling the output unit, the smart shoe can be paired by authenticating the smart shoe according to a gesture or selection of the smart shoe wearer.

When the smart shoe application is executed, the controller searches for the smart shoe based on a specific communication protocol for pairing with the smart shoe, and generates a trace based on a signal received from a sensor module of the retrieved smart shoe. By calculating, the smart shoe can be authenticated and paired with the authenticated smart shoe.

The control unit stores the unique identification data of the smart shoe in the memory after the initial pairing, and then automatically pairs without the authentication procedure when the smart shoe application is re-executed and receives motion data sensed from the sensor module of the smart shoe The processed data can be output.

The specific communication protocol may be at least one of Bluetooth, Wi-Fi, ZigBee, and LTE.

The sensor module may include a motion sensor and a pressure sensor, and the motion sensor may include an acceleration sensor and a gyro sensor.

The mobile terminal includes all terminals in which the smart shoe application has been downloaded or installed, but may include a smart phone, a wearable device, a PC, and a digital TV. Here, the wearable device may include a virtual reality (VR) device and an augmented reality (AR) device in addition to the above-described device.

1 is a diagram schematically illustrating a service system including smart shoes according to an embodiment of the present invention.

Referring to FIG. 1 , the service system is configured to include a smart shoe 110 , a server 150 , and one or more mobile terminals. In this case, the server 150 may not be essential depending on the system.

The smart shoe 110 is implemented as a pair including a pair of shoes for the left foot (hereinafter, 'left (L) smart shoes') and a pair of shoes for the right foot (hereinafter, 'right (R) smart shoes'). In this case, the sensor module for smart shoes related to the present invention may be included in at least one of the left (L) smart shoes and the right (R) smart shoes. However, in this specification, for better understanding of the present invention and convenience of explanation, a case in which the sensor module for smart shoes is included in both the left (L) smart shoes and the right (R) smart shoes will be described as an example.

The smart shoe 110 senses the user, that is, the motion information of the smart shoe wearer, and transmits the sensed user's motion information to one or more mobile terminals directly or indirectly through the server 150 . Here, the one or more mobile terminals may include a smart phone 120 , a smart watch 130 , and the like. In addition, the smart shoe 110 may transmit the motion information to the digital TV 140 , a digital signage (not shown), or the like. However, it is self-evident that the smart shoe 110 can perform data communication with various devices other than the above-described terminals or the illustrated device.

On the other hand, the smart shoe 110 mainly performs direct data communication with terminals located at a short distance using a short-range communication protocol, but data communication with the terminals located at a long distance using the server 150 can be performed with the corresponding terminals. have. Alternatively, as described above, regardless of the distance, the smart shoe 110 periodically/aperiodically uploads the user's movement information to the server 150 such as the cloud, and a desired time point through the terminal. You can also conveniently download it and use it at any place you want.

In addition, the smart shoe 110 may perform data communication simultaneously or sequentially with at least two or more terminals.

2 is a block diagram illustrating a smart shoe sensor module 200 according to an embodiment of the present invention. Here, although FIG. 2 describes the configuration of the smart shoe sensor module 200, it can also be viewed as the configuration of a mobile terminal. In this case, some configurations may be different from those shown.

The smart shoe sensor module 200 includes a wireless communication unit 210 , an input unit 220 , a sensor unit 240 , an output unit 250 , an interface unit 260 , a memory 270 , a control unit 280 , a power supply unit ( 290) and the like. The components shown in FIG. 2 are not essential for implementing the smart shoe sensor module 200, so the smart shoe sensor module 200 described herein has more or fewer components than the components listed above. It can have elements.

More specifically, among the above components, the wireless communication unit 210 may include between the smart shoe sensor module 200 and the wireless communication system, between the smart shoe sensor module 200 and another mobile terminal, or the smart shoe sensor module 200 . and one or more modules that enable wireless communication between the server and an external server. In addition, the wireless communication unit 210 may include one or more modules for connecting the smart shoe sensor module 200 to one or more networks.

The wireless communication unit 210 may include at least one of a short-range communication module 211 and a location information module 212 .

The short-distance communication module 211 may be connected to the smart shoe module 200 through a Bluetooth method to transmit/receive data.

The location information module 212 serves to measure or transmit location information of the smart shoe module 200 , and may include a concept overlapping with the motion sensor 243 to be described later.

The input unit 220 may include a user input unit 221 (eg, a touch key, a mechanical key, etc.) for receiving information from a user. The voice data or image data collected by the input unit 220 may be analyzed and processed as a user's control command. The input unit 220 may serve to receive an on/off function for activating or deactivating the function of the smart shoe module 200 , and may be omitted as necessary to reduce production cost or reduce weight.

The sensor unit 240 may include one or more sensors for sensing at least one of information in the smart shoe module 200 , surrounding environment information surrounding the smart shoe module 200 , and user information. For example, the sensor unit 240 may include a proximity sensor 241, an illumination sensor 242, an illumination sensor, a touch sensor, an acceleration sensor 244, and a magnetic sensor. , gravity sensor (G-sensor), gyroscope sensor (245, gyroscope sensor, hereinafter 'gyro sensor'), motion sensor (243, motion sensor), RGB sensor, infrared sensor (IR sensor: infrared sensor), fingerprint recognition sensor (finger scan sensor), ultrasonic sensor, optical sensor, battery gauge, environmental sensor (eg barometer, hygrometer, thermometer, radiation detection sensor, thermal sensor, gas detection) sensor, etc.) and a chemical sensor (eg, electronic nose, healthcare sensor, biometric sensor, etc.). On the other hand, the smart shoe module 200 disclosed herein may combine and utilize information sensed by at least two or more of these sensors.

In particular, the acceleration sensor 244 and the gyro sensor 345 mentioned in the present invention may be included in the motion sensor 243 .

The motion sensor 243 mounted on the smart shoe sensor module 200 may refer to a configuration that directly senses the motion of the smart shoe sensor module 200 . The motion sensor 243 may include an acceleration sensor 244 and a gyro sensor 245 . If necessary, only one of the acceleration sensor 244 and the gyro sensor 245 may be provided.

Through the motion sensor 243 , the position of the smart shoe sensor module 200 in 2D or 3D and a motion such as a change in position with respect to time may be sensed.

The controller 280 may control the power supply 290 to supply a current required for the motion sensor 243 . The controller 280 may include a physical configuration of a micro controller unit (MCU) such as a central processing unit (CPU).

The motion sensor 243 and the controller 280 may be included in the smart shoe sensor module 200 or may be mounted on the smart shoe 110 as a separate configuration.

The pressure sensor 246 is mounted on the smart shoe sensor module 200 to sense the pressure. The pressure sensor 246 may be a concept included in the motion sensor 243 functionally, but in the present invention, the motion sensor 243 including the acceleration sensor 244 and the gyro sensor 245 is referred to as the pressure sensor 246 . ) is to be described separately as a configuration independent of the motion sensor 243 .

The output unit 250 is for generating an output related to visual, auditory or tactile sense, and includes at least one of a display unit 251 , a sound output unit 252 , a haptip module 253 , and an optical output unit 254 . can do.

The interface unit 260 serves as a passage with various types of external devices connected to the smart shoe sensor module 200 . The interface unit 260 includes at least one of an external charger port, a wired/wireless data port, a memory card port, and a port for connecting a device equipped with an identification module. can do. In response to the connection of the external device to the interface unit 260 , the smart shoe sensor module 200 may perform appropriate control related to the connected external device.

In addition, the memory 270 stores data supporting various functions of the smart shoe sensor module 200 . The memory 270 may store data and commands for the operation of the controller driven in the smart shoe sensor module 200 .

The controller 280 generally controls the overall operation of the smart shoe sensor module 200 in addition to the operation related to the application. The control unit 280 processes signals, data, information, etc. input or output through the above-described components or uses data and commands stored in the memory 270 to provide or process appropriate information or functions to the user. .

The power supply unit 290 receives external power and internal power under the control of the control unit 280 to supply power to each component included in the smart shoe sensor module 200 . The power supply 290 includes a battery, and the battery may be a built-in battery or a replaceable battery.

At least some of the respective components may operate in cooperation with each other to implement the operation, control, or control method of the smart shoe sensor module 200 according to various embodiments to be described below. In addition, the operation, control, or control method of the smart shoe sensor module 200 may be implemented on the smart shoe sensor module 200 through at least one data or command stored in the memory 270 .

3 is a y-z plane cross-sectional view of the smart shoe 110 provided with the smart shoe sensor module 200 according to an embodiment of the present invention.

The sole frame 310 of the smart shoe 110 refers to a region directly/indirectly touched by the sole of the wearer's sole. In other words, in the smart shoe sensor module 200, it may mean a frame of a region provided between the wearer's foot and the floor. The sole frame 310 is provided at the lowermost end of the insole 311, in which the sole of the wearer's sole is in direct contact, and the smart shoe module 200 to the outside, that is, the outsole 313 and the insole 311 in direct contact with the ground. It may be provided between the outsole 313 and the midsole 312 (midsole) forming a predetermined volume.

The insole 311 may be a common insole, but may be integrally configured without distinction between the insole 311 and the midsole 312 as necessary, or may be provided in a combined form by a separate member or adhesive.

The smart shoe sensor module 200 may be provided on the sole frame 310 . The smart shoe sensor module 200 may signal or data according to the pressure applied by the wearer's walking or driving.

FIG. 4 is a time-series diagram showing the walking of the smart shoe wearer 400 equipped with the smart shoe sensor module 200 according to an embodiment of the present invention and a response to a signal generated accordingly.

When the wearer 400 puts on the smart shoe 110 and steps on the floor, an on ('1') signal to the smart shoe sensor module 200 falls off the floor while wearing the smart shoe 200, the smart shoe sensor An off signal '0' by the module 200 may be generated.

A pressure value above a certain level acts on the states of ② to ④ in FIG. 4 to generate a value '1', that is, an ON signal, in the smart shoe sensor module 200, and in the remaining cases ① and ⑤-⑦, a pressure value less than a specific value With this action, a value of '0', that is, an off signal, may be generated in the smart shoe sensor module 200 .

The ON signal generated by the smart shoe sensor module 200 may be generated by a predetermined threshold pressure value.

The predetermined threshold pressure value may be determined according to the material stiffness and elasticity of the smart shoe sensor module 200 , the size of the smart shoe sensor module 200 , or a distance between the conductive member and the first circuit unit.

For example, when the predetermined threshold pressure value is made larger, the pressure threshold at which the ON signal can be generated becomes higher, so that the value '1', that is, the ON signal is generated in the smart shoe module 200 only in the case of ② or ③ And, in the case of the remaining ① and ④-⑦, the value '0', ie, an off signal, may be generated in the smart shoe module 200 .

Accordingly, the start and end of one step of the wearer can be determined through these results, and when the step is repeated, the cycle of each step can be identified.

Referring to FIG. 4 , ② can be interpreted as the start of a step, and a point passing through ⑦ and becoming ① can be interpreted as the end of a step.

In addition, when the change from ② to ① is repeated, one cycle can be identified as one step and multiple steps can be interpreted.

When the unit of step is interpreted only with the acceleration sensor 244 (see FIG. 2) and/or the gyro sensor 245 (see FIG. 2) among the motion sensors 243 (see FIG. 2), the speed value of the smart shoe sensor module 200 is When the point of '0' is interpreted, errors may occur due to several variables, that is, noise. However, in the present invention, by removing the noise through the on/off signal using the pressure sensor in the smart shoe sensor module 200, it is possible to distinguish the correct step unit.

The smart shoe sensor module 200 may operate in a direction from the sole to the sole frame 310 (refer to FIG. 3 ), that is, depending on whether pressure is applied to the bottom direction. However, it is not necessarily required to be in the lower direction, and if necessary, it may operate based on the pressure in the direction shifted at a certain angle with respect to the lower direction, and if a plurality of smart shoe sensor modules 200 are provided, It can also operate on a direction.

The direction of this pressure may be based on the wearer's general gait and force action, or may vary based on the wearer's different gait and force action for each individual.

The predetermined critical pressure value may be applied differently depending on physical and habitual factors such as height, weight, foot size, sex, and age of the wearer. However, since the on/off of the smart shoe sensor module 200 may depend on materials and structures, the smart shoe sensor module 200 for which the materials and structures are determined may have a predetermined threshold pressure value. However, although not shown, the threshold pressure value may be arbitrarily changed in consideration of the accuracy of sensing data for the wearer, noise, and the like.

5 is an operation flowchart of the smart shoe sensor module 200 according to an embodiment of the present invention.

The controller 280 may supply and control current of the motion sensor 243 based on an on or off signal of the smart shoe sensor module 200 .

When the off signal continues to occur in the smart shoe sensor module 200 for a predetermined time or more, it may be interpreted that the user does not wear the smart shoe 110 or does not move even though the user wears the smart shoe 110 . Alternatively, even if the user wears the smart shoes 110, it may be interpreted that the user does not make a movement that generates more than the predetermined threshold pressure. For example, this may correspond to a case in which the user wears the smart shoes 110 and sits on a chair and moves lightly even if the user touches the floor or does not touch the floor.

Accordingly, the controller 280 may perform a system sleep mode in which the power consumed in the smart shoe sensor module 200 is minimized by inactivating the motion sensor 243 ( S501 ).

When an on signal is generated in the smart shoe sensor module 200 during the system sleep mode, it may be interpreted that the user performs an activity by wearing the smart shoe 110 (S502).

Accordingly, the on signal of the smart shoe sensor module 200 generated during the system sleep mode may activate the controller 280 (S503). If the control unit 280 is already activated, this step may be omitted.

The controller 280 may release the system sleep mode of the smart shoe sensor module 200 and drive the system (S504). Here, the driving of the system may mean that various electronic components, circuits, sensors, etc. provided in the smart shoe sensor module 200 are turned on.

The control unit 280 compares the generation time interval (interval) of the on and off signals of the smart shoe sensor module 200 in real time with a preset time interval (S505).

If the generation time interval of the on and off signals of the smart shoe sensor module 200 is within a preset time interval, that is, if the on value '1' is received within a predetermined time, the system operation of the smart shoe sensor module 200 can be maintained. There is (S506).

On the other hand, when the generation time interval of the on and off signals of the smart shoe sensor module 200 exceeds a preset time interval, that is, when the off value '0' continues for more than a predetermined time, the controller 280 controls the smart shoe sensor module The entire system of 200 may be deactivated, that is, the system operation may be controlled to be switched to the system sleep mode. Here, the control unit 280 may block current, deactivate the motion sensor 243 , and the like.

6 is a diagram illustrating a system or circuit configuration of the smart shoe sensor module 200 according to an embodiment of the present invention.

As one of the core components of the smart shoe sensor module 200 , the pressure conductive member 630 according to the present invention may operate in connection with the first circuit unit 651 . The first circuit unit 651 may be mounted on the substrate 650 so that at least one region may be exposed on the substrate 650 .

Here, for convenience, FIG. 6 shows the state before the coupling of the conductive member 630 and the first circuit part 651, wherein the conductive member 630 is fixed to be spaced apart from the substrate 650 by another member or fixed in contact with the conductive member 630. can be

When a pressure less than a threshold value is applied to the smart shoe sensor module 200 , the conductive member 630 is electrically separated from the first circuit part 651 .

Until the first circuit part 651 is connected by the pressure conductive member 630 , the first circuit part 651 may maintain an open circuit, that is, an electrically open state.

When a pressure greater than or equal to a threshold value is applied to the smart shoe sensor module 200 , the conductive member 630 may be electrically connected to the contact terminal 6511 of the first circuit unit 651 .

The two spaced apart contact terminals 6511 may be electrically connected by the conductive member 630 to form a closed circuit of the first circuit unit 651 . When the first circuit unit 651 constitutes a closed circuit, an electrical signal may be generated.

The control unit 280 (refer to FIG. 2) may recognize the electrical signal generated in the first circuit unit 651 as the on/off signal of FIG. Based on this, various operations can be controlled.

Since the control unit 280 (refer to FIG. 2 ) recognizes the on/off signal according to the electrical signal, it may be interpreted as a separate independent process, but may also be interpreted as one operation performed in the same circuit.

Meanwhile, as an example, in FIG. 6 , two contact terminals 6511 related to electrical connection and disconnection of the pressure conductive member 630 and the first circuit part 651 are illustrated and described, but the present invention is not limited thereto. does not For example, at least one contact terminal 6511 is sufficient. Also, although not shown, electrical connection and disconnection may be implemented in a non-contact method instead of the contact method using the contact terminal 6511 .

FIG. 7 is a diagram illustrating an example of the appearance of the smart shoe sensor module 200 including the circuit configuration of FIG. 6 .

7A is a front perspective view of the exterior of the smart shoe sensor module 200 , and FIG. 7B is a rear perspective view of the exterior of the smart shoe sensor module 200 .

The housing 760 forming the exterior of the smart shoe sensor module 200 may include an upper case 761 and a lower case 762 . Alternatively, the upper case 761 and the lower case 762 may be formed in a uni-body shape, but in the present invention, the upper case 761 and the lower case 762 are formed as separate bodies. The case of combining is taken as an example.

In addition, in the present specification, for convenience, a structure for coupling the smart shoe sensor module 200 with two cases of an upper case 761 and a lower case 762 is illustrated, but the present invention is not limited thereto. In some cases, three or more The smart shoe sensor module 200 may be formed by combining cases.

8 is a view showing an individual configuration diagram of the smart shoe sensor module 200 according to an embodiment of the present invention.

The smart shoe sensor module 200 may mean a structural unit for mounting a component performing the function of the pressure sensor 246 (see FIG. 2 ), and may physically include the entire configuration mounted in the housing 760 . have.

The housing 760 may mount components such as the substrate 650 . It may be composed of a combination of the upper case 761 and the lower case 762 provided on the front of the housing 760 .

The power supply unit 290 may be mounted in the housing 760 to supply power to the control unit 280 and the like. A battery cover 774 coupled to the lower case 762 may be included for smooth replacement of the power supply unit 290 . The waterproof ring 775 may block the gap between the battery cover 774 and the lower case 762 to prevent a problem in waterproofing.

9 is a cross-sectional view taken along the line A-A' of FIG. 7 .

The upper case 761 may form an upper exterior of the smart shoe sensor module 200 and may elastically behave by a pressure greater than or equal to a threshold value acting in the first direction. The first direction may in particular mean a direction from the wearer's feet to the ground. In other words, the first direction may refer to a direction from the upper case 761 to the lower case 762 .

The upper case 761 may be formed in a thin flat shape so that pressure can be well transmitted from the sole of the wearer's sole to the conductive member 630 , and may be provided in direct contact with the conductive member 630 . The outer surface of the upper case 761 may be convex so that the pressure from the wearer's foot or the insole to which the pressure is transmitted from the wearer's foot may be well transmitted to the upper case 761 . The upper case 761 may include a material having elasticity as needed to transmit pressure to the conductive member 630 well. For example, the upper case 761 may be formed of a silicon material.

The lower case 762 may be coupled to the lower end of the upper case 761 to form the lower exterior of the smart shoe sensor module 200 .

The first circuit unit 651 may be mounted on the housing 760 formed by the upper case 761 and the lower case 762 , and in particular may be fixed to the lower case 762 .

A portion of the first circuit unit 651 may be exposed from one surface of the substrate 650 to come into contact with a conductive member 630 to be described later.

The first circuit part 651 may be implemented in the form of a combination of a film and a metal electrode or in the form of a film and a conductive polymer. Alternatively, it may be implemented in the form of a film and CNT or in the form of a film and graphene.

Alternatively, the first circuit unit 651 may be provided in the form of an injection-molded product and MID (Mold Interconnect Devices).

The substrate 650 may mount the first circuit unit 651 . The substrate 650 may mount a second circuit unit for driving the motion sensor 243 . The substrate 650 may mount the controller 280 (refer to FIG. 2 ). However, the motion sensor 243, the second circuit unit, or the control unit 280 does not necessarily have to be provided in the smart shoe sensor module 200, and the smart shoe 110 is a separate motion sensor independently separated according to necessity or system. 243 , a second circuit unit or control unit 280 (see FIG. 2 ) may be included.

The conductive member 630 may generate an electrical signal to the first circuit unit 651 .

The conductive member 630 may be mounted in the housing 760 formed by the upper case 761 and the lower case 762 , in particular. It may be provided inside the upper case 761 .

The conductive member 630 is provided to form a first gap with the first circuit part 651 on the inner side 7611 of the upper case, and elastically behaves by a pressure greater than or equal to a threshold value acting on the upper case 761 in the first direction. Thus, it may come into contact with the first circuit unit 651 and generate a signal.

That is, the conductive member 630 may perform a function of the pressure sensor 246 (refer to FIG. 2 ) according to whether or not the pressure is greater than or equal to a threshold value applied to the upper case 761 in contact with the first circuit unit 651 . When a pressure equal to or greater than a threshold value acts on the smart shoe sensor module 200 , an electrical signal may be generated in the first circuit unit 651 .

The conductive member 630 may serve to electrically connect the first circuit unit 651 when it comes into contact with the first circuit unit 651 . The conductive member 630 may include a conductive material. Accordingly, the conductive member 630 may be implemented with conductive silicon, a metal gasket, a metal plate or metal deposition, a conductive polymer, CNT, graphene, or the like.

Alternatively, the first circuit unit 651 may be composed of a combination of an injection-molded product and a Mold Interconnect Device (MID).

For convenience of explanation, a state in which no pressure is applied to the smart shoe sensor module 200 is named a first state, and a state in which a pressure greater than a threshold value is applied to the smart shoe sensor module 200 is named a second state. do.

In the first state, the conductive member and the first circuit unit 651 may form a first gap G1 . The first gap G1 may be a specific value greater than 0 mm.

In the first state, the first gap G1 is maintained, and in the second state, the conductive member 630 and the first circuit part 651 may be in contact with each other due to the elastic behavior of the upper case 761 .

When the smart shoe sensor module 200 is formed, manufacturing tolerances of the upper case 761 and the lower case 762 , manufacturing tolerances of the substrate 650 having the first circuit part 651 and the conductive member 630 , and coupling The first gap G1 may vary due to a tolerance, a coupling tolerance between the conductive member 630 and the upper case 761 , and a coupling tolerance between the upper case 761 and the lower case 762 .

When the first gap G1 does not have a constant value, the threshold pressure value of signal generation is different, so that an accurate boundary between the on signal and the off signal cannot be formed.

If an error occurs in the distinction between the on signal and the off signal, so that the step is not recognized even though it has occurred, or it is recognized that it has occurred even though the step has not occurred, an error occurs in the analysis of the wearer's step pattern and the cumulative error If this occurs, problems may arise, such as producing completely different results.

Therefore, it is necessary to maintain the first gap G1 in the first state, that is, to have reliability so that the conductive member 230 and the first circuit unit 651 do not generate an ON signal when they come into contact.

The upper case 761 and the lower case 762 may be coupled as a pair of coupling holes and coupling protrusions.

The coupling hole and the coupling protrusion may be fixed in a fitting manner, and it is possible to prevent the case where the upper case 761 and the lower case 762 are unintentionally opened.

The coupling hole may be provided on one side of the upper case 761 or the lower case 762 , and the coupling protrusion may be provided on the other side.

The coupling hole and the coupling protrusion may be in contact with each other to exert a fitting effect.

The coupling hole and the coupling protrusion may form a second gap G2 in a longitudinal direction, which is a coupling direction. The second gap G2 may serve to prevent the width of the first gap G1 from being changed due to a tolerance occurring between the coupling hole and the coupling protrusion.

In a similar manner, the outer boundary of the upper case 761 and the lower case 762 coupling may form a third gap (G3).

The support rib may protrude downward from the inner side of the upper case 761 to support the substrate 650 including the first circuit unit 651 . When the first circuit part 651 is mounted on the lower case 762 , in order to minimize the tolerance occurring in the first gap G1 due to the clearance, the substrate 650 including the first circuit part 651 flows. You can play a role in preventing it from happening.

The hook part may be protruded inside the lower case 762 to fix the substrate 650 including the first circuit part 651 .

The conductive member 730 may be coupled to the inner surface 7611 of the upper case 761 . The coupling method may be coupled through an adhesive tape, or by a double injection method at the same time or at the same time as the formation of the upper case 761 .

When the conductive member 730 is coupled to the inner surface 7611 of the upper case 761 , the conductive member 730 may be provided in the recessed region of the upper case 761 to improve the reliability of the coupling. have. The recessed region may increase the contact area between the conductive member 630 and the inner surface 7611 of the upper case, and may serve to secure a space so that the conductive member 630 has a predetermined thickness or more. .

FIG. 10 is a diagram illustrating a time difference between the time of the on signal measured by the motion sensor 243 of the smart shoe 100 and the time difference of the on signal measured by the pressure sensor 246 according to an embodiment of the present invention. it is one drawing

The motion sensor 243 may recognize the position of the smart shoe 100 in 3D space in real time through the acceleration sensor 244 and the gyro sensor 245 .

Through this, the control unit 280 can check and analyze whether the smart shoe 200 is in an on-signal state supported on the ground, that is, a '1' value state, or an off-signal state away from the ground, that is, a '0' value state. have.

Meanwhile, the pressure sensor 246 may analyze the on-signal state estimated to be ground-supported or the off-signal state estimated to have fallen from the ground according to whether the signal generation threshold pressure value is greater or more.

However, when the on signal or the off signal is determined through the pressure sensor 246 , an error may occur due to the manufacturing tolerance or coupling tolerance of the smart shoe module 200 described above.

Accordingly, the state of the on-signal or off-signal measured and analyzed by the pressure sensor 246 needs to be corrected to the state of the on-signal or off-signal measured and analyzed by the motion sensor 243 . The reverse is also possible.

11 and 12 are, respectively, an algorithm and a flowchart for correcting the smart shoe on signal time measurement value through the pressure sensor 246 to the smart shoe on signal time through the motion sensor 243 according to an embodiment of the present invention. .

The smart shoe sensor module 200 is provided in the left (L) smart shoe and the right (R) smart shoe, respectively, to analyze the wearer's gait pattern and the like.

Left (L) smart shoe sensor module 200 provided in smart shoes left (L) smart shoe sensor module, right (R) smart shoe sensor module 200 provided in smart shoe right (R) smart shoe sensor It can be defined as a module, and a unit in which the left (L) smart shoe sensor module and the right (R) smart shoe sensor module are organically measured and analyzed is defined as the smart shoe sensor module system.

That is, the measured value or analysis value of either one of the left (L) smart shoe sensor module and the right (R) smart shoe sensor module may be transmitted to the other smart shoe sensor module, or a separate terminal may be used for each smart shoe. Calibration may be performed by receiving the measured values and analysis values of the sensor module.

In the former case, the left (L) smart shoe sensor module and the right (R) smart shoe sensor module can be viewed as a smart shoe sensor module system, and in the latter case, the left (L) smart shoe sensor module and the right (R) smart A shoe sensor module and a separate terminal may be viewed as a smart shoe sensor module system.

The above-described error between the pressure sensor 246 and the motion sensor 243 of FIG. 10 may be extended to a problem of the on-signal time of the left smart shoe and the right smart shoe.

The left (L) smart shoe and the right (R) smart shoe may have different lengths of time for supporting the ground, that is, the amount of time or ratio of pressure above a threshold value, depending on the wearer's walking pattern. Accordingly, such deviation may lead to inaccurate results when analyzing the wearer's gait pattern. Therefore, it may be necessary to correct such a balance difference.

Due to complex factors such as deviations due to the wearer's left/right weight imbalance, as well as causes due to manufacturing tolerances of each of the aforementioned left/right (L/R) smart shoe sensor modules 200, left/right (L/R) ) A left/right deviation may occur for the analysis of the time that the smart shoe sensor module 200 supports on the ground.

Therefore, it is necessary to correct the ground support time deviation of the left/side (L/R) smart shoe measured by the pressure sensor 246 .

Correction can be implemented through ground support time analysis of the motion sensor 243 provided in each of the left/right (L/R) smart shoes.

As described above, the motion sensor 243 can measure the position in the three-dimensional space of the left/right (L/R) smart shoe 110 in real time through the acceleration sensor 244 and the gyro sensor 245 . have.

Based on this, the controller 280 may analyze the starting point and the ending point of the smart shoe 110 actually supported by the motion sensor 243 on the ground.

The left/right smart shoes 110 identified through the pressure sensor 246 based on the ratio of the ground support time of each of the left/right (L/R) smart shoes 110 analyzed through the motion sensor 243 as a reference (Reference) ) of the on-signal time ratio deviation can be corrected (Calibration).

For example, when the smart shoe 110 is used for the first time, a correction algorithm may be automatically activated (S1201).

The controller 280 determines the ground support time ratio through the three-dimensional movement of the left/right (L/R) smart shoe 110 measured by the motion sensor 243 including the acceleration sensor 244 and the gyro sensor 245 . It can be analyzed (S1202), and the ratio of the time that the pressure sensor 246 measured the left/right smart shoes 110 acting above the threshold pressure value can be analyzed (S1203).

The measuring or analyzing steps may be performed simultaneously or simultaneously.

For example, the ground support time ratio measured and analyzed by the motion sensor 243 is 0.8:1.2, and the ratio of the time that the signal generation threshold pressure value measured and analyzed by the pressure sensor 246 or more acts is 0.9 Let's say :1.1.

In this case, the controller 280 multiplies the value measured by the pressure sensor 246 of the left (L) smart shoe by 0.8/0.9 in the future, and 1.2 to the value measured by the pressure sensor 246 of the right (R) smart shoe A correction algorithm multiplied by /1.1 may be applied (S1204, S1206).

However, in order to minimize power consumption, the control unit 280 drives the motion sensor 243 only in the initial calibration stage of the pressure sensor 246 and deactivates the driving of the motion sensor 243 unless there is a separate need. .

That is, when performing the correction, the controller 280 may temporarily activate the inactive motion sensor 243 .

The correction of the controller 280 may be performed at a cycle set by the wearer, or may be performed automatically at a preset cycle (S1205).

1 to 12 described above, the smart shoe system according to the present invention has been mainly described. Hereinafter, a smart shoe tracking algorithm based on the sensing data of the pressure sensor described above in the Pedestrian Dead Reckoning (PDR) algorithm will be described in detail.

Hereinafter, in particular, a smart shoe system operated based on a smart shoe tracking algorithm will be described in more detail.

Here, the smart shoe tracking algorithm may refer to the sensing data of the pressure sensor to the PDR algorithm in order to accurately sense the movement (eg, every step or step) of the smart shoe wearer. By using such a smart shoe tracking algorithm, it is possible to more easily and accurately calculate movement data for the smart shoe wearer's gait trajectory, gait direction, stride, and height. In addition, by using the smart shoe tracking algorithm, in conjunction with the above-described pressure switch or pressure sensor circuit or module, compared to the conventional smart shoe system, power consumption can be minimized and efficiency can be maximized.

The smart shoe according to the present invention, as described above, the time, velocity, distance or position, orientation, and trajectory in which the user moves while wearing the smart shoe. It is possible to track, sense, record, etc. movement data such as (trace or path), altitude (attitude), and stride (stride). At this time, it is very important to accurately track and sense every step of the smart shoe wearer.

In relation to the present invention, in sensing the motion data of the smart shoe wearer, when the motion data of the wearer is measured only through a motion sensor such as an acceleration sensor or a gyro sensor (also called a PDR sensor or an inertial sensor), the motion sensor is It must be maintained in a measurable state at all times. However, activation of the motion sensor causes continuous battery consumption. In addition, when motion data is sensed through the motion sensor, if the wearer's steps are not accurately distinguished due to noise generated by the motion sensor, for example, there is a possibility of errors such as missing one step. An error occurs in the wearer's movement data acquired through In order to solve this problem, in the present invention, the above-described pressure switch or pressure sensor is further employed as the motion sensor, and for this, the above-described contents are cited, and overlapping description is omitted here.

Hereinafter, a smart shoe tracking algorithm, motion data sensing through the smart shoe tracking algorithm, and a smart shoe system therefor will be described in detail.

13 is a diagram illustrating a configuration block diagram for a tracking algorithm in a smart shoe system according to an embodiment of the present invention.

Referring to FIG. 13 , the smart shoe tracking algorithm may be processed by a configuration called a smart shoe tracking data processing unit 1300 or a tracking data processing unit 1300 (for convenience, hereinafter, 'tracking data processing unit'). However, it is not limited to the name of the configuration, and the scope of rights should be judged by referring to its function or role. The tracking data processing unit 1300 may be implemented as hardware such as a circuit or module, or software embedded in one component of the aforementioned smart shoe system. However, the tracking data processing unit 1300 described in Figs. 13 to this specification does not necessarily have to be a component of a smart shoe, and other devices such as a mobile terminal that can receive and process sensing data of sensors of the smart shoe (server diagram) included) may be designed in one configuration.

In relation to this, the tracking data processing unit 1300 estimates the moving speed (Velocity (3D)) and the moving direction (Attitude (3D)) of the smart shoe wearer through a sensor module mounted on the smart shoe to move the distance (Position (3D)) can be calculated cumulatively.

The tracking data processing unit 1300 may process the tracking data for the smart shoe wearer based on the sensing data of the sensor module mounted on the smart shoe using the processing unit 1320 and the filter unit 1350 . This is related to the PDR algorithm related to the conventional inertial navigation system, and the detailed description thereof refers to the description of the conventional PDR algorithm, and a detailed description of the PDR algorithm is omitted here.

The tracking data processing process through the processing unit 1320 and the filter unit 1350 will be described first.

The processing unit 1320 includes a first processing unit 1322 and a second processing unit 1324 .

The first processing unit 1322 receives the data sensed by the first sensor 1312 , processes the received sensed data, and outputs it to the first integrator. Here, the first sensor 1312 includes, for example, an acceleration sensor. In particular, the first processing unit 1322 subtracts gravity from the data sensed by the first sensor 1312 .

The second processing unit 1324 receives data sensed by the second sensor 1314 and processes the received sensed data. The processed data is output to the first processing unit 1322 and the mixer. Here, the second sensor 1314 includes, for example, a gyro sensor. The moving direction data may include yaw data, pitch data, roll data, and the like. The second processing unit 1324 calculates the moving direction A of the insole of the smart shoe based on the data sensed by the second sensor 1314 .

In the above, the output data of the first integrator may itself be movement speed data (V), and the data processed by the second processing unit 1324 may itself be movement direction data (A) of the smart shoe wearer. have.

In the above, data excluding the movement speed data v1 from the output data of the first integrator, that is, the movement distance data p0, is again input to the second integrator and accumulated. The movement speed data v1 , the output data of the second integrator, that is, the movement distance data p1 , and the movement direction data a1 of the second processing unit 1324 are input to the filter unit 1350 . The filter unit 1350 filters, for example, the movement speed data v1, the movement distance data p1, and the movement direction data a1 that are input by using the Kalman filter mainly used in the above-described PDR algorithm. . The input movement speed data v1, movement distance data p1, and movement direction data a1 are filtered by the filter unit 1350 to obtain movement speed data v2, movement distance data p2, and The movement direction data a2 is output. The movement speed data v2 , movement distance data p2 , and movement direction data a2 output in this way are output to the mixer unit 1360 .

The mixer unit 1360 includes a first mixer relating to a moving distance, a second mixer relating to a moving speed, and a third mixer relating to a moving direction.

The first mixer calculates the final moving distance data P by mixing the moving distance data p1 that is the output of the second integrator and the moving distance data p2 that is the output of the filter unit 1350 .

The second mixer calculates final movement speed data V by mixing the movement speed data v1 extracted from the first integrator and the movement speed data v2 output from the filter unit 1350 .

The third mixer calculates the final movement direction data A by mixing the movement direction data a1 output from the second processing unit 1324 and the movement direction data a2 output from the filter unit 1350 .

When the tracking data for the smart shoe wearer is processed based on the sensing data of the sensor module mounted on the smart shoe in the tracking data processing unit 1300 using the processing unit 1320 and the filter unit 1350 of FIG. 13 described above, Sensing data such as a graph as shown in FIG. 14 can be obtained.

However, referring to FIG. 14 , based only on data sensed by the first sensor 1312 and the second sensor 1314 , it may not be possible to accurately detect every step of the smart shoe wearer due to the noise region 1410 . This is because it is difficult to accurately measure the zero velocity for every step of the wearer due to the influence of the noise, and it is difficult to distinguish the previous step from the next step, so that one step may not be detected and missed. For example, this may not be a big problem when the wearer of the smart shoe is just walking or in a static state, but when the moving speed is increased or the stride length is narrow, it may affect the entire data and cause an error. In addition, the noise may be generated at every step, which may cause a large error in the entire data. Therefore, as described above, the error according to the noise region may affect the reliability of the sensed tracking data, so there is a problem. Meanwhile, in the present specification, the noise region 1410 may not necessarily mean only a region in which noise is generated, unlike its name, and may refer to a point or region where there is a risk of an error occurring in the data sensing process in relation to the present invention. have.

In order to minimize or eliminate the error caused by the above-mentioned noise, in the present invention, the sensing data of the above-described pressure sensor is further referred to.

Referring to FIG. 13 , the tracking data processing unit 1300 further includes a detection unit 1330 and a fourth mixer 1340 .

The detector 1330 receives the data sensed from the third sensor 1316 , processes the received data and outputs it to the fourth mixer 1340 . Here, the third sensor 1316 may be the pressure sensor according to the present invention described above. Therefore, here, the detailed description of the pressure sensor is cited and omitted. Data sensed by the pressure sensor may be generated, for example, for every step of the smart shoe wearer. This may be, for example, a graph such as FIG. 15 or 16 .

The detector 1330 detects zero velocity from data sensed and input by the third sensor 1316 . This can be easily detected from the graph data as shown in FIG. 14 that is sensed as the third sensor 1316 operates as a pressure switch according to every step of the wearer.

The zero velocity data z1 detected by the detection unit 1330 is mixed with the movement speed data v1 extracted from the first integrator in the fourth mixer 1340, and the mixed data is mixed with the above-described filter unit 1350. ) is an input (v1') different from the input (v1). Thereafter, as described above, after filtering by the filter unit 1350 , the movement distance P, the movement speed V, and the movement direction A data are calculated.

14 and 15, as described above in FIG. 14, the noise region 1410 is present. However, referring to FIG. 15 , the data 1510 filtered through the detector 1330 and the fourth mixer 1340 cancels the noise as shown in FIG. 14 to minimize the zero velocity, so that every step is clearly defined. to be recognized and dealt with. Accordingly, in the case of FIG. 14 described above, a part that may be missed is compensated for a specific step that may occur, and accurate data calculation is possible.

Therefore, according to FIG. 16, since zero velocity is minimized with respect to the movement data of the smart shoe wearer, that is, the movement of the x, y, and z axes, every step can be accurately calculated. Accordingly, it is possible to easily and accurately calculate foot angle data or foot angle correction data, and as shown in FIG. 16 , it is possible to accurately and easily calculate the wearer's movement trajectory, movement speed, movement direction, stride length, report, and the like. This can increase system efficiency and reduce power consumption compared to the case where the PDR sensor or the inertial sensor alone cannot accurately acquire zero velocity step by step and requires correction due to accumulated errors. In addition, when only PDR sensor data is used, wireless positioning correction is required based on Wi-Fi or Bluetooth. However, if pressure sensor data is also used, more accurate data sensing is possible without using such a wireless positioning technique.

In addition, in relation to stride length and reporting, conventionally, when hiking or using stairs in a building, altitude was measured using a barometric pressure sensor, but in this case, when the ambient air pressure suddenly fluctuates according to weather changes, wind, etc., or when using stairs, windows or doors Due to other factors such as opening and closing, atmospheric pressure changes were severe, accurate data sensing was impossible, and the reliability of the sensed data was also low. In contrast, in the present invention, by minimizing zero velocity based on the sensing data of a simple pressure sensor (pressure switch), it is possible to easily and accurately calculate data without a pressure sensor or other configuration.

The tracking data processing algorithm according to the present invention can be used for a wearer's exercise information tracking and management service to measure the wearer's calorie consumption, weight change, etc., and automatically recognizes bike riding, walking, running, etc. or scheduling service is also possible. In addition, according to the tracking data processing algorithm according to the present invention, the walking posture tracking and management service of the wearer (soldiers, etc.), indoor navigation services such as marts, libraries, and public institutions, outdoor bicycles, and walking navigation accuracy correction Various services such as tracking history management of walking area, exercise measurement and management service using stride length and reporting, and wearer tracking management service in areas where GPS or Wi-Fi are not available will be available.

17 is a UX diagram of an example of a service scenario according to an embodiment of the present invention.

FIG. 17A is a case of walking a moving distance of 10 m at an average speed, and FIG. 17B is a UX of data obtained through the tracking data processing unit in the case of FIG. 17A. Referring to FIG. 17B , it can be seen that the data acquired through the tracking data processing unit for a moving distance of 10m in FIG. 17A is 10.072m.

Fig. 17c is a case of walking a moving distance of 10m at a high speed like an alarm, and Fig. 17d is a UX of data obtained through the tracking data processing unit in the case of Fig. 17c. Referring to FIG. 17D , it can be seen that the data acquired through the tracking data processing unit for a moving distance of 10m in FIG. 17C is 10.066m.

In addition, FIG. 17E is a UX for stride length, speed, and total distance data accumulated through the tracking data processing unit for a predetermined time.

18 is a flowchart of a data processing method using a tracking algorithm in a smart shoe system according to an embodiment of the present invention.

According to the present invention, the tracking data processing unit of the smart shoe system receives the sensed data from one or more first sensors ( S1802 ), and receives the data sensed based on the operation of the second sensor to obtain zero velocity data is detected (S1804). Here, the first sensors include, for example, the first sensor (acceleration sensor) and the second sensor (gyro sensor) of FIG. 13 described above. Also, here, the second sensor includes the third sensor (pressure sensor) of FIG. 13 described above.

The tracking data processing unit removes step noise from the sensing data received from the first sensors based on the detected zero velocity data (S1806). The step noise means the noise 1410 shown in FIG. 14 , and removing the step noise means processing as in FIG. 15 .

The tracking data processing unit filters the sensing data from which the step noise is removed (S1808).

The tracking data processing unit acquires movement data of the smart shoe based on the filtered sensing data and a predefined threshold (S1810). Here, the predefined threshold may indicate a value according to data normalization according to filtering in the filter unit. In this way, normalizing data may help data management and the like.

19 and 20 are diagrams illustrating a pairing process between a smart shoe and a mobile terminal according to the present invention.

Based on the above-described embodiments, the smart shoe 1910 senses motion data, and the mobile terminal 1920 may obtain meaningful data from the data sensed by the smart shoe 1910 in this way. In this case, in order to smoothly perform data communication between the smart shoe 1910 and the mobile terminal 1920 as described above, a pairing process for data communication between each other must be preceded.

For convenience, in this specification, it is assumed that the data communication is performed based on a Bluetooth communication protocol. Accordingly, pairing for the data communication is also performed according to the definition of the Bluetooth communication protocol. However, as described above, the communication protocol is a Bluetooth communication protocol as an example, but the present invention is not limited thereto, and all communications currently defined for data communication such as Wi-Fi, LTE, and Zigbee. It may also include a protocol or a communication protocol to be defined in the future.

Meanwhile, the communication protocol is not necessarily used in the data communication process, but a plurality of communication protocols may be used depending on circumstances according to various criteria such as data amount and data properties. For example, when there is a communication protocol predefined for urgent data processing or corresponding data processing, such as an emergency message (EAS), it may be followed. In addition, if data communication is not smooth depending on the communication environment, other communication protocols may be used.

Referring to FIG. 19A , the first smart shoe sensor module 1912 is mounted on the left (L) smart shoe constituting the smart shoe, and the second smart shoe sensor module 1914 is mounted on the right (R) smart shoe. . The first smart shoe sensor module 1912 and the second smart shoe sensor module 1914 may each have unique identification data according to a communication protocol for data communication. For example, referring to FIG. 19A , the first smart shoe sensor module 1912 has unique identification data 'SHV-EKJ2KPS' for data communication. And the second smart shoe sensor module 1914 has unique identification data of 'PK-A14TS62' for data communication.

If the unique identification data is, for example, a predefined communication protocol, for example, Bluetooth, the unique identification data may be provided at the time of manufacture according to a method promised or defined in the communication protocol. Although such unique identification data is assigned for a specific communication protocol, it can be used as it is when using other communication protocols, and unique identification data may be provided for general purpose from the beginning at the time of manufacture. Alternatively, it may be arbitrarily changed for the convenience of user identification within a range that does not impair the method defined in data communication or communication protocol by the user in the future.

The mobile terminal 1920 may provide a connectable Bluetooth communication list 1925 on the screen of the mobile terminal as shown in FIG. 19B when, for example, Bluetooth communication is activated or turned on for data communication with the smart shoe 1910. have.

Accordingly, the user may select a desired device from the list provided on the mobile terminal 1920 and perform pairing. However, in this case, if a password or the like is set in the selected device, the pairing process may be completed by providing an appropriate UX and inputting the password. In addition, when pairing is complete, it is difficult for the user to identify whether the pairing has been performed properly, so depending on the system, a smart shoe-shaped UX is provided on the screen of the mobile terminal to show the pairing process or to vibrate the paired smart shoes. By giving feedback, it is possible to easily recognize the result of the pairing.

Unlike FIG. 19 , in FIG. 20 , automatic pairing may be performed based on a result according to a predetermined action of the smart shoe wearer rather than a list and a separate list as shown in FIG. 19B . This can help the user to perform pairing more intuitively and conveniently in various situations, such as, for example, difficulty in selecting when a user cannot input a mobile terminal by touch, inconvenient, or when too many device lists are provided on the list.

As shown in FIG. 20A , for example, when the mobile terminal 1920 wears smart shoes according to a guide on the UX and presses or selects to connect, an additional operation for pairing is requested as shown in FIGS. 20B and 20C . When the pairing request with the smart shoe is selected in the mobile terminal in FIG. 20A , in FIG. 20B , it is requested to roll the left foot three times to check whether the sensor and the application work well. When the smart shoe wearer performs an operation according to the request of the mobile terminal, the left (L) smart shoe sensor module and the mobile terminal are automatically registered and paired. Thereafter, as in FIG. 20B , when the requested operation is performed for the right (R) smart shoe sensor module in FIG. 20C , the mobile terminal automatically performs registration and pairing. 20B and 20C are for registering and pairing both smart shoe sensor modules, the order of which is arbitrary and not important. On the other hand, if the sensor module is mounted on only one side of the smart shoe, it is sufficient to perform either one of FIGS. 20B or 20C.

20 shows, for example, automatic registration and pairing of sensor modules mounted on smart shoes in a mobile terminal, as well as a function of pre-checking whether smooth data communication is performed. In addition, when the user does not perform the operations as shown in FIG. 20 , it is difficult to determine whether data sensing is properly performed, and thus, a correction operation for more accurate data sensing may be performed through this process. For example, through FIGS. 20B or 20C , the user can intuitively recognize the intensity or degree of pressure for recognizing a step, and can determine whether there is a malfunction or error of the sensor module by itself. Through this, the user may correct the sensing sensitivity of the sensor module in some cases. In other words, most sensor modules of smart shoes may have preset sensing sensitivity and threshold pressure criteria based on average data.

However, even according to such a standard, the degree of data sensing felt by the user may be different, and this can be easily corrected through the process shown in FIGS. 20B and 20C . For example, as described above, it is assumed that the user performs the same process as in FIG. 20B or 20C for pairing. In the process, when the smart shoe wearer feels that the sensor is different from what the wearer feels, the critical pressure correction is requested and provided in a form similar to the UX provided in FIG. 20B or 20C to adjust the critical pressure as the user wants. In this case, the threshold pressure adjusted or corrected by FIG. 20B or 20C is transmitted from the mobile terminal to the smart shoe, and based on this, the controller of the smart shoe appropriately controls the sensor module or reads data sensed by the sensor module. It can be classified or transformed.

On the other hand, in FIG. 20 , pairing is performed to the smart shoe wearer through an action such as a step, but the present invention is not limited to the number of steps or the step itself. can be performed. On the other hand, in addition to the above step, a list for various operations, ie, pairing, etc. may be provided, and the pairing process may be performed according to the operation selected by the user. In this case, the operation selected by the user may be used for later application execution or identification of the corresponding user. Alternatively, if the mobile terminal continues to receive a signal with the smart shoe instead of a predetermined pattern after making a pairing request with the smart shoe, the mobile terminal may automatically pair it. Meanwhile, the mobile terminal may automatically pair the device with the highest signal strength, ie, smart shoes, when a pairing request is made.

On the other hand, in relation to the present invention, the mobile terminal can distinguish the left (L) smart shoe and the right (R) smart shoe through a predetermined gesture input when the sensor of the smart shoe, particularly the gyro sensor, is 3-axis, and the 9-axis In the case of sensors (3 axes of accelerometer, 3 axes of gyro sensor, 3 axes of geomagnetic sensor), there is no need to separate the left (L) smart shoe and right (R) smart shoe separately. can be distinguished.

In addition, in certain cases, such as registering the smart shoe application as a basic application in the mobile terminal, the mobile terminal locks, releases, performs a specific function, and/or performs a specific function of the mobile terminal based on a predetermined operation of the smart shoe wearer. It is also possible to variously perform application execution, control of the executed application, and the like.

In addition, the request, selection, and function performance related to the smart shoe on the mobile terminal may be made in various ways such as voice, gesture, eye-tracking, etc. as well as the touch of the mobile terminal, and a plurality of combinations of the methods may be used. have.

However, FIG. 20 may be performed together with FIG. 19 . For example, after pairing through FIG. 19 , actual data communication start or end may be performed through FIG. 20 or vice versa.

Meanwhile, referring to FIGS. 19 and 20 , when the mobile terminal 1920 is first paired with the smart shoe 1910 or when pairing is performed through an application for smart shoes, the mobile terminal 1920 automatically Pairing can also be performed. However, at this time, in the case of using the smart shoe application in the mobile terminal 1920, a list based on the unique identification data of the smart shoe sensor modules as shown in FIG. 19B is provided at the time of initial pairing. Bluetooth-specific identification data of other mobile terminals, etc. may be filtered from the list to provide selection convenience. In addition, the automatic pairing described above obtains sensing data by setting or in consideration of the user's previous use pattern even without additional user action or input, and calculates various movement data using a tracking algorithm, and obtains and calculates smart shoe data accordingly. , and related UX provision can also be performed automatically.

21 and 22 are diagrams illustrating a sequence diagram for explaining a process of automatically pairing a smart shoe with a plurality of mobile terminals according to an embodiment of the present invention.

For example, FIG. 21 shows a pairing process through a gesture between a mobile terminal and a smart shoe equipped with a 3-axis sensor, and FIG. 22 is a pairing process between a mobile terminal and a smart shoe equipped with a 9-axis sensor through a gesture. shows the process.

First, a pairing process through a gesture between the mobile terminal 2110 and the first smart shoe 2120 and the second smart shoe 2130 will be described in more detail with reference to FIG. 21 . In this case, the first smart shoe 2120 represents, for example, a left (L) smart shoe including a 3-axis based smart shoe sensor module, and the second smart shoe 2130 is, for example, a 3-axis based smart shoe sensor. It may represent the right (R) smart shoe including the module.

The mobile terminal 2110 first transmits a pairing start request signal to the first smart shoe 2120 (S2102). At this time, the first smart shoe 2120 transmits a pairing start request signal of the mobile terminal 2110 to the sensor unit to activate it. The first smart shoe 2120 returns a pairing start response signal in response to the pairing start request signal of the mobile terminal 2110 (S2104). Typically, the returned pairing start response signal of the first smart shoe 2120 includes a response agreeing to the pairing start request.

Next, the mobile terminal 2120 transmits a pairing start request signal to the second smart shoe 2130 (S2106). At this time, the second smart shoe 2130 transmits a pairing start request signal of the mobile terminal 2110 to the sensor unit to activate it. The second smart shoe 2130 returns a pairing start response signal in response to the pairing start request signal of the mobile terminal 2110 (S2108).

Steps S2102 to S2104 or S2106 to S2108 are processes performed when the smart shoe sensor module is mounted on the corresponding shoe. Therefore, if the sensor module is mounted on both smart shoes, all steps S2102 to S2108 may be performed, but if the sensor module is mounted on only one smart shoe, steps S2102 to S2104 or S2106 to Only a predetermined step of step S2108 may be performed. In addition, the order of the steps S2102 to S2104 or the steps S2106 to S2108 may be different from that shown.

Steps S2102 to S2108 described above are, for example, a connection step for pairing, and may be viewed as an initial pairing step.

As such, after performing the initial pairing step, the mobile terminal 2110 provides a UX as shown in FIG. 19 or 20 to attempt pairing with the smart shoe.

Specifically, the mobile terminal 2110 first performs an authentication procedure with the first smart shoe 2120 . Referring to FIG. 20 , the authentication is performed through the smart shoe wearer stepping on the smart shoe corresponding to the first smart shoe a predetermined number of times. At this time, the mobile terminal 2110 counts the number of steps of the first smart shoe 2120 ( S2110 ), and when the predetermined count number is reached, the corresponding smart shoe is authenticated. In this case, the above process may be repeatedly performed in a loop form continuously until authentication is successful.

On the other hand, in the authentication process, for example, if authentication fails more than a predetermined number of times or authentication is not successful within a predetermined time, the repeated authentication process itself is reset to return to the pairing initialization step or executed for pairing on the mobile terminal 2110 It is also possible to terminate the execution of the specified application.

The authentication process for the first smart shoe 2120 of the mobile terminal 2110 is similarly performed for the second smart shoe 2130 (S2112).

When the pairing authentication process for both smart shoes is completed through the above-described steps S2110 and S2112, the mobile terminal 2110 transmits a pairing stop request signal to each smart shoe 2120 and 2130 (S2114, S2118), and the corresponding A response signal to the pairing stop request signal is received from each of the smart shoes 2120 and 2130 (S2116 and S2120).

Through the above-described process, the pairing process is completed and data communication is performed between the mobile terminal 2110 and the smart shoes 2120 and 2130 .

Meanwhile, the process illustrated in FIG. 21 is not necessarily limited to the illustrated order. For example, steps S2106 to S2108 in the above may be performed after step S2110 or step S2114.

Next, a pairing process through a gesture between the mobile terminal 2110 and the first smart shoe 2120 and the second smart shoe 2130 will be described in more detail with reference to FIG. 22 . In this case, the first smart shoe 2120 represents, for example, a left (L) smart shoe including a 9-axis based smart shoe sensor module, and the second smart shoe 2130 is, for example, a 9-axis based smart shoe sensor. It may represent the right (R) smart shoe including the module.

In FIG. 22 as well, the initial stage of pairing between the mobile terminal 2110 and the smart shoes 2120 and 2130 is the same, so the contents described in FIG. 21 are cited and will not be repeated. However, compared to the sensors activated based on the 3-axis sensor in the initial stage of pairing in FIG. 21 , there may be more sensors activated based on the 9-axis sensor in the initial stage of pairing in FIG. 22 .

Meanwhile, in FIG. 22 , after the initial pairing step, that is, the pairing authentication process is different from that of FIG. 21 . For example, in FIG. 21 , the mobile terminal 2110 provides authentication UX and accordingly receives the gesture input of the smart shoe, whereas in FIG. 22 , a different method is used. In other words, the mobile terminal 2110 first detects at least one of the first smart shoe 2120 and the second smart shoe 2130 ( S2210 ).

The mobile terminal 2110 authenticates the searched smart shoes. In this case, it is assumed that both the first smart shoe 2120 and the second smart shoe 2130 are found. The mobile terminal first calculates traces of the first smart shoe 2120 ( S2212 ), and calculates the same traces with respect to the second smart shoe 2130 ( S2214 ). Then, the mobile terminal 2110 compares the calculated traces for the searched first smart shoe 2120 and the second smart shoe 2130 ( S2216 ). Here, for example, the mobile terminal 2110 includes a trace calculation value of each smart shoe stored in advance in the mobile terminal 2110 (or a server, etc.) for authentication and the trace of each smart shoe calculated through the steps S2212 and S2214. Calculated values can be compared. However, the present invention is not limited thereto, and in relation to the comparison, various objects capable of recognizing or authenticating each smart shoe may be used.

As a result of the comparison in step S2216, when authentication fails with respect to at least one of the smart shoes, the mobile terminal 2110 may re-perform the above-described authentication process for the corresponding smart shoe or all smart shoes. In other words, the authentication process may be repeatedly performed in a loop structure. Meanwhile, this repetition may be performed only for a predetermined number of times, and the entire pairing process may be reset and re-performed for the smart shoes or all smart shoes that have finally failed to be authenticated.

As a result of the comparison in step S2216, the mobile terminal 2110 proceeds to the next procedure if each smart shoe is authenticated. Referring to FIG. 22 , the mobile terminal 2110 transmits a 'LEFT' request assignment signal to the first smart shoe 2120 (S2218), and the first smart shoe 2120 sends a 'LEFT and Stop' corresponding assignment signal. is returned (S2220). The request-response process for the first smart shoe is the same for the second smart shoe (S2222, S2224).

Through the above-described process, the pairing process between the mobile terminal 2110 and the smart shoes 2120 and 2130 equipped with the 9-axis sensor may be completed, and data communication may be performed after the pairing is completed.

The above-described pairing process between the smart shoe equipped with a 3-axis sensor, the smart shoe equipped with a 9-axis sensor, and the mobile terminal of FIGS. 21 and 22 described above is only an example and is not necessarily limited to the illustrated sequence. In addition, each pairing sequence shown in FIGS. 21 and 22 may not necessarily be an essential sequence, and at least one sequence may be omitted or skipped, and conversely, at least one sequence may be added according to a system or situation.

Among the processes shown in FIG. 21 , the processes for the first smart shoe 2120 and the second smart shoe 2130 may be performed in reverse. For example, in FIG. 21 , the first smart shoe 2120 accesses the mobile terminal first as compared to the second smart shoe 2130 , but may be the other way around. This is also the same in FIG. 22 .

Meanwhile, in this specification, although it is assumed and described that the sensor module is mounted on both smart shoes, even so, as shown in FIGS. 21 and 22 , pairing initialization, pairing authentication, etc. for each of both smart shoes does not have to be done. For example, when the pairing process is completed with respect to one of the smart shoes, the other shoes may be automatically paired as a set or a pair without an authentication process or the like. If there is an error or problem in the data communication process later, it is sufficient to obtain new authentication or resolve it through re-authentication.

23 is a diagram illustrating a service scenario according to an embodiment of the present invention.

23A shows a smart shoe, and FIG. 23B shows a smart glove. Hereinafter, a brief service scenario will be described after the smart shoe and the smart glove are worn and paired with a mobile terminal.

Referring to FIG. 23 , when a smart application is executed in the mobile terminal after pairing, it is automatically connected at a predefined data sync time point and may go through a sync process. Accordingly, it is convenient for the user to automatically connect the smart shoe or glove sensor without having to perform a pairing process.

Referring to FIG. 23A , in the present invention, by mounting a smart shoe sensor module to each smart shoe, the movements of the left foot and the right foot can be accurately analyzed. Accordingly, it is possible to provide services such as posture and injury prevention by analyzing the body data of each location. For example, after the wearer of smart shoes rolls both feet, if the ground contact time and intensity of each foot are analyzed, it can be used not only for the amount of exercise but also for diagnosing the load of a specific foot and the need for strengthening, etc., and can be used for line touch in sports games, etc. can

Similarly, referring to FIG. 23B , unlike FIG. 23A , in the case where the user wears smart gloves, data analysis is performed on the swing speed of each arm, the strength of hitting a specific object, etc. after first separating the hands such as crossing the hands. This enables coaching services to prevent injuries and improve performance. In addition, the load for both hands may be calculated separately. For example, various data analysis and coaching services may be provided by using such smart gloves in a sports game in which hands are mainly used.

Meanwhile, although not shown, when smart shoes and smart gloves are worn at the same time, automatic pairing and syncing process may be performed with reference to the above-described contents of the present invention, and comprehensive body condition, rhythm, etc. may be identified and serviced.

According to the above-described various embodiments of the present invention, each or a combination thereof, data communication between a plurality of devices and a preliminary process for it can be easily and quickly performed, and the functions of terminals such as smart shoes and mobile terminals are expanded and performance is improved. Not only can it be improved, but it also has the effect of improving product satisfaction by enhancing usability.

It is apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit and essential characteristics of the present invention.

The above detailed description should not be construed as restrictive in all respects but as illustrative. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are included in the scope of the present invention.

240: sensor unit 243: motion sensor
244: acceleration sensor 245: gyro sensor
246: pressure sensor 270: memory
280: control unit 290: power supply unit
310: sole frame 311: insole
312: midsole 313: outsole
630: conductive member 650: main board
651: first circuit part 6511: contact terminal

Claims (10)

In a mobile terminal performing data communication with smart shoes,
Memory;
a communication unit for exchanging a signal with the smart shoe;
Control the execution of the smart shoe application, pair with the smart shoe when the smart shoe application is executed, and receive the motion data of the smart shoe wearer sensed by the smart shoe from the smart shoe after the pairing to collect the received motion data a control unit controlling to analyze and output the analysis result; and
An output unit for outputting the application execution screen, UX for pairing with the smart shoe, and the analysis result,
The smart shoes are
Consists of a pair of left (L) smart shoes and right (R) smart shoes,
A sensor module is mounted on at least one of the left (L) smart shoes and the right (R) smart shoes,
The control unit is
When the smart shoe application is executed, for pairing with the smart shoe, the smart shoe is searched for based on a specific communication protocol, and the smart shoe is authenticated by calculating a trace based on a signal received from a sensor module of the retrieved smart shoe. and pairing with certified smart shoes
mobile terminal. delete According to claim 1,
The control unit is
When the smart shoe application is executed, for pairing with the smart shoe, the output unit is controlled to output a list of pairable terminals according to a specific communication protocol on the screen or to output a UX related to a specific method predefined for the smart shoe and, authenticating and pairing the smart shoe according to the gesture or selection of the smart shoe wearer. delete 4. The method of claim 3,
The control unit is
store the unique identification data of the smart shoe in the memory after the initial pairing;
Thereafter, when the smart shoe application is re-executed, the mobile terminal is automatically paired without the authentication process, receives motion data sensed from the sensor module of the smart shoe, and outputs the processed data. In the smart shoe system,
a smart shoe comprising a left (L) smart shoe and a right (R) smart shoe pair, wherein at least one of the left (L) smart shoe and the right (R) smart shoe includes a sensor module; and
A memory, a communication unit that sends and receives signals to and from the smart shoe, controls execution of a smart shoe application, pairs with the smart shoe when the smart shoe application is executed, and a smart shoe wearer sensed by the smart shoe from the smart shoe after the pairing A control unit configured to receive the motion data of , analyze the received motion data and control to output the analysis result, and an output unit for outputting the application execution screen, UX for pairing with the smart shoe, and the analysis result mobile terminal;
including,
The control unit is
When the smart shoe application is executed, for pairing with the smart shoe, the smart shoe is searched for based on a specific communication protocol, and the smart shoe is authenticated by calculating a trace based on a signal received from a sensor module of the retrieved smart shoe. and pairing with certified smart shoes
Smart shoe system. 7. The method of claim 6,
The control unit is
When the smart shoe application is executed, for pairing with the smart shoe, the output unit is controlled to output a list of pairable terminals according to a specific communication protocol on the screen or to output a UX related to a specific method predefined for the smart shoe and, authenticating and pairing the corresponding smart shoe according to the gesture or selection of the smart shoe wearer. delete 8. The method of claim 7,
The control unit is
store the unique identification data of the smart shoe in the memory after the initial pairing;
Thereafter, when the smart shoe application is re-executed, the smart shoe system is automatically paired without the authentication process, and receives the motion data sensed from the sensor module of the smart shoe and outputs the processed data. 7. The method of claim 6,
The mobile terminal,
The smart shoe application is downloaded or installed or includes all possible terminals,
A smart shoe system comprising a smartphone, a wearable device, a PC, and a digital TV.

Images