CN113546402A

CN113546402A - Intelligent shoe and intelligent wearable device

Info

Publication number: CN113546402A
Application number: CN202110839717.5A
Authority: CN
Inventors: 牟森林; 郑学龙; 陈仲军
Original assignee: Guangzhou Ouyou Network Technology Co ltd
Current assignee: Guangzhou Oujia Technology Co ltd
Priority date: 2021-07-23
Filing date: 2021-07-23
Publication date: 2021-10-26

Abstract

The invention provides an intelligent shoe and intelligent wearing equipment, wherein the intelligent shoe comprises a shoe body, a distance measuring sensor and a control device, wherein the distance measuring sensor and the control device are arranged in the shoe body; the distance measuring sensor is arranged at the heel part of the shoe body and used for transmitting infrared signals to the upper part of the heel part and calculating and acquiring distance data based on the return signals; the control device includes: the control unit is used for receiving the distance data acquired by the distance measuring sensor, and triggering a squatting instruction representing the detected squatting action when the acquired distance data meet the judgment condition of a preset squatting data model; and the communication unit is used for sending the squat instruction to the terminal equipment in a wireless connection state so that the control unit and the terminal equipment realize interaction based on the squat instruction. The intelligent shoe can calculate and obtain a squatting instruction for representing whether to squat or not by obtaining the distance data, and interacts with the terminal equipment through the squatting instruction.

Description

Intelligent shoe and intelligent wearable device

Technical Field

The invention relates to the technical field of motion recognition, in particular to an intelligent shoe and intelligent wearing equipment with the intelligent shoe.

Background

In recent years, with the rise of AR and VR technologies, motion sensing games have been popular with people because of their excellent realistic experiences. In the motion sensing game, by capturing various gesture motions of a human body, gesture changes of a character in the motion sensing game or special effect output can be controlled.

In order to capture various gesture actions of a human body, a corresponding game device is generally required to be configured for the motion sensing game so as to accurately control the motion of the motion sensing game. For example, when a player is provided with two handles, and each of the two hands of the player holds one handle, the handles detect the movement path of the arm to control the arm of the character of the motion sensing game to perform the same movement path, thereby achieving good game control.

However, the squat action is always a difficulty in motion detection in the motion sensing game, and in the industry, a plurality of cameras are arranged indoors, the motion action of the human body is captured in real time through the cameras, the human body action obtained by the cameras is analyzed through a computer to obtain the squat action, and then the squat action is output by the computer to control the motion of the motion sensing game. However, in this squat motion detection method, a plurality of cameras need to be arranged indoors, so that the economic cost of a player is greatly increased, and a computer needs to perform complicated calculation and analysis to recognize squat motions, so that the operation load of the computer is increased, the situation that the calculation time is too long easily occurs, the squat motions cannot be timely output to a motion sensing game, the operation of the motion sensing game is controlled, and the experience of the motion sensing game is affected. Moreover, when the human body moves to the blind area of the camera, the camera cannot capture the human body action, and further cannot acquire the squat action, so that the operation of the motion sensing game is controlled, and the motion sensing game is greatly restricted.

In order to solve the problem, the industry also provides that a motion sensor is arranged in a shoe of a player to acquire the squatting data of the human body in real time and control the operation of the motion sensing game. However, whether the human body squats is generally difficult to accurately judge through the motion data acquired by the motion sensor arranged in the shoe, and the misjudgment condition is easy to occur, so that the squat data is output when the human body does not squat, and the squat data is not output when the human body squats, so that the experience of the motion sensing game is poor.

Disclosure of Invention

The first purpose of the invention is to provide an intelligent shoe capable of accurately judging squatting actions.

The invention further aims to provide the intelligent wearing equipment suitable for the intelligent shoe.

In order to meet various purposes of the invention, the invention adopts the following technical scheme:

the invention provides an intelligent shoe which is suitable for the first purpose and comprises a shoe body, a distance measuring sensor and a control device, wherein the distance measuring sensor and the control device are arranged in the shoe body;

the distance measuring sensor is arranged at the heel part of the shoe body and used for transmitting infrared signals to the upper part of the heel part and calculating and acquiring distance data based on the return signals;

the control device includes:

the control unit is used for receiving the distance data acquired by the distance measuring sensor, and triggering a squatting instruction representing the detected squatting action when the acquired distance data meet the judgment condition of a preset squatting data model;

and the communication unit is used for sending the squat instruction to the terminal equipment in a wireless connection state so that the control unit and the terminal equipment realize interaction based on the squat instruction.

Further, the angle between the ray of the infrared signal emitted by the distance measuring sensor and the virtual vertical plane of the heel part perpendicular to the sole is 10-75 degrees.

Preferably, the angle between the ray of the infrared signal emitted by the distance measuring sensor and the virtual vertical plane of the heel part perpendicular to the sole is 15 degrees or 30 degrees or 45 degrees.

Specifically, the ranging sensor comprises an infrared signal transmitting port and a return signal receiving port, and the transmitting port and the receiving port are exposed to the heel part.

Specifically, the distance measuring sensor further comprises a microprocessor, a timer, an infrared transmitting part arranged in the transmitting port and a signal receiving part arranged in the receiving port, the timer sends a driving signal to the microprocessor at intervals to drive the microprocessor to control the infrared transmitting part to transmit an infrared signal, the signal receiving port outputs a received return signal to the microprocessor, and the microprocessor calculates and acquires distance data between the distance measuring sensor and an obstacle based on the return signal.

Preferably, the wavelength of the infrared signal is 900-940 nm.

Preferably, the control unit is configured to control the character in the application program run by the terminal device to make posture adjustment through a squat instruction sent by the communication unit to the terminal device.

Furthermore, a pressure sensor is arranged in the shoe body, the pressure sensor and the control device are arranged in an insole layer of the shoe body, the pressure sensor arranged in the insole layer is pressed to output a pressure signal to the control unit, and the control unit receives the pressure signal and drives the distance measuring sensor to measure distance at regular time to continuously acquire distance data.

Specifically, be equipped with on the rear heel of the shoes body and be used for the holding ranging sensor's holding chamber with be used for sealing the shell in holding chamber, the shell is equipped with the through-hole on infrared signal and passback signal's transmission path, the shell with connect through joint or zip fastener between the holding chamber.

The intelligent wearing equipment comprises a pair of intelligent shoes with the first purpose, the pair of intelligent shoes carry out data interaction through respective communication units, the second intelligent shoes send the obtained squatting instructions to the control unit of the first intelligent shoes, and when the control unit of the first intelligent shoes simultaneously obtains the respective squatting instructions of the pair of intelligent shoes, the control unit sends the squatting instructions to the terminal equipment through the communication unit.

Compared with the prior art, the invention has the following advantages:

firstly, the distance data is detected by the distance measuring sensor arranged at the heel part of the intelligent shoe, the distance data acquiring mode is simple, convenient and effective, and the distance data can be detected in real time. When the user squats, the infrared signals emitted to the hip or thigh direction of the user by the distance measuring sensor arranged on the heel part are reflected back by the hip or thigh of the user, so that the distance measuring sensor obtains return signals, and the distance between the distance measuring sensor and the hip or thigh of the user when the user squats can be calculated according to the return signals, so that whether the user squats or not is determined.

Secondly, the intelligent shoe sends the obtained squat instruction to the terminal device to interact with the terminal device based on the squat instruction, so that the user obtains good experience of the motion sensing game, and the interestingness is enhanced.

Thirdly, the intelligent shoe is simple in structure and convenient for large-scale production and manufacturing. And the intelligent shoe has simple flow for detecting whether the user squats or not, and can reduce the calculation amount of squat detection.

Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.

Drawings

The foregoing and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

FIG. 1 is a schematic circuit diagram of the intelligent shoe of the present invention

Fig. 2 is a schematic structural view of the intelligent shoe of the present invention.

Fig. 3 is a schematic view of the intelligent shoe of the present invention being worn on the foot of a user.

Fig. 4 is a schematic structural view of a distance measuring sensor of the intelligent shoe of the present invention.

Fig. 5 is a schematic flow chart of a squat action recognition method of the present invention.

Fig. 6 is a flowchart illustrating step S11 of the squat motion recognition method according to the present invention.

Fig. 7 is a flowchart illustrating step S12 of the squat motion recognition method according to an embodiment of the present invention.

Fig. 8 is a flowchart illustrating a step S12 of a squat motion recognition method according to another embodiment of the present invention.

FIG. 9 is a schematic view of distance data collected by a distance measuring sensor using the intelligent shoe of the present invention.

Fig. 10 is a flowchart illustrating step S13 of the squat motion recognition method according to an embodiment of the present invention.

Fig. 11 is a flowchart illustrating a step S13 of a squat motion recognition method according to another embodiment of the present invention.

Fig. 12 is a schematic structural view of the squat motion recognition apparatus of the present invention.

Detailed Description

As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combinations of one or more of the associated listed items.

It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

The person skilled in the art will know this: although the various methods and apparatus of the present invention have been described based upon the same general concepts that are common to each other, they may operate independently unless otherwise specified. In the same way, for the embodiments disclosed in the present invention, the same inventive concept is proposed, and therefore, concepts expressed in the same and, although the concepts expressed in the same are different, those merely changed appropriately for convenience should be equally understood.

The invention provides a squat action recognition method, which is used for recognizing squat actions of a user and generating computer instructions related to the squat actions of the user. The user can interact with the external electronic equipment in real time by making a squatting action to participate in various electronic data activities. For example, when the motion sensing game is controlled through the intelligent shoe, the external electronic device acquires the squat action of the user through the intelligent shoe, further determines the action executed by the user in the interaction process of the motion sensing game on the basis, analyzes the action into an action instruction, executes corresponding feedback, and ensures that the human-computer interaction operation is realized between the user and the motion sensing game.

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

In an exemplary embodiment of the present invention, referring to fig. 1 and 2, the present invention provides an intelligent shoe 10 suitable for detecting a squat action, wherein the intelligent shoe 10 includes a shoe body 11, a distance measuring sensor 12 disposed in the shoe body 11, and a control device 13.

The distance measuring sensor 12 is disposed on the heel portion 111 of the shoe body 11, and the distance measuring sensor 12 is configured to emit an infrared signal above the heel portion 111, receive a return signal of the infrared signal reflected back, and calculate a distance to an obstacle based on the return signal. The distance measuring sensor 12 outputs distance data acquired based on the return signal to the control device 13, the control device 13 calculates and analyzes whether the user squats or not based on the distance data, converts the acquired squat data into a squat instruction, and then sends the squat instruction to the terminal device, so that human-computer interaction between the user and the terminal device is achieved based on the squat instruction.

With reference to fig. 3, the principle of detecting the squat action of the user by the distance measuring sensor 12 is as follows: when a user squats, thighs and buttocks of the user naturally tilt backwards, which is a characteristic inevitably generated when the human body performs the squat action. When the user squats, the squat buttocks or thighs will block the infrared signals emitted by the distance measuring sensor 12, the infrared signals are blocked by the buttocks or thighs of the user and then return signals to the distance measuring sensor 12, and the distance measuring sensor 12 can calculate the distance between the distance measuring sensor 12 and the buttocks or thighs of the user according to the return signals. The distance data acquired by the distance measuring sensor 12 is output to the control device 13, and when the distance data meets the judgment condition of the squat data model, it can be judged that the user has performed squat action.

Referring to fig. 3, the infrared signal emitted from the distance measuring sensor 12 is at an angle of 10 ° to 75 ° with respect to a virtual vertical plane perpendicular to the shoe sole in the heel 111. When the user stands, the buttocks or the thighs of the user are vertical or approximately vertical to the shoe body 11, that is, the buttocks or the thighs of the user are parallel or approximately parallel to the virtual vertical plane, so that when the angle between the ray of the infrared signal emitted by the distance measuring sensor 12 and the virtual vertical plane is between 10 ° and 75 °, the infrared signal emitted by the distance measuring sensor 12 is not blocked by the buttocks or the thighs of the user in a standing state and returns to a return signal, and the distance measuring sensor 12 does not receive the corresponding return signal, so that the user can be judged to be in the standing state.

When the user squats, the angle between the dummy vertical plane and the dummy line between the user's buttocks or thighs and the ranging sensor is between 10 ° and 75 °, so that the ranging sensor 12 is disposed at 10 ° to 75 ° to the vertical plane, so that the infrared signal emitted from the ranging sensor 12 can be blocked by the user's buttocks or thighs to return an echo signal to the ranging sensor 12.

Preferably, the angle between the ray of the infrared signal emitted from the distance measuring sensor 12 and the virtual vertical plane perpendicular to the heel 111 and the sole is 15 ° or 30 ° or 45 °, so that the infrared signal emitted from the distance measuring sensor 12 can be blocked by the user's buttocks or thighs when the user squats down to reflect the echo signal to the distance measuring sensor 12.

Specifically, in conjunction with fig. 1, the ranging sensor 12 includes an infrared emitting portion 121 for emitting a signal, a signal receiving portion 122 for receiving a return signal, a microprocessor 123, and a timer 124. The microprocessor 123 controls the infrared emitting part 121 to emit an infrared signal to the outside, the signal receiving part 122 receives a return signal reflected by the infrared signal, the signal receiving part 122 outputs the obtained return signal to the microprocessor 123, and the microprocessor 123 calculates distance data between the obstacle based on the return signal. The specific way of calculating the distance data is that the microprocessor 123 calculates the time T from the infrared signal sent by the infrared emitting unit 121 to the return signal reflected by the infrared signal hitting the obstacle received by the signal receiving unit 122, and if the emitting speed of the infrared signal and the return signal is the light speed C, the distance data S between the distance measuring sensor 12 and the obstacle is (C x T)/2. The microprocessor 123 acquires the distance data and transmits the distance data to the control device 13. The wavelength of the infrared signal and the wavelength of the return signal are between 900mm and 940 mm.

The timer 124 is used for controlling the emission interval of the infrared emission part 121, and specifically, the timer 124 is electrically connected to the microprocessor 123, the timer 124 sends a driving signal to the microprocessor 123 at intervals, and the microprocessor 123 controls the infrared emission part 121 to emit an infrared signal after receiving the driving signal.

Referring to fig. 4, the ranging sensor 12 is further provided with a transmitting port 125 for protecting the infrared transmitting part 121 and a receiving port 126 for protecting the signal receiving part 122. The emitting port 125 and the receiving port 126 are exposed to the rear heel 111 of the shoe body 11, so that the infrared emitting portion 121 can directly emit infrared signals to the outside of the shoe body 11, and the signal receiving portion 122 can directly receive return signals from the outside without being blocked by the shoe body 11.

In an embodiment, referring to fig. 2, an accommodating cavity 112 for accommodating the distance measuring sensor 12 and a housing for closing the accommodating cavity 112 are provided on the heel portion 111, the distance measuring sensor 12 is fixedly disposed in the accommodating cavity 112, and the housing is connected to the accommodating cavity 112 by a snap-fit connection or a zipper connection, so as to facilitate installation or removal of the distance measuring sensor 12. And, the housing is provided with through holes on the transmission path of the infrared signal and the return signal, and the transmitting port 125 and the receiving port 126 are correspondingly disposed in the two through holes, respectively, so as to transmit the infrared signal and receive the return signal.

With reference to fig. 1, the control device 13 includes a control unit 131 and a communication unit 132. The control unit 131 is electrically connected with the microprocessor 123 of the distance measuring sensor 12, the microprocessor 123 outputs the acquired distance data to the control unit 131, the control unit 131 guides the acquired distance data into a preset squat data model, and when the distance data meets the judgment condition of the squat data model, a squat instruction representing squat action is triggered. The communication unit 132 is preferably bluetooth or other near field communication technology, although communication mechanisms based on mobile communication, WiFi, etc. are not excluded, and those skilled in the art can flexibly select the communication mechanism.

The control unit 131 sends the obtained squat instruction to the terminal device via the communication unit 132, so that the control unit 131 and the terminal device implement interaction based on the squat instruction. And after receiving the squat instruction, the terminal equipment controls the role in the application program running in the terminal equipment to make corresponding posture adjustment. For example, after receiving a squat instruction, the terminal device controls a character of the motion sensing game running therein to perform a squat action.

In one embodiment, referring to fig. 1, the intelligent shoe 10 is further provided with a pressure sensor 14, the pressure sensor 14 is disposed in an insole layer of the shoe body 11, the pressure sensor 14 is electrically connected to the control unit 131, and the pressure sensor 14 is used for driving the control unit 131 to work. When the user wears the intelligent shoe 10, the foot of the user generates pressure on the pressure sensor 14 disposed in the insole layer, the pressure sensor 14 is pressed to acquire a pressure signal, the pressure sensor 14 outputs the acquired pressure signal to the control unit 131, and the control unit 131 receives the pressure signal and drives the distance measuring sensor 12 to measure distance at regular time to continuously acquire the distance data.

The invention also provides intelligent wearing equipment which comprises a pair of the intelligent shoes, wherein the two shoes of the pair of the shoes are respectively called as a first intelligent shoe and a second intelligent shoe. When a user feels a game in a body, usually, the user wears the first intelligent shoe and the second intelligent shoe at the same time, the two intelligent shoes can be preset as a main-slave relation when leaving a factory, so that the two intelligent shoes can be mutually backed up when necessary, and when the user works, the first intelligent shoe can be used for establishing wireless communication connection with the terminal equipment, the second intelligent shoe only needs to synchronize a squatting instruction generated by the second intelligent shoe to the first intelligent shoe, and the first intelligent shoe is used for carrying out related judgment and outputting data to the terminal equipment.

The two intelligent shoes are in wireless communication through respective communication units so as to carry out data interaction. The communication unit of the first intelligent shoe outputs the received second squat instruction to the control unit of the first intelligent shoe; if the first intelligent shoe obtains the squat instruction (called as a first squat instruction) through detecting the distance data, the first intelligent shoe encapsulates the first squat instruction and the second squat instruction into a squat instruction, and the squat instruction is sent to the terminal equipment through the communication unit of the first intelligent shoe so as to perform human-computer interaction with the terminal equipment based on the squat instruction. That is, when the control unit of the first intelligent shoe receives the respective squat command of the pair of intelligent shoes at the same time, the control unit sends the squat command to the terminal device through the communication unit.

It is understood that, in an embodiment, the master-slave relationship between the first intelligent shoe and the second intelligent shoe may be switched or a disaster-backup relationship may be formed at any time, that is, when the communication link between the first intelligent shoe and the terminal device is disconnected, a control instruction may be sent to control the second intelligent shoe to establish a communication link with the terminal device, instead of the first intelligent shoe communicating with the terminal device. In this case, the second smart shoe and the first smart shoe are exchanged in roles. Therefore, those skilled in the art should understand that the serial numbers of the first intelligent shoe and the second intelligent shoe are assigned to the roles played by the intelligent shoes, and are not specific to the intelligent shoes.

In an exemplary embodiment of the invention, in combination with the intelligent shoe, the invention provides a squatting action identification method based on the intelligent shoe, which outputs a squatting instruction representing a squatting action after calculation and judgment by acquiring distance data acquired by a distance measuring sensor. With reference to fig. 5, the squat motion recognition method includes the following steps:

step S11, monitoring distance data provided by a distance measuring sensor, wherein the distance data is obtained by calculating after the distance measuring sensor fixedly arranged at the heel part of the first intelligent shoe emits an infrared signal to the upper part of the heel part and detects a return signal thereof:

the control unit drives the ranging sensor to perform ranging, and particularly controls a microprocessor of the ranging sensor to work, the microprocessor drives an infrared emitting part to emit an infrared signal outwards, the infrared signal is blocked by an obstacle and returns a return signal, a signal receiving part receives the return signal and outputs the return signal to the microprocessor, and the microprocessor calculates distance data between the microprocessor and the obstacle based on the return signal and outputs the acquired distance data to the control unit.

The microprocessor continuously controls the infrared emitting part to emit infrared signals so as to continuously monitor the distance between the ranging sensor and the obstacle and continuously output the acquired distance data to the control unit.

In one embodiment, the control unit is further electrically connected with a timer of the distance measuring sensor, the control unit outputs a timing signal to the timer, and the timer controls the microprocessor to drive the infrared emission part to emit the infrared signal at the time interval according to the timing signal, so that the infrared emission part can continuously emit the infrared signal at the fixed time interval.

With reference to fig. 6, step S11 in one embodiment further includes the following steps:

step S111, receiving the pressure signal of the pressure sensor, analyzing pressure data:

when the user does not wear the intelligent shoe, the user does not need to detect distance data through the distance measuring sensor to calculate and obtain a squatting instruction. When the user wears the intelligent shoes, whether the user squats or not needs to be detected. When being provided with pressure sensor in the intelligent shoes, user's self weight will produce pressure to the pressure sensor who sets up in the shoe-pad in-layer of intelligent shoes, and pressure sensor pressurized acquires pressure signal, and pressure sensor exports the pressure signal who acquires to the control unit, and the control unit analysis the pressure data that pressure signal obtained.

Step S112, judging that the current shoe body is in a pressed state when the received pressure data is larger than a preset threshold value:

when a human body wears the intelligent shoe, the weight of the user can generate pressure on the intelligent shoe, generally speaking, different pressure is generated on the intelligent shoe according to the weight of the human body, and when the user does not wear the intelligent shoe, the weight generated on the intelligent shoe is different from the weight generated when the user wears the intelligent shoe. Therefore, the control unit presets a pressure threshold value based on the lowest weight of the user, and when the pressure data analyzed by the control unit from the pressure signal acquired by the pressure sensor is greater than the pressure threshold value, the intelligent shoe is characterized to be worn by the user; otherwise, the characteristic is that no user wears the intelligent shoe.

And S113, controlling the distance measuring sensor to carry out timing distance measurement to continuously acquire the distance data when the current shoe body is in a pressed state.

When the pressure data acquired by analyzing the pressure signal by the control unit is larger than the pressure threshold value, the control unit controls the microprocessor of the distance measuring sensor to control the infrared emitting part to emit the infrared signal. The control unit outputs control signals to the microprocessor at regular time so as to drive the microprocessor to drive the infrared emission part at regular time to implement ranging. Thus, the control unit may control the ranging sensor to perform a timed ranging to continuously acquire the distance data.

In one embodiment, the control unit controls a timer of the distance measuring sensor, the control unit outputs a timing signal to the timer, the timer receives the timing signal and then sends a driving signal to the microprocessor at a timing, and the microprocessor receives the driving signal and then drives the infrared emitting part to emit an infrared signal. Thus, the control unit may control the ranging sensor to perform a timed ranging to continuously acquire the distance data.

Step S12, a sliding window with fixed sampling duration is started for a distance sequence formed by the sequentially arranged distance data to obtain sequence local data, whether a plurality of distance data in the sequence local data meet the judgment condition of a preset squat data model is judged, and when the distance data meet the judgment condition, a squat instruction for representing the detected squat action is triggered:

the microprocessor of the distance measuring sensor sequentially sends the acquired distance data to the control unit according to the time sequence, and the control unit sequentially arranges all the acquired distance data according to the time sequence to form a distance sequence. The control unit sets a sliding window with fixed sampling duration, and collects a plurality of distance data in the distance sequence within the fixed sampling duration into the sliding window to form sequence local data. If all the distance data in the sequence local data meet the judgment condition of the squat data model, representing that the user is in a squat state within the fixed sampling duration of the sliding window, and acquiring a squat instruction representing squat action by the control unit; otherwise, the user is not in the squatting state, and the control unit does not acquire a squatting instruction representing the squatting action.

Referring to fig. 9, fig. 9 shows a distance sequence formed by arranging distance data acquired by the distance measuring sensor in time sequence by the control unit when the user wears the intelligent shoe indoors, and the distance data of the distance sequence in fig. 9 are connected by a connection line. In fig. 9, a portion 01 is a distance between the ranging sensor and the ceiling of the room, and

portions

02, 03 and 04 are distances between the user's buttocks or thighs and the ranging sensor when the user squats down.

Specifically, when the ranging sensor returns the range data acquired by transmitting the infrared signal back to the return signal, the infrared signal and the return signal may be interfered by various factors. For example, the infrared signal or the return signal undergoes multiple reflections, which results in a prolonged time for the ranging sensor to receive the return signal, and thus makes the distance data acquired by the microprocessor of the ranging sensor inaccurate. In order to avoid inaccuracy of the distance data acquired by the microprocessor, the control unit performs denoising processing on the acquired distance data after receiving the plurality of distance data acquired by the microprocessor, and then constructs the distance sequence. Referring to fig. 7, the control unit performs the denoising process on the acquired distance data as follows:

step S121, sequentially receiving a plurality of distance data sent by the distance measuring sensor:

the control unit receives the distance data sent by the microprocessor of the distance measuring sensor in sequence.

Step S122, performing filtering processing on the plurality of distance data, removing distance data as noise:

and sequentially carrying out filtering operations such as amplitude limiting filtering, arithmetic mean filtering, first-order inertia filtering and the like on all the acquired distance data so as to remove the distance data serving as noise in the acquired distance data and avoid interfering the judgment of squatting motion.

The control unit sorts the remaining distance data in time order after removing the distance data as noise to constitute the distance series. That is, the distance sequence is composed of distance data arranged sequentially one by one.

The user needs a certain time to perform the squat action or release the squat action, and the squat action cannot be completed in a moment. Therefore, a fixed sampling time length is set according to the characteristic that a user needs a certain time to squat or release the squat, the fixed sampling time length corresponds to the distance sequence, and the distance sequence is divided into a plurality of sequence local data according to the fixed sampling time length. The control unit sets a sliding window with a fixed sampling duration to acquire sequence local data from the distance sequence in time sequence. When all data in the sequence of local data meet the judgment condition of the squatting data model, the user is determined to be in a squatting state within the fixed sampling duration of the sequence of local data, and the control unit acquires a squatting instruction; otherwise, the user is not in the squatting state, and the control unit does not acquire the squatting instruction.

Specifically, with reference to fig. 8, the step of determining whether the sequence local data satisfies the decision condition of the squat data model includes the following specific steps:

step S123, obtaining a squat distance range defined by the squat data model and composed of a squat distance maximum value and a squat distance minimum value:

the squat data model includes a squat distance maximum and a squat distance minimum. When the human body is in a squatting state, the distance between the hip or thigh of the human body and the ranging sensor is within a fixed range, and the fixed range can be obtained through experimental measurement. Therefore, the maximum value and the minimum value between the hip or the thigh of the human body and the ranging sensor can be obtained when the human body squats. This maximum value is used as the maximum squat distance value of the squat data model, and this minimum value is used as the minimum squat distance value of the squat data model, which maximum squat distance value and minimum squat distance value constitute the two end points of the squat distance range of the squat data model.

Step S124, if all distance data in the sequence local data are within the squat distance range, determining that the judgment condition of the squat data model is satisfied:

when all the distance data in the sequence local data acquired by the sliding window are in two end points of the squat distance range of the squat data model, the fact that the user is in a squat state within the fixed sampling duration is represented, and the control unit acquires a squat instruction.

Step S13, sending the squat instruction to the terminal equipment in wireless connection state with the local machine, so as to realize interaction based on the squat instruction with the terminal equipment:

and after the control unit acquires the squat instruction, the communication unit sends the squat instruction to the terminal equipment so that the control unit realizes interaction with the terminal equipment based on the squat instruction.

Furthermore, when the intelligent shoe implementing the method is used for interacting with terminal equipment such as an intelligent television, a mobile terminal and a game machine, the intelligent shoe can be used as an input device for user instructions. In this case, the control unit of the intelligent shoe establishes communication connection with the terminal device through the communication unit, and outputs a squatting instruction obtained after the control unit recognizes the squatting action to the terminal device in real time. When the terminal devices start the related game programs or the health data APP, the squatting instructions can also be regarded as related user instructions or user data, correspondingly, the program processes of the terminal devices respond to the squatting instructions and can also feed back information or send notification to the intelligent shoes, for example, a notification instruction for controlling vibration warning of a vibration sensor of the intelligent shoes is sent, and the like.

In a game scene applying the invention, after the posture of the user is determined to face, the intelligent shoe can output a squatting instruction of the user to terminal equipment such as an intelligent television, a mobile terminal and a game machine through the communication unit, and after the terminal equipment receives the squatting instruction of the user, a computer control instruction can be generated based on the data so as to guide the user to carry out man-machine interaction control on the terminal equipment and improve the interestingness of the game.

In one embodiment, the control unit in connection with fig. 10 implementing the interaction with the terminal device based on the squat instruction comprises the following steps: step S14, controlling the role in the application program operated by the terminal equipment to make posture adjustment based on the squatting action instruction:

the application program running on the terminal equipment is a motion sensing game, the control unit sends the obtained squat instruction to the terminal equipment through the communication unit, and the terminal equipment controls game roles in the motion sensing game to make corresponding posture adjustment or release a corresponding special effect based on the squat instruction. For example, the terminal device controls a game character in the motion sensing game to perform a squat action based on a squat instruction.

In one embodiment, when the user uses the above-mentioned intelligent wearable device, if the user outputs a squat instruction to the terminal device, the user only needs to output the squat instruction to the terminal device after a pair of intelligent shoes of the intelligent wearable device simultaneously acquire the squat instruction. Specifically, in conjunction with fig. 11, the following steps are included:

s131, monitoring and receiving a squatting instruction triggered by the second intelligent shoe based on the implementation of the method;

the control unit of second intelligent shoes obtains based on distance data the instruction of squatting (being called the second instruction of squatting), the control unit of second intelligent shoes will obtain the second instruction of squatting and send the communication unit of first intelligent shoes to through its communication unit, the communication unit of first intelligent shoes will obtain the second instruction of squatting and export the control unit of first intelligent shoes.

Step S132, judge whether receive first intelligent shoes and second intelligent shoes respectively in the same time the instruction of squatting, when two intelligent shoes all output the instruction of squatting, just send the instruction of squatting to terminal equipment:

when the control unit of the first intelligent shoe obtains a second squat instruction output by the second intelligent shoe, if the control unit of the first intelligent shoe obtains the squat instruction (called as a first squat instruction) based on the distance data of the distance measuring sensor, the control unit of the first intelligent shoe packages the two squat instructions into one squat instruction and outputs the squat instruction to the terminal equipment; otherwise, the squat instruction is not sent to the terminal equipment.

From this, if the user dresses two intelligent shoes of intelligent wearing equipment, obtain the instruction of squatting simultaneously through two intelligent shoes, can be better judge whether the user has carried out the action of squatting.

The invention also provides a squatting action recognition device which is used for judging whether a user squats or not. With reference to fig. 12, the squat motion recognition apparatus includes the following modules:

the monitoring unit 100 is used for monitoring distance data provided by a distance measuring sensor, wherein the distance data is obtained by calculating after the distance measuring sensor fixedly arranged at the heel part of the first intelligent shoe emits an infrared signal to the upper part of the heel part and detects a return signal of the infrared signal;

a judging unit 200, configured to start a sliding window with a fixed sampling duration for a sequentially arranged distance sequence formed by the distance data to obtain sequence local data, judge whether a plurality of distance data in the sequence local data satisfy a preset judgment condition of a squat data model, and trigger a squat instruction representing that a squat action is detected when the plurality of distance data satisfy the judgment condition;

and the interaction unit 300 is configured to send the squat instruction to the terminal device in a wireless connection state with the local device, so as to implement interaction based on the squat instruction with the terminal device.

The invention also provides terminal equipment suitable for the squatting action identification method, and the terminal equipment is in wireless connection with the intelligent shoes. At least one process running in the terminal device triggers another computer event in response to the squat instruction, and controls the role in the application program to make a corresponding posture adjustment based on the squat instruction.

The invention also provides a computer device which is wirelessly connected with the intelligent shoe as described in the above, wherein at least one process running in the computer device responds to the event notification and triggers another computer event to change the self-executed business process.

The present application further provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the squat action recognition method as described above. The storage medium may include: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

In summary, the intelligent shoe of the invention can calculate and obtain the squat instruction for representing whether squat or not by obtaining the distance data, and interact with the terminal equipment through the squat instruction.

Because the situation is complicated and cannot be illustrated by a list, a person skilled in the art can realize that many examples exist according to the basic method principle provided by the application and the practical situation, and the protection scope of the application should be protected without enough inventive work.

The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.

Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

The principles and embodiments of the present application are explained herein using specific examples, which are provided only to help understand the method and the core idea of the present application. It should be noted that, for those skilled in the art, it is possible to make several improvements and modifications to the present application without departing from the principle of the present application, and such improvements and modifications also fall within the scope of the claims of the present application.

It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

Claims

1. An intelligent shoe is characterized by comprising a shoe body, a distance measuring sensor and a control device, wherein the distance measuring sensor and the control device are arranged in the shoe body;

the control device includes:

2. The intelligent shoe according to claim 1, wherein the angle between the ray of the infrared signal emitted by the distance measuring sensor and the virtual vertical plane of the heel portion perpendicular to the sole is between 10 ° and 75 °.

3. The intelligent shoe according to claim 2, wherein the angle between the ray of the infrared signal emitted by the distance measuring sensor and the virtual vertical plane of the heel portion perpendicular to the sole is 15 ° or 30 ° or 45 °.

4. The intelligent shoe according to claim 2, wherein the ranging sensor comprises a transmitting port for infrared signals and a receiving port for return signals, the transmitting port and the receiving port being exposed at the heel portion.

5. The intelligent shoe according to claim 4, wherein the distance measuring sensor further comprises a microprocessor, a timer, an infrared emitting portion disposed in the emitting port, and a signal receiving portion disposed in the receiving port, the timer sends a driving signal to the microprocessor at intervals, the driving microprocessor controls the infrared emitting portion to emit an infrared signal, the signal receiving port outputs a received return signal to the microprocessor, and the microprocessor calculates and obtains distance data between the sensor and an obstacle based on the return signal.

6. The intelligent shoe as claimed in claim 2, wherein the wavelength of the infrared signal is 900-940 nm.

7. The intelligent shoe according to claim 1, wherein the squat command sent by the control unit to the terminal device via the communication unit is used for controlling the character to make posture adjustment in an application program run by the terminal device.

8. The intelligent shoe as claimed in claim 1, wherein a pressure sensor is further disposed in the shoe body, the pressure sensor and the control device are disposed in an insole layer of the shoe body, the pressure sensor disposed in the insole layer is pressed to output a pressure signal to the control unit, and the control unit receives the pressure signal and drives the distance measuring sensor to measure distance at regular time to continuously obtain the distance data.

9. The intelligent shoe according to claim 4, wherein a receiving cavity for receiving the distance measuring sensor and a housing for closing the receiving cavity are arranged on the rear heel of the shoe body, the housing is provided with a through hole on a transmission path of the infrared signal and the return signal, and the housing is connected with the receiving cavity through a clamping connection or a zipper.

10. An intelligent wearing device, comprising a pair of intelligent shoes according to any one of claims 1 to 9, wherein the pair of intelligent shoes perform data interaction through respective communication units, the second intelligent shoe sends the obtained squat instruction to the control unit of the first intelligent shoe, and when the control unit of the first intelligent shoe simultaneously obtains the respective squat instruction of the pair of intelligent shoes, the control unit sends the squat instruction to the terminal device through the communication unit.