CN108853946A - A kind of exercise guide training system and method based on Kinect - Google Patents
A kind of exercise guide training system and method based on Kinect Download PDFInfo
- Publication number
- CN108853946A CN108853946A CN201810748176.3A CN201810748176A CN108853946A CN 108853946 A CN108853946 A CN 108853946A CN 201810748176 A CN201810748176 A CN 201810748176A CN 108853946 A CN108853946 A CN 108853946A
- Authority
- CN
- China
- Prior art keywords
- user
- training
- building
- data
- fitness
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
- A63B24/0062—Monitoring athletic performances, e.g. for determining the work of a user on an exercise apparatus, the completed jogging or cycling distance
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
- A63B24/0003—Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
- A63B24/0087—Electric or electronic controls for exercising apparatus of groups A63B21/00 - A63B23/00, e.g. controlling load
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
- A63B71/0619—Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
- A63B71/0619—Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
- A63B71/0622—Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
- A63B71/0619—Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
- A63B71/0622—Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
- A63B2071/0625—Emitting sound, noise or music
- A63B2071/063—Spoken or verbal instructions
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
- A63B2071/0694—Visual indication, e.g. Indicia
Landscapes
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Physical Education & Sports Medicine (AREA)
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Rehabilitation Tools (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The present invention relates to sport and body-building equipment technical field more particularly to a kind of interactive body-building systems and method based on virtual scene.Including fitness equipment, Kinect sensor, large-screen display, main frame, sound equipment, body building management system, body-building user may be selected different instruments and combine with virtual scene, by the way that introducing movement assessment correction is corrected in time with vision, hearing, touch feel various aspects feedback, specification body-building acts, reaches quick and form specification body-building effect.Assessment user for body-building movement in real time completes effect adaptively changing action triggers threshold value or project kind according to it with adjusting training degree-of-difficulty factor, while can also carry out adjusting training difficulty by adjusting frequency of training, training time, the different instruments of selection.When system detection to user is correctly completed a certain body-building movement completely, frequency of training just increases once automatically, and a next training program of being allowed for access after the targeted number that user completes this item training setting realizes training rhythm active control.
Description
Technical field
The present invention relates to sport and body-building equipment technical field more particularly to a kind of interactive body-building systems based on virtual scene
System and method.
Background technique
As constantly development and progress, people's lives level step up for society, the people of sport and body-building ranks is stepped into
Group is also more and more, and all kinds of fitness products and gymnasium are also gradually throughout each corner in city, such as：Treadmills, dumbbell, strong abdomen
Wheel, pulling force rope etc. are all common indoor body-building equipment.According to the survey, though these fitness equipments can meet to a certain extent
The body-building demand of people, but unavoidably will appear on user experience it is dry as dust, be difficult to the problems such as adhering to.Meanwhile commonly
User is difficult to these fitness equipments of Normalize use under the specialized guidance of not fitness, it is difficult to according to self training situation
With target making targetedly fitness program, and then trained safety and validity not can guarantee.In addition, professional fitness
Short and expense is relatively expensive.
To solve the problems such as engaging fitness's somewhat expensive, certain customers take foradownloaded video study course to be trained and refer to
Lead, but this video guidance is only unidirectional action modeling guidance, user can not (or being not easy) obtain itself action norm
The case where degree information is fed back, and causes user that cannot correct itself action in time.
Nowadays, Kinect device can accurately track acquisition user 20 as a more mature virtual interactive device
Artis information provides the feedback of view, the sense of hearing etc. for user, is widely used each neck such as movement, rehabilitation, education
Domain.In recent years, domestic and foreign scholars have also carried out in terms of Kinect is in conjunction with fitness training studies and achieves numerous achievements,
But segmental defect is still had in current existing scheme, such as a kind of physical fitness based on Kinect of publication number CN107115675A
Game system and implementation method improve the body-building enthusiasm and feeling of immersion of user by setting scene of game, but can not to
Body-building posture in family carries out assessment guidance, and then is difficult to that user is promoted quickly to form correct, specification body-building movement.For another example, open
Number be a kind of virtual scene body-building system of CN205379594A, propose by virtual scene and health and fitness facilities combined training mode with
Exciting motion enjoyment, but there is the defects of training difficulty, training burden that cannot adaptively be adjusted according to user's individual difference.Such as
What sets up a set of with professional exercise guide, posture correction, training reasonably by virtual technology in conjunction with existing health and fitness facilities
The human-computer interaction training system of Self-adaptive strength adjustment function is a set of product that current bodybuild market is badly in need of.
Summary of the invention
In order to solve the above technical problems, the present invention provide it is a kind of a variety of health and fitness facilities and Kinect sensor are carried out it is organic
In conjunction with, while there is the guidance of body-building postural assessment, training difficulty adaptively adjusts, the exercise guide of virtual scene interaction function is instructed
Practice system and method.
The purpose of the present invention is what is be achieved through the following technical solutions：
A kind of exercise guide training system based on Kinect, including
Fitness equipment can provide a certain size the resistance of motion to achieve the purpose that enhance muscle strength, simultaneously for user
Feedback in terms of tactile is provided；
Kinect sensor will be captured for acquiring 20 limbs joint dot position informations of user, and by USB serial ports
Human body color video stream, deep stream, the information such as audio stream be transferred to main frame；
Large-screen display, for providing the view during fitness training, the feedback in terms of the sense of hearing for user, facilitate user and
When correct, the body-building posture of specification itself；
Main frame, for receiving the posture information of Kinect sensor and being used for transmission data information and audio letter
Breath；
Sound equipment, for playing audio-frequency information；
Body building management system, the interaction feelings for being analyzed and processed, assessing to data between user and virtual fitness trainer
It is exported after condition by peripheral hardwares such as large-screen display, stereo sets.
As further scheme of the invention：The body building management system includes
Data management module is deeply dug for recording the essential information and user's training data of body-building user by data
Pick analysis, recommends the body-building scheme for having personalized, scientific for user；
Exercise guide module is equipped with virtual fitness trainer and faces user's training action from video, voice, text tripartite respectively
Parsed and demonstrated guidance, while for user is lack of standardization and malfunction is prompted into correcting；
For Training Control module, it can be achieved that the control of user's virtual portrait, training difficulty adaptively adjust, fitness training rhythm is fast
Slow control；
Training valuation module includes a kind of movement posture standard degree assessment mode based on joint coordinates point three-dimensional information.
As further scheme of the invention：The body building management system further includes workout data cloud management module, benefit
With TCP/IP agreement by the user data real-time synchronization being recorded in data management module into cloud server, user Ke Tong
Cross cell phone application application access personal workout data report stored in cloud server and body-building scheme.
A kind of exercise guide training method based on Kinect, includes the following steps：
Step 1, user's registration account fills in essential information, and logs in body building management system；
Step 2, user makes starting posture, until Kinect sensor traces into target user, carries out menu selection, if
Set trained joint part, strength grade, background music etc.；
Step 3, user's selection (or formulation) this fitness training plan；
Step 4, user selects corresponding body-building assisting device tool, into training link；
Step 5, virtual fitness trainer starts to instruct, and user is acted by the virtual portrait in scene and the voice of coach mentions
Show that, until action norm is up to standard, training action number will increase once to correct itself movement；
Step 6, after user reaches the targeted number of current project, into next trained item, until all training are completed, it is
This training related data of system output simultaneously shows user with report and curve form；
Step 7, training statistical data uploads to body-building cloud server, and user can download in real time body-building using cell phone application
Data information understands itself body-building situation in time.
The beneficial effects of the present invention are：
S1：Body-building user may be selected different instruments and combine with virtual scene, correct and regard by introducing movement assessment,
Listen, tactile various aspects feedback to be to correct in time, specification body-building movement, reach quick specification body-building effect of forming.
S2：Training degree-of-difficulty factor system self-adaption adjustment.It is adaptive to complete effect according to it for assessment user for body-building movement in real time
Action triggers threshold value or project kind should be changed with adjusting training degree-of-difficulty factor, while can also be by different health and fitness facilities (if not
With the dumbbell of weight), frequency of training, training time carry out adjusting training difficulty.
S3：Fitness training rhythm speed realizes user's active control.It is correctly completed completely in system detection to user a certain
When body-building acts, frequency of training just increase automatically it is primary, can be into after the targeted number that user completes this item training setting
Enter a next training program.
Detailed description of the invention
Fig. 1 is system main assembly schematic diagram of the invention；
Fig. 2 is the structural block diagram of main modular of the present invention；
Fig. 3 is human synovial skeleton point distribution map of the present invention；
Fig. 4 is body building management system of the present invention training interface embodiments schematic diagram；
Fig. 5 is the implementation method flow chart of fitness training process of the invention；
In figure：1, return to upper level, 2, last training program, 3, the target frequency of training of current training program with it is complete
At action frequency, 4, virtual fitness trainer action modeling guidance, 5, current training program title, 6, audio prompt switch, 7, use
Family virtual interacting model, 8, training action key point suggestion content, 9, the training time record, 10, next training program, 11, temporarily
Training before ready.
Specific embodiment
In order to more fully explain implementation of the invention, embodiment of the invention presented below, these examples are only
To elaboration of the invention, do not limit the scope of the invention.
Embodiment is as follows：
Referring to Fig.1, present embodiment discloses a kind of exercise guide training system based on Kinect and the structural frames of method
Figure, including body-building hardware and built-in system software two large divisions,
Body-building hardware device in the present embodiment mainly includes health and fitness facilities, Kinect sensor, main frame, sound equipment
The composition such as equipment, large-screen display and necessary gymnasium, power supply unit.
The health and fitness facilities include but is not limited to the common easy acquisition such as dumbbell, stretch cord, power roller, Yoga mat, horizontal bar
And the small health and fitness facilities of range are blocked to user's body.On the one hand, a certain size movement is provided in the training process for user
Resistance enhances the exercise purpose of muscle strength to reach；On the other hand, these instruments can mention in virtual environment training for user
For the feedback in terms of tactile, increase the Experience Degree interactivity, raising user between health and fitness facilities.
The Kinect sensor is the human-computer interaction device based on body feeling interaction that Microsoft releases, for acquiring user's
20 limbs joint information.It includes infrared camera, colour imagery shot, microphone array, USB serial ports transmission module that it is internal
Deng, the infrared camera is acquired by far and near distance of the infrared ray to user, by innernal CPU be calculated user and
The depth data of scene；The USB serial ports transmission module, by data informations such as the color video stream of capture, deep stream, audio streams
It is transferred in main frame.
The main frame is computer used in daily life, is equipped with body building management system software, while with
The external equipments such as Kinect sensor, large-screen display, sound equipment be connected, function mainly include to sensor obtain data into
The functions such as row processing, analysis and virtual training scene rendering.The large-screen display, stereo set are respectively by virtual interacting scene
In video exported in real time with audio-frequency information, for user for body-building training view, the sense of hearing are provided in terms of feedback.Display sizes
It is bigger than normal as far as possible that more preferable immersive effects can be provided for user, improve the Experience Degree of user.
Referring to Fig. 2, body building management system part is mainly by data management module, exercise guide module, instruction in the present embodiment
Practice control module, Training valuation module four module and extension workout data cloud management module composition, it can be achieved that user's limbs
Joint information acquisition is assessed with posture movement, virtual fitness action director corrects with wrong body-building posture, fitness training rhythm master
It moves control and difficulty adaptively adjusts, the function of planning four aspects is trained in user for body-building data management and body-building by scientific methods.
It is described in detail below with reference to how four module shown in Fig. 2 completes above-mentioned four big functions：
One, the information collection of user's limbs joint and posture movement are assessed
The information collection of user's limbs joint is completed by Microsoft's Kinect somatosensory device, and hardware composition mainly includes colour
Camera, infrared ray projector and depth (infrared) camera and four linear microphone arrays, in unobstructed situation
Depth, colour and skeleton data, acoustic information in its available visual range of Kinect.Kinect sensor passes through serial ports
The skeleton data per second that 30 frames or so can be transmitted to host computer, each frame include the three of 20 joint coordinates points (referring to Fig. 3)
It ties up information (x, y, z), and constitutes a secondary skeleton framework, three-dimensional coordinate information records each joint of human body and sits in bone
Position in mark system.The bone coordinate system：The position Kinect is coordinate origin, and x-axis is parallel with Kinect, in Y-axis
Perpendicular to Kinect, it is to the left positive axis, whole coordinate system meets right-hand rule that the direction of Z axis and Kinect are consistent.
User's posture movement assessment is mainly between 20 human synovial skeleton point coordinates using Kinect sensor output
Variation, movement character combined analysis the various movements such as obtains lift leg based on bone information, both hands side raise, jumps, squats down
Recognizer.It can further sketch and be：If user joint generates movement, corresponding joint coordinates information relative to Kinect
It will change, can judge to work as by the angle change situation between the variation of each body joint point coordinate of calculating, joint line
The body-building movement that preceding user is completed.
Citing demonstration is acted with user's both hands side raise body-building：Choose left wrist (xWL, yWL, zWL), right wrist (xWR, yWR, zWR)、
Left elbow (xEL, yEL, zEL), right elbow (xER, yER, zER), left shoulder (xSL, ySL, zSL) right shoulder (xSR, ySR, zSR), shoulder center (xSC,
ySC, zSC), backbone (xSP, ySP, zSP) eight body joint point coordinates as both hands side raise assess coordinate points；Left elbow joint and left wrist
The vector that joint is formedRight elbow joint and right wrist joint form vectorLeft shoulder joint and left elbow joint form vector
Right shoulder joint and right elbow joint form vectorWhat shoulder center and backbone were formed
VectorThe vector that five major joint points are linked to be；Left Angle of Elbow Joint is (left
The left wrist of the left elbow-of shoulder -)Right Angle of Elbow Joint (the right wrist of the right right elbow-of shoulder -)Left shoulder joint angle (the backbone center-left elbow of left shoulder -)
Right fillet degree (the backbone center-right elbow joint of right shoulder -)Four joint angles.
When user's joint angles meet 160 °≤θ simultaneouslyER≤180°、160°≤θEL≤180°、80°≤θSR≤100°、
80°≤θSLIt is believed that the flat act body-building movement of user side reaches normal conditions when≤100 ° of four conditions, 80 ° herein,
100 °, 160 °, 180 ° are the assessment threshold value set, can assess current user action by changing the size of angle threshold
Standard degree.
Also including (but not limited to) parts such as the estimation of training process consumption of calorie, training strength assessments in the present embodiment.Institute
State the estimation of trained consumption of calorie, by obtain the group number of user's training program type, each project training, training it is accumulative when
Between the factors bonding unit time reference movement consumption such as length, degree-of-difficulty factor value calorie value estimation user's training consumption Ka Lu
In be worth.
Two, virtual fitness action director and wrong body-building posture are corrected
It is difficult to standardize to solve the problems, such as ordinary user under the specialized guidance of not fitness and completes body-building movement, this
It is that user constructs one with body-building professional knowledge virtual fitness trainer that invention, which introduces virtual technology,.The fitness can be
User provides the demonstration of the body-building action video as shown in Fig. 2 exercise guide module, body-building acts character introduction, body-building scheme pushes away
It recommends, voice interface communication function.Further, body-building movement character introduction is to act key point to a certain body-building to move with this
Make the main position that exercises one's muscles briefly to be introduced；The body-building scheme is recommended, before network analysis user training data with
It is the personalization of user's intelligent recommendation, body-building by scientific methods scheme after fitness goals；The voice interface, virtual fitness trainer is in user
Specification is completed in a certain action process or the training completion moment carries out some voices with user and movement aspect interacts, such as
Voice prompting in terms of " continue to refuel, be made very good " enhances man-machine interaction effect to excite the enthusiasm of user's training.
To realize that user quickly forms specification body-building posture, virtual fitness trainer of the present invention is corrected equipped with malfunction
It reminds, the movement lack of standardization or malfunction during reminding user for body-building in real time is played by voice, while pointing out corresponding mistake
Accidentally joint part is to facilitate user to correct the action of itself in time.Further,
Malfunction, which is reminded, completes the actual pass intersegment angle of target action user, body joint point coordinate and completion by calculating
Whether the preset body joint point coordinate of target action, the difference size closed between intersegment angle exceed given threshold to assess use
The standardized degree of family movement and malfunction judgement.
Three, fitness training rhythm active control and difficulty adaptively adjust
To further enhance the initiative in body-building user's training process, training experience sense, present invention introduces shown in Fig. 2
Training Control module is cut including (but not limited to) the control of training action group number, the control of user's virtual portrait, training action project
It changes, background music control, the adaptive adjustment member function of difficulty.Further, user's virtual portrait control is computer
The person model artis corresponding coordinate being mapped to after each body joint point coordinate information of the user of extraction in virtual scene, with synchronization
Generate the limb action of user, the feedback in terms of facilitating user to obtain itself action in time.
Fitness training rhythm active control can be described as：After user standardizes the current training action of completion completely, accordingly
Action frequency increases primary, next link training of being allowed for access after the targeted number that user completes movement setting, instruction
Practice rhythm speed and the control of speed speed is completed by body-building user's current action completely.
System closely trains performance (including used time length, training compliance rate, movement scoring) by assessment user several times
The adaptive difficulty for adjusting training program next time.If user acts every time completes equal standard criterion, training program is passed in difficulty
Increase direction adjust automatically；If a certain movement user repeatedly attempts standardize completion, training difficulty will be automatically adjusted to it
Preceding difficulty.Further, the difficulty be mainly reflected in training program type, frequency of training, fitness-assisting instrument (weight,
Resistance), training action reach normalizing posture activation threshold value etc..Training degree-of-difficulty factor, which adaptively adjusts, substantially increases user
Fitness training effect and the enthusiasm for persistently adhering to training.
Four, user for body-building data management and body-building by scientific methods training are planned
It is generated with recording the essential information of body-building user with fitness training process referring to data management module shown in Fig. 2
Training data.Further, the user basic information includes but is not limited to address name, gender, height, weight, expects
It is good at type of sports, exercise target cycle of training；The fitness training data include but is not limited to) user is each
The calorie of training program title and time, individual event action group number, Training valuation score, consumption during progress fitness training
The information such as value, training difficulty level, accumulative training duration.System is after the relevant information of accurate recording user, by user
Data go deep into mining analysis and provide the fitness program of more personalized, specific aim, science for user.
Further：
It is shown body building management system training interface embodiments schematic diagram referring to Fig. 4, below exemplary briefly narration training
Training interface content in management system.The trained interface returns to upper level, 2- last time training item including (but not limited to) 1-
Mesh, the target frequency of training of the current training program of 3- are instructed with action frequency, 4- virtual fitness trainer action modeling is completed,
The current training program title of 5-, 6- audio prompt switch, 7- user's virtual interacting model, in the prompt of 8- training action key point
Hold, the 9- training time records, the lower training program of 10-, the current training of 11- pause.
Further：
Fig. 5 shows a kind of exercise guide training system based on Kinect and method realizes step：
Step 1, body-building management software system is opened, is logged in for the first time if new user, needs to register one's own strong
Body account, while individual subscriber essential information is filled in, including name, gender, weight, body-building position, fitness goals etc., and log in
Body building management system.
Step 2, subscriber station makes Kinect identification posture to 2 meters or so in front of Kinect sensor of position, user, directly
After identifying and trace into user to Kinect and be confirmed as target person, user can control operation circle by mobile palm
Face carries out respective menu selection, while voice system play menu option.Then this major joint portion for needing to take exercise is carried out
Position (chest, arm, shoulder, back, waist, abdomen, leg), training strength grade (1-5 grade), background music (light music, slowly
Shake, be popular, customized) parameter setting.
Step 3, drill program is formulated, user can choose system recommendation drill program, deposit default drill program, make by oneself
One of adopted 3 kinds of modes of drill program.Customized drill program mode, user can freely plan training program type, training
Number etc.；System recommendation drill program is that system is divided according to the essential information and historic training data of user by degree of correlation
Analysis, match with the most reasonable training program of user for body-building target, then recommend a set of drill program with individual adaptability
Scheme；Having deposited default drill program is the default drill program scheme in system storage, personalized relatively low, and user also can be
Increase on the basis of this, delete partial content to make the training program for being suitble to oneself.
Step 4, into fitness training link, suitable health and fitness facilities auxiliary is selected to be forged according to current training item
Refining.The present embodiment carries out demonstration explanation with dumbbell side raise training program, and user selects suitable weight according to the actual conditions of oneself
The dumbbell of amount prepares to start formal training.
Step 5, virtual fitness trainer starts guidance training.Virtual trainer first passes through voice and written form introduces this
The movement key point of item movement, the position that exercises one's muscles, points for attention, then instruct body-building user to be trained with action video.
At this time user can both hands respectively take one, dumbbell, slow side raise is kept for 2-3 second, is slowly put down, repeatedly this process.
Step 6, Kinect device captures user's limbs joint moving point three-dimensional coordinate information to user's training in real time simultaneously, and
Main frame is uploaded to by serial ports, control virtual portrait is made and user's synchronization action.User passes through in observation scene
Virtual portrait movement may know that itself action norm situation, while mistake occurs in user action by movement evaluation module
When, fitness will do it voice prompting user to be modified, until act specification completely it is correct after, training action number
It will increase primary.
Step 7, user reach current training program targeted number require after, system be trained automatically adjusting of difficulty after
It is continuous to perform physical exercise.After the completion of this all drill program, system according to the training of active user count exercise time,
The information such as each movement score, chargeable heat magnitude, the accumulative training duration of history show user with report or curve form.
The above-described embodiments merely illustrate the principles and effects of the present invention, and is not intended to limit the present invention.It is any ripe
The personage for knowing this technology all without departing from the spirit and scope of the present invention, carries out modifications and changes to above-described embodiment.Cause
This, institute is complete without departing from the spirit and technical ideas disclosed in the present invention by those of ordinary skill in the art such as
At all equivalent modifications or change, should be covered by the claims of the present invention.
Claims (4)
1. a kind of exercise guide training system based on Kinect, it is characterised in that：Including
Fitness equipment can provide a certain size the resistance of motion for user to achieve the purpose that enhance muscle strength, provide simultaneously
Feedback in terms of tactile；
Kinect sensor for acquiring 20 limbs joint dot position informations of user, and passes through USB serial ports for the people of capture
The information such as sports lottery ticket color video flowing, deep stream, audio stream are transferred to main frame；
Large-screen display facilitates user to entangle in time for providing the view during fitness training, the feedback in terms of the sense of hearing for user
Just, the body-building posture of specification itself；
Main frame, for receiving the posture information of Kinect sensor and being used for transmission data information and audio-frequency information；
Sound equipment, for playing audio-frequency information；
Body building management system, after the interaction scenario for being analyzed and processed, assessing to data between user and virtual fitness trainer
It is exported by peripheral hardwares such as large-screen display, stereo sets.
2. a kind of exercise guide training system based on Kinect according to claim 1, it is characterised in that：The body-building
Management system includes
Data management module is deeply excavated by data and is divided for recording the essential information and user's training data of body-building user
The body-building scheme for having personalized, scientific is recommended in analysis for user；
Exercise guide module is equipped with virtual fitness trainer and carries out respectively from video, voice, text tripartite in face of user's training action
Parsing and demonstration guidance, while for user is lack of standardization and malfunction is prompted into correcting；
Training Control module is, it can be achieved that user's virtual portrait controls, training difficulty adaptively adjusts, fitness training rhythm speed control
System；
Training valuation module includes a kind of movement posture standard degree assessment mode based on joint coordinates point three-dimensional information.
3. a kind of exercise guide training system based on Kinect according to claim 2, it is characterised in that：The body-building
Management system further includes workout data cloud management module, the user that will be recorded in data management module using ICP/IP protocol
For real time data synchronization into cloud server, user can access personal body-building stored in cloud server by cell phone application application
Data sheet and body-building scheme.
4. a kind of exercise guide training method based on Kinect, it is characterised in that：Include the following steps：
Step 1, user's registration account fills in essential information, and logs in body building management system；
Step 2, user makes starting posture, until Kinect sensor traces into target user, progress menu selection, setting instruction
Practice joint part, strength grade, background music etc.；
Step 3, user's selection (or formulation) this fitness training plan；
Step 4, user selects corresponding body-building assisting device tool, into training link；
Step 5, virtual fitness trainer starts to instruct, user acted by virtual portrait in scene and the voice prompting of coach come
Itself movement is corrected, until action norm is up to standard, training action number will increase once；
Step 6, after user reaches the targeted number of current project, into next trained item, until all training are completed, system is defeated
This is trained related data and shows user with report and curve form out；
Step 7, training statistical data uploads to body-building cloud server, and user can download in real time workout data using cell phone application
Information understands itself body-building situation in time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810748176.3A CN108853946A (en) | 2018-07-10 | 2018-07-10 | A kind of exercise guide training system and method based on Kinect |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810748176.3A CN108853946A (en) | 2018-07-10 | 2018-07-10 | A kind of exercise guide training system and method based on Kinect |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108853946A true CN108853946A (en) | 2018-11-23 |
Family
ID=64300207
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810748176.3A Pending CN108853946A (en) | 2018-07-10 | 2018-07-10 | A kind of exercise guide training system and method based on Kinect |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108853946A (en) |
Cited By (44)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110289072A (en) * | 2019-05-10 | 2019-09-27 | 咪咕互动娱乐有限公司 | Generation method, device, electronic equipment and the readable storage medium storing program for executing of body-building scheme |
| CN110302524A (en) * | 2019-05-22 | 2019-10-08 | 北京百度网讯科技有限公司 | Limbs training method, device, equipment and storage medium |
| CN110334684A (en) * | 2019-07-12 | 2019-10-15 | 上海秒针网络科技有限公司 | Guidance is washed one's hands the method and device of process |
| CN110504015A (en) * | 2019-08-30 | 2019-11-26 | 上海中医药大学 | A kind of old-aged training training methods of marking and electronic equipment |
| CN110718280A (en) * | 2019-09-26 | 2020-01-21 | 北京金山安全软件有限公司 | Fitness action accuracy determining method and device, electronic equipment and storage medium |
| CN110812802A (en) * | 2019-10-08 | 2020-02-21 | 梵高夫科技控股(深圳)有限公司 | Interesting training method based on weight lifting equipment, weight lifting training system and training terminal |
| CN110909621A (en) * | 2019-10-30 | 2020-03-24 | 中国科学院自动化研究所南京人工智能芯片创新研究院 | Body-building guidance system based on vision |
| CN111228767A (en) * | 2020-01-20 | 2020-06-05 | 北京驭胜晏然体育文化有限公司 | Intelligent simulation indoor skiing safety system and monitoring method thereof |
| CN111265843A (en) * | 2020-03-19 | 2020-06-12 | 济南圆纯设计有限公司 | Body-building ring using method based on Internet of things technology |
| CN111652078A (en) * | 2020-05-11 | 2020-09-11 | 浙江大学 | Yoga action guidance system and method based on computer vision |
| CN111840964A (en) * | 2020-07-17 | 2020-10-30 | 谢小强 | Fitness intensity control method, intelligent fitness equipment and readable storage medium |
| CN112090053A (en) * | 2020-09-14 | 2020-12-18 | 成都拟合未来科技有限公司 | 3D interactive fitness training method, device, equipment and medium |
| CN112151194A (en) * | 2020-09-25 | 2020-12-29 | 泰康保险集团股份有限公司 | Fitness training monitoring system and method, storage medium and electronic equipment |
| CN112206483A (en) * | 2019-07-12 | 2021-01-12 | 珀洛顿互动公司 | Control part of body-building machine |
| CN112230777A (en) * | 2020-10-29 | 2021-01-15 | 浙江工业大学 | Cognitive training system based on non-contact interaction |
| CN112245892A (en) * | 2020-09-25 | 2021-01-22 | 北京汇洋时代科技有限公司 | System for testing movement by using 3D camera |
| CN112364564A (en) * | 2020-11-12 | 2021-02-12 | 浙大宁波理工学院 | Human-in-loop intelligent training load curve optimization algorithm based on evaluation indexes |
| CN112399234A (en) * | 2019-08-18 | 2021-02-23 | 聚好看科技股份有限公司 | Interface display method and display equipment |
| CN112439180A (en) * | 2019-08-30 | 2021-03-05 | 华为技术有限公司 | Intelligent voice playing method and equipment |
| CN112587878A (en) * | 2019-09-17 | 2021-04-02 | 力健有限公司 | System and method for guiding a user to control an exercise machine |
| CN112791367A (en) * | 2019-11-13 | 2021-05-14 | 财团法人资讯工业策进会 | Exercise assisting device and exercise assisting method |
| CN112891861A (en) * | 2021-01-15 | 2021-06-04 | 山东体育学院 | Intelligent evaluation device and method for fitness training |
| CN112906653A (en) * | 2021-03-26 | 2021-06-04 | 河北工业大学 | Multi-person interactive exercise training and evaluation system |
| CN112957689A (en) * | 2021-02-05 | 2021-06-15 | 北京唐冠天朗科技开发有限公司 | Training remote guidance system and method |
| CN113096761A (en) * | 2020-01-08 | 2021-07-09 | 佛山市云米电器科技有限公司 | Entertainment and fitness method, cloud server, entertainment and fitness system and storage medium |
| CN113144540A (en) * | 2021-03-12 | 2021-07-23 | 华南理工大学 | Intelligent safe fitness guidance device, system and method |
| CN113398537A (en) * | 2021-06-15 | 2021-09-17 | 黄富表 | Microsoft Kinect-based upper limb motor function training method for stroke patient |
| CN113485560A (en) * | 2021-08-05 | 2021-10-08 | 北京百度网讯科技有限公司 | Method and device for displaying information |
| CN113591524A (en) * | 2020-04-30 | 2021-11-02 | 聚好看科技股份有限公司 | Display device and interface display method |
| CN113721758A (en) * | 2020-05-26 | 2021-11-30 | 华为技术有限公司 | Fitness guiding method and electronic equipment |
| CN113813585A (en) * | 2021-08-09 | 2021-12-21 | 惠州Tcl云创科技有限公司 | 5G network fitness action guidance system |
| WO2022002204A1 (en) * | 2020-07-01 | 2022-01-06 | 随机漫步(上海)体育科技有限公司 | Cycling training facilitation method and device, and network model training method and device |
| CN114042296A (en) * | 2021-09-22 | 2022-02-15 | 广州医科大学附属第一医院（广州呼吸中心） | Intelligent training system for rehabilitation of lung surgery patient |
| CN114367086A (en) * | 2021-12-31 | 2022-04-19 | 华南理工大学 | Lower limb rehabilitation training game system |
| CN114404904A (en) * | 2022-02-16 | 2022-04-29 | 中航创世机器人(西安)有限公司 | Training guidance and feedback method, system and equipment |
| CN114504777A (en) * | 2022-04-19 | 2022-05-17 | 西南石油大学 | Exercise intensity calculation system and method based on neural network and fuzzy comprehensive evaluation |
| CN114870323A (en) * | 2022-04-11 | 2022-08-09 | 北京觅淘智联科技有限公司 | Fitness equipment and exercise evaluation method for fitness equipment |
| CN115202530A (en) * | 2022-05-26 | 2022-10-18 | 当趣网络科技(杭州)有限公司 | Gesture interaction method and system of user interface |
| CN115359687A (en) * | 2022-07-05 | 2022-11-18 | 深圳英鸿骏智能科技有限公司 | Mirror surface interaction device for rehabilitation therapy and energy consumption calculation method |
| US11617921B2 (en) | 2016-08-27 | 2023-04-04 | Peloton Interactive, Inc. | Exercise machine controls |
| CN116212355A (en) * | 2023-03-26 | 2023-06-06 | 北京卡路里信息技术有限公司 | Exercise instruction system and exercise instruction method |
| TWI812247B (en) * | 2022-05-30 | 2023-08-11 | 誠屏科技股份有限公司 | Method and system for movement guidance, electronic device and server |
| CN117038006A (en) * | 2023-07-21 | 2023-11-10 | 筋斗云易行科技(西安)有限责任公司 | Method for performing rehabilitation training AI auxiliary diagnosis decision after upper and lower limb orthopedics operation |
| US11924513B2 (en) | 2019-08-18 | 2024-03-05 | Juhaokan Technology Co., Ltd. | Display apparatus and method for display user interface |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102500094A (en) * | 2011-10-28 | 2012-06-20 | 北京航空航天大学 | Kinect-based action training method |
| US20120231894A1 (en) * | 2010-12-06 | 2012-09-13 | Full Swing Golf | Method and apparatus for simulated golf |
| CN104157107A (en) * | 2014-07-24 | 2014-11-19 | 燕山大学 | Human body posture correction device based on Kinect sensor |
| CN107213619A (en) * | 2017-07-04 | 2017-09-29 | 曲阜师范大学 | Sports training assessment system |
| CN107754225A (en) * | 2017-11-01 | 2018-03-06 | 河海大学常州校区 | A kind of intelligent body-building coaching system |
-
2018
- 2018-07-10 CN CN201810748176.3A patent/CN108853946A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120231894A1 (en) * | 2010-12-06 | 2012-09-13 | Full Swing Golf | Method and apparatus for simulated golf |
| CN102500094A (en) * | 2011-10-28 | 2012-06-20 | 北京航空航天大学 | Kinect-based action training method |
| CN104157107A (en) * | 2014-07-24 | 2014-11-19 | 燕山大学 | Human body posture correction device based on Kinect sensor |
| CN107213619A (en) * | 2017-07-04 | 2017-09-29 | 曲阜师范大学 | Sports training assessment system |
| CN107754225A (en) * | 2017-11-01 | 2018-03-06 | 河海大学常州校区 | A kind of intelligent body-building coaching system |
Cited By (57)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11617921B2 (en) | 2016-08-27 | 2023-04-04 | Peloton Interactive, Inc. | Exercise machine controls |
| CN110289072A (en) * | 2019-05-10 | 2019-09-27 | 咪咕互动娱乐有限公司 | Generation method, device, electronic equipment and the readable storage medium storing program for executing of body-building scheme |
| CN110302524A (en) * | 2019-05-22 | 2019-10-08 | 北京百度网讯科技有限公司 | Limbs training method, device, equipment and storage medium |
| CN112206483B (en) * | 2019-07-12 | 2023-02-28 | 珀洛顿互动公司 | Control part of body-building machine |
| CN110334684A (en) * | 2019-07-12 | 2019-10-15 | 上海秒针网络科技有限公司 | Guidance is washed one's hands the method and device of process |
| CN112206483A (en) * | 2019-07-12 | 2021-01-12 | 珀洛顿互动公司 | Control part of body-building machine |
| WO2021031809A1 (en) * | 2019-08-18 | 2021-02-25 | 聚好看科技股份有限公司 | Interface display method and display device |
| CN116074564A (en) * | 2019-08-18 | 2023-05-05 | 聚好看科技股份有限公司 | Interface display method and display device |
| CN112399234A (en) * | 2019-08-18 | 2021-02-23 | 聚好看科技股份有限公司 | Interface display method and display equipment |
| US11924513B2 (en) | 2019-08-18 | 2024-03-05 | Juhaokan Technology Co., Ltd. | Display apparatus and method for display user interface |
| CN110504015A (en) * | 2019-08-30 | 2019-11-26 | 上海中医药大学 | A kind of old-aged training training methods of marking and electronic equipment |
| CN112439180A (en) * | 2019-08-30 | 2021-03-05 | 华为技术有限公司 | Intelligent voice playing method and equipment |
| CN112587878B (en) * | 2019-09-17 | 2023-11-07 | 力健有限公司 | System and method for guiding a user to control an exercise machine |
| CN112587878A (en) * | 2019-09-17 | 2021-04-02 | 力健有限公司 | System and method for guiding a user to control an exercise machine |
| CN110718280A (en) * | 2019-09-26 | 2020-01-21 | 北京金山安全软件有限公司 | Fitness action accuracy determining method and device, electronic equipment and storage medium |
| CN110812802A (en) * | 2019-10-08 | 2020-02-21 | 梵高夫科技控股(深圳)有限公司 | Interesting training method based on weight lifting equipment, weight lifting training system and training terminal |
| CN110909621A (en) * | 2019-10-30 | 2020-03-24 | 中国科学院自动化研究所南京人工智能芯片创新研究院 | Body-building guidance system based on vision |
| US11547904B2 (en) | 2019-11-13 | 2023-01-10 | Institute For Information Industry | Exercise assisting device and exercise assisting method |
| CN112791367A (en) * | 2019-11-13 | 2021-05-14 | 财团法人资讯工业策进会 | Exercise assisting device and exercise assisting method |
| CN113096761A (en) * | 2020-01-08 | 2021-07-09 | 佛山市云米电器科技有限公司 | Entertainment and fitness method, cloud server, entertainment and fitness system and storage medium |
| CN111228767B (en) * | 2020-01-20 | 2022-02-22 | 北京驭胜晏然体育文化有限公司 | Intelligent simulation indoor skiing safety system and monitoring method thereof |
| CN111228767A (en) * | 2020-01-20 | 2020-06-05 | 北京驭胜晏然体育文化有限公司 | Intelligent simulation indoor skiing safety system and monitoring method thereof |
| CN111265843B (en) * | 2020-03-19 | 2021-09-17 | 龚志 | Body-building ring using method based on Internet of things technology |
| CN111265843A (en) * | 2020-03-19 | 2020-06-12 | 济南圆纯设计有限公司 | Body-building ring using method based on Internet of things technology |
| CN113591524A (en) * | 2020-04-30 | 2021-11-02 | 聚好看科技股份有限公司 | Display device and interface display method |
| CN113596590B (en) * | 2020-04-30 | 2022-08-26 | 聚好看科技股份有限公司 | Display device and play control method |
| CN113596590A (en) * | 2020-04-30 | 2021-11-02 | 聚好看科技股份有限公司 | Display device and play control method |
| CN111652078A (en) * | 2020-05-11 | 2020-09-11 | 浙江大学 | Yoga action guidance system and method based on computer vision |
| CN113721758A (en) * | 2020-05-26 | 2021-11-30 | 华为技术有限公司 | Fitness guiding method and electronic equipment |
| WO2021238356A1 (en) * | 2020-05-26 | 2021-12-02 | 华为技术有限公司 | Fitness guidance method and electronic device |
| WO2022002204A1 (en) * | 2020-07-01 | 2022-01-06 | 随机漫步(上海)体育科技有限公司 | Cycling training facilitation method and device, and network model training method and device |
| CN111840964A (en) * | 2020-07-17 | 2020-10-30 | 谢小强 | Fitness intensity control method, intelligent fitness equipment and readable storage medium |
| CN112090053A (en) * | 2020-09-14 | 2020-12-18 | 成都拟合未来科技有限公司 | 3D interactive fitness training method, device, equipment and medium |
| CN112245892A (en) * | 2020-09-25 | 2021-01-22 | 北京汇洋时代科技有限公司 | System for testing movement by using 3D camera |
| CN112151194A (en) * | 2020-09-25 | 2020-12-29 | 泰康保险集团股份有限公司 | Fitness training monitoring system and method, storage medium and electronic equipment |
| CN112151194B (en) * | 2020-09-25 | 2023-12-19 | 泰康保险集团股份有限公司 | Health training monitoring system and method, storage medium and electronic equipment |
| CN112230777A (en) * | 2020-10-29 | 2021-01-15 | 浙江工业大学 | Cognitive training system based on non-contact interaction |
| CN112364564A (en) * | 2020-11-12 | 2021-02-12 | 浙大宁波理工学院 | Human-in-loop intelligent training load curve optimization algorithm based on evaluation indexes |
| CN112891861A (en) * | 2021-01-15 | 2021-06-04 | 山东体育学院 | Intelligent evaluation device and method for fitness training |
| CN112957689A (en) * | 2021-02-05 | 2021-06-15 | 北京唐冠天朗科技开发有限公司 | Training remote guidance system and method |
| CN113144540A (en) * | 2021-03-12 | 2021-07-23 | 华南理工大学 | Intelligent safe fitness guidance device, system and method |
| CN112906653A (en) * | 2021-03-26 | 2021-06-04 | 河北工业大学 | Multi-person interactive exercise training and evaluation system |
| CN113398537A (en) * | 2021-06-15 | 2021-09-17 | 黄富表 | Microsoft Kinect-based upper limb motor function training method for stroke patient |
| CN113485560A (en) * | 2021-08-05 | 2021-10-08 | 北京百度网讯科技有限公司 | Method and device for displaying information |
| CN113813585A (en) * | 2021-08-09 | 2021-12-21 | 惠州Tcl云创科技有限公司 | 5G network fitness action guidance system |
| CN114042296A (en) * | 2021-09-22 | 2022-02-15 | 广州医科大学附属第一医院（广州呼吸中心） | Intelligent training system for rehabilitation of lung surgery patient |
| CN114367086A (en) * | 2021-12-31 | 2022-04-19 | 华南理工大学 | Lower limb rehabilitation training game system |
| CN114404904A (en) * | 2022-02-16 | 2022-04-29 | 中航创世机器人(西安)有限公司 | Training guidance and feedback method, system and equipment |
| CN114870323A (en) * | 2022-04-11 | 2022-08-09 | 北京觅淘智联科技有限公司 | Fitness equipment and exercise evaluation method for fitness equipment |
| CN114504777A (en) * | 2022-04-19 | 2022-05-17 | 西南石油大学 | Exercise intensity calculation system and method based on neural network and fuzzy comprehensive evaluation |
| CN114504777B (en) * | 2022-04-19 | 2022-07-15 | 西南石油大学 | Exercise intensity calculation system and method based on neural network and fuzzy comprehensive evaluation |
| CN115202530A (en) * | 2022-05-26 | 2022-10-18 | 当趣网络科技(杭州)有限公司 | Gesture interaction method and system of user interface |
| CN115202530B (en) * | 2022-05-26 | 2024-04-09 | 当趣网络科技(杭州)有限公司 | Gesture interaction method and system of user interface |
| TWI812247B (en) * | 2022-05-30 | 2023-08-11 | 誠屏科技股份有限公司 | Method and system for movement guidance, electronic device and server |
| CN115359687A (en) * | 2022-07-05 | 2022-11-18 | 深圳英鸿骏智能科技有限公司 | Mirror surface interaction device for rehabilitation therapy and energy consumption calculation method |
| CN116212355A (en) * | 2023-03-26 | 2023-06-06 | 北京卡路里信息技术有限公司 | Exercise instruction system and exercise instruction method |
| CN117038006A (en) * | 2023-07-21 | 2023-11-10 | 筋斗云易行科技(西安)有限责任公司 | Method for performing rehabilitation training AI auxiliary diagnosis decision after upper and lower limb orthopedics operation |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108853946A (en) | A kind of exercise guide training system and method based on Kinect | |
| US11610035B2 (en) | Activities data modeling in human internet-of-things platforms | |
| KR102088333B1 (en) | Team training system with mixed reality based exercise apparatus | |
| US9878206B2 (en) | Method for interactive training and analysis | |
| CN108734104B (en) | Body-building action error correction method and system based on deep learning image recognition | |
| CN109919034A (en) | A kind of identification of limb action with correct auxiliary training system and method | |
| US6126449A (en) | Interactive motion training device and method | |
| US5904484A (en) | Interactive motion training device and method | |
| Renshaw et al. | Motor learning in practice | |
| KR101931784B1 (en) | Virtual fitness system for multi-user | |
| CN109799903A (en) | Percussion music method, terminal device and system based on virtual reality | |
| WO1998028053A9 (en) | Interactive motion training device and method | |
| WO2022110100A1 (en) | Physical activity teaching/learning system and use method thereof, physical activity device, and computer-readable storage medium | |
| JP2020174910A (en) | Exercise support system | |
| CN110404243A (en) | A kind of method of rehabilitation and rehabilitation system based on posture measurement | |
| US20220379166A1 (en) | Practice drill-related features using quantitative, biomechanical-based analysis | |
| CN113457105A (en) | Intelligent mirror with body-building menu | |
| KR20180097343A (en) | System for training of CPR(cardiopulmonary resuscitation) | |
| CN204246136U (en) | Sensitive fitness test set | |
| KR20180097334A (en) | Simulation method for training of CPR(cardiopulmonary resuscitation) | |
| CN116271757A (en) | Auxiliary system and method for basketball practice based on AI technology | |
| CN115337618A (en) | Auxiliary training device, system and method for soldier ping-pong sports | |
| EP4097709A1 (en) | Exercise instruction and feedback systems and methods | |
| JP2022187952A (en) | Program, method, and information processing device | |
| US9378656B2 (en) | Electronic exercise monitor with human facsimile and audible feedback |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181123 |