CN109395374A - Interactive entertainment equipment and its control method based on human body attitude detection - Google Patents

Interactive entertainment equipment and its control method based on human body attitude detection Download PDF

Info

Publication number
CN109395374A
CN109395374A CN201811023740.1A CN201811023740A CN109395374A CN 109395374 A CN109395374 A CN 109395374A CN 201811023740 A CN201811023740 A CN 201811023740A CN 109395374 A CN109395374 A CN 109395374A
Authority
CN
China
Prior art keywords
module
speed
attitude detection
motion
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811023740.1A
Other languages
Chinese (zh)
Inventor
李宁
任明乐
顾佳辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Institute of Technology
Original Assignee
Nanjing Institute of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Institute of Technology filed Critical Nanjing Institute of Technology
Priority to CN201811023740.1A priority Critical patent/CN109395374A/en
Publication of CN109395374A publication Critical patent/CN109395374A/en
Pending legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/211Input arrangements for video game devices characterised by their sensors, purposes or types using inertial sensors, e.g. accelerometers or gyroscopes
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/23Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention discloses a kind of interactive entertainment equipments and its control method based on human body attitude detection, and the interactive entertainment equipment based on human body attitude detection includes attitude detection module, main control module, communication module and video playback module;In control method, attitude detection module first establishes rectangular coordinate system in space, acquire current motion data, and main control module is sent to by communication module, current kinetic speed and athletic posture data is calculated in main control module, and is converted to video playing speed and video playing direction control signal, is sent to video playback module, video playback module realizes the real-time synchronization with current kinetic speed and athletic posture according to the control signal synchronization video broadcasting speed of main module and video playing direction.The present invention is by real-time monitoring human motion speed and athletic posture and changes the broadcasting speed of video accordingly and plays direction, realizes the function of interaction entertainment.

Description

Interactive entertainment equipment and its control method based on human body attitude detection
Technical field
The invention belongs to technical field of intelligent interaction, and in particular to a kind of interactive movement joy based on human body attitude detection Happy equipment and its control method.
Background technique
With the development of the times, the living standard of people is greatly improved, thus health problem also gradually at For people's focus of attention.On foot, the movements such as running, dancing are commonly people institute as simple aerobic metabolism body building Receive.Usually there are many places it can be selected that such as sports ground, road and treadmill for road-work.The movement people that dance are usual It can select the places such as square or dance rug.Outdoor view is open, can enjoy landscape on the way while movement, but be easy by It is limited to natural conditions such as environment, weather.Though treadmill and dance rug are not limited by natural conditions, it is only capable of by setting in advance Surely carry out adjustment speed, and to occupy certain interior space, while the more narrow dullness in their visual field, be unfavorable for people's alleviation Mood adjusts pressure.
Summary of the invention
To solve the above problems, the present invention propose it is a kind of based on human body attitude detection interactive entertainment equipment and its Control method, real-time monitoring human motion speed and athletic posture and broadcasting speed and the video playing side for changing video accordingly To being not take up exceptional space, while improving people's entertainment during exercise and experience property.
The present invention adopts the following technical scheme that, the interactive entertainment equipment based on human body attitude detection, comprising: posture Detection module, main control module, communication module and video playback module, wherein
The attitude detection module acquires current motion data, and pass through communication mould for establishing rectangular coordinate system in space Block is sent to main control module;
The main control module for calculating current kinetic speed and athletic posture based on current motion data, and is converted to Video playing speed and video playing direction control signal, and video playback module, current kinetic are sent to by communication module Posture includes linear motion and the rotary motion of the determining direction of motion;
The communication module, for realizing the data transmission between module, including IC bus and radio communication mold Block;
The video playback module, for the control signal synchronization video broadcasting speed and video playing according to main control module The real-time synchronization with current kinetic speed and athletic posture is realized in direction.
Interactive entertainment equipment control method based on human body attitude detection, comprising the following steps:
1) attitude detection module establishes rectangular coordinate system in space, acquires current motion data, and send by communication module To main control module;
2) main control module is based on current motion data and current kinetic speed and athletic posture is calculated, and is converted to video Speed and video playing direction control signal are played, and video playback module, current kinetic posture are sent to by communication module Linear motion and rotary motion including determining the direction of motion;
3) video playback module is real according to the control signal synchronization video broadcasting speed of main control module and video playing direction Now with the real-time synchronization of current kinetic speed and athletic posture.
Invent achieved the utility model has the advantages that the present invention is a kind of interactive entertainment equipment based on human body attitude detection And its control method, real-time monitoring human motion speed and athletic posture and accordingly change video broadcasting speed and video playing Direction is not take up exceptional space, while improving people's entertainment during exercise and experience property.The present invention can not only reach fortune Dynamic purpose, moreover it is possible to increase spirit impression, solve the problems, such as interactive poor, the loosening when improving movement of traditional indoor sport Sense and experience sense.
Detailed description of the invention
Fig. 1 is a kind of overall structure block diagram of the embodiment of the present invention;
Fig. 2 is a kind of hardware structure diagram of the embodiment of the present invention;
Fig. 3 is a kind of control method flow chart of the embodiment of the present invention.
Specific embodiment
Below according to attached drawing and technical solution of the present invention is further elaborated in conjunction with the embodiments.
Fig. 1 is a kind of interactive entertainment equipment structural block diagram based on human body attitude detection, and Fig. 2 is a kind of based on people The interactive entertainment equipment hardware structure diagram of body attitude detection, the interactive movement entertainment based on human body attitude detection are set It is standby, comprising: attitude detection module, main control module, communication module and video playback module,
Attitude detection module acquires current motion data, and send out by communication module for establishing rectangular coordinate system in space It send to main control module;
Main control module MCU, for current kinetic speed and athletic posture data to be calculated based on current motion data, and Video playing speed and video playing direction control signal are converted to, and video playback module is sent to by communication module, when Preceding athletic posture includes linear motion and the rotary motion of the determining direction of motion;
Communication module, for realizing the data transmission between each module, including IC bus (Inter- IntegratedCircuit, IIC) and wireless communication module;
Video playback module, for according to the control signal synchronization video broadcasting speed of main module and video playing direction, Realize the real-time synchronization with current kinetic speed and athletic posture.
Data are carried out by IC bus IIC communication mode between the attitude detection module and main control module to lead to Letter, module realizes data penetration transmission by wireless communication between main control module and video playback module.
The attitude detection module and main control module are placed in wearable device, and video playback module is placed in front of user;
It uses 220V external power supply for video playback module power supply in the present embodiment, uses 5V pressure stabilizing lithium battery for posture inspection Survey module for power supply, 5V pressure stabilizing lithium battery by power conversion chip LM1117-3.3V voltage stabilizing chip be main control module with communicate mould Block power supply.
As a kind of preferred embodiment, the main control module uses STM32VET6.
As a kind of preferred embodiment, the attitude detection module includes 3-axis acceleration sensor and three axis accelerometer Instrument, the data by detecting six axis determine the motion state of user.
As a kind of preferred embodiment, the attitude detection module uses six axis movement sensor of MPU6050.
As a kind of preferred embodiment, the wireless communication module is HC-05 bluetooth module.
As a kind of preferred embodiment, the video playback module is 3D television set.User wears 3D glasses, can obtain Obtain preferable video interactive experience.
Based on the interactive entertainment equipment control method of human body attitude detection, video content is set as panoramic video, Specific step is as follows:
1) attitude detection module establishes rectangular coordinate system in space, acquires current motion data, and send by communication module To main control module;Using user's foothold as the coordinate origin of rectangular coordinate system in space in the present embodiment;
2) main control module is based on current motion data and current kinetic speed and athletic posture data is calculated, and is converted to Video playing speed and video playing direction control signal, and video playback module, current kinetic are sent to by communication module Posture includes linear motion and the rotary motion of the determining direction of motion;
3) video playback module is real according to the control signal synchronization video broadcasting speed of main control module and video playing direction Now with the real-time synchronization of current kinetic speed and athletic posture.
The method that current kinetic speed is calculated specifically: when user moves in a straight line, pass through attitude detection mould Acceleration transducer in block acquires acceleration information, and edge is calculated according to the relationship between acceleration and speed in main control module The movement velocity of X, Y, Z axis;If user moves in a straight line along X, Y, Z major axes orientation, wherein being not resultant motion for 0 speed Speed;It is fixed by hooking stock according to the movement velocity along X, Y, Z axis if user does the linear motion of deviation X, Y, Z major axes orientation Reason accurately calculates resultant motion speed;The resultant motion speed is current kinetic speed.
The method that current kinetic posture is calculated specifically:
21) direction of motion is determined: based on the rectangular coordinate system in space established in step 1), with user face in the present embodiment It is X-axis positive direction to direction, left side is Y-axis positive direction, and top is Z axis positive direction;Gyroscope difference in attitude detection module To rotate clockwise direction as positive direction around X, Y, Z axis positive direction, the data by detecting six direction determine the movement of user Direction;
The method of the determining direction of motion is the symbol for the acceleration and angular speed data for judging that attitude detection module obtains Number, acceleration information symbol be positive sign be then along reference axis positive direction, acceleration information be negative sign be then along reference axis opposite direction, Angular velocity data symbol is that positive sign is then to rotate clockwise around reference axis positive direction, and angular velocity data symbol is that negative sign is then around seat Parameter positive direction rotates counterclockwise.
22) current kinetic posture: the acceleration that main control module detects acceleration transducer in attitude detection module is determined The movement angle data that degree evidence and gyroscope detect carry out the calculating of posture blending algorithm, obtain current kinetic posture, currently Athletic posture includes linear motion and the rotary motion of the determining direction of motion.It should be noted that utilizing posture blending algorithm meter Calculation athletic posture is the prior art.
The linear motion of the determining direction of motion includes: the linear motion and deviation X, Y, Z master along X, Y, Z major axes orientation The linear motion of axis direction;Along X, Y, Z major axes orientation linear motion include along the x axis move forward or back, along the y axis to Left or to the right and along Z-direction upward or downward, the linear motion for deviateing X, Y, Z major axes orientation includes: left front (Y-axis positive direction Between X-axis positive direction), it is left back (between Y-axis positive direction and X-axis negative direction), before right (Y-axis negative direction and X-axis positive direction it Between), it is right after (between Y-axis negative direction and X-axis negative direction), upper left lower-left, upper right bottom right (the positive and negative direction of Y-axis and Z axis positive direction Between), it is preceding it is it is front lower, rear upper after under (between the positive and negative direction of X-axis and Z axis positive direction), it is left front upper, left front lower (Y-axis positive direction, Between X-axis positive direction and Z axis positive direction), it is left back it is upper, left back under (between Y-axis positive direction, X-axis negative direction and Z axis positive direction), Right front upper, right front lower (between Y-axis negative direction, X-axis positive direction and Z axis positive direction), it is upper, right after right after under (Y-axis negative direction, X-axis Between negative direction and Z axis positive direction).
It is described that current kinetic speed data is converted into video playing speed control signal specifically: main control module will be current Movement velocity equal proportion is converted to video playing speed control signal.
Mode sends a control signal to video playback module to main control module by wireless communication, controls video playout speed.
It is described that current kinetic attitude data is converted into video playing direction control signal specifically: user does determining movement When the linear motion in direction, video playing direction is identical with the direction of motion;When rotary motion, video playing direction maintains upper one Control the video playing direction of signal control.Such as: when user moves forward or back along the x axis, video playing direction is forward Or backward;When leftward or rightward along the y axis, video playing direction mutually should be leftward or rightward;Upward or downward along Z-direction Constantly, video playing direction mutually should be upward or downward;When athletic posture is left front, video playing direction is simultaneously to the left forward It plays;When athletic posture is left back, main control module control video plays simultaneously backward to the left;When user movement posture is before the right side, Video playing direction is to play forward to the right simultaneously;When athletic posture is behind the right side, video playing direction is to broadcast backward to the right simultaneously It puts;Correspondingly, athletic posture is upper left, lower-left, upper right or when bottom right, video playing direction be it is corresponding simultaneously to the left upwards, to It is played downwards under left-hand, to the right upwards or to the right;Athletic posture be it is preceding it is upper, front lower, it is rear upper or afterwards under when, video playing direction is It is corresponding to play downwards upwards or backward downwards, backward forward and up, forward simultaneously;When athletic posture is left front upper or left front lower, Video playing direction is corresponding while playing downwards forward forward and up or to the left to the left;Athletic posture is on left back or under left back When, video playing direction is corresponding upward backward to the left simultaneously or plays downwards backward to the left;Athletic posture is right front upper or right When front lower, video playing direction is corresponding while playing downwards forward forward and up or to the right to the right;Athletic posture be it is right after on Or behind the right side under when, video playing direction mutually should be and meanwhile to the right backward upwards or to the right backward downwards play.
Current kinetic attitude data is converted to video playing direction control signal by main control module, is sent by wireless communication To video playback module, video playing direction is controlled.
Change broadcasting speed signal and the broadcasting of video by constantly refreshing current kinetic speed and athletic posture information Direction, to achieve the purpose that real-time interactive.
The acceleration information that acceleration transducer detects in the attitude detection module is reduced using Kalman filtering Noise is measured, the measurement accuracy of acceleration information is improved.
Fig. 3 is a kind of interactive entertainment equipment control method flow chart based on human body attitude detection, the step It 1) further include, using standing place as the coordinate origin of rectangular coordinate system in space, using coordinate origin as the center of circle, setting pre-set radius in Circle be motion range, if beyond finishing control if motion range, cannot achieve interaction effect;If in motion range, into Enter step 2).Radius is 1.5 meters in the present embodiment.System initialization is carried out before step 1).
It further include carrying out step counting, specially main control module analyzes acceleration information, resultant acceleration when user walks For data in regularity variation, the resultant acceleration that often makes a move will appear a peak value.Described analyzed acceleration information is examined The number of resultant acceleration peak value is surveyed, step number statistics is carried out.

Claims (10)

1. the interactive entertainment equipment based on human body attitude detection characterized by comprising attitude detection module, master control Module, communication module and video playback module, wherein
The attitude detection module acquires current motion data, and send out by communication module for establishing rectangular coordinate system in space It send to main control module;
The main control module for calculating current kinetic speed and athletic posture based on current motion data, and is converted to video Speed and video playing direction control signal are played, and video playback module, current kinetic posture are sent to by communication module Linear motion and rotary motion including determining the direction of motion;
The communication module, for realizing the data transmission between module, including IC bus and wireless communication module;
The video playback module, for according to the control signal synchronization video broadcasting speed of main control module and video playing side To real-time synchronization of the realization with current kinetic speed and athletic posture.
2. the interactive entertainment equipment according to claim 1 based on human body attitude detection, which is characterized in that described Data communication, main control module and video playing are carried out by IC bus mode between attitude detection module and main control module Module realizes data penetration transmission by wireless communication between module.
3. the interactive entertainment equipment according to claim 1 based on human body attitude detection, which is characterized in that described Attitude detection module and main control module are placed in wearable device, and video playback module is placed in front of user.
4. the interactive entertainment equipment control method based on human body attitude detection, which comprises the following steps:
1) attitude detection module establishes rectangular coordinate system in space, acquires current motion data, and be sent to master by communication module Control module;
2) main control module is based on current motion data and current kinetic speed and athletic posture is calculated, and is converted to video playing Speed and video playing direction control signal, and video playback module is sent to by communication module, current kinetic posture includes Determine linear motion and the rotary motion of the direction of motion;
3) video playback module is realized same according to the control signal synchronization video broadcasting speed of main control module and video playing direction The real-time synchronization of current kinetic speed and athletic posture.
5. the interactive entertainment equipment according to claim 4 based on human body attitude detection, which is characterized in that described The method that current kinetic speed is calculated specifically: when user moves in a straight line, pass through the acceleration in attitude detection module Sensor acquires acceleration information, and the fortune along X, Y, Z axis is calculated according to the relationship between acceleration and speed for main control module Dynamic speed;If user moves in a straight line along X, Y, Z major axes orientation, wherein being not resultant motion speed for 0 speed;If user When doing the linear motion of deviation X, Y, Z major axes orientation, according to the movement velocity along X, Y, Z axis, accurately calculated by Pythagorean theorem Resultant motion speed;The resultant motion speed is current kinetic speed.
6. the interactive entertainment equipment control method according to claim 4 based on human body attitude detection, feature It is, the method that current kinetic posture is calculated specifically:
21) it determines the direction of motion: being based on the rectangular coordinate system in space established in step 1), the gyroscope in attitude detection module Respectively to rotate clockwise direction as positive direction around X, Y, Z axis positive direction, the data by detecting six direction determine user's The direction of motion;
22) current kinetic posture: the acceleration degree that main control module detects acceleration transducer in attitude detection module is determined The calculating of posture blending algorithm is carried out according to the movement angle data detected with gyroscope, obtains current kinetic posture.
7. the interactive entertainment equipment control method according to claim 4 based on human body attitude detection, feature It is, it is described that current kinetic speed data is converted into video playing speed control signal specifically: main control module will be transported currently Dynamic speed equal proportion is converted to video playing speed control signal.
8. the interactive entertainment equipment control method according to claim 4 based on human body attitude detection, feature It is, it is described that current kinetic attitude data is converted into video playing direction control signal specifically: user, which does, determines movement side To linear motion when, video playing direction is identical with the direction of motion;When rotary motion, video playing direction maintains a upper control The video playing direction of signal control processed.
9. the interactive entertainment equipment control method according to claim 4 based on human body attitude detection, feature It is, further includes in the step 1), is circle with coordinate origin using standing place as the coordinate origin of rectangular coordinate system in space The heart sets the circle of pre-set radius as motion range, and the finishing control if beyond motion range cannot achieve interaction effect;If In motion range, then enter step 2).
10. the interactive entertainment equipment control method according to claim 4 based on human body attitude detection, feature It is, further includes carrying out step counting, specially main control module analyzes acceleration information, i.e. of detection resultant acceleration peak value Number carries out step number statistics.
CN201811023740.1A 2018-09-04 2018-09-04 Interactive entertainment equipment and its control method based on human body attitude detection Pending CN109395374A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811023740.1A CN109395374A (en) 2018-09-04 2018-09-04 Interactive entertainment equipment and its control method based on human body attitude detection

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811023740.1A CN109395374A (en) 2018-09-04 2018-09-04 Interactive entertainment equipment and its control method based on human body attitude detection

Publications (1)

Publication Number Publication Date
CN109395374A true CN109395374A (en) 2019-03-01

Family

ID=65463762

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811023740.1A Pending CN109395374A (en) 2018-09-04 2018-09-04 Interactive entertainment equipment and its control method based on human body attitude detection

Country Status (1)

Country Link
CN (1) CN109395374A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101648076A (en) * 2008-08-12 2010-02-17 鼎亿数码科技(上海)有限公司 Game controller and motion capture method using gyroscope
US20110218753A1 (en) * 2010-03-05 2011-09-08 Seiko Epson Corporation Posture information calculation device, posture information calculation system, posture information calculation method, and information storage medium
CN104801039A (en) * 2015-04-30 2015-07-29 浙江工商大学 Virtual reality gaming device and scene realization method
CN105664434A (en) * 2016-03-11 2016-06-15 中国人民解放军63680部队 Running machine and video playing synchronous control system
CN106817625A (en) * 2016-12-19 2017-06-09 广州视源电子科技股份有限公司 Adjust method, device, system and the control terminal of panoramic video viewing visual angle
CN108260006A (en) * 2018-01-12 2018-07-06 南京工程学院 Interactive Intelligent home theater and its control method based on the detection of human body pose

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101648076A (en) * 2008-08-12 2010-02-17 鼎亿数码科技(上海)有限公司 Game controller and motion capture method using gyroscope
US20110218753A1 (en) * 2010-03-05 2011-09-08 Seiko Epson Corporation Posture information calculation device, posture information calculation system, posture information calculation method, and information storage medium
CN104801039A (en) * 2015-04-30 2015-07-29 浙江工商大学 Virtual reality gaming device and scene realization method
CN105664434A (en) * 2016-03-11 2016-06-15 中国人民解放军63680部队 Running machine and video playing synchronous control system
CN106817625A (en) * 2016-12-19 2017-06-09 广州视源电子科技股份有限公司 Adjust method, device, system and the control terminal of panoramic video viewing visual angle
CN108260006A (en) * 2018-01-12 2018-07-06 南京工程学院 Interactive Intelligent home theater and its control method based on the detection of human body pose

Similar Documents

Publication Publication Date Title
US11590392B2 (en) Multi-sensor monitoring of athletic performance
CN100566782C (en) Bicycle sport simulated system
CN102307525A (en) Device and method for characterising movements
CN201492862U (en) Live-action interaction multifunction treadmill
CN105056468B (en) A kind of real-time, interactive treadmill
CN105118253A (en) Intelligent ball and system thereof
CN105536234A (en) Action monitoring system for snowboard
CN105709369A (en) Multifunctional intelligent treadmill
CN205581842U (en) Display system based on head mounted display
CN206577298U (en) A kind of intelligent running machine
CN109395374A (en) Interactive entertainment equipment and its control method based on human body attitude detection
CN106714303A (en) Intelligent football data collection system
CN107679623B (en) A kind of intelligent sphere, system and method
CN204767336U (en) Movement track and velocity of movement collection system and system
CN207237157U (en) Panoramic interactive experience equipment based on walking mode
CN206524984U (en) A kind of football data intelligence acquisition system
KR100919616B1 (en) omnidirectional running system using image map and motion tracking.
Liao et al. A Virtual Reality Cycling System Based On Multi-Sensor Fusion
CN203060755U (en) Human body energy detection device based on track motion
CN116585675A (en) Interactive online dance teaching method and device
KR20020072518A (en) Wireless Mechanical Motion Capture
Liu et al. An investigation of attitude information acquisition system applied in freestyle skiing aerials

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190301

RJ01 Rejection of invention patent application after publication