CN108091203A - It is a kind of based on virtual reality technology stress traffic scene driving training system - Google Patents

It is a kind of based on virtual reality technology stress traffic scene driving training system Download PDF

Info

Publication number
CN108091203A
CN108091203A CN201711293653.3A CN201711293653A CN108091203A CN 108091203 A CN108091203 A CN 108091203A CN 201711293653 A CN201711293653 A CN 201711293653A CN 108091203 A CN108091203 A CN 108091203A
Authority
CN
China
Prior art keywords
driving
driver
stress
virtual reality
scene
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711293653.3A
Other languages
Chinese (zh)
Inventor
牛文生
程岳
刘作龙
李亚晖
谢建春
张磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xian Aeronautics Computing Technique Research Institute of AVIC
Original Assignee
Xian Aeronautics Computing Technique Research Institute of AVIC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xian Aeronautics Computing Technique Research Institute of AVIC filed Critical Xian Aeronautics Computing Technique Research Institute of AVIC
Priority to CN201711293653.3A priority Critical patent/CN108091203A/en
Publication of CN108091203A publication Critical patent/CN108091203A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00Simulators for teaching or training purposes
    • G09B9/02Simulators for teaching or training purposes for teaching control of vehicles or other craft
    • G09B9/04Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of land vehicles
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/06Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • G09B5/065Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Multimedia (AREA)
  • Processing Or Creating Images (AREA)
  • Traffic Control Systems (AREA)

Abstract

The invention discloses it is a kind of based on virtual reality technology stress traffic scene driving training system.The system by can result in the emergency traffic scene of driver's stress reaction during virtual reality technology generation car steering, by Helmet Mounted Display, sound equipment and device for force feedback to stress traffic scene carry out real-playback.Training system carries out driving efficiency evaluation to driver accordingly with obtaining manipulation data during the vision of driver, the sense of hearing and haptic interaction.It establishes miserable traffic accident picture, audio and the impact of strong tactile to the faulty operation of driver to warn it, to reach the target for promoting driving ability.What system proposed by the present invention helped to improve that driver is difficult to obtain in actual driving procedure stress traffic scene driving efficiency, enhance driver to stress traffic scene ability to predict, establish it is good stress traffic scene driving habit, it is horizontal to promote traffic safety, has broad application prospects.

Description

It is a kind of based on virtual reality technology stress traffic scene driving training system
Technical field
The invention belongs to technical field of virtual reality, it is more particularly to a kind of based on virtual reality technology stress traffic scene Driving training system.
Background technology
With the increasingly complexity of road traffic condition, the training of traditional driving school and examination pattern expose a series of ask Topic:Cycle of training is long, of high cost;Several students share a vehicle, and training time of single student is short, learning experience is poor;Driving school Quality is irregular, and quality of instruction is difficult to ensure that;It the considerations of more it is essential that for training cost rather than drives in the future Real demand, driving school often carries out reinforcement training for examination main points, lack to stress be under road conditions training.Work as When member takes driving license and really starts upper road, just find not causing the accident and take place frequently in face of various precipitate traffics.Mirror In the serious disconnection of driving training process and actual traffic environment, it is necessary to be easy to causeing traffic accident in true driving environment Stress traffic scene, design corresponding driving training environment so that driver can be equal in reality environment The driving experience of true driving environment, obtain it is valuable stress traffic scene driving experience, ensure follow-up true driving procedure Security.
The content of the invention
The purpose of the present invention is:
It solves the problems, such as the driving training in the emergency traffic environment that can result in driver's stress reaction, proposes a kind of base In virtual reality technology stress traffic scene driving training system.
The present invention technical solution be:
It is a kind of based on virtual reality technology stress traffic scene driving training system, by drive simulating manipulation device, height Performance graph work station, more sense organ interactive terminals composition;The high performance graphics work station operation has virtual reality engine and drives Sail scoring subsystem;
Driver is interacted by drive simulating manipulation device and high performance graphics work station, and interactive signal passes through USB Port transmission is handled to high performance graphics work station;High performance graphics work station is according to interactive signal is driven, using virtual Reality-Engine generates different kinds of roads traffic stress scene;These stress scenes are transferred to more sense organs by HDMI and USB port and hand over It is presented in mutual terminal;Scoring subsystem is driven according to the interaction correctness of driver and system and reaction sensitivity to driving Process scores, and driving scoring is output to high performance graphics work station and scoring picture output is carried out to user.
The driving control device is by the interactive devices group such as vehicle steering, shift handle, brake pedal and gas pedal Into;Interactive signal passes to high performance graphics work station by usb signal caused by these interactive devices.
The virtual reality engine of the high performance graphics work station operation passes through USB port based on ripe unity software It receives and interactive signal is driven caused by the automobile driving simulator, current virtual of Engine draws is driven according to interactive signal Reality scene;Entire virtual reality what comes into a driver's is by the dimensional topography of Mesh model formation bases, and building in streetscape etc. is artificial Scene then is arranged into landform to establish by three-dimensional model building;What comes into a driver's picture, the sound equipment that virtual reality engine is generated Special efficacy and vibration signal are output in more sense organ interactive terminals with USB interface by HDMI and are presented.
More sense organ terminals include virtual implementing helmet display, audio device and device for force feedback etc.;It is described virtual Real Helmet Mounted Display in what comes into a driver's picture, by the corresponding parallax signals of left and right two-path video signal generation, is presented on the helmet On display or so screen, the display effect of 3 D stereo is obtained;The automobile of normal driving process is presented in the audio device Audio, acceleration-deceleration audio during stress scene causes automobile collision accident, generate and shake miserable collision audio;Institute State device for force feedback causes automobile collision procedure to excite in stress scene, is exported by different shockproofnesses, and simulation is different The collision special efficacy of degree.
It is described drive scoring subsystem by analyze driver automobile manipulate data to its driver behavior carry out judge beat Point;Stress be in traffic scene, it is necessary to judge the driving correctness and control sensitivity of driver simultaneously.Specific evaluation method For:If its
Driver behavior selects correctness as C ∈ { 1,0 }, and driving sensitivity is T ∈ [0,1], then final driving scoring For:
K=100*C*T
It can be seen from above-mentioned formula only score non-zero is driven when driver behavior correct (C=1).Specifically Score value is then reflected by riding manipulation sensitivity.Above-mentioned driving score is fed back into graphics workstation, after driving training, Driver is presented in the form of score scene.
Present invention has the advantage that:
Using virtual reality technology design stress traffic scene, can overcome during traditional driving training only for just Chang Lukuang trains the limitation of driving efficiency.Design be easy to cause the emergency traffic situations of severe traffic accidents, makes the trainer be Driving experience, the driving experience on the spot in person that height is immersed can be safely experienced in system.It is not only able to that driver is allowed to obtain Driving efficiency under valuable abnormal road traffic condition, additionally it is possible to be warned using the miserable scene of a traffic accident to driver Teaching is educated.It is a kind of based on virtual reality technology stress traffic scene driving training system help to improve driver and actually driving Be difficult to during sailing to obtain stress traffic scene driving efficiency, enhancing driver to stress traffic scene ability to predict, build It is vertical it is good stress traffic scene driving habit, it is horizontal to promote traffic safety, has in scientific research and commercial field important Application prospect.
Description of the drawings
Fig. 1 is the system principle diagram of the present invention;
Fig. 2 is that the system training course of work is illustrated in urban highway traffic environment.
Specific embodiment
Referring to attached drawing 1, in the present invention, be primarily upon be easy to causeing in driving environment traffic accident stress traffic scene, Being specifically designed road stress scene surrounded by mountains, country road stress scene, urban road stress scene, highway stress field A variety of emergency road traffic scenes such as scape, anomalous weather stress scene.Based on above-mentioned actual conditions, propose a kind of based on virtual existing Real technology stress traffic scene driving training system, by drive simulating manipulation device, high performance graphics work station, more sense organs hand over Mutual terminal composition;The high performance graphics work station operation has virtual reality engine and drives scoring subsystem;
Driver is interacted by drive simulating manipulation device and high performance graphics work station, and interactive signal passes through USB Port transmission is handled to high performance graphics work station;High performance graphics work station is according to interactive signal is driven, using virtual Reality-Engine generates different kinds of roads traffic stress scene;These stress scenes are transferred to more sense organs by HDMI and USB port and hand over It is presented in mutual terminal;Scoring subsystem is driven according to the interaction correctness of driver and system and reaction sensitivity to driving Process scores, and driving scoring is output to high performance graphics work station and scoring picture output is carried out to user.
In road stress scene surrounded by mountains, during devising zig zag, travel is occupied critical by opponent vehicle Scene, massif falling rocks and landslide scene.In country road stress scene, the agricultural of jaywalking reverse driving is devised Motor tricycle, the large-scale animals jaywalked suddenly.In urban road stress scene, the row jaywalked suddenly is devised People, the electric car to make a dash across the red light.In highway stress scene, devise construction road and narrow suddenly road conditions, before vehicle tension Vehicle, which is brought to a halt, waits scenes.In anomalous weather stress scene, under design sleet, haze, strong light and low light environment, visual range It shortens, the stress scene of vehicle performance limited ability.In short, in the present invention it is designed stress scene, be all common easy Cause the road traffic scene of traffic accident.
Referring to attached drawing 2, by taking the training process of the system urban highway traffic environment as an example, specific implementation step is as follows:
The first step sets the streetscape environment needed for system training in virtual reality driving training environment, is specified in streetscape Position centers corresponding training critical point, and automobile is set to set driver in virtual vapour to the training road start position specified The steering position of vehicle checks traffic above-ground environment with the first visual angle.Driver controls automobile according to system interface guide, Roam preassigned drive route.
Second step, when automobile is reached in reality environment in position a certain range specified by critical point one, triggering is closed The training program that mouth one is set.At this point, there is pedestrian and non motorized vehicle to create red light, if driver's not slow down, can hit To pedestrian and non motorized vehicle.The special efficacy of display collision special efficacy, sound equipment special efficacy and the injured spray blood of pedestrian is set according to critical point.
3rd step, when automobile is reached in reality environment in position a certain range specified by critical point two, triggering is closed The training programs that mouth two is set.At this point, there is heavy truck to head on reverse driving, if driver avoids not in time, can bump against Heavy truck.The special lower and smog special efficacy of display collision special efficacy, flame is set according to critical point.
4th step, when automobile is reached in reality environment in position a certain range specified by critical point three, triggering is closed The training programs that mouth three is set.At this point, sky snowfall, road surface slippery situation, can if driver's not slow down or random deflecting Cause automobile is out of control to hit Adjacent Buildings.According to critical point display collision special efficacy is set to slide laterally special efficacy out of control with automobile.
5th step, after driver completes driving training according to pre-determined route, according to operation of the driver at each critical point Correctness scores to the operative skill of driver with the reaction time, exports corresponding scoring picture, completes training.

Claims (6)

1. it is a kind of based on virtual reality technology stress traffic scene driving training system, it is characterised in that:The system is by simulating Driving control device, high performance graphics work station, more sense organ interactive terminals composition;The high performance graphics work station operation has void Intend Reality-Engine and drive scoring subsystem;
Driver is interacted by drive simulating manipulation device and high performance graphics work station, and interactive signal passes through USB port High performance graphics work station is transferred to be handled;High performance graphics work station utilizes virtual reality according to interactive signal is driven Engine generates different kinds of roads traffic stress scene;These stress scenes are transferred to more sense organs with USB port by HDMI and interact eventually It is presented in end;Scoring subsystem is driven according to the interaction correctness of driver and system and reaction sensitivity to driving procedure It scores, driving scoring is output to high performance graphics work station and scoring picture output is carried out to user.
2. it is according to claim 1 it is a kind of based on virtual reality technology stress traffic scene driving training system, it is special Sign is:The driving control device is by the interactive devices group such as vehicle steering, shift handle, brake pedal and gas pedal Into;Interactive signal passes to high performance graphics work station by usb signal caused by these interactive devices.
3. it is according to claim 1 it is a kind of based on virtual reality technology stress traffic scene driving training system, it is special Sign is:The virtual reality engine of the high performance graphics work station operation passes through USB port based on ripe unity software It receives and interactive signal is driven caused by the automobile driving simulator, current virtual of Engine draws is driven according to interactive signal Reality scene;Entire virtual reality what comes into a driver's is by the dimensional topography of Mesh model formation bases, and building in streetscape etc. is artificial Scene then is arranged into landform to establish by three-dimensional model building;What comes into a driver's picture, the sound equipment that virtual reality engine is generated Special efficacy and vibration signal are output in more sense organ interactive terminals with USB interface by HDMI and are presented.
4. it is according to claim 1 it is a kind of based on virtual reality technology stress traffic scene driving training system, it is special Sign is:More sense organ interactive terminals include virtual implementing helmet display, audio device and device for force feedback;Wherein, it is empty Intend real Helmet Mounted Display, in what comes into a driver's picture, by the corresponding parallax signals of left and right two-path video signal generation, be presented on head On helmet display or so screen, the display effect of 3 D stereo is obtained;The automobile sound of normal driving process is presented in audio device Effect, acceleration-deceleration audio during stress scene causes automobile collision accident, generate and shake miserable collision audio;Power is anti- Feedback device causes automobile collision procedure to excite in stress scene, is exported, simulated different degrees of by different shockproofnesses Collide special efficacy.
5. it is according to claim 1 it is a kind of based on virtual reality technology stress traffic scene driving training system, it is special Sign is:It is described drive scoring subsystem by analyze driver automobile manipulate data to its driver behavior carry out judge beat Point;Stress be in traffic scene, it is necessary to judge the driving correctness and control sensitivity of driver simultaneously.
6. it is according to claim 5 it is a kind of based on virtual reality technology stress traffic scene driving training system, it is special Sign is:Specifically evaluation method is:If its driver behavior selects correctness as C ∈ { 1,0 }, driving sensitivity for T ∈ [0, 1], then final driving scoring is:
K=100*C*T.
CN201711293653.3A 2017-12-07 2017-12-07 It is a kind of based on virtual reality technology stress traffic scene driving training system Pending CN108091203A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711293653.3A CN108091203A (en) 2017-12-07 2017-12-07 It is a kind of based on virtual reality technology stress traffic scene driving training system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711293653.3A CN108091203A (en) 2017-12-07 2017-12-07 It is a kind of based on virtual reality technology stress traffic scene driving training system

Publications (1)

Publication Number Publication Date
CN108091203A true CN108091203A (en) 2018-05-29

Family

ID=62174141

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711293653.3A Pending CN108091203A (en) 2017-12-07 2017-12-07 It is a kind of based on virtual reality technology stress traffic scene driving training system

Country Status (1)

Country Link
CN (1) CN108091203A (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108877374A (en) * 2018-07-24 2018-11-23 长安大学 Vehicle platoon analogue system and method based on virtual reality and driving simulator
CN108922307A (en) * 2018-07-26 2018-11-30 杭州拓叭吧科技有限公司 Drive simulating training method, device and driving simulation system
CN109542226A (en) * 2018-11-22 2019-03-29 国网上海市电力公司 10kV high-voltage metering cubicle final acceptance of construction simulation system and analogy method based on virtual reality technology
CN109887372A (en) * 2019-04-16 2019-06-14 北京中公高远汽车试验有限公司 Driving training analogy method, electronic equipment and storage medium
CN110222639A (en) * 2019-06-05 2019-09-10 清华大学 Human body stress reaction test method and system
CN110427682A (en) * 2019-07-26 2019-11-08 清华大学 A kind of traffic scene simulation experiment platform and method based on virtual reality
CN111435573A (en) * 2019-01-15 2020-07-21 哈尔滨唯尔时空科技有限公司 Automobile driving skill simulator based on VR display
CN111506980A (en) * 2019-01-30 2020-08-07 斯特拉德视觉公司 Method and device for generating traffic scene for virtual driving environment
CN112071155A (en) * 2020-08-17 2020-12-11 南昌泰豪虚拟现实科技有限公司 VR automobile driving analog machine for traffic education
CN112349172A (en) * 2020-10-20 2021-02-09 易显智能科技有限责任公司 Method and related device for training safety stress response capability of driver
CN114627717A (en) * 2022-03-28 2022-06-14 同济大学建筑设计研究院(集团)有限公司 Virtual reality and big data analysis-based novice driver training system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102184659A (en) * 2011-06-09 2011-09-14 公安部交通管理科学研究所 Automobile traffic safety simulation driving education training system
CN102542869A (en) * 2010-12-21 2012-07-04 北京宣爱智能模拟技术有限公司 Automobile driving skill testing and evaluation system
CN104464438A (en) * 2013-09-15 2015-03-25 南京大五教育科技有限公司 Virtual reality technology-based automobile driving simulation training system
CN106023714A (en) * 2016-04-26 2016-10-12 上海悉德信息科技有限公司 Analogue driving examination system
CN106251735A (en) * 2016-10-13 2016-12-21 西南大学 A kind of virtual driving system
CN106652643A (en) * 2016-10-12 2017-05-10 大连文森特软件科技有限公司 Driving training simulation system based on virtual reality technology
CN106960612A (en) * 2017-05-24 2017-07-18 电子科技大学 One kind sees car and test ride simulation system and method based on VR

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102542869A (en) * 2010-12-21 2012-07-04 北京宣爱智能模拟技术有限公司 Automobile driving skill testing and evaluation system
CN102184659A (en) * 2011-06-09 2011-09-14 公安部交通管理科学研究所 Automobile traffic safety simulation driving education training system
CN104464438A (en) * 2013-09-15 2015-03-25 南京大五教育科技有限公司 Virtual reality technology-based automobile driving simulation training system
CN106023714A (en) * 2016-04-26 2016-10-12 上海悉德信息科技有限公司 Analogue driving examination system
CN106652643A (en) * 2016-10-12 2017-05-10 大连文森特软件科技有限公司 Driving training simulation system based on virtual reality technology
CN106251735A (en) * 2016-10-13 2016-12-21 西南大学 A kind of virtual driving system
CN106960612A (en) * 2017-05-24 2017-07-18 电子科技大学 One kind sees car and test ride simulation system and method based on VR

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108877374A (en) * 2018-07-24 2018-11-23 长安大学 Vehicle platoon analogue system and method based on virtual reality and driving simulator
CN108922307A (en) * 2018-07-26 2018-11-30 杭州拓叭吧科技有限公司 Drive simulating training method, device and driving simulation system
CN109542226A (en) * 2018-11-22 2019-03-29 国网上海市电力公司 10kV high-voltage metering cubicle final acceptance of construction simulation system and analogy method based on virtual reality technology
CN111435573A (en) * 2019-01-15 2020-07-21 哈尔滨唯尔时空科技有限公司 Automobile driving skill simulator based on VR display
CN111506980B (en) * 2019-01-30 2023-09-08 斯特拉德视觉公司 Method and device for generating traffic scene for virtual driving environment
CN111506980A (en) * 2019-01-30 2020-08-07 斯特拉德视觉公司 Method and device for generating traffic scene for virtual driving environment
CN109887372A (en) * 2019-04-16 2019-06-14 北京中公高远汽车试验有限公司 Driving training analogy method, electronic equipment and storage medium
WO2020244060A1 (en) * 2019-06-05 2020-12-10 清华大学 Human body stress response test method, system, and computer readable storage medium
CN110222639A (en) * 2019-06-05 2019-09-10 清华大学 Human body stress reaction test method and system
US11751785B2 (en) 2019-06-05 2023-09-12 Tsinghua University Testing method and testing system for human stress reaction, and computer-readable storage medium
CN110427682A (en) * 2019-07-26 2019-11-08 清华大学 A kind of traffic scene simulation experiment platform and method based on virtual reality
CN112071155A (en) * 2020-08-17 2020-12-11 南昌泰豪虚拟现实科技有限公司 VR automobile driving analog machine for traffic education
CN112349172A (en) * 2020-10-20 2021-02-09 易显智能科技有限责任公司 Method and related device for training safety stress response capability of driver
CN114627717A (en) * 2022-03-28 2022-06-14 同济大学建筑设计研究院(集团)有限公司 Virtual reality and big data analysis-based novice driver training system

Similar Documents

Publication Publication Date Title
CN108091203A (en) It is a kind of based on virtual reality technology stress traffic scene driving training system
CN105788401B (en) Defensive drive simulation based on real vehicle body experiences training system
CN109658768B (en) Virtual reality's many people are with scene mixed traffic flow simulation experiment platform
CN104851330B (en) A kind of parking simulated training method and system
CN203366572U (en) Vehicle driving simulator
CN105654808A (en) Intelligent training system for vehicle driver based on actual vehicle
CN107945604A (en) A kind of traffic safety immersion experiencing system based on virtual reality technology
Galko et al. Vehicle-Hardware-In-The-Loop system for ADAS prototyping and validation
CN112819968B (en) Test method and device for automatic driving vehicle based on mixed reality
CN107871418A (en) It is a kind of to be used to evaluate the man-machine experiment porch for driving reliability altogether
US10713970B2 (en) Driver education system and method for training in simulated road emergencies
CN106327946A (en) Virtual reality integrated machine for driving training
CN104517493A (en) High-speed rail driving simulation system
CN112015164A (en) Intelligent networking automobile complex test scene implementation system based on digital twin
CN108648555A (en) A kind of intelligent travelling crane training device, system and method
CN101739856A (en) Interactive automobile driving teaching system and method
CN108922307A (en) Drive simulating training method, device and driving simulation system
CN111915956B (en) Virtual reality car driving teaching system based on 5G
CN111798718A (en) Driving adaptability training method, host and device based on virtual reality
CN105336242A (en) Automotive training simulator and automobile simulation assembly with same
CN206619301U (en) Strengthen the safe driving simulated training educational system of special efficacy with environment
CN110930811B (en) System suitable for unmanned decision learning and training
CN108447306B (en) Simulation method for real-time position sharing collision avoidance early warning among collision vehicles at uncontrolled intersection
CN204332141U (en) A kind of high ferro driving analog system
CN202939834U (en) Double-degree of freedom dynamic automobile-driving safety-training apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180529

RJ01 Rejection of invention patent application after publication