CN109933208A - A kind of operation behavior recognition methods and system based on virtual reality - Google Patents
A kind of operation behavior recognition methods and system based on virtual reality Download PDFInfo
- Publication number
- CN109933208A CN109933208A CN201910288156.7A CN201910288156A CN109933208A CN 109933208 A CN109933208 A CN 109933208A CN 201910288156 A CN201910288156 A CN 201910288156A CN 109933208 A CN109933208 A CN 109933208A
- Authority
- CN
- China
- Prior art keywords
- image
- virtual
- driver
- virtual reality
- processor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention relates to technical field of virtual reality, more particularly to a kind of operation behavior recognition methods and special vehicle virtual reality driving analog system based on virtual reality, the system includes: virtual reality helmet, two-hand positions capture device, and virtual reality helmet includes processor and image display；Two-hand positions capture device is used to acquire the two-hand positions image of driver；Processor is for merging the two-hand positions image of driver with the virtual image that image display is presented；Based on image more than fusion a later frame, the gesture behavior of driver is obtained；Processor corresponds to the target touch point in virtual image based on the gesture behavior of driver, obtain the operation behavior of driver, and the operation behavior based on driver, the driving effect picture of virtual special vehicle corresponding with the operation behavior of driver is presented by image display, not only real simulation Driving Scene effect more improves the safety of drive simulating training.
Description
Technical field
The present invention relates to technical field of virtual reality more particularly to a kind of operation behavior recognition methods based on virtual reality
And special vehicle virtual reality driving analog system.
Background technique
Existing special vehicle and engineering truck are limited by whole vehicle functions and structure, and generally existing shape is roomy, drives
The shortcomings that limited view, more demanding to the operative skill of driver, driving difficulty and manipulation strength are larger.Especially in vehicle
It, can not accurate observation since driver's seat is limited when by the extreme terrains such as abrupt slope, limited road, trench, vertical obstacle
The relative position of road conditions and wheel and road, there are biggish security risks.
Therefore, how to improve the safety during the simulated training of these vehicles is that technology urgently to be resolved at present is asked
Topic.
Summary of the invention
In view of the above problems, it proposes on the present invention overcomes the above problem or at least be partially solved in order to provide one kind
State operation behavior recognition methods based on virtual reality and the special vehicle virtual reality driving analog system of problem.
In a first aspect, the embodiment of the present invention provides a kind of operation behavior recognition methods based on virtual reality, it is applied to void
In quasi- reality helmet, comprising:
Receive the two-hand positions image of user；
The two-hand positions image of the user is merged with the virtual image that virtual reality helmet is presented；
Based on image more than fusion a later frame, the gesture behavior of the user and the gesture row of the user are obtained
For corresponding to the target touch point in the virtual image；
Gesture behavior and the target touch point based on the user, obtain the operation behavior of the user.
Further, the virtual image that the two-hand positions image by the user and virtual reality helmet are presented
Fusion, specifically includes:
, the user Chong Die with the virtual image that virtual reality helmet is presented by the two-hand positions image of the user
Two-hand positions image be located at the top of the virtual image.
Second aspect, the present invention also provides a kind of special vehicle virtual reality driving analog systems, comprising: virtual reality
Helmet, two-hand positions capture device, the virtual reality helmet includes processor and image display；
The two-hand positions capture device is used to acquire the two-hand positions image of driver；
The processor is used to be presented the two-hand positions image of the driver with described image display module virtual
Image co-registration；Based on image more than the fusion a later frame, obtain the driver gesture behavior and the user
Gesture behavior corresponds to the target touch point in the virtual image；Gesture behavior of the processor based on the driver and
The target touch point obtains the operation behavior of the driver, and the operation behavior based on the driver, passes through the figure
As the driving effect picture of virtual special vehicle corresponding with the operation behavior of the driver is presented in display module.
Further, further includes: steering wheel；The processor is used to obtain the turn signal of the steering wheel, is based on institute
It states turn signal and steering driving effect of the virtual special vehicle on virtual road is presented by described image display module
Figure.
Further, the processor is also used to after the turn signal for obtaining the steering wheel, controls the steering
The active force of disk execution opposite direction.
Further, further includes: device with pedal, the processor are used to obtain the signal of trampling of the device with pedal, base
It tramples signal in described acceleration of the virtual special vehicle on the virtual road is presented by described image display module
Or the driving effect picture to slow down.
Further, the device with pedal specifically includes accelerator pedal and brake pedal.
Further, the virtual reality helmet further includes position sensor sensor, the position sensor sensor
For acquiring the head movement information of driver, the processor is used to be based on the head movement information, be shown by image
Driving Scene effect picture corresponding with the head movement information is presented in module.
The third aspect the present invention also provides a kind of computer equipment, including memory, processor and is stored in memory
Computer program that is upper and can running on a processor, is realized when the processor executes described program as above-mentioned one kind is based on
The step of operation behavior recognition methods of virtual reality.
Further, the present invention also provides a kind of computer readable storage medium, it is stored thereon with computer program, it should
It realizes when program is executed by processor such as the step of a kind of above-mentioned operation behavior recognition methods based on virtual reality.
One or more technical solutions in the embodiment of the present invention, have at least the following technical effects or advantages:
The present invention provides a kind of special vehicle virtual reality driving analog system, specifically includes virtual reality and wear and set
Standby, two-hand positions capture device, the virtual reality helmet include processor and image display, which captures
Device is used to acquire the two-hand positions image of driver, processor is used to the two-hand positions image and image of driver showing mould
The virtual image fusion that block is presented, based on image more than the fusion a later frame, obtains gesture behavior and the user of driver
Gesture behavior correspond to virtual image in target touch point, gesture behavior and the target of the processor based on the driver
Touch point obtains the operation behavior of the driver, and the operation behavior based on the driver, is presented by the image display
The driving effect picture of virtual special vehicle corresponding with the operation behavior of driver comes by using the helmet of virtual reality
Driving scene figure in virtual reality opens virtual by gesture operation in trainer in the acquisition of two-hand positions capture device
When pseudo operation key in the scape figure of parking lot carries out touch-control, the helmet of the virtual reality can be presented and corresponding virtual behaviour
Make the corresponding driving effect picture of key, and then simulate the Driving Scene of actual special vehicle, avoids driving due to driver
The driving vision for sailing special vehicle is limited, can not accurate observation to the current condition of passing road and the opposite position of wheel and road
It sets, causes the security risk in driving procedure, and then by way of virtual reality, simulate the Driving Scene of special vehicle, and
And in the virtual scene, driver can form interaction with the icon in the virtual scene by actual operation behavior, no
Only real simulation Driving Scene effect more improves the safety of drive simulating training.
Detailed description of the invention
By reading the following detailed description of the preferred embodiment, various other advantages and benefits are common for this field
Technical staff will become clear.The drawings are only for the purpose of illustrating a preferred embodiment, and is not considered as to the present invention
Limitation.And throughout the drawings, identical component is indicated with identical reference pattern.In the accompanying drawings:
Fig. 1 shows the step process signal of the operation behavior recognition methods in the embodiment of the present invention based on virtual reality
Figure；
Fig. 2 shows the structural schematic diagrams of special vehicle virtual reality driving analog system in the embodiment of the present invention；
Fig. 3 shows the schematic illustration for realizing that control turns to when operating steering wheel in the embodiment of the present invention；
Fig. 4 shows to operate steering wheel in the embodiment of the present invention and organize course changing control button afterwards realizes course changing control jointly
Schematic diagram；
Fig. 5 shows and realizes the schematic illustration for accelerating control when operating accelerator pedal in the embodiment of the present invention；
Fig. 6 shows the schematic illustration that ramp to stop control is realized when operating brake pedal in the embodiment of the present invention；
Fig. 7 shows the structural representation of another special vehicle virtual reality driving analog system in the embodiment of the present invention
Figure；
Fig. 8 shows a kind of structural schematic diagram of computer equipment in the embodiment of the present invention.
Specific embodiment
Exemplary embodiments of the present disclosure are described in more detail below with reference to accompanying drawings.Although showing the disclosure in attached drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
It is fully disclosed to those skilled in the art.
Embodiment one
The embodiment of the present invention one provides a kind of operation behavior recognition methods based on virtual reality, is applied to virtual reality
In helmet, comprising: S101 receives the two-hand positions image of user；S102, by the two-hand positions image of user and virtually
The virtual image fusion that real helmet is presented；S103 obtains the gesture row of user based on image more than fusion a later frame
For and the user gesture behavior correspond to virtual image in target touch point；S104, the gesture behavior based on user
With target touch point, the operation behavior of user is obtained.
The virtual reality helmet specifically can be the helmet, be also possible to glasses etc., there is projectable to present visible
The equipment of virtual image.
The scene of virtual reality can be presented in the virtual reality helmet, and the scene of the virtual reality specifically can be the sky
, ground, in water etc. can see rainy scene for example, can be there are many kinds of scene rendering on cloud,
It can be the scene for seeing the ball match of simulation on the ground, be also possible to scene dived under water in water etc..
In the embodiment of the present invention, first in S101, which can receive the both hands position of user
Image is set, specifically can be the two-hand positions image according to image acquisition device to user, which can be with
It is that camera or laser emitter etc. are held after the two-hand positions image of the image acquisition device to user
Row S102 merges the two-hand positions image of user with the virtual image that virtual reality helmet is presented, specifically, by user
Two-hand positions image it is Chong Die with the virtual image that virtual reality helmet is presented, the two-hand positions image of the user is located at void
The top of quasi- image.Virtual image, i.e. virtual scene figure can be presented in the virtual reality helmet itself.It will use in this step
The two-hand positions image at family is merged with the virtual image that virtual reality helmet is presented, and the blending image of acquisition is exactly by user
Both hands and virtual image a width figure.
After S102, further includes: based on the both hands of user during mobile on the virtual image, in different targets
Touch point, which can correspond to, shows that different prompts is shown.The prompt information is specially speech prompt information and/or text prompt information.
For example, in the image of the two-hand positions image and dummy keyboard that have merged user, when the both hands of user are moved to
When operation keyboard position on virtual image, when the finger of user is directed to one of key, by the key
It can show the title, function and operation instruction of the key, certainly, these verbal descriptions again may be by voice and be shown.
For another example, in the two-hand positions image of fusion user and the image of virtual gunnery target, when the both hands of user are moved to virtual graph
When as upper gunnery target, the finger of user is directed toward the target center that virtual gunnery target can be aimed in moving process, when aiming at the bull's-eye,
It can show the prompt information for having aimed at target center, or be prompted by voice.
Then, S103 is executed, based on image more than fusion a later frame, obtains gesture behavior and the user of user
Gesture behavior corresponds to the target touch point in virtual image.
Since the both hands of user in the two-hand positions image of the user of acquisition are voluntomotory, then fused at this
In image, the both hands of user have relative positional relationship relative to static virtual image, when obtaining the gesture behavior of user,
It, can be according to by the two-hand positions image of user and virtual reality head since user gesture behavior is a dynamic image
The image of the frame after the virtual image that equipment is presented merges or more is worn to obtain, i.e., continuous multiple image can react
The gesture behavior of user.The gesture behavior of the user corresponds to the target touch point in virtual image, refers specifically to the gesture behavior
Icon at corresponding position, the icon are target touch point.
Finally, executing S104, gesture behavior and target touch point based on user obtain the operation behavior of user.
For example, the gesture behavior of user is the gesture for clicked at push button in virtual image, obtain
The operation behavior of the user is to click the push button；The gesture behavior of user aims at the target center of the gunnery target in virtual image,
The operation behavior for obtaining user is to the gunnery target aimed fire, etc..
Embodiment two
Based on identical innovation and creation, the embodiment of the invention provides a kind of special vehicle virtual reality drive simulation systems
System, as shown in Figure 2, comprising: virtual reality helmet 201, two-hand positions capture device 202, the virtual reality helmet
201 include processor 2011 and image display 2012.
The two-hand positions capture device 202 is used to acquire the two-hand positions image of driver；The processor 2011 is used for will
The two-hand positions image of driver is merged with the virtual image that the image display 2012 is presented, more than fusion a later frame
Image, obtain driver gesture behavior and user gesture behavior correspond to virtual image in target touch point, should
Gesture behavior and target touch point of the processor based on the driver obtain the operation behavior of driver, and are based on the driver
Operation behavior, pass through the image display 2012 and corresponding with the operation behavior of the driver virtual special vehicle be presented
Drive effect picture.
For example, when needing to open car light, opening the function buttons such as rain brush, the figure can be passed through in driver's driving procedure
These virtual keys are presented as display module 202, by processor 2011 to the two-hand positions image and the void of the driver
After the image co-registration of quasi- key, the gesture behavior of the gesture behavior and driver that obtain driver corresponds in virtual image
Target touch point, for example the finger of driver clicks car light key, so that it is determined that driver is to need to open car light, this
When, the driving effect picture of virtual special vehicle corresponding with driving lamp is presented by image display 2012, i.e., correspondence should
The brightness in the region that virtual special vehicle front end car light can be irradiated to is adjusted.
Certainly, for special vehicle, the function button needed also can be more, for example, working as engineering truck for engineering truck
When unloading raw material, unloading button is shown by image display 202, when being to click according to the gesture behavior determination of driver
After the unloading button, confirm that the driver needs to unload, at this point, engineering truck unloading is presented by image display 2012
Scene drive effect picture.
And then the collected driver's two-hand positions image of two-hand positions capture device 202 and image display will be passed through
The virtual image of 2012 displays realizes interaction, and then is presented by the virtual scene after interaction, by way of virtual reality,
It is true that the driving effect picture for driving special vehicle is presented, and then real simulation drives effect, and it is extraordinary to improve simulation training driving
The safety of vehicle.
Special vehicle refers to that contour dimension, weight etc. are more than design vehicle limit and with specific use vehicle
, by special or special repacking, equipped with fixed appliance arrangement, major function is not intended to manned or cargo transport motor vehicle
?.
Since the structure of special vehicle is more complicated, driving vision is also limited to, and driving difficulty is relatively high, moreover, this
The operation button of a little vehicle interiors is more, and driver is when maiden attempt drives, since the movement for being not suitable with this vehicle is special
Property and drive main points, be difficult to adapt to the vehicle of this complexity, therefore, drive safety cannot get effective guarantee.
Therefore, driving simulation system provided by the present invention is the system of a set of virtual driving, and driver can be made true
The kinetic characteristic and driving main points of vehicle during driving experience, provide the special vehicle dummy row of closing to reality for driver
Environment is sailed, is convenient for driver before really driving special vehicle, in advance driving experience effect, while having ensured the safety driven
Property, it prepares for true driving.
In a kind of special vehicle virtual reality driving analog system provided by the invention, virtual reality helmet 202
It is combined with two-hand positions capture device 201, provides the scene that driver interacts with the target image in virtual reality image, mention
The high efficiency of drive simulating.
In a particular embodiment, which is arranged in virtual reality helmet face driver
The position of both hands, for acquiring the two-hand positions image of driver, when the virtual reality helmet is specially the helmet, this pair
Hand position capture device is located at the front end of the helmet；When the virtual reality helmet is specially glasses, which is caught
It catches on the mirror holder that device is located between two eyeglasses of the glasses.
In a preferred embodiment, which further includes steering wheel 203, and the steering wheel 203 is for realizing vehicle
Steering, processor 2021 is used to obtain the turn signal of the steering wheel 203, passes through image display based on the turn signal
2022, which are presented steering of the virtual special vehicle on virtual road, drives effect picture.
In actual operation, as shown in figure 3, when driver operates steering wheel 203, I, II bridge wheel steering, steering angle δ
Directly proportional to the steering angle of steering wheel 203, between III bridge and IV bridge, steering angle δ increases special vehicle turning center O,
Turning radius PO reduces, and realizes the first steering mode.As shown in figure 4, operating steering wheel in driver on special vehicle
Course changing control button is organized open simultaneously again after (to be had by the finger that two-hand positions capture device captures driver after clicking this
Group course changing control button) when, which is used to control the steering of IV bridge wheel, i.e. driver's operation at this time turns
When to disk 203, I, II, IV bridge wheel steering, wherein I, II bridge wheel is the steering realized by the control of steering wheel 203, IV bridge vehicle
Wheel is controlled by the rear group of course changing control button, and steering angle sigma at this time is directly proportional to 203 angle of steering wheel, and special vehicle turns
Curved center O1On III bridge core wheel connection extended line, when steering angle sigma increases, turning radius P1O1Reduce, turning radius P1O1
It is smaller relative to turning radius PO.
In the scene specifically turned, driver realizes the virtual special purpose vehicle by the steering operation of the operation steering wheel 203
Steering on virtual road drives.Since the steering behavior of special vehicle is joined referring to the trees etc. on road or road
Relative motion according to object embodies, therefore, the figure of the relative position variation by showing virtual special vehicle and virtual road
Picture, for example, the scenery on the right of road is fallen back than very fast when turning left, the scenery retroversion on the left side is slow, to present virtual special
Steering of the kind vehicle on virtual road drives effect picture.
The virtual road specifically can be the road of different scenes, for example, flat highway, muddy path, curved
Hill path etc. according to the road of different scenes, and then simulates driving effect of the special vehicle on the road of corresponding scene, than
Such as, on flat highway, special vehicle traveling is gentle, and the scenery of surrounding is fallen back backward with pre-set velocity；In muddy path
On, special vehicle traveling is jolted, and the speed that the scenery of surrounding is fallen back backward is also sometimes fast and sometimes slow.
The processor 2021 is also used to after the turn signal for obtaining steering wheel, is controlled the steering wheel and is executed opposite direction
Active force.
Specifically, when driver is realizing steering of the virtual special vehicle on virtual road by operating steering wheel 203
After driving effect, which executes the active force of opposite direction, i.e., turns to clockwise when driver operates steering wheel 203
Later, which can execute anticlockwise active force, to restore the torque of steering wheel 203, real simulation is turned to
The power sense of disk 203.
In a preferred embodiment, system further include: device with pedal 204, processor is for obtaining the pedal
Device tramples signal, tramples signal based on this and the virtual special vehicle is presented on virtual road by image display
The driving effect picture for accelerating or slowing down.
Specifically, which includes accelerator pedal and brake pedal.As shown in figure 5, the special vehicle is more bridges
Automobile, when driver's step on the accelerator, each bridge wheel driving force F increases, which is accelerated forwardly traveling, driving force
The numerical value of F is directly proportional to accelerator angle changing value；As shown in fig. 6, when driver tramples brake pedal, each bridge wheel system
Kinetic moment M increases, and the numerical value of special vehicle Reduced Speed Now, braking moment M is directly proportional to angle of brake pedal variation.And then pass through
Actual acceleration and moderating process are simulated, the driving effect picture of acceleration and deceleration of the special vehicle on virtual road is opened up
Show.
For example, the variation of the deformation angle of the accelerator pedal is aobvious by the image when according to driver's step on the accelerator
Show that module 2022 shows that acceleration of the special vehicle on virtual road drives effect picture, can specifically pass through virtual road two sides
The variation for the acceleration that scenery retreats is realized.Similarly, when trampling brake pedal according to driver, the deformation angle of the brake pedal
Variation, show that deceleration of the special vehicle on virtual road drives effect picture by the image display 2022, specifically
It can be realized by the variation for the acceleration that the scenery of virtual road two sides retreats.
As shown in fig. 7, the steering wheel 203 of entity to be combined to the helmet 201 of virtual reality and double with device with pedal 204
Hand position capture device 202 enables the virtual reality driving analog system to be more nearly true real training experience.
In a preferred embodiment, which further includes position sensor sensor, the party
Position inductive pick-up is used to acquire the head movement information of driver, and processor 2021 is used to be based on the head movement information, lead to
It crosses image display and Driving Scene effect picture corresponding with the head movement information is presented.
For example, when the orientation inductive pick-up detects that the head of driver is tilted to the left, since virtual reality is worn
Equipment 202 is opposite with the head of driver constant, thus image shown by image display 2022 is also tilted to the left simultaneously,
But in order to enable simulate the true driving vision figure of driver, image shown by the image display 2022 need to be done
Adjustment, is specifically adjusted to be tilted to the right.Specific as shown in Figure 7: A1 is image adjusted.
One or more technical solutions in the embodiment of the present invention, have at least the following technical effects or advantages:
The present invention provides a kind of special vehicle virtual reality driving analog system, specifically includes virtual reality and wear and set
Standby, two-hand positions capture device, the virtual reality helmet include processor and image display, which captures
Device is used to acquire the two-hand positions image of driver, processor is used to the two-hand positions image and image of driver showing mould
The virtual image fusion that block is presented, based on image more than the fusion a later frame, obtains the gesture behavior of driver, processor base
Correspond to the target touch point in virtual image in the gesture behavior of the driver, obtains the operation behavior of the driver, and base
In the operation behavior of the driver, virtual special purpose vehicle corresponding with the operation behavior of driver is presented by the image display
Driving effect picture, carry out the driving scene figure in virtual reality by using the helmet of virtual reality, in two-hand positions
Capture device acquisition carries out touch-control to the pseudo operation key in virtual driving scene figure by gesture operation in trainer
When, driving effect picture corresponding with corresponding pseudo operation key can be presented in the helmet of the virtual reality, and then simulates
The Driving Scene of actual special vehicle, avoid due to driver drive special vehicle driving vision it is limited, Wu Fazhun
The relative position for really observing the current condition of passing road and wheel and road, causes the security risk in driving procedure, into
And by way of virtual reality, the Driving Scene of special vehicle is simulated, and in the virtual scene, driver passes through reality
Operation behavior can form interaction with the icon in the virtual scene, not only real simulation Driving Scene effect, more improves
The safety of drive simulating training.
Embodiment three
Based on identical inventive concept, third embodiment of the invention provides a kind of computer equipment, as shown in figure 8, including
Memory 804, processor 802 and it is stored in the computer program that can be run on memory 804 and on processor 802, it is described
The step of processor 802 realizes the above-mentioned operation behavior recognition methods based on virtual reality when executing described program.
Wherein, in Fig. 4, bus architecture (is represented) with bus 800, and bus 800 may include any number of interconnection
Bus and bridge, bus 800 will include the one or more processors represented by processor 802 and what memory 804 represented deposits
The various circuits of reservoir link together.Bus 800 can also will peripheral equipment, voltage-stablizer and management circuit etc. it
Various other circuits of class link together, and these are all it is known in the art, therefore, no longer carry out further to it herein
Description.Bus interface 806 provides interface between bus 800 and receiver 801 and transmitter 803.Receiver 801 and transmitter
803 can be the same element, i.e. transceiver, provide the unit for communicating over a transmission medium with various other devices.Place
It manages device 802 and is responsible for management bus 800 and common processing, and memory 804 can be used for storage processor 802 and execute behaviour
Used data when making.
Example IV
Based on identical inventive concept, fourth embodiment of the invention provides a kind of computer readable storage medium, thereon
It is stored with computer program, which realizes the above-mentioned operation behavior recognition methods based on virtual reality when being executed by processor
Step.
Although preferred embodiments of the present invention have been described, it is created once a person skilled in the art knows basic
Property concept, then additional changes and modifications may be made to these embodiments.So it includes excellent that the following claims are intended to be interpreted as
It selects embodiment and falls into all change and modification of the scope of the invention.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art
Mind and range.In this way, if these modifications and changes of the present invention belongs to the range of the claims in the present invention and its equivalent technologies
Within, then the present invention is also intended to include these modifications and variations.
Claims (10)
1. a kind of operation behavior recognition methods based on virtual reality is applied in virtual reality helmet, which is characterized in that
Include:
Receive the two-hand positions image of user；
The two-hand positions image of the user is merged with the virtual image that virtual reality helmet is presented；
Based on image more than fusion a later frame, the gesture behavior of the user and the gesture behavior pair of the user are obtained
Target touch point in virtual image described in Ying Yu；
Gesture behavior and the target touch point based on the user, obtain the operation behavior of the user.
2. the method as described in claim 1, which is characterized in that the two-hand positions image and virtual reality by the user
The virtual image fusion that helmet is presented, specifically includes:
The two-hand positions image of the user is Chong Die with the virtual image that virtual reality helmet is presented, and the user's is double
Hand position image is located at the top of the virtual image.
3. a kind of special vehicle virtual reality driving analog system characterized by comprising virtual reality helmet, both hands
Position capture device, the virtual reality helmet includes processor and image display；
The two-hand positions capture device is used to acquire the two-hand positions image of driver；
The processor is used for the virtual image that the two-hand positions image of the driver and described image display module is presented
Fusion；Based on image more than the fusion a later frame, the gesture behavior of the driver and the gesture of the user are obtained
Behavior corresponds to the target touch point in the virtual image；Gesture behavior of the processor based on the driver and described
Target touch point obtains the operation behavior of the driver, and the operation behavior based on the driver, aobvious by described image
Show that the driving effect picture of virtual special vehicle corresponding with the operation behavior of the driver is presented in module.
4. system as claimed in claim 3, which is characterized in that further include: steering wheel；The processor is for obtaining described turn
To the turn signal of disk, the virtual special vehicle is presented virtual by described image display module based on the turn signal
Steering on road drives effect picture.
5. system as claimed in claim 4, which is characterized in that the processor is also used in the steering for obtaining the steering wheel
After signal, the active force that the steering wheel executes opposite direction is controlled.
6. system as claimed in claim 3, which is characterized in that further include: device with pedal, the processor are described for obtaining
Device with pedal tramples signal, based on it is described trample signal the virtual special vehicle be presented by described image display module exist
The driving effect picture of acceleration or deceleration on the virtual road.
7. system as claimed in claim 6, which is characterized in that the device with pedal specifically includes accelerator pedal and braking is stepped on
Plate.
8. system as claimed in claim 3, which is characterized in that the virtual reality helmet further includes position sensor sensing
Device, the position sensor sensor are used to acquire the head movement information of driver, and the processor is used to be based on the head
Driving Scene effect picture corresponding with the head movement information is presented by image display in motion information.
9. a kind of computer equipment including memory, processor and stores the meter that can be run on a memory and on a processor
Calculation machine program, which is characterized in that the processor is realized when executing described program such as any claim institute in claim 1-2
The method and step stated.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor
The method and step as described in any claim in claim 1-2 is realized when execution.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910288156.7A CN109933208A (en) | 2019-04-11 | 2019-04-11 | A kind of operation behavior recognition methods and system based on virtual reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910288156.7A CN109933208A (en) | 2019-04-11 | 2019-04-11 | A kind of operation behavior recognition methods and system based on virtual reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109933208A true CN109933208A (en) | 2019-06-25 |
Family
ID=66989768
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910288156.7A Pending CN109933208A (en) | 2019-04-11 | 2019-04-11 | A kind of operation behavior recognition methods and system based on virtual reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109933208A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111045425A (en) * | 2019-12-05 | 2020-04-21 | 中国北方车辆研究所 | Auxiliary teleoperation driving method for ground unmanned vehicle |
| CN112289125A (en) * | 2020-11-16 | 2021-01-29 | 株洲壹星科技股份有限公司 | Vehicle MR simulation driving practical training method and practical training device |
| CN112572665A (en) * | 2020-12-03 | 2021-03-30 | 敖立鸿 | Low-wind-resistance lying type bicycle |
| CN115909851A (en) * | 2022-12-01 | 2023-04-04 | 江西科骏实业有限公司 | Immersive driving simulation system for rail transit vehicle and application method thereof |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106205273A (en) * | 2016-09-20 | 2016-12-07 | 山西省交通科学研究院 | A kind of Vehicle driving simulator based on VR analogue technique and method |
| CN106980362A (en) * | 2016-10-09 | 2017-07-25 | 阿里巴巴集团控股有限公司 | Input method and device based on virtual reality scenario |
| CN109144269A (en) * | 2018-09-05 | 2019-01-04 | 戴姆勒股份公司 | A kind of virtual driving method and system |
-
2019
- 2019-04-11 CN CN201910288156.7A patent/CN109933208A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106205273A (en) * | 2016-09-20 | 2016-12-07 | 山西省交通科学研究院 | A kind of Vehicle driving simulator based on VR analogue technique and method |
| CN106980362A (en) * | 2016-10-09 | 2017-07-25 | 阿里巴巴集团控股有限公司 | Input method and device based on virtual reality scenario |
| CN109144269A (en) * | 2018-09-05 | 2019-01-04 | 戴姆勒股份公司 | A kind of virtual driving method and system |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111045425A (en) * | 2019-12-05 | 2020-04-21 | 中国北方车辆研究所 | Auxiliary teleoperation driving method for ground unmanned vehicle |
| CN111045425B (en) * | 2019-12-05 | 2023-04-28 | 中国北方车辆研究所 | Auxiliary teleoperation driving method for ground unmanned vehicle |
| CN112289125A (en) * | 2020-11-16 | 2021-01-29 | 株洲壹星科技股份有限公司 | Vehicle MR simulation driving practical training method and practical training device |
| CN112572665A (en) * | 2020-12-03 | 2021-03-30 | 敖立鸿 | Low-wind-resistance lying type bicycle |
| CN115909851A (en) * | 2022-12-01 | 2023-04-04 | 江西科骏实业有限公司 | Immersive driving simulation system for rail transit vehicle and application method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109933208A (en) | A kind of operation behavior recognition methods and system based on virtual reality | |
| CN108319249B (en) | Unmanned driving algorithm comprehensive evaluation system and method based on driving simulator | |
| CN109636924B (en) | Vehicle-mounted multi-mode augmented reality system based on real road condition information three-dimensional modeling | |
| CN103010099B (en) | Multidate information display on full blast gear head-up display | |
| CN110869901B (en) | User interface device for vehicle and vehicle | |
| Naranjo et al. | Using fuzzy logic in automated vehicle control | |
| CN104260669B (en) | A kind of intelligent automobile HUD | |
| CN111931579A (en) | Automatic driving assistance system and method using eye tracking and gesture recognition technology | |
| CN105068857B (en) | A kind of driving behavior data capture method based on high fidelity driving simulator | |
| CN108688554A (en) | Motor-vehicle bulb | |
| CN109484299A (en) | Control method, apparatus, the storage medium of the display of augmented reality display device | |
| CN103129466A (en) | Driving maneuver assist on full windshield head-up display | |
| CN108447336A (en) | Test system is developed based on driving simulator and the ADAS of programmable touch screen | |
| CN104616559A (en) | System and method for simulating driving of real vehicle | |
| EP0443928A1 (en) | Training method and device for vehicle driving | |
| CN113440849B (en) | Vehicle control method, device, computer equipment and storage medium | |
| CN114022565A (en) | Alignment method and alignment device for display equipment and vehicle-mounted display system | |
| CN108995590A (en) | A kind of people's vehicle interactive approach, system and device | |
| CN107766872A (en) | A kind of method and apparatus for identifying illumination Driving Scene | |
| CN110930811B (en) | System suitable for unmanned decision learning and training | |
| US20230356588A1 (en) | Vehicle display device and vehicle display method | |
| CN117496790A (en) | Virtual fire-fighting vehicle training system, virtual fire-fighting vehicle training method, electronic device and storage medium | |
| CN104575155A (en) | Driving ergonomics designing platform for all-windshield head-up display | |
| CN113079352B (en) | Method and system for backing up display of augmented reality head-up display | |
| Weber et al. | Approach for improved development of advanced driver assistance systems for future smart mobility concepts |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190625 |