CN108830942A - Display methods and display system - Google Patents
Display methods and display system Download PDFInfo
- Publication number
- CN108830942A CN108830942A CN201810696070.3A CN201810696070A CN108830942A CN 108830942 A CN108830942 A CN 108830942A CN 201810696070 A CN201810696070 A CN 201810696070A CN 108830942 A CN108830942 A CN 108830942A
- Authority
- CN
- China
- Prior art keywords
- real
- time
- information
- cabin
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 230000001133 acceleration Effects 0.000 claims abstract description 53
- 238000004088 simulation Methods 0.000 claims abstract description 41
- 230000004927 fusion Effects 0.000 claims abstract description 12
- 230000005540 biological transmission Effects 0.000 claims description 6
- 230000003068 static effect Effects 0.000 claims description 5
- 238000004891 communication Methods 0.000 claims description 4
- 241000208340 Araliaceae Species 0.000 claims description 2
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 claims description 2
- 235000003140 Panax quinquefolius Nutrition 0.000 claims description 2
- 235000008434 ginseng Nutrition 0.000 claims description 2
- 230000002452 interceptive effect Effects 0.000 abstract description 10
- 230000003190 augmentative effect Effects 0.000 abstract description 2
- 230000008569 process Effects 0.000 description 10
- 230000006870 function Effects 0.000 description 7
- 230000003993 interaction Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 239000004576 sand Substances 0.000 description 6
- 238000012549 training Methods 0.000 description 5
- 230000009471 action Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 210000003141 lower extremity Anatomy 0.000 description 3
- 210000001364 upper extremity Anatomy 0.000 description 3
- 210000003414 extremity Anatomy 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 230000013011 mating Effects 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The present embodiments relate to augmented reality fields, in particular to a kind of display methods and display system.This method includes：Obtain the video image of camera and the camera out of my cabin shooting in the cabin, obtain the initial attitude model for having dressed the user of the clothes for drivers, receive the real-time directional information of each sensor, real-time position information and real time acceleration information, according to the real-time directional information, the real-time position information and the real time acceleration information calculate the pose adjustment parameter for having dressed the user of the clothes for drivers, the initial attitude model is adjusted according to the pose adjustment parameter, by the video image that camera in the cabin and the camera out of my cabin take and the initial attitude Model Fusion being in during adjusting and carry out real-time display, this method can allow driver or student carry out real-time interactive when carrying out traffic equipment drive simulation.
Description
Technical field
The present embodiments relate to augmented reality fields, in particular to a kind of display methods and display system.
Background technique
Traffic equipment analogue technique can provide more true traffic equipment drive simulation for driver or student, be typically based on
Virtual driving cabin is realized, but is difficult to carry out real-time interactive between driver or student.
Summary of the invention
In view of this, driver or student can be made to carry out the present invention provides a kind of display methods and display system
Real-time interactive can be carried out when traffic equipment drive simulation.
To achieve the above object, the embodiment of the invention provides a kind of display methods, are applied to control equipment, the control
Equipment and traffic equipment boiler-plate communicate to connect, and the traffic equipment boiler-plate is provided in cabin camera and out of my cabin camera, described
Camera and the camera out of my cabin are communicated to connect with the control equipment in cabin, and the method will be for that will be in the traffic
The posture of user in device boiler-plate carries out real-time display, the method includes：
Obtain the video image of camera and the camera out of my cabin shooting in the cabin；
The video image that camera in the cabin and the camera out of my cabin are shot is subjected to anastomosing and splicing, by anastomosing and splicing
Video image later carries out real-time display.
Optionally, the traffic equipment boiler-plate further includes the clothes for drivers for being provided with multiple sensors, each sensor with
The video image that camera in the cabin and the camera out of my cabin are shot is carried out fusion spelling by the control equipment communication connection
The step of connecing, the video image after anastomosing and splicing be subjected to real-time display, including：
Obtain the initial attitude model for having dressed the user of the clothes for drivers；
The real-time directional information, real-time position information and real time acceleration information for receiving each sensor, according to described
Real-time directional information, the real-time position information and the real time acceleration information calculate the user for having dressed the clothes for drivers
Pose adjustment parameter, the initial attitude model is adjusted according to the pose adjustment parameter；
Video image that camera in the cabin and the camera out of my cabin are taken with during adjustment just
Beginning attitude mode merges and carries out real-time display.
Optionally, the video image that camera in the cabin and the camera out of my cabin is taken in adjustment process
In initial attitude Model Fusion and the step of carry out real-time display, including：
Video image that camera in the cabin and the camera out of my cabin are taken with during adjustment just
Simultaneously real-time Transmission to another traffic equipment boiler-plate is shown the fusion of beginning attitude mode.
Optionally, the clothes for drivers includes the helmet, simulation clothing, simulation trousers and gloves；The helmet, the simulation clothing, institute
It states simulation trousers and the gloves is respectively arranged at least one sensor；Obtain the initial appearance for having dressed the user of the clothes for drivers
The step of states model, including：
When user has dressed the helmet, the simulation clothing, the simulation trousers and the gloves and in the traffic equipment mould
When remaining static in quasi- cabin, obtains be set to the helmet, the simulation clothing, the simulation trousers and the gloves respectively
Directional information, location information and the acceleration information of at least one sensor；
The helmet, the simulation clothing, the simulation trousers and the gloves are set at least according to what is got respectively
Directional information, location information and the acceleration information of one sensor, which simulate, has dressed the helmet, the simulation clothing, described
Simulate trousers and the gloves and the initial attitude model of the user to remain static in the traffic equipment boiler-plate.
Optionally, real-time directional information, real-time position information and the real time acceleration information of each sensor, root are received
It calculates according to the real-time directional information, the real-time position information and the real time acceleration information and has dressed the clothes for drivers
User pose adjustment parameter the step of, including：
It receives and is set to real-time directional information, real-time position information and reality that at least one sensor of the helmet is sent
Brief acceleration information is calculated according to the real-time directional information, the real-time position information and the real time acceleration information
Head pose adjusting parameter.
Optionally, real-time directional information, real-time position information and the real time acceleration information of each sensor, root are received
It calculates according to the real-time directional information, the real-time position information and the real time acceleration information and has dressed the clothes for drivers
User pose adjustment parameter the step of, including：
Receive be set to it is described simulation clothing at least one sensor send real-time directional information, real-time position information and
Real time acceleration information is calculated according to the real-time directional information, the real-time position information and the real time acceleration information
Upper limb pose adjustment parameter out.
Optionally, real-time directional information, real-time position information and the real time acceleration information of each sensor, root are received
It calculates according to the real-time directional information, the real-time position information and the real time acceleration information and has dressed the clothes for drivers
User pose adjustment parameter the step of, including：
Receive be set to it is described simulation trousers at least one sensor send real-time directional information, real-time position information and
Real time acceleration information is calculated according to the real-time directional information, the real-time position information and the real time acceleration information
Lower limb pose adjustment parameter out.
Optionally, real-time directional information, real-time position information and the real time acceleration information of each sensor, root are received
It calculates according to the real-time directional information, the real-time position information and the real time acceleration information and has dressed the clothes for drivers
User pose adjustment parameter the step of, including：
It receives and is set to real-time directional information, real-time position information and reality that at least one sensor of the gloves is sent
Brief acceleration information is calculated according to the real-time directional information, the real-time position information and the real time acceleration information
Hand gestures adjusting parameter.
Optionally, multiple reference sensors, each reference sensor and institute are additionally provided in the traffic equipment boiler-plate
Control equipment communication connection is stated, the step of being adjusted according to the pose adjustment parameter to the initial attitude model, including：
By directional information, location information and the acceleration information of the pose adjustment parameter and each reference sensor into
Row compares, and obtains comparison result；
The pose adjustment parameter is inputted into the initial attitude model so that the initial appearance according to the comparison result
States model is moved according to the pose adjustment parameter.
The embodiment of the invention also provides a kind of display systems, including：Control equipment and traffic equipment boiler-plate；
The control equipment and traffic equipment boiler-plate communicate to connect, and the traffic equipment boiler-plate includes being provided with multiple sensings
The clothes for drivers of device, each sensor and the control equipment communicate to connect, and the traffic equipment boiler-plate is provided in cabin and images
Head and camera out of my cabin, camera and the camera out of my cabin are communicated to connect with the control equipment in the cabin, described to show
Show system for real-time display will to be carried out in the posture for the user that the traffic equipment boiler-plate is interior and has dressed the clothes for drivers；
The control equipment is used to obtain the video image of camera and the camera out of my cabin shooting in the cabin, obtains
The initial attitude model of the user of the clothes for drivers is dressed；Receive real-time directional information, the real time position of each sensor
Information and real time acceleration information are believed according to the real-time directional information, the real-time position information and the real time acceleration
Breath calculates the pose adjustment parameter for the user for having dressed the clothes for drivers, according to the pose adjustment parameter to the initial appearance
States model is adjusted；Video image that camera in the cabin and the camera out of my cabin are taken in adjustment process
In initial attitude Model Fusion and carry out real-time display.
Display methods and display system provided by the embodiment of the present invention, control equipment can by camera in cabin and out of my cabin
The video image that camera takes carries out anastomosing and splicing, and is shown, can be realized the use in multiple traffic equipment boiler-plates
The interaction at family, and then realize more true driving training, amusement or emergency rating simulation.
Further, the video image that camera in cabin and out of my cabin camera can also be taken and in adjustment process
In initial attitude model merge and real-time display, by pre-establishing initial attitude model, and by obtaining sensor
Relevant information initial attitude model is adjusted in real time, can reduce interactive information transmission delay.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be to needed in the embodiment attached
Figure is briefly described, it should be understood that the following drawings illustrates only certain embodiments of the present invention, therefore is not construed as pair
The restriction of range for those of ordinary skill in the art without creative efforts, can also be according to this
A little attached drawings obtain other relevant attached drawings.
Fig. 1 is a kind of structural representation of display system provided by the embodiment of the present invention.
Fig. 2 is the structural schematic diagram of a kind of simulator cockpit and clothes for drivers provided by the embodiment of the present invention.
Fig. 3 is a kind of flow chart of display methods provided by the embodiment of the present invention.
Fig. 4 is a kind of another flow chart of display methods provided by the embodiment of the present invention.
Icon：100- display system；1- the first traffic equipment boiler-plate；11- seat；12- projection screen；13- clothes for drivers；131-
The helmet；1311- first sensor；132- simulates clothing；1321- second sensor；133- simulates trousers；1331- 3rd sensor；
134- gloves；The 4th sensor of 1341-；2- the second traffic equipment boiler-plate；3- controls equipment.
Specific embodiment
Traffic equipment analogue technique can provide more true traffic equipment drive simulation for driver or student, be typically based on
It realizes in virtual driving cabin.
Further investigation reveals that existing traffic equipment analogue technique is difficult to make to carry out real-time interactive between driver or student.Hair
Bright people is carefully investigated and is analyzed, it is found that existing traffic equipment analogue technique has delay mostly and transmitted in information transmission
Interactive information is mostly flat image, and simulation quality is lower.
Defect present in the above scheme in the prior art, is that inventor is obtaining after practicing and carefully studying
As a result, therefore, the solution that the discovery procedure of the above problem and the hereinafter embodiment of the present invention are proposed regarding to the issue above
Scheme all should be the contribution that inventor makes the present invention in process of the present invention.
Based on the studies above, the embodiment of the invention provides a kind of display methods and display system, can make driver or
Student can carry out real-time interactive when carrying out traffic equipment drive simulation.
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment only
It is a part of the embodiments of the present invention, instead of all the embodiments.The present invention being usually described and illustrated herein in the accompanying drawings
The component of embodiment can be arranged and be designed with a variety of different configurations.
Therefore, the detailed description of the embodiment of the present invention provided in the accompanying drawings is not intended to limit below claimed
The scope of the present invention, but be merely representative of selected embodiment of the invention.Based on the embodiments of the present invention, this field is common
Technical staff's every other embodiment obtained without creative efforts belongs to the model that the present invention protects
It encloses.
It should be noted that：Similar label and letter indicate similar terms in following attached drawing, therefore, once a certain Xiang Yi
It is defined in a attached drawing, does not then need that it is further defined and explained in subsequent attached drawing.
Fig. 1 shows a kind of structural schematic diagram of display system 100 provided by the embodiment of the present invention, as seen from the figure, should
Display system includes the first traffic equipment boiler-plate 1, the second traffic equipment boiler-plate 2 and control equipment 3.As seen from the figure, equipment 3 is controlled
It is communicated to connect respectively with the first traffic equipment boiler-plate 1 and the second traffic equipment boiler-plate 2, control equipment 3 can be understood as the first friendship
Information terminal between logical device boiler-plate 1 and the second traffic equipment boiler-plate 2, for assisting the first traffic equipment boiler-plate 1 and the
The information interaction of two traffic equipment boiler-plates 2.
It is appreciated that mating inside the first traffic equipment boiler-plate 1 and the second traffic equipment boiler-plate 2 be provided with clothes for drivers,
User can dress clothes for drivers before using the first traffic equipment boiler-plate 1 or the second traffic equipment boiler-plate 2.It should be appreciated that should
The interaction between multiple traffic equipment boiler-plates may be implemented in display system, and for ease of description, Fig. 1 illustrates only two traffic equipments
Boiler-plate is not the restriction to traffic equipment boiler-plate quantity in this programme.
Since the first traffic equipment boiler-plate 1 is similar with the structure of the second traffic equipment boiler-plate 2, only to the first traffic equipment
Boiler-plate 1 is illustrated.
Fig. 1 and Fig. 2 are please referred to, which includes seat 11, projection screen 12 and clothes for drivers 13.
User can dress clothes for drivers 13 and take a seat in seat 11, be simulated by controlling the associated components being set to around seat 11
It drives, user can observe external environment by projection screen 12.It is appreciated that user was controlled by the first traffic equipment boiler-plate 1
It is the sand table traffic equipment on the sand table of a distant place.For example, user A is controlled in the S of sand table place in the first traffic equipment boiler-plate 1
Sand table traffic equipment S1, user B control the sand table traffic equipment S2 in the S of sand table place in the second traffic equipment boiler-plate 2, in this feelings
Under condition, such as S1, before S2, user A wants to wave to user B, is difficult to realize.In view of this, the embodiment of the present invention is logical
It crosses and adds sensor in clothes for drivers 13 and then realize the interaction between user A and user B.
The video image that user B is seen by the projection screen being set in traffic equipment boiler-plate 2 includes being set to traffic equipment
Camera and video image+control equipment 3 that camera takes out of my cabin are dressed by user A in the cabin that boiler-plate 1 is arranged
The sensor added on clothes for drivers 13 obtains the attitude mode for calculating and obtaining.Traffic equipment boiler-plate 1 is set to it is appreciated that being placed in
Camera and the video image that camera takes out of my cabin are practical dynamic video information in the cabin of setting, and attitude mode is void
Quasi- video information, but attitude mode is to be obtained according to the emulation of the real-time action of user A, therefore can realize use to a certain extent
Real-time interactive between family A and user B.It is appreciated that in the present embodiment, can only image by camera in cabin and out of my cabin
The video image that takes of head carries out anastomosing and splicing and real-time display, can also by by cabin/camera and each sensing out of my cabin
Device is used cooperatively, to reach descending for actual situation combination, below with by cabin/camera and each sensor be with the use of carrying out out of my cabin
It is described in detail.
Fig. 3 shows a kind of flow chart of display methods provided by the embodiment of the present invention.The related process of the method
Defined method and step is applied to the control equipment 3 in Fig. 2, and detailed process shown in Fig. 3 will be described in detail below：
Step S31 obtains the video image of camera and camera shooting out of my cabin in cabin, obtains the use for having dressed clothes for drivers
The initial attitude model at family.
Camera and the video image of camera shooting out of my cabin in cabin is obtained to be merged convenient for after.
Fig. 1 and Fig. 2 are please referred to, by taking the first traffic equipment boiler-plate 1 and user A as an example, clothes for drivers 13 includes the helmet
131, clothing 132, simulation trousers 133 and gloves 134 are simulated.Wherein, the helmet 131 is provided at least one first sensor 1311, mould
Quasi- clothing 132 is provided at least one second sensor 1321, and simulation trousers 133 are provided at least one 3rd sensor 1331, hand
Set 134 is provided at least one the 4th sensor 1341.At least one first sensor 1311, at least one second sensor
1321, at least one 3rd sensor 1331 and at least one the 4th sensor 1341 are communicated to connect with control equipment 3.
Enter the first traffic equipment boiler-plate 1 when user A dresses the helmet 131, simulation clothing 132, simulation trousers 133 and gloves 134
Interior and when being seated at seat 11, control equipment 3 obtains at least one first sensor 1311, at least one second sensor respectively
1321, directional information, location information and the acceleration of at least one 3rd sensor 1331 and at least one the 4th sensor 1341
Spend information.For convenience, it is assumed that the helmet 131, simulation clothing 132, simulation trousers 133 and gloves 134 are only provided with a sensing
Device.
The corresponding information of each sensor is as shown in table 1：
Table 1
| Classification | Directional information | Location information | Acceleration information |
| The helmet 131 | D10 | L10 | a10 |
| Simulate clothing 132 | D20 | L20 | a20 |
| Simulate trousers 133 | D30 | L30 | a30 |
| Gloves 134 | D40 | L40 | a40 |
Control equipment 3 simulates the initial attitude model of user A according to the every terms of information in table 1, it will be understood that initial appearance
States model is that user A is seated at seat 11, holds the stationary posture of steering wheel.
It is appreciated that each joint in training clothes 13 can be set in sensor, so set, when user A is being done respectively
When kind limb action, control equipment 3 more preferably can accurately obtain the variation of sensor orientation, position and acceleration information.
Step S32 receives the real-time directional information, real-time position information and real time acceleration information of each sensor, according to
Real-time directional information, real-time position information and real time acceleration information calculate the pose adjustment ginseng for having dressed the user of clothes for drivers
Number, is adjusted initial attitude model according to pose adjustment parameter.
By taking user A as an example, at a time user A makes the movement waved in the first traffic equipment boiler-plate 1, at this time respectively
The corresponding information of a sensor is as shown in table 2：
Table 2
| Classification | Directional information | Location information | Acceleration information |
| The helmet 131 | D11 | L11 | a11 |
| Simulate clothing 132 | D21 | L21 | a21 |
| Simulate trousers 133 | D31 | L31 | a31 |
| Gloves 134 | D41 | L41 | a41 |
It is appreciated that since the limbs of user A change, the directional information of corresponding sensor, location information and add
Velocity information can also change, control equipment 3 can real-time reception these sensors every terms of information, calculated according to these information
The pose adjustment parameter of user A out.Pose adjustment parameter is inputted into initial attitude model, to realize initial attitude model according to appearance
State adjusting parameter is moved.
Optionally, pose adjustment parameter includes head pose adjusting parameter, upper limb pose adjustment parameter, lower limb pose adjustment
Parameter and hand gestures adjusting parameter.
Fig. 2 and table 2 are please referred to, control equipment 3 passes through D11、L11And a11It calculates and obtains head pose adjusting parameter, lead to
Cross D21、L21And a21It calculates and obtains upper limb pose adjustment parameter, pass through D31、L31And a31It calculates and obtains lower limb pose adjustment parameter,
Pass through D41、L41And a41It calculates and obtains hand gestures adjusting parameter, these pose adjustment parameters, which are carried out fusion, can obtain user
A is making pose adjustment parameter when waving to act.
It is appreciated that table 2 inscribes the every terms of information of each sensor when only showing a certain, a static variable, posture tune are indicated
Whole parameter be inscribe when will be each each sensor every terms of information be fitted after as a result, indicating a dynamic variable.
Step S33, the video image that camera in cabin and out of my cabin camera are taken in adjustment during just
Beginning attitude mode merges and carries out real-time display.
It is moved for example, the initial attitude model of user A can synchronize progress " waving " when user A carries out waving to act
Make, and then realizes the real-time adjustment of user A posture.Fig. 1 and Fig. 2 are please referred to, user A is in and adjusted by control equipment 3
Camera and the video image that camera takes out of my cabin in the cabin that initial attitude model and traffic equipment boiler-plate 1 in journey are arranged
It carries out fusion and real-time Transmission to the second traffic equipment boiler-plate 2 is shown that user B can pass through the second traffic equipment boiler-plate 2
In projection screen observe in real time user A " waving " movement.Similarly, user B can also wave, and control equipment 3
It images by camera in the user B initial attitude model being in during adjustment and the cabin that is arranged of traffic equipment boiler-plate 2 and out of my cabin
The video image that head takes carries out fusion and real-time Transmission to the first traffic equipment boiler-plate 1 is shown, and then realizes user A
Real-time interactive between user B.
Optionally, this method can be also used for driving instruction training or emergency test, for example, passing through the display methods
It may determine that in driving instruction training, student beats the gesture of steering wheel, and whether the direction that head rotation and eye are observed is correct.
In another example can judge whether student is correct to the reactive mode of emergency by this method.
Further, this method is carried out using the every terms of information that sensor acquires in real time " attitude-simulating ", by real image
It is merged with virtual image, can be realized the real-time interactive between user, signal transmission bring delay can be reduced.
Further, multiple reference sensors are additionally provided in traffic equipment boiler-plate, multiple reference sensors can be to appearance
State adjusting parameter plays reference and mark action, for example, controlling equipment 3 for the direction of pose adjustment parameter and each reference sensor
Information, location information and acceleration information are compared, and obtain comparison result, further according to comparison result that pose adjustment parameter is defeated
Enter initial attitude model so that initial attitude model is moved according to pose adjustment parameter, can more accurately carry out in this way
Pose adjustment.
Above-mentioned display method merges the virtual image that the real image that camera takes and attitude mode synthesize
And it shows.It is appreciated that can also by by multiple camera captured in real-time to image carry out anastomosing and splicing show.Such as
Shown in Fig. 4, another flow chart of display methods is provided by the embodiment of the present invention.
Step S41, control equipment obtain the video image of multiple camera shootings in real time.Wherein, multiple camera settings
In in cabin and out of my cabin.
Step S42, the video image that control equipment shoots each camera carry out anastomosing and splicing.
Video image after anastomosing and splicing is carried out real-time display by step S43, control equipment.
For example, the inside and outside of the first traffic equipment boiler-plate is provided with multiple cameras, these cameras are from polygonal
Spend captured in real-time user A video image, control equipment by these video images carry out anastomosing and splicing to realize naked eye 3D effect,
And the video image after anastomosing and splicing is sent to the second traffic equipment boiler-plate and is shown.
It should be appreciated that interaction between video, image or attitude mode in each traffic equipment boiler-plate bracket can also be with
It is not carried out by control equipment.For example, the first traffic equipment boiler-plate obtains the every terms of information of the sensor in cabin, calculating is analyzed
Pose adjustment parameter is adjusted initial attitude model according to pose adjustment parameter, then will be first during adjustment
Beginning attitude mode is sent directly to the second traffic equipment boiler-plate and is shown.It is appreciated that video image fusion, splicing and adjustment
Process carried out in traffic equipment boiler-plate.
Optionally, the interaction between traffic equipment boiler-plate can be one-to-one or one-to-many, for example, the first traffic equipment is simulated
The posture information of user A can be sent to other multiple traffic equipment boiler-plates by cabin.
To sum up, display methods and display system provided by the embodiment of the present invention, by taking the photograph by camera in cabin and out of my cabin
The video image taken as head carries out anastomosing and splicing and real-time display, can be realized the user's in multiple traffic equipment boiler-plates
Interaction, and then realize more true driving training, amusement or emergency rating simulation.
In several embodiments provided by the embodiment of the present invention, it should be understood that disclosed device and method, it can also
To realize by another way.Device and method embodiment described above is only schematical, for example, in attached drawing
Flow chart and block diagram show that the devices of multiple embodiments according to the present invention, method and computer program product are able to achieve
Architecture, function and operation.In this regard, each box in flowchart or block diagram can represent module, a program
A part of section or code, a part of the module, section or code include that one or more is patrolled for realizing defined
Collect the executable instruction of function.It should also be noted that in some implementations as replacement, function marked in the box
It can occur in a different order than that indicated in the drawings.For example, two continuous boxes can actually be held substantially in parallel
Row, they can also be executed in the opposite order sometimes, and this depends on the function involved.It is also noted that block diagram and/or
The combination of each box in flow chart and the box in block diagram and or flow chart, can the function as defined in executing or dynamic
The dedicated hardware based system made is realized, or can be realized using a combination of dedicated hardware and computer instructions.
In addition, each functional module in each embodiment of the present invention can integrate one independent portion of formation together
Point, it is also possible to modules individualism, an independent part can also be integrated to form with two or more modules.
It, can be with if the function is realized and when sold or used as an independent product in the form of software function module
It is stored in a computer readable storage medium.Based on this understanding, technical solution of the present invention is substantially in other words
The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter
Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a
People's computer, electronic equipment 10 or the network equipment etc.) execute all or part of step of each embodiment the method for the present invention
Suddenly.And storage medium above-mentioned includes：USB flash disk, read-only memory (ROM, Read-Only Memory), is deposited mobile hard disk at random
The various media that can store program code such as access to memory (RAM, Random Access Memory), magnetic or disk.
It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to the packet of nonexcludability
Contain, so that the process, method, article or equipment for including a series of elements not only includes those elements, but also including
Other elements that are not explicitly listed, or further include for elements inherent to such a process, method, article, or device.
In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including the element
Process, method, article or equipment in there is also other identical elements.
The foregoing is only a preferred embodiment of the present invention, is not intended to restrict the invention, for the skill of this field
For art personnel, the invention may be variously modified and varied.All within the spirits and principles of the present invention, made any to repair
Change, equivalent replacement, improvement etc., should all be included in the protection scope of the present invention.
Claims (10)
1. a kind of display methods, which is characterized in that be applied to control equipment, the control equipment and traffic equipment boiler-plate communication link
It connects, the traffic equipment boiler-plate is provided in cabin camera and out of my cabin camera, camera and described images out of my cabin in the cabin
Head with the control equipment communicate to connect, the method be used for by be in the traffic equipment boiler-plate in user posture into
Row real-time display, the method includes：
Obtain the video image of camera and the camera out of my cabin shooting in the cabin；
The video image that camera in the cabin and the camera out of my cabin are shot is subjected to anastomosing and splicing, after anastomosing and splicing
Video image carry out real-time display.
2. display methods according to claim 1, which is characterized in that the traffic equipment boiler-plate further include be provided with it is multiple
The clothes for drivers of sensor, each sensor and the control equipment communication connection, by camera in the cabin and it is described out of my cabin
The step of video image of camera shooting carries out anastomosing and splicing, the video image after anastomosing and splicing is carried out real-time display,
Including：
Obtain the initial attitude model for having dressed the user of the clothes for drivers；
The real-time directional information, real-time position information and real time acceleration information for receiving each sensor, according to described real-time
Directional information, the real-time position information and the real time acceleration information calculate the appearance for having dressed the user of the clothes for drivers
State adjusting parameter is adjusted the initial attitude model according to the pose adjustment parameter；
The video image that camera in the cabin and the camera out of my cabin are taken and the initial appearance during adjustment
States model merges and carries out real-time display.
3. display methods according to claim 2, which is characterized in that by camera in the cabin and the camera out of my cabin
The video image that takes and the initial attitude Model Fusion during adjustment and the step of carry out real-time display, including：
The video image that camera in the cabin and the camera out of my cabin are taken and the initial appearance during adjustment
Simultaneously real-time Transmission to another traffic equipment boiler-plate is shown for states model fusion.
4. display methods according to claim 2, which is characterized in that the clothes for drivers includes the helmet, simulation clothing, simulation trousers
And gloves；The helmet, the simulation clothing, the simulation trousers and the gloves are respectively arranged at least one sensor；It obtains
The step of having dressed the initial attitude model of the user of the clothes for drivers, including：
When user has dressed the helmet, the simulation clothing, the simulation trousers and the gloves and in the traffic equipment boiler-plate
When inside remaining static, obtains be set to the helmet, the simulation clothing, the simulation trousers and the gloves at least respectively
Directional information, location information and the acceleration information of one sensor；
According at least one for being set to the helmet, the simulation clothing, the simulation trousers and the gloves got respectively
Directional information, location information and the acceleration information of sensor, which simulate, has dressed the helmet, the simulation clothing, the simulation
Trousers and the gloves and the initial attitude model of the user to remain static in the traffic equipment boiler-plate.
5. display methods according to claim 4, which is characterized in that the real-time directional information of each sensor of reception,
Real-time position information and real time acceleration information, according to the real-time directional information, the real-time position information and it is described in real time
Acceleration information calculates the step of pose adjustment parameter for having dressed the user of the clothes for drivers, including：
It receives the real-time directional information for being set at least one sensor of the helmet and sending, real-time position information and adds in real time
Velocity information calculates head according to the real-time directional information, the real-time position information and the real time acceleration information
Pose adjustment parameter.
6. display methods according to claim 4, which is characterized in that the real-time directional information of each sensor of reception,
Real-time position information and real time acceleration information, according to the real-time directional information, the real-time position information and it is described in real time
Acceleration information calculates the step of pose adjustment parameter for having dressed the user of the clothes for drivers, including：
Receive be set to it is described simulation clothing at least one sensor send real-time directional information, real-time position information and in real time
Acceleration information is calculated according to the real-time directional information, the real-time position information and the real time acceleration information
Limb pose adjustment parameter.
7. display methods according to claim 4, which is characterized in that the real-time directional information of each sensor of reception,
Real-time position information and real time acceleration information, according to the real-time directional information, the real-time position information and it is described in real time
Acceleration information calculates the step of pose adjustment parameter for having dressed the user of the clothes for drivers, including：
Receive be set to it is described simulation trousers at least one sensor send real-time directional information, real-time position information and in real time
Acceleration information calculates down according to the real-time directional information, the real-time position information and the real time acceleration information
Limb pose adjustment parameter.
8. display methods according to claim 4, which is characterized in that the real-time directional information of each sensor of reception,
Real-time position information and real time acceleration information, according to the real-time directional information, the real-time position information and it is described in real time
Acceleration information calculates the step of pose adjustment parameter for having dressed the user of the clothes for drivers, including：
It receives the real-time directional information for being set at least one sensor of the gloves and sending, real-time position information and adds in real time
Velocity information calculates hand according to the real-time directional information, the real-time position information and the real time acceleration information
Pose adjustment parameter.
9. display methods according to claim 2, which is characterized in that be additionally provided with multiple ginsengs in the traffic equipment boiler-plate
Sensor is examined, each reference sensor and the control equipment communicate to connect, according to the pose adjustment parameter to described first
The step of beginning attitude mode is adjusted, including：
The pose adjustment parameter and directional information, location information and the acceleration information of each reference sensor are compared
It is right, obtain comparison result；
The pose adjustment parameter is inputted into the initial attitude model so that the initial attitude mould according to the comparison result
Type is moved according to the pose adjustment parameter.
10. a kind of display system, which is characterized in that including：Control equipment and traffic equipment boiler-plate；
The control equipment and traffic equipment boiler-plate communicate to connect, and the traffic equipment boiler-plate includes being provided with multiple sensors
Clothes for drivers, each sensor and the control equipment communicate to connect, the traffic equipment boiler-plate be provided in cabin camera with
Camera out of my cabin, camera and the camera out of my cabin are communicated to connect with the control equipment in the cabin, and the display is
System will be for that will carry out real-time display in the posture for the user that the traffic equipment boiler-plate is interior and has dressed the clothes for drivers；
The control equipment is used to obtain the video image of camera and the camera out of my cabin shooting in the cabin, is dressed
The initial attitude model of the user of the clothes for drivers；Receive real-time directional information, the real-time position information of each sensor
With real time acceleration information, according to the real-time directional information, the real-time position information and the real time acceleration information meter
The pose adjustment parameter for having dressed the user of the clothes for drivers is calculated, according to the pose adjustment parameter to the initial attitude mould
Type is adjusted；Video image that camera in the cabin and the camera out of my cabin are taken with during adjustment
Initial attitude Model Fusion simultaneously carries out real-time display.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810696070.3A CN108830942A (en) | 2018-06-29 | 2018-06-29 | Display methods and display system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810696070.3A CN108830942A (en) | 2018-06-29 | 2018-06-29 | Display methods and display system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108830942A true CN108830942A (en) | 2018-11-16 |
Family
ID=64134754
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810696070.3A Pending CN108830942A (en) | 2018-06-29 | 2018-06-29 | Display methods and display system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108830942A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102708722A (en) * | 2011-03-28 | 2012-10-03 | 上海日浦信息技术有限公司 | People-vehicle-road environment driving simulation experimental system |
| CN103050028A (en) * | 2012-12-28 | 2013-04-17 | 武汉理工大学 | Driving simulator with stereoscopic vision follow-up function |
| CN103359020A (en) * | 2013-07-04 | 2013-10-23 | 陈凌峰 | Motorcycle driving training or examination monitoring method and system |
| CN104413582A (en) * | 2013-08-28 | 2015-03-18 | 无锡慧思顿科技有限公司 | Multi-parameter multi-sensor intelligent clothing |
| CN104773178A (en) * | 2015-03-26 | 2015-07-15 | 合肥工业大学 | Driving gesture detecting system based on MEMS (Micro-electromechanical Systems) sensors |
-
2018
- 2018-06-29 CN CN201810696070.3A patent/CN108830942A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102708722A (en) * | 2011-03-28 | 2012-10-03 | 上海日浦信息技术有限公司 | People-vehicle-road environment driving simulation experimental system |
| CN103050028A (en) * | 2012-12-28 | 2013-04-17 | 武汉理工大学 | Driving simulator with stereoscopic vision follow-up function |
| CN103359020A (en) * | 2013-07-04 | 2013-10-23 | 陈凌峰 | Motorcycle driving training or examination monitoring method and system |
| CN104413582A (en) * | 2013-08-28 | 2015-03-18 | 无锡慧思顿科技有限公司 | Multi-parameter multi-sensor intelligent clothing |
| CN104773178A (en) * | 2015-03-26 | 2015-07-15 | 合肥工业大学 | Driving gesture detecting system based on MEMS (Micro-electromechanical Systems) sensors |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107066082B (en) | Display methods and device | |
| CN104699247B (en) | A kind of virtual reality interactive system and method based on machine vision | |
| US9170648B2 (en) | System and method for virtual engineering | |
| CN106708074A (en) | Method and device for controlling unmanned aerial vehicle based on VR glasses | |
| CN106600709A (en) | Decoration information model-based VR virtual decoration method | |
| CN106530894A (en) | Flight trainer virtual head-up display method through augmented reality technology and flight trainer virtual head-up display system thereof | |
| US9317956B2 (en) | Apparatus and method for providing mixed reality contents for learning through story-based virtual experience | |
| CN105704478A (en) | Stereoscopic display method, device and electronic equipment used for virtual and reality scene | |
| KR20130098770A (en) | Expanded 3d space based virtual sports simulation system | |
| CN107463245A (en) | Virtual reality emulation experimental system | |
| CN107894842A (en) | Augmented reality scene restored method, terminal and computer-readable recording medium | |
| CN109191983A (en) | Distribution network live line work emulation training method, apparatus and system based on VR | |
| KR102188313B1 (en) | Multi-model flight training simulator using VR | |
| CN109901713A (en) | Multi-person cooperative assembly system and method | |
| CN106910251A (en) | Model emulation method based on AR and mobile terminal | |
| CN113035010A (en) | Virtual and real scene combined visual system and flight simulation device | |
| CN109545003A (en) | A kind of display methods, device, terminal device and storage medium | |
| CN109407838A (en) | Interface interaction method and computer readable storage medium | |
| CN117278734B (en) | Rocket launching immersive viewing system | |
| KR19990054791A (en) | Radio controlled model aircraft simulation system | |
| CN113903210A (en) | Virtual reality simulation driving method, device, equipment and storage medium | |
| CN113941138A (en) | AR interaction control system, device and application | |
| CN108830942A (en) | Display methods and display system | |
| CN110741327B (en) | Mud toy system and method based on augmented reality and digital image processing | |
| KR20200058872A (en) | Immersive Flight Simulator Image System with HMD-based Chroma Key Technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181116 |
|
| RJ01 | Rejection of invention patent application after publication |