CN104794754B - A kind of Distributed Virtual Reality System - Google Patents
A kind of Distributed Virtual Reality System Download PDFInfo
- Publication number
- CN104794754B CN104794754B CN201510239252.4A CN201510239252A CN104794754B CN 104794754 B CN104794754 B CN 104794754B CN 201510239252 A CN201510239252 A CN 201510239252A CN 104794754 B CN104794754 B CN 104794754B
- Authority
- CN
- China
- Prior art keywords
- unit
- virtual
- virtual reality
- actual situation
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000001514 detection method Methods 0.000 claims abstract description 39
- 238000010276 construction Methods 0.000 claims abstract description 30
- 238000006243 chemical reaction Methods 0.000 claims abstract description 21
- 230000005540 biological transmission Effects 0.000 claims abstract description 16
- 238000013507 mapping Methods 0.000 claims description 15
- 230000004044 response Effects 0.000 claims description 13
- 238000012360 testing method Methods 0.000 claims description 13
- 239000011800 void material Substances 0.000 claims description 9
- 238000004891 communication Methods 0.000 claims description 5
- 230000002452 interceptive effect Effects 0.000 claims description 4
- 238000012856 packing Methods 0.000 claims description 4
- 238000012545 processing Methods 0.000 claims description 4
- 238000013461 design Methods 0.000 abstract description 2
- 238000005516 engineering process Methods 0.000 description 8
- 230000033001 locomotion Effects 0.000 description 8
- 239000007787 solid Substances 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 238000009826 distribution Methods 0.000 description 3
- 239000011159 matrix material Substances 0.000 description 3
- 238000011156 evaluation Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 238000000034 method Methods 0.000 description 2
- 238000012706 support-vector machine Methods 0.000 description 2
- 241000208340 Araliaceae Species 0.000 description 1
- 241001269238 Data Species 0.000 description 1
- 241000406668 Loxodonta cyclotis Species 0.000 description 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 1
- 235000003140 Panax quinquefolius Nutrition 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 150000001875 compounds Chemical class 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 235000008434 ginseng Nutrition 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000010422 painting Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000004886 process control Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000005303 weighing Methods 0.000 description 1
Abstract
The Distributed Virtual Reality System of the present invention includes multiple distributed mobile terminals and cloud server, virtual machine is installed, the virtual machine includes outdoor scene obtaining unit, standard point determination unit, information package transmission unit, realtime graphic frame decoding demodulating unit, real-time virtual image image-drawing unit on the mobile terminal；The cloud server includes actual situation conversion and establishes unit, assembled unit, virtual reality construction unit, virtual reality collision detection unit, virtual reality reliability judging unit, actual situation renewal adjustment unit and realtime graphic frame coded modulation unit, pass through the design of the present invention, solve the problems, such as the conflict in actual situation conversion and unreliability, improve user experience.
Description
Technical field
The present invention relates to virtual reality technology, more particularly to a kind of Distributed Virtual Reality System.
Background technology
Virtual reality technology originates from the 1980s, substantially, it is a kind of advanced calculating machine user interface skill
Art, by provided at the same time to user depending on, listen, say, the real-time perception interactive means various directly perceived and natural such as touch, maximum
Facilitate to limit the operation of user, so as to mitigate the burden of user, improve the work efficiency of whole system.Traditional void
Intending reality technology includes three features：Feeling of immersion, interactivity, independence, emphasize the Flow experience in Full-virtualization environment,
And emphasize that people can interact operation with the object in natural way and virtual reality.
But a width virtual scene may include the dough sheet of million millions in virtual reality construction unit, it is also possible to
Include substantial amounts of physical model, vector line drawing, or other virtual reality contents such as illumination, wave, sky etc., it is huge to complete these
The computing of big data and the draw computing far beyond mobile terminal and graphic capability, and how to store these mass datas
Also face the challenge.
DCS is the english abbreviation of dcs, it is meant that using microcontroller or miniature calculating machine technology to life
Production process is managed concentratedly and decentralised control, be it is a kind of by process control level and process monitoring level form using communication network as
The multistage operations machine system of tie, combines the 4C technologies such as calculating machine, communication, display and control, its basic thought is scattered control
System, centralized operation, differentiated control, configuration flexibly, configuration it is convenient.Development of the above-mentioned advantage of DCS technologies to virtual reality technology
Bring new solution.
But unreasonable allocation is still remained using the virtual reality system of distributed proccessing at present, efficiency is low, existing
It is real to conflict with virtually changing to exist, and reasonable prediction is unable to transformation result reliability, this causes the reality that virtual reality is changed
When property and user experience are deteriorated.
The content of the invention
The purpose of the present invention is what is be achieved through the following technical solutions.
According to the embodiment of the present invention, a kind of Distributed Virtual Reality System is proposed, the system comprises multiple distributions
Formula mobile terminal and cloud server, virtual machine, the mobile terminal and high in the clouds clothes are provided with the mobile terminal
Business device passes through LTE-A wireless network connections；Wherein,
The virtual machine includes the first LTE-A wireless transmit/receive units, response interface, instruction demodulating unit, outdoor scene and obtains list
Member, standard point determination unit, information package transmission unit, realtime graphic frame decoding demodulating unit, real-time virtual image are drawn single
Member；
The cloud server includes the 2nd LTE-A wireless transmit/receive units, data packet demodulating unit, actual situation conversion foundation list
Member, assembled unit, virtual reality construction unit, virtual reality collision detection unit, virtual reality reliability judging unit, actual situation
Update adjustment unit and realtime graphic frame coded modulation unit；
The first LTE-A wireless transmit/receive units input terminal connects the 2nd LTE-A wireless transmit/receive units, and output terminal connects respectively
Connect the 2nd LTE-A wireless transmit/receive units, response interface and realtime graphic frame decoding demodulating unit, the output of the response interface
End is sequentially connected instruction demodulating unit, outdoor scene obtaining unit, standard point determination unit, information package transmission unit, described information
Pack transmission unit output terminal connect the first LTE-A wireless transmit/receive units, the realtime graphic frame decoding demodulating unit it is defeated
Outlet connects real-time virtual image image-drawing unit；
The output terminal of the 2nd LTE-A wireless transmit/receive units is sequentially connected data packet demodulating unit, actual situation conversion is established
Unit, assembled unit, virtual reality construction unit, the output terminal of virtual reality construction unit connect virtual reality conflict inspection respectively
Survey unit, virtual reality reliability judging unit and actual situation renewal adjustment unit, the virtual reality collision detection unit and
Virtual reality reliability judging unit obtains output terminal and connects actual situation renewal adjustment unit respectively, the actual situation renewal adjustment unit
Output terminal connects realtime graphic frame coded modulation unit, the output terminal connection second of the realtime graphic frame coded modulation unit
LTE-A wireless transmit/receive units.
According to the embodiment of the present invention, the first LTE-A wireless transmit/receive units be used for realization with cloud server and
The transmitting-receiving operation of other mobile terminals；
The response interface, the operation requests for receiving cloud server instruct or the cooperation of other mobile terminals request
Message；
Described instruction demodulating unit, for the operation requests instruction or the cooperation of other mobile terminals of cloud server to be asked
Seek the execute instruction that message demodulation is virtual machine；
The outdoor scene obtaining unit is used for according to the image acquisition execute instruction that demodulates of instruction demodulating unit, and acquisition will be into
The live true picture of row actual situation conversion；
The standard point determination unit is used for images acquisition locations and view direction according to the outdoor scene, obtains predetermined model
Standard point and corresponding standard point information in enclosing, the standard point information include the positional information of corresponding standard point；
Described information packing transmission unit, live true picture and standard point for outdoor scene unit to be obtained determine list
The definite standard point of member and corresponding standard point information are packed, and are sent by the first LTE-A wireless transmit/receive units to cloud
Hold server.
According to the embodiment of the present invention, the realtime graphic frame decoding demodulating unit, for the cloud service to reception
The accurate virtual view data that device is sent is decoded and demodulated；
The real-time virtual image image-drawing unit, for the map data after being demodulated to decoding and shows interactive virtual field
Scape.
According to the embodiment of the present invention, the 2nd LTE-A wireless transmit/receive units are used for realization with distributed movement eventually
The wireless communication at end；
The data packet demodulating unit, for the packaged data bag of reception to be stored and demodulated, and will demodulate
True picture information and standard point information are sent to the actual situation conversion and establish unit；
The actual situation conversion establishes unit and is used to establish actual situation mapping graph, by acquired standard point according between standard point
Mutual alignment relationship map on the actual situation mapping graph, and corresponding standard point letter is added in the position for being mapped with standard point
Breath identification mark；
The assembled unit is used for the actual situation mapping graph added with standard point information identification mark and the real scene image
Combination, to form gain combination image.
According to the embodiment of the present invention, the virtual reality construction unit, for according to default constructing plan and institute
Gain combination image is stated, performs corresponding computing and virtual drawing, and virtual drawing is sent to actual situation renewal adjustment unit, void
Intend realistic collisions detection unit and virtual reality reliability judging unit；The virtual reality construction unit includes one by scheming
The virtual image-drawing unit of joint formed as processing unit group；After all virtual realities of task convert, the joint
Virtual image-drawing unit carries out 3D and virtually draws, and 3D is virtually drawn and is sent to actual situation renewal adjustment unit, virtual reality conflict
Detection unit and virtual reality reliability judging unit.
According to the embodiment of the present invention, the virtual reality collision detection unit is used for according to virtual reality construction unit
Virtual draw perform virtual reality collision detection, and testing result is exported to actual situation and updates adjustment unit；
The virtual reality reliability judging unit is used to be performed to obtaining according to virtual draw of virtual reality construction unit
The detection of the virtual image reliability taken, and testing result is exported to actual situation and updates adjustment unit.
According to the embodiment of the present invention, the actual situation renewal adjustment unit is used for according to the virtual reality construction unit
The virtual drawing of generation and the testing result of virtual reality collision detection unit and virtual reality reliability judging unit are to void
Intend drawing and be updated adjusting, to generate accurate virtual image；
The realtime graphic frame coded modulation unit, for carrying out coded modulation to the accurate virtual image of generation, and will
It is sent to the realtime graphic frame decoding demodulating unit of the mobile terminal.
The Distributed Virtual Reality System of the present invention includes multiple distributed mobile terminals and cloud server, the shifting
Virtual machine is installed, the virtual machine includes outdoor scene obtaining unit, standard point determination unit, information package transmission list in dynamic terminal
Member, realtime graphic frame decoding demodulating unit, real-time virtual image image-drawing unit；The cloud server includes actual situation conversion and establishes
Unit, assembled unit, virtual reality construction unit, virtual reality collision detection unit, virtual reality reliability judging unit, void
Real renewal adjustment unit and realtime graphic frame coded modulation unit, by the design of the present invention, solve in actual situation conversion
Conflict and unreliability problem, improve user experience.
Brief description of the drawings
By reading the detailed description of hereafter preferred embodiment, it is various other the advantages of and benefit it is common for this area
Technical staff will be clear understanding.Attached drawing is only used for showing the purpose of preferred embodiment, and is not considered as to the present invention
Limitation.And in whole attached drawing, identical component is denoted by the same reference numerals.In the accompanying drawings：
Attached drawing 1 shows the structure diagram of the Distributed Virtual Reality System of embodiment according to the present invention.
Embodiment
The illustrative embodiments of the disclosure are more fully described below with reference to accompanying drawings.Although this public affairs is shown in attached drawing
The illustrative embodiments opened, it being understood, however, that may be realized in various forms the disclosure without the reality that should be illustrated here
The mode of applying is limited.Conversely, there is provided these embodiments are to be able to be best understood from the disclosure, and can be by this public affairs
The scope opened completely is communicated to those skilled in the art.
According to the embodiment of the present invention, a kind of Distributed Virtual Reality System is proposed, as shown in Figure 1, the system
Including multiple distributed mobile terminals and cloud server, virtual machine, the mobile terminal are installed on the mobile terminal
Pass through LTE-A wireless network connections with the cloud server；Wherein,
The virtual machine includes the first LTE-A wireless transmit/receive units, response interface, instruction demodulating unit, outdoor scene and obtains list
Member, standard point determination unit, information package transmission unit, realtime graphic frame decoding demodulating unit, real-time virtual image are drawn single
Member；
The cloud server includes the 2nd LTE-A wireless transmit/receive units, data packet demodulating unit, actual situation conversion foundation list
Member, assembled unit, virtual reality construction unit, virtual reality collision detection unit, virtual reality reliability judging unit, actual situation
Update adjustment unit and realtime graphic frame coded modulation unit；
The first LTE-A wireless transmit/receive units input terminal connects the 2nd LTE-A wireless transmit/receive units, and output terminal connects respectively
Connect the 2nd LTE-A wireless transmit/receive units, response interface and realtime graphic frame decoding demodulating unit, the output of the response interface
End is sequentially connected instruction demodulating unit, outdoor scene obtaining unit, standard point determination unit, information package transmission unit, described information
Pack transmission unit output terminal connect the first LTE-A wireless transmit/receive units, the realtime graphic frame decoding demodulating unit it is defeated
Outlet connects real-time virtual image image-drawing unit；
The output terminal of the 2nd LTE-A wireless transmit/receive units is sequentially connected data packet demodulating unit, actual situation conversion is established
Unit, assembled unit, virtual reality construction unit, the output terminal of virtual reality construction unit connect virtual reality conflict inspection respectively
Survey unit, virtual reality reliability judging unit and actual situation renewal adjustment unit, the virtual reality collision detection unit and
Virtual reality reliability judging unit obtains output terminal and connects actual situation renewal adjustment unit respectively, the actual situation renewal adjustment unit
Output terminal connects realtime graphic frame coded modulation unit, the output terminal connection second of the realtime graphic frame coded modulation unit
LTE-A wireless transmit/receive units.
According to the embodiment of the present invention, the first LTE-A wireless transmit/receive units be used for realization with cloud server and
The transmitting-receiving operation of other mobile terminals；
The response interface, the operation requests for receiving cloud server instruct or the cooperation of other mobile terminals request
Message；
Described instruction demodulating unit, for the operation requests instruction or the cooperation of other mobile terminals of cloud server to be asked
Seek the execute instruction that message demodulation is virtual machine；
Outdoor scene obtaining unit is used for the image acquisition execute instruction demodulated according to instruction demodulating unit, and acquisition will carry out void
The live true picture that real-turn is changed；
Standard point determination unit is used for images acquisition locations and view direction according to the outdoor scene, obtains in preset range
Standard point and corresponding standard point information, the standard point information include the positional information of corresponding standard point；
Described information packing transmission unit, live true picture and standard point for outdoor scene unit to be obtained determine list
The definite standard point of member and corresponding standard point information are packed, and are sent by the first LTE-A wireless transmit/receive units to cloud
Hold server；
The realtime graphic frame decoding demodulating unit, the accurate virtual picture number for the cloud server transmission to reception
According to being decoded and demodulated；
The real-time virtual image image-drawing unit, for the map data after being demodulated to decoding and shows interactive virtual field
Scape.
According to the embodiment of the present invention, the 2nd LTE-A wireless transmit/receive units are used for realization with distributed movement eventually
The wireless communication at end；
The data packet demodulating unit, for the packaged data bag of reception to be stored and demodulated, and will demodulate
True picture information and standard point information are sent to the actual situation conversion and establish unit；
The actual situation conversion establishes unit and is used to establish actual situation mapping graph, by acquired standard point according between standard point
Mutual alignment relationship map on the actual situation mapping graph, and corresponding standard point letter is added in the position for being mapped with standard point
Breath identification mark；
The assembled unit is used for the actual situation mapping graph added with standard point information identification mark and the real scene image
Combination, to form gain combination image；
The virtual reality construction unit, for according to default constructing plan and the gain combination image, performing phase
The computing answered and it is virtual draw, and virtual will draw be sent to actual situation renewal adjustment unit, virtual reality collision detection unit, with
And virtual reality reliability judging unit；The virtual reality construction unit includes a connection being made of image processing unit group
Close virtual image-drawing unit；After all virtual realities of task convert, it is virtual that the virtual image-drawing unit of joint carries out 3D
Draw, and 3D is virtually drawn into transmission to actual situation renewal adjustment unit, virtual reality collision detection unit and virtual reality can
By property judging unit；
The virtual reality collision detection unit is used to be performed according to the virtual drawing of virtual reality construction unit virtual existing
Real collision detection, and testing result is exported to actual situation and updates adjustment unit；
The virtual reality reliability judging unit is used to be performed to obtaining according to virtual draw of virtual reality construction unit
The detection of the virtual image reliability taken, and testing result is exported to actual situation and updates adjustment unit；
The actual situation updates virtual drawing and the void that adjustment unit is used to generate according to the virtual reality construction unit
The testing result for intending realistic collisions detection unit and virtual reality reliability judging unit is updated adjusting to virtual drawing, with
Generate accurate virtual image；
The realtime graphic frame coded modulation unit, for carrying out coded modulation to the accurate virtual image of generation, and will
It is sent to the realtime graphic frame decoding demodulating unit of the mobile terminal.
According to the embodiment of the present invention, the actual situation conversion is established unit and is specifically included：
Compartmentalization unit, for establishing the actual situation mapping graph, and the actual situation mapping graph is divided into multiple uniform
Region；
Standard point map unit, for by acquired standard point according to the mutual alignment relation between standard point by adopting
Sample conversion is mapped in the corresponding region of the actual situation mapping graph respectively；
Identification mark adding device, for adding corresponding standard point information identification mark on the region for be mapped with standard point
Note.
According to the embodiment of the present invention, unit is established in the actual situation conversion can also further include：Region parameter is set
Put unit, for setting the parameter in the region, the parameter include showing when showing the virtual image region or
Hide the region.
According to the embodiment of the present invention, the assembled unit specifically includes：
Target image establishes unit, for choosing the image of a secondary outdoor scene as target image；
Unit is established at basic angle, for calculating the actual situation mapping graph visually parallel to flat in the target image
During face, the angle between the actual situation mapping graph and physical plane, sets the angle as basic angle；
Deflection matrix operation unit, for the direction angular moment between real scene image described in computing and the target image
Battle array；
Recombiner unit, for that according to the deflection matrix and the basic angle, standard point information will be added with and identified
The actual situation mapping graph of mark is compound in the real scene image.
According to the embodiment of the present invention, the virtual reality collision detection unit is according to the void of virtual reality construction unit
Intend drawing execution virtual reality collision detection to specifically include：
The calibration point extraction of A1, target frame, target two field picture is extracted from virtual Drawing image, carries out image in the picture
Segmentation, obtains the coordinate (X of calibration point in displaing coordinate system1、X2、X3、X4)；
Scenery movement estimation in A2, actual scene, the conversion by computing reality coordinate system to displaing coordinate system
Matrix, obtains the coordinate (Y under corresponding real coordinate system1、Y2、Y3、Y4)；After calibration point is obtained, calculate and obtain conflict plane
Normal vector；Then calculate the quality point C of entry/exit conflicts plane；And the actual scenery of particular moment is tried to achieve by the movement of quality point
Motion vector；
A3, the space geometric from for establishing virtual scene, are considered as sphere by virtual scene, using ball as space geometric from,
Space geometric from tree is established to virtual scene；
A4, based on cloud computing be detected actual situation conflict, specifically includes：
A41, the quantity according to actual situation collision detection node, are grouped virtual scene space geometric from tree；Will be each
The identifier of space geometric from is denoted as ID, its quality point G and radius r are denoted as Gr, obtain initial data<ID, Gr>；
A42, by each group initial data<ID, Gr>It is sent into actual situation collision detection node and carries out actual situation collision detection；
It is approximately a sphere by virtual scene, virtual scene conflicts with actual scenery regards conflicting for ball and plane as；
The distance of the quality point G of virtual scene ball to conflict plane is vectorial Y1Projection ds of the G on normal vector；At this time
The precondition of collision detection is：D≤τ r, wherein r are the radius of ball, and τ is that the distance of G to conflict plane accounts for the ratio of r；
Such as it is unsatisfactory for condition and does not produce actual situation conflict.When meeting this condition, then quality point G is calculated in conflict plane
Project G '；And judge whether that G ' inside the conflict area for having calibration point to be surrounded, is rushed if this condition is met
It is prominent；Quality point G is charged in Gr in the projection G ' of conflict plane, obtains new data<ID, Gr '>；
A43, general<ID, Gr '>Actual situation conflict response node is sent into, judges the information of conflict point whether is included in Gr ', is
It is no there occurs actual situation conflict, if actual situation conflict does not occur, the motion vector of next frame virtual scene and this frame virtual scene
Motion vector it is identical；Such as there occurs actual situation conflict, then send collision detection result to actual situation and update adjustment unit.
According to the embodiment of the present invention, the virtual reality reliability judging unit is according to virtual reality construction unit
The virtual detection performed to the virtual image reliability of acquisition of drawing specifically includes：
C1, virtually drawing as main with reference to collecting using virtual reality construction unit, real scene image collects as auxiliary reference, structure
Virtual reality scenario iterative data is grouped；And using the optical imagery difference of virtual objects and true picture, choose actual situation packet
Feature；The actual situation grouping feature of the selection includes partial statistics, plane of delineation gradient or second fundamental form etc., in image
It can extract to obtain the corresponding above-mentioned actual situation grouping feature of the point at each pixel；
C2, in iterative data packet, using actual situation grouping feature, extract the region of virtual reality scenario and outdoor scene respectively
Main body characteristic, builds stage resolution ratio actual situation burster；It is right in iterative data packet during the structure stage resolution ratio burster
Virtual reality scenario image, only chooses virtual objects region as main with reference to collection region；And to real scene image, only choose and main ginseng
Collect region as auxiliary reference according to the region that virtual objects are similar is concentrated；For given image-region, calculate every in region
The actual situation grouping feature of a bit；The given just auxiliary actual situation grouping feature with reference to collection region is pressed away from compression method using used
Contracting, obtains the corresponding region main body characteristic in the region；By the just auxiliary region main body characteristic set input support vector machines with reference to collection
Packet is trained, and obtains stage resolution ratio actual situation burster；
C3, in iterative data packet, using actual situation grouping feature, extract the region of virtual reality scenario and outdoor scene respectively
Contrast characteristic, builds region class actual situation burster；It is right in iterative data packet during the structure region class actual situation burster
In just auxiliary with reference to collection region, subject area to be determined itself will be considered as；And by the homalographic outside regional space solid
Rectangular area is considered as the background area residing for object；Extracting object region and the actual situation packet of every bit in background area are special respectively
Sign；Objects of statistics region actual situation grouping feature corresponding with all the points in background area, respectively constitutes the connection of subject area feature
Close distribution histogram and the joint distribution histogram of background area feature；Normal state squared-distance between two histograms of computing,
It is regarded as weighing poor another characteristic between object and its residing background, is known as regional correlation feature；By the just auxiliary reference of extraction
The regional correlation characteristic set input support vector machines packet of collection is trained, and obtains region class actual situation burster；
C4, given test virtual reality scenario, are examined using stage resolution ratio actual situation burster and small-bore detected envelope
Survey, obtain the Virtual matching figure for reflecting each pixel actual situation group result；The Virtual matching figure construction step includes：For defeated
The virtual reality scenario image entered, entire image is scanned using small-bore detected envelope with less stride；The each osculum of computing
The region main body characteristic of small image block in the detected envelope of footpath；The region main body characteristic of all small image blocks is input to resolution ratio
In level actual situation burster, the region main body characteristic evaluation of each small image block is obtained, evaluating high expression stage resolution ratio burster will
The degree of certainty that the image block is grouped into virtual region is high；Since the size of detected envelope with respect to entire image very little and is distributed close
Collection, therefore the region main body characteristic evaluation of each small image block can be mapped to the center pixel of the image block, and made
For the Virtual matching of the central pixel point；Thus constitute the Virtual matching figure of whole virtual reality scenario image；
C5, define virtual reliability graph, and on the basis of Virtual matching figure, splits to obtain test virtually using image
The virtual reliability graph of reality scene；The virtual reliability graph structure includes：Virtual for virtual reality scenario image is commented
Valency figure carries out image dividing processing, and it is positive point to record all Virtual matchings；One fixed percentage N% is set, records institute
Having Virtual matching, the location on original image, these points are known as high Virtual Calibration for the preceding N% of positive point and these points
Point；One fixation and relatively small constant M are set, record preceding M point and these points that all Virtual matchings are positive point
The location of on original image, these points are known as highest Virtual Calibration point；It can ensure that highest is virtually marked by parameter setting
Fixed point is also contained in the set where high Virtual Calibration point at the same time, i.e. highest Virtual Calibration point is virtually commented in high Virtual Calibration point
It is worth a highest part；Positional information on comprehensive high Virtual Calibration point, highest Virtual Calibration point and its place original image, structure
Into virtual reliability graph；
C6, based on virtual reliability graph, carry out virtual objects and obscure positioning, obtain obscuring for virtual object space solid
Shape and position；The blurred shapes for obtaining virtual object space solid and position are specially：It is virtual reliable to what is obtained
Property figure is classified as multiple subgraphs, tries to achieve the distribution center of the high Virtual Calibration point in each subgraph respectively；Subgraph center is regarded
For the virtual objects central point of candidate, distinguish outside expanded search from each central point, it is densely distributed to obtain high Virtual Calibration point
Region；For the densely distributed region of high Virtual Calibration point, Approximate Calculation goes out the candidate target shape in the region respectively, ties
The positional information in the region is closed, forms virtual objects preliminary candidate region；It is each according to its in virtual objects preliminary candidate region
The number of self-contained high Virtual Calibration point and highest Virtual Calibration point, selects one of weighted number at most, as
Virtual objects candidate region, the region contain virtual object space solid blurred shapes and positional information；
C7, obscure on the basis of positioning in virtual objects, empty using region class in virtual reality scenario image is tested
Real burster and heavy caliber detected envelope is detected, and obtains the final detection result of virtual objects；The virtual objects detection
Method is specially：The intensive sampling around the virtual objects candidate region in testing virtual reality scenario, constructs multiple phase mutual respects
Folded detected envelope, and using area level actual situation burster is grouped, and is chosen and is evaluated best detected envelope as virtual right
The final detection result of elephant.
According to the embodiment of the present invention, the actual situation renewal adjustment unit is generated according to the virtual reality construction unit
Virtual draw and the testing result of virtual reality collision detection unit and virtual reality reliability judging unit is to virtually painting
Figure is updated adjusting, is specifically included with generating accurate virtual image：When actual situation collision detection result is actual situation conflict or void
When the real reliability judging result of plan is unreliable, selection abandons the virtual image frame being currently generated, and estimates that next frame is virtual
The movement position of scenery, reacquires real scene image and generates new virtual image.
The foregoing is only a preferred embodiment of the present invention, but protection scope of the present invention be not limited thereto,
Any one skilled in the art the invention discloses technical scope in, the change or replacement that can readily occur in,
It should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should the protection model with claim
Subject to enclosing.
Claims (5)
1. a kind of Distributed Virtual Reality System, the system comprises multiple distributed mobile terminals and cloud server, institute
State and virtual machine is installed on mobile terminal, the mobile terminal and the cloud server pass through LTE-A wireless network connections；Its
In,
The virtual machine includes the first LTE-A wireless transmit/receive units, response interface, instruction demodulating unit, outdoor scene obtaining unit, mark
Determination unit, information package transmission unit, realtime graphic frame decoding demodulating unit, real-time virtual image image-drawing unit on schedule；
The cloud server include the 2nd LTE-A wireless transmit/receive units, data packet demodulating unit, actual situation conversion establish unit,
Assembled unit, virtual reality construction unit, virtual reality collision detection unit, virtual reality reliability judging unit, actual situation are more
New adjustment unit and realtime graphic frame coded modulation unit；
The first LTE-A wireless transmit/receive units input terminal connects the 2nd LTE-A wireless transmit/receive units, and output terminal connects the respectively
Two LTE-A wireless transmit/receive units, response interface and realtime graphic frame decoding demodulating unit, the output terminal of the response interface according to
Secondary link order demodulating unit, outdoor scene obtaining unit, standard point determination unit, information package transmission unit, described information packing
The output terminal of transmission unit connects the first LTE-A wireless transmit/receive units, the output terminal of the realtime graphic frame decoding demodulating unit
Connect real-time virtual image image-drawing unit；
The output terminal of the 2nd LTE-A wireless transmit/receive units is sequentially connected data packet demodulating unit, unit is established in actual situation conversion,
Assembled unit, virtual reality construction unit, the output terminal of virtual reality construction unit connect virtual reality collision detection list respectively
Member, virtual reality reliability judging unit and actual situation renewal adjustment unit, the virtual reality collision detection unit and virtual
The output terminal of real reliability judging unit connects actual situation renewal adjustment unit, the output of the actual situation renewal adjustment unit respectively
End connection realtime graphic frame coded modulation unit, the output terminal of the realtime graphic frame coded modulation unit connect the 2nd LTE-A
Wireless transmit/receive units；
The 2nd LTE-A wireless transmit/receive units are used for realization the wireless communication with distributed mobile terminal；
The data packet demodulating unit, for the packaged data bag of reception to be stored and demodulated, and it is true by what is demodulated
Image information and standard point information are sent to the actual situation conversion and establish unit；
The actual situation conversion establishes unit and is used to establish actual situation mapping graph, by acquired standard point according to the phase between standard point
Mutual position relationship is mapped on the actual situation mapping graph, and is added corresponding standard point information in the position for being mapped with standard point and known
Do not mark；
The assembled unit is used to combine the actual situation mapping graph added with standard point information identification mark with the true picture,
To form gain combination image；
The virtual reality construction unit, for according to default constructing plan and the gain combination image, performing corresponding
Computing and virtual drawing, and virtual drawing is sent to actual situation renewal adjustment unit, virtual reality collision detection unit, Yi Jixu
Intend real reliability judging unit；It is empty that the virtual reality construction unit includes a joint being made of image processing unit group
Intend image-drawing unit；After all virtual realities convert, the virtual image-drawing unit of joint carries out 3D and virtually draws, and will
3D, which virtually draws to send to actual situation renewal adjustment unit, virtual reality collision detection unit and virtual reality reliability, to be judged
Unit.
2. a kind of the system as claimed in claim 1, the first LTE-A wireless transmit/receive units are used for realization and cloud server
Receive and dispatch and operate with other mobile terminals；
The response interface, the operation requests for receiving cloud server instruct or the cooperation of other mobile terminals request disappears
Breath；
Described instruction demodulating unit, for the operation requests instruction of cloud server or the cooperation of other mobile terminals request to be disappeared
Breath is demodulated into the execute instruction of virtual machine；
The outdoor scene obtaining unit is used for the image acquisition execute instruction demodulated according to instruction demodulating unit, and acquisition will carry out void
The live true picture that real-turn is changed；
The standard point determination unit is used to obtain position and view direction according to the live true picture, obtains preset range
Interior standard point and corresponding standard point information, the standard point information include the positional information of corresponding standard point；
Described information packing transmission unit, the live true picture and standard point determination unit for outdoor scene unit to be obtained are true
Fixed standard point and corresponding standard point information are packed, and are sent to high in the clouds and taken by the first LTE-A wireless transmit/receive units
Business device.
3. a kind of system as claimed in claim 2, the realtime graphic frame decoding demodulating unit, for the high in the clouds clothes to reception
The accurate virtual view data that business device is sent is decoded and demodulated；
The real-time virtual image image-drawing unit, for the map data after being demodulated to decoding and shows interactive virtual scene.
4. a kind of system as claimed in claim 3, the virtual reality collision detection unit is used to be built according to virtual reality
Virtual draw of unit performs virtual reality collision detection, and testing result is exported to actual situation and updates adjustment unit；
The virtual reality reliability judging unit is used to be performed to acquisition according to virtual draw of virtual reality construction unit
The detection of virtual image reliability, and testing result is exported to actual situation and updates adjustment unit.
5. a kind of system as claimed in claim 4, the actual situation renewal adjustment unit is used to be built according to the virtual reality
The virtual drawing of unit generation and the testing result of virtual reality collision detection unit and virtual reality reliability judging unit
Adjusting is updated to virtual drawing, to generate accurate virtual image；
The realtime graphic frame coded modulation unit, for carrying out coded modulation to the accurate virtual image of generation, and is sent out
Give the realtime graphic frame decoding demodulating unit of the mobile terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510239252.4A CN104794754B (en) | 2015-05-12 | 2015-05-12 | A kind of Distributed Virtual Reality System |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510239252.4A CN104794754B (en) | 2015-05-12 | 2015-05-12 | A kind of Distributed Virtual Reality System |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104794754A CN104794754A (en) | 2015-07-22 |
| CN104794754B true CN104794754B (en) | 2018-04-20 |
Family
ID=53559533
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510239252.4A Active CN104794754B (en) | 2015-05-12 | 2015-05-12 | A kind of Distributed Virtual Reality System |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104794754B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106094540B (en) * | 2016-06-14 | 2020-01-07 | 珠海格力电器股份有限公司 | Electrical equipment control method, device and system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102148818A (en) * | 2010-12-29 | 2011-08-10 | 北京大学 | Method and system for realizing distributed virtual reality and visualization on mobile device |
| CN102254346A (en) * | 2011-06-30 | 2011-11-23 | 上海大学 | Method for detecting augmented reality virtual-real collision based on cloud computing |
| CN102375972A (en) * | 2010-08-23 | 2012-03-14 | 谢铮 | Distributive augmented reality platform based on mobile equipment |
| CN102509104A (en) * | 2011-09-30 | 2012-06-20 | 北京航空航天大学 | Confidence map-based method for distinguishing and detecting virtual object of augmented reality scene |
-
2015
- 2015-05-12 CN CN201510239252.4A patent/CN104794754B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102375972A (en) * | 2010-08-23 | 2012-03-14 | 谢铮 | Distributive augmented reality platform based on mobile equipment |
| CN102148818A (en) * | 2010-12-29 | 2011-08-10 | 北京大学 | Method and system for realizing distributed virtual reality and visualization on mobile device |
| CN102254346A (en) * | 2011-06-30 | 2011-11-23 | 上海大学 | Method for detecting augmented reality virtual-real collision based on cloud computing |
| CN102509104A (en) * | 2011-09-30 | 2012-06-20 | 北京航空航天大学 | Confidence map-based method for distinguishing and detecting virtual object of augmented reality scene |
Non-Patent Citations (2)
| Title |
|---|
| 增强现实技术在虚实图像配准中的研究;陈新等;《集美大学学报（自然科学版）》;20070131;第12卷(第1期);第43-46页 * |
| 虚拟现实技术在医学中的应用;姜红等;《中国医疗设备》;20081231;第23卷(第8期);第49-52、71页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104794754A (en) | 2015-07-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106804046B (en) | Mobile location method and device based on measurement report | |
| CN108550190A (en) | Augmented reality data processing method, device, computer equipment and storage medium | |
| CN104169965B (en) | For system, the method and computer program product adjusted during the operation of anamorphose parameter in more filming apparatus systems | |
| CN104102335B (en) | A kind of gestural control method, device and system | |
| CN107968689A (en) | Perception recognition methods and device based on wireless communication signals | |
| KR101086068B1 (en) | 3 dimensional marker detection method and device and method for providing augmented reality and mixed reality using the same | |
| CN106157354B (en) | A kind of three-dimensional scenic switching method and system | |
| CN103761539B (en) | Indoor locating method based on environment characteristic objects | |
| CN104780180B (en) | A kind of Virtual Reality Platform based on mobile terminal | |
| CN105338483B (en) | The methods, devices and systems of museum tour guide are realized based on enhancing realization technology | |
| CN108235113A (en) | A kind of panoramic video renders and presents attribute indicating means and system | |
| KR20190114652A (en) | Image Feature Matching Method and System Using The Labeled Keyframes In SLAM-Based Camera Tracking | |
| CN104680188A (en) | Method for constructing human body posture reference image library | |
| CN108132054A (en) | For generating the method and apparatus of information | |
| CN110298281A (en) | Video structural method, apparatus, electronic equipment and storage medium | |
| CN104794754B (en) | A kind of Distributed Virtual Reality System | |
| CN104869160B (en) | A kind of Distributed Virtual Reality System based on cloud platform | |
| CN109146773A (en) | By river map maps to the method and device of Web map | |
| CN105631849B (en) | The change detecting method and device of target polygon | |
| KR101696102B1 (en) | System for providing virtual reality and method thereof | |
| CN104982032A (en) | Method and apparatus for segmentation of 3D image data | |
| CN105208372A (en) | 3D landscape generation system and method with interaction measurable function and reality sense | |
| CN115546034A (en) | Image processing method and device | |
| Huang et al. | An efficient visualization method of RFID indoor positioning data | |
| CN108416846A (en) | It is a kind of without the three-dimensional registration algorithm of mark |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20181220 Address after: 430000 Yinjiu Science and Technology Industrial Park, No. 35 Guanggu Avenue, Donghu New Technology Development Zone, Wuhan City, Hubei Province (Phase II), 01 Building No. 1, No. 2, No. 3, 8 floors Patentee after: Wuhan Fenghe Information Technology Co.,Ltd. Address before: 510000 B1B2, one, two, three and four floors of the podium building 231 and 233, science Avenue, Guangzhou, Guangdong. Patentee before: BOAO ZONGHENG NETWORK TECHNOLOGY Co.,Ltd. Effective date of registration: 20181220 Address after: 510000 B1B2, one, two, three and four floors of the podium building 231 and 233, science Avenue, Guangzhou, Guangdong. Patentee after: BOAO ZONGHENG NETWORK TECHNOLOGY Co.,Ltd. Address before: 610041 Sichuan Chengdu high tech Zone Fucheng Avenue West Section 399 7 7 2 Units 6 level 608 Patentee before: CHENGDU LYUYE QIDIAN TECHNOLOGY Co.,Ltd. |
|
| TR01 | Transfer of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A distributed virtual reality system Effective date of registration: 20210812 Granted publication date: 20180420 Pledgee: Guanggu Branch of Wuhan Rural Commercial Bank Co.,Ltd. Pledgor: Wuhan Fenghe Information Technology Co.,Ltd. Registration number: Y2021420000075 |
|
| PC01 | Cancellation of the registration of the contract for pledge of patent right |
Date of cancellation: 20221103 Granted publication date: 20180420 Pledgee: Guanggu Branch of Wuhan Rural Commercial Bank Co.,Ltd. Pledgor: Wuhan Fenghe Information Technology Co.,Ltd. Registration number: Y2021420000075 |
|
| PC01 | Cancellation of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A distributed virtual reality system Effective date of registration: 20221109 Granted publication date: 20180420 Pledgee: Guanggu Branch of Wuhan Rural Commercial Bank Co.,Ltd. Pledgor: Wuhan Fenghe Information Technology Co.,Ltd. Registration number: Y2022420000363 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PC01 | Cancellation of the registration of the contract for pledge of patent right |
Date of cancellation: 20230824 Granted publication date: 20180420 Pledgee: Guanggu Branch of Wuhan Rural Commercial Bank Co.,Ltd. Pledgor: Wuhan Fenghe Information Technology Co.,Ltd. Registration number: Y2022420000363 |
|
| PC01 | Cancellation of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A Distributed Virtual Reality System Effective date of registration: 20230831 Granted publication date: 20180420 Pledgee: Guanggu Branch of Wuhan Rural Commercial Bank Co.,Ltd. Pledgor: Wuhan Fenghe Information Technology Co.,Ltd. Registration number: Y2023980054782 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right |