CN104794754A - Distribution type virtual reality system - Google Patents
Distribution type virtual reality system Download PDFInfo
- Publication number
- CN104794754A CN104794754A CN201510239252.4A CN201510239252A CN104794754A CN 104794754 A CN104794754 A CN 104794754A CN 201510239252 A CN201510239252 A CN 201510239252A CN 104794754 A CN104794754 A CN 104794754A
- Authority
- CN
- China
- Prior art keywords
- unit
- virtual
- virtual reality
- actual situation
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000001514 detection method Methods 0.000 claims abstract description 38
- 238000006243 chemical reaction Methods 0.000 claims abstract description 21
- 230000005540 biological transmission Effects 0.000 claims abstract description 14
- 238000010276 construction Methods 0.000 claims description 31
- 238000013507 mapping Methods 0.000 claims description 15
- 238000012360 testing method Methods 0.000 claims description 14
- 230000004044 response Effects 0.000 claims description 13
- 238000004891 communication Methods 0.000 claims description 5
- 230000002452 interceptive effect Effects 0.000 claims description 5
- 238000012856 packing Methods 0.000 claims description 3
- 238000012545 processing Methods 0.000 claims description 3
- 238000013461 design Methods 0.000 abstract description 2
- 238000004806 packaging method and process Methods 0.000 abstract 1
- 238000005516 engineering process Methods 0.000 description 8
- 239000000284 extract Substances 0.000 description 6
- 230000033001 locomotion Effects 0.000 description 6
- 239000011159 matrix material Substances 0.000 description 4
- 238000000034 method Methods 0.000 description 4
- 239000007787 solid Substances 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000011218 segmentation Effects 0.000 description 3
- 238000011156 evaluation Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 238000012706 support-vector machine Methods 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 150000001875 compounds Chemical class 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000004886 process control Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Abstract
The invention discloses a distribution type virtual reality system which comprises a plurality of distribution type mobile terminal and a cloud server, wherein a virtual machine is mounted on the mobile terminal; the virtual machine comprises a live-action acquiring unit, a standard point confirming unit, an information packaging transmission unit, a real-time image frame decoding demodulating unit and a real-time virtual image drawing unit; the cloud sever comprises a virtuality-reality conversion establishment unit, a combination unit, a virtuality-reality establishment unit, a virtuality-reality conflict detection unit, a virtuality-reality reliability judgment unit, a virtuality-reality updating adjustment unit and a real-time image frame encoding demodulation unit. Due to the design of the invention, the problem of confliction and unreliability in virtuality-reality conversion can be solved, and the user experiment can be improved.
Description
Technical field
The present invention relates to virtual reality technology, particularly relate to a kind of Distributed Virtual Reality System.
Background technology
Virtual reality technology originates from the eighties in 20th century, in essence, it is the calculating machine user interface techniques of a kind of advanced person, by give user provide simultaneously such as depending on, listen, say, the various real-time perception interactive means directly perceived and natural such as to touch, user friendly operation to greatest extent, thus alleviate the burden of user, improve the work efficiency of whole system.Traditional virtual reality technology comprises three features: feeling of immersion, interactivity, independence, emphasizes the Flow experience in Full-virtualization environment, and emphasizes that people can carry out interactive operation with the object in natural way and virtual reality.
But, in virtual reality construction unit, a width virtual scene may comprise the dough sheet of 1,000,000 millions, also may include a large amount of physical models, vector line drawing, or other virtual reality contents are as illumination, wave, sky etc., complete the computing of these huge data and draw far beyond computing and the graphic capability of mobile terminal, and how storing these mass datas and also face the challenge.
DCS is the english abbreviation of dcs, its implication utilizes single-chip microcomputer or miniature calculating machine technology to manage concentratedly and decentralised control production run, that a kind of what be made up of process control level and process monitoring level take communication network as the multistage operations machine system of tie, combine the 4C technology such as calculating machine, communication, display and control, its basic thought is decentralised control, centralized operation, differentiated control, flexible configuration, configuration convenience.The above-mentioned advantage of DCS technology brings new solution to the development of virtual reality technology.
But adopt the virtual reality system of distributed proccessing still to there is unreasonable allocation at present, efficiency is low, there is conflict in real and virtual conversion, and can not reasonable prediction, this real-time causing virtual reality to be changed and Consumer's Experience variation to transformation result reliability.
Summary of the invention
The object of the invention is to be achieved through the following technical solutions.
According to the embodiment of the present invention, a kind of Distributed Virtual Reality System is proposed, described system comprises multiple distributed mobile terminal and cloud server, and described mobile terminal is provided with virtual machine, and described mobile terminal is connected by LTE-A wireless network with described cloud server; Wherein,
Described virtual machine comprises a LTE-A wireless transmit/receive units, response interface, instruction demodulating unit, outdoor scene acquisition unit, standard point determining unit, information package transmission unit, realtime graphic frame decoding demodulating unit, real-time virtual image image-drawing unit;
Described cloud server comprises the 2nd LTE-A wireless transmit/receive units, unit is set up in packet demodulating unit, actual situation conversion, assembled unit, virtual reality construction unit, virtual reality collision detection unit, virtual reality reliability judging unit, actual situation upgrade regulon and realtime graphic frame coded modulation unit;
A described LTE-A wireless transmit/receive units input end connects the 2nd LTE-A wireless transmit/receive units, output terminal connects the 2nd LTE-A wireless transmit/receive units, response interface and realtime graphic frame decoding demodulating unit respectively, link order demodulating unit, outdoor scene obtain unit, standard point determining unit, information package transmission unit to the output terminal of described response interface successively, the output terminal of described information package transmission unit connects a LTE-A wireless transmit/receive units, and the output terminal of described realtime graphic frame decoding demodulating unit connects real-time virtual image image-drawing unit;
The output terminal connection packet demodulating unit successively of described 2nd LTE-A wireless transmit/receive units, unit is set up in actual situation conversion, assembled unit, virtual reality construction unit, the output terminal of virtual reality construction unit connects virtual reality collision detection unit respectively, virtual reality reliability judging unit and actual situation upgrade regulon, described virtual reality collision detection unit and virtual reality reliability judging unit obtain output terminal and are connected actual situation renewal regulon respectively, the output terminal that described actual situation upgrades regulon connects realtime graphic frame coded modulation unit, the output terminal of described realtime graphic frame coded modulation unit connects the 2nd LTE-A wireless transmit/receive units.
According to the embodiment of the present invention, a described LTE-A wireless transmit/receive units is used for realizing receiving and dispatching with cloud server and other mobile terminals operating;
Described response interface, for the cooperation request message of the operation requests instruction or other mobile terminals that receive cloud server;
Described instruction demodulating unit, for being demodulated into the execution instruction of virtual machine by the operation requests instruction of cloud server or the cooperation request message of other mobile terminals;
Described outdoor scene obtains the Image Acquisition execution instruction that unit is used for demodulating according to instruction demodulating unit, obtains the on-the-spot true picture that will carry out actual situation conversion;
Described standard point determining unit is used for according to the images acquisition locations of described outdoor scene and view direction, and obtain the standard point information of standard point in preset range and correspondence, described standard point information comprises the positional information of corresponding standard point;
Described information package transmission unit, the standard point determined for the on-the-spot true picture that obtained by outdoor scene unit and standard point determining unit and corresponding standard point information are packed, and are sent to cloud server by a LTE-A wireless transmit/receive units.
According to the embodiment of the present invention, described realtime graphic frame decoding demodulating unit, decodes and demodulation for the accurate virtual view data sent the cloud server received;
Described real-time virtual image image-drawing unit, for decoding demodulation after map data and show interactive virtual scene.
According to the embodiment of the present invention, described 2nd LTE-A wireless transmit/receive units is for realizing the radio communication with distributed mobile terminal;
Described packet demodulating unit, for storing and demodulation the packing data bag received, and sends to the conversion of described actual situation to set up unit by the true picture information demodulated and standard point information;
The conversion of described actual situation sets up unit for setting up actual situation mapping graph, by obtained standard point according to the mutual alignment relationship map between standard point on described actual situation mapping graph, and add corresponding standard point information identification marking in the position being mapped with standard point;
Described assembled unit is used for the actual situation mapping graph and described real scene image that are added with standard point information identification marking to combine, to form gain combination image.
According to the embodiment of the present invention, described virtual reality construction unit, the constructing plan preset for basis and described gain combination image, perform corresponding computing and virtual drawing, and virtual drawing sent to actual situation to upgrade regulon, virtual reality collision detection unit and virtual reality reliability judging unit; Described virtual reality construction unit comprises the virtual image-drawing unit of an associating be made up of graphics processing unit group; After all virtual realities of task convert, the virtual image-drawing unit of described associating carries out the virtual drawing of 3D, and virtual for 3D drawing is sent to actual situation renewal regulon, virtual reality collision detection unit and virtual reality reliability judging unit.
According to the embodiment of the present invention, described virtual reality collision detection unit is used for performing virtual reality collision detection according to the virtual drawing of virtual reality construction unit, and testing result is exported to actual situation renewal regulon;
Described virtual reality reliability judging unit is used for the virtual detection performed the virtual image reliability obtained of drawing according to virtual reality construction unit, and testing result is exported to actual situation renewal regulon.
According to the embodiment of the present invention, described actual situation upgrades regulon and is used for carrying out renewal adjustment, to generate accurate virtual image according to the described virtual drawing of virtual reality construction unit generation and the testing result of virtual reality collision detection unit and virtual reality reliability judging unit to virtual drawing;
Described realtime graphic frame coded modulation unit, for carrying out coded modulation to the accurate virtual image generated, and sends it to the realtime graphic frame decoding demodulating unit of described mobile terminal.
Distributed Virtual Reality System of the present invention comprises multiple distributed mobile terminal and cloud server, described mobile terminal is provided with virtual machine, and described virtual machine comprises outdoor scene and obtains unit, standard point determining unit, information package transmission unit, realtime graphic frame decoding demodulating unit, real-time virtual image image-drawing unit; Described cloud server comprises actual situation conversion and sets up unit, assembled unit, virtual reality construction unit, virtual reality collision detection unit, virtual reality reliability judging unit, actual situation renewal regulon and realtime graphic frame coded modulation unit, by design of the present invention, solve the conflict in actual situation conversion and unreliability problem, improve Consumer's Experience.
Accompanying drawing explanation
By reading hereafter detailed description of the preferred embodiment, various other advantage and benefit will become cheer and bright for those of ordinary skill in the art.Accompanying drawing only for illustrating the object of preferred implementation, and does not think limitation of the present invention.And in whole accompanying drawing, represent identical parts by identical reference symbol.In the accompanying drawings:
Figure 1 show the structural representation of the Distributed Virtual Reality System according to embodiment of the present invention.
Embodiment
Below with reference to accompanying drawings illustrative embodiments of the present disclosure is described in more detail.Although show illustrative embodiments of the present disclosure in accompanying drawing, however should be appreciated that can realize the disclosure in a variety of manners and not should limit by the embodiment of setting forth here.On the contrary, provide these embodiments to be in order to more thoroughly the disclosure can be understood, and complete for the scope of the present disclosure can be conveyed to those skilled in the art.
According to the embodiment of the present invention, a kind of Distributed Virtual Reality System is proposed, as shown in Figure 1, described system comprises multiple distributed mobile terminal and cloud server, described mobile terminal is provided with virtual machine, and described mobile terminal is connected by LTE-A wireless network with described cloud server; Wherein,
Described virtual machine comprises a LTE-A wireless transmit/receive units, response interface, instruction demodulating unit, outdoor scene acquisition unit, standard point determining unit, information package transmission unit, realtime graphic frame decoding demodulating unit, real-time virtual image image-drawing unit;
Described cloud server comprises the 2nd LTE-A wireless transmit/receive units, unit is set up in packet demodulating unit, actual situation conversion, assembled unit, virtual reality construction unit, virtual reality collision detection unit, virtual reality reliability judging unit, actual situation upgrade regulon and realtime graphic frame coded modulation unit;
A described LTE-A wireless transmit/receive units input end connects the 2nd LTE-A wireless transmit/receive units, output terminal connects the 2nd LTE-A wireless transmit/receive units, response interface and realtime graphic frame decoding demodulating unit respectively, link order demodulating unit, outdoor scene obtain unit, standard point determining unit, information package transmission unit to the output terminal of described response interface successively, the output terminal of described information package transmission unit connects a LTE-A wireless transmit/receive units, and the output terminal of described realtime graphic frame decoding demodulating unit connects real-time virtual image image-drawing unit;
The output terminal connection packet demodulating unit successively of described 2nd LTE-A wireless transmit/receive units, unit is set up in actual situation conversion, assembled unit, virtual reality construction unit, the output terminal of virtual reality construction unit connects virtual reality collision detection unit respectively, virtual reality reliability judging unit and actual situation upgrade regulon, described virtual reality collision detection unit and virtual reality reliability judging unit obtain output terminal and are connected actual situation renewal regulon respectively, the output terminal that described actual situation upgrades regulon connects realtime graphic frame coded modulation unit, the output terminal of described realtime graphic frame coded modulation unit connects the 2nd LTE-A wireless transmit/receive units.
According to the embodiment of the present invention, a described LTE-A wireless transmit/receive units is used for realizing receiving and dispatching with cloud server and other mobile terminals operating;
Described response interface, for the cooperation request message of the operation requests instruction or other mobile terminals that receive cloud server;
Described instruction demodulating unit, for being demodulated into the execution instruction of virtual machine by the operation requests instruction of cloud server or the cooperation request message of other mobile terminals;
Outdoor scene obtains the Image Acquisition execution instruction that unit is used for demodulating according to instruction demodulating unit, obtains the on-the-spot true picture that will carry out actual situation conversion;
Standard point determining unit is used for according to the images acquisition locations of described outdoor scene and view direction, and obtain the standard point information of standard point in preset range and correspondence, described standard point information comprises the positional information of corresponding standard point;
Described information package transmission unit, the standard point determined for the on-the-spot true picture that obtained by outdoor scene unit and standard point determining unit and corresponding standard point information are packed, and are sent to cloud server by a LTE-A wireless transmit/receive units;
Described realtime graphic frame decoding demodulating unit, decodes and demodulation for the accurate virtual view data sent the cloud server received;
Described real-time virtual image image-drawing unit, for decoding demodulation after map data and show interactive virtual scene.
According to the embodiment of the present invention, described 2nd LTE-A wireless transmit/receive units is for realizing the radio communication with distributed mobile terminal;
Described packet demodulating unit, for storing and demodulation the packing data bag received, and sends to the conversion of described actual situation to set up unit by the true picture information demodulated and standard point information;
The conversion of described actual situation sets up unit for setting up actual situation mapping graph, by obtained standard point according to the mutual alignment relationship map between standard point on described actual situation mapping graph, and add corresponding standard point information identification marking in the position being mapped with standard point;
Described assembled unit is used for the actual situation mapping graph and described real scene image that are added with standard point information identification marking to combine, to form gain combination image;
Described virtual reality construction unit, the constructing plan preset for basis and described gain combination image, perform corresponding computing and virtual drawing, and virtual drawing sent to actual situation to upgrade regulon, virtual reality collision detection unit and virtual reality reliability judging unit; Described virtual reality construction unit comprises the virtual image-drawing unit of an associating be made up of graphics processing unit group; After all virtual realities of task convert, the virtual image-drawing unit of described associating carries out the virtual drawing of 3D, and virtual for 3D drawing is sent to actual situation renewal regulon, virtual reality collision detection unit and virtual reality reliability judging unit;
Described virtual reality collision detection unit is used for performing virtual reality collision detection according to the virtual drawing of virtual reality construction unit, and testing result is exported to actual situation renewal regulon;
Described virtual reality reliability judging unit is used for the virtual detection performed the virtual image reliability obtained of drawing according to virtual reality construction unit, and testing result is exported to actual situation renewal regulon;
Described actual situation upgrades regulon and is used for carrying out renewal adjustment, to generate accurate virtual image according to the described virtual drawing of virtual reality construction unit generation and the testing result of virtual reality collision detection unit and virtual reality reliability judging unit to virtual drawing;
Described realtime graphic frame coded modulation unit, for carrying out coded modulation to the accurate virtual image generated, and sends it to the realtime graphic frame decoding demodulating unit of described mobile terminal.
According to the embodiment of the present invention, the conversion of described actual situation is set up unit and is specifically comprised:
Compartmentalization unit, for setting up described actual situation mapping graph, and is divided into multiple uniform region by described actual situation mapping graph;
Standard point map unit, for being respectively mapped in the corresponding region of described actual situation mapping graph according to the mutual alignment relation between standard point by sampling transformation by obtained standard point;
Identification marking adding device, for adding corresponding standard point information identification marking on the region being mapped with standard point.
According to the embodiment of the present invention, described actual situation conversion is set up unit and can also be comprised further: region parameter setting unit, and for arranging the parameter in described region, described parameter comprises when showing described virtual image and shows described region or hiding described region.
According to the embodiment of the present invention, described assembled unit specifically comprises:
Target image sets up unit, for choosing the image of a secondary outdoor scene as target image;
Basis angle set up unit, for calculate described actual situation mapping graph be visually parallel to the plane in described target image time, the angle between described actual situation mapping graph and physical plane, sets angle based on this angle;
Deflection matrix operation unit, for real scene image described in computing and the deflection matrix between described target image;
Recombiner unit, for according to described deflection matrix and described basic angle, is compound in the actual situation mapping graph being added with standard point information identification marking in described real scene image.
According to the embodiment of the present invention, described virtual reality collision detection unit specifically comprises according to the virtual drawing execution virtual reality collision detection of virtual reality construction unit:
The calibration point of A1, target frame extracts, and extracts target two field picture, carry out Iamge Segmentation in the picture from virtual Drawing image, obtains the coordinate (X of calibration point in displaing coordinate system
1, X
2, X
3, X
4);
Scenery movement estimation in A2, actual scene, is tied to the transition matrix of displaing coordinate system, obtains the coordinate (Y under corresponding real coordinate system by computing reality coordinate
1, Y
2, Y
3, Y
4); After acquisition calibration point, calculate the normal vector obtaining conflict plane; Calculate the quality point C of conflict plane subsequently; And the motion vector of the actual scenery of particular moment is tried to achieve by the motion of quality point;
A3, set up the space geometric from of virtual scene, virtual scene is considered as spheroid, uses ball as space geometric from, space geometric from tree is set up to virtual scene;
A4, based on cloud computing, actual situation conflict to be detected, specifically comprises:
A41, quantity according to actual situation collision detection node, divide into groups to virtual scene space geometric from tree; The identifier of each space geometric from is designated as ID, its quality point G and radius r is designated as Gr, obtains raw data <ID, Gr>;
A42, each group of raw data <ID, Gr> are sent into actual situation collision detection node carry out actual situation collision detection;
Virtual scene is approximately a spheroid, virtual scene conflicts with actual scenery and regards conflicting of ball and plane as;
Namely the quality point G of virtual scene ball is vectorial Y to the distance of conflict plane
1the projection d of G on normal vector; The precondition of now collision detection is: d≤τ r, and wherein r is the radius of ball, the ratio of τ to be G to the distance of conflict plane account for r;
Namely actual situation conflict is not produced if do not satisfied condition.When meeting this condition, then calculate the projection G ' of quality point G in conflict plane; And judge whether that G ' is inner in the conflict area having calibration point to surround, if meet this condition, there occurs conflict; Quality point G is charged in Gr at the projection G ' of conflict plane, obtains new data <ID, Gr ' >;
A43, by <ID, Gr ' > sends into actual situation conflict response node, judge the information whether comprising conflict point in Gr ', namely whether there occurs actual situation conflict, if there is not actual situation conflict, then the motion vector of the motion vector of next frame virtual scene frame virtual scene is therewith identical; As there occurs actual situation conflict, then send collision detection result and upgrade regulon to actual situation.
According to the embodiment of the present invention, described virtual reality reliability judging unit specifically comprises according to the virtual detection performed the virtual image reliability obtained of drawing of virtual reality construction unit:
C1, using the virtual drawing of virtual reality construction unit as main with reference to collection, real scene image with reference to collection, builds the grouping of virtual reality scenario iterative data as auxiliary; And utilize the optical imagery difference of virtual objects and true picture, choose actual situation grouping feature; The described actual situation grouping feature chosen comprises partial statistics, plane of delineation gradient or second fundamental form etc., can extract the above-mentioned actual situation grouping feature obtaining this some correspondence at each pixel place of image;
C2, in iterative data grouping, utilize actual situation grouping feature, extract the region main body characteristic of virtual reality scenario and outdoor scene respectively, structure stage resolution ratio actual situation burster; During described structure stage resolution ratio burster, in iterative data grouping, to virtual reality scenario image, only choose virtual objects region as main with reference to collection region; And to real scene image, only choose and concentrate the akin region of virtual objects as auxiliary with reference to collecting region with main reference; For given image-region, calculate the actual situation grouping feature of every bit in region; Utilize used distance compression method to compress the given just auxiliary actual situation grouping feature with reference to collection region, obtain the region main body characteristic that this region is corresponding; The just auxiliary region main body characteristic set input support vector machine grouping with reference to collection is trained, obtains stage resolution ratio actual situation burster;
C3, in iterative data grouping, utilize actual situation grouping feature, extract the regional correlation feature of virtual reality scenario and outdoor scene respectively, structure region class actual situation burster; During described structure region class actual situation burster, in iterative data grouping, for just auxiliary with reference to collection region, itself is considered as subject area to be determined; And the homalographic rectangular area outside regional space solid is considered as the background area residing for object; Extract the actual situation grouping feature of every bit in subject area and background area respectively; The actual situation grouping feature that in objects of statistics region and background area, all-pair is answered, forms the joint distribution histogram of subject area feature and the joint distribution histogram of background area feature respectively; Normal state squared-distance between computing two histograms, is regarded as and weighs object and the feature of difference between background residing for it, be called regional correlation feature; The just auxiliary input of the regional correlation characteristic set with reference to the collection support vector machine grouping of extracting is trained, obtains region class actual situation burster;
C4, given test virtual reality scenario, utilize stage resolution ratio actual situation burster and small-bore detected envelope to detect, and obtains the Virtual matching figure reflecting each pixel actual situation group result; Described Virtual matching figure construction step comprises: for the virtual reality scenario image of input, utilizes small-bore detected envelope with less stride scanning entire image; The region main body characteristic of the little image block in each small-bore detected envelope of computing; The region main body characteristic of all little image blocks is input in stage resolution ratio actual situation burster, obtains the region main body characteristic evaluation of each little image block, evaluate the high degree of certainty representing that this image block is grouped into virtual region by stage resolution ratio burster high; Because the size of detected envelope is very little and densely distributed relative to entire image, therefore the region main body characteristic evaluation of each little image block can be mapped to the center pixel of this image block, and it can be used as the Virtual matching of this central pixel point; Thus constitute the Virtual matching figure of whole virtual reality scenario image;
C5, defining virtual reliability graph, and on the basis of Virtual matching figure, utilize Iamge Segmentation to obtain testing the virtual reliability graph of virtual reality scenario; Described virtual reliability graph builds and comprises: the Virtual matching figure for virtual reality scenario image carries out Iamge Segmentation process, and recording all Virtual matching is positive point; Arrange a fixing number percent N%, record the position that front N% and these that all Virtual matching are positive point are residing on original image, these points are called high Virtual Calibration point; Arrange one to fix and relatively little constant M, record front M point and these positions residing on original image that all Virtual matching are positive point, these points are called the highest Virtual Calibration point; Can be ensured by optimum configurations, the highest Virtual Calibration point is also contained in the set at high Virtual Calibration point place simultaneously, and namely the highest Virtual Calibration point is the part that in high Virtual Calibration point, Virtual matching value is the highest; Positional information on comprehensive high Virtual Calibration point, the highest Virtual Calibration point and place original image thereof, forms virtual reliability graph;
C6, based on virtual reliability graph, carry out the fuzzy location of virtual objects, obtain blurred shapes and the position of virtual object space solid; Described obtain virtual object space solid blurred shapes and position be specially: multiple subgraph is divided into the virtual reliability graph obtained, is tried to achieve the distribution center of the high Virtual Calibration point in each subgraph respectively; Subgraph center is considered as the virtual objects central point of candidate, searches for respectively to external expansion from each central point, obtain the region that high Virtual Calibration point is densely distributed; For the region that high Virtual Calibration point is densely distributed, Approximate Calculation goes out the candidate target shape in this region respectively, in conjunction with the positional information in this region, forms virtual objects preliminary candidate region; In virtual objects preliminary candidate region, according to the number of its each self-contained high Virtual Calibration point with the highest Virtual Calibration point, select one that weighted number is maximum, it can be used as virtual objects candidate region, namely this region contains virtual object space solid blurred shapes and positional information;
C7, on the basis of the fuzzy location of virtual objects, in test virtual reality scenario image, utilize region class actual situation burster and heavy caliber detected envelope to detect, obtain the final detection result of virtual objects; Described virtual objects detection method is specially: intensive sampling around the virtual objects candidate region in test virtual reality scenario, construct multiple overlapped detected envelope, and use region class actual situation burster to divide into groups, choose and evaluate the final detection result of best detected envelope as virtual objects.
According to the embodiment of the present invention, described actual situation upgrades the virtual drawing and virtual reality collision detection unit that regulon generates according to described virtual reality construction unit, carry out renewal with the testing result of virtual reality reliability judging unit to virtual drawing to regulate, specifically comprise to generate accurate virtual image: when actual situation collision detection result is actual situation conflict or virtual reality reliability judged result is unreliable, select the virtual graph picture frame abandoning current generation, and estimate the movement position of next frame virtual scene, again obtain real scene image and generate new virtual image.
The above; be only the present invention's preferably embodiment, but protection scope of the present invention is not limited thereto, is anyly familiar with those skilled in the art in the technical scope that the present invention discloses; the change that can expect easily or replacement, all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should described be as the criterion with the protection domain of claim.
Claims (7)
1. a Distributed Virtual Reality System, described system comprises multiple distributed mobile terminal and cloud server, and described mobile terminal is provided with virtual machine, and described mobile terminal is connected by LTE-A wireless network with described cloud server; Wherein,
Described virtual machine comprises a LTE-A wireless transmit/receive units, response interface, instruction demodulating unit, outdoor scene acquisition unit, standard point determining unit, information package transmission unit, realtime graphic frame decoding demodulating unit, real-time virtual image image-drawing unit;
Described cloud server comprises the 2nd LTE-A wireless transmit/receive units, unit is set up in packet demodulating unit, actual situation conversion, assembled unit, virtual reality construction unit, virtual reality collision detection unit, virtual reality reliability judging unit, actual situation upgrade regulon and realtime graphic frame coded modulation unit;
A described LTE-A wireless transmit/receive units input end connects the 2nd LTE-A wireless transmit/receive units, output terminal connects the 2nd LTE-A wireless transmit/receive units, response interface and realtime graphic frame decoding demodulating unit respectively, link order demodulating unit, outdoor scene obtain unit, standard point determining unit, information package transmission unit to the output terminal of described response interface successively, the output terminal of described information package transmission unit connects a LTE-A wireless transmit/receive units, and the output terminal of described realtime graphic frame decoding demodulating unit connects real-time virtual image image-drawing unit;
The output terminal connection packet demodulating unit successively of described 2nd LTE-A wireless transmit/receive units, unit is set up in actual situation conversion, assembled unit, virtual reality construction unit, the output terminal of virtual reality construction unit connects virtual reality collision detection unit respectively, virtual reality reliability judging unit and actual situation upgrade regulon, described virtual reality collision detection unit and virtual reality reliability judging unit obtain output terminal and are connected actual situation renewal regulon respectively, the output terminal that described actual situation upgrades regulon connects realtime graphic frame coded modulation unit, the output terminal of described realtime graphic frame coded modulation unit connects the 2nd LTE-A wireless transmit/receive units.
2. a system as claimed in claim 1, a described LTE-A wireless transmit/receive units is used for realizing receiving and dispatching with cloud server and other mobile terminals operating;
Described response interface, for the cooperation request message of the operation requests instruction or other mobile terminals that receive cloud server;
Described instruction demodulating unit, for being demodulated into the execution instruction of virtual machine by the operation requests instruction of cloud server or the cooperation request message of other mobile terminals;
Described outdoor scene obtains the Image Acquisition execution instruction that unit is used for demodulating according to instruction demodulating unit, obtains the on-the-spot true picture that will carry out actual situation conversion;
Described standard point determining unit is used for according to the images acquisition locations of described outdoor scene and view direction, and obtain the standard point information of standard point in preset range and correspondence, described standard point information comprises the positional information of corresponding standard point;
Described information package transmission unit, the standard point determined for the on-the-spot true picture that obtained by outdoor scene unit and standard point determining unit and corresponding standard point information are packed, and are sent to cloud server by a LTE-A wireless transmit/receive units.
3. a system as claimed in claim 2, described realtime graphic frame decoding demodulating unit, decodes and demodulation for the accurate virtual view data sent the cloud server received;
Described real-time virtual image image-drawing unit, for decoding demodulation after map data and show interactive virtual scene.
4. a system as claimed in claim 3, described 2nd LTE-A wireless transmit/receive units is for realizing the radio communication with distributed mobile terminal;
Described packet demodulating unit, for storing and demodulation the packing data bag received, and sends to the conversion of described actual situation to set up unit by the true picture information demodulated and standard point information;
The conversion of described actual situation sets up unit for setting up actual situation mapping graph, by obtained standard point according to the mutual alignment relationship map between standard point on described actual situation mapping graph, and add corresponding standard point information identification marking in the position being mapped with standard point;
Described assembled unit is used for the actual situation mapping graph and described real scene image that are added with standard point information identification marking to combine, to form gain combination image.
5. a system as claimed in claim 4, described virtual reality construction unit, the constructing plan preset for basis and described gain combination image, perform corresponding computing and virtual drawing, and virtual drawing sent to actual situation to upgrade regulon, virtual reality collision detection unit and virtual reality reliability judging unit; Described virtual reality construction unit comprises the virtual image-drawing unit of an associating be made up of graphics processing unit group; After all virtual realities of task convert, the virtual image-drawing unit of described associating carries out the virtual drawing of 3D, and virtual for 3D drawing is sent to actual situation renewal regulon, virtual reality collision detection unit and virtual reality reliability judging unit.
6. a system as claimed in claim 5, described virtual reality collision detection unit is used for performing virtual reality collision detection according to the virtual drawing of virtual reality construction unit, and testing result is exported to actual situation renewal regulon;
Described virtual reality reliability judging unit is used for the virtual detection performed the virtual image reliability obtained of drawing according to virtual reality construction unit, and testing result is exported to actual situation renewal regulon.
7. a system as claimed in claim 6, described actual situation upgrades regulon and is used for carrying out renewal adjustment, to generate accurate virtual image according to the described virtual drawing of virtual reality construction unit generation and the testing result of virtual reality collision detection unit and virtual reality reliability judging unit to virtual drawing;
Described realtime graphic frame coded modulation unit, for carrying out coded modulation to the accurate virtual image generated, and sends it to the realtime graphic frame decoding demodulating unit of described mobile terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510239252.4A CN104794754B (en) | 2015-05-12 | 2015-05-12 | A kind of Distributed Virtual Reality System |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510239252.4A CN104794754B (en) | 2015-05-12 | 2015-05-12 | A kind of Distributed Virtual Reality System |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104794754A true CN104794754A (en) | 2015-07-22 |
| CN104794754B CN104794754B (en) | 2018-04-20 |
Family
ID=53559533
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510239252.4A Active CN104794754B (en) | 2015-05-12 | 2015-05-12 | A kind of Distributed Virtual Reality System |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104794754B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106094540A (en) * | 2016-06-14 | 2016-11-09 | 珠海格力电器股份有限公司 | Electrical equipment control method, Apparatus and system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102148818A (en) * | 2010-12-29 | 2011-08-10 | 北京大学 | Method and system for realizing distributed virtual reality and visualization on mobile device |
| CN102254346A (en) * | 2011-06-30 | 2011-11-23 | 上海大学 | Method for detecting augmented reality virtual-real collision based on cloud computing |
| CN102375972A (en) * | 2010-08-23 | 2012-03-14 | 谢铮 | Distributive augmented reality platform based on mobile equipment |
| CN102509104A (en) * | 2011-09-30 | 2012-06-20 | 北京航空航天大学 | Confidence map-based method for distinguishing and detecting virtual object of augmented reality scene |
-
2015
- 2015-05-12 CN CN201510239252.4A patent/CN104794754B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102375972A (en) * | 2010-08-23 | 2012-03-14 | 谢铮 | Distributive augmented reality platform based on mobile equipment |
| CN102148818A (en) * | 2010-12-29 | 2011-08-10 | 北京大学 | Method and system for realizing distributed virtual reality and visualization on mobile device |
| CN102254346A (en) * | 2011-06-30 | 2011-11-23 | 上海大学 | Method for detecting augmented reality virtual-real collision based on cloud computing |
| CN102509104A (en) * | 2011-09-30 | 2012-06-20 | 北京航空航天大学 | Confidence map-based method for distinguishing and detecting virtual object of augmented reality scene |
Non-Patent Citations (2)
| Title |
|---|
| 姜红等: "虚拟现实技术在医学中的应用", 《中国医疗设备》 * |
| 陈新等: "增强现实技术在虚实图像配准中的研究", 《集美大学学报（自然科学版）》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106094540A (en) * | 2016-06-14 | 2016-11-09 | 珠海格力电器股份有限公司 | Electrical equipment control method, Apparatus and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104794754B (en) | 2018-04-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11024092B2 (en) | System and method for augmented reality content delivery in pre-captured environments | |
| CN110753218A (en) | Digital twinning system and method and computer equipment | |
| CN101273635B (en) | Apparatus and method for encoding and decoding multi-view picture using camera parameter, and recording medium storing program for executing the method | |
| KR102454161B1 (en) | Method and apparatus for processing omnidirectional image | |
| CN102546793B (en) | Self-adaption method and system of mobile terminal based on cloud computing | |
| CN109997364A (en) | Method, equipment and the stream of the instruction of the mapping of omni-directional image are provided | |
| CN104780180A (en) | Virtual reality platform based on mobile terminals | |
| CN112085031A (en) | Target detection method and system | |
| CN109041012A (en) | Base station selecting method and system based on integrated communication and computing capability | |
| CN114071116A (en) | Video processing method and device, electronic equipment and storage medium | |
| CN111508033A (en) | Camera parameter determination method, image processing method, storage medium, and electronic apparatus | |
| CN104869160A (en) | Distributed virtual reality system based on cloud platform | |
| KR101696102B1 (en) | System for providing virtual reality and method thereof | |
| CN104794754A (en) | Distribution type virtual reality system | |
| CN106791829A (en) | The method for building up and equipment of virtual reference frame | |
| CN115989527A (en) | Method and apparatus for performing anchor point-based rendering of augmented reality media objects | |
| CN107872441B (en) | Method and device for generating equipment attribute configuration file | |
| CN116935008A (en) | Display interaction method and device based on mixed reality | |
| CN111629228A (en) | Data transmission method and server | |
| CN105208372A (en) | 3D landscape generation system and method with interaction measurable function and reality sense | |
| CN112400316A (en) | Method and apparatus for encoding and decoding three-degree-of-freedom and volumetrically compatible video streams | |
| CN115546034A (en) | Image processing method and device | |
| CN105959121A (en) | Mobile terminal with identity authentication function | |
| CN112486315A (en) | Multi-person cooperation method based on computer vision | |
| WO2024001847A1 (en) | 2d marker, and indoor positioning method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20181220 Address after: 430000 Yinjiu Science and Technology Industrial Park, No. 35 Guanggu Avenue, Donghu New Technology Development Zone, Wuhan City, Hubei Province (Phase II), 01 Building No. 1, No. 2, No. 3, 8 floors Patentee after: Wuhan Fenghe Information Technology Co.,Ltd. Address before: 510000 B1B2, one, two, three and four floors of the podium building 231 and 233, science Avenue, Guangzhou, Guangdong. Patentee before: BOAO ZONGHENG NETWORK TECHNOLOGY Co.,Ltd. Effective date of registration: 20181220 Address after: 510000 B1B2, one, two, three and four floors of the podium building 231 and 233, science Avenue, Guangzhou, Guangdong. Patentee after: BOAO ZONGHENG NETWORK TECHNOLOGY Co.,Ltd. Address before: 610041 Sichuan Chengdu high tech Zone Fucheng Avenue West Section 399 7 7 2 Units 6 level 608 Patentee before: CHENGDU LYUYE QIDIAN TECHNOLOGY Co.,Ltd. |
|
| TR01 | Transfer of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A distributed virtual reality system Effective date of registration: 20210812 Granted publication date: 20180420 Pledgee: Guanggu Branch of Wuhan Rural Commercial Bank Co.,Ltd. Pledgor: Wuhan Fenghe Information Technology Co.,Ltd. Registration number: Y2021420000075 |
|
| PC01 | Cancellation of the registration of the contract for pledge of patent right |
Date of cancellation: 20221103 Granted publication date: 20180420 Pledgee: Guanggu Branch of Wuhan Rural Commercial Bank Co.,Ltd. Pledgor: Wuhan Fenghe Information Technology Co.,Ltd. Registration number: Y2021420000075 |
|
| PC01 | Cancellation of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A distributed virtual reality system Effective date of registration: 20221109 Granted publication date: 20180420 Pledgee: Guanggu Branch of Wuhan Rural Commercial Bank Co.,Ltd. Pledgor: Wuhan Fenghe Information Technology Co.,Ltd. Registration number: Y2022420000363 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PC01 | Cancellation of the registration of the contract for pledge of patent right |
Date of cancellation: 20230824 Granted publication date: 20180420 Pledgee: Guanggu Branch of Wuhan Rural Commercial Bank Co.,Ltd. Pledgor: Wuhan Fenghe Information Technology Co.,Ltd. Registration number: Y2022420000363 |
|
| PC01 | Cancellation of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A Distributed Virtual Reality System Effective date of registration: 20230831 Granted publication date: 20180420 Pledgee: Guanggu Branch of Wuhan Rural Commercial Bank Co.,Ltd. Pledgor: Wuhan Fenghe Information Technology Co.,Ltd. Registration number: Y2023980054782 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right |