CN109427100A - A kind of assembling fittings method and system based on virtual reality - Google Patents

A kind of assembling fittings method and system based on virtual reality Download PDF

Info

Publication number
CN109427100A
CN109427100A CN201710759056.9A CN201710759056A CN109427100A CN 109427100 A CN109427100 A CN 109427100A CN 201710759056 A CN201710759056 A CN 201710759056A CN 109427100 A CN109427100 A CN 109427100A
Authority
CN
China
Prior art keywords
virtual
accessory
user
image
virtual reality
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710759056.9A
Other languages
Chinese (zh)
Inventor
李炜
孙其民
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inlife Handnet Co Ltd
Original Assignee
Inlife Handnet Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inlife Handnet Co Ltd filed Critical Inlife Handnet Co Ltd
Priority to CN201710759056.9A priority Critical patent/CN109427100A/en
Publication of CN109427100A publication Critical patent/CN109427100A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00Simulators for teaching or training purposes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/012Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Business, Economics & Management (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The embodiment of the invention discloses a kind of assembling fittings method and system based on virtual reality.The described method includes: establishing user scapegoat in virtual scene, and the viewpoint according to the position and direction message identification user of user scapegoat in virtual scene, target accessory is chosen from accessory library, and target accessory is modeled to generate virtual accessory model, virtual accessory model is projected to the display device of virtual reality according to viewpoint, to show the virtual image of assembling scene, the operation that user is directed to virtual accessory model is obtained, and according to the virtual image for assembling scene in the display device of user's operation real-time update virtual reality.This programme is by modeling accessory, to generate threedimensional model, and interacts by the operation of user with user, and opposite and two-dimensional image has more three-dimensional sense, facilitates understandings, can accurate simulation assembling fittings process.

Description

A kind of assembling fittings method and system based on virtual reality
Technical field
The present invention relates to data processing fields, and in particular to a kind of assembling fittings method and system based on virtual reality.
Background technique
Collaborative virtual environment (Collaborative virtual environment, CVE) generates and is applied to education neck Behind domain, novel wisdom academic environment is expedited the emergence of out.This wisdom academic environment is by single user virtual environment (Virtual Environment, VE) it is extended to multi-user virtual space, it supports to cooperate with and interact between multi-user, allows student on the spot in person Virtual environment in study in coordination, complete learning tasks jointly, gradually grasp operative skill.With traditional CBT (computer supported Educational training, Computer Based Training) system compares, collaborative virtual environment support under skill training system, energy Break space-time limitation, support to study in coordination, securely and reliably, training cost can be substantially reduced, can be regarded as current skills training The supporting condition being badly in need of is changed with vocational education teaching method.
Summary of the invention
The embodiment of the present invention provides a kind of assembling fittings method and system based on virtual reality, can accurately simulation match The process of part assembling.
In a first aspect, the embodiment of the present invention provides a kind of assembling fittings method based on virtual reality, comprising:
User scapegoat is established in virtual scene, and is existed according to the position and direction message identification user of the user scapegoat Viewpoint in the virtual scene;
Target accessory is chosen from accessory library, and the target accessory is modeled to generate virtual accessory model;
The virtual accessory model is projected to the display device of virtual reality according to the viewpoint, to show assembling scene Virtual image;
The operation that user is directed to the virtual accessory model is obtained, and virtual according to the user's operation real-time update The virtual image of scene is assembled in the display device of reality.
Second aspect, the assembling fittings system based on virtual reality that the embodiment of the invention also provides a kind of, comprising: establish Module, generation module, projection module and update module;
It is described to establish module, for establishing user scapegoat in virtual scene, and according to the position of the user scapegoat and Viewpoint of the directional information identity user in the virtual scene;
The generation module for choosing target accessory from accessory library, and models with life the target accessory At virtual accessory model;
The projection module, for being filled the display that the virtual accessory model is projected to virtual reality according to the viewpoint It sets, to show the virtual image of assembling scene;
The update module, the operation for being directed to the virtual accessory model for obtaining user, and grasped according to the user Make the virtual image that scene is assembled in the display device of virtual reality described in real-time update.
Assembling fittings method provided in an embodiment of the present invention based on virtual reality establishes user in virtual scene first Scapegoat, and the viewpoint according to the position and direction message identification user of user scapegoat in virtual scene, choose from accessory library Target accessory, and target accessory is modeled to generate virtual accessory model, virtual accessory model is projected to according to viewpoint The display device of virtual reality obtains the operation that user is directed to virtual accessory model to show the virtual image of assembling scene, and According to the virtual image for assembling scene in the display device of user's operation real-time update virtual reality.This programme by accessory into Row modeling, to generate threedimensional model, and interacts with user by the operation of user, opposite and two-dimensional image, more Have three-dimensional sense, facilitate understanding, can accurate simulation assembling fittings process.
Detailed description of the invention
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for For those skilled in the art, without creative efforts, it can also be obtained according to these attached drawings other attached Figure.
Fig. 1 is a kind of flow diagram of the assembling fittings method based on virtual reality provided in an embodiment of the present invention.
Fig. 2 is the flow diagram of another assembling fittings method based on virtual reality provided in an embodiment of the present invention.
Fig. 3 is the schematic diagram of a scenario of the assembling fittings method provided in an embodiment of the present invention based on virtual reality.
Fig. 4 is a kind of structural schematic diagram of the assembling fittings system based on virtual reality provided in an embodiment of the present invention.
Fig. 5 is the structural schematic diagram of another assembling fittings system based on virtual reality provided in an embodiment of the present invention.
Fig. 6 is server architecture schematic diagram provided in an embodiment of the present invention.
Specific embodiment
Schema is please referred to, wherein identical component symbol represents identical component, the principle of the present invention is to implement one It is illustrated in computing environment appropriate.The following description be based on illustrated by the specific embodiment of the invention, should not be by It is considered as the limitation present invention other specific embodiments not detailed herein.
In the following description, specific embodiments of the present invention will refer to the step as performed by one or multi-section computer And symbol illustrates, unless otherwise stating clearly.Therefore, these steps and operation will have to mention for several times is executed by computer, this paper institute The computer execution of finger includes by representing with the computer processing unit of the electronic signal of the data in a structuring pattern Operation.This operation is converted at the data or the position being maintained in the memory system of the computer, reconfigurable Or in addition change the running of the computer in mode known to the tester of this field.The maintained data structure of the data For the provider location of the memory, there is the specific feature as defined in the data format.But the principle of the invention is with above-mentioned text Word illustrates that be not represented as a kind of limitation, this field tester will appreciate that plurality of step and behaviour as described below Also it may be implemented in hardware.
The principle of the present invention is grasped using many other wide usages or specific purpose operation, communication environment or configuration Make.The known example suitable for arithmetic system of the invention, environment and configuration may include (but being not limited to) hold phone, Personal computer, server, multicomputer system, system, body frame configuration computer and distributed arithmetic ring based on micro computer Border, which includes any above system or devices.
It will be described in detail respectively below.
The present embodiment will be described from the angle of the assembling fittings system based on virtual reality, which can specifically collect At in the terminal.
Referring to Fig. 1, Fig. 1 is a kind of process of the assembling fittings method based on virtual reality provided in an embodiment of the present invention The assembling fittings method based on virtual reality of schematic diagram, the present embodiment includes:
Step S101 establishes user scapegoat in virtual scene, and according to the position and direction message identification of user scapegoat Viewpoint of the user in virtual scene.
In embodiments of the present invention, need first to establish virtual scene, the basic procedure of modeling can be with are as follows: data acquisition and place Manage (real training place data, equipment size data etc.), professional three-dimensional software modeling (such as: being modeled with Pro/E, 3DMax), visualization Software for editing amendment (such as: with Cosmo Wrolds amendment error, addition material and interaction), text edit software are perfect (such as: using Vrmlpad optimize structure, reduce code, compressed file) etc. the stages.
In collaborative virtual environment, user scapegoat (avatar) is indispensable element.It is co-located on same virtual The user in space is identified by user scapegoat, the state position of scapegoat and the direction signs viewpoint of the user in the scene (Viewpoint), under computer supported cooperative work (CSCW) mechanism, realize that you see that i.e. I sees (WYSIWIS).For this purpose, Skill training under collaborative virtual environment is supported should meet following demand:
It 1, can simulation skill training scene true to nature.It can be with the external environment of simulation skill training true to nature (such as: training field Structure, size, environment, layout etc.).
2, the presence and behavior of other users can be perceived.The working condition of other users can be perceived (such as: which being completed Task proceeds to any degree etc.).
3, it can interact and link up with other users.It can use input equipment to hand over environment or other users Mutually, convenient and fast communication means (such as: electronic whiteboard, word message transmitting) can be provided.
Step S102 chooses target accessory from accessory library, and is modeled to target accessory to generate virtual accessory mould Type.
To improve modeling efficiency, the rapid modeling strategy based on model complexity can be used, basic thought is to model Before, effect of the first analysis model in virtual scene, to determine using which kind of modeling pattern.If model is in irregular shape, knot Structure is complicated, and the model (such as: Practical training equipment, assembling spare and accessory parts) having the call in virtual scene then utilizes profession three Software modeling is tieed up, using general modeling developing process;If model is regular shape, structure is simple, it is in virtual scene The model (such as: real training chamber inner space, wall fitting) of secondary role then uses VRML Direct Modeling, passes through Material or the domain Texture reference textures are called to realize in the domain material of Appearance node.
To improve network transmission efficiency, the wrl file that modeling generates is optimized and compression is very important.It is common Method have: compressed with the text edit tool (such as: Vrmlpad), with DEF/USE, PORTO and EXTERNPROTO sentence Quote the instance model of same type, optimization data (data be rounded or fixed precision), with special compressed software (such as: wingz, Gzip) compression etc..Compressed wrl file is smaller, is more suitable in transmission over networks.
Virtual accessory model is projected to the display device of virtual reality according to viewpoint by step S103, to show assembling field The virtual image of scape.
In the embodiment of the present invention, after generating virtual accessory model, image rendering can be carried out to virtual accessory model, Image is finally set to meet the stage of 3D scene by image rendering.There are many softwares for rendering, such as: the included rendering of each CG software is drawn It holds up, there are also RenderMan etc..The virtual image of three-dimensional accessory model is obtained, then throws the three-dimensional virtual image Be incident upon the display device of virtual reality, user can by wear virtual reality head-mounted display apparatus to three-dimensional virtual image into Row is checked, to obtain 3D effect.
In other embodiments, after generating three-dimensional virtual image, it can also will be loaded with the virtual accessory model Image projection is to sphere model, so as to realize that being directed to the virtual accessory model carries out 360 ° of browsings.
Step S104 obtains the operation that user is directed to virtual accessory model, and virtually existing according to user's operation real-time update The virtual image of scene is assembled in real display device.
In the embodiment of the present invention, obtain user for virtual accessory model operation method can there are many, than Such as incude hand information, step mobile message, and/or the cephalad direction information of user in real time by wearable receiving device Deng.
Wherein, which may include: intelligent data gloves, intelligent data shoes and intelligent data head Helmet etc., the intelligent data gloves for obtaining user's hand action message and user's wrist force information in real time;The intelligence number According to shoes for obtaining the leg shift action information of user in real time;The intelligent data helmet for obtaining user's head movement in real time Information.
User, which is generated, according to the wrist dynamics information, step mobile message, and/or cephalad direction information is directed to virtual accessory The operation of model.
Wherein, the informix of the acquisitions such as intelligent data gloves, intelligent data shoes and the intelligent data helmet, life will be passed through At user's operation, the user's operation is for lifting the virtual image of scene in the display device of real-time update virtual reality.For example, When user needs to install computer fittings (such as: CPU, memory bar, keyboard connector), it is only necessary to click corresponding accessory, user replaces Body is grabbed automatically.At this point, the pose of computer fittings and the pose of hand are bound, computer fittings with virtual hand pose It converts and moves, the timestamp of pose acquisition can be set to 250 milliseconds, can preferably guarantee the mobile continuity of pose.User is only Have after discharging this virtual accessory, could apply for the operating right of other virtual accessories.When accessory is moved near installation site When, there is accurate assembly position indicating in system, and behind the corresponding position of user click, accessory is installed successfully, and shows corresponding peace Dress up function virtual image.
From the foregoing, it will be observed that the assembling fittings method provided in an embodiment of the present invention based on virtual reality is first in virtual scene User scapegoat, and the viewpoint according to the position and direction message identification user of user scapegoat in virtual scene are established, from accessory Target accessory is chosen in library, and target accessory is modeled to generate virtual accessory model, according to viewpoint by virtual accessory mould Type is projected to the display device of virtual reality, to show the virtual image of assembling scene, obtains user and is directed to virtual accessory model Operation, and according in the display device of user's operation real-time update virtual reality assemble scene virtual image.This programme is logical It crosses and accessory is modeled, to generate threedimensional model, and interacted by the operation of user with user, opposite and two-dimensional surface Image has more three-dimensional sense, facilitates understandings, can accurate simulation assembling fittings process.
According to the description of a upper embodiment, below by the assembling fittings method further to of the invention based on virtual reality It is illustrated.
Referring to Fig. 2, Fig. 2 is another stream of the assembling fittings method provided in an embodiment of the present invention based on virtual reality Journey schematic diagram, comprising:
Step S201 establishes user scapegoat in virtual scene, and according to the position and direction message identification of user scapegoat Viewpoint of the user in virtual scene.
In embodiments of the present invention, user scapegoat (avatar) is indispensable element.It is co-located on same virtual The user in space is identified by user scapegoat, the state position of scapegoat and the direction signs viewpoint of the user in the scene (Viewpoint), under computer supported cooperative work (CSCW) mechanism, realize that you see that i.e. I sees (WYSIWIS).
Step S202 chooses target accessory from accessory library, and obtains the three-dimensional tectonic information of target accessory.
Referring to Fig. 3, for example, only being needed when user needs to install computer fittings (such as: CPU, memory bar, keyboard connector) Corresponding accessory is clicked, user scapegoat is grabbed automatically.
Step S203 models target accessory according to three-dimensional tectonic information to generate virtual accessory model.
It is above-mentioned according to three-dimensional tectonic information in an embodiment, target accessory is modeled to generate virtual accessory The step of model may include:
Determine the type of target accessory;
Target Modeling strategy is determined according to the type of target accessory and three-dimensional tectonic information;
It is modeled according to Target Modeling strategy to generate virtual accessory model.
Step S204 carries out image rendering to virtual accessory model, to obtain three-dimensional accessory image.
Wherein, above-mentioned rendering can specifically include light processing and texture processing, and light processing includes to virtual accessory mould Type carries out lighting effect simulation, and texture processing includes carrying out grain effect simulation to virtual accessory model.Specifically, can pass through Light processing module constructs illumination model.In basic illumination model, the surface color of an object is radiation (emissive), the illumination such as Ambient (ambient), diffusing reflection (diffuse) and mirror-reflection (specular) act on Summation.Every kind of illumination effect depends on the property (such as brightness and material color) of Facing material and property (such as the light of light source Color and position) collective effect.The module supports various light sources model, including directional light, spotlight, floodlight etc., and It can be by adjusting parameter real time inspection lighting effect.It is then based on GPU Shader technology and carries out lighting simulation.At texture Manage the data texturing of module management and schedule virtual scene.The core of the submodule is a texture management device (TextureManager), common data texturing format is supported, including tga, png, jpg, bmp, dds etc..It is loaded onto interior The data texturing deposited carries out parsing and information extraction is avoided using the public texture of texture counter technical management rendering engine The repetition of identical texture is loaded into, and saves memory, video memory space.Meanwhile the module is supported to render a variety of GPU texture special efficacys, in conjunction with The display cachings technologies such as FBO (Frame Buffer Object), PBO (Pixel Buffer Object), to model texture into The more life-like Specially Effect Simulation of row, including Z-Correct bump mapping Z-correct, bright special efficacy, AVI video etc..
Step S205 carries out image procossing twice to three-dimensional accessory image according to viewpoint, and will treated image It is projected in two display screens of the display device of virtual reality respectively.
Image shown by two display screens of the above-mentioned display device for being processed so that virtual reality is matched for three-dimensional Part image different angle view so that the virtual screen that user watches after the display device for wearing upper virtual reality has more There is the sense of reality.
Step S206 receives the limb action information of user, generates user's operation according to limb action information.
In the embodiment of the present invention, receive the limb action information of user method can there are many, such as by can Wearable receiving device incudes hand motion information, step mobile message, and/or cephalad direction information of user etc. in real time.
Step S207 carries out real-time operation according to virtual image of the user's operation to assembling scene, to generate real-time virtual Image.
Step S208 shows virtual image to the display device of virtual reality.
For example, accurate assembly position indicating occurs in system when accessory is moved near installation site, user click is corresponding Position after, accessory is installed successfully, and is shown and corresponding installed successfully virtual image.
In one embodiment, there may be multiple users to carry out assembling fittings simultaneously in a virtual scene, wherein using Mutual exchange can also be realized between family, the mutual exchange between user is realized by the Input of similar chatroom 's.After input AC information, when clicking " transmission " button, user terminal generates StudentPost thread, and building includes User ID The request data package of information, to server-initiated messages pass through mechanism, and this message synchronization to other users end.Due to number According in packet containing the id information of user, so user terminal can show the address name for sending information.Certainly, user can also select It selects and is only exchanged with some or certain certain customers, server then only sends message to these specific user terminals.
From the foregoing, it will be observed that the embodiment of the present invention can establish user scapegoat in virtual scene, and according to the position of user scapegoat The viewpoint with directional information identity user in virtual scene is set, target accessory is chosen from accessory library, and obtain target accessory Three-dimensional tectonic information target accessory is modeled according to three-dimensional tectonic information to generate virtual accessory model, to virtually matching Part model carries out image rendering, to obtain three-dimensional accessory image, is carried out twice according to viewpoint to three-dimensional accessory image Image procossing, and by two display screens of treated display device that image is projected to virtual reality respectively, it receives and uses The limb action information at family generates user's operation according to limb action information, according to user's operation to the virtual graph of assembling scene Virtual image is shown to the display device of virtual reality with generating real-time virtual image as carrying out real-time operation.This programme is logical It crosses and accessory is modeled, to generate threedimensional model, and interacted by the operation of user with user, opposite and two-dimensional surface Image has more three-dimensional sense, facilitates understandings, can accurate simulation assembling fittings process.
For the ease of the better implementation assembling fittings method provided in an embodiment of the present invention based on virtual reality, the present invention Embodiment additionally provides a kind of system of assembling fittings method based on above-mentioned based on virtual reality.Wherein the meaning of noun with it is upper State identical in the assembling fittings method based on virtual reality, specific implementation details can be with reference to the explanation in embodiment of the method.
Referring to Fig. 4, Fig. 4 is a kind of structure of the assembling fittings system based on virtual reality provided in an embodiment of the present invention Schematic diagram, the assembling fittings system 30 based on virtual reality of being somebody's turn to do includes: to establish module 301, generation module 302, projection module 303 And update module 304;
Module 301 is established, for establishing user scapegoat in virtual scene, and according to the position and side of the user scapegoat To viewpoint of the message identification user in the virtual scene;
Generation module 302 is modeled for choosing target accessory from accessory library, and to the target accessory to generate Virtual accessory model;
Projection module 303, for being filled the display that the virtual accessory model is projected to virtual reality according to the viewpoint It sets, to show the virtual image of assembling scene;
Update module 304, the operation for being directed to the virtual accessory model for obtaining user, and according to the user's operation The virtual image of scene is assembled in the display device of virtual reality described in real-time update.
In one embodiment, referring to Fig. 5, generation module 302 includes: acquisition submodule 3021 and generation submodule 3022;
Acquisition submodule 3021, for obtaining the three-dimensional tectonic information of the target accessory;
Submodule 3022 is generated, for being modeled the target accessory to generate according to the three-dimensional tectonic information The virtual accessory model.
Wherein, above-mentioned generation submodule 3022 is matched specifically for the type of the determination target accessory according to the target The type of part and the three-dimensional tectonic information determine Target Modeling strategy, are modeled according to the Target Modeling strategy with life At the virtual accessory model.
Further, above-mentioned projection module 303 includes: rendering submodule 3031 and projection submodule 3032;
Submodule 3031 is rendered, for carrying out image rendering to the virtual accessory model, to obtain three-dimensional accessory Image;
Submodule 3032 is projected, for carrying out at image twice according to the viewpoint to the three-dimensional accessory image Reason, and by two display screens of treated display device that image is projected to the virtual reality respectively, so that institute Stating image shown by two display screens of the display device of virtual reality is view of the three-dimensional accessory image in different angle Figure.
Further, above-mentioned update module 304 includes: receiving submodule 3041, operation submodule 3042 and display Module 3043;
Receiving submodule 3041 generates institute according to the limb action information for receiving the limb action information of user State user's operation;
Operation submodule 3042, for carrying out i.e. luck according to virtual image of the user's operation to the assembling scene It calculates, to generate real-time virtual image;
Display sub-module 3043, for showing the virtual image to the display device of the virtual reality.
From the foregoing, it will be observed that the assembling fittings system provided in an embodiment of the present invention based on virtual reality can be by establishing module 301 establish user scapegoat in virtual scene, and according to the position and direction message identification user of user scapegoat in virtual scene In viewpoint, generation module 302 chooses target accessory from accessory library, and is modeled to target accessory to generate virtual accessory Model, virtual accessory model is projected to the display device of virtual reality according to viewpoint by projection module 303, to show assembling scene Virtual image, update module 304 obtains the operation that user is directed to virtual accessory model, and empty according to user's operation real-time update Intend the virtual image that scene is assembled in the display device of reality.This programme is by modeling accessory, to generate threedimensional model, And interacted by the operation of user with user, opposite and two-dimensional image has more three-dimensional sense, facilitates understanding, can be with The process of accurate simulation assembling fittings.
Correspondingly, the embodiment of the present invention also provides a kind of server 500, as shown in fig. 6, the server 500 includes radio frequency (RF, Radio Frequency) circuit 501, the memory for including one or more computer readable storage medium 502, input unit 503, power supply 504, Wireless Fidelity (WiFi, Wireless Fidelity) module 505, include one or The components such as the processor 506 of more than one processing core of person.It will be understood by those skilled in the art that structure shown in Fig. 6 is simultaneously It does not constitute or not server and limit, may include perhaps combining certain components or not than illustrating more or fewer components Same component layout.
Radio circuit 501 can be used for receiving and sending messages or communication process in signal send and receive, particularly, by base station Downlink information receive after, transfer to one or more than one processor 506 processing;In addition, the data for being related to uplink are sent To base station.In general, radio circuit 501 includes but is not limited to antenna, at least one amplifier, tuner, one or more oscillations Device, subscriber identity module (SIM, Subscriber Identity Module) card, transceiver, coupler, low noise amplification Device (LNA, Low Noise Amplifier), duplexer etc..In addition, radio circuit 501 can also by wireless communication with network It is communicated with other equipment.Any communication standard or agreement, including but not limited to global system for mobile telecommunications can be used in the wireless communication System (GSM, Global System of Mobile communication), general packet radio service (GPRS, General Packet Radio Service), CDMA (CDMA, Code Division Multiple Access), wideband code division it is more Location (WCDMA, Wideband Code Division Multiple Access), long term evolution (LTE, Long Term Evolution), Email, short message service (SMS, Short Messaging Service) etc..
Memory 502 can be used for storing application program and data.It include that can hold in the application program that memory 502 stores Line code.Application program can form various functional modules.Processor 506 is stored in the application journey of memory 502 by operation Sequence, thereby executing various function application and data processing.Memory 502 can mainly include storing program area and storing data Area, wherein storing program area can application program needed for storage program area, at least one function (such as sound-playing function, Image player function etc.) etc.;Storage data area can store according to server use created data (such as audio data, Phone directory etc.) etc..In addition, memory 502 may include high-speed random access memory, it can also include non-volatile memories Device, for example, at least a disk memory, flush memory device or other volatile solid-state parts.Correspondingly, memory 502 can also include Memory Controller, to provide the access of processor 506 and input unit 503 to memory 502.
Input unit 503 can be used for receiving the information of other equipment transmission, and generate and user setting and function control Make related keyboard, mouse, operating stick, optics or trackball signal input.Give the information of input to processor 506 again, And order that processor 506 is sent can be received and executed.Input unit 503 can also include other input equipments.Specifically Ground, other input equipments can include but is not limited to physical keyboard, function key (such as volume control button, switch key etc.), One of mouse, operating stick etc. are a variety of.
Server further includes the power supply 504 (such as battery) powered to all parts.Preferably, power supply can pass through power supply Management system and processor 506 are logically contiguous, to realize management charging, electric discharge and power consumption pipe by power-supply management system The functions such as reason.Power supply 504 can also include one or more direct current or AC power source, recharging system, power failure The random components such as detection circuit, power adapter or inverter, power supply status indicator.
Wireless Fidelity (WiFi) belongs to short range wireless transmission technology, and server can be helped by wireless fidelity module 505 Help user to send and receive e-mail, browse webpage and access streaming video etc., it provides wireless broadband internet for user and visits It asks.Although Fig. 6 shows wireless fidelity module 505, but it is understood that, and be not belonging to server must be configured into portion Point, it can according to need within the scope of not changing the essence of the invention and omit completely.
Processor 506 is the control centre of server, utilizes each portion of various interfaces and the entire server of connection Point, by running or executing the application program being stored in memory 502, and the data that calling is stored in memory 502, The various functions and processing data of execute server, to carry out integral monitoring to server.Optionally, processor 506 can wrap Include one or more processing cores;Preferably, processor 506 can integrate application processor and modem processor, wherein answer With the main processing operation system of processor, user interface and application program etc., modem processor mainly handles wireless communication. It is understood that above-mentioned modem processor can not also be integrated into processor 506.
Processor 506 is for realizing following functions: user scapegoat is established in virtual scene, and according to the position of user scapegoat Set the viewpoint with directional information identity user in virtual scene, from accessory library choose target accessory, and to target accessory into Virtual accessory model is projected to the display device of virtual reality according to viewpoint to generate virtual accessory model by row modeling, with aobvious Show the virtual image of assembling scene, obtains the operation that user is directed to virtual accessory model, and empty according to user's operation real-time update Intend the virtual image that scene is assembled in the display device of reality.
When it is implemented, the above modules can be used as independent entity to realize, any combination can also be carried out, is made It is realized for same or several entities, the specific implementation of the above modules can be found in the embodiment of the method for front, herein not It repeats again.
It should be noted that those of ordinary skill in the art will appreciate that whole in the various methods of above-described embodiment or Part steps are relevant hardware can be instructed to complete by program, which can store in computer-readable storage medium It in matter, is such as stored in the memory of terminal, and is executed by least one processor in the terminal, can be wrapped in the process of implementation Include the process of the embodiment such as information issuing method.Wherein, storage medium may include: read-only memory (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), disk or CD etc..
A kind of assembling fittings method and system based on virtual reality provided in an embodiment of the present invention has been carried out in detail above Thin to introduce, each functional module can integrate in a processing chip, be also possible to modules and physically exist alone, can also It is integrated in a module with two or more modules.Above-mentioned integrated module both can take the form of hardware realization, It can also be realized in the form of software function module.Specific case used herein is to the principle of the present invention and embodiment It is expounded, the above description of the embodiment is only used to help understand the method for the present invention and its core ideas;Meanwhile for Those skilled in the art, according to the thought of the present invention, there will be changes in the specific implementation manner and application range, comprehensive Upper described, the contents of this specification are not to be construed as limiting the invention.

Claims (10)

1. a kind of assembling fittings method based on virtual reality, which comprises the following steps:
User scapegoat is established in virtual scene, and according to the position and direction message identification user of the user scapegoat described Viewpoint in virtual scene;
Target accessory is chosen from accessory library, and the target accessory is modeled to generate virtual accessory model;
The virtual accessory model is projected to the display device of virtual reality according to the viewpoint, to show the void of assembling scene Quasi- image;
Obtain the operation that user is directed to the virtual accessory model, and the virtual reality according to the user's operation real-time update Display device in assemble scene virtual image.
2. the assembling fittings method based on virtual reality as described in claim 1, which is characterized in that the target accessory into Row is modeled to generate
Obtain the three-dimensional tectonic information of the target accessory;
According to the three-dimensional tectonic information, the target accessory is modeled to generate the virtual accessory model.
3. the assembling fittings method based on virtual reality as claimed in claim 2, which is characterized in that according to the three-dimensional construction Information models the target accessory and is specifically included the step of the virtual accessory model with generating:
Determine the type of the target accessory;
Target Modeling strategy is determined according to the type of the target accessory and the three-dimensional tectonic information;
It is modeled according to the Target Modeling strategy to generate the virtual accessory model.
4. the assembling fittings method based on virtual reality as described in claim 1, which is characterized in that according to the viewpoint by institute Stating the step of virtual accessory model is projected to the display device of virtual reality includes:
Image rendering is carried out to the virtual accessory model, to obtain three-dimensional accessory image;
Image procossing twice is carried out to the three-dimensional accessory image according to the viewpoint, and image is thrown respectively by treated It is incident upon in two display screens of the display device of the virtual reality, so that two of the display device of the virtual reality Image shown by display screen is view of the three-dimensional accessory image in different angle.
5. the assembling fittings method based on virtual reality as described in claim 1, which is characterized in that obtain user for described The operation of virtual accessory model, and scene is assembled in the display device of the virtual reality according to the user's operation real-time update Virtual image the step of include:
The limb action information for receiving user generates the user's operation according to the limb action information;
Real-time operation is carried out according to virtual image of the user's operation to the assembling scene, to generate real-time virtual image;
The virtual image is shown to the display device of the virtual reality.
6. a kind of assembling fittings system based on virtual reality characterized by comprising establish module, generation module, projective module Block and update module;
It is described to establish module, for establishing user scapegoat in virtual scene, and according to the position and direction of the user scapegoat Viewpoint of the message identification user in the virtual scene;
The generation module for choosing target accessory from accessory library, and models to generate void the target accessory Quasi- accessory model;
The projection module, for the virtual accessory model to be projected to the display device of virtual reality according to the viewpoint, To show the virtual image of assembling scene;
The update module, the operation for being directed to the virtual accessory model for obtaining user, and it is real according to the user's operation The virtual image of scene is assembled in the display device of virtual reality described in Shi Gengxin.
7. the assembling fittings system based on virtual reality as claimed in claim 6, which is characterized in that the generation module packet It includes: acquisition submodule and generation submodule;
The acquisition submodule, for obtaining the three-dimensional tectonic information of the target accessory;
The generation submodule, for being modeled described in generation to the target accessory according to the three-dimensional tectonic information Virtual accessory model.
8. the assembling fittings system based on virtual reality as claimed in claim 7, which is characterized in that
The generation submodule, specifically for the type of the determination target accessory, according to the type of the target accessory and The three-dimensional tectonic information determines Target Modeling strategy, is modeled according to the Target Modeling strategy to generate and described virtually match Part model.
9. the assembling fittings system based on virtual reality as claimed in claim 6, which is characterized in that the projection module packet It includes: rendering submodule and projection submodule;
The rendering submodule, for carrying out image rendering to the virtual accessory model, to obtain three-dimensional accessory image;
The projection submodule, for carrying out image procossing twice to the three-dimensional accessory image according to the viewpoint, and In two display screens of treated display device that image is projected to the virtual reality respectively, so that described virtual Image shown by two display screens of the display device of reality is view of the three-dimensional accessory image in different angle.
10. the assembling fittings system based on virtual reality as claimed in claim 6, which is characterized in that the update module packet It includes: receiving submodule, operation submodule and display sub-module;
The receiving submodule generates the use according to the limb action information for receiving the limb action information of user Family operation;
The operation submodule, for carrying out real-time operation according to virtual image of the user's operation to the assembling scene, To generate real-time virtual image;
The display sub-module, for showing the virtual image to the display device of the virtual reality.
CN201710759056.9A 2017-08-29 2017-08-29 A kind of assembling fittings method and system based on virtual reality Pending CN109427100A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710759056.9A CN109427100A (en) 2017-08-29 2017-08-29 A kind of assembling fittings method and system based on virtual reality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710759056.9A CN109427100A (en) 2017-08-29 2017-08-29 A kind of assembling fittings method and system based on virtual reality

Publications (1)

Publication Number Publication Date
CN109427100A true CN109427100A (en) 2019-03-05

Family

ID=65503780

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710759056.9A Pending CN109427100A (en) 2017-08-29 2017-08-29 A kind of assembling fittings method and system based on virtual reality

Country Status (1)

Country Link
CN (1) CN109427100A (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110111630A (en) * 2019-04-29 2019-08-09 中国人民解放军战略支援部队航天工程大学士官学校 Analogy method, device and the electronic equipment of device assembling training
CN110415359A (en) * 2019-07-29 2019-11-05 恒信东方文化股份有限公司 A kind of three-dimensional modeling method and system
CN110428684A (en) * 2019-07-19 2019-11-08 暨南大学 The Physical Experiment artificial intelligence automotive engine system and working method of virtual reality
CN111260982A (en) * 2020-01-20 2020-06-09 中山职业技术学院 Cross-platform virtual simulation training system for gallbladder machine assembly
CN113052982A (en) * 2021-03-23 2021-06-29 深圳市瑞立视多媒体科技有限公司 Method and device for assembling and disassembling accessories in industrial model, computer equipment and storage medium
CN113885913A (en) * 2021-09-30 2022-01-04 珠海虎江科技有限公司 Upgrading method of virtual reality display equipment, computer device and computer readable storage medium
CN116152383A (en) * 2023-03-06 2023-05-23 深圳优立全息科技有限公司 Voxel model, image generation method, device and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060021566A (en) * 2004-09-03 2006-03-08 (주)제니텀 엔터테인먼트 컴퓨팅 Reconstruction 3d scene of virtual viewpoint using foreground projection-image and virtual-shap
CN102789313A (en) * 2012-03-19 2012-11-21 乾行讯科(北京)科技有限公司 User interaction system and method
CN105159522A (en) * 2015-07-22 2015-12-16 深圳多新哆技术有限责任公司 Method for response of virtual reality display device to operation of peripheral device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060021566A (en) * 2004-09-03 2006-03-08 (주)제니텀 엔터테인먼트 컴퓨팅 Reconstruction 3d scene of virtual viewpoint using foreground projection-image and virtual-shap
CN102789313A (en) * 2012-03-19 2012-11-21 乾行讯科(北京)科技有限公司 User interaction system and method
CN105159522A (en) * 2015-07-22 2015-12-16 深圳多新哆技术有限责任公司 Method for response of virtual reality display device to operation of peripheral device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
许爱军: "多用户协同虚拟现实的技能训练系统", 《计算机系统应用》 *

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110111630A (en) * 2019-04-29 2019-08-09 中国人民解放军战略支援部队航天工程大学士官学校 Analogy method, device and the electronic equipment of device assembling training
CN110111630B (en) * 2019-04-29 2021-03-02 中国人民解放军战略支援部队航天工程大学士官学校 Simulation method and device for device assembly training and electronic equipment
CN110428684A (en) * 2019-07-19 2019-11-08 暨南大学 The Physical Experiment artificial intelligence automotive engine system and working method of virtual reality
CN110415359A (en) * 2019-07-29 2019-11-05 恒信东方文化股份有限公司 A kind of three-dimensional modeling method and system
CN111260982A (en) * 2020-01-20 2020-06-09 中山职业技术学院 Cross-platform virtual simulation training system for gallbladder machine assembly
CN113052982A (en) * 2021-03-23 2021-06-29 深圳市瑞立视多媒体科技有限公司 Method and device for assembling and disassembling accessories in industrial model, computer equipment and storage medium
CN113052982B (en) * 2021-03-23 2023-11-28 深圳市瑞立视多媒体科技有限公司 Fitting dismounting method and device in industrial model, computer equipment and storage medium
CN113885913A (en) * 2021-09-30 2022-01-04 珠海虎江科技有限公司 Upgrading method of virtual reality display equipment, computer device and computer readable storage medium
CN116152383A (en) * 2023-03-06 2023-05-23 深圳优立全息科技有限公司 Voxel model, image generation method, device and storage medium
CN116152383B (en) * 2023-03-06 2023-08-11 深圳优立全息科技有限公司 Voxel model, image generation method, device and storage medium

Similar Documents

Publication Publication Date Title
CN109427100A (en) A kind of assembling fittings method and system based on virtual reality
CN109427096A (en) A kind of automatic guide method and system based on augmented reality
Tecchia et al. A Flexible Framework for Wide‐Spectrum VR Development
CN110533755A (en) A kind of method and relevant apparatus of scene rendering
CN106504311B (en) A kind of rendering intent and device of dynamic fluid effect
CN103905885B (en) Net cast method and device
CN108961890A (en) The drilling method and system of fire incident
CN110083324A (en) Method, apparatus, electronic equipment and the computer storage medium of Image Rendering
CN101059760B (en) OPENGL to OPENGLIES translator and OPENGLIES emulator
CN101980152A (en) Mobile middleware system and implementation method thereof
CN112070906A (en) Augmented reality system and augmented reality data generation method and device
CN108958459A (en) Display methods and system based on virtual location
CN109685884A (en) A kind of three-dimensional modeling method and system based on virtual reality
CN109725956A (en) A kind of method and relevant apparatus of scene rendering
CN104820585A (en) Apparatus and Method for Multi-User Editing of Computer-Generated Content
US20240144625A1 (en) Data processing method and apparatus, and electronic device and storage medium
CN108880983A (en) A kind of the voice real-time processing method and device of virtual three-dimensional space
Chen et al. Analysis of augmented reality application based on cloud computing
CN105550934A (en) System and method for pushing WeChat soft advertisement in virtual reality
CN104158899B (en) Based on information push of mobile terminal method, the Apparatus and system of Service-Oriented Architecture Based
CN109427097A (en) A kind of hoisting simulation method and system based on virtual reality
CN113298924A (en) Scene rendering method, computing device and storage medium
US20200210038A1 (en) Robot eye lamp control method and apparatus and terminal device using the same
CN113572822A (en) Cloud terminal simulation control method and device, storage medium and electronic equipment
CN107085509B (en) A kind of processing method and terminal of the foreground picture in virtual scene

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination