RU2656584C1 - System of designing objects in virtual reality environment in real time - Google Patents

Abstract

FIELD: information technology.

SUBSTANCE: invention relates to technologies for managing and editing objects in virtual reality. System for designing objects in a virtual reality environment in real time is proposed. System comprises at least one display device configured to: display in real time at least one three-dimensional image of the object, monitor the movement of the marker, receive data from the computing device, obtain data from the positioning device, and at least one positioning device configured to: measure the position and orientation of the at least one limb of the user, update the position of the object in a virtual reality environment and display it on the display device, and obtain data from the computing device.

EFFECT: technical result is an increase in the efficiency of designing objects in virtual reality, increase the accuracy of designing objects in virtual reality by performing a verification of the compliance of the characteristics of a virtual object with the characteristics of technical documentation.

11 cl, 3 dwg, 1 tbl

Description

FIELD OF TECHNOLOGY

[1] This technical solution relates generally to computer technology, and in particular to object control systems and their editing in virtual reality.

BACKGROUND

[2] Currently, devices that are able to transfer the interactive interaction of man and computer technology to a qualitatively higher level are becoming increasingly popular.

[3] Virtual reality technologies are developing significantly due to advances in computer technology and stereoscopic displays.

[4] Virtual reality is a world created by technical means (objects and subjects), transmitted to a person through his sensations: sight, hearing, smell, touch and other feelings. Virtual reality simulates both exposure and response to exposure. To create a convincing complex of sensations of reality, a computer synthesis of the properties and reactions of virtual reality is performed in real time.

[5] The advantage of virtual reality is that the simulated environment can be applied in various fields: real estate, architecture, product design, analysis of human behavior, user training, data visualization, telepresence, or any physical phenomena that may benefit or harm the user.

[6] In addition, virtual reality can be used in augmented reality, for example, in an automotive virtual reality environment.

[7] There are several approaches to obtaining three-dimensional coordinates of an object in space. In one of them, a set of cameras or other three-dimensional sensors is pre-installed, the main task of which is to take pictures of the working area, so that each point of the object is in the field of view of at least two cameras or three-dimensional sensors. Thus, the entire object can be restored by processing a set of received images. Such an approach is computationally inefficient, since it implies rather expensive processing of survey data. Additionally, to obtain the three-dimensional coordinates of each new object, it is necessary to reconfigure the configuration of cameras or three-dimensional sensors, which is a significant drawback.

[8] An approach is also known, according to which the object and its fragments are preliminarily surveyed, and then post-processing is performed to construct one three-dimensional model in one global coordinate system.

ESSENCE OF TECHNICAL SOLUTION

[9] This technical solution is aimed at eliminating the disadvantages inherent in solutions known from the prior art.

[10] The technical problem to be solved in this technical solution is the implementation of a system for designing objects in virtual reality, in which the user interaction zone is visualized with the possibility of connecting various libraries in real time, depending on the application, as well as the possibility of conversion and export data in computer-aided design systems.

[11] The technical result achieved in solving this problem is to increase the efficiency of designing objects in virtual reality and using virtual reality tools.

[12] Also, an additional technical result is to increase the accuracy of designing objects in virtual reality by checking the conformity of the characteristics of a virtual object with the characteristics of technical documentation.

[13] The specified technical result is achieved through the implementation of a system for designing objects in virtual reality in real time, which contains at least one display device configured to display in real time at least one three-dimensional image of the object; at least one positioning device configured to measure the position and orientation of the user's limbs; at least one data reader configured to detect touch of a virtual object and measure the force of impact on it; at least one computing device configured to design an object in a virtual reality environment, wherein said computing device receives at least one virtual object that is displayed on a display device; then receives user control commands for at least one received virtual object from the above positioning device; after which it executes the received control commands on the virtual object for at least one virtual object; further checks the characteristics of the virtual object for compliance with the characteristics approved in the regulatory documentation for this virtual object; display on the display device a message about the result of the check.

[14] In some embodiments, the display device is a virtual reality helmet (HMD) or a multi-layer virtual reality display (CAVE) or active shutter glasses in combination with an on-screen display (CRT).

[15] In some embodiments, the data display device includes a gyroscope and / or microaccelerometer, and / or a magnetometer, and / or a positioning device.

[16] In some embodiments, the positioning device is a spatial positioning sensor.

[17] In some embodiments of the technical solution, the data reader is a tactile device.

[18] In some embodiments, the data reader is a joystick or robotic device, or an exoskeleton.

[19] In some embodiments of the technical solution, the computing device obtains a virtual object from a virtual directory or by forming an object from primitives on a display device.

[20] In some embodiments of the technical solution, a virtual reality object is obtained from the DirectX or Open GL graphics library, or 3ds Max, or Max Cinema 4D.

[21] In some embodiments of the technical solution, a control command over the virtual object may be generated by perceiving the facial expressions of the user and / or the movement of the user's body in the real world.

[22] In some embodiments of the technical solution, the characteristics of the created virtual object are geometric and / or color and / or include the assigned attributes.

[23] In some embodiments of the technical solution, when displaying the result of the verification of characteristics, deviations from the standard of the normative document are detected, a message about the detected deviation is output to the user display device.

BRIEF DESCRIPTION OF THE DRAWINGS

[24] In FIG. 1 shows an example implementation of a system for designing objects in a virtual reality environment in real time;

[25] In FIG. 2 shows an example of the implementation of the design of objects in a virtual environment of virtual reality, performed by a computing device;

[26] In FIG. 3 shows an example implementation of a database of designers, suppliers of materials and virtual objects;

DETAILED DESCRIPTION OF THE TECHNICAL SOLUTION

[27] Below will be described the concepts and definitions necessary for the detailed disclosure of the ongoing technical solution.

[28] The technical solution can be implemented as a distributed computer system.

[29] In this solution, a system means a computer system, a computer (electronic computer), CNC (numerical control), PLC (programmable logic controller), computerized control systems, and any other devices capable of performing a given, well-defined sequence of operations (actions, instructions).

[30] A computing device means an electronic unit or an integrated circuit (microprocessor) that executes machine instructions (programs).

[31] A computing device reads and executes machine instructions (programs) from one or more data storage devices. Storage devices may include, but are not limited to, hard disks (HDD), flash memory, ROM (read only memory), solid state drives (SSD), optical media (CD, DVD, etc.).

[32] A program is a sequence of instructions for execution by a computer control device or an instruction processing device.

[33] Virtual reality is the world created by technical means (objects and subjects), transmitted to a person through his sensations: vision, hearing, smell, touch, and others.

[34] A virtual reality helmet (Head-mounted display) is a device that allows you to partially immerse yourself in the world of virtual reality, creating a visual and acoustic effect of being in a given control device (computer) space.

[35] Technical documentation - a set of documents used in the design (construction), creation (manufacture) and use (operation) of any technical objects: buildings, structures, industrial goods, software and hardware.

[36] Design documentation (CD) - graphic and text documents that, together or separately, determine the composition and structure of the product and contain the necessary data for its development, manufacture, control, operation, repair and disposal.

[37] OpenGL (Open Graphics Library) is a specification defining a platform-independent (independent of the programming language) programming interface for writing applications using two-dimensional and three-dimensional computer graphics. Includes over 300 functions for drawing complex three-dimensional scenes from simple primitives. It is used to create computer games, CAD, virtual reality, visualization in scientific research.

[38] The virtual reality environment includes hardware devices and computer programs.

[39] A detailed virtual reality system is shown in FIG. one.

[40] This technical solution uses a group of sensors, for example, a gyroscope, microaccelerometer, magnetometer, positioning device, which together constitute a distributed system and are located in the display device 110 for modeling a virtual environment. In some embodiments, the display device 110 is a virtual reality helmet. Moreover, between the sensors or between the sensors and the computing device 100 , interaction is possible due to the use of wireless data transmission, which can be carried out via Wi-Fi, Bluetooth, ZigBee, LTE, 4G, 5G, WiMAX. The data that comes from all sensors in real time to the computing device 100 is compared and verified. If, when verifying the data from the sensors by comparing them with the experimental ones (reference or empirical), the error exceeds a predetermined allowable value, an automatic calibration of all the sensors of the system in real-world coordinates is performed, combining the virtual images of the sensors with a predetermined base point on the display device 110 , whose coordinates are known. This is done to establish a one-to-one relationship between the coordinates in the real and virtual worlds, so that a person can "take" a virtual object with his hand or a special device, and the system reflects this action in his virtual space. The data depending on the type of sensor may include the coordinates of the points of the objects of space, the characteristics of the magnetic field, acceleration, angle of orientation, not limited to.

[41] After the data from the sensors arrive at the computing device 100 , they are processed on it. For example, statistical outliers are deleted in the coordinates of the points of the objects (in other words, they thin out the points), or they carry out decimation, at which every tenth coordinate of the point remains. This processing can be performed in conjunction with a recursive filter (a Chebyshev filter, a Kalman filter, a Bessel filter or a Butterworth filter can be used, not limited to). Such filters can be either analog or digital. To transmit data from the sensors to the computing device 100 , a text or binary data protocol may be used. For example, NTCB can be used as a binary data transfer protocol, and NTCT as a text protocol. The binary data transfer protocol allows you to transfer several coordinates of points with the sensor at once, as well as, for example, all data about the sensor itself, for example, its temperature, pressure, charge level, which significantly increases the data transfer speed.

[42] Then, on the computing device 100, based on the set of coordinates of the points of the objects obtained from the sensors, a common point cloud is formed that uniquely displays the position of the objects. In some embodiments, a point cloud is formed through the operation of a 3D scanner (for example, a lidar), which automatically measures a large number of points on the surface of the scanned object and forms a point cloud in the form of a digital data file. The point cloud in this technical solution is a set of vertices in a three-dimensional coordinate system. These vertices, as a rule, are determined by the coordinates X, Y and Z and, as a rule, are intended to represent the outer surface of the object.

[43] In some embodiments, the point cloud may be converted to a polygon mesh or, for example, a three-dimensional model with NURBS curves. There are many approaches for converting a point cloud into three-dimensional surfaces that can be used in this technical solution. Some approaches, such as Delaunay triangulation, alpha shapes and ball pivoting, build a grid of triangles on top of existing vertices of a point cloud.

[44] In some embodiments, the computing device 100 mainly controls all system operations, such as display, data transmission, operation of sensors, and the display operation on the display device. Computing device 100 may include one or more processors that implement instructions for performing all or part of the steps of these methods. In addition, computing device 100 may include one or more modules for a convenient interaction process between device 100 and other components.

[45] The data warehouse on which the databases described below are configured to store various types of data to support the operation of the system. Examples of such data include instructions from any application or method, images, videos, etc. The data storage can be implemented in the form of any type of volatile memory, non-volatile memory or a combination thereof, for example, Static Random Access Memory (RAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Permanent Storage Device (ROM), Permanent Storage Device (ROM), magnetic memory, flash memory, ma magnetic or optical disk. Also, the aforementioned data warehouse may include a database in which a supplier accounts database with a database of materials and products offered by these suppliers can be located, and also include a designer accounts database with a database of virtual reality objects. These databases can be hierarchical, network, and relational.

[46] In order for virtual objects to correlate with real ones, the virtual reality system requires a positioning device 120 , which may be a spatial positioning sensor (as shown in Fig. 1). To obtain full three-dimensional coordinates (point clouds), as well as determine the position and orientation of objects (for example, hands, heads, or special devices), positioning devices for scanned objects are used, which, with a given accuracy, move and rotate objects in the field of view of the scanning system. The transition matrix from the local coordinate system of an object fragment to the global coordinate system of the complete model is determined by the given displacements and rotation angles of the positioning device. As a device for positioning, markers, ultrasonic sensors, infrared sensors can be used, not limited to. By marker is meant an active or passive type element for creating labels for positioning. A passive marker reflects light coming from the flash; active has a diode that glows in the infrared range

[47] Positioning may occur as follows. A marker is attached to the object. Depending on the implementation, it can be glued directly to the hand, attached to objects in the hand, etc. A fixed sensor located in a virtual reality system, for example, on a display device 110 , monitors marker movements. Marker tracking can be electromagnetic, laser, optical or ultrasonic.

[48] For example, with electromagnetic tracking of a marker, the strength of a magnetic field is measured. The magnetic field arises as a result of the passage of current through electromagnetic coils located perpendicular to each other. These coils should be in a small case, mounted on a moving object, the position of which must be monitored. The current passing sequentially through the coils turns them into electromagnets, which makes it possible to determine their position and orientation in space. Such a system works ineffectively near any metal objects and devices that can affect the electromagnetic field.

[49] Based on this technology, for example, there is a SpaceGrips device, as well as various modifications of virtual gloves. For their high-quality work, a specially equipped room is required, but even then the system must be recalibrated almost monthly.

[50] If you equip a tracking system, for example, with optical markers or an electromagnetic sensor, an ordinary joystick or other device for interacting with a computer, you will get a virtual reality control device.

[51] The marker can be active and passive. The active marker has a built-in emitter (accordingly, it either has a built-in power supply or is wired to the main unit). A passive marker reflects visible or infrared light.

[52] Typically, a positioning device is used for two purposes: to represent the limbs of a body in virtual space and to update the image display. The position and orientation of the marker on the limbs is used by the positioning device 120 to update the position of the object in virtual reality and display it on the display device.

[53] The display device 120 may be glasses or a virtual reality helmet, which has a display for displaying three-dimensional virtual reality objects. There are several possible display devices that include a virtual reality headset (HMD), multi-layer displays for virtual reality (CAVE), and the use of active shutter glasses in combination with an on-screen display (CRT).

[54] Multilayer displays for virtual reality can be useful in that several users in virtual reality can work with them. For example, it is possible to work with a virtual catalog of objects when designing for several users at once. However, such devices have a high cost, a great need for placement in space, and a rather low resolution of images.

[55] Active shutter glasses, in combination with the on-screen display, display a three-dimensional image to the user by using the sequential shutter of each eye in two images displayed on the on-screen display. The disadvantages of this approach include the fact that the resolution of the images is limited by the hardware of the monitor and the images are limited by the relatively small field of view of the user, which leads to a low effect of immersion in the "virtual" reality.

[56] A virtual reality helmet is worn on the user's head, which provides a high degree of “immersion” in virtual reality by blocking external visual stimuli. The virtual reality helmet includes two miniature screens and an optical system that transmits images from the screen to the eyes, thereby providing a stereo image of the virtual world. The positioning device, which is located in the virtual reality helmet, continuously real-time measures the position and orientation of the user's head and allows the computing device to generate images for adjusting the presentation of the scene to the current view. The user can view and go through a virtual reality environment.

[57] A tactile device can be used as the data reader 130 , which provides a physical sense of touch and is placed in the user's hand. In some embodiments, the tactile device may be a special glove with tactile feedback and a sensation of warmth. This technical solution includes, but is not limited to, Control VR, GloveOne from NeuroDigital, PowerClaw, Manus VR, Senso, etc. Also, a device of five tips connected to a robotic arm can be used as a tactile device. Some tactile devices provide feedback when pressure is applied to a finger, head, arm, or other limb. Such devices allow the user to feel very realistic tactile feedback in combination with a virtual reality interface. In the task of designing a virtual object, tactile devices 130 allow the user to create the illusion that he forms the component of the object or the object itself from some material material, for example, a brick texture. Gain feedback may be provided by the data reader 130 . Such devices may include, but are not limited to, joysticks, robotic devices, exoskeletons. For example, the advantage of exoskeletons is that they accurately simulate the anatomy of the human hand and can be used to position the position of the hand in virtual reality.

[58] The purpose of using the data reader 130 in this technical solution is as follows: a) simulating the selection and capture of a virtual object from a virtual directory; b) simulation of editing operations on a virtual object.

[59] In some embodiments, the computing device 100, configured to design an object in a virtual reality environment, implements the method of designing objects in virtual reality, shown in FIG. 2.

[60] Step 201 : receives at least one virtual object that is displayed on the display device 110 ;

[61] In some embodiments, a virtual directory exists, or in other words, a virtual object database that provides a multi-user network environment. This virtual directory in some cases can be stored in different places distributed throughout the Internet, for example, in the form of a distributed database. Also, the user from the virtual directory can download not the virtual object itself, but a link to this virtual object and follow this link if there is a network connection to work with the virtual object.

[62] At this step, they can either receive a virtual object from a virtual directory, or form from existing primitives.

[63] In the simplest case, objects are formed from primitives (cubes, spheres, cones, cylinders, planes, etc.).

[64] In some embodiments, objects are formed based on splines (lines, circles, polygons, etc.). For example, using splines, you can create a rotation object or a loft object (the result of moving a spline along a given path). More complex objects can be created using pieces of a Bezier surface. A piece of a Bezier surface consists of two parts: a surface and a strain grating. The deformation lattice, in turn, is a set of interconnected control points surrounding the surface of a Bezier piece. The movement of one or more control points of the strain grating affects the shape of the surface area. When a Bezier piece is deformed, a rather smooth surface is obtained. However, this is just an approximation of the original object. A method based on non-uniform rational B-splines (Non-Uniform Rational BSplines - NURBS) more accurately reproduces the shape of objects. In this method, as in the case of Bézier pieces, control points are used to control the curvature of the surface. However, the NURBS method is very powerful and therefore more difficult to use.

[65] Pre-form an object, for example, a construction of primitives on a display device in a virtual reality system.

[66] VRML or X3D can be used to create virtual reality objects. The VRML specification is adopted by ISO (International Organization for Standardization). The presence of an international standard guarantees high quality and stability specifications. The X3D language is developed by the Web3D consortium and is an extension of VRML. The most important extensions include character animation, an improved lighting and navigation system, morphing, support for streaming data types, XML compatibility, etc. X3D is fully compatible with VRML. The X3D specification is an ISO standard. In VRML or X3D, the virtual world is represented as an acyclic scene graph whose nodes are nodes. The nodes contain fields that store information about the geometric properties of the model, the appearance of objects (standard materials and textures), lighting parameters, cameras, sounds, videos, as well as links to other objects, including VRML or X3D documents. To create a VRML or X3D file, use the editor to write the VRML / X3D code (VRMLPad, X3D-Edit). Visualization of the description of the scene graph is performed by the browser. Among the most popular browsers are Cortona3D Viewer from Parallel Graphics, BS Contact from BitManagement and others.

[67] In some other embodiments, the object is downloaded from a graphics library, such as, for example, DirectX, Open GL, 3ds Max, Max Cinema 4D.

[68] The objects and their parts (faces, points, lines), from which they are formed, can create relationships. Relations are formed along the x, y, and z axes. Relationships local to the plane can be horizontal, vertical, and normal.

[69] The table below shows the possible types of relationships and their parameters.

[70] In some embodiments, when designing virtual reality objects, the OpenGL graphics library may additionally be used. This library is a software-independent interface to graphic equipment, i.e. can be used on various hardware platforms. OpenGL commands allow you to: - create objects from geometric primitives (points, lines, polygons); - place objects in three-dimensional space and choose the method of their projection; - set the parameters of light sources and cameras; - apply various materials to objects (including textures); - Perform scene visualization and create animations. OpenGL teams implement all the stages of creating virtual reality objects. However, the OpenGL library provides the user with a powerful but low-level set of commands, the knowledge of which requires a certain programming skill. The joint use of high-level programming languages and the OpenGL library allows you to create high-quality images and animations of any complexity in various subject areas.

[71] At the design stage, the created object (or its part, group of objects) is assigned attributes. When creating objects, it is not always possible to display all existing characteristics of objects in the drawing, for example, cost, manufacturer, acquisition date, etc. This data can subsequently be extracted and used in programs for working with databases. When assigning attributes, the object or its part, to which the attribute is assigned, is pre-selected. The necessary attributes can be selected from the list of possible attributes, which also displays the attribute parameters. Then the operation of setting attributes is performed, which allows you to set certain attribute values. An attribute can be hidden, which means that the attribute is not displayed on the virtual reality object. Also, the attribute may be constant, i.e. automatically accept a preset value. The attribute can be controlled when, when setting the attribute, an additional prompt appears on the display device with a request to check the set value. The attribute can be fixed, which allows you to block the position of the attribute relative to the object, and if the attribute is fixed, it cannot be moved from the group of objects or separately from the object if it consists of parts. Attribute editing is possible, as before creating the object, i.e. in the process and after the creation of the object. Editing an attribute means changing the type of attribute, name, visibility, etc.

[72] Step 202 : receives user control commands for at least one received virtual object from the above positioning device 120 ;

[73] In a virtual space instance, users can traverse virtual space, manipulate virtual objects in virtual space, perform work, monitor and / or perform any other types of interactions with virtual space. Users can manage one or more of the available user-managed items in the virtual space. Monitoring can be carried out by means of control commands entered by users through a positioning or reading device. Users can interact with each other through a communication channel within the exchange in the virtual space, for example, through messages. Such messages may include text chat, instant messages, private messages, voice and / or other communications. Messages can be received and entered by users through a display device.

[74] A control command over the virtual object can be generated by perceiving the facial expressions of the user and / or the movement of the user's body in the real world. Perception is carried out by means of a head tracking system, an information input device for a personal computer, which converts the movements of the user's head into coordinates. As this system can be used TrackIR, RUCAP UM-5, ART, etc., without limitation. The control commands after generation are transmitted to the computing device 100 for execution.

[75] The control team is mainly aimed at compressing an object, deleting a fragment, decreasing or increasing an object, ie performing transformations known in the art. To edit an object or its fragment, the area where the object is located is selected first, and then the tool or action that can be performed with the edited area. The area and action is selected by means of a data reader or positioning device 120 , for example, located on the user's hand. Since several users can have access to the same area or object and its fragment for editing, the blocking principle applies: if one user has selected the area, the rest are not allowed to edit.

[76] Step 203 : the received control commands are executed on the virtual object for at least one virtual object;

[77] After receiving control commands on the computing device 100 for making changes to the object or its fragment, the data from the sensors of the system is automatically synchronized with the computing device 100 , and if the coordinates of the points of the object change, the computing device 100 updates the data in real time, and old data is written to the data buffer. Data in the data buffer can be stored until a certain event is executed, for example, when the user accepted changes in the state of the object and confirmed the completion of work with it. After editing the objects, select the output file format or software environment in which further interaction with the system will be carried out, and then place the object back into the virtual directory of objects by applying the control commands described above. Access to the changed object in the virtual directory can be obtained on the computing device 100 or the device 110 display when working in a computer-aided design.

[78] Step 204 : checks the characteristics of the virtual object for compliance with the characteristics approved in the regulatory documentation for this virtual object;

[79] Previously, at the design stage, based on the purpose of the object or assembly, both the object and the group of objects combined into the assembly, normative documentation (GOSTs, SNiPs to which it must comply) can be supplied in the corresponding unit. This can be general technical regulatory documents, regulatory documents on construction, on structures, on supervision in the field of construction, industry and departmental regulatory and methodological documents, as well as directive letters, regulations., Recommendations. At the same time, it is possible to assign related regulatory documents both during design “from below” (from an object to an assembly) and during design “from above” (from assembly to an object). At the same time, a set of model documents can highlight the basic principles by which the corresponding standard assembly standard document is selected when designing “from the bottom”. When designing the “top” and decomposing the “assembly” into key objects, based on the regulatory requirements for the assembly, regulatory documents are selected from the database, and the requirements that the objects that make up the assembly must meet.

[80] At this step, it checks the characteristics of the virtual object for compliance with the characteristics approved in the regulatory documentation for this virtual object. The characteristics of the created virtual object can be geometric, color, and also include the assigned attributes.

[81] Step 204 : displays a check result message on the display device.

[82] If any deviations from the standard of the normative document are detected within the framework of the performance check, which is carried out by comparing the characteristics, a message about all detected deviations is output to the user display device 110 .

[83] In some implementations, in addition to displaying a message about the deviation of the characteristic from the standard of the normative documentation, the acceptable characteristics for design are displayed.

[84] In some embodiments, the created virtual object is transformed after checking for compliance with regulatory documentation in the design documentation (assembly drawing, production sketch, estimate, specification, technical report or user-defined output format, as well as additional text documents for the drawing).

[85] After exporting to the design documentation, an output file is obtained with the relevant information, attributes and data on regulatory documents), after which the user can edit or not the received documentation. In case of refusal to edit the file is saved. If you select the option to edit the created file, an additional request appears - on which interface the user wants to continue editing - the computing device or in virtual reality mode on the display device. After that, the file is edited, the saved changes are recorded in the attributes of the virtual object or assembly.

[86] After choosing to edit the finished file, the user can accept or save the changes.

[87] After that, the technical documentation is approved and can be changed only with the assignment of a subsequent identification internal number (version).

[88] Users who have access to a virtual catalog of objects, in some embodiments, can be not only designers, but also manufacturers of materials and components, that is suppliers. For example, if the object is construction, the materials may be wood, polystyrene foam, metal tile, etc., and components, for example, bolts, slate, boards, etc. If, for example, the object is a building, based on the physical properties of the materials of the object and applicable standards, a multiphysical computer simulation of the object or several different physical and chemical properties is carried out. This can be physicochemical hydrodynamics, magnetohydrodynamics, electrokinetic flow, multiphase flow, double diffusion, etc. Knowing the initial parameters of the model and the distribution of heat and energy in the facility, you can automatically calculate the most optimal materials for the facility, select a supplier based on the selected materials and components. In the event that there is an alternative to the selected characteristics, a similar solution can also be selected.

[89] Each user additionally has an interface system, which is implemented in conjunction with the database 301 shown in FIG. 3, which includes a supplier accounts database 302 with a database 303 of materials and products offered by these suppliers, and also includes a designer accounts database 304 with an indexed virtual reality object database 305 .

[90] The supplier has access to a database of 305 virtual reality objects data through a user interface system. The supplier, in turn, associates images of products and materials, as well as relevant information about the cost of products and materials in the form of one or more records of these elements with his supplier account in the database system 301 of the database.

[91] The designer has access to a database of 303 product and material data through a user interface system.

[92] In some embodiments, a user interface system includes a web compatible interface between a remote computer and at least one processor. In one embodiment, the user interface system includes a mobile computing device. The mobile computing device connects to the network through a wireless connection. Also, the mobile computing device may include a touch screen, which includes a display and a user input interface. The user interface system may include, for example, an application that is activated by the user using the touch icon displayed on the touch screen.

[93] The virtual reality environment can also be adapted to the 3D environment of viewing virtual reality using 3D projection tools so that the user can immerse themselves in the 3D landscape created for a more complete simulated 3D reality. It is also contemplated that a 3D image in a virtual environment may contain a combined image of several virtual objects.

[94] This technical solution implies that after the virtual reality object is designed, it has access to a set of suppliers who can offer various materials and products for the designed virtual reality object for purchase.

[95] In some embodiments, it is contemplated that multiple suppliers of materials and products can access a single virtual reality object. The designer, depending on the proposals, can choose the most suitable supplier, for example, at a better price, quick delivery or specify additional requirements for the supplier.

Claims (23)

1. A system for designing objects in a virtual reality environment in real time, comprising: at least one display device configured to: display in real time at least one three-dimensional image of an object, track marker movement, receive data from a computing device, receive data from a positioning device; at least one positioning device, configured to: measure the position and orientation of at least one limb of a user, update the position of an object in a virtual reality environment and display it on a display device, receive data from a computing device; at least one data reader configured to: detect touch of a virtual object and measure the force of impact on it, provide realistic tactile feedback; at least one computing device configured to: design an object in a virtual reality environment, compare and verify data from sensors, automatically calibrate system sensors in real-world coordinates, remove statistical emissions in the coordinates of object points, filter data from sensors, create a common cloud points, unambiguously displaying the position of objects, controlling readers, positioning devices, display devices, and the above New computing device: forms an instance of virtual space; receives at least one virtual object that is displayed on the display device, the virtual object can be obtained from a virtual directory or graphic library or formed by the user from primitives on the display device in a virtual reality environment, and attributes are assigned to the created object at the design stage; receives user control commands for at least one received virtual object from the aforementioned positioning device, the control commands being generated by perceiving the user's facial expression and / or movement of the user's body and represent one or a combination of the following commands: compress the object, delete a fragment, decrease or increase object, while the object or its fragment is pre-selected the area where the object is located, it is blocked from changing other gimi users, then the user selects a tool or operation, which can be accomplished with an editable region; executes the received control commands on the virtual object for at least one virtual object; synchronizes data from system sensors; updates the data in real time, and writes the old data to the data buffer, if the coordinates of the points of the object change after making changes when the command is executed; checks the characteristics of the virtual object for compliance with the characteristics approved in the regulatory documentation for this virtual object; displays on the display device a message about the result of the check. 2. The system according to claim 1, characterized in that the display device is a virtual reality helmet (HMD), or a multi-layer display for virtual reality (CAVE), or glasses with an active shutter in combination with an on-screen display (CRT). 3. The system according to claim 1, characterized in that the data display device includes a gyroscope, and a microaccelerometer, and a magnetometer, and a positioning device. 4. The system according to claim 1, characterized in that the positioning device is a positioning sensor in space. 5. The system according to claim 1, characterized in that the data reading device is a tactile device. 6. The system according to claim 1, characterized in that the data reading device is a joystick, or a robotic device, or an exoskeleton. 7. The system according to claim 1, characterized in that the computing device receives a virtual object from a virtual directory or by forming an object from primitives on a display device. 8. The system according to claim 1, characterized in that they receive a virtual reality object from the DirectX or Open GL graphics library, or 3ds Max, or Max Cinema 4D. 9. The system according to claim 1, characterized in that the control command over the virtual object can be generated by perceiving the facial expressions of the user and / or the movement of the user's body in the real world. 10. The system according to claim 1, characterized in that the characteristics of the created virtual object are geometric, color, and include the assigned attributes. 11. The system according to claim 1, characterized in that when displaying the result of the verification of characteristics, deviations from the standard of the normative document are detected, a message about the detected deviation is displayed on the user display device.

Images