CN111192641A - System and method for user interaction in complex web 3D scene - Google Patents

System and method for user interaction in complex web 3D scene Download PDF

Info

Publication number
CN111192641A
CN111192641A CN201911327957.6A CN201911327957A CN111192641A CN 111192641 A CN111192641 A CN 111192641A CN 201911327957 A CN201911327957 A CN 201911327957A CN 111192641 A CN111192641 A CN 111192641A
Authority
CN
China
Prior art keywords
module
data
model
branch
browser
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201911327957.6A
Other languages
Chinese (zh)
Other versions
CN111192641B (en
Inventor
韩非
王炎
马健
赖力鹏
温书豪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xtalpi Inc
Original Assignee
Xtalpi Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xtalpi Inc filed Critical Xtalpi Inc
Priority to CN201911327957.6A priority Critical patent/CN111192641B/en
Publication of CN111192641A publication Critical patent/CN111192641A/en
Application granted granted Critical
Publication of CN111192641B publication Critical patent/CN111192641B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16CCOMPUTATIONAL CHEMISTRY; CHEMOINFORMATICS; COMPUTATIONAL MATERIALS SCIENCE
    • G16C20/00Chemoinformatics, i.e. ICT specially adapted for the handling of physicochemical or structural data of chemical particles, elements, compounds or mixtures
    • G16C20/20Identification of molecular entities, parts thereof or of chemical compositions
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16CCOMPUTATIONAL CHEMISTRY; CHEMOINFORMATICS; COMPUTATIONAL MATERIALS SCIENCE
    • G16C20/00Chemoinformatics, i.e. ICT specially adapted for the handling of physicochemical or structural data of chemical particles, elements, compounds or mixtures
    • G16C20/80Data visualisation

Landscapes

  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Crystallography & Structural Chemistry (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention provides a system and a method for user interaction in a complex web 3D scene, which comprise a receiving module, a transmitting module and a 3D model module; a receiving module: receiving molecular data; a transmission module: analyzing the received molecular data, and simultaneously entering two branch modules; the branching module includes: and a viewing layer unit: managing rendering of the browser and construction of the 3D model, wherein data generated by the branch can be finally displayed on a page of the browser; a data layer unit: processing 3D picking-up related business logic, and establishing a list of index information of a related model aiming at atoms, covalent bonds and the like in molecular data; a 3D model module: and a one-to-one correspondence relationship between colors and 3D models is established, and all 3D models needing to be picked up have a unique index in the data layer. The invention aims at the pickup of web 3D molecular visualization to firstly reduce the computational overhead of model data on the rendering of a display model (stick-shaped model) of a molecule.

Description

System and method for user interaction in complex web 3D scene
Technical Field
The invention belongs to the field of chemical computation, and particularly relates to a system and a method for user interaction in a complex web 3D scene.
Background
In the chemical research field, a set of standard description files aiming at molecules (mol format) and crystals (cif format) are often required to facilitate different research organizations and organizations to achieve consensus on chemical molecules or crystals with the same structure, while data in pure text formats such as cif and mol are not beneficial to researchers to visually observe the 3D structure of the corresponding chemical structure, although related 3D structure display software exists in the chemical field, the application of the clients is not beneficial to popularization, use and propagation, along with the improvement of modern browser performance and the update of web 3D technology, a 3D display and interactive web 3D tool which can run in a browser and is developed based on JavaScript programming language becomes a reality, and as a plurality of chemical molecules or crystal structures are complex, a large amount of data calculation is generated during 3D rendering, therefore, the optimization of the performance is particularly important, and the scheme aims to solve the problems of stagnation and insufficient rendering frame rate caused by time consumption of calculation on 3D molecular visualization interaction in a browser environment.
The interactive operation in the web 3D scene is to be picked up based on clicking of the object in the 3D scene at first, and the main scheme for picking up the object in the 3D scene is ray method pickup at present.
Objects rendered in the webgl rendering engine are all located in a space called a view volume. As shown in fig. 1 and 2.
Disclosure of Invention
In order to solve the above technical problems, the present invention provides a system for user interaction in a complex web 3D scene, comprising a receiving module, a transmitting module and a 3D model module;
a receiving module: receiving molecular data, mol files, cif files and custom structures containing crystal information;
a transmission module: analyzing the received molecular data, and simultaneously entering two branch modules; the branching module includes:
and a viewing layer unit: managing rendering of the browser and construction of the 3D model, wherein data generated by the branch can be finally displayed on a page of the browser;
a data layer unit: processing 3D picking-up related business logic, and establishing a list of index information of a related model aiming at atoms, covalent bonds, hydrogen bonds and flexible angles in molecular data;
a 3D model module: and a one-to-one correspondence relationship between colors and 3D models is established, and all 3D models needing to be picked up have a unique index in the data layer.
Preferably, the molecular data adopts mol files, cif files and custom structures containing crystal information.
Correspondingly, the invention provides a method for user interaction in a complex web 3D scene, which comprises the following steps:
step A, analyzing the received molecular data;
step B, simultaneously entering two branch modules, wherein the two branch modules comprise a first branch module and a second branch module, the first branch module is used as a view layer and mainly used for processing the rendering of the browser and the construction of a 3D model, and data generated by the branch can be finally displayed on a page of the browser;
step C, the second branch module is used as a data layer and is specially responsible for processing 3D picking-up related service logic, and a list of index information of related models is established for atoms, covalent bonds and the like in molecular data;
and D, establishing corresponding simplified model data in an invisible 3D scene according to requirements, and establishing a one-to-one corresponding relation between a color and the 3D model, wherein all the 3D models needing to be picked have a unique index in a data layer.
The index is a 16-ary color from #000001 to # FFFFFE, and may be marked with 16 × 16-2 units in total, without rendering on the browser page.
The invention brings the following beneficial effects:
1. this approach reduces the computational overhead of model data on the rendering of the presentation model (stick model) of the molecule first for the pick-up of web 3D molecular visualizations.
2. By establishing simplified and pickable model data of a data layer which does not need to be rendered, the 3D scene rendering overhead is reduced, and the construction of unnecessarily picked model data is avoided.
Drawings
Figure 1 is a view of a vertebral body model under perspective projection in the prior art,
fig. 2 is a view of a vertebral body model under orthogonal projection in the prior art.
Fig. 3 is a perspective projection view of a vertebral body.
The flow of the 3D pick-up scheme is shown in fig. 4
In fig. 5, L2 represents the related data of the 3D scene rendered in the browser page, corresponding to the data generated by the viewing layer in fig. 1; l1 may be considered a screen of a computer.
Fig. 6 is a cube of the lattice.
Fig. 7 is a cube of the 1x1x lattice.
Fig. 8 is a cube of a 2x2x2 lattice.
Fig. 9 is a cube of a 3x3x3 lattice.
Detailed Description
Preferred embodiments of the present invention will be described in further detail below with reference to the accompanying drawings:
example 1
The flow of the 3D picking scheme is shown in fig. 4, after receiving the molecular data (mol, cif files), the data is analyzed, and then the data enters into two branch modules simultaneously, the left branch module is used as a view layer to mainly process rendering of the browser and construction of the 3D model, the data generated by the branch will be finally presented on the page of the browser, the right branch module is used as a data layer and is specially responsible for processing 3D picking related service logic, a list of index information of related models is established for atoms, covalent bonds and the like in the molecular data, the data generated by the branch module is always operated in a memory, corresponding simplified model data is established in an invisible 3D scene according to requirements, a one-to-one correspondence relationship between a color and the 3D model is established, and all 3D models that need to be picked will have a unique index in the data layer, the index is a 16-ary color from #000001 to # FFFFFE, and may mark 16 × 16 — 2 units in total without rendering on the browser page.
Example 2
As shown in fig. 5, L2 represents the related data of the 3D scene rendered in the browser page, corresponding to the data generated by the viewing layer in fig. 4; l1 may be considered a screen of a computer. When the user clicks a point P1 on the screen, a 3D pick operation is triggered. When a user clicks a point P1 on the screen, the picking phase module obtains the screen click position of the point and constructs a temporary virtual plane, which is similar to the computer screen L1 and is a projection of 3D model data on a 2D plane, as if the sphere S1 is projected on the L1 and is represented as a circle P1, the projected 2D shape on the virtual plane takes the index of the projected 3D model as its color, for example, the index of an atom in 3D space at the picking module is #123456, that on the virtual plane temporarily constructed by the picking module, the color of the circle of the atom mapped on the plane is #123456, after the community module reads the color #123456 of the mouse position on the virtual plane, the 3D model corresponding to the position is found without calculation according to the color as index information, and the 3D object information of the point is successfully picked, in the process, a large number of calculation processes are avoided, and meanwhile, the overhead of data calculation of the picked 3D model is reduced, so that the rendering frame rate of the 3D scene is improved.
1x1x1 as shown in FIG. 7, 2x2x2 as shown in FIG. 8, and 3x3x3 as shown in FIG. 9.
Description of the drawings: the 3x3x3 lattice expansion is carried out in three directions of oa, ob and oc, and a single lattice expands to a cube consisting of 27 lattices 3x3x3, and a cube consisting of 8 lattices 2x2x 2.
Effect comparison (comparative test using structure of aspirin (aspirin)) as shown in table 1:
TABLE 1
Figure RE-GDA0002445028430000031
Description of the drawings: the 3x3x3 lattice expansion is carried out in three directions of oa, ob and oc, and a single lattice expands to a cube consisting of 27 lattices 3x3x3, and a cube consisting of 8 lattices 2x2x 2.
The foregoing is a more detailed description of the invention in connection with specific preferred embodiments and it is not intended that the invention be limited to these specific details. For those skilled in the art to which the invention pertains, several simple deductions or substitutions can be made without departing from the spirit of the invention, and all shall be considered as belonging to the protection scope of the invention.

Claims (3)

1. A system for user interaction in a complex web 3D scene is characterized by comprising a receiving module, a transmitting module and a 3D model module;
a receiving module: receiving molecular data;
a transmission module: analyzing the received molecular data, and simultaneously entering two branch modules;
the branching module includes:
and a viewing layer unit: managing rendering of the browser and construction of the 3D model, wherein data generated by the branch can be finally displayed on a page of the browser;
a data layer unit: processing 3D picking-up related business logic, and establishing a list of index information of a related model aiming at atoms, covalent bonds and the like in molecular data;
a 3D model module: and a one-to-one correspondence relationship between colors and 3D models is established, and all 3D models needing to be picked up have a unique index in the data layer.
2. A method for user interaction in a complex web 3D scenario as claimed in claim 1, comprising the steps of:
step A, analyzing the received molecular data;
step B, simultaneously entering two branch modules, wherein the two branch modules comprise a first branch module and a second branch module, the first branch module is used as a view layer and mainly used for processing the rendering of the browser and the construction of a 3D model, and data generated by the branch can be finally displayed on a page of the browser;
step C, the second branch module is used as a data layer and is specially responsible for processing 3D picking-up related service logic, and a list of index information of related models is established for atoms, covalent bonds and the like in molecular data;
and D, establishing corresponding simplified model data in an invisible 3D scene according to requirements, and establishing a one-to-one corresponding relation between a color and the 3D model, wherein all the 3D models needing to be picked have a unique index in a data layer.
3. The method of claim 2, wherein the index is a 16-ary color from #000001 to # FFFFFE, which may be marked with 16 x 16-2 units in total, without rendering on the browser page.
CN201911327957.6A 2019-12-20 2019-12-20 System and method for user interaction in complex web 3D scene Active CN111192641B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911327957.6A CN111192641B (en) 2019-12-20 2019-12-20 System and method for user interaction in complex web 3D scene

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911327957.6A CN111192641B (en) 2019-12-20 2019-12-20 System and method for user interaction in complex web 3D scene

Publications (2)

Publication Number Publication Date
CN111192641A true CN111192641A (en) 2020-05-22
CN111192641B CN111192641B (en) 2023-06-23

Family

ID=70710984

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911327957.6A Active CN111192641B (en) 2019-12-20 2019-12-20 System and method for user interaction in complex web 3D scene

Country Status (1)

Country Link
CN (1) CN111192641B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112068715A (en) * 2020-08-28 2020-12-11 深圳晶泰科技有限公司 Handheld crystal interaction device, crystal interaction system and method
CN112086147A (en) * 2020-09-22 2020-12-15 中山大学 WebGL-based three-dimensional crystal structure visualization method
CN112184870A (en) * 2020-10-13 2021-01-05 成都智鑫易利科技有限公司 Three-dimensional object picking method for three-dimensional graphic software
WO2021004020A1 (en) * 2019-12-20 2021-01-14 深圳晶泰科技有限公司 System and method for use in user interaction in complex web3d scene
WO2022041108A1 (en) * 2020-08-28 2022-03-03 深圳晶泰科技有限公司 Handheld crystal interaction device, and crystal interaction system and method

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102609246A (en) * 2011-01-21 2012-07-25 中国科学院计算机网络信息中心 Grid-based computational chemistry application integrated system
CN102609604A (en) * 2011-01-21 2012-07-25 中国科学院计算机网络信息中心 Grid-based computational chemistry visualization system and control method
CN103077239A (en) * 2013-01-10 2013-05-01 上海电力学院 IFrame embedded Web3D (Web three-dimensional) system based on cloud rendering
CN104571527A (en) * 2015-01-26 2015-04-29 华东理工大学 AR (augmented reality) technique-based 3D (three-dimensional) molecule interactive docking system and implementing method
CN105354872A (en) * 2015-11-04 2016-02-24 深圳墨麟科技股份有限公司 Rendering engine, implementation method and producing tools for 3D web game
CN107247548A (en) * 2017-05-31 2017-10-13 腾讯科技(深圳)有限公司 Method for displaying image, image processing method and device
CN108074274A (en) * 2017-12-26 2018-05-25 深圳拎得清软件有限公司 BIM model real-time rendering method and devices based on browser
CN108415696A (en) * 2018-02-09 2018-08-17 上海九辛信息技术有限公司 Distributed web services architecture design method
CN109658992A (en) * 2018-12-20 2019-04-19 广州市爱菩新医药科技有限公司 A kind of chemical structure method for drafting based on Web
CN110209974A (en) * 2019-05-29 2019-09-06 深圳图为技术有限公司 A kind of method and apparatus browsing threedimensional model

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102609246A (en) * 2011-01-21 2012-07-25 中国科学院计算机网络信息中心 Grid-based computational chemistry application integrated system
CN102609604A (en) * 2011-01-21 2012-07-25 中国科学院计算机网络信息中心 Grid-based computational chemistry visualization system and control method
CN103077239A (en) * 2013-01-10 2013-05-01 上海电力学院 IFrame embedded Web3D (Web three-dimensional) system based on cloud rendering
CN104571527A (en) * 2015-01-26 2015-04-29 华东理工大学 AR (augmented reality) technique-based 3D (three-dimensional) molecule interactive docking system and implementing method
CN105354872A (en) * 2015-11-04 2016-02-24 深圳墨麟科技股份有限公司 Rendering engine, implementation method and producing tools for 3D web game
CN107247548A (en) * 2017-05-31 2017-10-13 腾讯科技(深圳)有限公司 Method for displaying image, image processing method and device
CN108074274A (en) * 2017-12-26 2018-05-25 深圳拎得清软件有限公司 BIM model real-time rendering method and devices based on browser
CN108415696A (en) * 2018-02-09 2018-08-17 上海九辛信息技术有限公司 Distributed web services architecture design method
CN109658992A (en) * 2018-12-20 2019-04-19 广州市爱菩新医药科技有限公司 A kind of chemical structure method for drafting based on Web
CN110209974A (en) * 2019-05-29 2019-09-06 深圳图为技术有限公司 A kind of method and apparatus browsing threedimensional model

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021004020A1 (en) * 2019-12-20 2021-01-14 深圳晶泰科技有限公司 System and method for use in user interaction in complex web3d scene
US11562549B2 (en) 2019-12-20 2023-01-24 Shenzhen Jingtai Technology Co., Ltd. System and method for user interaction in complex web 3D scenes
CN112068715A (en) * 2020-08-28 2020-12-11 深圳晶泰科技有限公司 Handheld crystal interaction device, crystal interaction system and method
WO2022041108A1 (en) * 2020-08-28 2022-03-03 深圳晶泰科技有限公司 Handheld crystal interaction device, and crystal interaction system and method
CN112086147A (en) * 2020-09-22 2020-12-15 中山大学 WebGL-based three-dimensional crystal structure visualization method
WO2022062018A1 (en) * 2020-09-22 2022-03-31 中山大学 Three-dimensional crystal structure visualization method based on webgl
CN112086147B (en) * 2020-09-22 2023-11-03 中山大学 Three-dimensional crystal structure visualization method based on WebGL
CN112184870A (en) * 2020-10-13 2021-01-05 成都智鑫易利科技有限公司 Three-dimensional object picking method for three-dimensional graphic software
CN112184870B (en) * 2020-10-13 2023-11-03 成都智鑫易利科技有限公司 Three-dimensional object pickup method for three-dimensional graphics software

Also Published As

Publication number Publication date
CN111192641B (en) 2023-06-23

Similar Documents

Publication Publication Date Title
CN111192641B (en) System and method for user interaction in complex web 3D scene
CN106846497B (en) Method and device for presenting three-dimensional map applied to terminal
CN110457414B (en) Offline map processing and virtual object display method, device, medium and equipment
JP2022524891A (en) Image processing methods and equipment, electronic devices and computer programs
US5768447A (en) Method for indexing image information using a reference model
CN106383965A (en) Three-dimensional numerical atmospheric visual support system
CN107491174A (en) Method, apparatus, system and electronic equipment for remote assistance
CN105321142B (en) Sampling, mistake manages and/or the context switching carried out via assembly line is calculated
CN105892643A (en) Multi-interface unified display system and method based on virtual reality
CN107566793A (en) Method, apparatus, system and electronic equipment for remote assistance
CN110120087B (en) Label marking method and device for three-dimensional virtual sand table and terminal equipment
US20130257686A1 (en) Distributed virtual reality
CN111882632A (en) Rendering method, device and equipment of ground surface details and storage medium
CN111177167B (en) Augmented reality map updating method, device, system, storage and equipment
CN110096134B (en) VR handle ray jitter correction method, device, terminal and medium
CN204406423U (en) The augmented reality recognition device that a kind of image and Quick Response Code combine
CN112017304B (en) Method, apparatus, electronic device and medium for presenting augmented reality data
US11562549B2 (en) System and method for user interaction in complex web 3D scenes
KR102176805B1 (en) System and method for providing virtual reality contents indicated view direction
CN112565883A (en) Video rendering processing system and computer equipment for virtual reality scene
CN110119199B (en) Tracking system, method and non-transitory computer readable medium for real-time rendering of images
CN109816791B (en) Method and apparatus for generating information
CN112667137B (en) Switching display method and device for house type graph and house three-dimensional model
CN115619986A (en) Scene roaming method, device, equipment and medium
CN110378904A (en) The method and apparatus that point cloud data is split

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 3 / F, Shunfeng industrial building, No.2 Hongliu Road, Fubao community, Fubao street, Futian District, Shenzhen City, Guangdong Province

Applicant after: Shenzhen Jingtai Technology Co.,Ltd.

Address before: 518000 4th floor, No.9 Hualian Industrial Zone, Xinshi community, Dalang street, Longhua District, Shenzhen City, Guangdong Province

Applicant before: Shenzhen Jingtai Technology Co.,Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant