CN111192641B - System and method for user interaction in complex web 3D scene - Google Patents

System and method for user interaction in complex web 3D scene Download PDF

Info

Publication number
CN111192641B
CN111192641B CN201911327957.6A CN201911327957A CN111192641B CN 111192641 B CN111192641 B CN 111192641B CN 201911327957 A CN201911327957 A CN 201911327957A CN 111192641 B CN111192641 B CN 111192641B
Authority
CN
China
Prior art keywords
data
module
model
branch
browser
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911327957.6A
Other languages
Chinese (zh)
Other versions
CN111192641A (en
Inventor
韩非
王炎
马健
赖力鹏
温书豪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Jingtai Technology Co Ltd
Original Assignee
Shenzhen Jingtai Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Jingtai Technology Co Ltd filed Critical Shenzhen Jingtai Technology Co Ltd
Priority to CN201911327957.6A priority Critical patent/CN111192641B/en
Publication of CN111192641A publication Critical patent/CN111192641A/en
Application granted granted Critical
Publication of CN111192641B publication Critical patent/CN111192641B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16CCOMPUTATIONAL CHEMISTRY; CHEMOINFORMATICS; COMPUTATIONAL MATERIALS SCIENCE
    • G16C20/00Chemoinformatics, i.e. ICT specially adapted for the handling of physicochemical or structural data of chemical particles, elements, compounds or mixtures
    • G16C20/20Identification of molecular entities, parts thereof or of chemical compositions
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16CCOMPUTATIONAL CHEMISTRY; CHEMOINFORMATICS; COMPUTATIONAL MATERIALS SCIENCE
    • G16C20/00Chemoinformatics, i.e. ICT specially adapted for the handling of physicochemical or structural data of chemical particles, elements, compounds or mixtures
    • G16C20/80Data visualisation

Landscapes

  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Crystallography & Structural Chemistry (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention provides a system and a method for user interaction in a complex web 3D scene, wherein the system comprises a receiving module, a transmitting module and a 3D model module; and a receiving module: receiving molecular data; and a transmission module: analyzing the received molecular data, and then entering two branch modules at the same time; the branching module includes: view layer unit: processing the rendering of the browser and the construction of a 3D model, wherein data generated by the branch can be finally presented on a page of the browser; data layer unit: processing 3D pick-up related business logic, and establishing a list of index information of a related model aiming at atoms, covalent bonds and the like in molecular data; 3D model module: and a one-to-one correspondence between colors and 3D models is established, and all 3D models to be picked up have a unique index in the data layer. The invention aims at the calculation cost of model data on which a model (stick-shaped model) of a first simplified molecule is less rendered aiming at the pick-up of web 3D molecular visualization.

Description

System and method for user interaction in complex web 3D scene
Technical Field
The invention belongs to the field of chemical computation, and particularly relates to a system and a method for user interaction in a complex web 3D scene.
Background
In the field of chemical research, a set of standard description files aiming at molecules (mol format) and crystals (cif format) are often needed to facilitate different research organizations and institutions to realize consensus on chemical molecules or crystals of the same structure, while data in cif, mol and other plain text formats is unfavorable for researchers to intuitively observe 3D structures of corresponding chemical structures, although related 3D structure display software exists in the chemical field, application of the clients is unfavorable for popularization and use and propagation, with the improvement of the performance of modern browsers and the update of web 3D technology, 3D display and interactive web 3D tools which can be operated in the browsers based on development of JavaScript programming language become reality, because a large number of data calculation can be generated when 3D rendering is carried out due to the complexity of a plurality of chemical molecules or crystal structures, the scheme is particularly important for optimizing the performance, and aims to solve the problems of insufficient rendering and seizing caused by time-consuming calculation on 3D molecule visual interaction in the browser environment.
The current interaction operation in the web 3D scene is to pick up based on clicking of objects in the 3D scene, and the main scheme for picking up objects in the 3D scene is to pick up by using a ray method.
The objects rendered in the webgl rendering engine are all located in a space called the cone. As shown in fig. 1 and 2.
Disclosure of Invention
In order to solve the technical problems, the invention provides a system for user interaction in a complex web 3D scene, which comprises a receiving module, a transmitting module and a 3D model module;
and a receiving module: receiving molecular data, mol files, cif files and custom structures containing crystal information;
and a transmission module: analyzing the received molecular data, and then entering two branch modules at the same time; the branching module includes:
view layer unit: processing the rendering of the browser and the construction of a 3D model, wherein data generated by the branch can be finally presented on a page of the browser;
data layer unit: processing 3D pick-up related business logic, and establishing a list of index information of a related model aiming at atoms, covalent bonds, hydrogen bonds and flexible angles in molecular data;
3D model module: and a one-to-one correspondence between colors and 3D models is established, and all 3D models to be picked up have a unique index in the data layer.
Preferably, the molecular data adopts mol file, cif file and custom structure containing crystal information.
Correspondingly, the invention provides a method for user interaction in a complex web 3D scene, which comprises the following steps:
step A, after receiving the molecular data, analyzing according to the molecular data;
step B, two branch modules are simultaneously entered after that, the two branch modules comprise a first branch module and a second branch module, the first branch module is used as a view layer and mainly processes the rendering of a browser and the construction of a 3D model, and data generated by the branches are finally presented on a page of the browser;
step C, the second branch module is used as a data layer and is specially responsible for processing service logic related to 3D pickup, and a list of index information of related models is established aiming at atoms, covalent bonds and the like in molecular data;
and D, establishing corresponding simplified model data in an invisible 3D scene according to the requirements, and establishing a one-to-one correspondence between colors and the 3D models, wherein all the 3D models to be picked up have a unique index in a data layer.
Wherein the index is a 16-ary color, ranging from #000001 to # FFFFFE, the total may be marked 16 x 16-2 units without rendering on the page of the browser.
The invention has the following beneficial effects:
1. the solution aims at picking up model data on which a model (stick-shaped model) of a first simplified molecule of web 3D molecular visualization is less in computational overhead of rendering.
2. By establishing simplified and pickable model data of a data layer which does not need to be rendered, the cost of 3D scene rendering is reduced, and the construction of the model data which does not need to be picked up is avoided.
Drawings
Figure 1 is a prior art perspective view cone model,
fig. 2 is a prior art view cone model under orthogonal projection.
Fig. 3 is a perspective projection view of a vertebral body.
The flow of the 3D pick-up scheme is shown in fig. 4
In fig. 5, L2 represents related data of a 3D scene rendered in a browser page, corresponding to data generated by the view layer in fig. 1; l1 may be considered the screen of the computer.
Fig. 6 is a cube of a lattice.
Fig. 7 is a cube of a 1x1x lattice.
Fig. 8 is a cube of a 2x2x2 lattice.
Fig. 9 is a cube of a 3x3x3 lattice.
Detailed Description
Preferred embodiments of the present invention will be described in further detail below with reference to the attached drawings:
example 1
In fig. 4, the flow of the 3D pick-up scheme is shown, after molecular data (mol, cif files) are received, the data are parsed, then two branch modules are simultaneously entered, the left branch module is used as a view layer, the rendering of the browser and the construction of the 3D model are mainly processed, the data generated by the branch are finally presented on the page of the browser, the right branch module is used as a data layer, the service logic related to 3D pick-up is specially processed, a list of index information of related models is established for atoms, covalent bonds and the like in the molecular data, the data generated by the branching module always operates in the memory, corresponding simplified model data is built in an invisible 3D scene according to the requirement, a one-to-one correspondence relationship between colors and 3D models is built, all 3D models to be picked up have a unique index in the data layer, the index is a 16-system color, and from #000001 to # FFFFFE, 16 x 16-2 units can be marked in total, and the data cannot be rendered on a page of a browser.
Example 2
As shown in fig. 5, L2 represents related data of a 3D scene rendered in a browser page, corresponding to the data generated by the view layer in fig. 4; l1 may be considered the screen of the computer. When the user clicks on a point P1 on the screen, a 3D pick-up operation is triggered. When a user clicks a point P1 on the screen, the pick-up phase module obtains the screen click position of the point, and constructs a temporary virtual plane, which is similar to the computer screen L1, and is the projection of 3D model data on the 2D plane, as if the sphere S1 is projected on the L1 to represent a circle P1, the projected 2D shape on the virtual plane takes the index of the 3D model projected on the virtual plane as its own color, for example, the index of an atom in the 3D space on the pick-up module is #123456, the color of the circle mapped on the plane on the virtual plane is #123456, and after the community module reads the color #123456 of the mouse position on the virtual plane, the 3D model corresponding to the position is found without calculation according to the color as index information, so that the 3D object information of the point is successfully picked up, a great amount of calculation processes are avoided in the process, and the overhead of data calculation of the 3D model not required to be picked up is reduced, so that the rendering frame rate of the 3D scene is improved.
1x1x1 as shown in fig. 7, 2x2x2 as shown in fig. 8, and 3x3x3 as shown in fig. 9.
Description: the 3x3x3 lattice expansion is performed in the directions oa, ob and oc, and a single lattice is expanded into a cube composed of 3x3x 3=27 lattices, and 2x2x2 is expanded into a cube with 8 single lattices.
Effect comparison (comparison test using aspirin (aspirin) structure) is shown in table 1:
TABLE 1
Figure GDA0002445028430000031
Description: the 3x3x3 lattice expansion is performed in the directions oa, ob and oc, and a single lattice is expanded into a cube composed of 3x3x 3=27 lattices, and 2x2x2 is expanded into a cube with 8 single lattices.
The foregoing is a further detailed description of the invention in connection with the preferred embodiments, and it is not intended that the invention be limited to the specific embodiments described. It will be apparent to those skilled in the art that several simple deductions or substitutions may be made without departing from the spirit of the invention, and these should be considered to be within the scope of the invention.

Claims (3)

1. A system for user interaction in a complex web 3D scene, comprising a receiving module, a transmitting module and a 3D model module;
and a receiving module: receiving molecular data;
and a transmission module: analyzing the received molecular data, and then entering two branch modules at the same time;
the branching module includes:
view layer unit: processing the rendering of the browser and the construction of the 3D model, wherein the data generated by the branch can be finally presented on the page of the browser;
data layer unit: processing 3D pick-up related business logic, and establishing a list of index information of a related model aiming at atoms, covalent bonds, hydrogen bonds and flexible angles in molecular data;
3D model module: for establishing a one-to-one correspondence between colors and 3D models, all 3D models that need to be picked up will have a unique index in the data layer.
2. A method for user interaction in a complex web 3D scene as claimed in claim 1, comprising the steps of:
step A, after receiving the molecular data, analyzing according to the molecular data;
step B, two branch modules are simultaneously entered after that, the two branch modules comprise a first branch module and a second branch module, the first branch module is used as a view layer and mainly processes the rendering of a browser and the construction of a 3D model, and data generated by the branches are finally presented on a page of the browser;
step C, the second branch module is used as a data layer and is specially responsible for processing service logic related to 3D pickup, and a list of index information of related models is established aiming at atoms, covalent bonds, hydrogen bonds and flexible angles in molecular data;
and D, establishing corresponding simplified model data in an invisible 3D scene according to the requirements, establishing a one-to-one correspondence relationship between colors and 3D models, wherein all 3D models to be picked up have a unique index in a data layer.
3. The method of claim 2 wherein the index is a 16-ary color, which from #000001 to #fffffe can total 16 x 16-2 units without rendering on the browser page.
CN201911327957.6A 2019-12-20 2019-12-20 System and method for user interaction in complex web 3D scene Active CN111192641B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911327957.6A CN111192641B (en) 2019-12-20 2019-12-20 System and method for user interaction in complex web 3D scene

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911327957.6A CN111192641B (en) 2019-12-20 2019-12-20 System and method for user interaction in complex web 3D scene

Publications (2)

Publication Number Publication Date
CN111192641A CN111192641A (en) 2020-05-22
CN111192641B true CN111192641B (en) 2023-06-23

Family

ID=70710984

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911327957.6A Active CN111192641B (en) 2019-12-20 2019-12-20 System and method for user interaction in complex web 3D scene

Country Status (1)

Country Link
CN (1) CN111192641B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021004020A1 (en) * 2019-12-20 2021-01-14 深圳晶泰科技有限公司 System and method for use in user interaction in complex web3d scene
WO2022041108A1 (en) * 2020-08-28 2022-03-03 深圳晶泰科技有限公司 Handheld crystal interaction device, and crystal interaction system and method
CN112068715A (en) * 2020-08-28 2020-12-11 深圳晶泰科技有限公司 Handheld crystal interaction device, crystal interaction system and method
CN112086147B (en) * 2020-09-22 2023-11-03 中山大学 Three-dimensional crystal structure visualization method based on WebGL
CN112184870B (en) * 2020-10-13 2023-11-03 成都智鑫易利科技有限公司 Three-dimensional object pickup method for three-dimensional graphics software

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102609246A (en) * 2011-01-21 2012-07-25 中国科学院计算机网络信息中心 Grid-based computational chemistry application integrated system
CN102609604A (en) * 2011-01-21 2012-07-25 中国科学院计算机网络信息中心 Grid-based computational chemistry visualization system and control method
CN103077239A (en) * 2013-01-10 2013-05-01 上海电力学院 IFrame embedded Web3D (Web three-dimensional) system based on cloud rendering
CN104571527A (en) * 2015-01-26 2015-04-29 华东理工大学 AR (augmented reality) technique-based 3D (three-dimensional) molecule interactive docking system and implementing method
CN105354872A (en) * 2015-11-04 2016-02-24 深圳墨麟科技股份有限公司 Rendering engine, implementation method and producing tools for 3D web game
CN107247548A (en) * 2017-05-31 2017-10-13 腾讯科技(深圳)有限公司 Method for displaying image, image processing method and device
CN108074274A (en) * 2017-12-26 2018-05-25 深圳拎得清软件有限公司 BIM model real-time rendering method and devices based on browser
CN108415696A (en) * 2018-02-09 2018-08-17 上海九辛信息技术有限公司 Distributed web services architecture design method
CN109658992A (en) * 2018-12-20 2019-04-19 广州市爱菩新医药科技有限公司 A kind of chemical structure method for drafting based on Web
CN110209974A (en) * 2019-05-29 2019-09-06 深圳图为技术有限公司 A kind of method and apparatus browsing threedimensional model

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102609246A (en) * 2011-01-21 2012-07-25 中国科学院计算机网络信息中心 Grid-based computational chemistry application integrated system
CN102609604A (en) * 2011-01-21 2012-07-25 中国科学院计算机网络信息中心 Grid-based computational chemistry visualization system and control method
CN103077239A (en) * 2013-01-10 2013-05-01 上海电力学院 IFrame embedded Web3D (Web three-dimensional) system based on cloud rendering
CN104571527A (en) * 2015-01-26 2015-04-29 华东理工大学 AR (augmented reality) technique-based 3D (three-dimensional) molecule interactive docking system and implementing method
CN105354872A (en) * 2015-11-04 2016-02-24 深圳墨麟科技股份有限公司 Rendering engine, implementation method and producing tools for 3D web game
CN107247548A (en) * 2017-05-31 2017-10-13 腾讯科技(深圳)有限公司 Method for displaying image, image processing method and device
CN108074274A (en) * 2017-12-26 2018-05-25 深圳拎得清软件有限公司 BIM model real-time rendering method and devices based on browser
CN108415696A (en) * 2018-02-09 2018-08-17 上海九辛信息技术有限公司 Distributed web services architecture design method
CN109658992A (en) * 2018-12-20 2019-04-19 广州市爱菩新医药科技有限公司 A kind of chemical structure method for drafting based on Web
CN110209974A (en) * 2019-05-29 2019-09-06 深圳图为技术有限公司 A kind of method and apparatus browsing threedimensional model

Also Published As

Publication number Publication date
CN111192641A (en) 2020-05-22

Similar Documents

Publication Publication Date Title
CN111192641B (en) System and method for user interaction in complex web 3D scene
CN106846497B (en) Method and device for presenting three-dimensional map applied to terminal
US8194101B1 (en) Dynamic perspective video window
CN1093659C (en) Method for displaying information in virtual reality environment
JP2022524891A (en) Image processing methods and equipment, electronic devices and computer programs
CN107491174A (en) Method, apparatus, system and electronic equipment for remote assistance
CN106383965A (en) Three-dimensional numerical atmospheric visual support system
CN105892643A (en) Multi-interface unified display system and method based on virtual reality
CN105321142B (en) Sampling, mistake manages and/or the context switching carried out via assembly line is calculated
CN109920056B (en) Building rendering method, device, equipment and medium
CN111860167A (en) Face fusion model acquisition and face fusion method, device and storage medium
US20220358735A1 (en) Method for processing image, device and storage medium
US20130257686A1 (en) Distributed virtual reality
CN111177167B (en) Augmented reality map updating method, device, system, storage and equipment
CN115861498A (en) Redirection method and device for motion capture
CN204406423U (en) The augmented reality recognition device that a kind of image and Quick Response Code combine
US11562549B2 (en) System and method for user interaction in complex web 3D scenes
KR102176805B1 (en) System and method for providing virtual reality contents indicated view direction
CN109816791B (en) Method and apparatus for generating information
CN111652831B (en) Object fusion method and device, computer-readable storage medium and electronic equipment
CN112667137B (en) Switching display method and device for house type graph and house three-dimensional model
CN112132938B (en) Model element deformation processing and picture rendering method, device, equipment and medium
CN115619986A (en) Scene roaming method, device, equipment and medium
CN110430417B (en) Multi-view stereoscopic image generation method and device, computer equipment and storage medium
Dewberry et al. Problems and Solutions of Point Cloud Mapping for VR and CAVE Environments for Data Visualization and Physics Simulation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 3 / F, Shunfeng industrial building, No.2 Hongliu Road, Fubao community, Fubao street, Futian District, Shenzhen City, Guangdong Province

Applicant after: Shenzhen Jingtai Technology Co.,Ltd.

Address before: 518000 4th floor, No.9 Hualian Industrial Zone, Xinshi community, Dalang street, Longhua District, Shenzhen City, Guangdong Province

Applicant before: Shenzhen Jingtai Technology Co.,Ltd.

GR01 Patent grant
GR01 Patent grant