CN111667906B - Eyeball structure virtual teaching system and digital model building method thereof - Google Patents
Eyeball structure virtual teaching system and digital model building method thereof Download PDFInfo
- Publication number
- CN111667906B CN111667906B CN202010541563.7A CN202010541563A CN111667906B CN 111667906 B CN111667906 B CN 111667906B CN 202010541563 A CN202010541563 A CN 202010541563A CN 111667906 B CN111667906 B CN 111667906B
- Authority
- CN
- China
- Prior art keywords
- eyeball
- module
- model
- data
- dimensional
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 210000005252 bulbus oculi Anatomy 0.000 title claims abstract description 138
- 238000000034 method Methods 0.000 title claims abstract description 35
- 230000036541 health Effects 0.000 claims abstract description 30
- 238000000547 structure data Methods 0.000 claims abstract description 16
- 230000036285 pathological change Effects 0.000 claims abstract description 15
- 231100000915 pathological change Toxicity 0.000 claims abstract description 15
- 208000030533 eye disease Diseases 0.000 claims abstract description 11
- 210000001508 eye Anatomy 0.000 claims description 23
- 238000003384 imaging method Methods 0.000 claims description 23
- 230000000694 effects Effects 0.000 claims description 20
- 238000004519 manufacturing process Methods 0.000 claims description 18
- 238000009877 rendering Methods 0.000 claims description 18
- 230000002265 prevention Effects 0.000 claims description 15
- 230000004379 myopia Effects 0.000 claims description 14
- 208000001491 myopia Diseases 0.000 claims description 14
- 239000000463 material Substances 0.000 claims description 13
- 230000008569 process Effects 0.000 claims description 10
- 238000004088 simulation Methods 0.000 claims description 8
- 210000004087 cornea Anatomy 0.000 claims description 7
- 210000000695 crystalline len Anatomy 0.000 claims description 7
- 239000011521 glass Substances 0.000 claims description 6
- 210000001742 aqueous humor Anatomy 0.000 claims description 5
- 210000004127 vitreous body Anatomy 0.000 claims description 5
- 230000004927 fusion Effects 0.000 claims description 4
- 230000003902 lesion Effects 0.000 description 9
- 238000012937 correction Methods 0.000 description 5
- 201000010099 disease Diseases 0.000 description 5
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 5
- 210000001525 retina Anatomy 0.000 description 5
- 230000001886 ciliary effect Effects 0.000 description 4
- 210000003205 muscle Anatomy 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000013480 data collection Methods 0.000 description 3
- 230000004436 pseudomyopia Effects 0.000 description 3
- 238000003860 storage Methods 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 201000009487 Amblyopia Diseases 0.000 description 2
- 206010020675 Hypermetropia Diseases 0.000 description 2
- 241000219095 Vitis Species 0.000 description 2
- 235000009754 Vitis X bourquina Nutrition 0.000 description 2
- 235000012333 Vitis X labruscana Nutrition 0.000 description 2
- 235000014787 Vitis vinifera Nutrition 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000005520 cutting process Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000001125 extrusion Methods 0.000 description 2
- 201000006318 hyperopia Diseases 0.000 description 2
- 230000004305 hyperopia Effects 0.000 description 2
- 230000001788 irregular Effects 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000007170 pathology Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 210000003786 sclera Anatomy 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000006806 disease prevention Effects 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 239000012528 membrane Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000001575 pathological effect Effects 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 230000000284 resting effect Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—3D [Three Dimensional] animation
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/50—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for simulation or modelling of medical disorders
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Public Health (AREA)
- Medical Informatics (AREA)
- Primary Health Care (AREA)
- Epidemiology (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Geometry (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Computer Graphics (AREA)
- Radiology & Medical Imaging (AREA)
- Software Systems (AREA)
- Biomedical Technology (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Pathology (AREA)
- Processing Or Creating Images (AREA)
- Instructional Devices (AREA)
Abstract
The invention discloses an eyeball structure virtual teaching system, which comprises: the eyeball structure data acquisition module is used for acquiring or importing eyeball structure data; the medical data module is used for storing or updating health and pathological change data related to eyeballs; the digital model module is used for generating a three-dimensional eyeball structure model according to eyeball structure data and health and pathological change data; the control module is used for generating a control instruction; and the holographic equipment module is used for playing the three-dimensional eyeball structural model according to the control instruction. According to the invention, different ophthalmic models can be manufactured in real time according to different eye diseases, so that different eyeball models can be displayed conveniently and the popularization and teaching of ophthalmology can be realized. The invention also discloses a model building method for the eyeball structure virtual teaching system.
Description
Technical Field
The invention relates to the field of virtual teaching systems, in particular to an eyeball structure virtual teaching system and a digital model building method thereof.
Background
The eye teaching aid physical model expresses the eyeball structure in a physical mode, so that teaching activities are more visual and are beneficial to understanding. However, the physical model is complicated to manufacture, so that the price of the physical model is high and the physical model is difficult to popularize. Meanwhile, the size of the help effect of the physical model on teaching depends on the fineness of the physical model and whether the internal structure can be displayed after being disassembled. Even though the physical model is manufactured finely, the defects that how to display the pathological change process, how to cooperate with the explanation content and how to carry out corresponding teaching on each structure in the physical model are caused, the educated person is hard to understand, the repeated work of the educated person is more and the like are also caused. These disadvantages have hampered the development of eye science popularization and teaching.
Disclosure of Invention
To solve the above technical problems, an embodiment of an aspect of the present invention provides an eyeball structure virtual teaching system, including:
the eyeball structure data acquisition module is used for acquiring or importing eyeball structure data;
the medical data module is used for storing or updating health and pathological change data related to eyeballs;
the digital model module is used for generating a three-dimensional eyeball structure model according to eyeball structure data and health and pathological change data;
the control module is used for generating a control instruction;
and the holographic equipment module is used for playing the three-dimensional eyeball structural model according to the control instruction.
By adopting the technical scheme, different ophthalmic models can be manufactured in real time according to different eye diseases, so that different eyeball models can be conveniently displayed and the general teaching of the eye is convenient.
Further, the lesion data includes a myopic process of the eyeball.
Further, the three-dimensional eyeball structural model is a combination of pictures, audio and video.
Further, the method further comprises the following steps: and the remote control module is used for acquiring the operation information of the user and transmitting the operation information to the control module.
Further, the method further comprises the following steps: the voice module comprises a voice characteristic model library and a voice data acquisition module, wherein the voice characteristic model library is used for storing voice characteristic models corresponding to the three-dimensional eyeball structural model and medical data, the voice data acquisition module is used for acquiring and identifying voice data, comparing and matching the acquired voice data with the voice characteristic models, and transmitting a matching result to the control module.
Further, the method further comprises the following steps: the service module comprises a prevention module and an experience module, wherein the prevention module is used for introducing basic information and prevention knowledge of various eye diseases, and the experience module provides an eye treatment simulation scene.
An embodiment of another aspect of the present invention provides a digital model building method for an eyeball structure virtual teaching system, including the steps of:
collecting or importing the eyeball structure data;
storing or updating health and pathology data associated with the eyeball;
generating a three-dimensional eyeball structure model according to the stored eyeball structure data and the health and pathological change data;
matching the animation deduction video to a three-dimensional eyeball structural model according to equipment parameters of the holographic image equipment;
manufacturing a virtual map, virtual lamplight and a special effect, and importing the virtual map, the virtual lamplight and the special effect into holographic imaging equipment to render a three-dimensional eyeball structural model;
acquiring operation information of a user and generating a control instruction;
and playing the three-dimensional eyeball structural model according to the control instruction.
Further, the method further comprises the following steps: inputting a logic control operation method, and setting the holographic image equipment and the remote control module to realize the matching of the holographic image equipment and the remote control module.
Further, the method further comprises the following steps: and adjusting the material of the three-dimensional eyeball structural model.
Drawings
Fig. 1 is a schematic structural diagram of an eyeball structure virtual teaching system according to an embodiment of an aspect of the present invention;
fig. 2 is a schematic structural diagram of an eyeball structure virtual teaching system according to another embodiment of an aspect of the present invention;
FIG. 3 is a flow chart of a method for creating a digital model for an eye structure virtual teaching system according to another embodiment of the present invention;
FIG. 4 is a flow chart of a method for creating a digital model for an eye structure virtual teaching system according to another embodiment of another aspect of the present invention;
fig. 5 is a flowchart of a digital model building method for an eyeball structure virtual teaching system according to another embodiment of the present invention.
Reference numerals:
an eyeball structural data collection module 100;
a medical data module 200;
a digital model module 300;
a control module 400;
a holographic device module 500;
a remote control module 600;
a voice module 700;
a speech feature model library 701;
a voice data acquisition module 702;
a service module 800;
a prevention module 801;
experience module 802.
Detailed Description
Further advantages and effects of the present invention will become apparent to those skilled in the art from the disclosure of the present specification, by describing the embodiments of the present invention with specific examples. While the description of the invention will be described in connection with the preferred embodiments, it is not intended to limit the inventive features to the implementation. Rather, the purpose of the invention described in connection with the embodiments is to cover other alternatives or modifications, which may be extended by the claims based on the invention. The following description contains many specific details for the purpose of providing a thorough understanding of the present invention. The invention may be practiced without these specific details. Furthermore, some specific details are omitted from the description in order to avoid obscuring the invention. It should be noted that, without conflict, the embodiments of the present invention and features of the embodiments may be combined with each other.
It should be noted that in this specification, like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further definition or explanation thereof is necessary in the following figures.
For the purpose of making the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in further detail below with reference to the accompanying drawings.
The ophthalmic teaching aid model expresses the causative process of eye diseases in a physical model mode, however, the physical model is complicated to manufacture, the causative process of the diseases is difficult to explain through the physical model, and meanwhile, the ophthalmic teaching aid model can only demonstrate the formation details of the diseases which cannot be displayed in a face-to-face manner in a fixed causative process of the diseases.
The system can be used for loading eyeball model structure data, and can be expanded at any time according to specific requirements to develop and establish a high-quality three-dimensional eyeball model. Different from a common eyeball model, the three-dimensional eyeball structural model established by the invention more finely presents eyeball structural materials. Using various hardware and software such as: maya, 3dsMax, afterEffect and the like, and performing animation production, data acquisition and repair on the three-dimensional eyeball structural model to form a complete three-dimensional eyeball structural model.
As shown in fig. 1, an embodiment of an aspect of the present invention discloses an eyeball structure virtual teaching system, which includes:
the eyeball structural data acquisition module 100 is used for acquiring or importing eyeball structural data;
a medical data module 200 for storing or updating health and lesion data associated with the eyeball;
the digital model module 300 is used for generating a three-dimensional eyeball structural model according to eyeball structural data and health and pathological change data;
a control module 400 for generating control instructions;
the holographic device module 500 is used for playing the three-dimensional eyeball structural model according to the control instruction.
The eyeball structure collection module 100 is used for collecting or importing structure data of an eyeball, for example, a photosensitive system of the eyeball is composed of an outer layer film, a middle layer film and an inner layer film, wherein the outer layer film comprises cornea and sclera, the middle layer film comprises grape film, and the inner layer film comprises retina; the refractive system of the eyeball consists of cornea, aqueous humor, lens and vitreous body. The eyeball structure collection module 100 may collect the structure data of the eyeball through an external device (such as a sensor), or may directly introduce the structure data of the eyeball.
The medical data module 200 stores and updates health and lesion data related to the eyeball and establishes correspondence between each health data and lesion data. For example, the lesion data may be a myopia formation process: the lens is attached to a circle of ciliary muscle by the zonules, and when the eye is overlooked, far light is just focused on the retina, so that the imaging is clear; when looking proximally, the focal point falls behind the retina, the ciliary muscle contracts, and the zonules relax, thereby imaging on the retina. When people excessively see near for a long time, ciliary muscles are always in a contracted state, so that people see things in a blurred state, and pseudomyopia is caused. Pseudomyopia can be improved or completely restored by resting or using drugs, and if the ciliary muscle is in a contracted state for a long time, it can evolve from pseudomyopia to true myopia. Meanwhile, the medical data module 200 may be connected to an external server to update health and lesion data related to the eyeball in real time, and may also be provided with an import interface for importing health and lesion data related to the eyeball.
The digital model module 300 is respectively connected to the eyeball structural data collection module 100 and the medical data module 200, and generates a three-dimensional eyeball structural model (including pictures, audio and/or video) according to the eyeball structural data and the health and lesion data, such as a healthy three-dimensional eyeball structural model, a myopic three-dimensional eyeball structural model, a video of the evolution of the healthy three-dimensional eyeball structural model into a myopic three-dimensional eyeball structural model, and the like. The digital model module 300 adopts fusion deformation editing to manufacture animation on a flexible object, extrusion, stretching, cutting, twisting and other deformation animation of irregular objects are completed through Maya and 3dsMax to simulate changes generated by rendering inside an eyeball, the materials of the three-dimensional eyeball structural model are rendered layer by layer through 3dsMax, the light and shadow effect of cornea, aqueous humor, crystalline lens and vitreous body is better, and the three-dimensional eyeball structural model is rendered layer by layer through afterEffect. The digital model module 300 creates a virtual map and creates three-dimensional modeling and animation of the eye according to the script. And performing model three-dimensional reconstruction and topology by adopting standard data in eyeball three-dimensional modeling, and finally completing three-dimensional eyeball structural model modeling, optimizing, mapping and beautifying. The digital model module 300 generates digital materials from the three-dimensional eyeball structural model through 3dsMax, and generates a lamplight system which is suitable for animation demonstration related to the three-dimensional eyeball structural model according to the digital materials. Meanwhile, the digital model module 300 may also set a trigger event for each part of the three-dimensional eyeball structural model, when the trigger event occurs at the part, the generated trigger signal is transmitted to the control module 400, and the control module 400 controls the holographic device module 500 to play health and pathological data related to the part, such as video and audio of a myopia forming process, according to the trigger signal.
The hologram device module 500 is connected with the control module 400, and the hologram device module 500 includes an outer case, a display device, and an imaging device. The display device is arranged on the top surface of the outer shell, and the display screen of the display device faces the bottom surface of the outer shell; the imaging device is a rectangular pyramid surrounded by four glass plates, the imaging device is fixedly arranged in the outer shell, the bottom surface of the imaging device is arranged at the bottom of the outer shell, and the vertex of the imaging device is overlapped with the center of the display screen of the display device of the outer shell. The display device converts the three-dimensional eyeball structural model into images with completely synchronous front, back, left and right directions, the display screen plays the converted images, and the images are projected on glass plates in the front, back, left and right directions of the imaging device to form holographic images. The display device can be a display screen fixedly arranged on the top surface of the outer shell, or can be terminal equipment such as a tablet personal computer, a notebook computer and the like which are placed on the top surface of the outer shell.
As shown in fig. 2, another embodiment of an aspect of the present invention further includes:
the remote control module 600 is configured to acquire operation information of a user, and transmit the operation information to the control module 400;
the voice module 700 comprises a voice feature model library 701 and a voice data acquisition module 702, wherein the voice feature model library 701 is used for storing a voice feature model corresponding to the three-dimensional eyeball structural model and the medical data module 200, the voice data acquisition module 702 is used for acquiring and identifying voice data, comparing and matching the acquired voice data with the voice feature model, and transmitting a matching result to the control module 400; and
the service module 800 comprises a prevention module 801 and an experience module 802, wherein the prevention module 801 is used for introducing basic information and prevention knowledge of various eye diseases, and the experience module 802 provides an eye treatment simulation scene.
The remote control module 600 is used for acquiring operation information of a user and transmitting the operation information to the control module 400. The user may select various parts of the three-dimensional eyeball structural model, basic information and prevention knowledge of eye diseases of the prevention module 801, a simulation scene of the experience module 802, etc. through the remote control module 600, and transmit operation information to the control module 400. For example, when the user selects the simulation scene of myopia correction in the experience module 802 through the remote control module, the remote control module generates corresponding operation information and sends the operation information to the control module 400, and the control module 400 controls the holographic device module 500 to play the simulation scene of myopia correction.
The speech module 700 includes a speech feature model library 701 and a speech data collection module 702. The voice feature model library 701 is used for storing voice feature models corresponding to the eyeball structure collection module 100 and the medical data module 200. The voice data acquisition module 702 is used for acquiring and recognizing voice data. Comparing and matching the collected voice data with the voice feature model library 701, and generating a trigger signal to be sent to the control module 400 when the voice data is matched with the voice feature model corresponding to the medical data module; when the speech data does not match the speech feature model corresponding to the medical profile module 200, no trigger signal is generated. For example, the voice feature model is "myopia", when the user speaks "myopia", the voice data acquisition module acquires the voice data "myopia" and matches the voice data from the voice feature model library to the voice model of "myopia", the voice module generates a trigger signal and sends the trigger signal to the control module, and the control module controls the holographic device module to play video and audio of the myopia forming process.
The service module 800 is connected with the control module 400, and displays the eyeball health education experience data through the holographic device module 500. The service module 800 is also connected to the remote control module 600, and a user selects the service module 800 through the remote control module 600 and generates user operation information to be transmitted to the control module 400. The service module 800 includes a prevention module 801 and an experience module 802. The prevention module 801 is used for introducing basic information and prevention knowledge of various eye diseases, and can be used for describing the classification of common ophthalmic diseases and the ophthalmic knowledge of myopia, hyperopia, amblyopia and the like. The experience module 802 is configured to provide an eye treatment simulation scenario, where the eye treatment simulation scenario includes a virtual eye clinic treatment room, myopia correction, hyperopia correction, amblyopia correction, and other treatment scenario experiences. The holographic technology is applied to eye health propaganda, the limitation of the traditional health propaganda in time and space is broken through, the health propaganda is not a boring knowledge interpretation any more, the multimedia propaganda is not limited to pictures and video display any more, an eye disease patient can directly participate in the disease introduction, a virtual health propaganda environment is experienced personally, multiple sensory stimuli are provided for the eye disease patient, the strong active learning desire of the patient is stimulated, the interest of the patient in learning eye disease prevention knowledge is improved, and the defect that part of patients do not participate in the operation is overcome. In addition, some eye treatment operations with high danger coefficient and difficult development and scenes which cannot be achieved in practical operation can be virtually experienced through holographic technology, so that the depth of eye health education can be increased. By adopting the virtual simulation software for the eye health education, only the software content needs to be expanded, so that the eye patient can repeatedly learn the new technical product, the content of the eye health education is enhanced, and the breadth and depth of the education are increased.
As shown in fig. 3, an embodiment of another aspect of the present invention provides a digital model building method for an eyeball structure virtual teaching system, including the following steps:
collecting or importing structural data of eyeballs;
storing or updating health and pathology data associated with the eyeball;
generating a three-dimensional eyeball structure model according to the stored eyeball structure data and the health lesion data;
matching the animation deduction video to a three-dimensional eyeball structural model according to the equipment parameters of the holographic equipment module;
manufacturing a virtual map, virtual lamplight and a special effect, and importing the virtual map, the virtual lamplight and the special effect into a holographic equipment module to render a three-dimensional eyeball structural model;
acquiring operation information of a user and generating a control instruction;
and playing the three-dimensional eyeball structural model according to the control instruction.
Matching the animation deduction video to a three-dimensional eyeball structural model according to the equipment parameters of the holographic equipment module; the holographic equipment module adopts fusion deformation editing to manufacture animation on the basis of the three-dimensional eyeball structural model, and extrusion, stretching, cutting, twisting and other deformation animation of irregular articles are completed through Maya and 3dsMax to simulate the change generated by rendering of the virtual system in the eyeball.
Manufacturing a virtual map, virtual lamplight and a special effect, and importing the virtual map, the virtual lamplight and the special effect into a holographic equipment module to render a three-dimensional eyeball structural model; and (3) manufacturing a virtual map, and manufacturing modeling and animation of the three-dimensional eyeball structural model according to the script. Modeling of the three-dimensional eyeball structure model adopts standard data to carry out three-dimensional reconstruction and topology of the model, and modeling, optimization, mapping and beautifying of the three-dimensional eyeball structure model are completed. The virtual light and special effect can be manufactured by switching the visual angles through the virtual model positioning machine and the motion machine, and the model light and the shadow change along with the change of the visual angles to form different scenes. The virtual map, virtual lamplight and special effects are led into the holographic equipment module, and a lamplight system which is suitable for the animation demonstration related to the three-dimensional eyeball structural model can be generated by rendering the holographic model and the animation of the three-dimensional eyeball structural model through 3 dsMax. And performing layering rendering, and correspondingly and independently adjusting and outputting a series of frame files on different layers of the three-dimensional eyeball structural model, and performing later dynamic processing by adopting later AfterEffect to generate and output digital content, so that the holographic rendering effect of the three-dimensional eyeball structural model is realized. And the lamplight loading needs to be rendered by scheduling the angle and the machine position of the virtual camera to generate a lamplight system and a scene which are suitable for the animation demonstration related to the three-dimensional eyeball structural model. The specific rendering steps are as follows: after a preset model is given, selecting the model to be imported, and checking that the model corresponding to the eyeball is imported in sequence in the scene; saving the rendering file; setting a rendering layer; presetting a material ball, enabling a script, and endowing the model material ball with a model (selecting the model needing to be endowed with the material) in a box. The method is correspondingly applied to color material balls and detail material balls when the lower rendering layer is rendered; the rendering base layers that generally need to be set fall into four general categories: color, line, light, matte. Color is classified into: part layer, eyeball color (color), eyeball detail layer (detail), eyeball overflow layer (push). How many layers the Group hierarchy has divided into how many rendering layers.
As shown in fig. 4, another embodiment of another aspect of the present invention provides a digital model building method for an eyeball structure virtual teaching system, which further includes: and inputting a logic control operation method, and setting the holographic equipment module and the remote control module to realize the matching of the holographic equipment module and the remote control module.
And (3) the production flow of the digital content adopts three-dimensional manufacturing tools Maya and 3dsMax to manufacture, render and output according to the script flow, performs data previewing and configuration through Maya and afterEffect, and uniformly packages configuration files such as parameters, virtual light, special effects and the like of the holographic equipment module. The 3D model generated by rendering is provided with a guiding voice system, a guiding animation deduction and a guiding operation system, and a logic control remote controller in the guiding operation system operates a demonstration lens by adjusting virtual lamplight, special effects and the like.
As shown in fig. 5, a digital model building method for an eyeball structure virtual teaching system according to another embodiment of the present invention further includes: and adjusting the material of the three-dimensional eyeball structural model.
Displaying the imaging animation of the outer membranous cornea and sclera, the middle membranous uveal grape membrane and the inner membranous retina in the virtual scene. The 3dsMax layer-by-layer rendering of the three-dimensional eyeball structural model enables the cornea, aqueous humor, crystalline lens and vitreous body to have better shadow effect.
In the several embodiments provided in this application, it should be understood that the disclosed methods and apparatus may be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection via interfaces, devices or units, which may be in electrical, mechanical or other forms.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may be physically included separately, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in hardware plus software functional units.
The integrated units implemented in the form of software functional units described above may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium, and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform part of the steps of the transceiving method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
While the invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those skilled in the art that the foregoing is a further detailed description of the invention with reference to specific embodiments, and it is not intended to limit the practice of the invention to those descriptions. Various changes in form and detail may be made therein by those skilled in the art, including a few simple inferences or alternatives, without departing from the spirit and scope of the present invention.
Claims (8)
1. An eyeball structure virtual teaching system, which is characterized by comprising:
the eyeball structure data acquisition module is used for acquiring or importing eyeball structure data;
the medical data module is used for storing or updating health and pathological change data related to the eyeballs and establishing corresponding relations between each health data and pathological change data, wherein the pathological change data comprises changes of the eyeballs in a myopia process;
the digital model module is used for generating a three-dimensional eyeball structural model according to the eyeball structural data and the health and pathological change data, the digital model module adopts fusion deformation editing to manufacture animation on a flexible object, changes generated by rendering inside an eyeball are simulated through Maya and 3dsMax, the materials of the three-dimensional eyeball structural model are rendered layer by layer through 3dsMax, the light and shadow effect of cornea, aqueous humor, crystalline lens and vitreous body is better, layering rendering is carried out on the three-dimensional eyeball structural model through AfterEffect, and the digital model module is used for manufacturing a virtual map and manufacturing the three-dimensional eyeball structural model and animation according to a script;
the control module is used for generating a control instruction;
the holographic equipment module is connected with the control module and used for playing the three-dimensional eyeball structural model according to the control instruction, and comprises an outer shell, a display device and an imaging device, wherein the display device is arranged on the top surface of the outer shell, and a display screen of the display device faces the bottom surface of the outer shell; the imaging device is a rectangular pyramid surrounded by four glass plates, the imaging device is fixedly arranged in the outer shell, the bottom surface of the imaging device is arranged at the bottom of the outer shell, the top point of the imaging device coincides with the center of the display screen, the display device converts the three-dimensional eyeball structural model into images in front, back, left and right directions, the display screen plays the converted images, and the images are projected on the glass plates in front, back, left and right directions of the imaging device to form holographic images.
2. The virtual teaching system of eye structure of claim 1, wherein the three-dimensional eye structure model is a combination of a picture, audio, and video.
3. The virtual teaching system of eye structure of claim 1, further comprising:
and the remote control module is used for acquiring the operation information of the user and transmitting the operation information to the control module.
4. The virtual teaching system of eye structure of claim 1, further comprising:
the voice module comprises a voice characteristic model library and a voice data acquisition module, wherein the voice characteristic model library is used for storing voice characteristic models corresponding to the three-dimensional eyeball structural model and the medical data, the voice data acquisition module is used for acquiring and identifying voice data, comparing and matching the acquired voice data with the voice characteristic models, and transmitting a matching result to the control module.
5. The virtual teaching system for an eye structure according to any of claims 1-4, further comprising:
the service module comprises a prevention module and an experience module, wherein the prevention module is used for introducing basic information and prevention knowledge of various eye diseases, and the experience module provides an eye treatment simulation scene.
6. A digital model building method for an eyeball structure virtual teaching system comprises the following steps:
collecting or importing the eyeball structure data;
storing or updating health and pathological change data related to eyeballs, and establishing corresponding relation between each health data and pathological change data, wherein the pathological change data comprises changes of the eyeballs in a myopia process;
generating a three-dimensional eyeball structural model according to the stored eyeball structural data and the health and pathological change data;
matching animation deduction videos to the three-dimensional eyeball structural model according to equipment parameters of the holographic image equipment; animation production is carried out on the flexible object by fusion deformation editing on the basis of the three-dimensional eyeball structural model, and changes generated by rendering of a virtual system in the eyeball are simulated through Maya and 3 dsMax; the 3dsMax layer-by-layer rendering of the three-dimensional eyeball structural model can enable the cornea, aqueous humor, crystalline lens and vitreous body to have better shadow effect; layering rendering is carried out on the three-dimensional eyeball structure model through an AfterEffect;
manufacturing a virtual map, virtual lamplight and a special effect, and guiding the virtual map, the virtual lamplight and the special effect into holographic imaging equipment to render the three-dimensional eyeball structural model;
acquiring operation information of a user and generating a control instruction;
playing the three-dimensional eyeball structure model according to the control instruction;
the holographic image equipment comprises an outer shell, a display device and an imaging device, wherein the display device is arranged on the top surface of the outer shell, and a display screen of the display device faces the bottom surface of the outer shell; the imaging device is a rectangular pyramid surrounded by four glass plates, the imaging device is fixedly arranged in the outer shell, the bottom surface of the imaging device is arranged at the bottom of the outer shell, the top point of the imaging device coincides with the center of the display screen, the display device converts the three-dimensional eyeball structural model into images in front, back, left and right directions, the display screen plays the converted images, and the images are projected on the glass plates in front, back, left and right directions of the imaging device to form holographic images.
7. The digital model building method according to claim 6, further comprising: inputting a logic control operation method, and setting the holographic image equipment and the remote control module to realize the matching of the holographic image equipment and the remote control module.
8. The digital model building method according to any one of claims 6 to 7, further comprising: and adjusting the material of the three-dimensional eyeball structural model.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010541563.7A CN111667906B (en) | 2020-06-15 | 2020-06-15 | Eyeball structure virtual teaching system and digital model building method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010541563.7A CN111667906B (en) | 2020-06-15 | 2020-06-15 | Eyeball structure virtual teaching system and digital model building method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111667906A CN111667906A (en) | 2020-09-15 |
| CN111667906B true CN111667906B (en) | 2024-02-13 |
Family
ID=72387927
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010541563.7A Active CN111667906B (en) | 2020-06-15 | 2020-06-15 | Eyeball structure virtual teaching system and digital model building method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111667906B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116646079B (en) * | 2023-07-26 | 2023-10-10 | 武汉大学人民医院（湖北省人民医院） | Auxiliary diagnosis method and device for ophthalmologic symptoms |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101477701A (en) * | 2009-02-06 | 2009-07-08 | 南京师范大学 | Built-in real tri-dimension rendering process oriented to AutoCAD and 3DS MAX |
| CN204614327U (en) * | 2015-03-11 | 2015-09-02 | 上海市浦东新区潍坊社区卫生服务中心 | Funduscopy simulated teaching instrument |
| CN105117589A (en) * | 2015-08-13 | 2015-12-02 | 丁琴 | High-simulation multimedia ophthalmological doctor-patient communication system |
| CN108066006A (en) * | 2016-11-11 | 2018-05-25 | 鸿富锦精密工业（深圳）有限公司 | Vision correction effect simulation system and method |
| CN109979600A (en) * | 2019-04-23 | 2019-07-05 | 上海交通大学医学院附属第九人民医院 | Orbital Surgery training method, system and storage medium based on virtual reality |
| CN110174953A (en) * | 2019-07-01 | 2019-08-27 | 苏州蓝软智能医疗科技有限公司 | Prosthetic replacement surgery simulation system and construction method based on mixed reality technology |
| CN111128367A (en) * | 2020-01-13 | 2020-05-08 | 浙江清华柔性电子技术研究院 | Modeling and simulating method and system for eyes |
| CN111223576A (en) * | 2020-01-14 | 2020-06-02 | 于金明 | Patient propaganda and education system based on virtual intelligent medical platform |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10859857B2 (en) * | 2016-03-22 | 2020-12-08 | Johnson & Johnson Vision Care, Inc. | Pulsed plus lens designs for myopia control, enhanced depth of focus and presbyopia correction |
-
2020
- 2020-06-15 CN CN202010541563.7A patent/CN111667906B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101477701A (en) * | 2009-02-06 | 2009-07-08 | 南京师范大学 | Built-in real tri-dimension rendering process oriented to AutoCAD and 3DS MAX |
| CN204614327U (en) * | 2015-03-11 | 2015-09-02 | 上海市浦东新区潍坊社区卫生服务中心 | Funduscopy simulated teaching instrument |
| CN105117589A (en) * | 2015-08-13 | 2015-12-02 | 丁琴 | High-simulation multimedia ophthalmological doctor-patient communication system |
| CN108066006A (en) * | 2016-11-11 | 2018-05-25 | 鸿富锦精密工业（深圳）有限公司 | Vision correction effect simulation system and method |
| CN109979600A (en) * | 2019-04-23 | 2019-07-05 | 上海交通大学医学院附属第九人民医院 | Orbital Surgery training method, system and storage medium based on virtual reality |
| CN110174953A (en) * | 2019-07-01 | 2019-08-27 | 苏州蓝软智能医疗科技有限公司 | Prosthetic replacement surgery simulation system and construction method based on mixed reality technology |
| CN111128367A (en) * | 2020-01-13 | 2020-05-08 | 浙江清华柔性电子技术研究院 | Modeling and simulating method and system for eyes |
| CN111223576A (en) * | 2020-01-14 | 2020-06-02 | 于金明 | Patient propaganda and education system based on virtual intelligent medical platform |
Non-Patent Citations (2)
| Title |
|---|
| "基于多层液晶的近眼三维显示研究";丁俊;《中国优秀硕士学位论文全文数据库 (信息科技辑)》;20170315;全文 * |
| 沙丽华等编著.《生物教学问题》.辽宁师范大学出版社,2000,全部. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111667906A (en) | 2020-09-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8953909B2 (en) | System, method, and computer software code for mimic training | |
| US10908421B2 (en) | Systems and methods for personal viewing devices | |
| CN102445756B (en) | Automatic focus improvement for augmented reality displays | |
| CN108369457A (en) | Real mixer for mixed reality | |
| CN111771231A (en) | Matching mesh for avatars | |
| CN109564706A (en) | User's interaction platform based on intelligent interactive augmented reality | |
| CN107643597A (en) | Integration reality border wisdom glasses eyeshield photochopper | |
| US20210233318A1 (en) | Neutral avatars | |
| EP2583131B1 (en) | Personal viewing devices | |
| CN112150617A (en) | Control device and method of three-dimensional character model | |
| CN106774929A (en) | The display processing method and virtual reality terminal of a kind of virtual reality terminal | |
| CN111667906B (en) | Eyeball structure virtual teaching system and digital model building method thereof | |
| CN111276022A (en) | Gastroscope simulation operation system based on VR technique | |
| US20200349766A1 (en) | Methods and Systems for Viewing and Editing AR/VR Computer-based Designs Allowing Impaired Vision Simulation | |
| KR100445846B1 (en) | A Public Speaking Simulator for treating anthropophobia | |
| CN104182979A (en) | Visual impairment simulation method and device | |
| CN108234986B (en) | For treating the 3D rendering management method and management system and device of myopia or amblyopia | |
| US10992984B2 (en) | Multiple data sources of captured data into single newly rendered video feed | |
| US20180286125A1 (en) | Deteriorated video feed | |
| US11823343B1 (en) | Method and device for modifying content according to various simulation characteristics | |
| WO2023243093A1 (en) | Data terminal, 3d image display method for data terminal, and data processing system | |
| WO2023237023A1 (en) | Image processing method and apparatus, storage medium, and head-mounted display device | |
| US20230171484A1 (en) | Devices, methods, and graphical user interfaces for generating and displaying a representation of a user | |
| NL2020040B1 (en) | Method and system for generating an augmented reality signal and a control signal for an auxiliary device for performing sexually arousing actions to a spectator | |
| Cheng | Visualizing Glaucoma: Accurately Characterizing and Depicting Visual Loss Via Virtual Reality |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |