CN111968441A - Virtual craniocerebral auxiliary cognitive system and method - Google Patents

Virtual craniocerebral auxiliary cognitive system and method Download PDF

Info

Publication number
CN111968441A
CN111968441A CN202010863612.9A CN202010863612A CN111968441A CN 111968441 A CN111968441 A CN 111968441A CN 202010863612 A CN202010863612 A CN 202010863612A CN 111968441 A CN111968441 A CN 111968441A
Authority
CN
China
Prior art keywords
brain
virtual
functional area
user
area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010863612.9A
Other languages
Chinese (zh)
Other versions
CN111968441B (en
Inventor
顾天奇
林薇
何炳蔚
苏晓航
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fuzhou University
Original Assignee
Fuzhou University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fuzhou University filed Critical Fuzhou University
Priority to CN202010863612.9A priority Critical patent/CN111968441B/en
Publication of CN111968441A publication Critical patent/CN111968441A/en
Application granted granted Critical
Publication of CN111968441B publication Critical patent/CN111968441B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00Simulators for teaching or training purposes

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Electrically Operated Instructional Devices (AREA)
  • Instructional Devices (AREA)

Abstract

The invention relates to a virtual brain auxiliary cognition system, which comprises a brain cognition learning module, a brain function partition testing module, a virtual operation practice module and a database; the brain cognitive learning module is used for providing a complete brain model and is used for performing brain cognitive learning; the brain function partition testing module is used for performing brain function partition testing; the virtual operation practice module is used for constructing a virtual lateral ventricle puncture operating room scene and providing CT cases of patients, and a user can puncture the lateral ventricle by using a puncture needle in the scene. The invention provides a virtual brain auxiliary cognitive system and method, which can effectively help to learn the related knowledge of the brain and improve the teaching efficiency based on virtual interaction.

Description

Virtual craniocerebral auxiliary cognitive system and method
Technical Field
The invention relates to the field of neurosurgery assisted teaching, in particular to a virtual craniocerebral assisted cognitive system and a method thereof.
Background
Virtual reality technology is widely used in various fields because of its unique sense of immersion. With the innovation of medical education, the application of virtual reality technology to medical education has become a novel teaching means. For example, in the field of surgery, the anatomy as a basis needs to be firmly mastered by students, and various surgical operations are closely related to the anatomy, but due to the defects that textbooks, videos and the like are not intuitive and boring, medical students are particularly labored to learn related anatomical knowledge and remember spatial relationships among various anatomical structures, and therefore, how to provide an intuitive and interesting teaching means for the medical students becomes a problem of being constantly researched in the medical education industry. Virtual anatomic structures are created by utilizing a virtual reality technology (VR), and good effects are achieved by providing an intuitive anatomic learning mode for medical students.
In neurosurgery, learning brain anatomy by using a virtual reality technology is also the key point of neurosurgery teaching, however, in the existing brain anatomy system, the emphasis is placed on the spatial position relationship among all tissue structures in the brain, the correct partition of a brain tissue functional region and the further cognition of the cranium based on the postoperative condition are also very important, the existing brain tissue functional region can only be learned through an anatomical map, or the brain tissue is reconstructed through medical three-dimensional reconstruction software, the partition cannot be performed, the interaction is also lacked, and further teaching aiming at the aspect is also lacked in the virtual brain anatomy system.
Disclosure of Invention
In view of this, the present invention aims to provide a virtual brain-assisted cognitive system and method thereof, which can effectively assist understanding of brain knowledge and improve learning efficiency of brain cognition.
In order to achieve the purpose, the invention adopts the following technical scheme:
a virtual brain auxiliary cognition system comprises a brain cognition learning module, a brain function partition testing module, a virtual operation practice module and a database; the brain cognitive learning module is used for providing a complete brain model and is used for performing brain cognitive learning; the brain function partition testing module is used for performing brain function partition testing; the virtual operation practice module is used for constructing a virtual lateral ventricle puncture operating room scene and providing CT cases of patients, and a user can puncture the lateral ventricle by using a puncture needle in the scene.
A virtual brain auxiliary cognition method comprises a brain cognition learning process, a brain functional region partition testing process and a virtual operation practice process.
Further, the brain cognitive learning process specifically comprises the following steps:
a1, three-dimensional reconstruction is carried out on each intracranial organ tissue;
a2, performing functional area division on brain tissues according to the brain functional area division map, rendering in different colors for division, and splicing the brain tissues into a complete brain tissue model to be imported into a system;
a3, after acquiring a brain cognitive learning request, displaying the reconstructed and partitioned brain tissue and the virtual models of other organs, and acquiring the relevant knowledge points of the organs, the brain tissue or the brain functional area to be displayed by the system according to the requirements of a user.
Further, the step a2 is specifically: numbering each brain functional area and organ tissue option buttons according to 0-n numbers, numbering theoretical texts and explicit-implicit buttons corresponding to each brain functional area and organ by 0-n numbers after the theoretical texts and explicit-implicit buttons are established in advance and hiding the theoretical texts and organ in advance, clicking the buttons by using a handle of VR equipment by a user, monitoring that the buttons are clicked by a system, acquiring the numbers corresponding to the buttons and canceling the hiding of the corresponding theoretical texts; and if the user clicks a button for hiding a functional area or organ by using the handle of the VR device, displaying or hiding the functional area or organ corresponding to the number according to the command.
Further, the brain function region test process specifically includes the following steps:
b1, changing the rendering material of the brain tissue into grey after acquiring the test request of the brain functional area;
b2, randomly and repeatedly highlighting each functional area in sequence, obtaining the functional area name selected by the user, and matching the selected functional area name with the highlighted functional area name; if the selection is wrong, the system prompts the selection to be wrong and displays the knowledge point of the functional area as a prompt; if the selection is correct, highlighting the next functional area until all the functional areas are highlighted and the test is finished; after the test is finished, the system displays the test result, including the selection times, the correct answer times and the wrong answer times, and informs the user of the functional area part needing additional learning according to the wrong answer times of the user;
and B3, uploading the test result to a background database.
Further, the step B2 is specifically:
b21, naming a plurality of function areas by numbers 0-n, and naming corresponding function area options and function area error reminders by numbers 0-n;
step B22 creating a list with the numbers 0-n added to the list to represent the 0-n functional areas. Establishing correct answer times x, wherein the initial value is 0;
step B23, creating an error answer number array, wherein the array comprises n elements, the initial values are all 0, and the element values correspond to the error answer number corresponding to each functional area;
b24, randomly generating a number in the list by using the random number, highlighting the functional area corresponding to the number, and deleting the generated random number from the list;
b25, monitoring the button number selected by the user, matching the button number with the function area number, if the button number is the same as the function area number, continuing to generate the number in the next list, adding one to the number x of correct answer, highlighting the new function area, if the button number is different from the function area number, displaying the corresponding error prompt and prompt, adding one to the number of the corresponding function area by the error prompt array, adding one to the corresponding number of the function area in the error prompt array every time of error selection, and highlighting the next function area until the selection is correct
Step B26, after the test of all the functional areas is finished, adding the correct answer times x and each element of the wrong answer time array to obtain total answer times, and obtaining the ratio of each element in the wrong answer time array to the total answer times, thereby obtaining the serial number of the functional area needing to be further learned;
and step B27, the final system displays the total answer times, correct answer times, wrong answer times and names of the functional areas with more wrong answers.
Further, the virtual surgery practice process specifically includes:
c1, constructing a scene of a virtual lateral ventricle puncture operating room, and providing a virtual puncture needle and a virtual patient;
and C2, after the virtual lateral ventricle puncture is finished, displaying the specific position of the correspondingly placed puncture tube in the ventricle of the patient in a mode of reproducing the CT scanning image of the corresponding patient, and randomly displaying the positions of the other three interference puncture tubes, thereby improving the spatial transformation relation between the CT scanning image and the craniocerebrum and the cognitive ability of the craniocerebrum of the user.
Compared with the prior art, the invention has the following beneficial effects:
according to the invention, the intuitive and understandable brain tissue model is provided for the user through the brain functional area partition learning, and each functional area is divided into different colors for rendering, so that the user can observe and learn conveniently; the random highlight functional areas are tested through the brain functional area partition, the test result is obtained according to the button selected by the user, and feedback is given according to the result, so that the learning result of the user is further consolidated after the learning effect is tested.
Drawings
FIG. 1 is a flow chart of a method performed in one embodiment of the present application;
FIG. 2 is a schematic structural diagram of an apparatus according to a second embodiment of the present application;
fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
FIG. 4 is a schematic diagram of a medium according to an embodiment of the present application;
FIG. 5 is a schematic diagram of a cognitive learning process of the third embodiment of the present application;
fig. 6 is a schematic flow chart of a brain function region partition test in the third embodiment of the present application;
FIG. 7 is a schematic view of a virtual surgical practice process flow according to a third embodiment of the present application;
FIG. 8 is a diagram of a third example of cognitive learning in the brain;
FIG. 9 is a diagram of a brain function region test in accordance with a third embodiment of the present invention;
FIG. 10 is a graph of the results of a brain function region partition test performed in the third embodiment of the present application;
fig. 11 is a diagram illustrating three virtual surgical procedures according to an embodiment of the present invention.
Detailed Description
The invention is further explained below with reference to the drawings and the embodiments.
The first embodiment is as follows:
referring to fig. 1, the present invention provides a virtual brain-assisted cognitive method,
the method comprises a cognitive learning process, a brain function region test process and a virtual surgery practice process;
a brain function partition learning process comprising: the method comprises the steps of carrying out three-dimensional reconstruction on each organ tissue in the cranium in advance, carrying out functional area division on the brain tissue according to a brain functional area division map, rendering in different colors for division, and splicing the brain tissue into a complete brain tissue model leading-in system. After acquiring a brain cognitive learning request, displaying a brain tissue and other organ virtual models which are reconstructed and partitioned, and acquiring relevant knowledge points of organs, brain tissues or brain functional areas to be displayed by a system according to user requirements and displaying the relevant knowledge points at the sides of the models in a text manner;
specifically, in this embodiment, a three-dimensional brain tissue and organ model is created by using medical three-dimensional reconstruction software and three-dimensional modeling software, and the three-dimensional brain tissue is divided into a plurality of (9 in this example) independent brain functional regions including medulla oblongata, frontal lobe, temporal lobe, auditory center, and the like according to the brain functional region map, and the three-dimensional brain tissue is integrated into a virtual scene. Different brain regions portions are rendered in different colors in the virtual scene for the user to observe the differentiation. Providing corresponding buttons of each functional area and organ at the edge of the model, and displaying theoretical knowledge of the corresponding brain functional area and organ according to the buttons selected by the user, wherein the theoretical knowledge comprises the spatial position relationship between the functional area and other functional areas, pathology related relation, organ spatial position relation, pathology related relation and the like. The user selects the button of the organ or the functional area to be learned by self to learn the brain cognition, and the virtual model can be grabbed in the hand, and the specific organ or the functional area is displayed or hidden to further observe, so that the student can learn the brain cognition more intuitively and easily.
A brain function region test procedure comprising: and after the brain functional region partition test request is obtained, displaying that the material of the brain tissue rendering is gray. And randomly and non-repeatedly highlighting each functional area in sequence, acquiring the functional area name selected by the user, matching the selected functional area name with the highlighted functional area name, prompting the selection error by the system if the selection is wrong, displaying some functions of the functional area as a prompt, and simultaneously deepening the impression of the student on the functional area. If the selection is correct, the next functional area is highlighted until the functional areas are all highlighted and the test is finished. After the test is finished, the system displays the test result, including the selection times, the correct answer times and the wrong answer times, and informs the student of the functional area part needing additional learning according to the wrong answer times of the student.
Rendering the brain tissue model to gray based on the brain tissue model in the brain function region learning process. The system firstly highlights a brain functional area randomly, a user selects a correct answer according to the highlighted functional area, the system matches the answer selected by the user with a correct result, if the result is the same, the next functional area is highlighted, the functional area is not highlighted any more, if the result is different, an error message is prompted, corresponding prompts are given (for example, the functional area is adjacent to what functional area, is related to what behavior of human beings and the like), and until the selected result is the same as the correct result, a next functional area highlight test is carried out. In the process, the system records the times of correct answers and the times of wrong answers corresponding to each functional area, and displays the name of the corresponding functional area to remind the user of continuing to learn the functional area according to the ratio of the times of the wrong answers of each corresponding functional area to the total times of answers (such as 30 percent, namely the times of wrong answers of a certain functional area is three times, and the total times of answers is 10 times) when the ratio is exceeded.
The virtual surgical practice process includes: and constructing a scene of a virtual lateral ventricle puncture operating room, and providing a virtual puncture needle and a virtual patient. After the virtual lateral ventricle puncture is finished, the specific position of the puncture tube which is correspondingly placed in the ventricle of the patient is displayed in a mode of reproducing the CT scanning image of the corresponding patient, so that the spatial transformation relation between the CT scanning image and the cranium cognitive ability of a user are further improved.
By constructing a lateral ventricle puncture virtual scene, an operation virtual environment, a virtual patient and a virtual operation instrument are provided for a user, a plurality of lateral ventricles with different sizes and shapes and corresponding CT images are led in advance, the corresponding CT images are respectively placed at different cross section positions of the corresponding lateral ventricles, and all the lateral ventricles and the CT images are hidden. The user selects a lateral ventricle at first, the system displays the corresponding lateral ventricle and the CT image in the brain of the virtual patient, and the VR camera rendering layer does not render the CT image, so that the user cannot view the CT image in a scene. The user performs a puncture on the virtual patient and the system captures the point of impact of the puncture needle with the CT image and places a small sphere on this point of impact to replace the location of the puncture tube in the lateral ventricle. Meanwhile, according to the position of the small sphere, 3 small spheres are randomly generated on the XOY plane in the range of 0.1f of radius on the XOY plane of the small sphere to serve as interference items, and a user is required to find out the correct puncture point (namely, the position of the small sphere).
Preferably, in this embodiment, after the brain cognitive learning request is obtained, the partitioned brain tissue virtual model and the other organ models are displayed, and the system obtains the brain functional area and the relevant knowledge points of the organs to be displayed according to the user requirement, and displays the brain functional area and the relevant knowledge points of the organs by text at the side of the model. The method for the student to grasp the model in the learning process and observe the model in a close range is further embodied as follows: numbering each brain functional area and organ tissue, corresponding brain functional area and organ tissue buttons, brain functional area and organ theoretical knowledge UI and brain functional area and organ explicit and implicit buttons respectively (for example, numbering 0-17 for 9 functional areas and scalp, skull, blood vessel, brain tissue and lateral ventricle, numbering 0-17 for 18 functional area organ tissues and explicit and implicit buttons, and numbering 0-13 for 13 theoretical knowledge UIs), hiding the buttons and theoretical knowledge UI at first when entering a virtual scene, displaying 18 buttons after acquiring a brain cognitive learning request, clicking by selecting the functional area organ tissue buttons by a user, acquiring the numbers corresponding to the clicked buttons of the user, and searching the theoretical knowledge UIs corresponding to the numbers for display. When a user clicks a next button, hiding the current UI and displaying the UI corresponding to the button number, and if the user clicks a display-hidden button, hiding or displaying a corresponding functional area or organ tissue;
preferably, in this embodiment, after the cognitive learning of the brain of the user reaches a certain degree, the user may perform a brain function area partition test, the system hides other organ tissues and highlights the function area randomly, the user selects according to the highlighted function area, the next function area is highlighted if the selection is correct, otherwise, a prompt is given until the next function area is highlighted if the selection is correct, the process is repeated until all function areas are tested, and the system records a test result and uploads the test result to the background database, specifically as follows;
the functional areas are named by numbers 0-n, and corresponding functional area options and functional area error reminding are named by numbers 0-n. A list is created with the numbers 0-n added to the list to represent the 0-n functional areas. And (4) creating correct answer times x, wherein the initial value is 0. And creating an error answer number array, wherein the array comprises n elements, the initial values are all 0, and the element values correspond to the error answer number corresponding to each functional area. A certain number in the list is randomly generated by using the random number, the functional area corresponding to the number is highlighted, and the generated random number is deleted from the list. Monitoring the button number selected by the user, matching the button number with the function area number, if the button number is the same as the function area number, continuing to generate the number in the next list, adding one to the correct answer number x, highlighting the new function area, if the button number is different from the function area number, displaying the corresponding error prompt, adding one to the number of the corresponding function area by the error prompt array, and adding one to the corresponding number of the function area in the error prompt array every time the error is selected, until the next function area is highlighted after the error is selected. And after the test of all the functional areas is finished, adding the correct answer times x and each element of the wrong answer time array to obtain total answer times, and obtaining the element number according to the maximum value of the element in the wrong answer time array so as to obtain the serial number of the most wrong functional area. And finally, the system displays the total answer times, the correct answer times, the wrong answer times and the names of the function areas with the most wrong answers.
Preferably, in this embodiment, the database is configured to store user information and training results, provide a query interface, and display the query result according to the query condition. By storing the user information and the training results and providing a query interface, the training conditions of all the training contents of the user can be conveniently queried and known.
Example two
Referring to fig. 2, the present embodiment provides a virtual brain-assisted cognitive system, which includes a brain cognitive learning module, a brain function partition testing module, a virtual surgery practice module, and a database; the brain cognitive learning module is used for providing a complete brain model and is used for performing brain cognitive learning; the brain function partition testing module is used for performing brain function partition testing; the virtual operation practice module is used for constructing a virtual lateral ventricle puncture operating room scene and providing CT cases of patients, and a user can puncture the lateral ventricle by using a puncture needle in the scene.
In this embodiment, after the system obtains the virtual surgical practice request, the scene is switched to the operating room scene, the system provides the virtual puncture needle and the virtual patient, selects the reconstructed lateral ventricle and CT image with different sizes in advance to be imported into the system, and respectively numbers the lateral ventricle and CT image to 0-5 according to the size, and the corresponding button is also numbered to 0-5. And placing the CT image at the cross section position corresponding to the lateral ventricle. When the scene starts to run, all lateral ventricles and CT images are hidden, and when the button number selected by the user is acquired, the corresponding lateral ventricles and CT images are displayed. At this time, the rendering layer of the VR camera does not render the CT image, so the user does not see the CT image. When the user punctures, the system acquires the collision point of the puncture needle and the CT image, and records the collision point as (x, y, z), generates a small sphere, and sets the Transform of the small sphere as (x, y, z). At the same time, an additional three small spheres are generated, x-coordinate values and y-coordinate values of the three small spheres are randomly generated in such a manner that six random numbers are generated, and x or y of the small spheres is applied to Transform. The system displays the CT image and four beads from above through Camera1, whose rendering layer only selects the CT and four beads. The user selects the corresponding correct puncture position, clicks the button to select, and the system judges the selection result and displays the correct answer.
Since the apparatus described in the second embodiment of the present invention is an apparatus used for implementing the method of the first embodiment of the present invention, based on the method described in the first embodiment of the present invention, a person skilled in the art can understand the specific structure and the deformation of the apparatus, and thus the details are not described herein. All the devices adopted in the method of the first embodiment of the present invention belong to the protection scope of the present invention.
Referring to fig. 3 to 4, this embodiment provides an electronic device including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program, and may implement any one of the first embodiment.
The present embodiment also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the computer program can implement any one of the embodiments in the first embodiment.
EXAMPLE III
Referring to fig. 5-11, this embodiment is a virtual brain-aided learning embodiment applied to a virtual brain function partition learning system, and the aided teaching includes the following learning contents:
1. brain cognitive learning: referring to fig. 5, the mic software is used to perform three-dimensional reconstruction on the CT image data to obtain corresponding tissue/organ models, and then the geochemical Studio is used to segment the brain tissue model using the brain function partition map as the standard. And respectively storing the divided functional areas in stl format, sequentially importing 3DS MAX software, optimizing the functional areas, and forming the functional areas into groups, namely the functional areas can be distinguished, but the visual effect is a complete brain tissue. And (3) leading the brain tissue and other tissues and organs into unity, numbering the corresponding functional area theoretical UI and the tissue and organ functional area buttons and the visible and invisible buttons respectively to be 0-17, clicking the buttons by a user, acquiring the button numbers by the system, and displaying the functional area theoretical UIs corresponding to the numbers. If the user selects to display and hide certain organ tissues, the system acquires the button number, and hides or displays the corresponding tissue tissues. And if the user does not select to finish learning, the system continues to acquire the button number clicked by the user until the user submits a learning finishing request, and the system finishes the brain function partition learning.
2) Brain functional area test: referring to fig. 6, after acquiring a request for performing a brain function region partition test by a user, the system renders the entire brain tissue model to be gray, numbers each function region, a corresponding function region button, and a corresponding function region prompt to be 0 to 8, and creates a function region number list, where elements in the list are 0 to 8. Firstly, a random number is obtained from a list, a brain functional area corresponding to the random number is highlighted, a user selects a button to click according to the highlighted functional area, the system matches the number of the button with the random number, if the matching result is the same, the list is deleted from the list, whether the list is empty or not is judged, if not, a random number is obtained from the list again, and the next functional area is highlighted. If the list is empty, the system is ended. If the matching result of the button number and the random number is different, displaying the wrong answer and providing the prompt of the functional area corresponding to the number. The user selects the button again to continue clicking, and the system continues to match the button number with the random number. The test module ends until the list is empty.
3) Virtual surgical practice: referring to fig. 8, after reconstructing the lateral ventricle model, the reconstructed lateral ventricle model is guided into Unity together with the CT, and the CT is placed according to the cross section of each lateral ventricle. When a user enters a scene, each lateral ventricle is hidden, the system acquires the lateral ventricle selected by the user and displays the lateral ventricle and the corresponding CT. The system creates a list, the list comprises 0-3 elements, puncture tubes are placed corresponding to users with four materials of white, blue, green and red, the system obtains the coordinates of collision points of the puncture tubes and the CT and applies the coordinates to newly generated pellets, the system obtains random numbers from the list, the pellets are endowed with the materials corresponding to the random numbers, and the random numbers are deleted from the list; and simultaneously generating three random numbers in the range from x-0.1 to x +0.1 of the coordinates of the collision point, three random numbers in the range from y-0.1 to y +0.1 of the coordinates of the collision point and three random numbers in the range of the list, respectively applying the random numbers to newly generated three small spheres, and simultaneously endowing the three small spheres with materials corresponding to three color numbers. And (3) judging the correct puncture tube position, namely the correct spherule by the user, selecting the color button corresponding to the spherule, finishing the judgment if the judgment is correct, and giving a prompt and continuing the judgment if the judgment is wrong until the judgment is correct.
The three teaching contents are all used for improving the craniocerebral cognition of the user. The brain cognitive learning aims at providing basic knowledge and three-dimensional space structure of a user about each brain functional area and each tissue organ, and providing an intuitive and understandable learning mode with more interactivity for the user by presenting a segmented three-dimensional brain tissue model. The brain function partition test aims to test the learning effect of the user, further consolidate the learning result of the user through the test, and simultaneously indicate the part needing further learning for the user through the test. The virtual operation practice combines the cranium and the CT by introducing the CT image, guides the user to perform lateral ventricle puncture, and further improves the understanding of the user on the cranium structure by judging the point position which the puncture tube may reach, thereby further improving the cognitive ability of the cranium.
The above description is only a preferred embodiment of the present invention, and all equivalent changes and modifications made in accordance with the claims of the present invention should be covered by the present invention.

Claims (7)

1. A virtual brain auxiliary cognition system is characterized by comprising a brain cognition learning module, a brain function partition testing module, a virtual operation practice module and a database; the brain cognitive learning module is used for providing a complete brain model and is used for performing brain cognitive learning; the brain function partition testing module is used for performing brain function partition testing; the virtual operation practice module is used for constructing a virtual lateral ventricle puncture operating room scene and providing CT cases of patients, and a user can puncture the lateral ventricle by using a puncture needle in the scene.
2. A virtual brain auxiliary cognition method is characterized by comprising a brain cognition learning process, a brain functional region test process and a virtual operation practice process.
3. The virtual brain-assisted cognitive method according to claim 2, wherein the brain cognitive learning process specifically comprises the following steps:
a1, three-dimensional reconstruction is carried out on each intracranial organ tissue;
a2, performing functional area division on brain tissues according to the brain functional area division map, rendering in different colors for division, and splicing the brain tissues into a complete brain tissue model to be imported into a system;
a3, after acquiring a brain cognitive learning request, displaying the reconstructed and partitioned brain tissue and the virtual models of other organs, and acquiring the relevant knowledge points of the organs, the brain tissue or the brain functional area to be displayed by the system according to the requirements of a user.
4. The virtual craniocerebral assisted cognitive method according to claim 3, wherein the step A2 is specifically as follows: numbering each brain functional area and organ tissue option buttons according to 0-n numbers, numbering theoretical texts and explicit-implicit buttons corresponding to each brain functional area and organ by 0-n numbers after the theoretical texts and explicit-implicit buttons are established in advance and hiding the theoretical texts and organ in advance, clicking the buttons by using a handle of VR equipment by a user, monitoring that the buttons are clicked by a system, acquiring the numbers corresponding to the buttons and canceling the hiding of the corresponding theoretical texts; and if the user clicks a button for hiding a functional area or organ by using the handle of the VR device, displaying or hiding the functional area or organ corresponding to the number according to the command.
5. The virtual brain-assisted cognitive method according to claim 2, wherein the brain function region test process specifically includes the following steps:
b1, changing the rendering material of the brain tissue into grey after acquiring the test request of the brain functional area;
b2, randomly and repeatedly highlighting each functional area in sequence, obtaining the functional area name selected by the user, and matching the selected functional area name with the highlighted functional area name; if the selection is wrong, the system prompts the selection to be wrong and displays the knowledge point of the functional area as a prompt; if the selection is correct, highlighting the next functional area until all the functional areas are highlighted and the test is finished; after the test is finished, the system displays the test result, including the selection times, the correct answer times and the wrong answer times, and informs the user of the functional area part needing additional learning according to the wrong answer times of the user;
and B3, uploading the test result to a background database.
6. The virtual brain-assisted cognitive method according to claim 5, wherein the step B2 is specifically as follows:
b21, naming a plurality of function areas by numbers 0-n, and naming corresponding function area options and function area error reminders by numbers 0-n;
step B22, creating a list, and adding numbers 0-n in the list to represent 0-n functional areas;
establishing correct answer times x, wherein the initial value is 0;
step B23, creating an error answer number array, wherein the array comprises n elements, the initial values are all 0, and the element values correspond to the error answer number corresponding to each functional area;
b24, randomly generating a number in the list by using the random number, highlighting the functional area corresponding to the number, and deleting the generated random number from the list;
step B25, monitoring the button number selected by the user, matching the button number with the function area number, if the button number is the same as the function area number, continuing to generate the number in the next list, adding one to the correct answer number x, highlighting the new function area, if the button number is different from the function area number, displaying the corresponding error prompt and prompt, adding one to the number of the corresponding function area by the error prompt array, and adding one to the corresponding number of the function area in the error prompt array every time of error selection until the next function area is highlighted;
step B26, after the test of all the functional areas is finished, adding the correct answer times x and each element of the wrong answer time array to obtain total answer times, and obtaining the ratio of each element in the wrong answer time array to the total answer times, thereby obtaining the serial number of the functional area needing to be further learned;
and step B27, finally displaying the total answering times, correct answering times, wrong answering times and wrong answering function area names by the system.
7. The virtual brain-assisted cognitive method according to claim 2, wherein the virtual surgical practice process specifically comprises:
c1, constructing a scene of a virtual lateral ventricle puncture operating room, and providing a virtual puncture needle and a virtual patient;
and C2, after the virtual lateral ventricle puncture is finished, displaying the specific position of the correspondingly placed puncture tube in the ventricle of the patient in a mode of reproducing the CT scanning image of the corresponding patient, and randomly displaying the positions of the other three interference puncture tubes, thereby improving the spatial transformation relation between the CT scanning image and the craniocerebrum and the cognitive ability of the craniocerebrum of the user.
CN202010863612.9A 2020-08-25 2020-08-25 Virtual craniocerebral auxiliary cognitive system and method Active CN111968441B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010863612.9A CN111968441B (en) 2020-08-25 2020-08-25 Virtual craniocerebral auxiliary cognitive system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010863612.9A CN111968441B (en) 2020-08-25 2020-08-25 Virtual craniocerebral auxiliary cognitive system and method

Publications (2)

Publication Number Publication Date
CN111968441A true CN111968441A (en) 2020-11-20
CN111968441B CN111968441B (en) 2022-08-16

Family

ID=73390727

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010863612.9A Active CN111968441B (en) 2020-08-25 2020-08-25 Virtual craniocerebral auxiliary cognitive system and method

Country Status (1)

Country Link
CN (1) CN111968441B (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1883376A (en) * 2006-06-19 2006-12-27 陈宁宁 Self-testing eye chart with speech instruction
US20080235263A1 (en) * 2007-03-02 2008-09-25 Adi, Llc Automating Creation of Digital Test Materials
CN106157774A (en) * 2015-04-03 2016-11-23 王智 A kind of mask method of the anthropometric dummy collection of illustrative plates diagnosed
CN108198247A (en) * 2018-01-12 2018-06-22 福州大学 A kind of lateral cerebral ventricle puncture operation teaching tool based on AR augmented realities
CN109893220A (en) * 2019-02-28 2019-06-18 成都真实维度科技有限公司 A kind of confirmation of auxiliary cerebral hemorrhage puncture drainage puncture path and localization method
DE102018214325A1 (en) * 2018-08-24 2020-02-27 Siemens Healthcare Gmbh Method and provision unit for the provision of a virtual tomographic stroke follow-up examination image
CN111221739A (en) * 2020-01-10 2020-06-02 中国建设银行股份有限公司 Service testing method, device and system
CN111369879A (en) * 2018-12-26 2020-07-03 苏州敏行医学信息技术有限公司 Central venous puncture intelligent training method and system
CN111429765A (en) * 2020-04-27 2020-07-17 裴欣瑶 Brain anatomy VR learning system and method
CN111539509A (en) * 2020-04-16 2020-08-14 山东第一医科大学(山东省医学科学院) Virtual digital brain construction method and system and intelligent robot control system

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1883376A (en) * 2006-06-19 2006-12-27 陈宁宁 Self-testing eye chart with speech instruction
US20080235263A1 (en) * 2007-03-02 2008-09-25 Adi, Llc Automating Creation of Digital Test Materials
CN106157774A (en) * 2015-04-03 2016-11-23 王智 A kind of mask method of the anthropometric dummy collection of illustrative plates diagnosed
CN108198247A (en) * 2018-01-12 2018-06-22 福州大学 A kind of lateral cerebral ventricle puncture operation teaching tool based on AR augmented realities
DE102018214325A1 (en) * 2018-08-24 2020-02-27 Siemens Healthcare Gmbh Method and provision unit for the provision of a virtual tomographic stroke follow-up examination image
CN111369879A (en) * 2018-12-26 2020-07-03 苏州敏行医学信息技术有限公司 Central venous puncture intelligent training method and system
CN109893220A (en) * 2019-02-28 2019-06-18 成都真实维度科技有限公司 A kind of confirmation of auxiliary cerebral hemorrhage puncture drainage puncture path and localization method
CN111221739A (en) * 2020-01-10 2020-06-02 中国建设银行股份有限公司 Service testing method, device and system
CN111539509A (en) * 2020-04-16 2020-08-14 山东第一医科大学(山东省医学科学院) Virtual digital brain construction method and system and intelligent robot control system
CN111429765A (en) * 2020-04-27 2020-07-17 裴欣瑶 Brain anatomy VR learning system and method

Also Published As

Publication number Publication date
CN111968441B (en) 2022-08-16

Similar Documents

Publication Publication Date Title
US10943505B2 (en) Hybrid image/scene renderer with hands free control
US20080050711A1 (en) Modulating Computer System Useful for Enhancing Learning
CN111553979B (en) Operation auxiliary system and method based on three-dimensional reconstruction of medical image
CN107862912A (en) Medical educational system based on VR technologies
CN111968441B (en) Virtual craniocerebral auxiliary cognitive system and method
CN113379929B (en) Bone tissue repair virtual reality solution method based on physical simulation
McBain et al. Scoping review: the use of augmented reality in clinical anatomical education and its assessment tools
Serrano-Vergel et al. Exploring the suitability of using virtual reality and augmented reality for anatomy training
Rubab et al. Exploring Effective Relationships Between Visual-Audio Channels in Data Visualization
Soeiro et al. Mobile solution for brain visualization using augmented and virtual reality
Cecotti et al. Serious game for medical imaging in fully immersive virtual reality
CN116631252A (en) Physical examination simulation system and method based on mixed reality technology
Schott et al. CardioGenesis4D: interactive morphological transitions of embryonic heart development in a virtual learning environment
Aguilar et al. Ar-classroom: Usability of ar educational technology for learning rotations using three-dimensional matrix algebra
CN108665777A (en) The method for being accurately positioned minimum tissue based on virtual reality technology medical anatomy system
CN111798727B (en) Virtual lateral ventricle puncture auxiliary training method, device, equipment and medium
CN113504960B (en) Display method and device for preoperative planning, computer equipment and storage medium
CN110992477B (en) Bioepidermal marking method and system for virtual surgery
CN117573012A (en) Anatomic teaching demonstration method and system
CN111028364B (en) Method and device for simulating physical deformation of biological tissue structure
Coffey et al. THE USE OF 3D MODELLING TO AID VISUALIZATION IN OBSTETRICS E-LEARNING
Xiong et al. IoT Networks and Digital Twin Technology-Based English Classroom Immersive Teaching
CN115756157A (en) Training system based on internet virtual reality
KR20240022746A (en) Method and Apparatus for Providing of Surgery Simulation
Marshall et al. Interactive visualisation for surface proximity monitoring

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant