KR102200663B1 - High-resolution magnetic resonance imaging system-compatible 3-dimensional virtual reality system for functional brain imaging study - Google Patents

Abstract

A 3D virtual reality device compatible with a high-resolution MRI device for functional brain imaging research is presented. An MRI device compatible 3D virtual reality device according to an embodiment includes: a main computer for designing and outputting 3D virtual reality contents; An MR compatible signal conversion unit for converting a signal and outputting the 3D virtual reality content input from the input/output interface of the main computer; Transmits the 3D virtual reality content received from the MR compatible signal conversion unit without interference with the MRI device, and a relay lens is configured on one side and an optical system for magnification on the other side so that image information can be displayed to both eyes of the user. Fiber optic cables coupled; An MR compatible 3D display unit for directly providing the 3D virtual reality content received through the optical fiber cable to both eyes of a user in an MRI device; And an MR compatible game pad provided for real-time interaction with the 3D virtual reality content in order to induce and measure an existential and immersive response related to brain function from a user in the MRI device, wherein the user in the MRI device It is possible to provide a 3D virtual reality environment by video.

Description

High-resolution magnetic resonance imaging system-compatible 3D virtual reality device for functional brain imaging research {HIGH-RESOLUTION MAGNETIC RESONANCE IMAGING SYSTEM-COMPATIBLE 3-DIMENSIONAL VIRTUAL REALITY SYSTEM FOR FUNCTIONAL BRAIN IMAGING STUDY}

The following examples relate to a 3D virtual reality device compatible with a high-resolution magnetic resonance imaging (MRI) device for functional brain imaging research, and more specifically, to induce and measure brain functions with high sense of immersion and presence to the user. The present invention relates to a 3D virtual reality device platform compatible with high-resolution MRI devices for functional brain imaging research.

Virtual reality devices allow a person to feel their physical presence in a virtual reality environment through computer screens, stereo displays, and peripheral devices, and as the performance of computers and stereo display technologies are developed recently, the performance of virtual reality devices is also supported. Is developing.

Currently, virtual reality devices are used for various purposes such as education, treatment, training, communication, and games in schools, hospitals, military, and other information and communication technology and game-related media, and for various research purposes in the fields of cognitive psychology, brain science, and clinical research. It is using a virtual reality device.

In the field of functional brain imaging research using electroencephalogram (EEG), near-infrared spectroscopy (NIRS), positron emission tomography (PET), MRI, etc., virtual reality devices have been introduced in living humans. Research has been conducted to evaluate behavioral function or to develop cognitive dysfunction evaluation and therapeutic approach techniques for various patients such as Alzheimer's and schizophrenia patients.

However, in the case of functional brain imaging research using an MRI device, there are many limitations in applying a commercial virtual reality device due to technical and environmental limitations of the MRI device. In particular, metal materials and electronic equipment cannot be brought into the MRI room (within 5 Gauss line) or the MRI device due to the magnetic field generated by the MRI device.Even if electronic equipment is brought into the MRI room (within 5 Gauss line) or the MRI device Continuous exposure to the magnetic field generated by the MRI device can cause malfunction. Usually, commercial virtual reality devices are electronic devices, so it is not possible to use the MRI device room (within 5 Gauss line) or within the MRI device. In addition, since the RF (radio-frequency) coil, which is used when photographing a human brain using an MRI device, wraps around a person's head at a short distance, it is difficult to use the RF coil while a person is wearing a commercial virtual reality device. it's difficult.

In order to overcome these limitations, a goggle-type MRI device compatible display device using an optical fiber cable has been developed. However, in order to induce and measure an existential and immersive response related to brain function when studying functional brain imaging using an MRI device, the user has a sense of immersion and Contents with a high sense of existence must be provided, and an MRI device compatible platform is required to provide them.

Therefore, when studying functional brain imaging using an MRI device, there is a need for a method that can precisely induce the brain function to be measured while increasing the user's sense of immersion and presence by using a 3D virtual reality device.

Korean Patent Registration No. 10-0812624 relates to such a 3D image-based virtual reality, and describes a technology related to a virtual reality device using a vibrating tactile device through which a user can actually feel a sense.

Korean Patent Registration No. 10-0812624

The examples describe a 3D virtual reality device compatible with a high-resolution MRI device for functional brain imaging research, and more specifically, an MRI device compatible 3D virtual reality device capable of inducing and measuring brain functions with high immersion and presence to the user. It is to provide a real device platform.

Embodiments provide 3D virtual reality content within a high-resolution MRI device and provide a 3D virtual reality device compatible with an MRI device equipped with a virtual reality system and peripheral devices so as to interact with the 3D virtual reality content.

An MRI device compatible 3D virtual reality device according to an embodiment includes: a main computer for designing and outputting 3D virtual reality contents; An MR compatible signal conversion unit for converting a signal and outputting the 3D virtual reality content input from the input/output interface of the main computer; Transmits the 3D virtual reality content received from the MR compatible signal conversion unit without interference with the MRI device, and a relay lens is configured on one side and an optical system for magnification on the other side so that image information can be displayed to both eyes of the user. Fiber optic cables coupled; An MR compatible 3D display unit for directly providing the 3D virtual reality content received through the optical fiber cable to both eyes of a user in an MRI device; And an MR compatible game pad that interacts in real time with the virtual reality content in order to induce and measure an existential and immersive response related to brain function from a user in the MRI device, and 3 by an image to the user in the MRI device. It can provide a dimensional virtual reality environment.

An MR compatible signal conversion unit cradle configured with a rail capable of fixing the optical fiber cable connected from the MR compatible signal conversion unit; And an optical fiber cable holder configured in the form of a rail so as to support the middle portion of the optical fiber cable connected from the MR compatible signal conversion unit to the MR compatible 3D display unit on the bed of the MRI device so as not to touch the user's body but to support the weight. It may further include.

The MR-compatible signal converter cradle and the optical fiber cable cradle on the bed of the MRI apparatus have heights corresponding to each other, so that the optical fiber cable having the number of 800,000 optical fiber cores may be supported for high-resolution image output.

The main computer is located outside the MRI room, the MR compatible signal conversion unit, the optical fiber cable, the MR compatible 3D display unit, and the MR compatible game pad are located inside the MRI unit room and mutually affect the MRI unit It can be designed so that there is no

The main computer may enable a researcher to perform real-time monitoring through a display or the like while a user in the MRI device performs a task during functional brain image research.

The main computer may be equipped with software capable of controlling the output of the 3D virtual reality content to the MR compatible signal conversion unit.

The MR compatible signal conversion unit is disposed in the MRI device room, is composed of a brass case to shield the magnetic field generated from the MRI device, and an internal frame made of acrylic material so that the board and the relay lens inside can be stably mounted. It can be composed of.

The MR compatible signal conversion unit includes a Micro-OLED for providing image information output from the image board to a relay lens connected to an optical fiber cable in a digital form, and a rail is mounted on the holder of the Micro-OLED to -As the distance between the OLED and the relay lens is adjustable, the output image information can be focused.

The optical fiber cable is provided from the MR compatible signal conversion unit located inside the MRI device room to the MR compatible 3D display unit located in the MRI device to transmit and output image information from the outside of the MRI device to the inside. It has a length of 4 meters or more in consideration of the distance, and can have 800,000 fiber cores for high-resolution video output. The MR compatible 3D display unit includes an RF coil coupling unit capable of attaching and fixing various types of RF coils on one side, and two or more types of RF coils may be coupled and fixed to the RF coil coupling unit.

The MR-compatible 3D display unit includes a 10-fold eyepiece optical system part coupled with the optical fiber cable so that the height and the distance between the left and right of the optical system can be adjusted according to personal characteristics including the size of the user's head and the structure of the eye in the MRI apparatus. Can be moved in the x-axis and y-axis directions based on the MRI coordinates.

In the MR compatible game pad, both the outer frame and the bolt are made of acrylic so that it can be used in the MRI device, and the inner side of the outer frame is covered with a protective film made of brass, thereby shielding the magnetic field generated by the MRI device. I can.

The MR compatible game pad is composed of a total of 8 game ports to enable interaction in a 3D virtual reality environment while the user's head and body are fixed in order to acquire a functional brain image in the MRI device. , In one embodiment, when measuring the space search function, among the eight-direction game ports, the four-direction game ports are set to move forward, back, left, and right, and the remaining four-direction game ports are above the head and sight, It can be set to move down, left and right.

According to embodiments, 3D virtual reality content is provided within a high-resolution MRI device to induce brain functions with high immersion and presence during functional brain imaging research, and a virtual reality system and peripheral devices are provided to interact with it. By providing a 3D virtual reality device platform compatible with a high-resolution MRI device, it is possible to perform brain function related tasks that were not possible with conventional technologies in the field of functional brain imaging research.

1 is a diagram illustrating a 3D virtual reality device compatible with a high-resolution MRI device for functional brain image research according to an exemplary embodiment.
2 is a block diagram showing the configuration of a main computer according to an embodiment.
3 is a diagram showing the overall structure of an MR compatible signal converter according to an embodiment.
4 is a diagram illustrating an MR compatible signal converter according to an embodiment.
5 is a diagram illustrating an overall structure of an MR compatible 3D display unit according to an exemplary embodiment.
6 is a diagram illustrating a front view and a rear view of an MR compatible 3D display unit according to an exemplary embodiment.
7 is a diagram illustrating an MR compatible game pad according to an embodiment.
8 is a diagram illustrating a PCB and operating components of an MR compatible game pad according to an exemplary embodiment.
9 is a view showing an optical fiber cable holder according to an embodiment.
10 is a diagram illustrating an MR compatible signal converter cradle according to an embodiment.
11 is a view for explaining an example of 3D virtual reality content according to an embodiment.
12 is a view for explaining another example of 3D virtual reality content according to an embodiment.

Hereinafter, embodiments will be described with reference to the accompanying drawings. However, the described embodiments may be modified in various forms, and the scope of the present invention is not limited by the embodiments described below. In addition, various embodiments are provided to more completely explain the present invention to those of ordinary skill in the art. In the drawings, the shapes and sizes of elements may be exaggerated for clearer explanation.

The following examples provide 3D virtual reality content within a high-resolution MRI device to induce brain functions with a high sense of immersion and presence during functional brain imaging research, and a high-resolution virtual reality device and a peripheral device to interact with it. The present invention relates to a 3D virtual reality device platform compatible with an MRI device. In the field of functional brain imaging research using an MRI device, it is possible to perform brain function-related tasks that were not possible with conventional technologies.

For example, when measuring a spatial search function for a user using an MRI device, in the conventional technology, a specific space is presented as a photo or image, or a brain function is induced by prompting the user to recall the memory of the spatial search. On the other hand, according to the present embodiments, it is possible to induce and measure brain functions in real time while the user directly performs spatial search in a 3D virtual reality environment within the MRI apparatus.

1 is a diagram illustrating a 3D virtual reality device compatible with a high-resolution MRI device for functional brain image research according to an exemplary embodiment.

Referring to FIG. 1, a 3D virtual reality device 1 compatible with a high-resolution MRI device for functional brain image research according to an embodiment includes components located outside the MRI device room and components located inside the MRI device room. The components located outside the MRI room include the main computer 100, and components located inside the MRI room include an MR compatible signal converter 200, an optical fiber cable 400, There is an MR compatible 3D display unit 300, an MR compatible game pad 500, an optical fiber cable holder 600, and an MR compatible signal converter holder 700. Among the 3D virtual reality devices, components located inside the MRI room should be designed so that they do not mutually affect the MRI device.

The main computer 100 may design and output 3D virtual reality content. The main computer 100 enables the researcher to perform real-time monitoring through a display, etc., while the user in the MRI device performs a task during functional brain image research, and outputs 3D virtual reality contents to the MR compatible signal converter 200. Controllable software can be installed.

The MR compatible signal conversion unit 200 may output the 3D virtual reality content input from the input/output interface of the main computer 100 after signal conversion. The MR-compatible signal conversion unit 200 is disposed in the MRI device room and is composed of a brass case capable of shielding the magnetic field generated from the MRI device, and is made of acrylic material so that the internal board and the relay lens can be stably mounted. It can be composed of a frame.

In particular, the MR compatible signal conversion unit 200 includes a Micro-OLED for providing image information output from an image board to a relay lens connected to the optical fiber cable 400 in a digital form, and is attached to the holder of the Micro-OLED. As the rail is mounted and the distance between the Micro-OLED and the relay lens is adjustable, the output image information can be focused.

The optical fiber cable 400 transmits the 3D virtual reality content transmitted from the MR compatible signal conversion unit 200 without interference with the MRI device, and a relay lens is configured on one side to display image information in both eyes of the user. An optical system for magnification may be coupled to the other side.

The optical fiber cable 400 includes an MR compatible 3D display unit 300 located in the MRI device from the MR compatible signal conversion unit 200 located inside the MRI device room to transmit and output image information from the outside of the MRI device to the inside. In consideration of the distance to ), it has a length of 4 meters or more, and can have 800,000 fiber cores for high-resolution video output. As described above, when the optical fiber cable 400 has 800,000 optical fiber cores, a higher resolution image can be output.

The MR-compatible 3D display unit 300 may directly provide 3D virtual reality content transmitted through the optical fiber cable 400 to both eyes of a user in the MRI apparatus.

The MR compatible 3D display unit 300 may be configured based on a goggle type, and an RF coil coupling unit capable of attaching and fixing various RF coil types to one side is configured, and at least two types of RF The coil can be combined and fixed. The MR-compatible 3D display unit 300 is 10 times the optical fiber cable 400 coupled with the optical system so that the height and the distance between the left and right can be adjusted according to personal characteristics including the head size and eye structure of the user in the MRI apparatus. The eyepiece optical system can be moved in the x-axis and y-axis directions based on the MRI coordinates.

The MR compatible gamepad 500 may be provided for real-time interaction with virtual reality content in order to induce and measure an existential and immersive response related to brain function from a user in the MRI device. The MR-compatible gamepad 500 is made of acrylic in both the outer frame and the bolt so that it can be used in the MRI device, and the inner side of the outer frame is covered with a protective film made of brass, so that the magnetic field generated by the MRI device can be shielded. .

This MR-compatible game pad 500 is composed of a total of 8 game ports to enable interaction in a 3D virtual reality environment while the user's head and body are fixed in order to acquire a functional brain image in the MRI device. , According to an embodiment, when measuring the space search function, among the game ports in 8 directions, 4 game ports are set to move forward, back, left, and right, and the remaining 4 game ports are set to move the head and the field of view. It can be set to move down, left and right.

The MR compatible signal conversion unit cradle 700 includes a rail that can fix the optical fiber cable 400 connected from the MR compatible signal conversion unit 200, and the optical fiber cable cradle 600 includes an MR compatible signal conversion unit ( At 200), the intermediate part of the optical fiber cable 400 connected to the MR-compatible 3D display unit 300 is configured in a rail shape so as to be supported on the bed of the MRI device, so that the weight can be supported without touching the user's body. The height of the MR-compatible signal converter cradle 700 and the optical fiber cable cradle 600 on the bed of the MRI device correspond to each other to support an optical fiber cable 400 having 800,000 fiber cores for high-resolution image output. can do.

Each configuration of a 3D virtual reality device compatible with a high-resolution MRI device for functional brain image research according to an embodiment will be described in more detail below.

2 is a block diagram showing the configuration of a main computer according to an embodiment.

2, a block diagram of the configuration of the main computer 100 and the external device is shown, and the main computer 100 is a stimulus design for functional brain image research based on 3D virtual reality and a 3D virtual reality device. Output can be performed, and the researcher can perform real-time monitoring while the user is performing the task during functional brain image research. The main computer 100 may be equipped with software capable of controlling the output of image information to the MR compatible signal conversion unit.

The main computer 100 includes a bus 110, a processor 120, a memory 130, an input/output interface 140, a display 150, a graphic processing unit (GPU) 160, a mass storage device ( 170) and a communication interface 180.

The bus 110 may include a circuit that connects components of a computer to each other and transfers communication (eg, control messages or data) between the components.

The processor 120 may include one or more of a central processing unit, an application processor, and a communication processor (CP). For example, the processor 120 may control at least one other component of the computer and/or perform an operation or data processing related to communication.

The memory 130 may include volatile and/or nonvolatile memory and may store instructions or data related to at least one other component of the computer. As a specific example, software and/or programs may be stored. For example, the program may include a kernel, middleware, an application programming interface (API), and/or an application program (or “application”).

The input/output interface 140 transmits commands or data input from a user or other external device to other component(s) of the computer, or transmits commands or data received from other component(s) of the computer to a user or another external device. It can be output to the device. In this case, the other external device may include a 3D virtual reality device.

The display 150 may include a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, and the like. For example, the display 150 may display various contents (eg, text, images, videos, icons, etc.) to the user.

The GPU 160 may process image information and output an image to the display 150.

The mass storage device 170 may be divided into a solid state drive (SSD) and a hard disk drive (HDD). The main storage device, SSD, installs and runs programs such as MatLab or Unity using high-speed processing power, and the HDD can store a large amount of data.

The communication interface 180 may establish communication between the computer and the server 800. For example, the communication interface 180 may be connected to a network through wireless communication or wired communication to communicate with an external device.

3 is a diagram showing the overall structure of an MR compatible signal conversion unit according to an embodiment, and FIG. 4 is a diagram showing an MR compatible signal conversion unit according to an embodiment. More specifically, FIG. 4 is a (a) plan view, (b) a bottom view, (c) of the MR compatible signal conversion unit of FIG. 3 It is a figure showing a front view and (d) a perspective view.

3 and 4, the MR-compatible signal conversion unit 200 performs MR-compatible 3 stimulus for functional brain imaging research based on 3D virtual reality output from the main computer through an optical fiber cable without interference with the MRI device. It can be provided as a dimensional display unit.

The MR compatible signal conversion unit 200 considers that 1) an image board for outputting image information received from the input/output interface of the main computer to a Micro-OLED, and 2) an optical fiber cable may not easily reach the image emitting part. A relay lens capable of applying C-mount and creating a virtual image of image information on an optical fiber cable, 3) Micro-OLED to provide image information output from an image board to a relay lens connected to an optical fiber cable in digital form, 4) Power board and power cable for supplying power to the MR compatible signal converter 200, 5) connector board for controlling the image board and power board, and 6) brass for shielding the magnetic field generated from the MRI device It can be composed of a case (including an acrylic internal frame and brass bolts).

The brass case of the MR compatible signal conversion unit 200 is configured to shield the magnetic field generated from the MRI device, and the inside of the MR compatible signal conversion unit 200 is made of acrylic material so that the board and the relay lens can be stably mounted. It can be composed of an inner frame of. In particular, a rail is mounted on the Micro-OLED cradle so that the distance between the Micro-OLED and the relay lens can be adjusted, so that the output image information can be focused. In addition, an external power cut-off switch can be installed on the side of the case to quickly cut off power in case of an emergency that may occur during functional brain imaging studies.

5 is a diagram illustrating an overall structure of an MR compatible 3D display unit according to an embodiment, and FIG. 6 is a view showing a front view and a rear view of an MR compatible 3D display unit according to an embodiment.

5 and 6, the optical fiber cable 320 transmits and outputs image information from the MR-compatible signal converter to the MR-compatible 3D display unit 300, and an optical fiber to display image information to both eyes of a user. A relay lens may be coupled to one end of the cable 320 and a 10-fold eyepiece optical system 310 may be coupled to the other end of the cable 320.

In addition, since the optical fiber cable 320 needs to transmit and output image information into the MRI device from outside the MRI device, from the MR compatible signal converter located inside the MRI device room to the MR compatible 3D display unit 300 located in the MRI device. It has a length of more than 4 meters in consideration of the distance of and can have 800,000 fiber cores for high resolution video output.

The MR compatible 3D display unit 300 is a part that directly provides stimulation for functional brain image research (eg, visual content, etc.) based on 3D virtual reality to both eyes of a user in the MRI apparatus.

More specifically, the MR compatible 3D display unit 300 needs to transmit the image information output from the main computer to both eyes of the user while being mounted on the RF coil (32 channel head coil and 8 channel head coil, etc.). The structure is configured according to the shape of the user, and the height and the distance between the left and right of the optical system 310 must be adjustable according to personal characteristics such as the size of the user's head and the structure of the eyes. The (310) part can be moved in the x-axis and y-axis directions based on the MRI coordinates. At this time, the RF coil is coupled and fixed to the RF coil coupling unit 350, and the distance between the user's eyes is adjusted through the distance adjustment unit 330 between the eyes, and the relay lens and the optical fiber cable are used using the height adjustment unit 340. The height of (320) can be adjusted.

In addition, the frame of the MR compatible 3D display unit 300 is made of acrylic so that it can be used without interference with the MRI signal in the MRI device, and the bolts used for connection between frames and fixing to the RF coil have strong fixing force and In order to prevent distortion of the MRI image, it can be made of a non-magnetic brass material.

7 is a diagram illustrating an MR compatible game pad according to an embodiment.

Referring to FIG. 7, the MR compatible game pad 500 interacts in real time with virtual reality contents provided by a 3D virtual reality device to induce and measure an existential and immersive response related to brain function during functional brain image research. In order to be used in the MRI device, both the outer frame and the bolt may be made of acrylic.

8 is a diagram illustrating a PCB and operating components of an MR compatible game pad according to an exemplary embodiment.

As shown in FIG. 8, the inside of the outer frame of the MR compatible game pad 500 is covered with a protective film made of brass, so that the magnetic field generated by the MRI device can be shielded. Accordingly, interference between the magnetic field and the PCB and moving parts existing in the MR compatible game pad 500 can be reduced.

Table 1 shows the moving parts of the MR compatible game pad of FIG. 8, and the moving parts are largely divided into eight types. The numbers here indicate the parts shown in FIG. 8.

[Table 1]

Among the moving parts, the switch has a metal reaction, but there are no alternative moving parts that can be used in the MRI device, so it can be used in a removed state.

The MR-compatible gamepad 500 may be configured with a total of 8 game ports to enable interaction in a 3D virtual reality environment while the user's head and body are fixed in order to acquire a functional brain image within the MRI device. have. In one embodiment, in order to freely move in a 3D virtual reality environment when the user performs space search, the game ports in 4 directions out of 8 direction game ports are set to move forward, back, left and right, and the rest The four-way game port can be set to move the head and sight up, down, left and right.

The MR compatible game pad 500 must be used by a user lying in the MRI apparatus while connected to a main computer located outside the MRI apparatus room. Therefore, it has a total length of 11 meters in consideration of the distance from the outside of the MRI room to the inside of the MRI device, and is compatible with MRI equipment so that it can be used inside the MRI device.

9 is a view showing an optical fiber cable holder according to an embodiment. And FIG. 10 is a diagram illustrating an MR compatible signal converter cradle according to an embodiment. 9 is a (a) front view and (b) a plan view of an optical fiber cable holder according to an embodiment, and FIG. 10 is a (a) front view and (b) a plan view of the MR compatible signal converter holder according to an embodiment .

9 and 10, the optical fiber cable and the MR-compatible signal converter cradle are parts necessary to mount the devices in the MRI room, and the height, weight, and length of the optical fiber cable connected to the MR-compatible 3D display unit , May be configured in consideration of the location inside the MRI room.

The MR-compatible signal conversion unit cradle can be configured with a rail that can fix the optical fiber cables that are connected from the MR-compatible signal conversion unit when viewed from above.

The fiber optic cable holder is constructed in the form of a rail so that the middle part of the fiber optic cable connected from the MR compatible signal converter to the MR compatible 3D display unit can be held on the bed of the MRI device, so it can support the weight without touching the user's body. It can be configured to be.

Example

A 3D virtual reality device compatible with a high-resolution MRI device for functional brain image research proposed in the present embodiment can be configured as follows.

The main computer, located outside the MRI room, has an Intel Xeon E5-2604v4 CPU for fast software processing, a GTX 1080 (8 gigabytes) to assist in 3D graphics processing, and 64 gigabytes of RAM (RAM) to support a large-capacity process. Can be mounted. In addition, the OS is composed of Windows 10 and the Unity program is installed, allowing 3D virtual reality content to be produced and provided to external devices. In addition, data and statistical analysis programs such as MATLAB, SPM, and SPSS, and software that can control the output of image information to an MR-compatible signal converter can be installed. In addition, dual monitors, MR-compatible signal converters and game pads are directly connected to the main computer's main body, allowing researchers to monitor users' task performance through the main computer during functional brain imaging studies, and MR-compatible 3D display. It is possible to output 3D virtual reality contents of Buro, and users can interact in real time in a 3D virtual reality environment.

The MR-compatible 3D display unit, the optical fiber cable, the MR-compatible signal converter, and the MR-compatible gamepad were manufactured based on the drawings proposed in this example, and are located inside the MRI room and in the MRI device, and are applied when studying functional brain imaging. have.

In addition, in functional brain imaging research, 3D virtual reality contents for measuring spatial search functions were developed, and the contents were applied to the 3D virtual reality device proposed in this embodiment.

11 is a view for explaining an example of 3D virtual reality content according to an embodiment.

As shown in FIG. 11, by providing the two images separated by using a stereoscopic effect provided by the Unity program to both eyes of the user, it is possible to feel a three-dimensional effect in a virtual reality space.

12 is a view for explaining another example of 3D virtual reality content according to an embodiment.

As shown in Fig. 12, in order to measure the brain function related to spatial exploration ability during functional brain image research, a virtual reality environment (baseline) in the form of a maze is presented for spatial exploration in unfamiliar and familiar spaces. By creating a virtual reality environment (task) with the motif of a specific university and presenting it to the user, it is possible to measure the spatial search function of a living person.

A 3D virtual reality device compatible with a high-resolution MRI device for functional brain imaging research according to embodiments and a method of operating the same are used together with a commercial MRI device, and provide stimulation based on 3D virtual reality when studying functional brain imaging. At the same time, the user can measure brain functions with high sense of immersion and presence through interaction with real-time stimuli. Through this, a tool for evaluating the existential brain function of a living person can be prepared. In addition, it is possible to prepare tools for evaluating and treating cognitive function of patients during clinical research.

The apparatus described above may be implemented as a hardware component, a software component, and/or a combination of a hardware component and a software component. The devices and components described in the embodiments are, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA), a programmable logic unit (PLU). unit), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications executed on the operating system. In addition, the processing device may access, store, manipulate, process, and generate data in response to the execution of software. For the convenience of understanding, although it is sometimes described that one processing device is used, one of ordinary skill in the art, the processing device is a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of these, configuring the processing unit to behave as desired or processed independently or collectively. You can command the device. Software and/or data may be interpreted by a processing device or to provide instructions or data to a processing device, of any type of machine, component, physical device, virtual equipment, computer storage medium or device. Can be embodyed. The software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those produced by a compiler but also high-level language codes that can be executed by a computer using an interpreter or the like.

As described above, although the embodiments have been described by the limited embodiments and drawings, various modifications and variations are possible from the above description by those of ordinary skill in the art. For example, the described techniques are performed in a different order from the described method, and/or components such as a system, structure, device, circuit, etc. described are combined or combined in a form different from the described method, or other components Alternatively, even if substituted or substituted by an equivalent, an appropriate result can be achieved.

Therefore, other implementations, other embodiments, and claims and equivalents fall within the scope of the claims to be described later.

Claims (13)

A main computer for designing and outputting 3D virtual reality contents;
An MR compatible signal conversion unit for converting a signal and outputting the 3D virtual reality content input from the input/output interface of the main computer;
Transmits the 3D virtual reality content received from the MR compatible signal conversion unit without interference with the MRI device, and a relay lens is configured on one side and an optical system for magnification on the other side so that image information can be displayed to both eyes of the user. Fiber optic cables coupled;
An MR compatible 3D display unit which directly provides the 3D virtual reality content received through the optical fiber cable to both eyes of a user in an MRI device; And
MR compatible gamepad provided for real-time interaction with the 3D virtual reality contents in order to induce and measure an existential and immersive response related to brain function from a user in the MRI device
Including,
The MR compatible signal conversion unit,
Includes a Micro-OLED for providing image information output from the image board to a relay lens connected to an optical fiber cable in digital form, and a rail is mounted on the holder of the Micro-OLED to between the Micro-OLED and the relay lens. As the distance is adjustable, the output image information can be focused,
A 3D virtual reality device compatible with an MRI device that provides a 3D virtual reality environment based on an image to a user in the MRI device. The method of claim 1,
An MR compatible signal conversion unit cradle configured with a rail capable of fixing the optical fiber cable connected from the MR compatible signal conversion unit; And
An optical fiber cable holder configured in the form of a rail to support the middle part of the optical fiber cable connected from the MR compatible signal conversion unit to the MR compatible 3D display unit on the bed of the MRI device so that it does not touch the user's body but supports the weight
A 3D virtual reality device compatible with an MRI device further comprising a. The method of claim 2,
The MR compatible signal conversion unit cradle and the optical fiber cable cradle on the bed of the MRI device correspond to each other in height to support the optical fiber cable having the number of 800,000 optical fiber cores for high-resolution image output.
Characterized in that, MRI device compatible 3D virtual reality device. The method of claim 1,
The main computer is located outside the MRI room, the MR compatible signal conversion unit, the optical fiber cable, the MR compatible 3D display unit, and the MR compatible game pad are located inside the MRI unit room and mutually affect the MRI unit Designed to be
Characterized in that, MRI device compatible 3D virtual reality device. The method of claim 1,
The main computer,
When studying functional brain imaging, the researcher can monitor in real time while the user in the MRI device performs the task.
Characterized in that, MRI device compatible 3D virtual reality device. The method of claim 1,
The main computer,
The software capable of controlling the output of the 3D virtual reality content to the MR compatible signal conversion unit is installed
Characterized in that, MRI device compatible 3D virtual reality device. The method of claim 1,
The MR compatible signal conversion unit,
Arranged in the MRI device room, a brass case is configured to shield the magnetic field generated by the MRI device, and an internal frame made of acrylic material so that the board and the relay lens inside can be stably mounted
Characterized in that, MRI device compatible 3D virtual reality device. delete The method of claim 1,
The optical fiber cable,
Considering the distance from the MR compatible signal converter located inside the MRI device room to the MR compatible 3D display unit located in the MRI device in order to transmit and output image information from the outside of the MRI device to the inside, 4 It has a length of meters or more and has 800,000 fiber cores for high-resolution video output.
Characterized in that, MRI device compatible 3D virtual reality device. A main computer for designing and outputting 3D virtual reality contents;
An MR compatible signal conversion unit for converting a signal and outputting the 3D virtual reality content input from the input/output interface of the main computer;
Transmits the 3D virtual reality content received from the MR compatible signal conversion unit without interference with the MRI device, and a relay lens is configured on one side and an optical system for magnification on the other side so that image information can be displayed to both eyes of the user. Fiber optic cables coupled;
An MR compatible 3D display unit for directly providing the 3D virtual reality content received through the optical fiber cable to both eyes of a user in an MRI device; And
MR compatible gamepad provided for real-time interaction with the 3D virtual reality contents in order to induce and measure an existential and immersive response related to brain function from a user in the MRI device
Including,
The MR compatible 3D display unit,
An RF coil coupling portion capable of attaching and fixing various types of RF coils on one side is configured, and two or more types of RF coils can be coupled and fixed to the RF coil coupling portion,
A 3D virtual reality device compatible with an MRI device, which provides a 3D virtual reality environment by image to a user in the MRI device. The method of claim 1,
The MR compatible 3D display unit,
In order to adjust the height of the optical system and the distance between the left and right according to the personal characteristics including the size of the user's head and the structure of the eyes in the MRI device, the 10-fold eyepiece optical system part coupled with the optical fiber cable is based on MRI coordinates x-axis and y Axially movable
Characterized in that, MRI device compatible 3D virtual reality device. A main computer for designing and outputting 3D virtual reality contents;
An MR compatible signal conversion unit for converting a signal and outputting the 3D virtual reality content input from the input/output interface of the main computer;
Transmits the 3D virtual reality content received from the MR compatible signal conversion unit without interference with the MRI device, and a relay lens is configured on one side and an optical system for magnification on the other side so that image information can be displayed to both eyes of the user. Fiber optic cables coupled;
An MR compatible 3D display unit which directly provides the 3D virtual reality content received through the optical fiber cable to both eyes of a user in an MRI device; And
MR compatible gamepad provided for real-time interaction with the 3D virtual reality contents in order to induce and measure an existential and immersive response related to brain function from a user in the MRI device
Including,
The MR compatible game pad,
Both the outer frame and the bolt are made of acrylic so that they can be used in the MRI device, and the inner side of the outer frame is covered with a protective film made of brass to shield the magnetic field generated by the MRI device,
A 3D virtual reality device compatible with an MRI device that provides a 3D virtual reality environment based on an image to a user in the MRI device. The method of claim 1,
The MR compatible game pad,
In order to obtain a functional brain image within the MRI device, it is composed of a total of 8 game ports to enable interaction in a 3D virtual reality environment while the user's head and body are fixed. Among the 8-direction game ports, the 4 game ports are set to move forward, back, left and right, and the remaining 4 direction game ports are set to move the head and view up, down, left and right.
Characterized in that, MRI device compatible 3D virtual reality device.

Images