WO2018056790A1 - Device, method, and program for memory training through brain stimulation - Google Patents

Device, method, and program for memory training through brain stimulation Download PDF

Info

Publication number
WO2018056790A1
WO2018056790A1 PCT/KR2017/010631 KR2017010631W WO2018056790A1 WO 2018056790 A1 WO2018056790 A1 WO 2018056790A1 KR 2017010631 W KR2017010631 W KR 2017010631W WO 2018056790 A1 WO2018056790 A1 WO 2018056790A1
Authority
WO
WIPO (PCT)
Prior art keywords
computer
response
user
memory
screen
Prior art date
Application number
PCT/KR2017/010631
Other languages
French (fr)
Korean (ko)
Inventor
강동화
김동호
Original Assignee
재단법인 아산사회복지재단
울산대학교 산학협력단
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 재단법인 아산사회복지재단, 울산대학교 산학협력단 filed Critical 재단법인 아산사회복지재단
Priority to EP17853504.3A priority Critical patent/EP3517160B1/en
Priority claimed from KR1020170123892A external-priority patent/KR101939339B1/en
Publication of WO2018056790A1 publication Critical patent/WO2018056790A1/en
Priority to US16/363,884 priority patent/US11376393B2/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis

Definitions

  • the present invention relates to a memory training apparatus, a method and a program, and more particularly, to a device, a method and a program for stimulating the brain to improve memory.
  • the present invention provides an apparatus and method for training spatial memory through brain stimulation that enhances the effect of improving spatial memory by simultaneously providing visual perception stimulation and spatial memory stimulation to a user's brain.
  • a computer provides a first problem on a task display unit within a screen, wherein the first problem is displayed on one or more output images at a specific position in the task display unit space. That is, the first problem providing step; A first response from the user to the computer, wherein the first response is a result of comparing the first problem provided before N times (N is a natural number) with the currently provided first problem Receiving step; And a response evaluation step of the computer evaluating the memory state of the user based on the first response.
  • the first problem providing step may include a computer measuring a gaze direction of a user and determining an arrangement position of an output image according to the first problem based on the gaze direction. It is done.
  • the first problem is provided by changing at least one of the number, type, arrangement position, and size of the output image, and the first response is N times the currently provided screen image. It is to input whether or not to match the previous screen image, wherein the screen image is the screen itself on which one or more output images are arranged according to the first problem.
  • the value of N is adjusted according to the user state.
  • the providing of the first problem may include determining a location in a three-dimensional space that displays an output image included in the first problem, based on a location in the three-dimensional space of the second problem. It is characterized by.
  • the computer provides a first problem on the screen of the head mounted display device.
  • the task display unit on the screen provides a first problem
  • the computer receives a first response to the first problem from the user
  • the computer Evaluate the memory state of the user based on the response, wherein the first problem is one or more output images are displayed at a specific position in the task display space, and the first response is the first problem provided N times and the currently provided The result of comparing the first problem.
  • the memory training program through brain stimulation is combined with a computer which is hardware to execute the above-mentioned memory training method through brain stimulation, and is stored in a medium.
  • a spatial memory stimulation and visual perception stimulation at the same time to the user's brain can improve the effect of improving spatial memory.
  • spatial memory when spatial memory is deteriorated due to brain damage or aging (for example, patients with dementia) or when spatial memory is insufficient due to normal growth, there is an effect of improving spatial memory through brain stimulation.
  • it when applied to growing children, it can provide an effect of improving the spatial memory of the child.
  • FIG. 1 is a flow chart of a memory training method through brain stimulation according to an embodiment of the present invention.
  • Figure 2 is a flow chart of the memory training method through the brain stimulation, further comprising a second problem providing and response process according to an embodiment of the present invention.
  • FIG. 3 is an exemplary diagram illustrating a process of performing memory training in accordance with a first problem according to an embodiment of the present invention.
  • Figure 4 is an internal configuration of the memory training apparatus through brain stimulation according to an embodiment of the present invention.
  • the 'computer' includes all the various devices capable of performing arithmetic processing.
  • a computer can be a desktop PC, a notebook, as well as a smartphone, a tablet PC, a cellular phone, a PCS phone (Personal Communication Service phone), synchronous / asynchronous
  • the mobile terminal of the International Mobile Telecommunication-2000 (IMT-2000), a Palm Personal Computer (PC), a Personal Digital Assistant (PDA), and the like may also be applicable.
  • the computer may also be a server computer that receives information from a client.
  • the 'first problem' refers to a problem provided on a screen in order to provide memory training to a user.
  • the "first problem” is a problem in which the user is requested to compare and judge the problem before N times.
  • the 'first response' means a response to a first problem provided at a specific time.
  • the 'second problem' refers to a problem provided to fix a user's gaze direction to a screen center.
  • the second problem may be to display any one of a plurality of objects (for example, ⁇ or ⁇ ) that is distinguished in the center of the screen at a specific time in the center of the screen.
  • the 'second response' refers to a response received from the user with respect to the second problem.
  • the 'output image' refers to an image provided at a specific position on the screen by the first problem.
  • the 'output image' may be a horizontal or vertical striped image displayed in a specific quadrant on the screen.
  • the 'screen image' is a screen itself on which one or more output images are arranged according to the first problem.
  • the screen image may be output to a general display device or to a head mounted display device.
  • the screen image may be generated as a left eye image and a right eye image, respectively.
  • the 'central field view part' means a central area within a screen provided to a user.
  • the 'near viewable part' refers to a remaining area of the screen except for the center viewable part.
  • a 'task display unit' refers to a region in which an output image which is a task of memory training is provided in a screen provided to a user.
  • the 'desk display unit' may include only the peripheral field of view except for the central field of view, or may include both the central field of view and the surrounding field of view.
  • FIG. 1 is a flow chart of a memory training method through brain stimulation according to an embodiment of the present invention.
  • a memory training method through brain stimulation may include: providing a first problem by a computer to a task display unit on a screen (S200; providing a first problem); Receiving, by the computer, a first response to the first problem from the user (S300; first response receiving step); And evaluating, by the computer, the memory state of the user based on the first response (S600; response evaluation step).
  • the computer provides a first problem to the task display unit on the screen (S200; a first problem providing step).
  • the first problem is that one or more output images are displayed at a specific position in the task display unit.
  • the first problem is provided by changing at least one of the number, type, arrangement position and size of the output image.
  • the first problem may be varied by changing the arrangement position of the output image included in the screen for each trial providing the first problem on the screen.
  • the computer may generate another screen image by changing the position on the screen where the same output image is displayed. Changing the position of the output image means that when the task display unit is divided into a plurality of divided regions, the divided region in which the output image of the first problem is displayed or a point where the output image is arranged in the same divided region is different. It may be.
  • the computer can generate various problem forms by changing the depth at which the output image is displayed.
  • the computer may display the output image by dividing it into an area near or far from the reference depth (eg, the depth at which the second problem is indicated when the second problem is provided).
  • the first problem providing step (S200) determines the position in the three-dimensional space for displaying the output image included in the first problem.
  • the images provided to the left and right eyes that is, the left eye image and the right eye image
  • the computer converges the left eye image and the right eye image with respect to the second problem while arranging the second problem to be described later at a specific depth, and arranges the output image according to the first problem at a specific depth to be disposed at the reference depth.
  • a screen in which the output image is displayed at various depths can be implemented.
  • the computer may change the type of the output image (for example, the classification of the figure and the character image, etc.) or the shape (for example, the horizontal stripe pattern and the vertical stripe pattern) to solve different first problems. Can be generated.
  • the computer may generate different problems by displaying output images of different shapes (for example, horizontal stripes and vertical stripes) at the same location of the task display unit.
  • the computer may create different first problems as the size of the output image is changed while displaying the same output image type / shape at the same location.
  • the computer receives a first response to the first problem from the user (S300; receiving a first response).
  • the first response is a result of comparing the first problem provided before N times (N is a natural number) with the currently provided first problem. For example, if N is 1, the computer compares the first first problem (ie, the screen image according to the previous first problem) with the current first problem (the screen image displayed on the current screen) from the user. The first response is received as a result of determining whether or not it is. Also, for example, if N is a specific natural number other than 1, the computer may receive from the user the result of comparing the current screen image with the screen image provided in the trial N times from the current trial as the first response of the current trial. Can be.
  • the computer evaluates the memory state of the user based on the first response (S600; response evaluation step). That is, when receiving a result of comparing the screen image with N times before as the first response, the computer compares the screen image with the previous N times and the current screen image stored therein to determine whether it is the same. To this end, in the case of performing spatial memory training in comparison with the previous N trials, the computer may store screen images of the N trials before. In addition, the computer may delete the screen image of the previous trial N times after comparison with the screen image of the current trial. When the first response input from the user is determined to be a correct answer, the computer may immediately inform the user that the answer is correct or increase the number of correct answers.
  • the computer may determine the memory state of the user based on the number of correct answers and adjust the difficulty of memory training. For example, if the memory training result at a specific N value of the user is good, the computer can increase the difficulty by increasing the N value of the memory training provided to the user at the next training. In other words, the computer can increase the difficulty of memory training by increasing the trial interval requiring the user to remember. Also, for example, the computer may increase the difficulty by lowering the brightness or saturation of the output image provided on the screen or reducing the size of the output image.
  • the computer may adjust the difficulty level by adjusting the number of output images appearing in the screen image. As the number of output images increases, the degree of difficulty may increase due to a complicated arrangement of output images. For example, in the case of providing horizontal stripes and vertical stripes as an output image, the computer may generate a screen image by providing a specific output image among horizontal stripes or vertical stripes to a part of the plurality of divided regions in the screen. The user has to compare whether the plurality of output image arrangement positions of the current trial and the types of output images displayed at each position are the same as the previous trial N times, thus providing a first problem having a higher difficulty level than when one output image is provided. Will receive.
  • the computer may determine whether any type of output image is memory based on the result of memory training of the patient. For example, memory may be degraded for an image displayed at a specific position within a viewing range according to a patient's condition, or memory for a specific shape may be degraded. Thus, the computer can determine the type of memory that the patient falls into based on the results of the brain stimulation training.
  • the screen image having a specific trial interval specific to the user that is, the current screen image and the previous screen image N times
  • the user should be made to visually recognize the screen image provided based on the first problem of the same condition.
  • the computer can apply various ways to provide the same screen image in each trial by the first problem of the same condition.
  • the computer may measure the user's gaze direction, determine the arrangement position of the output image according to the first problem based on the gaze direction can be provided.
  • the computer recognizes the user's bow movement or eye movement, acquires the gaze direction, and determines the arrangement position of the output image based on the gaze direction.
  • the computer measures the user's motion based on the motion data acquired through the motion sensor included in the head mounted display device.
  • the computer measures the eye movement based on eye movement data acquired by an eye movement sensor (ie, an eye tracker) included in the head mounted display device.
  • the computer calculates the visual direction (ie, the center direction of the visual field range) when the user's bow movement or eye movement is present.
  • the computer displays the output image about the visual direction (ie, the direction of the center of the viewing range) to generate the screen image provided for the particular trial.
  • the output image arrangement position information in the first problem is a relative position determined based on the visual direction (ie, the center direction of the viewing range), and the computer displays the screen image of each trial based on the output image arrangement position information in the first problem. Create Through this, the computer can smoothly provide memory training while the user performs free head movements and eye movements.
  • the computer provides a second problem displayed on the central field of view in the screen (S400; second problem providing step); And receiving a second response to the second problem (S500; receiving a second response).
  • the second problem serves to fix the gaze direction of the user at a specific position.
  • the second problem may be provided simultaneously with the first problem provided on one side of the task display unit. That is, a screen image for simultaneously displaying the first problem and the second problem on the screen is provided so that the user checks the first problem while the user watches the center view portion where the second problem is displayed. As the user looks at the central field of view where the second problem is displayed to input a correct answer to the second problem, the same condition of providing the screen image in the user's field of view may be formed.
  • the computer may accurately calculate the memory training result by excluding the first response inputted when the computer is not suitable to perform the response to the first problem.
  • the computer may determine whether the brain stimulation memory training is properly performed in a state where the gaze is fixed at the center of the screen based on the correct answer rate of the second problem displayed on the central field of view. For example, as the second problem is displayed in the small center of the screen, if the user does not accurately observe the central field of view where the second problem is displayed, the computer may set the correct answer rate to not be higher than a certain correct rate. It is determined whether the central fixation is properly performed. If the correct answer rate of the second response to the second problem is lower than the specified value, the computer may determine that the training is not performed properly and guide or re-perform the training.
  • FIG. 3 is a diagram for describing a method of training memory in a state in which a gaze direction of a user is fixed at a screen center based on a second problem according to an embodiment of the present invention.
  • the controller 130 displays the task display units 221 to 224 220 other than the center view 210 and the center view 210 as the memory training image 200. )
  • the central field of view 220 is a central area within the screen on which the problem 230 for fixing the user's gaze direction is displayed. That is, the central view unit 210 may include a predetermined problem (ie, a second problem) for fixing the focus of the user at the center.
  • the center view unit 210 may include a character or figure that can be guessed by the user, and the user may answer an answer corresponding to the character or figure included in the center view unit 210. 140).
  • the task display unit 220 is an area in which an output image to be compared with a previous trial is provided for the user's memory test.
  • the task display unit may divide the area in which the output image is displayed in various ways or numbers. For example, the task display unit 220 divides the virtual horizontal lines and the vertical lines based on the screen (ie, the memory training image) 200 as the quadrants into quadrants 221 to 224, and then divides the first quadrant into at least one quadrant. It may contain the output image according to the problem.
  • the first problem included in the task display unit 220 may be related to at least one of a spatial position, number, shape, and color of an output image (eg, a figure) displayed in at least one quadrant.
  • the computer can display the quadrant position at which the output image is provided, the position at which the output image is displayed within the quadrant, the type of the output image (for example, stripes or character images), and the shape of the output image (for example, horizontal stripes or vertical lines).
  • Various screens ie, memory training images
  • the computer outputs the screen image 220 including the central view 210 and the first problem 231 of the M-th point as the M-th training image 200.
  • the computer is the M + 1th training image 200 and the second problem provided to the central field of view 210 and the M + 1 time point provided to the task display unit 220.
  • the screen image 220 including one problem 232 is output.
  • the computer is provided with the second problem provided to the central field of view 210 as the M + Nth training image 200 and the M + N time point provided to the task display unit 220.
  • the screen image 220 including the first problem 232 is output.
  • the computer includes a first problem 231 in which the first problem 233 included in the M + N th training image 200 is included in the training image 200 before M times.
  • the user's answer regarding whether or not may be received through the user input unit 140. That is, the computer receives a response from the user as to whether the screen image according to the first problem at the Nth point and the screen image according to the first problem at the M + N point coincide.
  • the user may include a spatial position (eg, a specific position in a specific quadrant) of the figure included in the first problem 233 included in the M + N th training image 200, a shape of the figure, and a shape of the figure. If the number, the size of the figure, the color of the figure, etc. match the first problem 231 included in the N-th training image 200, O may be input. If one does not match, X may be input.
  • the user may input an answer as to whether the N-th training image 200 corresponds to a problem included in the previous image, and FIG. 3B.
  • the user's answer may be input as to whether or not a match with a problem included in a previous image of a specific number of times of the M + 1 th training image 200 is obtained.
  • the user can improve the short-term and medium-long term memory through repetitive training, which remembers the problems contained in the task display part of the training image before a certain number of times and compares the problems included in the task display part of the current training image.
  • the spatial memory can be trained by storing the position of the output image provided in the screen image.
  • the hippocampus of the brain is in charge of spatial memory, and the recovery of function by stimulating the hippocampus by brain connectivity only with visual perceptual learning training (ie, training to provide a visual stimulus to the patient). It is possible. Accordingly, the present invention provides the effect of increasing visual memory stimulation speed by repeatedly providing visual perception stimuli to the eye and training to remember spatial arrangement in order to improve hippocampus function in charge of spatial memory. do.
  • the present invention is a brain region (for example, primary visual domain, parietal lobe, frontal lobe) that performs the Egocentric (sensory receptor center) processing of space-time and space-time environment allocentric (space-time environment itself)
  • a brain region for example, primary visual domain, parietal lobe, frontal lobe
  • Egocentric sensor receptor center
  • space-time and space-time environment allocentric space-time environment itself
  • FIG. 4 is an internal configuration diagram of a memory training apparatus through brain stimulation according to an embodiment of the present invention.
  • the memory training apparatus 100 may include all or a portion of the display 110, the memory 120, the controller 130, and the user input unit 140.
  • the memory training apparatus 100 may be a computer, a personal computer, a display device, a portable terminal, or the like, but is not limited thereto.
  • the memory training device 100 is a device for training spatial memory by visually stimulating a user's brain.
  • the spatial memory power may mean a memory power for a spatial position, a shape, and the like of a visual display (for example, a figure) appearing in front of the visual field.
  • the memory 120 stores a memory training program.
  • the memory training program may be a native program pre-installed in the memory training apparatus 100 or a program downloaded and installed from an external server.
  • the memory 120 may be an external memory connected to or inserted into the memory training apparatus 100.
  • the controller 130 may output a training image corresponding to the visual perception training program to the display 110.
  • the training image may include a task display unit for fixing the focus of the user to the center.
  • the task display unit may include a predetermined problem (ie, a first problem) for training the spatial memory of the user. That is, the task display unit displays the output image according to the first problem at a specific position in a two-dimensional or three-dimensional space.
  • the task display unit may use only the peripheral field of view, or may use both the peripheral field of view and the central field of view.
  • the first problem may be performed on the task display unit in various ways.
  • the output image (eg, figure) of the first problem may be displayed in a specific quadrant among the four divided quadrants of the task display unit, and the placement position in the specific quadrant, the shape, size, and color of the output image. At least one can be adjusted.
  • the user input unit 140 may receive a user input related to the memory training image.
  • the user may input a response corresponding to a problem included in the central view field unit and a problem included in the task display unit through the user input unit 140.
  • the controller 130 outputs the task display unit including the center view portion and the first problem as the M-th training image to the display 110, and the task including the center view portion and the second problem as the M + N-th training image.
  • the display unit may be output to the display 110 and the user input unit may answer the user's answer as to whether the second problem included in the M + Nth training image matches the first problem included in the training image before N times. 140). That is, the controller 130 determines whether the answer is correct by receiving a first response, which is a result of comparing the first problem provided N times and the currently provided first problem, from the user through the user input unit 140.
  • the controller 130 may adjust the difficulty level of the problem included in the task display unit based on the correct answer rate of the answer input through the user input unit 140.
  • the difficulty of the problem included in the task display unit may be adjusted by adjusting the number of N or adjusting at least one of the number, shape, and color of the figure displayed in the task display unit.
  • the controller 130 provides a second problem for fixing the user's gaze direction to the center of the screen in the center view portion of the display 110.
  • the second problem is a predetermined problem for focusing the user's attention so that the user's focus is fixed at the center.
  • the controller 130 may use only the peripheral view portion as a task display unit that provides the first problem so that the first problem and the second problem do not overlap.
  • the memory training method through brain stimulation according to an embodiment of the present invention described above may be implemented as a program (or application) to be executed in combination with a computer which is hardware and stored in a medium.
  • the memory training program through brain stimulation may be directly installed in a device that outputs a screen (that is, a device having a display unit) or may be installed in a device connected to the display device.
  • a device that outputs a screen that is, a device having a display unit
  • the head mounted display device may be installed in a mobile terminal (for example, a smartphone or a PC) to which the head mounted display device is connected, and has a processor capable of arithmetic processing.
  • One head mounted display device may install a memory training program through brain stimulation.
  • the above-described program includes C, C ++, JAVA, machine language, etc. which can be read by the computer's processor (CPU) through the computer's device interface so that the computer reads the program and executes the methods implemented as the program.
  • Code may be coded in the computer language of. Such code may include functional code associated with a function or the like that defines the necessary functions for executing the methods, and includes control procedures related to execution procedures necessary for the computer's processor to execute the functions according to a predetermined procedure. can do.
  • the code may further include memory reference code for additional information or media required for the computer's processor to execute the functions at which location (address address) of the computer's internal or external memory should be referenced. have.
  • the code may be used to communicate with any other computer or server remotely using the communication module of the computer. It may further include a communication related code for whether to communicate, what information or media should be transmitted and received during communication.
  • the stored medium is not a medium for storing data for a short time such as a register, a cache, a memory, but semi-permanently, and means a medium that can be read by the device.
  • examples of the storage medium include, but are not limited to, a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like. That is, the program may be stored in various recording media on various servers to which the computer can access or various recording media on the computer of the user. The media may also be distributed over network coupled computer systems so that the computer readable code is stored in a distributed fashion.

Landscapes

  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Acoustics & Sound (AREA)
  • Psychology (AREA)
  • Engineering & Computer Science (AREA)
  • Anesthesiology (AREA)
  • Physics & Mathematics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Hematology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Rehabilitation Tools (AREA)

Abstract

The present invention relates to a device, method, and program for memory training through brain stimulation. The method for memory training through brain stimulation, according to one embodiment of the present invention, comprises: a first problem provision step (S200) in which a computer provides a first problem in a task display area of a screen, wherein the first problem is one or more output images displayed in a predetermined position within the task display area; a first response reception step (S300) in which the computer receives, from a user, a first response to the first problem, wherein the first response is a result of the comparison of a first problem provided prior to or at an Nth time (N is a natural number) with the first problem currently provided; and a response assessment step (S600) in which the computer assesses the memory state of the user on the basis of the first response.

Description

뇌 자극을 통한 기억력 훈련 장치, 방법 및 프로그램Memory training devices, methods and programs through brain stimulation
본 발명은 기억력 훈련 장치, 방법 및 프로그램에 관한 것으로, 더욱 상세하게는 기억력을 향상시키기 위해 뇌를 자극하는 장치, 방법 및 프로그램에 관한 것이다.The present invention relates to a memory training apparatus, a method and a program, and more particularly, to a device, a method and a program for stimulating the brain to improve memory.
뇌 손상이나 노화로 인한 치매 환자의 경우 시지각에는 문제가 없으나 공간적 기억력이 감퇴된다. 뇌 손상으로 인하여 뇌의 특정 부분이 손상됨으로써 특정 영역의 시야에 이상이 생긴 환자의 경우 이들을 위한 시지각 훈련 방법은 존재하지만, 공간적 기억력이 감퇴된 치매 환자나 노년층을 위한 기억력 훈련 방법은 존재하지 않아 그 필요성이 대두된다.In patients with dementia due to brain damage or aging, there is no problem in visual perception but spatial memory is reduced. There are methods for visual perception training for patients who have abnormalities in their vision due to damage to certain parts of the brain due to brain damage.However, there are no memory training methods for dementia patients or elderly people with spatial memory loss. The need arises.
본 발명은 사용자의 뇌에 시지각 자극과 공간 기억 자극을 동시에 제공함에 따라, 공간 기억력의 향상 효과를 높여주는, 뇌 자극을 통해 공간적 기억력을 훈련하기 위한 장치 및 방법을 제공하고자 한다.The present invention provides an apparatus and method for training spatial memory through brain stimulation that enhances the effect of improving spatial memory by simultaneously providing visual perception stimulation and spatial memory stimulation to a user's brain.
본 발명이 해결하고자 하는 과제들은 이상에서 언급된 과제로 제한되지 않으며, 언급되지 않은 또 다른 과제들은 아래의 기재로부터 통상의 기술자에게 명확하게 이해될 수 있을 것이다.Problems to be solved by the present invention are not limited to the above-mentioned problems, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.
본 발명의 일실시예에 따른 뇌 자극을 통한 기억력 훈련방법은, 컴퓨터가 화면 내의 테스크표시부에 제1문제를 제공하되, 상기 제1문제는 상기 테스크표시부 공간 내의 특정한 위치에 하나 이상의 출력이미지가 표시되는 것인, 제1문제 제공단계; 컴퓨터가 사용자로부터 상기 제1문제에 대한 제1응답을 수신하되, 상기 제1응답은 N회(N은 자연수) 이전에 제공된 제1문제와 현재 제공된 제1문제를 비교한 결과인, 제1응답 수신단계; 및 컴퓨터가 상기 제1응답을 기반으로 사용자의 기억력 상태를 평가하는 응답평가단계;를 포함한다.In a memory training method through brain stimulation according to an embodiment of the present invention, a computer provides a first problem on a task display unit within a screen, wherein the first problem is displayed on one or more output images at a specific position in the task display unit space. That is, the first problem providing step; A first response from the user to the computer, wherein the first response is a result of comparing the first problem provided before N times (N is a natural number) with the currently provided first problem Receiving step; And a response evaluation step of the computer evaluating the memory state of the user based on the first response.
또한, 다른 일실시예로, 컴퓨터가 화면 내의 중심시야부에 표시되는 제2문제를 제공하는 제2문제 제공단계; 및 상기 제2문제에 대한 제2응답을 수신하는 제2응답 수신단계;를 더 포함하되, 상기 제2문제는 사용자에게 출력영상의 중앙을 주시하도록 제공되는 것이다.In another embodiment, a second problem providing step of providing a second problem displayed by the computer on the central field of view within the screen; And a second response receiving step of receiving a second response to the second problem, wherein the second problem is provided to observe the center of the output image to the user.
또한, 다른 일실시예로, 상기 제1문제 제공단계는, 컴퓨터가 사용자의 시선방향을 측정하여, 상기 시선방향을 기준으로 상기 제1문제에 따른 출력이미지의 배치위치를 결정하여 제공하는 것을 특징으로 한다.In another exemplary embodiment, the first problem providing step may include a computer measuring a gaze direction of a user and determining an arrangement position of an output image according to the first problem based on the gaze direction. It is done.
또한, 다른 일실시예로, 상기 제1문제는, 상기 출력이미지의 개수, 종류, 배치위치 및 크기 중 적어도 하나를 변경하여 제공되는 것이고, 상기 제1응답은, 현재 제공되는 화면이미지가 N회 이전의 화면이미지와 일치하는지 여부를 입력하는 것이며, 상기 화면이미지는 상기 제1문제에 따라 하나 이상의 출력이미지가 배치된 화면 자체이다.In another embodiment, the first problem is provided by changing at least one of the number, type, arrangement position, and size of the output image, and the first response is N times the currently provided screen image. It is to input whether or not to match the previous screen image, wherein the screen image is the screen itself on which one or more output images are arranged according to the first problem.
또한, 다른 일실시예로, 사용자상태에 따라 N의 값을 조절하는 것을 특징으로 한다.In another embodiment, the value of N is adjusted according to the user state.
또한, 다른 일실시예로, 상기 제1문제 제공단계는, 상기 제2문제의 3차원공간 내 배치위치를 기반으로, 제1문제에 포함된 출력이미지를 표시하는 3차원공간 내 위치를 결정하는 것을 특징으로 한다.In another embodiment, the providing of the first problem may include determining a location in a three-dimensional space that displays an output image included in the first problem, based on a location in the three-dimensional space of the second problem. It is characterized by.
또한, 다른 일실시예로, 컴퓨터가 제1문제를 헤드마운트 디스플레이 장치의 화면 상에 제공하는 것을 특징으로 한다.In another embodiment, the computer provides a first problem on the screen of the head mounted display device.
본 발명의 다른 일실시예에 따른 뇌 자극을 통한 기억력 훈련장치는, 화면 내의 테스크표시부에 제1문제를 제공하고, 컴퓨터가 사용자로부터 상기 제1문제에 대한 제1응답을 수신하고, 컴퓨터가 상기 응답을 기반으로 사용자의 기억력 상태를 평가하되, 상기 제1문제는 상기 테스크표시부 공간 내의 특정한 위치에 하나 이상의 출력이미지가 표시되는 것이고, 상기 제1응답은 N회 이전에 제공된 제1문제와 현재 제공된 제1문제를 비교한 결과이다.Memory stimulation training apparatus through a brain stimulation according to another embodiment of the present invention, the task display unit on the screen provides a first problem, the computer receives a first response to the first problem from the user, the computer Evaluate the memory state of the user based on the response, wherein the first problem is one or more output images are displayed at a specific position in the task display space, and the first response is the first problem provided N times and the currently provided The result of comparing the first problem.
본 발명의 다른 일실시예에 따른 뇌 자극을 통한 기억력 훈련프로그램은, 하드웨어인 컴퓨터와 결합되어 상기 언급된 뇌 자극을 통한 기억력 훈련방법을 실행하며, 매체에 저장된다.The memory training program through brain stimulation according to another embodiment of the present invention is combined with a computer which is hardware to execute the above-mentioned memory training method through brain stimulation, and is stored in a medium.
상기와 같은 본 발명에 따르면, 사용자의 뇌에 공간 기억력 자극과 시지각 자극을 동시에 제공함에 따라 공간 기억력 향상 효과를 높일 수 있다. 특히, 뇌 손상이나 노화로 인하여 공간 기억력이 감퇴된 경우(예를 들어, 치매 환자)나 정상적으로 성장하지 못하여 공간적 기억력이 부족한 경우에 뇌 자극을 통해 공간 기억력을 향상시킬 수 있는 효과가 있다. 또한, 성장하는 소아들에게 적용하는 경우, 소아의 공간 기억력을 향상시키는 효과를 제공할 수 있다.According to the present invention as described above, by providing a spatial memory stimulation and visual perception stimulation at the same time to the user's brain can improve the effect of improving spatial memory. In particular, when spatial memory is deteriorated due to brain damage or aging (for example, patients with dementia) or when spatial memory is insufficient due to normal growth, there is an effect of improving spatial memory through brain stimulation. In addition, when applied to growing children, it can provide an effect of improving the spatial memory of the child.
도 1은 본 발명의 일실시예에 따른 뇌 자극을 통한 기억력 훈련방법의 순서도이다.1 is a flow chart of a memory training method through brain stimulation according to an embodiment of the present invention.
도 2은 본 발명의 일실시예에 따른 제2문제 제공 및 응답과정을 더 포함하는, 뇌 자극을 통한 기억력 훈련방법의 순서도이다.Figure 2 is a flow chart of the memory training method through the brain stimulation, further comprising a second problem providing and response process according to an embodiment of the present invention.
도 3은 본 발명의 일실시예에 따라 제1문제에 따라 기억력 훈련을 수행하는 과정을 도시한 예시도면이다.3 is an exemplary diagram illustrating a process of performing memory training in accordance with a first problem according to an embodiment of the present invention.
도 4는 본 발명의 일실시예에 따른 뇌 자극을 통한 기억력 훈련장치의 내부 구성도이다.Figure 4 is an internal configuration of the memory training apparatus through brain stimulation according to an embodiment of the present invention.
이하, 첨부된 도면을 참조하여 본 발명의 바람직한 실시예를 상세히 설명한다. 본 발명의 이점 및 특징, 그리고 그것들을 달성하는 방법은 첨부되는 도면과 함께 상세하게 후술되어 있는 실시예들을 참조하면 명확해질 것이다. 그러나 본 발명은 이하에서 게시되는 실시예들에 한정되는 것이 아니라 서로 다른 다양한 형태로 구현될 수 있으며, 단지 본 실시예들은 본 발명의 게시가 완전하도록 하고, 본 발명이 속하는 기술분야에서 통상의 지식을 가진 자에게 발명의 범주를 완전하게 알려주기 위해 제공되는 것이며, 본 발명은 청구항의 범주에 의해 정의될 뿐이다. 명세서 전체에 걸쳐 동일 참조 부호는 동일 구성 요소를 지칭한다.Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Advantages and features of the present invention and methods for achieving them will be apparent with reference to the embodiments described below in detail with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various forms, and only the embodiments are intended to complete the disclosure of the present invention, and the general knowledge in the art to which the present invention pertains. It is provided to fully inform the person having the scope of the invention, which is defined only by the scope of the claims. Like reference numerals refer to like elements throughout.
다른 정의가 없다면, 본 명세서에서 사용되는 모든 용어(기술 및 과학적 용어를 포함)는 본 발명이 속하는 기술분야에서 통상의 지식을 가진 자에게 공통적으로 이해될 수 있는 의미로 사용될 수 있을 것이다. 또 일반적으로 사용되는 사전에 정의되어 있는 용어들은 명백하게 특별히 정의되어 있지 않는 한 이상적으로 또는 과도하게 해석되지 않는다.Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used in a sense that can be commonly understood by those skilled in the art. In addition, the terms defined in the commonly used dictionaries are not ideally or excessively interpreted unless they are specifically defined clearly.
본 명세서에서 사용된 용어는 실시예들을 설명하기 위한 것이며 본 발명을 제한하고자 하는 것은 아니다. 본 명세서에서, 단수형은 문구에서 특별히 언급하지 않는 한 복수형도 포함한다. 명세서에서 사용되는 "포함한다(comprises)" 및/또는 "포함하는(comprising)"은 언급된 구성요소 외에 하나 이상의 다른 구성요소의 존재 또는 추가를 배제하지 않는다.The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In this specification, the singular also includes the plural unless specifically stated otherwise in the phrase. As used herein, "comprises" and / or "comprising" does not exclude the presence or addition of one or more other components in addition to the mentioned components.
본 명세서에서 '컴퓨터'는 연산처리를 수행할 수 있는 다양한 장치들이 모두 포함된다. 예를 들어, 컴퓨터는 데스크 탑 PC, 노트북(Note Book) 뿐만 아니라 스마트폰(Smart phone), 태블릿 PC, 셀룰러폰(Cellular phone), 피씨에스폰(PCS phone; Personal Communication Service phone), 동기식/비동기식 IMT-2000(International Mobile Telecommunication-2000)의 이동 단말기, 팜 PC(Palm Personal Computer), 개인용 디지털 보조기(PDA; Personal Digital Assistant) 등도 해당될 수 있다. 또한, 컴퓨터는 클라이언트로부터 정보를 수신하는 서버컴퓨터가 해당될 수도 있다. In the present specification, the 'computer' includes all the various devices capable of performing arithmetic processing. For example, a computer can be a desktop PC, a notebook, as well as a smartphone, a tablet PC, a cellular phone, a PCS phone (Personal Communication Service phone), synchronous / asynchronous The mobile terminal of the International Mobile Telecommunication-2000 (IMT-2000), a Palm Personal Computer (PC), a Personal Digital Assistant (PDA), and the like may also be applicable. The computer may also be a server computer that receives information from a client.
본 명세서에서 '제1문제'는 사용자에게 기억력 훈련을 제공하기 위해 화면 상에 제공되는 문제를 의미한다. 예를 들어, '제1문제'는 사용자에게 N회 이전의 문제와 비교 판단이 요청되는 문제이다.In the present specification, the 'first problem' refers to a problem provided on a screen in order to provide memory training to a user. For example, the "first problem" is a problem in which the user is requested to compare and judge the problem before N times.
본 명세서에서 '제1응답'은 특정시점에 제공되는 제1문제에 대한 응답을 의미한다.In the present specification, the 'first response' means a response to a first problem provided at a specific time.
본 명세서에서 '제2문제'는 사용자의 시선방향을 화면 중앙에 고정하기 위해 제공되는 문제를 의미한다. 예를 들어, '제2문제'는 화면 중앙에 구별되는 복수의 대상체(예를 들어, ㅋ 또는 ㅌ) 중에서 어느 하나를 특정시점에 화면 중앙에 표시하는 것일 수 있다.In the present specification, the 'second problem' refers to a problem provided to fix a user's gaze direction to a screen center. For example, the second problem may be to display any one of a plurality of objects (for example, 또는 or ㅌ) that is distinguished in the center of the screen at a specific time in the center of the screen.
본 명세서에서 '제2응답'은 제2문제에 대해 사용자로부터 수신되는 응답을 의미한다.In the present specification, the 'second response' refers to a response received from the user with respect to the second problem.
본 명세서에서 '출력이미지'는 제1문제에 의해 화면 상의 특정한 위치에 제공되는 이미지를 의미한다. 예를 들어, '출력이미지'는 화면 상의 특정한 사분면 내에 표시되는 가로 또는 세로 줄무늬 이미지일 수 있다.In the present specification, the 'output image' refers to an image provided at a specific position on the screen by the first problem. For example, the 'output image' may be a horizontal or vertical striped image displayed in a specific quadrant on the screen.
본 명세서에서 '화면이미지'는 제1문제에 따라 하나 이상의 출력이미지가 배치된 화면 자체이다. 화면이미지는 일반적인 디스플레이 장치로 출력되거나 헤드마운트 디스플레이 장치에 출력될 수 있다. 헤드마운트 디스플레이 장치에 화면이미지가 제공되는 경우, 화면이미지는 좌안용 영상 및 우안용 영상으로 각각 생성될 수 있다.In the present specification, the 'screen image' is a screen itself on which one or more output images are arranged according to the first problem. The screen image may be output to a general display device or to a head mounted display device. When a screen image is provided to the head mounted display device, the screen image may be generated as a left eye image and a right eye image, respectively.
본 명세서에서 '중심시야부'는 사용자에게 제공되는 화면 내에서 중앙 영역을 의미한다.In the present specification, the 'central field view part' means a central area within a screen provided to a user.
본 명세서에서 '주변시야부'는 화면 내에서 중심시야부를 제외한 나머지 영역을 의미한다.In the present specification, the 'near viewable part' refers to a remaining area of the screen except for the center viewable part.
본 명세서에서 '테스크(Task)표시부'는 사용자에게 제공되는 화면 내에 기억력 훈련의 테스크인 출력이미지가 제공되는 영역을 의미한다. '테스크표시부'는 중심시야부를 제외한 주변시야부만이 해당될 수도 있고, 중심시야부와 주변시야부를 모두 포함할 수도 있다.In the present specification, a 'task display unit' refers to a region in which an output image which is a task of memory training is provided in a screen provided to a user. The 'desk display unit' may include only the peripheral field of view except for the central field of view, or may include both the central field of view and the surrounding field of view.
이하, 도면을 참조하여, 본 발명의 실시예들에 따른 뇌 자극을 통한 기억력 훈련 장치, 방법 및 프로그램을 상세히 설명한다.Hereinafter, an apparatus, a method and a program for training memory through brain stimulation according to embodiments of the present invention will be described in detail.
도 1은 본 발명의 일실시예에 따른 뇌 자극을 통한 기억력 훈련방법의 순서도이다.1 is a flow chart of a memory training method through brain stimulation according to an embodiment of the present invention.
도 1을 참조하면, 본 발명의 일실시예에 따른 뇌 자극을 통한 기억력 훈련방법은, 컴퓨터가 화면 내의 테스크표시부에 제1문제를 제공하는 단계(S200; 제1문제 제공단계); 컴퓨터가 사용자로부터 상기 제1문제에 대한 제1응답을 수신하는 단계(S300; 제1응답 수신단계); 및 컴퓨터가 상기 제1응답을 기반으로 사용자의 기억력 상태를 평가하는 단계(S600; 응답평가단계);를 포함한다. 이하 각 단계에 대한 상세한 설명을 기재한다.컴퓨터가 화면 내의 테스크표시부에 제1문제를 제공한다(S200; 제1문제 제공단계). 상기 제1문제는 상기 테스크표시부 내의 특정한 위치에 하나 이상의 출력이미지가 표시되는 것이다. 상기 제1문제는, 상기 출력이미지의 개수, 종류, 배치위치 및 크기 중 적어도 하나를 변경하여 제공되는 것이다. Referring to FIG. 1, a memory training method through brain stimulation according to an embodiment of the present invention may include: providing a first problem by a computer to a task display unit on a screen (S200; providing a first problem); Receiving, by the computer, a first response to the first problem from the user (S300; first response receiving step); And evaluating, by the computer, the memory state of the user based on the first response (S600; response evaluation step). A detailed description of each step will be given below. The computer provides a first problem to the task display unit on the screen (S200; a first problem providing step). The first problem is that one or more output images are displayed at a specific position in the task display unit. The first problem is provided by changing at least one of the number, type, arrangement position and size of the output image.
일실시예로, 화면 상에 제1문제를 제공하는 시행마다 화면 내에 포함되는 출력이미지의 배치위치를 변경하여 제1문제를 다양하게 할 수 있다. 예를 들어, 컴퓨터가 동일한 출력이미지가 표시되는 화면 내의 위치를 변경하여 다른 화면이미지를 생성할 수 있다. 출력이미지의 위치를 변경하는 것은, 테스크표시부가 복수의 분할영역으로 나누어져 있는 경우, 제1문제의 출력이미지가 표시되는 분할영역을 다르게 하거나 동일한 분할영역 내에서 출력이미지가 배치되는 지점을 다르게 하는 것일 수 있다.In one embodiment, the first problem may be varied by changing the arrangement position of the output image included in the screen for each trial providing the first problem on the screen. For example, the computer may generate another screen image by changing the position on the screen where the same output image is displayed. Changing the position of the output image means that when the task display unit is divided into a plurality of divided regions, the divided region in which the output image of the first problem is displayed or a point where the output image is arranged in the same divided region is different. It may be.
또한, 테스크표시부를 3차원공간으로 구현함에 따라 출력이미지를 다양한 깊이에 생성할 수 있는 경우, 컴퓨터는 출력이미지가 표시되는 깊이를 변경하여 다양한 문제 형태를 생성할 수 있다. 예를 들어, 컴퓨터는 기준깊이(예를 들어, 제2문제가 제공되는 경우에 제2문제가 표시되는 깊이)로부터 가까운 영역 또는 먼 영역으로 나누어서 출력이미지를 표시할 수 있다. In addition, when the task display unit is implemented in a three-dimensional space, when the output image can be generated at various depths, the computer can generate various problem forms by changing the depth at which the output image is displayed. For example, the computer may display the output image by dividing it into an area near or far from the reference depth (eg, the depth at which the second problem is indicated when the second problem is provided).
구체적으로, 상기 제1문제 제공단계(S200)는, 후술되는 제2문제의 3차원공간 내 배치위치를 기반으로, 제1문제에 포함된 출력이미지를 표시하는 3차원공간 내 위치를 결정한다. 3차원 공간에서는 좌안과 우안에 제공되는 영상(즉, 좌안용 영상 및 우안용 영상)이 컨버젼스(Convergence)를 형성하는 지점을 기준으로 원근감을 형성하게 된다. 따라서, 컴퓨터는 후술되는 제2문제를 특정한 깊이에 배치하면서 제2문제에 대해 좌안용영상과 우안용영상을 컨버젼스 매칭시키고, 제1문제에 따른 출력이미지를 특정한 깊이에 배치하여 기준깊이에 배치된 제2문제와의 상대적인 위치관계를 기반으로 다양한 깊이에 출력이미지가 표시되는 화면을 구현할 수 있다.Specifically, the first problem providing step (S200), based on the arrangement position in the three-dimensional space of the second problem to be described later, determines the position in the three-dimensional space for displaying the output image included in the first problem. In the 3D space, the images provided to the left and right eyes (that is, the left eye image and the right eye image) form perspective based on a point at which convergence is formed. Accordingly, the computer converges the left eye image and the right eye image with respect to the second problem while arranging the second problem to be described later at a specific depth, and arranges the output image according to the first problem at a specific depth to be disposed at the reference depth. Based on the positional relationship with the second problem, a screen in which the output image is displayed at various depths can be implemented.
또한, 다른 일실시예로, 컴퓨터는 출력이미지의 종류(예를 들어, 도형 분류와 캐릭터 이미지 분류 등) 또는 형상(예를 들어, 가로줄무늬 패턴과 세로줄무늬 패턴)을 변경하여 상이한 제1문제를 생성할 수 있다. 예를 들어, 컴퓨터는 테스크표시부의 동일한 위치에 상이한 형상의 출력이미지(예를 들어, 가로줄무늬 패턴과 세로줄무늬 패턴)를 표시하여 다른 문제를 생성할 수 있다.Further, in another embodiment, the computer may change the type of the output image (for example, the classification of the figure and the character image, etc.) or the shape (for example, the horizontal stripe pattern and the vertical stripe pattern) to solve different first problems. Can be generated. For example, the computer may generate different problems by displaying output images of different shapes (for example, horizontal stripes and vertical stripes) at the same location of the task display unit.
또한, 다른 일실시예로, 컴퓨터는 동일한 위치에 동일한 출력이미지 종류/형상을 표시하면서 출력이미지의 크기를 변경함에 따라 상이한 제1문제를 생성할 수 있다.Further, in another embodiment, the computer may create different first problems as the size of the output image is changed while displaying the same output image type / shape at the same location.
컴퓨터가 사용자로부터 상기 제1문제에 대한 제1응답을 수신한다(S300; 제1응답 수신단계). 상기 제1응답은 N회(N은 자연수) 이전에 제공된 제1문제와 현재 제공된 제1문제를 비교한 결과이다. 예를 들어, N이 1인 경우, 컴퓨터는 사용자로부터 직전의 제1문제(즉, 직전 제1문제에 따른 화면이미지)와 현재 제1문제(현재 화면상에 출력된 화면이미지)를 비교하여 동일한지 여부를 판단한 결과를 제1응답으로 입력받는다. 또한, 예를 들어, N이 1이 아닌 특정한 자연수인 경우, 컴퓨터는 사용자로부터 현재시행으로부터 N회 이전의 시행에서 제공된 화면이미지와 현재 화면이미지를 비교한 결과를 현재시행의 제1응답으로 수신할 수 있다.The computer receives a first response to the first problem from the user (S300; receiving a first response). The first response is a result of comparing the first problem provided before N times (N is a natural number) with the currently provided first problem. For example, if N is 1, the computer compares the first first problem (ie, the screen image according to the previous first problem) with the current first problem (the screen image displayed on the current screen) from the user. The first response is received as a result of determining whether or not it is. Also, for example, if N is a specific natural number other than 1, the computer may receive from the user the result of comparing the current screen image with the screen image provided in the trial N times from the current trial as the first response of the current trial. Can be.
컴퓨터가 상기 제1응답을 기반으로 사용자의 기억력 상태를 평가한다(S600; 응답평가단계). 즉, N회 이전의 화면이미지와 비교한 결과를 제1응답으로 수신하는 경우, 컴퓨터는 내부에 저장된 N회 이전의 화면이미지와 현재 화면이미지를 비교하여 동일여부를 판단한다. 이를 위해, N회 이전의 시행과 비교하는 것으로 공간 기억력 훈련을 수행하는 경우, 컴퓨터는 N회 이전 시행의 화면이미지까지 저장하여 둘 수 있다. 또한, 컴퓨터는 N회 이전 시행의 화면이미지를 현재 시행의 화면이미지와 비교에 이용한 후에 삭제할 수 있다. 컴퓨터는 사용자로부터 입력된 제1응답이 정답으로 판단되면, 사용자에게 정답임을 바로 안내하거나 정답횟수 누적을 증가시킬 수 있다. The computer evaluates the memory state of the user based on the first response (S600; response evaluation step). That is, when receiving a result of comparing the screen image with N times before as the first response, the computer compares the screen image with the previous N times and the current screen image stored therein to determine whether it is the same. To this end, in the case of performing spatial memory training in comparison with the previous N trials, the computer may store screen images of the N trials before. In addition, the computer may delete the screen image of the previous trial N times after comparison with the screen image of the current trial. When the first response input from the user is determined to be a correct answer, the computer may immediately inform the user that the answer is correct or increase the number of correct answers.
또한, 다른 일실시예로, 컴퓨터는 정답횟수를 기반으로 사용자의 기억력 상태를 판단하고, 기억력 훈련의 난이도를 조절할 수 있다. 예를 들어, 사용자의 특정한 N값에서의 기억력 훈련결과가 좋은 경우, 컴퓨터는 다음 훈련 시에 사용자에게 제공되는 기억력 훈련의 N값을 증가시켜서 난이도를 높일 수 있다. 즉, 컴퓨터는 사용자에게 기억하도록 요구하는 시행 간격을 늘려서 기억력 훈련의 난이도를 높일 수 있다. 또한, 예를 들어, 컴퓨터는 화면 상에 제공되는 출력이미지의 밝기 또는 채도를 낮추거나 출력이미지의 크기를 줄여서 난이도를 높일 수 있다. In another embodiment, the computer may determine the memory state of the user based on the number of correct answers and adjust the difficulty of memory training. For example, if the memory training result at a specific N value of the user is good, the computer can increase the difficulty by increasing the N value of the memory training provided to the user at the next training. In other words, the computer can increase the difficulty of memory training by increasing the trial interval requiring the user to remember. Also, for example, the computer may increase the difficulty by lowering the brightness or saturation of the output image provided on the screen or reducing the size of the output image.
또한, 컴퓨터는 화면이미지 내에 등장하는 출력이미지의 개수를 조절하여 난이도를 조절할 수 있다. 출력이미지의 개수가 늘어나면 출력이미지간의 배치관계가 복잡하여 난이도가 높아질 수 있다. 예를 들어, 출력이미지로 가로줄무늬와 세로줄무늬를 제공하는 경우, 컴퓨터는 화면 내 복수의 분할영역 중의 일부에 가로줄무늬 또는 세로줄무늬 중에서 특정한 출력이미지를 제공하여 화면이미지를 생성할 수 있다. 사용자는 현재 시행의 복수의 출력이미지 배치위치 및 각 위치에 표시된 출력이미지의 종류가 N회 이전 시행과 동일한 지 비교하여야 하므로, 하나의 출력이미지가 제공되는 경우에 비해 난이도가 높은 제1문제를 제공받게 된다.In addition, the computer may adjust the difficulty level by adjusting the number of output images appearing in the screen image. As the number of output images increases, the degree of difficulty may increase due to a complicated arrangement of output images. For example, in the case of providing horizontal stripes and vertical stripes as an output image, the computer may generate a screen image by providing a specific output image among horizontal stripes or vertical stripes to a part of the plurality of divided regions in the screen. The user has to compare whether the plurality of output image arrangement positions of the current trial and the types of output images displayed at each position are the same as the previous trial N times, thus providing a first problem having a higher difficulty level than when one output image is provided. Will receive.
또한, 다른 일실시예로, 컴퓨터는 환자의 기억력 훈련의 결과를 기반으로 어떠한 유형의 출력이미지에 대해 기억력이 떨어져 있는지 여부를 판단할 수 있다. 예를 들어, 환자의 상태에 따라 시야범위 내의 특정한 위치에 표시되는 이미지에 대해 기억력이 떨어질 수 있고, 특정한 형상에 대한 기억력이 떨어질 수도 있다. 따라서, 컴퓨터는 뇌 자극 훈련 결과를 기반으로 환자가 떨어지는 기억력의 유형을 파악할 수 있다.또한, 사용자에게 특정한 시행간격 차이가 나는 화면이미지(즉, 현재 화면이미지와 N회 이전의 화면이미지)가 동일한 지 여부를 판단하도록 하기 위해서는, 사용자가 동일한 조건의 제1문제를 기반으로 제공되는 화면이미지를 동일하게 시각적으로 인지하도록 하여야 한다. 이를 위해, 컴퓨터는 동일한 조건의 제1문제에 의해 각각의 시행에서 동일한 화면이미지를 제공되도록 하는 다양한 방식을 적용할 수 있다.Also, in another embodiment, the computer may determine whether any type of output image is memory based on the result of memory training of the patient. For example, memory may be degraded for an image displayed at a specific position within a viewing range according to a patient's condition, or memory for a specific shape may be degraded. Thus, the computer can determine the type of memory that the patient falls into based on the results of the brain stimulation training. In addition, the screen image having a specific trial interval specific to the user (that is, the current screen image and the previous screen image N times) is the same. In order to determine whether or not the user is required, the user should be made to visually recognize the screen image provided based on the first problem of the same condition. To this end, the computer can apply various ways to provide the same screen image in each trial by the first problem of the same condition.
일실시예로, 상기 제1문제 제공단계(S200)는, 컴퓨터가 사용자의 시선방향을 측정하여, 상기 시선방향을 기준으로 상기 제1문제에 따른 출력이미지의 배치위치를 결정하여 제공할 수 있다. 예를 들어, 사용자가 헤드마운트 디스플레이 장치를 통해 화면이미지를 제공받는 경우, 사용자가 헤드마운트 디스플레이 장치를 착용한 상태에서 고개를 움직이거나 안구방향을 움직이면 동일한 화면이미지에 대해 보이는 방향이 달라지게 된다. 따라서, 컴퓨터는 사용자의 고개움직임 또는 안구움직임을 인식하여 시선방향을 획득하고, 시선방향을 기준으로 출력이미지의 배치위치를 결정한다.In one embodiment, the first problem providing step (S200), the computer may measure the user's gaze direction, determine the arrangement position of the output image according to the first problem based on the gaze direction can be provided. . For example, when the user is provided with the screen image through the head mounted display device, the direction shown for the same screen image is changed when the user moves his head or moves the eyeball while wearing the head mounted display device. Therefore, the computer recognizes the user's bow movement or eye movement, acquires the gaze direction, and determines the arrangement position of the output image based on the gaze direction.
구체적으로, 컴퓨터는 헤드마운트 디스플레이 장치에 포함된 모션센서를 통해 획득된 고개움직임데이터를 기반으로 사용자의 고개움직임을 측정한다. 또한, 컴퓨터는 헤드마운트 디스플레이 장치에 포함된 안구움직임 센서(즉, 아이트래커; Eye-tracker)에 의해 획득된 안구움직임데이터를 기반으로 안구움직임을 측정한다. 그 후, 컴퓨터는 사용자의 고개움직임 또는 안구움직임이 있을 때의 시선방향(즉, 시야범위의 중심방향)을 산출해낸다. 그 후, 컴퓨터는 시선방향(즉, 시야범위의 중심방향)을 중심으로 출력이미지를 표시하여 특정 시행에 제공되는 화면이미지를 생성한다. 즉, 제1문제 내의 출력이미지 배치위치정보는 시선방향(즉, 시야범위의 중심방향)을 기준으로 결정된 상대적인 위치이고, 컴퓨터는 제1문제 내의 출력이미지 배치위치정보를 기반으로 각 시행의 화면이미지를 생성한다. 이를 통해, 컴퓨터는 사용자가 자유로운 고개움직임과 안구움직임을 수행하는 중에도 기억력 훈련을 원할하게 제공할 수 있다.Specifically, the computer measures the user's motion based on the motion data acquired through the motion sensor included in the head mounted display device. In addition, the computer measures the eye movement based on eye movement data acquired by an eye movement sensor (ie, an eye tracker) included in the head mounted display device. The computer then calculates the visual direction (ie, the center direction of the visual field range) when the user's bow movement or eye movement is present. The computer then displays the output image about the visual direction (ie, the direction of the center of the viewing range) to generate the screen image provided for the particular trial. That is, the output image arrangement position information in the first problem is a relative position determined based on the visual direction (ie, the center direction of the viewing range), and the computer displays the screen image of each trial based on the output image arrangement position information in the first problem. Create Through this, the computer can smoothly provide memory training while the user performs free head movements and eye movements.
또한, 다른 일실시예로, 도 2에서와 같이, 컴퓨터가 화면 내의 중심시야부에 표시되는 제2문제를 제공하는 단계(S400; 제2문제 제공단계); 및 상기 제2문제에 대한 제2응답을 수신하는 단계(S500; 제2응답 수신단계);를 더 포함한다. 제2문제는 사용자의 시선방향을 특정한 위치에 고정하는 역할을 수행한다. 제2문제는 테스크표시부의 일측에 제공되는 제1문제와 동시에 제공될 수 있다. 즉, 사용자가 제2문제가 표시되는 중심시야부를 주시한 상태에서 제1문제를 확인하도록 제1문제와 제2문제를 화면상에 동시에 표시하는 화면이미지를 제공한다. 사용자가 제2문제에 대한 정답을 입력하기 위해 제2문제가 표시되는 중심시야부를 주시함에 따라 사용자의 시야범위에 화면이미지를 제공하는 동일한 조건을 형성할 수 있다.Also, as another embodiment, as shown in Figure 2, the computer provides a second problem displayed on the central field of view in the screen (S400; second problem providing step); And receiving a second response to the second problem (S500; receiving a second response). The second problem serves to fix the gaze direction of the user at a specific position. The second problem may be provided simultaneously with the first problem provided on one side of the task display unit. That is, a screen image for simultaneously displaying the first problem and the second problem on the screen is provided so that the user checks the first problem while the user watches the center view portion where the second problem is displayed. As the user looks at the central field of view where the second problem is displayed to input a correct answer to the second problem, the same condition of providing the screen image in the user's field of view may be formed.
또한, 제2문제에 대한 제2응답이 입력되지 않으면 시선방향이 화면의 중앙에 제대로 배치되지 않은 것으로 판단하여, 제1문제에 대한 제1응답을 오답처리할 수 있다. 이를 통해, 컴퓨터는 제1문제에 대한 응답을 수행하기에 적절하지 않은 상태에서 입력한 제1응답은 배제하여 기억력 훈련 결과를 정확하게 산출할 수 있다.In addition, when the second response to the second problem is not input, it may be determined that the line of sight is not properly disposed at the center of the screen, and the first response to the first problem may be incorrectly processed. Through this, the computer may accurately calculate the memory training result by excluding the first response inputted when the computer is not suitable to perform the response to the first problem.
또한, 컴퓨터는 중심시야부에 표시되는 제2문제의 정답률을 기반으로 뇌자극 기억력 훈련이 화면 중심에 시선이 고정된 상태에서 제대로 수행되었는지 여부를 판단할 수 있다. 예를 들어, 제2문제가 화면 중앙에 작게 표시됨에 따라 사용자가 제2문제가 표시되는 중앙시야부를 정확히 주시하지 않으면 특정한 정답률 이상이 나오지 못하는 것으로 설정하여, 컴퓨터는 제2문제의 정답률을 기반으로 시선 중앙 고정(Central fixation)이 제대로 수행되었는지 여부를 판단한다. 컴퓨터는 제2문제에 대한 제2응답의 정답률이 특정값보다 낮으면 훈련이 제대로 수행되지 않은 것으로 판단하여 안내하거나 훈련을 재수행하도록 할 수 있다.In addition, the computer may determine whether the brain stimulation memory training is properly performed in a state where the gaze is fixed at the center of the screen based on the correct answer rate of the second problem displayed on the central field of view. For example, as the second problem is displayed in the small center of the screen, if the user does not accurately observe the central field of view where the second problem is displayed, the computer may set the correct answer rate to not be higher than a certain correct rate. It is determined whether the central fixation is properly performed. If the correct answer rate of the second response to the second problem is lower than the specified value, the computer may determine that the training is not performed properly and guide or re-perform the training.
도 3는 본 발명의 일 실시예에 따라 제2문제를 기반으로 사용자의 시선방향을 화면 중앙에 고정시킨 상태로 기억력을 훈련시키는 방법을 설명하기 위한 도면이다.FIG. 3 is a diagram for describing a method of training memory in a state in which a gaze direction of a user is fixed at a screen center based on a second problem according to an embodiment of the present invention.
도 3의 (a)를 참조하면, 제어부(130)는 기억력 훈련 영상(200)으로서 중심시야부(210) 및 중심시야부(210) 이외의 테스크표시부(221~224: 220)를 디스플레이(110)에 출력한다. Referring to FIG. 3A, the controller 130 displays the task display units 221 to 224 220 other than the center view 210 and the center view 210 as the memory training image 200. )
중심 시야부(220)는 사용자의 시선방향 고정을 위한 문제(230)가 표시되는 화면 내의 중앙 영역이다. 즉, 중심시야부(210)는 사용자의 초점을 중앙에 고정시키기 위한 소정 문제(즉, 제2문제)를 포함할 수 있다. 예를 들어, 중심시야부(210)는, 사용자가 알아맞출 수 있는 문자 또는 도형을 포함할 수 있고, 사용자는, 중심시야부(210)에 포함된 문자 또는 도형에 대응하는 답변을 사용자 입력부(140)를 통해 입력할 수 있다.The central field of view 220 is a central area within the screen on which the problem 230 for fixing the user's gaze direction is displayed. That is, the central view unit 210 may include a predetermined problem (ie, a second problem) for fixing the focus of the user at the center. For example, the center view unit 210 may include a character or figure that can be guessed by the user, and the user may answer an answer corresponding to the character or figure included in the center view unit 210. 140).
테스크표시부(220)는 사용자의 기억력 테스트를 위해 사용자가 이전 시행과 비교되어야 하는 출력이미지가 제공되는 영역이다. 테스크표시부는 출력이미지가 표시되는 영역을 다양한 방식 또는 개수로 분할할 수 있다. 예를 들어, 테스크표시부(220)는 화면(즉, 기억력 훈련 영상)(200)을 중심을 기준으로 가상의 가로선과 세로선을 교차시켜 사분면(221~224)으로 구획한 후 적어도 한 사분면에 제1문제에 따른 출력이미지를 포함할 수 있다. 예를 들어, 테스크표시부(220)에 포함되는 제1문제는, 적어도 한 사분면에 표시되는 출력이미지(예를 들어, 도형)의 공간적 위치, 개수, 형상, 색채 중 적어도 하나와 관련될 수 있다. 즉, 컴퓨터는 출력이미지가 제공되는 사분면 위치, 사분면 내에서 출력이미지가 표시되는 위치, 출력이미지의 종류(예를 들어, 줄무늬 또는 캐릭터이미지), 출력이미지의 형상(예를 들어, 가로줄무늬 또는 세로줄무늬), 출력이미지가 표시되는 개수 등을 조절하여 다양한 화면(즉, 기억력 훈련 영상)을 구현할 수 있다.The task display unit 220 is an area in which an output image to be compared with a previous trial is provided for the user's memory test. The task display unit may divide the area in which the output image is displayed in various ways or numbers. For example, the task display unit 220 divides the virtual horizontal lines and the vertical lines based on the screen (ie, the memory training image) 200 as the quadrants into quadrants 221 to 224, and then divides the first quadrant into at least one quadrant. It may contain the output image according to the problem. For example, the first problem included in the task display unit 220 may be related to at least one of a spatial position, number, shape, and color of an output image (eg, a figure) displayed in at least one quadrant. That is, the computer can display the quadrant position at which the output image is provided, the position at which the output image is displayed within the quadrant, the type of the output image (for example, stripes or character images), and the shape of the output image (for example, horizontal stripes or vertical lines). Various screens (ie, memory training images) can be realized by adjusting the number of stripes, the number of output images, and the like.
도 3의 (a)를 참조하면, 컴퓨터는, M번째 훈련 영상(200)으로서 중심시야부(210) 및 제M시점의 제1문제(231)를 포함하는 화면이미지(220)를 출력한다. 도 2의 (b)를 참조하면, 컴퓨터는 M+1번째 훈련 영상(200)으로서 중심시야부(210)에 제공되는 제2문제와 테스크표시부(220)에 제공되는 제M+1시점의 제1문제(232)를 포함하는 화면이미지(220)를 출력한다. 도 3의 (c)를 참조하면, 컴퓨터는, M+N번째 훈련 영상(200)으로서 중심시야부(210)에 제공되는 제2문제와 테스크표시부(220)에 제공되는 제M+N시점의 제1문제(232)를 포함하는 화면이미지(220)를 출력한다. 그리고, 도 3의 (c)에서, 컴퓨터는, M+N번째 훈련 영상(200)에 포함된 제1문제(233)가 M번 이전의 훈련 영상(200)에 포함된 제1문제(231)와 일치하는지 여부에 대한 사용자의 답변을 사용자 입력부(140)를 통해 수신할 수 있다. 즉, 컴퓨터는 사용자에게 제N시점의 제1문제에 따른 화면이미지와 제M+N시점의 제1문제에 따른 화면이미지가 일치하는지 여부를 대한 응답을 수신한다. 예를 들어, 사용자는, M+N번째 훈련 영상(200)에 포함된 제1문제(233)에 포함된 도형의 공간적 위치(예를 들어, 특정 사분면 내 특정 위치), 도형의 형상, 도형의 개수, 도형의 크기, 도형의 색채 등이 N번째 훈련 영상(200)에 포함된 제1문제(231)와 일치하면 O를 입력하고, 하나라도 일치하지 않으면 X를 입력할 수 있다.Referring to FIG. 3A, the computer outputs the screen image 220 including the central view 210 and the first problem 231 of the M-th point as the M-th training image 200. Referring to (b) of FIG. 2, the computer is the M + 1th training image 200 and the second problem provided to the central field of view 210 and the M + 1 time point provided to the task display unit 220. The screen image 220 including one problem 232 is output. Referring to (c) of FIG. 3, the computer is provided with the second problem provided to the central field of view 210 as the M + Nth training image 200 and the M + N time point provided to the task display unit 220. The screen image 220 including the first problem 232 is output. In addition, in FIG. 3C, the computer includes a first problem 231 in which the first problem 233 included in the M + N th training image 200 is included in the training image 200 before M times. The user's answer regarding whether or not may be received through the user input unit 140. That is, the computer receives a response from the user as to whether the screen image according to the first problem at the Nth point and the screen image according to the first problem at the M + N point coincide. For example, the user may include a spatial position (eg, a specific position in a specific quadrant) of the figure included in the first problem 233 included in the M + N th training image 200, a shape of the figure, and a shape of the figure. If the number, the size of the figure, the color of the figure, etc. match the first problem 231 included in the N-th training image 200, O may be input. If one does not match, X may be input.
설명의 편의상 생략하였으나, 도 3의 (a)에서도 N번째 훈련 영상(200)의 특정 횟수 이전 영상에 포함된 문제와의 일치 여부에 대하여 사용자가 답변을 입력할 수 있고, 도 3의 (b)에서도 M+1번째 훈련 영상(200)의 특정 횟수 이전 영상에 포함된 문제와의 일치 여부에 대하여 사용자의 답변을 입력할 수 있다. 이로써, 사용자는, 특정 횟수 이전의 훈련 영상의 테스크표시부에 포함된 문제를 기억하고 현재 훈련 영상의 테스크표시부에 포함된 문제와 비교하는 반복적인 훈련을 통해 단기 기억력 및 중장기 기억력을 향상시킬 수 있고 공간적 기억력을 개선할 수 있다.Although omitted for convenience of description, in FIG. 3A, the user may input an answer as to whether the N-th training image 200 corresponds to a problem included in the previous image, and FIG. 3B. In addition, the user's answer may be input as to whether or not a match with a problem included in a previous image of a specific number of times of the M + 1 th training image 200 is obtained. In this way, the user can improve the short-term and medium-long term memory through repetitive training, which remembers the problems contained in the task display part of the training image before a certain number of times and compares the problems included in the task display part of the current training image. Improve memory
본 발명을 통해, 단순한 기억력 향상이 아닌 공간 기억력 향상을 훈련시킬 수 있다. 즉, 화면이미지 내에 제공되는 출력이미지의 위치를 기억하도록 함에 따라 공간 기억력을 훈련시킬 수 있다.Through the present invention, it is possible to train the improvement of spatial memory, not just the improvement of memory. That is, the spatial memory can be trained by storing the position of the output image provided in the screen image.
구체적으로, 공간 기억력은 뇌의 해마(Hippocampus)가 담당하고 있고, 시지각학습 훈련(즉, 시각적인 자극을 환자에게 제공하는 훈련)만으로도 뇌 연결성(brain connectivity)에 의해 해마를 자극하여 기능 회복이 가능하다. 따라서, 본 발명은 공간 기억력을 담당하는 해마 기능을 향상시키기 위해, 눈에 시지각 자극을 반복적으로 제공하여 주는 것과 공간 배치를 기억하도록 훈련시키는 것을 함께 제공하여, 공간기억력 향상 속도를 높이는 효과를 제공한다. 즉, 본 발명은, 시공간의 자기중심적(Egocentric: 감각수용기 중심) 처리를 수행하는 뇌영역(예를 들어, 1차 시각영역, parietal lobe, frontal lobe)과 시공간의 타인중심적(Allocentric: 시공간 환경 자체) 처리를 수행하는 해마의 뇌연결성을 기반으로, 시각 자극을 제공하는 시지각 트레이닝을 기반으로 시공간 기억을 담당하는 해마를 자극하기 위한 공간 기억력 훈련을 제공하여, 공간기억력 향상 효과를 높인다.Specifically, the hippocampus of the brain is in charge of spatial memory, and the recovery of function by stimulating the hippocampus by brain connectivity only with visual perceptual learning training (ie, training to provide a visual stimulus to the patient). It is possible. Accordingly, the present invention provides the effect of increasing visual memory stimulation speed by repeatedly providing visual perception stimuli to the eye and training to remember spatial arrangement in order to improve hippocampus function in charge of spatial memory. do. That is, the present invention is a brain region (for example, primary visual domain, parietal lobe, frontal lobe) that performs the Egocentric (sensory receptor center) processing of space-time and space-time environment allocentric (space-time environment itself) Based on the brain connectivity of the hippocampus that performs processing, and based on visual perception training that provides visual stimulation, spatial memory training for stimulating the hippocampus responsible for spatiotemporal memory is provided, thereby improving spatial memory improvement effect.
도 4는 본 발명의 일실시예에 따른 뇌 자극을 통한 기억력 훈련장치의 내부구성도이다.4 is an internal configuration diagram of a memory training apparatus through brain stimulation according to an embodiment of the present invention.
도 4을 참조하면, 기억력 훈련 장치(100)는 디스플레이(110), 메모리(120), 제어부(130) 및 사용자 입력부(140)의 전부 또는 일부를 포함한다. Referring to FIG. 4, the memory training apparatus 100 may include all or a portion of the display 110, the memory 120, the controller 130, and the user input unit 140.
기억력 훈련 장치(100)는 컴퓨터, 퍼스널 컴퓨터, 디스플레이 디바이스, 휴대 가능한 단말기 등일 수 있으며 이에 한정하지 않는다. 기억력 훈련 장치(100)는 시각적으로 사용자의 뇌를 자극함으로써 공간적 기억력을 훈련시키기 위한 장치이다. 여기서, 공간적 기억력이란, 시야 전방에 나타나는 시각 표시(예를 들어, 도형)의 공간적 위치, 형태 등에 대한 기억력을 의미할 수 있다.The memory training apparatus 100 may be a computer, a personal computer, a display device, a portable terminal, or the like, but is not limited thereto. The memory training device 100 is a device for training spatial memory by visually stimulating a user's brain. Here, the spatial memory power may mean a memory power for a spatial position, a shape, and the like of a visual display (for example, a figure) appearing in front of the visual field.
메모리(120)는 기억력 훈련 프로그램을 저장한다. 기억력 훈련 프로그램은 기억력 훈련 장치(100)에 기 설치되어 있는 네이티브 프로그램일 수도 있고 외부 서버로부터 다운로드되어 설치된 프로그램일 수도 있다. 메모리(120)는 기억력 훈련 장치(100)에 연결 또는 삽입되는 외부 메모리일 수도 있다. The memory 120 stores a memory training program. The memory training program may be a native program pre-installed in the memory training apparatus 100 or a program downloaded and installed from an external server. The memory 120 may be an external memory connected to or inserted into the memory training apparatus 100.
제어부(130)는, 기억력 훈련 프로그램이 실행될 경우, 시지각 훈련 프로그램에 대응하는 훈련 영상을 디스플레이(110)에 출력할 수 있다. 훈련 영상은 사용자의 초점을 중앙에 고정하기 위한 테스크표시부를 포함할 수 있다. 테스크표시부는 사용자의 공간적 기억력을 훈련시키기 위한 소정 문제(즉, 제1문제)를 포함할 수 있다. 즉, 테스크표시부는 제1문제에 따른 출력이미지를 2차원 또는 3차원 공간 상의 특정한 위치에 표시한다. 테스크표시부는 주변시야부만을 이용할 수도 있고, 주변시야부와 중심시야부를 모두 이용할 수도 있다.When the memory training program is executed, the controller 130 may output a training image corresponding to the visual perception training program to the display 110. The training image may include a task display unit for fixing the focus of the user to the center. The task display unit may include a predetermined problem (ie, a first problem) for training the spatial memory of the user. That is, the task display unit displays the output image according to the first problem at a specific position in a two-dimensional or three-dimensional space. The task display unit may use only the peripheral field of view, or may use both the peripheral field of view and the central field of view.
제1문제는 테스크표시부 상에 다양한 방식으로 수행될 수 있다. 예를 들어, 제1문제의 출력이미지(예를 들어, 도형)는 테스크표시부의 분할된 네개의 사분면 중에 특정한 사분면에 표시될 수 있고, 특정한 사분면 내의 배치위치, 출력이미지의 형상, 크기, 색채 중 적어도 하나가 조절될 수 있다.The first problem may be performed on the task display unit in various ways. For example, the output image (eg, figure) of the first problem may be displayed in a specific quadrant among the four divided quadrants of the task display unit, and the placement position in the specific quadrant, the shape, size, and color of the output image. At least one can be adjusted.
사용자 입력부(140)는 기억력 훈련 영상과 관련된 사용자 입력을 수신할 수 있다. 사용자는, 사용자 입력부(140)를 통해, 중심시야부에 포함된 문제, 테스크표시부에 포함된 문제에 대응하는 답변을 입력할 수 있다.The user input unit 140 may receive a user input related to the memory training image. The user may input a response corresponding to a problem included in the central view field unit and a problem included in the task display unit through the user input unit 140.
제어부(130)는, M번째 훈련 영상으로서 중심시야부 및 제1 문제를 포함하는 테스크표시부를 디스플레이(110)에 출력하고, M+N번째 훈련 영상으로서 중심시야부 및 제2 문제를 포함하는 테스크표시부를 디스플레이(110)에 출력하고, M+N번째 훈련 영상에 포함된 상기 제2 문제가 N번 이전의 훈련 영상에 포함된 상기 제1 문제와 일치하는지 여부에 대한 사용자의 답변을 사용자 입력부(140)를 통해 수신할 수 있다. 즉, 제어부(130)는 N회 이전에 제공된 제1문제와 현재 제공된 제1문제를 비교한 결과인 제1응답을 사용자로부터 사용자 입력부(140)를 통해 입력받아서 정답여부를 판단한다.The controller 130 outputs the task display unit including the center view portion and the first problem as the M-th training image to the display 110, and the task including the center view portion and the second problem as the M + N-th training image. The display unit may be output to the display 110 and the user input unit may answer the user's answer as to whether the second problem included in the M + Nth training image matches the first problem included in the training image before N times. 140). That is, the controller 130 determines whether the answer is correct by receiving a first response, which is a result of comparing the first problem provided N times and the currently provided first problem, from the user through the user input unit 140.
또한, 제어부(130)는, 사용자 입력부(140)를 통해 입력되는 답변의 정답률에 기초하여, 테스크표시부에 포함되는 문제의 난이도를 조절할 수 있다. 예를 들어, 테스크표시부에 포함되는 문제의 난이도는, 상기 N의 숫자를 조절하거나, 테스크표시부에 표시되는 도형의 개수, 형상, 색채 중 적어도 하나를 조절함으로써 조절될 수 있다.In addition, the controller 130 may adjust the difficulty level of the problem included in the task display unit based on the correct answer rate of the answer input through the user input unit 140. For example, the difficulty of the problem included in the task display unit may be adjusted by adjusting the number of N or adjusting at least one of the number, shape, and color of the figure displayed in the task display unit.
또한, 다른 일실시예로, 제어부(130)는, 디스플레이(110)의 중심시야부에 사용자의 시선방향을 화면 중앙으로 고정(Fixation)하기 위한 제2문제를 제공한다. 상기 제2문제는, 사용자의 주의를 집중시켜 사용자의 초점이 중앙에 고정되도록 하기 위한 소정 문제이다. 제어부(130)는 제2문제를 중심시야부에 제공하는 경우에 제1문제와 제2문제가 중첩되지 않도록 제1문제를 제공하는 테스크표시부로 주변시야부만을 이용할 수 있다. In another embodiment, the controller 130 provides a second problem for fixing the user's gaze direction to the center of the screen in the center view portion of the display 110. The second problem is a predetermined problem for focusing the user's attention so that the user's focus is fixed at the center. When the second problem is provided to the central view portion, the controller 130 may use only the peripheral view portion as a task display unit that provides the first problem so that the first problem and the second problem do not overlap.
이상에서 전술한 본 발명의 일 실시예에 따른 뇌 자극을 통한 기억력 훈련방법은, 하드웨어인 컴퓨터와 결합되어 실행되기 위해 프로그램(또는 어플리케이션)으로 구현되어 매체에 저장될 수 있다.The memory training method through brain stimulation according to an embodiment of the present invention described above may be implemented as a program (or application) to be executed in combination with a computer which is hardware and stored in a medium.
본 발명의 일실시예에 따른 뇌 자극을 통한 기억력 훈련프로그램은 화면을 출력하는 장치(즉, 디스플레이부를 구비한 장치)에 직접 설치될 수도 있고, 디스플레이장치에 연결되는 장치에 설치될 수도 있다. 예를 들어, 헤드마운트 디스플레이 장치를 통해 기억력 훈련 영상을 제공하는 경우, 헤드마운트 디스플레이 장치가 연결되는 이동단말기(예를 들어, 스마트폰 또는 PC)에 설치될 수 있고, 연산처리가 가능한 프로세서를 구비한 헤드마운트 디스플레이 장치는 내부에 뇌 자극을 통한 기억력 훈련프로그램를 설치할 수 있다.The memory training program through brain stimulation according to an embodiment of the present invention may be directly installed in a device that outputs a screen (that is, a device having a display unit) or may be installed in a device connected to the display device. For example, when providing a memory training image through a head mounted display device, the head mounted display device may be installed in a mobile terminal (for example, a smartphone or a PC) to which the head mounted display device is connected, and has a processor capable of arithmetic processing. One head mounted display device may install a memory training program through brain stimulation.
상기 전술한 프로그램은, 상기 컴퓨터가 프로그램을 읽어 들여 프로그램으로 구현된 상기 방법들을 실행시키기 위하여, 상기 컴퓨터의 프로세서(CPU)가 상기 컴퓨터의 장치 인터페이스를 통해 읽힐 수 있는 C, C++, JAVA, 기계어 등의 컴퓨터 언어로 코드화된 코드(Code)를 포함할 수 있다. 이러한 코드는 상기 방법들을 실행하는 필요한 기능들을 정의한 함수 등과 관련된 기능적인 코드(Functional Code)를 포함할 수 있고, 상기 기능들을 상기 컴퓨터의 프로세서가 소정의 절차대로 실행시키는데 필요한 실행 절차 관련 제어 코드를 포함할 수 있다. 또한, 이러한 코드는 상기 기능들을 상기 컴퓨터의 프로세서가 실행시키는데 필요한 추가 정보나 미디어가 상기 컴퓨터의 내부 또는 외부 메모리의 어느 위치(주소 번지)에서 참조되어야 하는지에 대한 메모리 참조관련 코드를 더 포함할 수 있다. 또한, 상기 컴퓨터의 프로세서가 상기 기능들을 실행시키기 위하여 원격(Remote)에 있는 어떠한 다른 컴퓨터나 서버 등과 통신이 필요한 경우, 코드는 상기 컴퓨터의 통신 모듈을 이용하여 원격에 있는 어떠한 다른 컴퓨터나 서버 등과 어떻게 통신해야 하는지, 통신 시 어떠한 정보나 미디어를 송수신해야 하는지 등에 대한 통신 관련 코드를 더 포함할 수 있다. The above-described program includes C, C ++, JAVA, machine language, etc. which can be read by the computer's processor (CPU) through the computer's device interface so that the computer reads the program and executes the methods implemented as the program. Code may be coded in the computer language of. Such code may include functional code associated with a function or the like that defines the necessary functions for executing the methods, and includes control procedures related to execution procedures necessary for the computer's processor to execute the functions according to a predetermined procedure. can do. In addition, the code may further include memory reference code for additional information or media required for the computer's processor to execute the functions at which location (address address) of the computer's internal or external memory should be referenced. have. Also, if the processor of the computer needs to communicate with any other computer or server remotely in order to execute the functions, the code may be used to communicate with any other computer or server remotely using the communication module of the computer. It may further include a communication related code for whether to communicate, what information or media should be transmitted and received during communication.
상기 저장되는 매체는, 레지스터, 캐쉬, 메모리 등과 같이 짧은 순간 동안 데이터를 저장하는 매체가 아니라 반영구적으로 데이터를 저장하며, 기기에 의해 판독(reading)이 가능한 매체를 의미한다. 구체적으로는, 상기 저장되는 매체의 예로는 ROM, RAM, CD-ROM, 자기 테이프, 플로피디스크, 광 데이터 저장장치 등이 있지만, 이에 제한되지 않는다. 즉, 상기 프로그램은 상기 컴퓨터가 접속할 수 있는 다양한 서버 상의 다양한 기록매체 또는 사용자의 상기 컴퓨터상의 다양한 기록매체에 저장될 수 있다. 또한, 상기 매체는 네트워크로 연결된 컴퓨터 시스템에 분산되어, 분산방식으로 컴퓨터가 읽을 수 있는 코드가 저장될 수 있다.The stored medium is not a medium for storing data for a short time such as a register, a cache, a memory, but semi-permanently, and means a medium that can be read by the device. Specifically, examples of the storage medium include, but are not limited to, a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like. That is, the program may be stored in various recording media on various servers to which the computer can access or various recording media on the computer of the user. The media may also be distributed over network coupled computer systems so that the computer readable code is stored in a distributed fashion.
이상, 첨부된 도면을 참조로 하여 본 발명의 실시예를 설명하였지만, 본 발명이 속하는 기술분야의 통상의 기술자는 본 발명이 그 기술적 사상이나 필수적인 특징을 변경하지 않고서 다른 구체적인 형태로 실시될 수 있다는 것을 이해할 수 있을 것이다. 그러므로, 이상에서 기술한 실시예들은 모든 면에서 예시적인 것이며, 제한적이 아닌 것으로 이해해야만 한다. In the above, embodiments of the present invention have been described with reference to the accompanying drawings, but those skilled in the art to which the present invention pertains may implement the present invention in other specific forms without changing the technical spirit or essential features. I can understand that. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive.

Claims (9)

  1. 컴퓨터가 화면 내의 테스크표시부에 제1문제를 제공하되, 상기 제1문제는 상기 테스크표시부 공간 내의 특정한 위치에 하나 이상의 출력이미지가 표시되는 것인, 제1문제 제공단계;Providing a first problem to a task display unit in a computer screen, wherein the first problem is that one or more output images are displayed at a specific position in the task display unit space;
    컴퓨터가 사용자로부터 상기 제1문제에 대한 제1응답을 수신하되, 상기 제1응답은 N회(N은 자연수) 이전에 제공된 제1문제와 현재 제공된 제1문제를 비교한 결과인, 제1응답 수신단계; 및A first response from the user to the computer, wherein the first response is a result of comparing the first problem provided before N times (N is a natural number) with the currently provided first problem Receiving step; And
    컴퓨터가 상기 제1응답을 기반으로 사용자의 기억력 상태를 평가하는 응답평가단계;를 포함하는, 뇌 자극을 통한 기억력 훈련방법.Response evaluation step of evaluating the memory state of the user based on the first response by the computer; memory training method through the brain stimulation.
  2. 제1항에 있어서, The method of claim 1,
    컴퓨터가 화면 내의 중심시야부에 표시되는 제2문제를 제공하는 제2문제 제공단계; 및 A second problem providing step of providing, by the computer, a second problem displayed on the central field of view within the screen; And
    상기 제2문제에 대한 제2응답을 수신하는 제2응답 수신단계;를 더 포함하되,A second response receiving step of receiving a second response to the second problem;
    상기 제2문제는 사용자에게 출력영상의 중앙을 주시하도록 제공되는 것인, 뇌 자극을 통한 기억력 훈련방법.The second problem is that the user is provided to look at the center of the output image, memory stimulation training method through brain stimulation.
  3. 제1항에 있어서, The method of claim 1,
    상기 제1문제 제공단계는,The first problem providing step,
    컴퓨터가 사용자의 시선방향을 측정하여, 상기 시선방향을 기준으로 상기 제1문제에 따른 출력이미지의 배치위치를 결정하여 제공하는 것을 특징으로 하는, 뇌 자극을 통한 기억력 훈련방법.The computer measures the gaze direction of the user, and determines the arrangement position of the output image according to the first problem based on the gaze direction, characterized in that the memory training method through the brain stimulation.
  4. 제1항에 있어서, The method of claim 1,
    상기 제1문제는,The first problem,
    상기 출력이미지의 개수, 종류, 배치위치 및 크기 중 적어도 하나를 변경하여 제공되는 것이고,It is provided by changing at least one of the number, type, arrangement position and size of the output image,
    상기 제1응답은,The first response is,
    현재 제공되는 화면이미지가 N회 이전의 화면이미지와 일치하는지 여부를 입력하는 것이며,Enter whether or not the currently provided screen image matches the previous screen image N times.
    상기 화면이미지는 상기 제1문제에 따라 하나 이상의 출력이미지가 배치된 화면 자체인, 뇌 자극을 통한 기억력 훈련방법.The screen image is a memory training method through the brain stimulation, the screen itself is arranged one or more output images according to the first problem.
  5. 제1항에 있어서, The method of claim 1,
    사용자상태에 따라 N의 값을 조절하는 것을 특징으로 하는, 뇌 자극을 통한 기억력 훈련방법.The memory training method through the brain stimulation, characterized in that for adjusting the value of N according to the user state.
  6. 제2항에 있어서, The method of claim 2,
    상기 제1문제 제공단계는,The first problem providing step,
    상기 제2문제의 3차원공간 내 배치위치를 기반으로, 제1문제에 포함된 출력이미지를 표시하는 3차원공간 내 위치를 결정하는 것을 특징으로 하는, 뇌 자극을 통한 기억력 훈련방법.The memory training method through the brain stimulation, characterized in that for determining the position in the three-dimensional space for displaying the output image included in the first problem based on the placement position in the three-dimensional space of the second problem.
  7. 제1항 내지 제6항 중 어느 한 항에 있어서,The method according to any one of claims 1 to 6,
    컴퓨터가 제1문제를 헤드마운트 디스플레이 장치의 화면 상에 제공하는 것을 특징으로 하는, 뇌 자극을 통한 기억력 훈련방법.A memory training method through brain stimulation, characterized in that the computer presents the first problem on the screen of the head mounted display device.
  8. 화면 내의 테스크표시부에 제1문제를 제공하고,Provide the first problem to the task display on the screen,
    컴퓨터가 사용자로부터 상기 제1문제에 대한 제1응답을 수신하고,The computer receives a first response to the first problem from the user,
    컴퓨터가 상기 응답을 기반으로 사용자의 기억력 상태를 평가하되,The computer evaluates the memory state of the user based on the response,
    상기 제1문제는 상기 테스크표시부 공간 내의 특정한 위치에 하나 이상의 출력이미지가 표시되는 것이고,The first problem is that one or more output images are displayed at a specific position in the task display unit space.
    상기 제1응답은 N회 이전에 제공된 제1문제와 현재 제공된 제1문제를 비교한 결과인, 뇌 자극을 통한 기억력 훈련장치.The first response is a result of comparing the first problem provided first with the first problem provided N times, memory training device through the brain stimulation.
  9. 하드웨어인 컴퓨터와 결합되어, 제1항 내지 제6항 중 어느 한 항의 방법을 실행시키기 위하여 매체에 저장된, 뇌 자극을 통한 기억력 훈련프로그램.A memory training program through brain stimulation, stored in a medium for carrying out the method of any one of claims 1 to 6, coupled with a computer which is hardware.
PCT/KR2017/010631 2016-09-26 2017-09-26 Device, method, and program for memory training through brain stimulation WO2018056790A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP17853504.3A EP3517160B1 (en) 2016-09-26 2017-09-26 Device, method, and program for memory training through brain stimulation
US16/363,884 US11376393B2 (en) 2016-09-26 2019-03-25 Device and method for training memory using brain stimulation

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR10-2016-0123203 2016-09-26
KR20160123203 2016-09-26
KR10-2017-0123892 2017-09-26
KR1020170123892A KR101939339B1 (en) 2016-09-26 2017-09-26 Device, method and program for training memory using brain stimulation

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/363,884 Continuation US11376393B2 (en) 2016-09-26 2019-03-25 Device and method for training memory using brain stimulation

Publications (1)

Publication Number Publication Date
WO2018056790A1 true WO2018056790A1 (en) 2018-03-29

Family

ID=61689636

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2017/010631 WO2018056790A1 (en) 2016-09-26 2017-09-26 Device, method, and program for memory training through brain stimulation

Country Status (1)

Country Link
WO (1) WO2018056790A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109300364A (en) * 2018-11-30 2019-02-01 北京京师脑力科技有限公司 A kind of cognitive training method and system improving memory
CN115188447A (en) * 2022-09-08 2022-10-14 浙江强脑科技有限公司 Memory training method and device based on electroencephalogram signals

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101114299B1 (en) * 2008-11-21 2012-03-05 비알 컨설팅 인코포레이티드 Apparatus and method for training and managing brain condition
KR20120046578A (en) * 2010-11-02 2012-05-10 경성대학교 산학협력단 Serious game system for old-aged person, and method for the same
KR101297134B1 (en) * 2011-07-19 2013-08-20 영남대학교 산학협력단 Method for memory improvement training by smart-phone and recording medium storing the same
KR101350957B1 (en) * 2012-02-29 2014-02-13 주식회사 넷블루 Computer-based cognitive training system for cognitive disability children
KR101564168B1 (en) * 2014-04-11 2015-10-29 울산대학교 산학협력단 Brain damage and cognitive function in the visual perception training device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101114299B1 (en) * 2008-11-21 2012-03-05 비알 컨설팅 인코포레이티드 Apparatus and method for training and managing brain condition
KR20120046578A (en) * 2010-11-02 2012-05-10 경성대학교 산학협력단 Serious game system for old-aged person, and method for the same
KR101297134B1 (en) * 2011-07-19 2013-08-20 영남대학교 산학협력단 Method for memory improvement training by smart-phone and recording medium storing the same
KR101350957B1 (en) * 2012-02-29 2014-02-13 주식회사 넷블루 Computer-based cognitive training system for cognitive disability children
KR101564168B1 (en) * 2014-04-11 2015-10-29 울산대학교 산학협력단 Brain damage and cognitive function in the visual perception training device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3517160A4 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109300364A (en) * 2018-11-30 2019-02-01 北京京师脑力科技有限公司 A kind of cognitive training method and system improving memory
CN115188447A (en) * 2022-09-08 2022-10-14 浙江强脑科技有限公司 Memory training method and device based on electroencephalogram signals

Similar Documents

Publication Publication Date Title
KR101939339B1 (en) Device, method and program for training memory using brain stimulation
KR101965393B1 (en) Visual perception training device, method and program for visual perception training using head mounted device
WO2023033461A1 (en) Apparatus and method for providing virtual reality-based eye exercise and visual perception training
O'Regan et al. Acting out our sensory experience
WO2018056790A1 (en) Device, method, and program for memory training through brain stimulation
US20120282585A1 (en) Interest-Attention Feedback System for Separating Cognitive Awareness into Different Left and Right Sensor Displays
WO2018056791A1 (en) Computing device for providing visual perception training, and method and program, based on head-mounted display device, for providing visual perception training
Manzotti et al. Does Functionalism really deal with the phenomenal side of experience?
US11249549B2 (en) Brain connectivity-based visual perception training device, method and program
CA2217909C (en) Competing opposing stimulus simulator sickness reduction technique
Gallese et al. Mirror neurons: A sensorimotor representation system
Clark et al. Sensorimotor chauvinism?
Block Behaviorism revisited
KR102275379B1 (en) Device, method and program for visual perception training by brain connectivity
CN104352340A (en) Comprehensive visual function training device and comprehensive visual function training method
Scholl et al. Change blindness, Gibson, and the sensorimotor theory of vision
WO2023033545A1 (en) Device, method and program for searching and training preferred retinal locus of patient with visual field damage
Goodale Real action in a virtual world
Revonsuo Dreaming and the place of consciousness in nature
Bartolomeo et al. Visual awareness relies on exogenous orienting of attention: Evidence from unilateral neglect
CN207690338U (en) A kind of simulation training device and virtual reality device
Tatler Re-presenting the case for representation
Van Gulick Still room for representations
WO2020116739A1 (en) Device and method for predicting sickness experienced by user when viewing virtual reality content
Velichkovsky et al. In search of the ultimate evidence: The fastest visual reaction adapts to environment, not retinal locations

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17853504

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2017853504

Country of ref document: EP

Effective date: 20190426