KR20120051275A - Training device of point of view and recognition - Google Patents

Abstract

PURPOSE: An apparatus for training vision and recognition is provided to efficiently improve the vision and recognition capability of a user without voluntary will b improving eyeball muscle power. CONSTITUTION: An apparatus for training vision and recognition includes a recognition unit(111) and a beam output unit(115). The recognition unit recognizes characters displayed on an object. The object includes a print out on which the characters are printed and a screen of a digital device on which the characters are displayed. The beam output unit outputs recognition beams, which eyeballs recognize for training the vision and recognition of a user, to an object and moves the recognition beams while blinking the recognition beams if the recognition unit recognizes the characters.

Description

TRAINING DEVICE OF POINT OF VIEW AND RECOGNITION}

The present invention relates to a visual and cognitive training apparatus.

Digging into the secrets of the brain's attention system, everyone has a change-awareness disorder. This means that we miss the big change when we move from one scene to the next, and we often don't see any obvious and obvious changes, because the brain's partial utilization is divided so that the eye's attention system will see what the brain's attention system will see. This is because it selects key elements that are appropriate to the habits and situations.

Based on the brain's attention system, if you use cognitive training methods that suit your personal habits, you will be able to focus on one thing and have the ability to choose what's important just by looking at it. The other part is just a background screen and induces you to focus on only one, and conversely, it can also improve your ability to respond quickly and actively to changes in your surroundings.

However, the conventional cognitive enhancement technology is a technology using a computer monitor or LCD screen has a disadvantage that it is difficult to use when there is no computer.

In addition, the eyes are easily tired and practically can not apply the pattern directly while reading a book. In other words, even if the user starts the training with the expectation, it is difficult to actually apply, and most of them have a problem that the eye training cannot be performed properly.

Therefore, the technical problem to be achieved by the present invention is to provide a training apparatus that can easily improve the visual and cognitive ability even if the user does not intend to improve the visual and cognitive ability intentionally.

According to one aspect of the invention there is provided a visual and cognitive training apparatus. The apparatus includes a recognition unit for recognizing a character displayed on an object, wherein the object includes a publication in which characters are printed or a screen of a digital device on which the characters are displayed; And a beam output unit configured to output a blinking recognition beam that can be recognized by the eye for visual and / or cognitive training of the user to the object when the recognition unit recognizes a character and to move while blinking.

According to another feature of the invention there is provided a visual and cognitive training apparatus. The apparatus comprises a storage unit for storing visual images for visual or / and cognitive training; And a beam projector that continuously outputs the visual image on the screen while changing the speed in a predetermined direction among up, down, left, and right directions.

According to an embodiment of the present invention, more than 20 various training program schemes can improve regression and lack of concentration, which have a negative effect on speed reading training, and correct correction of circumference and non-viscidence, and brain training through EEG tuning. It is possible to effectively improve the visual and cognitive ability of the user without having a computer as in the prior art and without involving the user's willingness by improving the eye muscle strength.

1 is a block diagram showing the configuration of a visual and cognitive training apparatus according to a first embodiment of the present invention.
FIG. 2 is a flowchart illustrating an operation of the visual and cognitive training apparatus of FIG. 1.
3 is a block diagram showing the configuration of a visual and cognitive training apparatus according to a second embodiment of the present invention.
4 to 6 are flowcharts illustrating operations of the visual and cognitive training apparatus of FIG. 3.
7 is a block diagram showing the configuration of a visual and cognitive training apparatus according to a third embodiment of the present invention.
FIG. 8 is a flowchart illustrating an operation of the visual and cognitive training apparatus of FIG. 7.
9 shows an example output of a recognition beam according to an embodiment of the present invention.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when an element is referred to as "comprising ", it means that it can include other elements as well, without excluding other elements unless specifically stated otherwise.

Hereinafter, a visual and cognitive training apparatus according to an embodiment of the present invention with reference to the drawings will be described in detail.

In the present specification, the visual and cognitive training device is an electronic device that has a specific form of appearance and operates by being supplied with battery power or outlet power. For example, the visual and cognitive training device may be implemented in the form of a stand. However, it is not limited to the above and various embodiments are possible.

This visual and cognitive training device performs functions that help to acquire knowledge, and recognizes the information needed by the user by interlocking the object such as books through fast reading training, eye cognitive training and pre-stored data through the recognition beam. It is a device that can do it.

In addition, the visual and cognitive training device provides the cognitive training to guide the user to the most efficient use of the center of vision and the peripheral field of vision through the recognition beam, which informs the user of the best viewing position according to the user's visual ability. The most effective pattern is given according to the eye utilization ability.

In addition, the visual and cognitive training device is a device that provides a combination of various visual images in addition to the recognition beam to the object.

In addition, the visual and cognitive training device is a device that develops the cognitive area that activates the eyeball area of the brain through mutual interference of memory search and spatial working memory through various visual images.

Cognitive training performed by these visual and cognitive training devices includes speed reading training, eye training, and the like.

Here, the speed reading training is based on the interline movement of the eyeball, the learner can quickly remember and remember at any time when needed, and not only to remember many words in a short time but also to improve long-term memory ability. Specifically, the program is composed of a program for helping to improve concentration so that the learner can recognize the letter in a short time.

In addition, eye training is a training for activating the peripheral field of view to view a large number of sentences at a time, and consists of time-expanding training, eye stretching training, viewpoint movement training, and the like. For example, the time-expansion training is a training to widen the left and right and top and bottom of the visual field of view so that many characters can be seen by widening the range of the visual field at once. To widen the left and right field of view, place five points vertically on the left at regular intervals and place five points on the right at the same position on the right at intervals of 25 to 30 centimeters. The effect can be obtained.

On the other hand, visual training performed by the visual and cognitive training apparatus includes eye muscle strength training and cyan correction training.

Here, the eye muscle strength training is a training for improving the eye muscle strength, and may include eyeball traverse training, eyeball longitudinal training, eyeball oblique training, eye network training, and the like.

In addition, the cyan correction training is a training to reinforce the non-viscian through the brightness, hue, saturation contrast because the cyan and non-viscian are different in color recognition.

The visual and cognitive training apparatus outputs the recognition beam including the shape of the recognition beam that can be recognized by the eye, blinking, moving, blinking and moving direction / speed, amount of light output, output period, output position, and color. Combination to provide the above-described training effect.

Here, the shape of the recognition beam may include a point shape and may be a recognition beam of two or more point shapes. Also, meaningful figures may be combined.

In addition, the visual and cognitive training apparatus may emit a waveform that induces EEG tuning by continuously blinking or changing the color of the recognition beam based on a continuous or constant time.

Meanwhile, the specific visual and cognitive training method is selected from various cognitive and visual training methods presented in the related art. For example, there is a crawl focus, one of speed reading training, which moves characters from right to left to generate rapid eye movement. For this speed reading training, the visual and cognitive training apparatus outputs a recognition beam in the form of dots around a character and moves from right to left to obtain the effect of crawl focus. The rest of the training is omitted and it is obvious that it is implemented in this way.

Such visual and cognitive training apparatus may include all or some of the above-described visual and cognitive training, and may perform a complex training by combining some of the different visual and cognitive training methods. It may be implemented according to the following three embodiments.

<First Embodiment>

First, Figure 1 is a block diagram showing the configuration of a visual and cognitive training apparatus according to a first embodiment of the present invention.

Referring to FIG. 1, the visual and cognitive training apparatus includes a storage unit 101, an input unit 103, a display unit 105, a user interface control unit 107, a sensing unit 109, a recognition unit 111, and a beam output control unit. 113, a beam output unit 115, a distance sensor unit 117, and a light sensitivity sensor unit 119.

The storage unit 101 stores menu information, user information, and output control information of the recognition beam including a plurality of selection items for visual and cognitive training mode selection.

Here, the output control information may include information about a recognition beam for cognitive training and visual training, and may include an output position on an object of the recognition beam, a blinking of the recognition beam, and a moving speed / direction.

In addition, the user information includes user reading ability information.

The input unit 103 is a means for turning on the power, selecting a visual and cognitive training mode, and receiving user information. The input unit 103 may be implemented as a selection button, a keypad, a touch pad, or the like.

The display unit 105 displays menu information stored in the storage unit 101 and information selected or input by the user transferred from the input unit 103 on a screen, and may be implemented as a small liquid crystal display (LCD) screen.

The user interface controller 107 outputs menu information to the display unit 105 to receive information input or selected by the user from the input unit 103 to instruct the driving of the sensing unit 109, and to receive the information received from the input unit 103. To the beam output controller 113.

The sensing unit 109 irradiates light onto an object to collect light that is reflected or transmitted through the object. Here, the object includes a publication in which characters are printed or a screen of a digital device on which characters are displayed. That is, it includes printed matters such as books and notes, and electronic screens such as mobile phones, PDAs, notebooks, and iPads that output text.

Letters also include letters, numbers, and symbols.

The sensing unit 109 may be an infrared sensor, and includes a light emitting unit (not shown) for emitting infrared rays and a light receiving unit (not shown) for collecting infrared rays reflected or transmitted to an object.

The recognition unit 111 recognizes a character displayed on the object based on the light collected by the sensing unit 109, and recognizes the character through an amount of change in voltage or an amount of light. Here, the letter is defined as a letter including all letters, numbers, and symbols.

In general, the characters displayed on the object are mainly black, and the part other than the characters, that is, the margin where the characters are not displayed is white. Therefore, when infrared light is emitted from the light emitting unit (not shown) of the sensing unit 109 to white and black, the voltage of the light receiving unit (not shown) is higher than that of the black case of the white having a large reflection amount.

The recognition unit 111 compares the voltage sensed by the amount of reflection collected by the light receiving unit (not shown) with the reference voltage and recognizes the text by recognizing it as white when the reference voltage is higher than the reference voltage and black when the reference voltage is lower than the reference voltage.

In addition, since white has a larger reflection amount than black, the recognition unit 111 compares the reflection amount collected by the light receiving unit (not shown) with the reference reflection amount, and recognizes the character as white if it is larger than the reference reflection amount and black if it is lower than the reference reflection amount. Recognize.

When the recognition unit 111 recognizes the character, the beam output control unit 113 extracts output control information of the recognition beam according to the user selection or input information received from the user interface control unit 107 in the storage unit 101. . In this case, the output control information may be stored in match with the voltage or reflection amount of the portion corresponding to the black recognized by the recognition unit 111.

The beam output unit 115 outputs a recognition beam that can be recognized by the eye to the object under the control of the beam output controller 113. For example, several recognition beams in the form of dots are continuously displayed and blinked at positions adjacent to a character displayed on an object, and are moved at a specific speed in one of the up, down, left, and right directions.

In this case, the beam output unit 115 may output a recognition beam of a waveform for inducing brain wave tuning by blinking and changing color for a predetermined time.

The beam output unit 115 may be implemented as a light emitting diode (LED) lamp, a dispaly information processor (DIP) lamp, a beam projector, or the like.

The distance sensor unit 117 is a sensor that measures the distance between the beam output unit 115 and the object, and may be implemented as an ultrasonic sensor.

The light sensitivity sensor unit 119 detects light emitted from the beam output unit 115 to determine light sensitivity, and the recognition beam output by the beam output unit 115 in consideration of the distance information measured by the distance sensor unit 117. Adjust the illuminance of

FIG. 2 is a flowchart illustrating an operation of the visual and cognitive training apparatus of FIG. 1.

2, the storage unit 101, the input unit 103, the display unit 105, the user interface control unit 107, the sensing unit 109, the recognition unit 111, the beam output control unit 113, and the beam output unit. Part 115, the distance sensor unit 117 and the light sensitivity sensor unit 119

When the power is turned on, the display unit 105 displays menu information stored in the storage unit 101 on the screen (S101). When the input unit 103 receives user selection information (S103), the sensing unit 109 irradiates light onto the object (S105) and collects reflected or transmitted light (S107).

The recognition unit 111 recognizes the character line based on the amount of voltage or reflection of light collected in step S107 (S109). The light sensitivity sensor 119 sets light sensitivity and illuminance based on the distance information measured by the distance sensor 117 (S111).

In addition, the beam output controller 113 determines an output position, a blinking and moving speed / direction, and an output form of the recognition beam based on the user selection information input in step S103 (S113) and outputs the recognition beam to the object (S115). ).

Second Embodiment

3 is a block diagram showing the configuration of a visual and cognitive training apparatus according to a second embodiment of the present invention.

Referring to FIG. 3, the visual and cognitive training apparatus 200 includes a storage 201, an input unit 203, a display unit 205, a user interface control unit 207, a photographing unit 209, a recognition unit 211, Beam projector 213, beam output controller 215, beam output unit 217, distance sensor unit 219, light sensitivity sensor unit 221, sensor unit 223, memory 225, voice converter 227 ), A speaker 229, a code reader 231, a communication unit 233, a tag reader 235, a cable input / output terminal 237, a USB port 239, a short range wireless communication unit 241, and a sensing unit 243. Include.

The storage unit 201 stores menu information, user information, and output control information of the recognition beam including a plurality of selection items for visual and cognitive training mode selection.

Here, the menu information may be used to select a visual and cognitive training level, input or select visual and cognitive ability information of a user, and may include various selection items.

The user information refers to visual and cognitive ability information of the reading ability information of the user input or selected by the user.

And the output control information of the recognition beam is composed of the output characteristics of the recognition beam matched by visual and cognitive training, the shape of the recognition beam (beam), flashing, moving, flashing and moving direction / speed, output light amount, output period, It consists of a combination of output location and color.

In this case, the direction includes one or more of up, down, left, and right directions, and includes a form in which two or more point recognition beams continuously emit light on a horizontal line.

In addition, the recognition beam may be composed of a dot form, a set of braille or a specific symbol, and the like, and are output through the beam projector 213 and / or the beam output unit 217.

In addition, the storage unit 101 may store information about the summary text of the object, all texts described in the object, and / or some text.

Here, the text is composed of a plurality of characters, spaces between characters and characters, punctuation marks.

And the summary text is, for example, a summary of the text, all the text includes the entire contents of the text, some of the text is stored in the user terminal (not shown), or includes some contents of the text downloaded through a server (not shown) on the Internet. do.

In this case, the storage unit 101 may store the text itself of the object. In this case, the feature of the stored text is extracted in real time and compared with the feature of the text recognized by the recognizer 211. Alternatively, feature information for identifying text other than text may be stored.

Here, the characteristic information of the text is characteristic information of a character capable of identifying the text, and is configured to have only unique characteristics distinguished from other characters by using the outline of the character, the number of strokes of the character, and the like. At this time, the reference data information for providing the reference data when the feature information of the character is included and the character information of each character for character identification is included.

When the storage unit 101 stores the feature information for identifying the text, the storage 101 may store all the features of each character of the text. In this case, however, the capacity may be limited, so that only some character features that are distinguished from other text may be stored. That is, among the characters constituting the text displayed on one page by dividing the corresponding text into page units, the contour characteristics of the characters located at four corners of the page may be stored.

Here, two or more characters may be selected so that the characters located at four corners may have unique characteristics that are distinguished from the text of other pages.

In addition, the feature information of the text may include left and right page division information of the page on which the text is displayed. The output control information of the recognition beams differently set for each of the left and right pages is matched according to the left and right page division information. At this time, the output period, the light amount, and the shape of the recognition beam of the recognition beam of each page may be different.

In addition, the storage unit 101 includes a summary text, a visual image that matches all text and / or some text, and output control information of the visual image. In this case, the visual image may include a figure, a picture, a still image, a moving image, and the like, but various other embodiments are possible, and the output control information is defined similarly to the output control information of the recognition beam.

In addition, the storage unit 101 stores the visual image information mapped to the personal information so that the beam projector 213 may output the personal reading information or the advertisement image suitable for the personal characteristics near the text.

Here, the personal information includes personal reading information or personal characteristic information. The information may be downloaded when the user registers on the Internet, or may be information directly input by the user through the input unit 203.

Since constructing an advertisement image that conforms to personal information can be employed in many prior arts, various embodiments are possible.

The visual image may be embedded in the storage unit 101 and updated later through an internet network.

In addition, the storage unit 101 may include additional information matched with feature information of characters constituting a meaningful word. Here, the additional information includes dictionary information such as an English dictionary, a Korean dictionary, and the like for meaningful words.

In addition, the storage unit 101 may store output control information, visual images, and additional information of the recognition beam according to the amount of characters. The amount of characters may be expressed by the number of characters through the characteristic information of the characters, that is, the outline features of each character.

On the other hand, the input unit 203, the display unit 205, and the user interface control unit 207 are the same as the configurations 103, 105, and 107 of FIG.

The photographing unit 209 is a means for generating an image by photographing an object such as a camera or by scanning an object such as an image scanner.

The recognition unit 211 recognizes a character by extracting a character feature from an image generated by the photographing unit 209.

In this case, the method of recognizing the character from the image by the recognition unit 211, there are a variety of embodiments, representatively described two embodiments as follows, but is not limited to this, various conventional character recognition technology may be used. Is self-explanatory.

According to an exemplary embodiment, a character may be recognized by comparing an image with reference data stored in the storage 201. Specifically, the reference data may be a pixel of a character, and the recognition unit 211 compares the pixels of the image with the reference data, extracts only a portion corresponding to the character, and separates the image into an image where the character is displayed and an image that is not displayed. . The character may be recognized by comparing the contour characteristic of the character for each character stored in the storage unit 201 with the contour characteristic of the character of the image on which the character is displayed.

According to another embodiment, a character included in an image may be recognized through an optical character recognition (OCR) program.

The beam projector 213 outputs the recognition beam at a specific position close to the character recognized by the recognition unit 211. In addition, among the visual images stored in the storage unit 201, a visual image matching the character recognized by the recognition unit 211 is output to the object. In addition, among the additional information stored in the storage unit 201, the additional information matching the character recognized by the recognition unit 211 is output to the object.

The beam projector 213 may output a visual including a circle, a curved shape, a figure pattern, and / or a visual image for eye training to guide a user to memorize a sequential light emission sequence. The visual image may be output while sequentially moving to a position close to the recognition beam in a predetermined order in one of the up, down, left, and right directions.

In addition, the beam projector 213 may be rotated 360 ° so as to change the output direction at the request of the user interface controller 207, and outputs a text image stored in the memory 225 on a screen provided externally.

The beam output controller 215 controls the output of the recognition beam according to the output control information matching the information selected or input by the user provided from the user interface controller 207.

The beam output unit 217 may be implemented as an LED lamp, a digital light processing (DLP) lamp, or the like, and under the control of the beam output controller 215, a recognition beam independently or correlated with the beam projector 213 may be applied to the object. Output The beam output unit 217 is an element added to the beam projector 213 and may be an optional element.

The distance sensor unit 219 and the light sensitivity sensor unit 221 are the same as those of the configurations 117 and 119 of FIG. 1, where the light sensitivity sensor unit 221 controls the recognition beam output of the beam projector 213.

The detector 223 reads the existence of a predefined image in an image in which the character separated by the recognizer 211 is not displayed. Here, the predefined image may be variously defined as an image of an operation of emphasizing a character. For example, the image may be a gesture of emphasizing a character, an operation of drawing a line on a character, an operation of pointing a specific character for a certain time, and the like.

At this time, the detection unit 223 stores in advance an image of an operation of emphasizing a character with a subject such as a hand, an image lined with the character, a subject already pointing to a specific character for a predetermined time, and compares the pixels to compare the images. A match can be read, but not limited to the above, and may be employed among various image reading techniques presented in the prior art.

When the pre-defined image is read, the detector 223 stores the image obtained in the memory 225 by causing the photographing unit 209 to photograph the object on which the additional information is displayed by the beam projector 213.

In addition, the detector 223 may extract text data from an image acquired through the photographing unit 231 in association with the recognizer 211 and store the text data in the memory 225 together with the acquired image.

The voice converter 227 is a TTS (Text To Speech) device that converts the text data extracted by the recognition unit 211 matching the image stored in the memory 225 into voice.

The speaker 229 amplifies and outputs the voice converted by the voice converter 227.

The code reader 231 is a means for recognizing code means for representing information in a pattern, and the code means includes codes in a two-dimensional or three-dimensional form such as a barcode and a QR code. The code reader 231 reads the pattern pattern of the tag means, extracts identification information of the object including the text information (eg, summary text, all or some text of the object), and transmits it to the communication unit 233.

The communication unit 233 is connected to a wired / wireless network (not shown) to process data transmission and reception, and the wired / wireless network may include a Wi-Fi network, a 3G mobile communication network, and an internet network.

The communication unit 233 receives text information matching the identification information by transmitting identification information of the object extracted by the code reader 231 or the tag reader 235 to be described later to a server (not shown) on the Internet that manages the information of the object. To store in the storage unit 201.

The tag reader 235 performs frequency communication with a radio frequency identification (RFID) tag, extracts identification information of an object included in the radio frequency identification tag, and transmits the identification information to the communication unit 233.

The cable input / output terminal 237 is an input / output means connected to a digital electronic device (not shown) through a data cable. Here, the digital electronic device (not shown) includes a mobile phone, a personal digital assistant (PDA), a notebook, a PC, an iPad, an MP3, a portable multimedia player (PMP), and the like. The cable input / output terminal 237 receives text information stored in a digital electronic device (not shown) and stores it in the storage unit 201.

The USB (Universal Serial Bus) port 239 is connected to a digital electronic device (not shown) through a USB (Universal Serial Bus) cable, and receives the text information stored in the digital electronic device (not shown). 201).

The short range wireless communication unit 241 receives text information of an object stored in a digital electronic device (not shown) by short range wireless communication including Bluetooth and transmits it to the storage unit 201.

The sensing unit 243 is a means for collecting light reflected or transmitted to the object by irradiating light onto the object, and may be an infrared sensor. The detector 223 may determine that the text is emphasized when the amount of light at a specific point is continuously increased based on the amount of light collected by the sensing unit 243. Alternatively, when an underline is underlined with a colored pen, the underlined recognition may be performed by recognizing the underline through the amount of voltage of light for each color.

4 to 6 are flowcharts illustrating operations of the visual and cognitive training apparatus of FIG. 3, which will be described according to embodiments of the visual and cognitive training method.

First, referring to FIG. 4, when the power is turned on, the display unit 205 displays a user selection menu stored in the storage unit 201 (S201), and the input unit 203 receives user selection information (S203).

Then, the photographing unit 209 photographs the object located in the read range to generate an image (S205).

Then, the recognizer 211 decodes the image generated by the photographing unit 209 and divides the image into the image in which the character is displayed and the image in which the character is not displayed (S207).

The beam output controller 215 extracts the contour feature of the character from the image in which the separated character is displayed in step S207 (S209) and checks the output control information of the matching recognition beam from the storage unit 201 (S211).

The beam projector 213 or the beam output unit 217 outputs the recognition beam to the object according to the output control information checked in step S211 (S213).

In addition, the beam output controller 215 compares (S215) whether or not the contour feature that matches the contour feature of the character extracted in step S209 is stored in the storage unit 201 (S215), and matches (S217), the matching visual image and The output control information of the visual image is extracted (S219). The visual image is output to the object in addition to the recognition beam according to the output control information (S221).

Next, referring to FIG. 5, when the recognition unit 211 separates an image generated by the photographing unit 209 into an image displaying a character and an image not displaying (S301), the detection unit 223 does not display a character. The image that has not been analyzed is analyzed (S303), and it is determined whether or not the motion is important to the character (S305).

In this case, when it is determined that the important display operation is performed, the detector 223 captures an image of the current object through the photographing unit 209 and stores it in the memory 225 (S307).

Here, steps S301 to S307 may be performed in parallel with steps subsequent to step S209 of FIG. 4.

Thereafter, when the power is turned on, the display unit 205 displays a user selection menu (S309), and the input unit 203 receives user selection information (S311).

Then, if the user interface controller 207 receives user selection information for requesting the output of the text image stored in the memory 225 in step S311 (S313), the user interface controller 207 rotates the beam projector 213 in the screen direction. (S315). Then, the beam projector 213 outputs the text image stored in the memory 225 requested by the user interface controller 207 on the screen (S317).

In addition, when the user interface controller 207 is requested to output the recognition beam in operation S311 (S319), the user interface controller 207 requests the beam output controller 215 to rotate the beam output unit 217 in the screen direction (S321). Then, the beam output unit 217 outputs the recognition beam to the screen on which the text image is output (S323). At this time, the output operation of the recognition beam is the same as the steps S211 and S213 of FIG. 4.

Finally, referring to FIG. 6, the storage unit 201 stores an additional information image matching the contour features of one or more characters constituting a meaningful word (S401).

Thereafter, the detection unit 223 detects a predefined operation at a specific point of the object on which the character is displayed through the recognition unit 211 or the sensing unit 243 (S403). Then, the contour feature of the character at the point where the motion is detected is obtained from the recognition unit 211 and compared with the contour feature stored in the storage unit 201 (S405).

In this case, when there is a matching contour feature, the additional information image matching the corresponding contour feature is output to the object through the beam projector 213 (S409).

Third Embodiment

7 is a block diagram showing the configuration of a visual and cognitive training apparatus according to a third embodiment of the present invention.

Referring to FIG. 7, the visual and cognitive training apparatus 300 includes glasses 310 and a beam projector 330.

The glasses 310 may have a general form of glasses, such as an IMAX glasses, a 3D glasses, and the like, and include a small camera 311 and a communication unit 312.

The small camera 311 is attached to a position where the eye contact with the eye to take an eye image of the eye wearer.

The communication unit 312 transmits an eye image image captured by the small camera 311 to the beam projector 330. In this case, the communication unit 312 may perform wireless communication with the beam projector 330. Alternatively, the wire projector may be connected to the beam projector 330 through a cable (not shown).

The beam projector 330 includes a connection unit 331, a gaze tracking unit 332, an output unit 333, a storage unit 334, a display unit 335, an input unit 336, and a control unit 337.

The connection part 331 is a connection part connected to the communication part 312, and may be a cable input / output terminal (not shown), a USB port, or the like.

The gaze tracking unit 332 analyzes the eye image image received from the glasses 310 through the connection unit 331 to track the gaze movement including the gaze direction, gaze moving angle, and gaze depth.

The output unit 333 outputs a recognition beam and / or a visual image for visual and cognitive training according to the eye movement tracked by the eye tracking unit 332 on the screen.

The storage unit 334 includes menu information including a plurality of items for selecting the level and type of the visual and cognitive training mode, and output control information of the recognition beam matching the user's visual and cognitive ability information (FIGS. 1 and 3). The same as the content), and output control information (same as the content of FIGS. 1 and 3) of the visual image and the visual image. In this case, the output control information of the recognition beam and the output control information of the visual image are matched with the gaze motion.

The display unit 335 is a small LCD liquid crystal display and displays information stored in the storage unit 334 and information received through the input unit 336 on the screen.

The input unit 336 is composed of a keypad, a touch pad, a key button, and the like, and means for allowing a user to input menu selection and user information.

The controller 337 is connected to the connection unit 331, the eye tracking unit 332, the output unit 333, the storage unit 334, the display unit 335, and the input unit 336 to control an operation according to the interconnection relationship. . That is, the input unit 336 outputs a recognition beam and / or a visual image for visual and cognitive training according to the information selected or input by the user on the screen.

In addition, a visual image matching the eye movement, that is, a visual image for visual and cognitive training, is obtained from the storage 335 and transmitted to the output unit 334.

FIG. 8 is a flowchart illustrating an operation of the visual and cognitive training apparatus of FIG. 7.

Referring to FIG. 8, the beam projector 330 displays a user selection menu on a screen in operation S501 and receives a visual and eye training mode selected by the user in operation S503.

At this time, the beam projector 330 determines whether the glasses 310 are connected (S505), and if not connected, displays a message requesting the glasses connection on the screen (S507).

When the glasses 310 are connected, the beam projector 330 outputs a recognition beam and / or a visual image for visual and eye training received in operation S503 on the screen (S509). When the eye image of the spectacle wearer is received (S511), the eye movement is tracked (S513) to determine a recognition beam and / or a visual image matching the eye movement, and thus output control information is determined (S515).

Then, the beam projector 330 outputs the recognition beam and / or the visual image determined in step S515 to the screen according to the output control information (S517).

In this case, the beam projector 330 may continuously output the visual image on the screen while changing the speed in a predetermined direction among up, down, left, and right directions.

In addition, a single image or two or more images can be moved in at least one direction.

In addition, in all the embodiments described above, the beam output unit 115, 217 and the beam projectors 213, 330 visually recognize a recognition beam having waveform information that induces EEG tuning by blinking and color change for a predetermined time. And output to the object or screen in addition to the mode for cognitive training.

At this time, color therapy and periodic EEG tuning can be induced to the eyes by utilizing various colors of backlight. In addition, the eye shutter function and the light emitting point can induce the periodic waveform of vision to perform EEG tuning.

In addition, the beam output units 115 and 217 may sequentially move in a predetermined order in one of the up, down, left, and right directions while continuously emitting two or more dot-shaped recognition beams.

9 shows an example of the output of the recognition beam according to the embodiment of the present invention.

Referring to FIG. 9, by moving a plurality of dot-shaped recognition beams at the bottom of the characters displayed on the object 400 while blinking from left to right, the eye may recognize the characters in units of lines, thereby improving reading speed. In addition, the recognition beam may recognize only the characters of the exposed portion to block unnecessary vision, and may recognize the same as the moving speed of the recognition beam to perform the speed reading training.

Here, factors that negatively affect speed reading are degeneration, lack of concentration, eye fixation, and the like. Also, the factor that has a positive influence is reading the semantic unit. Therefore, speed reading training consists of training programs that reinforce the training of positively affecting factors and eliminate negatively affecting factors.

That is, the training to enhance reading by breaking the semantic unit may be performed by considering the output position and the moving direction / speed of the recognition beam in the sequential order of the meaningful words and the spacing between the meaningful words.

In addition, regression, which is one of the negative factors, is a habit of repeatedly reading a word or sentence that has been read once, and the reading speed training can be performed by controlling the moving speed of the recognition beam.

In addition, the lack of concentration may be implemented through the effects of the amount of light of the recognition beam, brain wave tuning waveform, etc. in order to focus on the character during the reading process.

In addition, eye fixation may be improved through time-expansion training, and the recognition beam may be output at a certain distance from the left and right at a certain position so that many characters may enter the field of view at once.

In addition, although not shown in the drawing, a plurality of dot-shaped recognition beams are output to specific left and right points of the characters so that the eye recognizes the positions where the recognition beams are output, thereby recognizing the characters displayed on the distances between the positions where the recognition beams are output. You can do time-expansion training.

In addition, although not shown in the drawing, the recognition beam having a constant amount of light may be output to the object 400, but may be separately outputted from the activation section and the inactivation section.

In addition, the visual image 403 matching the contour feature of the character of the specific point may be output to the object. In this case, the visual image 403 may be dictionary information of the corresponding character.

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements of those skilled in the art using the basic concepts of the present invention defined in the following claims are also provided. It belongs to the scope of rights.

100, 200, 300: visual and cognitive training apparatus 101, 201, 334: storage unit
103, 203, 336: input unit 105, 205, 335: display unit
107 and 207: user interface control unit 109 and 243: sensing unit
111, 211: recognition unit 113, 215: beam output control unit
115, 217: beam output unit 117, 219: distance sensor unit
119 and 221: light sensitivity sensor unit 213 and 330: beam projector
223: detector 225: memory
227: voice conversion unit 229: speaker
231: code reader 233: communication unit
235: tag reader 237: cable input and output terminal
239: USB port 241: Near field communication unit
310: glasses 311: miniature camera
312: communication unit 331: connection unit
332: eye tracking unit 333: output unit
337: control unit

Claims (26)

A recognition unit for recognizing a character displayed on an object, wherein the object includes a publication in which characters are printed or a screen of a digital device on which the characters are displayed; And
When the recognition unit recognizes a character, the beam output unit for outputting and blinking while moving the recognition beam that can be recognized by the eye for visual and / or cognitive training of the user to the object
Visual and cognitive training device comprising a. The method of claim 1,
Further comprising a sensing unit for irradiating light to the object to collect the light reflected or transmitted through the object,
The recognition unit,
Vision and cognitive training device for recognizing a character displayed on the object based on the light collected by the sensing unit. The method of claim 1,
A photographing unit for photographing the object to generate an image,
The recognition unit,
Visual and cognitive training device for recognizing a character by extracting a character feature from the image generated by the photographing unit. 4. The method according to any one of claims 1 to 3,
An input unit configured to receive user information, wherein the user information includes a visual and / or cognitive training mode of the user and visual and / or cognitive training capability information of the user; And
A beam output controller configured to determine a position to output the recognition beam, a blinking and moving speed of the recognition beam, and an output form of the recognition beam among the positions of the object on which the character is displayed based on the user information and to provide the beam output unit to the beam output unit;
Visual and cognitive training device further comprising. The method of claim 3,
Text information of the object, wherein the text information includes summary text, all texts described in the object, and / or some text; a storage unit storing a visual image matching the text information and output control information of the visual image ;
A beam projector for outputting the visual image to an object according to the output control information; And
A beam output controller for outputting a visual image matching the character feature of the recognized object by comparing the character feature of the object recognized by the recognition unit with the character feature of the text information stored in the storage unit.
Visual and cognitive training device further comprising. The method of claim 5,
The recognition unit,
Extract contour features of one or more characters displayed on each of the four corners of the object separated by pages;
The beam output control unit,
And a visual and cognitive training apparatus for comparing a contour feature of a character constituting text information stored in the storage unit with a contour feature of a character extracted by the recognition unit. The method of claim 6,
The beam output control unit,
A visual and cognitive training apparatus for controlling the output of the recognition beam to assist in the expansion of the speed reading and the center field of vision at a specific position set based on the characters displayed on the four corners of the object at predetermined intervals. The method of claim 3,
A storage unit for storing the number information of characters including letters, numbers, and symbols, a position to output the recognition beam matching the number information of the characters, a blinking and moving speed of the recognition beam, and an output form of the recognition beam; And
The number of characters is checked based on the contour characteristics of the characters displayed on the object recognized by the recognition unit, and the output position, blinking and moving speed, and output form of the recognition beam matching the number of characters are extracted from the storage unit. Beam output control unit provided to the output unit
Visual and cognitive training device further comprising. 4. The method according to any one of claims 1 to 3,
The beam output unit,
A visual and cognitive training device that continuously emits two or more dot-shaped recognition beams sequentially in a predetermined order in one of the up, down, left, and right directions. The method of claim 5,
The beam projector,
And a visual and cognitive training apparatus outputting the visual image while sequentially moving the visual image to a position close to the recognition beam in a predetermined order in one of up, down, left, and right directions. The method of claim 3,
Recognition beams that distinguish all the characters displayed on the object by page and store outline features of one or more characters located at the corners of each page, and left and right page division information mapped to the outline features of the letters, and are differently matched to the left and right pages. Or a storage unit for storing an output amount, a shape, an output period, an output speed, and an output position of the visual image; And
The left and right pages of the recognized object are distinguished by comparing the contour features of one or more characters located at the corners of the object recognized by the recognition unit with the contour features of the one or more characters stored in the storage unit, and the divided pages are left. Beam output control unit for controlling the output of the recognition beam or the visual image according to the output amount, shape, output period, output speed and output position of the matching beam according to whether it is a page or a right page.
Visual and cognitive training device further comprising. The method of claim 5,
The beam projector,
A visual and cognitive training device for outputting a visual image for visual and / or eye training that induces a user to memorize a sequential form of light emission. The method of claim 5,
The beam projector,
And a visual and cognitive training device for outputting visual images representing additional information associated with the text. The method according to any one of claims 2, 3 or 5,
The beam output unit or the beam projector,
A visual and cognitive training device that outputs a recognition beam having a waveform that induces EEG tuning by blinking and changing color for a predetermined time. The method of claim 5,
A tag reader recognizing a radio frequency identification tag and extracting identification information of the text information included in the radio frequency identification tag;
A code reader for recognizing code means representing information in a pattern pattern and extracting identification information of the text information included in the code means; And
The communication unit transmits the identification information extracted by the tag reader or the code reader to a server managing the information of the object through a network, and receives the text information mapped to the identification information from the server and transmits the text information to the storage unit.
Visual and cognitive training device further comprising. The method according to claim 5 or 15,
A cable input / output terminal for receiving the text information stored in the digital electronic device through a cable and transferring the text information to the storage unit;
A universal serial bus port which receives the text information stored in the digital electronic device and transmits the text information to the storage unit; And
Short-range wireless communication unit for receiving the text information stored in the digital electronic device by the short-range wireless communication including Bluetooth to deliver to the storage unit
A visual and cognitive training device further comprising one or more of the following. The method of claim 5,
A detector for detecting an image defined in the image in which the text is not displayed, wherein the predefined image includes a subject or an important mark displayed near the text;
A memory configured to store an image from which the predefined image is removed from an image on which a character including the predefined image is displayed, when the predefined image is detected; And
The apparatus may further include an input unit configured to receive a request for outputting a text image stored in the memory.
The beam projector,
Outputs a character image stored in the memory on a screen according to the output request;
The recognition unit,
Visual and cognitive training device for separating the image generated by the photographing unit into an image and a non-displayed image is provided to the detection unit. The method of claim 17,
The storage unit,
Further includes additional information matching the predefined image, wherein the additional information includes dictionary information of characters.
The memory comprising:
Stores an image displaying additional information near the character,
The beam projector,
And a visual and cognitive training apparatus for outputting an image on which the additional information is displayed near the character on a screen. The method of claim 18,
A conversion unit for converting text and additional information stored in the memory into voice; And
A speaker for outputting the voice converted by the conversion unit simultaneously with the image output of the beam projector
Visual and cognitive training device further comprising. 4. The method according to any one of claims 1 to 3,
A distance sensor unit measuring a distance from the object;
An optical sensitivity sensor unit controlling the recognition beam output of the beam output unit by adjusting light sensitivity and illumination of the recognition beam according to the distance
Visual and cognitive training device further comprising. 4. The method according to any one of claims 1 to 3,
Display unit for displaying various user selection menus previously stored and information input by the user through the input unit on the screen
Visual and cognitive training device further comprising. A storage unit for storing visual images for visual or / and cognitive training; And
Beam projector that continuously outputs the visual image on the screen while changing the speed in a predetermined direction among up, down, left and right directions
Visual and cognitive training device comprising a. The method of claim 22,
The beam projector,
A visual and cognitive training device for moving a single image or two or more images in at least one direction. 24. The method according to claim 22 or 23,
Further comprising eyeglasses for detecting the eye movement of the wearer to transmit to the beam projector,
The beam projector,
Vision and cognitive training device for outputting the visual image according to the gaze movement received from the glasses. 25. The method of claim 24,
The glasses,
A miniature camera for capturing an eye image of the wearer; And
A wired or wireless connection to the beam projector and a communication unit configured to transfer the eye image to the beam projector,
The beam projector,
A gaze tracking unit that tracks a gaze movement including a gaze direction, a gaze moving angle, and a gaze depth from the eye image; And
An output unit for extracting a visual image according to the eye movement tracked by the eye tracking unit from the storage unit and outputting the visual image to a screen
Visual and cognitive training device comprising a. 25. The method of claim 24,
And a beam output unit configured to output a beam for the visual or cognitive training to the screen.

Images