CN107854288A - Ocular disorders monitoring and rehabilitation training glasses based on digital intelligent virtual three-dimensional stereopsis technology - Google Patents

Abstract

The invention discloses glasses for visual disorder monitoring and rehabilitation training based on digital intelligent virtual three-dimensional image technology. The glasses use intelligent digital 3D imaging technology and optical design to create a virtual 3D depth scene with a wide angle; and through the interactive communication with the mobile terminal, a special App controls the various visual disorders monitoring and stereo pictures for rehabilitation training of the glasses. And video playback function and related interactive operations, software programs with different functions such as visual acuity and color blindness inspection and visual rehabilitation training for users, and interactive communication capabilities with the cloud and doctors, which can conveniently allow users to perform visual inspection and visual inspection at home. Rehabilitation training, including depth of field adjustment, viewing angle adjustment, response adjustment, contrast adjustment, etc., can help users solve various visual disorders.

Description

Monitoring and rehabilitation of visual disorders based on digital intelligent virtual three-dimensional image technology training glasses

technical field

The invention relates to the technical field of biomedical optoelectronics, in particular to glasses for visual disorder monitoring and rehabilitation training based on digital intelligent virtual three-dimensional image technology.

Background technique

About 25% of the world's population has visual disorders of one kind or another. Low vision affects their quality of life and work, as well as employment and career choices, and if not handled properly, it may also lead to the risk of blindness in their later life. The so-called visual disorders refer to problems such as strabismus, amblyopia, insufficient eye adjustment, and narrow visual field. These problems, in addition to being due to problems with the eye itself (such as misalignment of visual channels, differences in refractive index, defects or damage, etc.), are also related to the learning and perceptual processing functions of the brain. Therefore, in addition to eye-related treatment, various visual disorders can be improved through appropriate visual training.

Relevant studies have shown that video games with three-dimensional display can stimulate the human brain to build appropriate visual channels to correct vision, and even overcome vision degradation caused by age. The most important discovery is the effect of visual restoration through 3D video games, which is not only applicable to teenagers, but also to adults and even the elderly. Benefit from the training of rehabilitation glasses, resulting in good social and economic benefits.

There is no report in the world at present that there is a small-sized handheld/wearable home visual training rehabilitation device that is not only suitable for children but also for adults based on digital intelligent virtual three-dimensional video image technology. Existing visual training devices are basically of the scale-based or focusing-box type. These training devices generally require medical staff to manually adjust the focus or move the visual target. The operation and training process is complicated and cumbersome. Users, especially children, often It is difficult to adapt to persistence, and the training is suspended in a short period of time, failing to meet the relevant requirements. There are also some so-called vision training glasses. In essence, only a few pairs of light-emitting diodes are installed on the glasses frame, and the movement of the eyeball is simply attracted by the way of flashing in turn, in order to relieve the fatigue of the eyeball. Both the function and the effect are equivalent. limited. There are also computer-based trainers that only work in two dimensions. There are also some 3D stereoscopic vision training digital rehabilitation treatment systems that require large-scale 3D stereoscopic movie reflection systems, which cannot be miniaturized household handheld or wearable.

Contents of the invention

The purpose of the present invention is to solve the above-mentioned defects in the prior art, provide a kind of glasses for visual disorder monitoring and rehabilitation training based on digital intelligent virtual three-dimensional image technology, and use intelligent digital three-dimensional image technology to manufacture virtual three-dimensional stereo The deep scene enables users to get a realistic feeling of the virtual world. Moreover, the vision training and rehabilitation device can be miniaturized and worn like glasses, and can be conveniently used by users at home; it can be changed by moving back and forth, left and right, or changing colors or capturing and dodging in its scene. Users carry out various visual training, including depth of field adjustment, viewing angle adjustment, response adjustment, contrast adjustment, etc., to help users solve various visual disorders, especially to prevent or delay the occurrence of presbyopia for the elderly, improve viewing angle and vision Sensitivity; enable children to prevent myopia and correct strabismus. And it can monitor the user's vision status and training effect through various three-dimensional and color vision checklists.

The purpose of the present invention can be achieved by taking the following technical solutions:

A kind of glasses for visual disorder monitoring and rehabilitation training based on digital intelligent virtual three-dimensional image technology. The glasses include a large wide-angle adjustable depth-of-field optical imaging system, a digital intelligent main control system, and an interactive communication system with a mobile terminal. and a power system;

The wide-angle adjustable depth-of-field optical imaging system is arranged in front of both eyes of the user, and generates stereoscopic images with different depth-of-field perceptions by displaying images of the same scene at different angles on the corresponding display screens of the two eyes;

The digital intelligent main control system is used to realize the control and operation of the entire glasses, including the transmission and storage of data and signals, and transmits the image signals of the left and right split screens of the video to the large wide-angle adjustable depth-of-field optical imaging system , respond to the manipulation or interaction of visual training video programs or games, and sense the user's position, orientation and accelerated motion, and feed back relevant operating instructions to the system;

The interactive communication system with the mobile terminal is used for exchanging information with external mobile terminals, operating the mobile terminal to realize the manipulation of the glasses or related interactive responses, updating software, downloading video images, and uploading to the user for visual disorder monitoring and rehabilitation. training result data;

The power supply system is used to provide working voltage for each subsystem of the glasses.

Further, the large wide-angle adjustable depth-of-field optical imaging system includes a high-definition digital display screen and a lens group capable of zooming to achieve high depth-of-field stereoscopic imaging. The large wide-angle adjustable depth-of-field optical imaging system displays Stereoscopic scenes with high depth of field with a monocular viewing angle of up to 120 degrees.

Further, the digital intelligent main control system is based on the Android platform, and includes a microcontroller as the main control chip, an input device subsystem and an output device subsystem, and the microcontroller also includes a USB interface, a wireless The communication transmission interface and SD card interface are used to transmit, import and store relevant visual training programs or videos.

Further, the input device subsystem in the digital intelligent main control system includes a wireless communication control function module, a power management module, a nine-axis gyroscope, an electronic compass, an accelerometer, and a micro-control unit. The nine-axis gyroscope It is used to sense the rotation of the user's head, the accelerometer is used to sense the acceleration of the user's head, the electronic compass is used to locate the direction, and the camera is used to view the external real scene and video collection.

Further, the output device subsystem in the digital intelligent main control system has SD/USB storage devices, image output and display, audio output and playback devices.

Further, the interactive communication system with a mobile terminal includes a wireless communication module and a mobile terminal with a dedicated App control software.

Further, the interactive communication system with the mobile terminal includes two communication modes, one is a point-to-point communication mode with the user's mobile terminal, and the user can realize the training video program or training program with the mobile terminal through a specially designed mobile terminal App The control of the game or related interactive responses, as well as the data between the two, the transmission of video and images, the operation of visual training games and the reception and storage of glasses training result data, the other is the Access Point mode, which combines glasses and use The user's mobile terminal is connected to the access point of the wireless network at the same time, connected to the cloud of the vision training system, directly updates the software system of the glasses through the cloud, downloads the latest training pictures, videos and visual training game content, and directly uploads the training results To the database in the cloud for interactive data transmission.

Further, the mobile terminal with dedicated App control software includes mobile phone, notebook computer, tablet computer and handheld Internet device, multimedia device, streaming media device, mobile Internet device (MID, mobile internet device), wearable device or other types terminal equipment.

Further, the mobile terminal with special App control software in the interactive communication system with the mobile terminal has key switches for controlling various functions of the glasses for visual disorder monitoring and rehabilitation training, and has the ability to perform relevant visual health checks including visual acuity And the software program modules, pictures and videos of the visual rehabilitation training function of color blindness and color weakness inspection and detection of amblyopia training and pseudomyopia training.

Further, the software program module of the visual rehabilitation training function is implemented by a vision chart of different distances realized through a virtual stereoscopic scene, and icons and objects that can move in different colors in different directions up and down, front and back, left and right, or change their positions and orientations. interactive content and games.

Further, the power supply system is a rechargeable and dischargeable lithium battery pack with a voltage of 3.7 volts to 12 volts.

The working principle of the glasses for visual disorder monitoring and rehabilitation training based on digital intelligent virtual three-dimensional image technology is as follows:

The large wide-angle depth-of-field adjustable optical imaging system can display high-depth stereoscopic scenes with a monocular viewing angle of up to 120 degrees in front of the user's eyes. Then, through the control of the special App on the mobile terminal, or the control buttons on the glasses, the intelligent main control system will input the visual training program or game-style video into the display screen to form three-dimensional images with different depths of field. It can realize different functions such as visual health detection, amblyopia training, and pseudomyopia training for users.

Its visual health examination includes visual acuity (distance, near vision, stereo vision) and color blindness. The visual acuity test consists of an eye chart that simulates different distances displayed in the glasses, which is convenient for checking the user's far vision, near vision and peripheral vision (ie visual field). For example, different "E"-shaped characters at a distance of 5 meters in the conventional vision test form are used for distance vision testing, and Jaeger's near vision chart or standard vision chart (Xu Guangdi) at a distance of 30 cm from the eye is simulated for near vision. detection etc. The user can conveniently perform various vision tests without changing the environmental position, and through the display of the left and right eyes respectively and combined with the gyroscope of the glasses to sense the head turning, the user's vision status can be quickly and automatically detected.

The amblyopia training adopts the multi-frequency and multi-color light alternate flashing stimulation method, and the cone cells are stimulated by the red, green, and blue three-color lights that alternately flash at different distances in three dimensions. Visual acuity training adopts the game of training users to capture animals that appear instantly; 3D pseudomyopia training uses this system to realize the function of dynamic patterns in 3D space with different depths of field, by designing different animals and objects to go back and forth in the field of view in the glasses The running game allows the user to observe the continuous changes in the depth of field of the spatial image, and trains the ciliary muscle of the user to perform alternate tension and relaxation movements, thereby realizing the rehabilitation effect on pseudomyopia. During this period, the user responds or manipulates the relevant vision examination or training content or games through the mobile terminal, mainly the function equivalent to the mouse of the mobile phone App. The intelligent main control system automatically displays the scoring results of vision testing and training on the glasses screen at the end of each testing and training, and simultaneously sends them to the user's mobile terminal and the cloud of the vision training system for storage. To allow users and vision training physicians to understand, master and analyze the effects or problems of vision inspection and training, and allow vision training physicians to guide users on the next training session through mobile terminals, as well as update and transmit training content, etc. The camera on the glasses can enable the glasses to see the real scene outside without taking off the glasses.

Compared with the prior art, the present invention has the following advantages and effects:

1. The glasses for visual health monitoring and rehabilitation training have various visual monitoring and training for users, such as distance vision, near vision and peripheral vision detection, color blindness and color weakness detection, depth of field adjustment, vision adjustment, etc. The content can help users solve various visual disorders, especially to prevent or delay the occurrence of presbyopia for the elderly, improve the viewing angle and visual sensitivity, and enable children to prevent and treat myopia and correct strabismus.

2. Using the unique large wide-angle depth-of-field adjustable binocular visual optical system and intelligent digital 3D imaging technology, it can produce a virtual 3D stereoscopic depth scene with a viewing angle of up to 120 degrees and a high depth of field recognition function, allowing users to experience The realistic feeling of the virtual three-dimensional world of various scenes.

3. The glasses have the function of seeing both the virtual world and the real world.

4. The ingenious optoelectronic design is adopted, which makes the optical structure of the whole device simple, and the whole device is small and light, which can be worn like ordinary glasses and is easy to use.

5. Because of the use of mobile terminals, especially the use of mobile phones that almost everyone owns and carries with them as data transmission and control functions, it can avoid the trouble and cost of using conventional methods such as joysticks, keyboards, and even computer connections.

6. The production cost is low, and it can be better popularized in other health diagnosis and treatment application fields or home entertainment.

Description of drawings

Fig. 1 is a structural diagram of glasses for visual disorder monitoring and rehabilitation training disclosed by the present invention;

Fig. 2 is the intelligent main control system of the glasses for visual disorder monitoring and rehabilitation training disclosed by the present invention;

Fig. 3 is the communication structure and modules of the glasses for visual disorder monitoring and rehabilitation training disclosed by the present invention.

Detailed ways

In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

Embodiment one

This embodiment discloses a kind of glasses for visual disorder monitoring and rehabilitation training based on digital intelligent virtual three-dimensional image technology, including a large wide-angle adjustable depth of field optical imaging system, a digital intelligent main control system, and an interactive communication system with mobile terminals , and a power supply system.

It should be emphasized that the mobile terminals described in the present invention include mobile phones, notebook computers, tablet computers and palm Internet devices, multimedia devices, streaming media devices, mobile Internet devices (MID, mobile internet device), wearable devices or other types terminal equipment.

The wide-angle adjustable depth-of-field optical imaging system is set in front of both eyes of the user, and its display screen is a 5-inch high-definition digital display screen with a resolution of 1920×1080. of two screens. With reasonable optical design and adjustment, each eye can produce a viewing angle of up to 120 degrees. And by displaying the same scene images from different angles on the two screens, it simulates stereoscopic images of various distances and different depths of field from the distance of eyesight (25cm) to infinity.

The digital intelligent main control system is an intelligent main control system based on the Android platform, including a microcontroller as the main control chip, which can perform file reading and writing of SD/USB storage devices, HDMI image and audio output, and WiFi control and other functions, and has hardware interfaces such as position and orientation tracking, camera, wireless communication control, and power management. And through its USB interface, wireless transmission, SD card reading and other ways to transmit, import and store relevant visual training programs or videos in the SD card. Through the set nine-axis gyroscope, electronic compass, accelerometer and microcontroller, it can effectively sense various movements such as the rotation and acceleration of the user's head, and realize the control of visual training video programs or games or related interactive responses. And feed back relevant operation instructions to the system.

The interactive communication system with mobile terminals such as mobile phones is composed of the wireless transmission part of the digital intelligent main control system and the specially designed App in the user's smart phone to form an interaction, as shown in FIG. 3 . There are two ways of communication. The first one is point-to-point communication mode with the user’s mobile terminal. The user can use the specially designed mobile terminal App to realize the control or related interactive response of the training video program or game with the mobile terminal, and both Functions such as data exchange, video and image transmission, vision training game operation, and glasses training result data reception and storage. The second is the Access Point (AP) mode, which connects the glasses and the user's mobile phone to the access point of the wireless network at the same time, and connects to the cloud of the vision training system. By directly updating the software system of the glasses through the cloud, downloading the latest training pictures, videos and visual training game content, and uploading the training results directly to the cloud database, so that the cloud can store the user's training data and then analyze the training data and Relevant results are sent to the mobile terminal of the vision training physician, allowing users to understand and grasp the effects or problems of the training.

Emphasize once again that the mobile terminal described in the present invention includes mobile phone, notebook computer, tablet computer and handheld Internet device, multimedia device, streaming media device, mobile Internet device (MID, mobile internet device), wearable device or other types Terminal Equipment.

The rechargeable lithium battery pack used in the power supply system is a 2500mA/h 5-volt battery pack, which can make the visual disorder monitoring and rehabilitation training glasses work continuously for 1.5 hours when fully charged once.

Embodiment two

This embodiment discloses a visual disorder monitoring and rehabilitation training glasses based on digital intelligent virtual three-dimensional image technology, as shown in Figure 1, including a large wide-angle adjustable depth of field optical imaging system, a digital intelligent main control system, a An interactive communication system with the mobile terminal, and a power supply system. The large wide-angle depth-of-field adjustable optical imaging system is arranged in front of both eyes of the user. Its display is two discrete 0.44-inch displays. After reasonable design and adjustment, each eye can produce a viewing angle of up to 100 degrees. And by displaying the same scene images from different angles on the two screens, it simulates stereoscopic images of various distances and different depths of field from the distance of eyesight (25cm) to infinity.

The digital intelligent main control system, as shown in Figure 2, is an intelligent main control system based on the Android platform, and the main control chip is composed of a 64-bit architecture, a quad-core processor and a GPU. It can perform file reading and writing of SD/USB storage devices, HDMI image and audio output, etc., and has hardware interfaces such as position and orientation tracking, camera, wireless communication control, and power management. Signal. And through its USB interface, wireless transmission, SD card reading and other ways to transmit, import and store relevant visual training programs or videos in the SD card. Through the set nine-axis gyroscope, electronic compass, accelerometer and micro-control unit, it can effectively sense various positions, orientations and movements of the user's head such as rotation and acceleration, and realize the control or control of visual training video programs or games. about interactive responses. And feed back relevant operation instructions to the system. It can provide 4K video, image effects and an image refresh rate of 60fps. The visual persistence display technology adopted can reduce the visual delay to less than 20ms, and can realize the playback of high-definition stereoscopic video or pictures for training glasses.

The interactive communication system with the mobile terminal is composed of the wireless transmission part of the digital intelligent main control system and the specially designed App in the user's smart phone to form an interaction, as shown in FIG. 3 . The specially designed App in the user's mobile terminal realizes the following series of functions through interactive data communication with the wireless transmission part of the glasses for visual disorder monitoring and rehabilitation training: (1) Control the mouse function, even if the user usually has and Portable mobile phones and other mobile terminals can be used as a computer mouse to select the content displayed by the glasses for visual disorder monitoring and rehabilitation training, and to respond to the content and games related to visual inspection and training, eliminating the need to set up additional mouse (2) The mobile terminal App is responsible for obtaining updated software, videos and images related to visual disorder monitoring and rehabilitation training from the cloud, and sending them to the cloud for visual disorder monitoring and rehabilitation training. These updated software, videos and images are transmitted by the glasses, and at the same time, the result data of the user’s visual disorder monitoring and rehabilitation training are obtained from the transmission of the glasses for visual disorder monitoring and rehabilitation training; (3) through the powerful operating system of the mobile terminal and the special The designed App performs various complicated analysis, calculation and processing on the result data of the user's visual disorder monitoring and rehabilitation training, or sends it to the cloud management for analysis, calculation and processing of relevant data; (4) utilizes the capacity of the smartphone The large storage device receives and stores the result data of the user's visual disorder monitoring and rehabilitation training transmitted from the glasses, or transfers them to the cloud for storage; (5) interactively communicates with the doctor through the user's mobile terminal App, which will The result data of the user's visual disorder monitoring and rehabilitation training are sent to the doctor or the relevant medical system in real time, and the doctor's real-time guidance can also be accepted.

The rechargeable lithium battery pack is a 2000mA/h 3.7 volt battery pack.

The above-mentioned embodiment is a preferred embodiment of the present invention, but the embodiment of the present invention is not limited by the above-mentioned embodiment, and any other changes, modifications, substitutions, combinations, Simplifications should be equivalent replacement methods, and all are included in the protection scope of the present invention.

Claims (10)

1. a kind of ocular disorders monitoring and rehabilitation training glasses based on digital intelligent virtual three-dimensional stereopsis technology, it is special Sign is that described glasses include a big wide-angle depth of field adjustable optical imaging system, a digital intelligent master control system, one and movement Terminal interaction communication system, and a power-supply system；

Described big wide-angle depth of field adjustable optical imaging system, the side at the moment of user two is arranged at, by each right at the moment two The Same Scene image of the different angle for the display screen displaying answered, there is the stereo-picture of different depth perceptions；

Described digital intelligent master control system is used to realize the control and operation to whole glasses, including to data and the biography of signal Defeated and storage, the picture signal of video or so split screen broadcasting is transmitted to described big wide-angle depth of field adjustable optical imaging system, it is right The manipulation or interactive response of visual exercise video program or game, and sensing user position, orientation and accelerated motion situation, The operational order related to system feedback；

Described exchanges with mobile terminal interactive correspondence system for entering row information with outside mobile terminal, is operated with mobile terminal Realize that the manipulation to glasses or relevant interactive response, renewal software, video image are downloaded, and upload user and carry out vision mistake Adjust the result data of monitoring and rehabilitation training；

Described power-supply system is used to provide operating voltage for other systems.

2. ocular disorders monitoring and rehabilitation according to claim 1 based on digital intelligent virtual three-dimensional stereopsis technology Training glasses, it is characterised in that described big wide-angle depth of field adjustable optical imaging system includes a high-definition digital display screen, and Its varifocal lens group for realizing high depth of field three-dimensional imaging, described big wide-angle depth of field adjustable optical imaging system is in user's eye The preceding simple eye visual angle of displaying is up to 120 degree of high depth of field stereo scene.

3. ocular disorders monitoring and rehabilitation according to claim 1 based on digital intelligent virtual three-dimensional stereopsis technology Training glasses, it is characterised in that described digital intelligent master control system is based on Android platform, including a microcontroller as master Control chip and an input equipment subsystem and an output equipment subsystem, described microcontroller also includes USB interface, wireless Communication transmission interface and SD card interface, relevant visual exercise program or video are imported and store for transmitting.

4. ocular disorders monitoring and rehabilitation according to claim 3 based on digital intelligent virtual three-dimensional stereopsis technology Training glasses, it is characterised in that the input equipment subsystem in described digital intelligent master control system includes wireless telecommunications control Functional module, power management module, nine axle gyroscopes, electronic compass, accelerometer and micro control unit processed, nine described axle gyros Instrument is used for the rotation for sensing user head, and described accelerometer is used for the acceleration for sensing user head, described electronics sieve Disk is used for orientation, and described camera is used for depending on seeing outside reality scene and video acquisition.

5. ocular disorders monitoring and rehabilitation according to claim 3 based on digital intelligent virtual three-dimensional stereopsis technology Training glasses, it is characterised in that the output equipment subsystem in described digital intelligent master control system has SD/USB storages Equipment, image output and display, audio output and playback equipment.

6. the monitoring of the ocular disorders based on digital intelligent virtual three-dimensional stereopsis technology and rehabilitation training described in claim 1 With glasses, it is characterised in that described to include a wireless communication module and one with special App with mobile terminal interactive correspondence system Manipulate the mobile terminal of software.

7. ocular disorders monitoring and rehabilitation according to claim 6 based on digital intelligent virtual three-dimensional stereopsis technology Training glasses, it is characterised in that described to include two kinds of communication modes with mobile terminal interactive correspondence system, one kind is with making The mobile terminal point-to- point communication pattern of user, user can be realized with mobile terminal by the mobile terminal App specially designed Manipulation or relevant interactive response to training video program or game, and data between the two, the transmission of video and image, The operation of visual exercise game and reception and the store function of glasses training result data, another kind is Access Point moulds Formula, glasses and the mobile terminal of user are connected to the access point of wireless network simultaneously, are connected to the cloud of vision-training system End, the software systems of glasses are directly updated by high in the clouds, download nearest training picture, video and visual exercise game content, And training result is uploaded directly into the database in high in the clouds, interact data transfer.

8. ocular disorders monitoring and rehabilitation according to claim 6 based on digital intelligent virtual three-dimensional stereopsis technology Training glasses, it is characterised in that the mobile end with special App manipulation softwares in the interactive correspondence system with mobile terminal Key switch of the end with the described ocular disorders monitoring of manipulation and rehabilitation training glasses various functions, and it is relevant with carrying out Vision Health inspection includes eyesight and colour blindness anomalous trichromatism inspection detection and amblyopia training, the visual rehabilitation training of pseudo-myopia training The software program module and picture and video of function.

9. ocular disorders monitoring and rehabilitation according to claim 8 based on digital intelligent virtual three-dimensional stereopsis technology Training glasses, it is characterised in that the software program module of described visual rehabilitation training function is by virtual three-dimensional scene The different distance visual chart of realization, and can different azimuth different color is mobile or changing position and orientation up and down, around The interactive content and game that the icon and object of orientation are carried out.

10. ocular disorders monitoring and health according to claim 1 based on digital intelligent virtual three-dimensional stereopsis technology Refreshment white silk glasses, it is characterised in that described power-supply system be a voltage be 3.7 volt of -12 volt can charge-discharge lithium battery group.