CN106910322B - A kind of pre- myopia prevention device of wear-type based on stereoscopic vision and behavioural analysis - Google Patents
A kind of pre- myopia prevention device of wear-type based on stereoscopic vision and behavioural analysis Download PDFInfo
- Publication number
- CN106910322B CN106910322B CN201710126985.6A CN201710126985A CN106910322B CN 106910322 B CN106910322 B CN 106910322B CN 201710126985 A CN201710126985 A CN 201710126985A CN 106910322 B CN106910322 B CN 106910322B
- Authority
- CN
- China
- Prior art keywords
- user
- computer
- module
- mobile phone
- pad
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
- G08B21/24—Reminder alarms, e.g. anti-loss alarms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
Landscapes
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Telephone Function (AREA)
- Eye Examination Apparatus (AREA)
Abstract
A kind of pre- myopia prevention device of wear-type based on stereoscopic vision and behavioural analysis, belongs to technical field of computer vision.Device includes binocular camera, wireless module, computing module and reminding module.Binocular camera is for obtaining two-way image；By wireless module by two-way image transmitting to computing module；The depth information that computing module passes through the method restoration scenario of stereoscopic vision；Behavioural analysis is carried out according to the image of acquisition simultaneously, when judging user in the computer that read a book/use/with behavior based on Pad/ mobile phone, according to 3-d recovery as a result, judging eye distance book/computer/Pad/ mobile phone distance, if hypotelorism is reminded by reminding module；It is whether excessively dark by the light in image analysis scene, if excessively dark, reminded by reminding module；Furthermore the computer/with the overlong time of Pad/ mobile phone if user reads a book/uses, is reminded also by reminding module.So as to effective pre- myopic-preventing generation.
Description
Technical field
The present invention relates to a kind of pre- myopia prevention devices of the wear-type based on stereoscopic vision and behavioural analysis, belong to computer view
Feel technical field.
Background technique
Adolescent myopia is the very big social concern that we face at present, and near-sighted generation is frequently due to see
The reasons such as book/computer posture is not right, and eye distance target is excessively close, and reading/computer overlong time and illuminating ray are dim
Caused by.How the generation of above situation is effectively monitored, so that effective pre- myopia prevention is a urgent problem to be solved.
Have at present through ultrasonic wave or infrared carry out ranging and the pre- myopia prevention device reminded, but such device is only
Be capable of measuring the distance of drawing axis object distance eyes, and can not judge whether object at the moment is book/computer, when user at the moment
Object when not being book/computer or user be not carry out reading activities and when only having book/computer at the moment, such device
It will be reminded, bring interference and inconvenience to the life of user；User is in computer of reading a book/see/with the different field such as mobile phone simultaneously
Under scape, different reading distance and reading interval are needed, it is that device before can not judge automatically for which kind of reading scene, can not be certainly
Dynamic is configured, and makes troubles to the use of user.
In order to overcome the problem above of current pre- myopia prevention device, we have proposed one kind based on stereoscopic vision and behavior point
The pre- myopia prevention device of the wear-type of analysis.By the device can with automatic measurement eye distance book/computer/Pad/ mobile phone distance with
And judge the behavior of user, if user is in reading/with computer/with Pad/ mobile phone, if the distance of eye distance target
It crosses closely, then may remind the user that, correct posture；The computer/with the overlong time of Pad/ mobile phone if it is determined that user reads/uses,
Or the light in scene is excessively dark, also may remind the user that；It is which kind of reading activities, root that the device, which can judge automatically currently, simultaneously
Relevant parameter can be automatically set according to different reading activities, can effectively reach pre- myopic-preventing purpose.
Summary of the invention
The purpose of the invention is to effectively pre- myopia preventions to occur, and propose a kind of based on stereoscopic vision and behavioural analysis
The pre- myopia prevention device of wear-type.
A kind of pre- myopia prevention device of wear-type based on stereoscopic vision and behavioural analysis, the abbreviation present apparatus, mainly by binocular
Camera, wireless module, computing module and reminding module composition.
Wherein, wireless module is by wireless network connection computing module, and the image transmitting that binocular camera is obtained is to meter
Module is calculated, while sending the result for calculating and analyzing to reminding module；
Wherein, wireless network is the local area network, WiFi or Metropolitan Area Network (MAN) with wireless transmission function and related protocol；
Computing module receives the image that binocular camera obtains by wireless network, and carries out stereo restoration and behavior point
Analysis, stereo restoration and the result of behavioural analysis send reminding module to by wireless module later；Reminding module is according to three-dimensional extensive
Multiple and behavioural analysis result reminds user to keep at a distance by the mode based on voice and vibration, appropriateness is rested or increases and illuminates
With pre- myopia prevention.
The present apparatus is worn on a user's head when in use, wherein the eye position for being closely located to user of binocular camera.
It is pre- myopic-preventing based on the present apparatus specific steps are as follows:
Step 1: the present apparatus, by calibration, is determining the inside and outside parameter of binocular camera using preceding；
Step 2: binocular camera obtains two-way scene image, computing module is transmitted to by wireless module；
Step 3: the three-dimensional information of two-way image restoration scenario of the computing module based on acquisition and dividing user behavior
Analysis, and corresponding operating is carried out based on the analysis results；
Wherein, the three-dimensional information of restoration scenario refers to the three-dimensional information for restoring scene point corresponding to every bit on image, right
User behavior carries out that analysis refers to and judge whether user is reading, and whether reading time is too long, eyes and reading correlative
Whether body distance is excessively close and whether scene lighting is suitable, and progress corresponding operating, which refers to, based on the analysis results reminds user
Or return step two reacquires two-way scene image；Step 3, specifically:
The two-way scene image that step 3.1 is obtained according to binocular camera, is obtained in two images by Stereo matching
Corresponding points obtain stereo matching results；
The inside and outside parameter for the binocular camera that step 3.2 is obtained according to step 1, by the method for trigonometric ratio to step 3.1
The stereo matching results of output are handled, and the three-dimensional information at scene midpoint is obtained；
Step 3.3 analyze to user behavior and carries out corresponding operating for behavioural analysis result, specifically:
It detects book, computer, Pad and mobile phone etc. in the picture by object detecting method and reads relevant object, and work as
After detecting this type objects, judge whether the distance of such object distance user keeps stable, according to stablize whether result into
The measurement of row reading time and prompting or return step two reacquire two-way scene image, specifically:
If the distance of the relevant object distance user of the reading such as 3.3A book, computer, Pad and mobile phone is more stable and continues one
The section time, it may be considered that user is in reading/with computer/with Pad/ mobile phone；At this point, in the scene obtained according to step 3.2
The three-dimensional information of point and the testing result of book, computer, Pad or mobile phone, measurement user obtain at a distance from target, and according to measurement
Distance, decide whether to prompt user in a manner of sound or vibration reminding module；And further according to reading time
Realize that the time successively decreases intensive remind；
Wherein, it continues for some time and is defined as greater than equal to 30 seconds；
Wherein, time intensive remind of successively decreasing refers to reading/with computer/holding with Pad/ mobile phone time of the act
It is continuous, the increased prompting frequency of index is set；Simultaneously with reading behavior continue and scene image it is real-time analyze as a result, to
Family illumination is accordingly reminded；
If the distance that 3.3B book, computer, Pad and mobile phone etc. read relevant object distance user is unstable and also not lasting
For a period of time, it may be considered that user jumps to step 2 not in reading/with computer/with Pad/ mobile phone；
So far, it from step 1 to step 3, completes based on the pre- myopic-preventing concrete operations of the present apparatus.
Beneficial effect
A kind of pre- myopia prevention device of wear-type based on stereoscopic vision and behavioural analysis has such as compared with prior art
It is lower the utility model has the advantages that
The present invention is a kind of wear-type device, can detect the reading of user/with computer/with Pad/ hand anywhere or anytime
Machine behavior；According to different behaviors, corresponding parameter is automatically set, better pre- myopic-preventing generation, while will not be read to non-
Reading behavior is judged by accident and is interfered, and is convenient for the user to use.
The present apparatus can remind user to keep good reading distance and appropriate reading time anywhere or anytime；
The present apparatus can also remind user to keep good reading lighting, effective pre- myopic-preventing generation.
Detailed description of the invention
Fig. 1 is a kind of composition signal of the pre- myopia prevention device of wear-type based on stereoscopic vision and behavioural analysis of the invention
Figure；
Wherein, left figure is pre- myopia prevention head hoop, and right figure is myopia prevention glasses, and 101 be binocular camera, and 102 be to remind
Module, 103 be wireless module, and 104 be computing module, and computing module can be placed in any place that can be connected with wireless network.
Specific embodiment
The pre- myopia prevention device of wear-type can be made the form of pre- myopia prevention head hoop or myopia prevention glasses, such as Fig. 1 institute
Show, wherein 101 be binocular camera, 102 be reminding module, and 103 be wireless module, and 104 be computing module, and computing module can be put
It sets in any place that can be connected with wireless network.
(1) binocular camera
Binocular camera is used to obtain the two-way image of scene, and the image of acquisition is used to the three-dimensional information of restoration scenario, with
And the behavior of user is analyzed.
The three-dimensional information of restoration scenario is carried out by way of stereoscopic vision, and device, by calibration, is determined double using preceding
The inside and outside parameter of mesh camera obtains pair in two images by Stereo matching according to the two-way image taken when use
Then Ying Dian obtains the three-dimensional information at scene midpoint by the method for trigonometric ratio.
Behavioural analysis detects the objects such as book/computer/Pad/ mobile phone first, after detecting this type objects, judges such object
Whether distance of the body apart from user keeps stable, if the distance of such object distance user is more stable and when continuing one section
Between, it may be considered that user is in the computer that read a book/use/with the behavior of Pad/ mobile phone.At this time if eye distance target
It crosses closely, then prompts user；The computer/too long with the behavioral duration of Pad/ mobile phone if user reads a book/uses, also prompt is used
Family；The lighting condition for analyzing scene by image simultaneously also prompts user if dark.
(2) wireless module
Wireless module is by wireless network connection computing module, and the image transmitting that camera is obtained is to computing module, together
When by calculate and analysis result send reminding module to.
(3) computing module
Computing module receives the image that binocular camera obtains by wireless network, and carries out stereo restoration and behavior point
Analysis, restores and the result of analysis sends reminding module to by wireless module.
(4) reminding module
According to analysis as a result, reminding module will be by voice, the modes such as vibration remind user to keep at a distance, and appropriateness is rested
Or increase illumination, with pre- myopia prevention.
Embodiment
The present invention can be used for reading/with computer/with a variety of studying and living scenes such as Pad/ mobile phone, below with three
It is described for typical application scenarios.
(1) reading scene
When user's reading, wearable pre- myopia prevention head hoop or myopia prevention glasses obtain image by binocular camera
And analyzed, if user read a book overlong time (more than 45 minutes) or eye distance books excessively close (distance is less than 35 lis
Rice) or scene in dark, then user is reminded in a manner of voice or vibration reminding module.
(2) computer scene is used
When user uses computer, wearable pre- myopia prevention head hoop or myopia prevention glasses are obtained by binocular camera
Image is simultaneously analyzed, if user is excessively close using machine time too long (more than 30 minutes) or eye distance computer screen
(distance is less than 60 centimetres), then remind user in a manner of voice or vibration reminding module.
(3) mobile phone scene is used
When user uses mobile phone, wearable pre- myopia prevention head hoop or myopia prevention glasses are obtained by binocular camera
Image is simultaneously analyzed, if user is excessively close using mobile phone time too long (more than 20 minutes) or eye distance computer screen
(distance is less than 30 centimetres), then remind user in a manner of voice or vibration reminding module.
The above is presently preferred embodiments of the present invention, and it is public that the present invention should not be limited to embodiment and attached drawing institute
The content opened.It is all not depart from the lower equivalent or modification completed of spirit disclosed in this invention, both fall within the model that the present invention protects
It encloses.
Claims (1)
1. a kind of pre- myopia prevention device of wear-type based on stereoscopic vision and behavioural analysis, it is characterised in that: described device includes
Binocular camera, wireless module, computing module and reminding module；
Wherein, for wireless module by wireless network connection computing module, the image transmitting that binocular camera is obtained gives calculating mould
Block, while sending the result for calculating and analyzing to reminding module；
Computing module receives the image that binocular camera obtains by wireless network, and carries out stereo restoration and behavioural analysis, it
Stereo restoration and the result of behavioural analysis send reminding module to by wireless module afterwards；Reminding module is according to stereo restoration and row
For analysis result remind user to keep at a distance by way of voice and vibration, appropriateness rest or to increase illumination close to prevent
Depending on；
Wherein, wireless network is the Wi F i or Metropolitan Area Network (MAN) with wireless transmission function and related protocol；
The present apparatus is worn on a user's head when in use, wherein the eye position for being closely located to user of binocular camera；
It is pre- myopic-preventing based on the present apparatus specific steps are as follows:
Step 1: the present apparatus, by calibration, is determining the inside and outside parameter of binocular camera using preceding；
Step 2: binocular camera obtains two-way scene image, computing module is transmitted to by wireless module；
Step 3: the three-dimensional information of two-way image restoration scenario of the computing module based on acquisition and user behavior is analyzed,
And corresponding operating is carried out based on the analysis results；
Step 3, specifically:
The two-way scene image that step 3.1 is obtained according to binocular camera, the correspondence in two images is obtained by Stereo matching
Point, obtains stereo matching results；
The inside and outside parameter for the binocular camera that step 3.2 is obtained according to step 1 exports step 3.1 by the method for trigonometric ratio
Stereo matching results handled, obtain the three-dimensional information at scene midpoint；
Step 3.3 analyze to user behavior and carries out corresponding operating for behavioural analysis result；
Step 3.3, specifically:
It detects book, computer, Pad and mobile phone in the picture by object detecting method and reads relevant object, and work as and detect
After this type objects, judge whether the distance of such object distance user keeps stable, is read according to result whether stabilization
Time measurement and prompting or return step two reacquire two-way scene image, specifically:
If the distance that 3.3A book, computer, Pad and mobile phone read relevant object distance user is more stable and when continuing one section
Between, then it is assumed that user is in reading/with computer/with Pad/ mobile phone；At this point, the three-dimensional at the scene midpoint obtained according to step 3.2
The testing result of information and book, computer, Pad or mobile phone measures user at a distance from target, and the distance obtained according to measurement,
Decide whether to prompt user in a manner of sound or vibration reminding module；And the time is further realized according to reading time
Intensity of successively decreasing is reminded；
Wherein, it continues for some time and is defined as greater than equal to 30 seconds；
Wherein, time intensive remind of successively decreasing refers to as reading/with computer/with Pad/ mobile phone time of the act continues, if
Set the increased prompting frequency of index；Simultaneously as lasting and scene image the real-time analysis of reading behavior is as a result, shine user
It is bright accordingly to be reminded；
If the distance that 3.3B book, computer, Pad and mobile phone read relevant object distance user is unstable and when also not continuing one section
Between, then it is assumed that user in reading/with computer/with Pad/ mobile phone, does not jump to step 2；
Wherein, the three-dimensional information of restoration scenario refers to the three-dimensional information for restoring scene point corresponding to every bit on image, to user
Behavior carries out that analysis refers to and judge whether user is reading, and whether reading time too long, eyes and reading object correlation away from
From whether excessively close and scene lighting is suitable, carry out corresponding operating based on the analysis results and refer to reminding user or returning
It returns step 2 and reacquires two-way scene image；So far, it from step 1 to step 3, completes pre- myopic-preventing based on the present apparatus
Concrete operations.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710126985.6A CN106910322B (en) | 2017-03-06 | 2017-03-06 | A kind of pre- myopia prevention device of wear-type based on stereoscopic vision and behavioural analysis |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710126985.6A CN106910322B (en) | 2017-03-06 | 2017-03-06 | A kind of pre- myopia prevention device of wear-type based on stereoscopic vision and behavioural analysis |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106910322A CN106910322A (en) | 2017-06-30 |
| CN106910322B true CN106910322B (en) | 2019-02-22 |
Family
ID=59186076
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710126985.6A Expired - Fee Related CN106910322B (en) | 2017-03-06 | 2017-03-06 | A kind of pre- myopia prevention device of wear-type based on stereoscopic vision and behavioural analysis |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106910322B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108777058B (en) * | 2018-05-18 | 2020-08-07 | Oppo广东移动通信有限公司 | Posture reminding method, electronic device and computer readable storage medium |
| CN110533894B (en) * | 2019-09-02 | 2021-11-02 | 深圳市新系区块链技术有限公司 | Visual fatigue reminding method, device, equipment and readable storage medium |
| CN111144363B (en) * | 2019-12-31 | 2023-02-28 | 北京理工大学 | Behavior identification method under first view angle based on scene and object information |
| CN112365690A (en) * | 2020-10-30 | 2021-02-12 | 四川大学华西医院 | Intelligent wearable device based on scene recognition and early warning method thereof |
| CN113867163A (en) * | 2021-10-09 | 2021-12-31 | 深圳康佳电子科技有限公司 | Intelligent household scene switching method and device, intelligent terminal and storage medium |
| CN115264800A (en) * | 2022-06-16 | 2022-11-01 | 青岛海尔空调器有限总公司 | Air conditioner-based electronic product use duration prompting method and device and air conditioner |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102956090A (en) * | 2011-08-26 | 2013-03-06 | 陈仕国 | Double-lens image sensing myopia-preventing reminder |
| CN104614876A (en) * | 2015-02-16 | 2015-05-13 | 刘博� | Device for preventing myopia and correcting sitting posture |
| CN104637263A (en) * | 2015-01-30 | 2015-05-20 | 刘博� | Device and method for preventing myopia and correcting sitting posture |
| TW201608229A (en) * | 2014-08-29 | 2016-03-01 | 國立臺灣大學 | Surface-enhanced raman scattering substrate and manufacturing method thereof |
| CN106297211A (en) * | 2015-06-12 | 2017-01-04 | 上海渐华科技发展有限公司 | Sitting posture correcting system for prompting based on movable camera and projection light and application thereof |
-
2017
- 2017-03-06 CN CN201710126985.6A patent/CN106910322B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102956090A (en) * | 2011-08-26 | 2013-03-06 | 陈仕国 | Double-lens image sensing myopia-preventing reminder |
| TW201608229A (en) * | 2014-08-29 | 2016-03-01 | 國立臺灣大學 | Surface-enhanced raman scattering substrate and manufacturing method thereof |
| CN104637263A (en) * | 2015-01-30 | 2015-05-20 | 刘博� | Device and method for preventing myopia and correcting sitting posture |
| CN104614876A (en) * | 2015-02-16 | 2015-05-13 | 刘博� | Device for preventing myopia and correcting sitting posture |
| CN106297211A (en) * | 2015-06-12 | 2017-01-04 | 上海渐华科技发展有限公司 | Sitting posture correcting system for prompting based on movable camera and projection light and application thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106910322A (en) | 2017-06-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106910322B (en) | A kind of pre- myopia prevention device of wear-type based on stereoscopic vision and behavioural analysis | |
| CN109168102A (en) | A kind of earphone wearing state detection method, device and earphone | |
| US20220176200A1 (en) | Method for Assisting Fitness and Electronic Apparatus | |
| KR101094766B1 (en) | Apparatus and mehtod for tracking eye | |
| CN103099602A (en) | Constitution detecting method and constitution detecting system based on optical identification | |
| CN108139582A (en) | For data acquisition and the method and apparatus of Evaluation Environment data | |
| CN108897423A (en) | A kind of VR glasses and its online testing anti-cheating method | |
| CN107563325B (en) | Method and device for testing fatigue degree and terminal equipment | |
| CN110352033A (en) | Eyes degree of opening is determined with eye tracks device | |
| CN105049596B (en) | A kind of mobile terminal and its fatigue state detection method | |
| CN103927250A (en) | User posture detecting method achieved through terminal device | |
| CN104766056A (en) | Human-computer interaction method, device and virtual headset device | |
| CN106469288A (en) | A kind of reminding method and terminal | |
| CN104238752B (en) | Information processing method and first wearable device | |
| CN105183170A (en) | Head-wearing-type wearable equipment and information processing method and device thereof | |
| WO2020015629A1 (en) | Image acquiring method and device, and terminal | |
| CN110345407A (en) | A kind of intelligent posture correction desk lamp and strong attitude positioning method based on deep learning | |
| EP4040268A1 (en) | Object sharing method and apparatus | |
| CN105380590B (en) | A kind of equipment and its implementation with eye position detection function | |
| CN105607252A (en) | Control method of intelligent glasses and control device thereof | |
| US20230256327A1 (en) | Visual guidance-based mobile game system and mobile game response method | |
| CN112308014B (en) | High-speed accurate searching and positioning method for pupil and cornea reflecting spot of two eyes | |
| JP2020077271A (en) | Display unit, learning device, and method for controlling display unit | |
| CN205850175U (en) | Motion correcting instrument | |
| CN108399365B (en) | Method and device for detecting living human face by using pupil diameter |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20190222 Termination date: 20200306 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |