CN216060988U - Intelligent eye patch based on structured light measurement - Google Patents

Intelligent eye patch based on structured light measurement Download PDF

Info

Publication number
CN216060988U
CN216060988U CN202122189619.XU CN202122189619U CN216060988U CN 216060988 U CN216060988 U CN 216060988U CN 202122189619 U CN202122189619 U CN 202122189619U CN 216060988 U CN216060988 U CN 216060988U
Authority
CN
China
Prior art keywords
module
eye
infrared light
near infrared
structured light
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202122189619.XU
Other languages
Chinese (zh)
Inventor
许峰
陶宇龙
汤志远
陈健康
童强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou University
Original Assignee
Suzhou University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou University filed Critical Suzhou University
Priority to CN202122189619.XU priority Critical patent/CN216060988U/en
Application granted granted Critical
Publication of CN216060988U publication Critical patent/CN216060988U/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Eye Examination Apparatus (AREA)

Abstract

The application discloses intelligent eye-shade based on structured light measurement. This intelligence eye-shade includes: the eye-shade body, dispose on the eye-shade body: the near-infrared light projection module, the camera module and the processing module are respectively connected with the control module, the light-emitting wavelength of the near-infrared light projection module is 780 nm-1000 nm, the near-infrared light projection module is used for projecting a pattern with known characteristic parameters in a preset range of an eyelid of a user, and the camera module is used for shooting the whole projection area and transmitting the shot picture data to the control module. This embodiment integrates structured light measurement system in the eye-shade, uses the invisible near-infrared light source of people's eye and utilizes camera module to monitor eye movement state, has the precision height, and does not have direct contact or oppression with the eye under this embodiment, can promote the comfort level. Without interfering with the normal rest of the user/user.

Description

Intelligent eye patch based on structured light measurement
The technical field is as follows:
the utility model relates to the field of wearable electronic equipment, in particular to an intelligent eyeshade based on structured light measurement.
Background art:
structured light measurement techniques refer to the active projection of one-dimensional line light or two-dimensional images of known characteristic information onto a target object. After the shooting by the camera, the three-dimensional information of the target object is calculated from the shot image by using the known projection information.
The sleep cycle means that a biological rhythm exists in sleep, adults experience one sleep cycle in about 90-120 minutes, and an adult experiences 4-6 sleep cycles in an approximately-scheduled night. The eye movement state is commonly used in sleep studies to divide sleep stages, namely a rapid eye movement state and a non-rapid eye movement state. Studies have shown that waking a sleeper during rapid eye movement optimizes the mental state of the awakened person.
Rapid eye movement sleep is characterized by rapid movements of the eyeball in both the horizontal and vertical directions during sleep. Moreover, the eyelids are thin, so that the eyelids are deformed obviously during the movement of eyes.
The sleep cycle monitoring equipment on the market at present has the defects of difficult detection, low accuracy and high cost.
The utility model has the following contents:
in order to solve the existing defects, the intelligent eyeshade applies the structured light measurement to the eye movement monitoring, integrates the structured light measurement system into the eyeshade, and effectively solves the defects mentioned in the background.
In order to achieve the purpose, the application is realized by the following technical scheme:
an intelligent eye shield based on structured light measurements, comprising: the eye-shade body, the eye-shade body disposes: near-infrared light projection module and camera module, near-infrared light projection module and camera module are respectively through wire connection control module, control module includes: the wireless transmission module is used for being connected with an intelligent terminal carrying a sleep data processing module, the wavelength of light emitted by the near infrared light projection module is 780 nm-1000 nm, the near infrared light projection module is used for projecting patterns with known characteristic parameters in a preset range of eyelids of a user, and the camera module is used for shooting the whole projection area and transmitting the shot image data to the control module. This embodiment integrates structured light measurement system in the eye-shade, uses the invisible near-infrared light source of people's eye and utilizes camera module to monitor eye movement state, has the precision height, and does not have direct contact or oppression with the eye under this embodiment, can promote the comfort level. Without interfering with the normal rest of the user/user. The near infrared light projection module, the camera module and the control module are arranged in the eyeshade body at intervals. The near infrared light projection module and the camera module are arranged on one side and approximately face one eye of a user, and the control module faces the other eye of the user. The eyeshade body is internally provided with a certain radian which is matched with a human face. Therefore, the intelligent eyeshade can be perfectly attached after the user wears the intelligent eyeshade.
Preferably, the attachment portion is disposed on a side of the eyecup body facing the user's face, and the attachment portion improves the comfort of the user.
Preferably, the control module further comprises: a power supply module and a processor, wherein the power supply module and the wireless transmission module are arranged at two sides of the processor
Preferably, the control module includes: and the control module transmits the image fed back by the camera module to a sleep data processing module through the wireless transmission module.
Preferably, the wireless transmission module is a bluetooth module.
Preferably, the wireless transmission module is an HC-05 Bluetooth module.
Preferably, the two sides of the eyeshade body are provided with connecting ends, and the connecting ends are used for connecting fixing belts.
Preferably, the near-infrared light projection module and the camera module are disposed on the same side of the eyeshade body, the working area is the eyelid of the same eye of the user, and the camera module and the projection module work synchronously.
Preferably, the control module is configured on the same side as the near-infrared light projection module and is far away from the near-infrared light projection module.
Preferably, the pattern projected on the eyelid of the human eye by the near infrared light projection module has known characteristic parameters.
Preferably, the shooting range of the camera module is a projection area including characteristics reflecting eyelid deformation.
Has the advantages that:
the utility model has the advantages that: the application provides an eye-shade based on structured light measurement uses the invisible near infrared light source of people's eye for monitoring eye movement state, it is high to have the precision, and does not have direct contact or oppression with the eye, can promote the comfort level, and can not cause the interference to user's normal rest.
Description of the drawings:
fig. 1 is a schematic diagram illustrating logical relationships between modules of an eyeshade according to an embodiment of the present application.
Fig. 2 is a schematic view of the inner structure of the eyeshade according to the embodiment of the present application.
Fig. 3 is a schematic top view of the eyeshade according to the embodiment of the present application.
Fig. 4 shows a pin connection manner between the processor stm32 of the control module and the near-infrared light projection module in the eyecup according to the embodiment of the present application.
Fig. 5 shows the connection manner of the processor stm32 of the control module in the eyecup and the pin of the camera module ov7725 according to the embodiment of the present application.
Fig. 6 shows the pin connection between the stm32 of the control module and the HC-05 in the eyecup according to the embodiment of the present application.
The specific implementation mode is as follows:
the above-described scheme is further illustrated below with reference to specific examples. It should be understood that these examples are for illustrative purposes and are not intended to limit the scope of the present application. The conditions employed in the examples may be further adjusted as determined by the particular manufacturer, and the conditions not specified are typically those used in routine experimentation.
The application provides an intelligence eye-shade based on structured light measurement, and this eye-shade has avoided the oppression to the eye among the traditional monitoring eye movement technique through the optimization of structure, and the processing of the eye image that the while is directed against can effectively improve the judgement precision to the eye movement state and avoid other interferences.
The intelligent eyeshade based on structured light measurement proposed by the present application will be explained with reference to the accompanying drawings.
Fig. 1 is a schematic diagram of functional modules of an intelligent eyeshade based on structured light measurement,
this intelligence eye-shade includes:
and the control module is electrically connected with the infrared light projection module, the camera module and the camera module. The control module also comprises a wireless module which transmits the obtained information to a remote sleep data processing module in a wireless mode. The intelligent eye patch integrates a near infrared light projection module, a camera module, a control module and a sleep data processing module. The near-infrared light projection module projects a specific structured light feature pattern on an eyelid (also known as eyelid) of a user. After the image data is collected by the camera module, the obtained image data is transmitted to the sleep data processing module for processing, so that the eyeball movement (eye movement for short) state of the user during sleeping is obtained, the sleep state of the user is calculated, and finally the sleep data processing module wakes up the user in combination with the user-defined wake-up time period.
The near infrared light projection module is used for projecting a pattern with known characteristic parameters in a proper range of an eyelid (alias eyelid) of a user.
The camera shooting module is used for shooting the whole projection area, feeding back picture data to the control module and transmitting the picture data to the sleep data processing module through the control module. The camera module. For processing picture data and performing a wake-up function. Can be carried on a PC segment or a mobile terminal and is used for judging the eye movement state and the sleep state. And calling the loudspeaker function of hardware (a PC or a mobile terminal) to wake up in combination with the wake-up time period set by the user. The intelligent eyeshade also comprises a power supply module and a processor. Which are respectively arranged on the eyeshade body and connected with the near infrared light projection module and the camera module. The infrared light projection module and the camera module are controlled. And receiving the image data of the camera module and transmitting the image data to the sleep data processing module through a wireless transmission module contained in the camera module.
The structure of the intelligent eyewear proposed in the present application is described next in conjunction with fig. 2-6.
This intelligence eye-shade includes:
the eyeshade comprises an eyeshade body 1 and a fixing belt 2. The two sides of the eyeshade body 1 are provided with connecting ends which are used for connecting the fixing belt 2,
the eyeshade body 1 is provided with: a near infrared light projection module 3 and a camera module 4. The near infrared light projection module 3 and the camera module 4 are arranged on the same side of the eyeshade body 1, so that the working area is the eyelid part of the same eye, and the projection module is in a working state when the camera module works. The shooting range of the camera module is a projection area which comprises the characteristic of reflecting eyelid deformation.
The near infrared light projection module 3 is connected with the control module through a power line, and the connection mode is as shown in figure 4. The near-infrared light projection module 3 has a first terminal (GND terminal) and a second terminal (VCC terminal), and is connected to a processor (processing module, such as an STM32 processor) through matching lines. The three-stripe black-and-white gray scale image covering the eyelid range is projected by adopting a projection lens with a focal length of 3.6 mm. The light-emitting wavelength of the near infrared light projection module 3 is 780 nm-1000 nm, which belongs to near infrared light, and the light-emitting wavelength is invisible to human eyes, so that the normal rest of a user is not influenced. In the present embodiment, the wavelength emitted by the near-infrared light projection module 3 is 850 nm. The pattern projected on the eyelid of human eyes by the near infrared light projection module has known characteristic parameters. Near infrared light projection modules, which apply structured light measurements, project patterns with known characteristic parameters, including, but not limited to, striped patterns of known distribution and width, speckled patterns of known distribution and size, etc., that reflect patterns characteristic of eye movements.
The camera module 4 adopts an ov7725 camera which can clearly image at an object distance of 45 mm. The camera module 4 responds well to near infrared light of 850nm wavelength. The camera module 4 is connected with the control module through a data line, and the connection mode of the camera module and the processor is shown in figure 5. The camera module 4 is connected with the processor through a pre-configured port. The camera module is used for shooting a picture comprising a projection pattern when the near infrared light projection module works, and transmitting image data obtained after shooting to the control module. The processing module of the OV7725 camera has OV _ VSYNC, OV _ SCL, OV _ SDA, OV _ DO-OV _ D7, FIFO _ rclk, FIFO _ WEN, FIFO _ WRST, FIFO _ RRST and FIFO _ OE, which are respectively matched and connected to ports (PA8, PD3, PG13, PCO-PC 7, PV4, PB3, PD6, PG14, PG15 ports) corresponding to one-to-one matching of STM 32.
A control module 5 comprising: wireless transmission module 6, power module 7, treater 8. The processor 8 is a stm32 processor (the processor 8 is disposed on the PCB), and is connected to the near infrared light projection module 3 and the camera module 4, respectively, and controls the same based on instructions. And processing the image obtained by the camera module and transmitting the image to the sleep data processing module through the wireless transmission module 6. The power supply module 7 and the wireless transmission module 6 are disposed on two sides of the processor 8. In one embodiment, the control module 5 includes a power supply module 7, a processor 8, and a wireless transmission module 6 stacked in this order. In one embodiment, the power supply module 7 is configured to a power receiving module (e.g., a coil), and is connected to a matching power transmitting module through the power receiving module, so as to wirelessly charge the power supply module 7. The power receiving module is disposed outside the power supply module 7.
In this embodiment, the wireless transmission module 6 is a bluetooth module, such as an HC-05 bluetooth serial port communication module (which includes GND, VCC, TX, RX, EN, and STATE ports, which are respectively connected to ports (GND, VCC, TX, RX, PA4, and P15A ports) of the STM32 in a matching manner.
In this embodiment, the power supply module 7 is a 3.7v, 1200mA polymer lithium ion battery. The system is used for supplying power to the processor, the near infrared light projection module 3, the camera module 4, the wireless transmission module 6 and the processor 8.
The sleep data processing module carries out corresponding processing on the picture based on the image information of the near infrared light projection module 3 and the camera module 4 to obtain the current eye movement state. The sleep data processing module is preferably an image processing and analyzing program, which is loaded on the PC side and the mobile side and can wake up by calling the speaker function of the PC side and the mobile side.
When the intelligent eyeshade works, a user wears the intelligent eyeshade on the head when sleeping,
the near infrared light projection module is controlled to be in a working state at regular time based on the control module so as to project a preset stripe pattern to the eyelid area of a user, and the stripe pattern has preset frequency spectrum characteristics;
the control camera module controlled by the control module shoots the fringe pattern projected by the near infrared light projection module and feeds the fringe pattern back to the control module,
the sleep data processing module receives and responds to the images, judges the eye movement state during shooting according to the comparison result of the images adjacent in time, and further deduces the sleep state;
and the sleep data processing module executes the awakening function if judging that the current time is the optimal awakening time according to the sleep state and the awakening time defined by the user.
In a specific embodiment, a user (user) fits and wears the eyeshade body, the near-infrared light projection module 3 is in a working state under the control of the control module 5 at regular time (for example, the first 10 seconds per minute), during working, the near-infrared light projection module projects to the eyelid area of the user, three stripe patterns with the width of 5mm, the length of 10mm and the interval of 10mm are shot by the camera module 4 under the control of the control module 5 every second, and the obtained image is transmitted to an intelligent terminal (for example, a smart phone and an intelligent sound box) carrying a sleep data processing module (APP) through the bluetooth transmission function of the control module 5 based on the wireless transmission module 6. Preferably, the attachment portion is disposed on a side of the eyecup body facing the face of the user, and the attachment portion improves the comfort of the user.
After the sleep data processing module receives the (eye movement image) data, time is set for each image and the images are sequenced.
And comparing and judging two temporally adjacent pictures. And judging whether the eyeballs move in the shooting periods of the two pictures according to the characteristic parameter change of the projection pattern in the comparison image. If the change of the characteristic parameter exceeds a threshold value, the eye movement phenomenon is judged to occur.
After the eye movement characteristics reflected among the pictures are judged, the relation between the eye movement state and the time can be obtained. And then the sleep stage is calculated according to the eye movement state data. If the eye movement is in a rapid eye movement stage, namely a shallow sleep state, the eye movement can be awakened by combining the awakening time period set by the user. The intelligent eye shade can accurately detect the sleep state of a user. When a person is in a sleep state, the eye movement state may be indicative of the stage of sleep in which the person is asleep. The eye movement state is divided into a rapid eye movement state and a non-rapid eye movement state; the sleep states are classified into deep sleep and light sleep, in which a rapid eye movement state is often in a light sleep state. The awakening in the shallow sleep is superior to the awakening in the deep sleep, and the current eye movement state monitoring means has the defects of difficult monitoring, low precision, eye compression and the like.
In an embodiment, the sleep data processing module sets the image receiving time based on the obtained image according to the system time of the mobile phone end when the image is received, and sorts the images according to the time sequence (before use, the user needs to define the earliest time and the latest time for waking up the user). Then comparing every two adjacent images in time, performing curve fitting on five characteristic points of two stripes in the pattern to obtain ten characteristic point position coordinates of each image,
if the average offset of the transverse positions of the ten characteristic points of the two pictures exceeds a threshold value, the eye movement phenomenon can be determined to occur during the shooting of the two pictures.
And if the determined eye movement times per minute are more than 5 times of the threshold value, determining that the user is in the rapid eye movement sleep stage in the minute.
According to the eye movement state of the user every minute. If the user has rapid eye movement sleep of not less than 15 minutes within the awakening time set by the user, calling the function of the loudspeaker of the mobile phone to awaken the user at the end of the 15 th minute. If the requirement is not met, calling the function of the loudspeaker of the mobile phone for waking up the user in the last minute of the waking-up time period set by the user.
The foregoing is only a preferred embodiment of the present invention. It should be noted that, for those skilled in the art, various modifications and substitutions can be made without departing from the technical principle of the present invention, and these should be also construed as the scope of the present invention.

Claims (10)

1. An intelligent eye shield based on structured light measurements, comprising:
the eye-shade body, the eye-shade body disposes:
a near infrared light projection module and a camera module, wherein the near infrared light projection module and the camera module are respectively connected with the control module through leads,
the control module includes: a wireless transmission module used for connecting an intelligent terminal carrying a sleep data processing module,
the wavelength of the light emitted by the near infrared light projection module is 780 nm-1000 nm, and the near infrared light projection module is used for projecting a pattern with known characteristic parameters in a preset range of an eyelid of a user,
the camera module is used for shooting the whole projection area and transmitting the shot picture data to the control module.
2. The intelligent eyewear based on structured light measurements of claim 1,
the control module further comprises: the power supply module and the wireless transmission module are arranged on two sides of the processor.
3. The intelligent eyewear based on structured light measurements of claim 1,
the wireless transmission module is a Bluetooth module.
4. The intelligent eyewear based on structured light measurements of claim 2,
the wireless transmission module is an HC-05 Bluetooth module.
5. The intelligent eyewear based on structured light measurements of claim 1,
the both sides of eye-shade body dispose the link, the link is used for connecting the fixed band.
6. The intelligent eyewear based on structured light measurements of claim 1,
the near infrared light projection module and the camera module are arranged on the same side of the eyeshade body, the working area of the near infrared light projection module and the camera module is the eyelid part of the same eye of a user, and the camera module and the projection module work synchronously.
7. The intelligent eyewear based on structured light measurements of claim 6,
the control module and the near infrared light projection module are configured on the same side and are far away from the near infrared light projection module.
8. The intelligent eye shade based on structured light measurements according to claim 1, wherein the pattern projected by the near infrared light projection module onto the eyelids of a human eye has known characteristic parameters.
9. The intelligent eyewear based on structured light measurements of claim 1,
the shooting range of the camera module is a projection area which comprises eyelid deformation characteristics.
10. The intelligent eyewear based on structured light measurements of claim 1,
still include in the eye-shade main part: a power receiving module connected with the power supply module,
the power receiving module is used for being connected with the matched power transmitting module.
CN202122189619.XU 2021-09-10 2021-09-10 Intelligent eye patch based on structured light measurement Active CN216060988U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202122189619.XU CN216060988U (en) 2021-09-10 2021-09-10 Intelligent eye patch based on structured light measurement

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202122189619.XU CN216060988U (en) 2021-09-10 2021-09-10 Intelligent eye patch based on structured light measurement

Publications (1)

Publication Number Publication Date
CN216060988U true CN216060988U (en) 2022-03-18

Family

ID=80675785

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202122189619.XU Active CN216060988U (en) 2021-09-10 2021-09-10 Intelligent eye patch based on structured light measurement

Country Status (1)

Country Link
CN (1) CN216060988U (en)

Similar Documents

Publication Publication Date Title
US10342428B2 (en) Monitoring pulse transmissions using radar
US9662067B2 (en) System for sensing light exposure of a user
TW201808215A (en) Electronic ophthalmic lens with medical monitoring
JP6470749B2 (en) Apparatus and method for determining writing mode or reading mode
TW201733519A (en) Electronic ophthalmic lens with sleep monitoring
CN104720821A (en) Method and smart clothing for achieving real-time posture monitoring
CN109717830B (en) Fatigue detection and wake-up promotion system based on eye movement and head movement parameter monitoring
TW201727191A (en) Electronic ophthalmic lens with alarm clock
TW201720118A (en) Electronic ophthalmic lens with eye closed sensor with open eye prompt and data logging
CN109847168B (en) Wearable fatigue detection and intervention system
CN208172977U (en) A kind of Intelligent sitting posture monitoring device based on structured light technique
CN106037752A (en) Portable cervical vertebra rehabilitation auxiliary device and system
CN112014850A (en) Method for judging read-write state based on laser ranging sensor and mobile device
US20200094015A1 (en) Controlling light exposure for circadian phase management
CN115300228A (en) Intelligent eye patch based on structured light measurement and control method thereof
CN110262074B (en) Intelligent eye protection instrument
CN216060988U (en) Intelligent eye patch based on structured light measurement
CN109009010A (en) The longer intelligent glasses of cruising ability
CN213667800U (en) Intelligent swimming goggles
CN209821541U (en) Intelligent glasses
CN111696325A (en) Vision correction auxiliary device and method based on infrared distance measurement
CN108957793B (en) Intelligent myopia prevention glasses
CN211658137U (en) Head-wearing physiological parameter monitoring device
CN209460514U (en) A kind of anti-myopia glasses
WO2015159850A1 (en) Ocular potential information processing device, ocular potential information processing system, mounting fixture and program

Legal Events

Date Code Title Description
GR01 Patent grant
GR01 Patent grant