EP4677316A1 - System, method and computer program for the measurement and analysis of melanopic light quantity - Google Patents
System, method and computer program for the measurement and analysis of melanopic light quantityInfo
- Publication number
- EP4677316A1 EP4677316A1 EP24707560.9A EP24707560A EP4677316A1 EP 4677316 A1 EP4677316 A1 EP 4677316A1 EP 24707560 A EP24707560 A EP 24707560A EP 4677316 A1 EP4677316 A1 EP 4677316A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- sensor
- melanopic
- light
- behavioral
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J1/00—Photometry, e.g. photographic exposure meter
- G01J1/42—Photometry, e.g. photographic exposure meter using electric radiation detectors
- G01J1/429—Photometry, e.g. photographic exposure meter using electric radiation detectors applied to measurement of ultraviolet light
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J1/00—Photometry, e.g. photographic exposure meter
- G01J1/02—Details
- G01J1/0204—Compact construction
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J1/00—Photometry, e.g. photographic exposure meter
- G01J1/02—Details
- G01J1/0219—Electrical interface; User interface
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J1/00—Photometry, e.g. photographic exposure meter
- G01J1/42—Photometry, e.g. photographic exposure meter using electric radiation detectors
- G01J1/4204—Photometry, e.g. photographic exposure meter using electric radiation detectors with determination of ambient light
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/02—Details
- G01J3/0256—Compact construction
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/02—Details
- G01J3/0264—Electrical interface; User interface
Definitions
- the invention relates to a system, method, and computer program for the measurement and analysis of melanopic light quantity.
- ipRGCs intrinsically photosensitive retinal ganglion cells
- the ipRGCs are quite unlike the cones and rods, which underlie vision and visual perception. They have a spectral sensitivity with maximum of around 490 nm.
- the spectral sensitivities of the ipRGCs were standardized in 2018 by the International Commission on Illumination (CIE) in the International Standard CIE S 026/E:2018.
- illuminance [lux] follows a different spectral sensitivity compared to melanopic irradiance. While illuminance sensors are common, melanopic irradiance needs to be measured using custom filters or calculated from spectral measurements.
- W02021003344A1 describes a system for measuring the radiant exposure of electromagnetic radiation and includes an accumulation detection module which continuously monitors the electromagnetic radiation.
- the present invention relates to a system for the measurement and analysis of melanopic light quantity, comprising: a wearable sensor device, comprising a sensor array, the sensor array comprising sensors, the sensors comprising a melanopic light sensor and at least one of a UV light sensor and an accelerometer, wherein the melanopic light sensor is adapted to capture light sensor data at multiple wavelengths within the visible and optionally near infrared light spectrum, wherein the UV light sensor is adapted to capture light sensor data at specified wavelengths within the UV light spectrum; and a data recording unit, wherein the data recording unit is adapted to store time-series sensor data of each of the sensors.
- the system further comprises a data processing unit comprising a memory storing machine executable instructions, wherein the execution of the instructions causes the data processing unit to determine a behavioral pattern comprising analyzing the time-series sensor data of the melanopic light sensor and at least one of the UV light sensor and the accelerometer , the pattern comprising multiple behavioral elements, each element having assigned a respective melanopic light quantity as obtained from the sensor data of the melanopic light sensor for said element; determine a melanopic light quantity within a predefined time range of the sensor data of the melanopic light sensor; determine a selected behavioral element of the multiple behavioral elements which has assigned a respective one of the melanopic light quantities suitable to at least partially compensate for the difference between a desired value and the determined value of the melanopic light quantity; and output a signal comprising a behavioral recommendation based on the selected behavioral element.
- a behavioral pattern comprising analyzing the time-series sensor data of the melanopic light sensor and at least one of the UV light sensor and the accelerometer , the
- each behavioral element is assigned with the melanopic light quantity associated with the information on the previous behavior of the subject when it was exposed to this light quantity.
- the determined value of the melanopic light quantity may be understood as the total amount of melanopic light detected by the sensors over a specific period of time (time range).
- the time period can be a floating period (e.g., the last N hours) or the time period can be a fixed period, e.g., N hours restarting each day at a determined time.
- Total amount of melanopic light may be understood as an e.g. optionally weighted sum of the melanopic light detected over said time period. Light detected in a certain time range of the day (e.g. morning) may be weighted more compared to other time ranges of the day.
- the predefined time range is a time range in the past and optionally in the future.
- the data processing unit may determine the melanopic light quantity within the predefined time range in the past using the time series sensor data.
- the desired value of the melanopic light quantity may be the desired amount of melanopic light desirably detected by the sensors over a future period of time.
- the future period of time may be a floating period (e.g., the next N hours) or the future period of time can be a fixed period, e.g., N hours restarting each day at a determined time.
- the future period of time may be e.g., a time range being in between 4 hours and 72 hours, preferably in between 8 hours and 24 hours.
- behavioral elements are further assigned a respective time at which they have been carried out in the past. For example, the determination of the selected behavioral elements of the multiple behavioral elements considers the respective assigned time, wherein the respective assigned time falls within the future period of time.
- the execution of the instructions causes the data processing unit to anticipate the melanopic light quantity within the future time range using time series analysis of the time series sensor data.
- time series analysis of the time series sensor data examples include usage of: moving average, exponential smoothing, seasonal decomposition, or machine learning models, especially linear regression, random forest analysis, neural networks, or statistical models, especially AutoRegressive Integrated Moving Average (ARIMA), seasonal AutoRegressive Integrated Moving Average (SARIMA), or geospatial analysis, or environmental and contextual analysis, or a combination of those.
- the melanopic light quantity may include or be the melanopic irradiance.
- the melanopic irradiance may be defined as the irradiance at a given wavelength spectrum, with a peak wavelength of 480 nm. It may further or alternatively include photometric, colorimetric, and radiometric measurement parameters.
- An example for a photometric measurement parameter may be the photopic illuminance (lux).
- Examples for a colorimetric measurement parameter may be CIE xy chromaticity or correlated colour temperature (CCT).
- Examples for a radiometric measurement parameter may be total irradiance or spectral-band-wise irradiance.
- a behavioral pattern may be defined as an action that exposes a subject to a defined dose of melanopic irradiance.
- a subject may be a human or an animal, and a behavioral pattern may be defined but is not limited to for example being inside or outside of a building, for example being exposed to bright screens such as televisions, smart phone screens, computer screens, or for example being exposed to artificial sources of light, for example LED light, incandescent light bulbs, or halogen lights.
- the UV light sensor may be used for determining if a subject is subjected to natural sunlight or daylight.
- the accelerometer may be used for determining the movement patterns of the subject, which may be inside or outside the building.
- the accelerometer may be a 6- axis accelerometer (linear acceleration and angular velocity) to e.g. measure movement to be able to extract information when the light logger is worn.
- the subject may carry or wear the sensor device. In this way it may be ensured that the sensor readings especially of the melanopic light sensor correspond to a real light exposure of the subject.
- a behavioral recommendation may be defined as a concrete instruction. It may be defined as instruction for a certain action that is associated with the exposure to a specific dose of melanopic irradiance.
- a behavioral recommendation may be the recommendation for the subject to physically go inside or outside of a building, to prevent or cancel the exposure to bright artificial screens or monitors, or to dim or turn off artificial light sources.
- the system may have the advantage to help the subject to develop a healthy sleep pattern, to fall asleep faster, to preserve and regulate physiological melatonin levels, to be well rested after sleep, and to be more vigilant during the daytime.
- a further benefit may be that the subject is able to comprehend recommendations how to act to be subject to an optimal dose of melanopic irradiance in an intuitive manner.
- the behavioral recommendation is based on the subject's previous behavioral patterns, which are therefore already familiar to the subject. Instead of giving the subject a rather abstract recommendation "Exposure to 300 lux of light, maximum 650nm wavelength", the behavioral recommendation can be based on the subject's previous behavior and provide an easy-to- implement instruction for action that the subject will intuitively implement correctly.
- the system credibly assists the subject in enhancing his or her physical condition by providing him/her with readily comprehensible recommendations referring to concrete previous user actions in a thus guided process.
- the subject can follow the recommendation (instruction) much more precisely compared to a rather scientific recommendation mentioning concrete exposure values "300 lux” or even some general instructions like "expose yourself to sun”. So, the subject is supported in optimizing his physical condition in a much more precise and reliable way.
- the behavioral recommendation may e.g. be tagged with a time information indicating a time when the subject conducted the respective behavior last time. This may assist the user in selecting the correct behavior.
- the system then automatically considers the user's compliance with the instructions in a kind of loop by continuously performing capturing of the sensor data, determining the melanopic light quantity, and determining the selected behavioral element.
- the signal may be output e.g. using a user interface that is either implemented in the wearable sensor device or in the data processing unit.
- user interfaces are an audio interface or a display.
- the system is configured to communicate wirelessly via Bluetooth (e.g., low energy) with a host computer, wherein the host computer comprises the data processing unit.
- Bluetooth e.g., low energy
- the host computer comprises the data processing unit.
- miniaturization of the sensor device may be achieved, and a host computer with a high processing power may be used.
- This may further have the advantage to decrease the energy consumption of the wearable sensor device, as energy-intensive steps may not be carried out within the miniaturized system.
- a small and portable wearable sensor device is achieved, wherein the data processing unit is not comprised within the device itself, but outside of the device, e.g., in a mobile telecommunication device.
- the sensors of the sensor array may comprise the GNSS sensor. This could introduce independence from a host computer, as the foregoing advantages that are linked to the integration of the GNSS sensor may be directly available in the wearable sensor device.
- enrichment of the behavioral pattern with the GNSS sensor data may only be performed in case the data processing unit (e.g. a mobile phone) is close by the sensor device.
- the data processing unit e.g. a mobile phone
- this may be beneficial in order to keep the battery size of the sensor device small and nevertheless have to possibility to enrich at least part of the data with the GNSS data.
- the data processing unit may access environmental light data, including solar irradiation data from weather or climate measurements or predictions.
- the data may be retrieved from respective databases or service providers over e.g. the internet, or part of the environmental data like an amount of hours of remaining daylight may be calculated by data processing device itself.
- the environmental light data may be used in the forecast.
- the assigned (average) melanopic light quantities may be weighted or adjusted using the environmental light data.
- the determination of the selected behavioral element of the multiple behavioral elements further considers a weather forecast.
- the memory of the data processing unit further comprises machine executable instructions which, after execution, cause the data processing unit to e.g., obtain the weather forecast.
- One advantage of considering the weather forecast could be that the system may optimize the melanopic light uptake by recommending only behavioral elements that take place inside of a building when e.g., behavioral elements that may take place outside of a building may provide a lesser melanopic light quantity due to bad weather (e.g., cloudy) than behavioral elements that may take place inside of a building and vica versa for the case of recommending only behavioral elements that take place outside of a building.
- bad weather e.g., cloudy
- Another advantage of considering weather forecasts could be that the system may anticipate hazardous conditions (e.g., storms, extreme temperatures, ice) and may adjust the behavioral element to prevent accidents or injuries. For example, it could advise against outdoor activities during severe weather or suggest safer, indoor alternatives.
- hazardous conditions e.g., storms, extreme temperatures, ice
- Another advantage could be that over time, a system that incorporates weather forecasts may learn from past outcomes to potentially improve its future recommendations. By e.g., analyzing the success and comfort level of melanopic light uptake in relation to weather conditions, it could refine its predictive algorithms to offer even more accurate and appropriate suggestions.
- the respective associated melanopic light quantity may be adjusted to a higher values during summer time (the days are longer) compared to winter time (it may already be dark at 6pm).
- a similar dynamic adjustment may be used with respect to actual weather data which can reflect a difference in melanopic light quantity of a behavioral element in case of bright sunlight compared to foggy drizzling conditions.
- the system provides in the signal information about the environmental light data. For example, the system may indicate that a certain number of hours of daylight are remaining for following the indicated behavioral recommendation.
- personalized light exposure patterns may be compared to environmental light data, including solar irradiation data from weather or climate measurements or predictions, to deliver personalized, localized behavioral recommendations.
- the system may indicate that participants are receiving a certain proportion of maximum light given the current availability daylight.
- Certain types of activities such as being inside a building and being exposed to artificial light sources, being outside a building and being exposed to natural light sources, or engaging in sports, including but not limited to jogging or cycling, may be associated with receiving certain doses of melanopic irradiance.
- the forecasting may be based on the time-series sensor data, the forecasting preferably comprising modeling the time-series sensor data using an autoregressive-moving-average model.
- autoregressive moving average models may help to predict future trends and develop the forecast for the melanopic irradiance within the aforementioned examples.
- a behavioral pattern could be the subject being inside the building, which could be determined by the sensor data as explained in the foregoing examples.
- the dose of melanopic irradiance can be controlled by switching, which includes turning on, turning off, dimming, or changing the color temperature of artificial lighting. This can be done by controlling the light sources with a switch or dimmer, for example. In this way, the dose of melanopic irradiance can be automatically controlled by the system to achieve a desired dose of melanopic irradiance (desired value of melanopic light quantity).
- FIG. 10 An example to illustrate this is when the subject is wearing the sensor device attached to the head, e.g., via a headband or as an element of eyewear, and is inside a building.
- a sudden turn of the head where the subject may be looking directly into an artificial light source after the turn, can cause large differences in the photometric reading of the sensor. If the photometric reading is already in the saturation range when the subject has not yet turned his or her head toward the artificial light source, this may result in unusable photometric readings after the subject turns his or her head.
- a sudden change in sunlight intensity can also result in very high (saturation) or very low sensor readings. In the case of a very low photometric reading, it may be impossible to interpret the reading because it may be difficult to distinguish from background noise, for example.
- the user communication comprises a planned future behavior of the user regarding a deselection of a behavioral element of the multiple behavioral elements, removing from the multiple behavioral elements the element comprising the planned future behavior;
- the user communication comprises a planned future behavior of the user regarding a planned user activity corresponding to a certain melanopic light quantity, decreasing the difference between the desired value and the determined value of the melanopic light quantity by the certain melanopic light quantity;
- the user communication comprises an altered user light sensitivity, altering the difference between the desired value and the determined value of the melanopic light quantity to compensate for the altered user light sensitivity.
- Another advantage could be that the system's ability to potentially adjust behavioral recommendations based on user input (e.g., deselecting a behavioral element or specifying activities with specific melanopic light requirements) could enable the system to dynamically respond to changes in user preferences or conditions.
- This adaptability could make the system more effective in supporting user goals over time, even as those goals may evolve. For example, the user thus has the possibility to have a one-time activity not being registered as one of the behavioral elements being considered for his recommendations. Thus, this may enable the user to achieve his goal of the desired value of melanopic light quantity more effectively.
- the behavioral elements may differentiate between at least anyone of activity types comprising indoor and outdoor activity based on the light sensor data of the melanopic light sensor having been captured indoor or outdoor, the differentiating being performed using the light sensor data of the UV light sensor; activity locations of a user of the wearable sensor device based on the location data (e.g. using GNSS data as described above); university motion activities of a user of the wearable sensor device based on the sensor data fromll the accelerometer.
- indoor activities may not only be limited to the bare classification indoor or outdoor but may comprise but are not limited to watching television or playing video games (as could be identified via a specific frequency of changes in the light intensity or color as captured by the light sensors), performing indoor sports (identified via the respective movements detected using the accelerometer), while outdoor activities may comprise but are not limited to going for a walk, riding a bike, jogging, or skiing which all may be identified via the respective movements detected using the accelerometer or using GNSS sensor data. So, many of these indoor or outdoor activities may or may not be a classic motion activity, which can be determined based on the sensor data from the accelerometer.
- the differentiation between indoor and outdoor may be performed by using the light sensor data of the UV light sensor, as the sun emits UV light which is captured by the UV sensor and is usually absorbed by glass, so that only a minimal amount of UV light may be captured when a subject is inside of the building even if the room is illuminated by the sun through e.g., the windows.
- the activity type "indoor” may be determined comparing the UV sensor data (photometric reading) with a threshold that is representative for the respective time of the day and location where the UV sensor data is acquired. In a rather simplified example, in case e.g. at lpm the photometric reading of the UV sensor is below a certain threshold, it is concluded that the sensor device is indoor.
- these behavioral elements may be user-specific and if the system detects that a benefit regarding the melanopic light quantity may be achieved by going e.g., outside or inside, it may offer a behavioral recommendation to achieve said benefit.
- the system may further be configured to determine whether the sensor device has been discarded by a user based on the sensor data from the accelerometer, wherein the light sensor data is disregarded for the determining of the behavioral pattern in case a determined likelihood of the sensor device being discarded is above a predetermined threshold.
- the captured melanopic light quantity does not reliably reflect the light to which the subject was exposed during that time.
- An automatic detection if the subject is currently wearing the device may be a convenient way to filter out any irrelevant data, because the subject may not be required to automatically switch off the device during periods where the device may not be worn and used.
- the system may further be configured to determine whether the sensor device has been moved by a user using a motorized transportation system based on the location data from the GNSS sensor, wherein the light sensor data is disregarded for the determining of the behavioral pattern in case a determined likelihood of the sensor device being moved by the user using a motorized transportation system is above a predetermined threshold.
- the data accuracy of the light sensor readings may be low, frequently and unpredictably changing and/or subjected to artifacts.
- the device would automatically discard the data during a motorized transportation and may not offer any form of motorized transportation as a behavioral recommendation.
- the system further comprises a physical button adapted for indicating a predefined behavioral element upon being pushed, the determining of the behavioral pattern further comprising analyzing the pushing of the physical button, the indicated predefined behavioral element upon being pushed preferably indicating the beginning or end of a resting phase of a user of the wearable sensor device.
- the subject may be sleeping.
- the dose of melanopic irradiance that is captured during that phase may still be relevant for determining a behavioral pattern as well as for giving behavioral recommendations.
- the system may assume that a non-movement of the sensor device corresponds of a discarding of the sensor device.
- the usage of the physical button can avoid such a situation by manually indicating the correct usage of the sensor device avoiding disregarding of captures light sensor data.
- the wearable sensor device is battery powered and configured to communicate via a wireless connection with the data processing unit, wherein the data processing unit is comprised in a mobile telecommunication device.
- the data processing unit is comprised in a mobile telecommunication device.
- FIG 4 is a schematic of a system for the measurement and analysis of melanopic light quantity, comprising the discussed features of figure 1 and further illustrating a user communication interface, a docking station and a weather forecast.
- the data processing unit 112 may obtain a weather forecast 402, as depicted in figure 4.
- the weather forecast may be obtained by a wireless or a wired connection and may be obtained locally, e.g., from a local server, or remotely, e.g., from a remote server, e.g., from a server via the internet.
- a behavioral element that takes place e.g., outside a building, i.e., a behavioral element that, for example, takes place directly on the earth's surface with no obstruction to the sky, may be selected.
- step 206 the single determined behavioral element of step 204 is output via the interface 118.
- the interface 118 may be a small display that is integrated into the unit, or, in the case the data processing unit is an external device such as a smartphone, the recommendation can be a notification on such device.
- Optional steps include the adjustment of the sensitivity of either of the UV light and melanopic light sensor in step 208.
- a frequent adjustment of the sensor's sensitivity may be necessary.
- the sensor could be operated in a range that leads to usable photometric readings under current illumination conditions, if these illumination conditions change in the usual way.
- One possibility would be to maintain the sensitivity of the respective sensors in such a range that the respective photometric readings are within the first 10%-20% of the maximal photometric reading of the respective sensor.
- the sensitivity could be adjusted in a regular way, e.g., at each sensor data capture.
- Another optional step would be to forecast the expected melanopic light quantity in step 210.
- this may help supporting the decision which behavioral element is selected in step 204 or for how long it should be recommended in step 206.
- the forecast results in a probability over 80% that the subject will expose himself/herself within the next 6 hours to sufficient sunlight according his/her usual behavior, outputting the recommendation of "riding a bike now" can be omitted.
- Optional step 212 may further assist in improving the quality of the determination of selected behavioral elements by taking into account physiological factors of the subject, such as age, skin tone, gender, or eye color.
- physiological factors of the subject such as age, skin tone, gender, or eye color.
- the desired (optimal) value of the amount of melanopic light may vary, as certain characteristics may require either higher or lower amounts of melanopic light.
- a possible purpose of the physical button 120 could be to accurately signal rest periods of the subject wearing the sensor device 100.
- resting phases such as at noon when the subject is exposed to natural light, may not be taken into account with respect to the subject's exposure to sunlight during the resting phase.
- the subject could indicate the beginning and the end of the resting period, thus ensuring that the subject's exposure to sunlight during the resting period is correctly considered (recorded) for the evaluation of the determined value of the melanopic light quantity.
- FIG 3 is a schematic of an example situation for the usage of the wearable sensor device 100.
- a user 302 also referred to as a subject, wearing and using the wearable sensor device 100 is located inside the enclosed space of a building 300 and thus, the UV light sensor 106 of the sensor array 102 is not capturing the UV light rays from the sun 308. Furthermore, the user 302 is working with and looking at a bright illuminated screen 304.
- step 202 the data processing unit determines the melanopic light quantity that the subject was exposed to within a defined time period in e.g. the past 6 hours.
- a respective behavioral element is selected in step 204.
- One behavioral element of the behavioral pattern as determined in step 200 comprises being outside of the enclosed space 300 and use the bike while being subjected to natural sunlight from the sun 308. This activity (behavioral element) is associated with a representative mean melanopic light quantity as described above.
- the determined selected behavioral element of step 204 is then offered as a recommendation to the subject using a respective signal via the interface 118 in step 206.
- the output may be the recommendation of the behavioral element "bike riding" as a message.
- a light bulb 310 which may be controlled by the signal provided in step 206.
- the light bulb 310 may be part of a home automation system.
- the system e.g. the data processing unit 112 may send the signal to the home automation system or directly to the light bulb commanding the light bulb to switch color temperature, light intensity, turn on or off etc. This may assist the subject in compensating for the difference between the desired value and the determined value of the melanopic light quantity e.g. in case the suggested behavioral recommendation based on the selected behavioral element is not sufficient to compensate for said difference.
- Figure 6 displays a system 600 equipped with computing and hardware interfaces for example for the measurement and analysis of melanopic light quantity.
- the system 600 is intended to represent one or more computing units, which may be distributed.
- the system 600 is shown to comprise a computing system 604.
- the computing system 604 is intended to represent one or more computing systems.
- the system 600 is further shown to include an optional hardware interface 606.
- the hardware interface may enable the system 600 to send and receive data from external components.
- the system 600 is further shown to be in communication with an optional user interface 608.
- the system 600 may also comprise, for example, a display device. This could include, for example, a two-dimensional computer display, a touch screen, a virtual reality system, and an augmented reality system.
- Figure 7 shows a data processing unit 702 comprising a memory storing machine executable instructions 114 for the analysis of melanopic light quantity.
- the data processing unit 702 may be similar to the data processing unit 112.
- the data processing unit 702 may have further means to receive time-series sensor data 704 from an external device, such as e.g., an external device comprising sensors.
- the external device may e.g. be a smartwatch, a smartphone, a wearable, a smart glass, a fitness tracker, a sport and/or action camera, a wearable health device, a smart home device, an automotive dash cam, a gaming controller, a gaming glass, a virtual reality headset, an environmental monitoring device, a smart luggage.
- a data may be retrieved over a modem, over the internet, or over a local area network.
- Computer executable code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Landscapes
- Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Life Sciences & Earth Sciences (AREA)
- Sustainable Development (AREA)
- Photometry And Measurement Of Optical Pulse Characteristics (AREA)
Abstract
Disclosed is a system for the measurement and analysis of melanopic light quantity, comprising a wearable sensor device (100), comprising a sensor array (102), the sensor array (102) comprising sensors, the sensors comprising a melanopic light sensor and at least one of a UV light sensor and an accelerometer. A data processing unit determines a behavioral pattern comprising analyzing the time-series sensor data. If further determines a melanopic light quantity within a predefined time range of the sensor data of the melanopic light sensor, determines a behavioral element of the pattern which has assigned a respective one of the melanopic light quantities suitable to at least partially compensate for the difference between a desired value and the determined value of the melanopic light quantity, and outputs a signal comprising a behavioral recommendation based on the selected behavioral element.
Description
SYSTEM, METHOD AND COMPUTER PROGRAM FOR THE MEASUREMENT AND ANALYSIS OF MELANOPIC LIGHT QUANTITY
FIELD OF THE INVENTION
[0001] The invention relates to a system, method, and computer program for the measurement and analysis of melanopic light quantity.
BACKGROUND
[0002] Light is a key driver of human physiology and behavior, affecting the biological clock, hormone production and sleep. The non-visual effects of light are due to a set of cells in the eye's retina called the intrinsically photosensitive retinal ganglion cells (ipRGCs) expressing the photopigment melanopsin. The ipRGCs are quite unlike the cones and rods, which underlie vision and visual perception. They have a spectral sensitivity with maximum of around 490 nm. The spectral sensitivities of the ipRGCs were standardized in 2018 by the International Commission on Illumination (CIE) in the International Standard CIE S 026/E:2018. Importantly, illuminance [lux] follows a different spectral sensitivity compared to melanopic irradiance. While illuminance sensors are common, melanopic irradiance needs to be measured using custom filters or calculated from spectral measurements.
[0003] Miniaturized light dosimeters are known in the art. W02021003344A1 describes a system for measuring the radiant exposure of electromagnetic radiation and includes an accumulation detection module which continuously monitors the electromagnetic radiation.
[0004] It is an objective to provide for a system, method, and computer program system for the measurement and analysis of melanopic light quantity.
SUMMARY
[0005] The present invention relates to a system for the measurement and analysis of melanopic light quantity, comprising: a wearable sensor device, comprising a sensor array, the sensor array comprising sensors, the sensors comprising a melanopic light sensor and at least one of a UV light sensor and an accelerometer, wherein the melanopic light sensor is adapted to capture light sensor data at multiple wavelengths within the visible and optionally near infrared light
spectrum, wherein the UV light sensor is adapted to capture light sensor data at specified wavelengths within the UV light spectrum; and a data recording unit, wherein the data recording unit is adapted to store time-series sensor data of each of the sensors. The system further comprises a data processing unit comprising a memory storing machine executable instructions, wherein the execution of the instructions causes the data processing unit to determine a behavioral pattern comprising analyzing the time-series sensor data of the melanopic light sensor and at least one of the UV light sensor and the accelerometer , the pattern comprising multiple behavioral elements, each element having assigned a respective melanopic light quantity as obtained from the sensor data of the melanopic light sensor for said element; determine a melanopic light quantity within a predefined time range of the sensor data of the melanopic light sensor; determine a selected behavioral element of the multiple behavioral elements which has assigned a respective one of the melanopic light quantities suitable to at least partially compensate for the difference between a desired value and the determined value of the melanopic light quantity; and output a signal comprising a behavioral recommendation based on the selected behavioral element.
[0006] Thus, this may be understood in that each behavioral element is assigned with the melanopic light quantity associated with the information on the previous behavior of the subject when it was exposed to this light quantity. Generally, the determined value of the melanopic light quantity may be understood as the total amount of melanopic light detected by the sensors over a specific period of time (time range). The time period can be a floating period (e.g., the last N hours) or the time period can be a fixed period, e.g., N hours restarting each day at a determined time. Total amount of melanopic light may be understood as an e.g. optionally weighted sum of the melanopic light detected over said time period. Light detected in a certain time range of the day (e.g. morning) may be weighted more compared to other time ranges of the day.
[0007] For example, the predefined time range is a time range in the past and optionally in the future. The data processing unit may determine the melanopic light quantity within the predefined time range in the past using the time series sensor data. The desired value of the melanopic light quantity may be the desired amount of melanopic light desirably detected by the sensors over a future period of time.
[0008] The future period of time may be a floating period (e.g., the next N hours) or the future period of time can be a fixed period, e.g., N hours restarting each day at a determined time. The future period of time may be e.g., a time range being in between 4 hours and 72 hours, preferably in between 8 hours and 24 hours.
[0009] For example, behavioral elements are further assigned a respective time at which they have been carried out in the past. For example, the determination of the selected behavioral elements of the multiple behavioral elements considers the respective assigned time, wherein the respective assigned time falls within the future period of time.
[0010] In case the predefined time range comprises the future, the execution of the instructions causes the data processing unit to anticipate the melanopic light quantity within the future time range using time series analysis of the time series sensor data. Examples include usage of: moving average, exponential smoothing, seasonal decomposition, or machine learning models, especially linear regression, random forest analysis, neural networks, or statistical models, especially AutoRegressive Integrated Moving Average (ARIMA), seasonal AutoRegressive Integrated Moving Average (SARIMA), or geospatial analysis, or environmental and contextual analysis, or a combination of those.
[0011] The melanopic light quantity may include or be the melanopic irradiance. The melanopic irradiance may be defined as the irradiance at a given wavelength spectrum, with a peak wavelength of 480 nm. It may further or alternatively include photometric, colorimetric, and radiometric measurement parameters. An example for a photometric measurement parameter may be the photopic illuminance (lux). Examples for a colorimetric measurement parameter may be CIE xy chromaticity or correlated colour temperature (CCT). Examples for a radiometric measurement parameter may be total irradiance or spectral-band-wise irradiance.
[0012] In the following, without limiting the generality of the foregoing it is assumed that the light quantity is given by the melanopic light irradiance.
[0013] High doses of melanopic irradiance may disrupt sleep, suppress melatonin, and increase alertness. In The system, a behavioral pattern may be defined as an action that exposes a subject to a defined dose of melanopic irradiance. In this context, a subject may be a human or an animal, and a behavioral pattern may be defined but is not limited to for example being inside or outside of a building, for example being exposed to bright screens such as televisions, smart phone screens, computer screens, or for example being exposed to artificial sources of light, for example LED light, incandescent light bulbs, or halogen lights. In The system, the UV light sensor may be used for determining if a subject is subjected to natural sunlight or daylight. Furthermore, the accelerometer may be used for determining the movement patterns of the subject, which may be inside or outside the building. Generally, the accelerometer may be a 6- axis
accelerometer (linear acceleration and angular velocity) to e.g. measure movement to be able to extract information when the light logger is worn.
[0014] The subject may carry or wear the sensor device. In this way it may be ensured that the sensor readings especially of the melanopic light sensor correspond to a real light exposure of the subject.
[0015] Further, in this context, a behavioral recommendation may be defined as a concrete instruction. It may be defined as instruction for a certain action that is associated with the exposure to a specific dose of melanopic irradiance. For example, a behavioral recommendation may be the recommendation for the subject to physically go inside or outside of a building, to prevent or cancel the exposure to bright artificial screens or monitors, or to dim or turn off artificial light sources. The system may have the advantage to help the subject to develop a healthy sleep pattern, to fall asleep faster, to preserve and regulate physiological melatonin levels, to be well rested after sleep, and to be more vigilant during the daytime.
[0016] A further benefit may be that the subject is able to comprehend recommendations how to act to be subject to an optimal dose of melanopic irradiance in an intuitive manner. The behavioral recommendation is based on the subject's previous behavioral patterns, which are therefore already familiar to the subject. Instead of giving the subject a rather abstract recommendation "Exposure to 300 lux of light, maximum 650nm wavelength", the behavioral recommendation can be based on the subject's previous behavior and provide an easy-to- implement instruction for action that the subject will intuitively implement correctly. In other words, the system credibly assists the subject in enhancing his or her physical condition by providing him/her with readily comprehensible recommendations referring to concrete previous user actions in a thus guided process. The subject can follow the recommendation (instruction) much more precisely compared to a rather scientific recommendation mentioning concrete exposure values "300 lux" or even some general instructions like "expose yourself to sun". So, the subject is supported in optimizing his physical condition in a much more precise and reliable way. The behavioral recommendation may e.g. be tagged with a time information indicating a time when the subject conducted the respective behavior last time. This may assist the user in selecting the correct behavior. The system then automatically considers the user's compliance with the instructions in a kind of loop by continuously performing capturing of the sensor data, determining the melanopic light quantity, and determining the selected behavioral element.
Thus, it is continuously checked to what extent the compensation for the difference between the desired value and the actualized determined value of the melanopic light quantity has taken
place and, if necessary, a new output of a correspondingly changed signal with changed recommendation is carried out.
[0017] The signal may be output e.g. using a user interface that is either implemented in the wearable sensor device or in the data processing unit. Examples of user interfaces are an audio interface or a display.
[0018] Preferably, the system is configured to communicate wirelessly via Bluetooth (e.g., low energy) with a host computer, wherein the host computer comprises the data processing unit. By outsourcing the data processing unit to a host computer, miniaturization of the sensor device may be achieved, and a host computer with a high processing power may be used. This may further have the advantage to decrease the energy consumption of the wearable sensor device, as energy-intensive steps may not be carried out within the miniaturized system. Eventually, a small and portable wearable sensor device is achieved, wherein the data processing unit is not comprised within the device itself, but outside of the device, e.g., in a mobile telecommunication device.
[0019] The system may comprise a global navigation satellite system, GNSS, sensor, wherein the GNSS sensor is configured to provide as time series sensor data location data to the data processing unit, wherein the execution of the instructions causes the data processing unit to further use the location data for determining the behavioral pattern. As per the foregoing definition of the behavioral pattern, a behavioral pattern may include the information if the user is inside or outside a building which can, in an example, accurately be determined by the information obtained from the GNSS sensor. A different example for behavioral pattern that includes data from said GNSS sensor would be the type of activity the subject is currently performing, such as e.g., jogging or riding a bike, which may be determined by taking the velocity data extracted from the GNSS sensor and/or the accelerometer into account. Eventually, a detailed melanopic profile for different kinds of behavioral patterns may be developed.
[0020] Another usage scenario of the GNSS sensor data is to assign the behavioral elements with location information, e.g. a name of a location like a street or place like "xyz beach" which may further assist the subject to perform the recommended behavior as suggested since the recommendation is enriched with further information that helps the user to understand the recommendation.
[0021] The sensors of the sensor array may comprise the GNSS sensor. This could introduce independence from a host computer, as the foregoing advantages that are linked to the
integration of the GNSS sensor may be directly available in the wearable sensor device. On the other hand, in case the sensor is part of the data processing unit, enrichment of the behavioral pattern with the GNSS sensor data may only be performed in case the data processing unit (e.g. a mobile phone) is close by the sensor device. However, since GNSS sensor data acquisition takes a lot of battery power, this may be beneficial in order to keep the battery size of the sensor device small and nevertheless have to possibility to enrich at least part of the data with the GNSS data.
[0022] Preferably, the execution of the instructions causes the data processing unit to forecast an expected amount of melanopic light to be sensed by the melanopic light sensor within a predetermined future time period, wherein the determination of the selected behavioral element further takes into account the expected amount of melanopic light as compensation for the difference between the desired value and the determined value of the amount of melanopic light. The forecast of the expected amount of melanopic light is e.g. based on the determined behavioral pattern. The forecast may be assuming that the subject follows his usual habits on the course of the day according to the behavioral pattern.
[0023] This prediction may have the advantage of predicting and forecasting the dose of melanopic irradiance to which the subject may be exposed. Because a prediction takes into account the likely course of melanopic dose exposure over a period of time, recommendations can be tailored accordingly. For example, if a subject is supposed to be expected to be exposed to sunlight in the next few hours anyway, and this is exactly what the subject needs to do, then the output of an appropriate signal can be omitted. If, on the other hand, it is predicted that the subject will not be exposed to sunlight in the next few hours, and exactly the opposite would be the necessary action for the subject, the subject could be informed accordingly by means of the signal. The predetermined future time period could be for example the remaining time of the day or a remaining time until the subject typically will go to sleep.
[0024] The data processing unit may access environmental light data, including solar irradiation data from weather or climate measurements or predictions. The data may be retrieved from respective databases or service providers over e.g. the internet, or part of the environmental data like an amount of hours of remaining daylight may be calculated by data processing device itself. The environmental light data may be used in the forecast. For the determination of the selected behavioral element the assigned (average) melanopic light quantities may be weighted or adjusted using the environmental light data.
[0025] For example, the determination of the selected behavioral element of the multiple behavioral elements further considers a weather forecast. For example, the memory of the data processing unit further comprises machine executable instructions which, after execution, cause the data processing unit to e.g., obtain the weather forecast.
[0026] One advantage of considering the weather forecast could be that the system may optimize the melanopic light uptake by recommending only behavioral elements that take place inside of a building when e.g., behavioral elements that may take place outside of a building may provide a lesser melanopic light quantity due to bad weather (e.g., cloudy) than behavioral elements that may take place inside of a building and vica versa for the case of recommending only behavioral elements that take place outside of a building.
[0027] Another advantage of considering weather forecasts could be that the system may anticipate hazardous conditions (e.g., storms, extreme temperatures, ice) and may adjust the behavioral element to prevent accidents or injuries. For example, it could advise against outdoor activities during severe weather or suggest safer, indoor alternatives.
[0028] Another advantage could be that over time, a system that incorporates weather forecasts may learn from past outcomes to potentially improve its future recommendations. By e.g., analyzing the success and comfort level of melanopic light uptake in relation to weather conditions, it could refine its predictive algorithms to offer even more accurate and appropriate suggestions.
[0029] In an example, in case for a certain outdoor activity reflected by a respective behavioral element that is expected to take place at a certain time (e.g. 6pm) the respective associated melanopic light quantity may be adjusted to a higher values during summer time (the days are longer) compared to winter time (it may already be dark at 6pm). A similar dynamic adjustment may be used with respect to actual weather data which can reflect a difference in melanopic light quantity of a behavioral element in case of bright sunlight compared to foggy drizzling conditions.
[0030] It is possible that the system provides in the signal information about the environmental light data. For example, the system may indicate that a certain number of hours of daylight are remaining for following the indicated behavioral recommendation. Thus, in conclusion, personalized light exposure patterns may be compared to environmental light data, including solar irradiation data from weather or climate measurements or predictions, to deliver personalized, localized behavioral recommendations. The system may indicate that participants are receiving a certain proportion of maximum light given the current availability daylight.
[0031] Certain types of activities, such as being inside a building and being exposed to artificial light sources, being outside a building and being exposed to natural light sources, or engaging in sports, including but not limited to jogging or cycling, may be associated with receiving certain doses of melanopic irradiance. In this way, specific behavioral patterns could be offered as a behavioral recommendation to achieve the predicted dose of melanopic irradiation within a predetermined future time period. Ultimately, this can be expected to lead to health-optimized doses of melanopic irradiance throughout the day, preventing excess or deficient melanopic irradiance.
[0032] The forecasting may be based on the time-series sensor data, the forecasting preferably comprising modeling the time-series sensor data using an autoregressive-moving-average model. Such kind of autoregressive moving average models may help to predict future trends and develop the forecast for the melanopic irradiance within the aforementioned examples.
However, other tools for forecasting are known in the art and the disclosure is thus not limited to using an autoregressive-moving-average model.
[0033] The system could be communicatively coupled with a house automation system, wherein the system is adapted to send a command to the house automation system to switch light, the expected melanopic light quantity resulting from the switching of the light in the predetermined future time period, the signal further comprising the command.
[0034] In one example, a behavioral pattern could be the subject being inside the building, which could be determined by the sensor data as explained in the foregoing examples. Inside a building, the dose of melanopic irradiance can be controlled by switching, which includes turning on, turning off, dimming, or changing the color temperature of artificial lighting. This can be done by controlling the light sources with a switch or dimmer, for example. In this way, the dose of melanopic irradiance can be automatically controlled by the system to achieve a desired dose of melanopic irradiance (desired value of melanopic light quantity). In one example, the command may cause the home automation system to reduce the intensity or turn off the artificial lighting, which may reduce the dose of melanopic irradiance to which the subject is exposed. In another example, the command may cause the home automation system to increase the intensity or turn on the artificial lighting, which may increase the dose of melanopic irradiance to which the subject is exposed. This may have the advantage of providing a convenient way to automatically control the dose of melanopic irradiance throughout the day when the subject is in the building, which may minimize the amount of signals to be output and which includes the behavioral recommendation based on the selected behavioral element.
[0035] For example, the sensitivity of the melanopic light sensor and/or the UV light sensor is adjustable, wherein the sensor device is adapted to adjust the sensor sensitivity such that a photometric reading of the sensor is obtained within a predefined range. Sudden high-magnitude changes in light intensity may lead to artifactual readings from the melanopic light sensor and/or the UV light sensor. The sensor integration time may therefore be controlled using an adaptive mechanism to account for the very high large differences in environmental illumination spanning multiple orders of magnitude.
[0036] An example to illustrate this is when the subject is wearing the sensor device attached to the head, e.g., via a headband or as an element of eyewear, and is inside a building. A sudden turn of the head, where the subject may be looking directly into an artificial light source after the turn, can cause large differences in the photometric reading of the sensor. If the photometric reading is already in the saturation range when the subject has not yet turned his or her head toward the artificial light source, this may result in unusable photometric readings after the subject turns his or her head. In another example, if the subject is outside a building, a sudden change in sunlight intensity can also result in very high (saturation) or very low sensor readings. In the case of a very low photometric reading, it may be impossible to interpret the reading because it may be difficult to distinguish from background noise, for example.
[0037] In view of such sudden changes in the lightning conditions the adjustment of the sensor sensitivity may be beneficial, so that sensor readings within the sensor specifications are obtained with a rather high likelihood. The adjusting of the sensor sensitivity may comprise an adjustment of the exposure time of the sensor. In general, the sensor could be operated in a range that leads to usable photometric readings even under the current illumination conditions, if these illumination conditions change in the usual way. The sensitivity could be adjusted in a regular way, e.g., at each sensor data capture.
[0038] Preferably, the determination of the selected behavioral element is specific for a user of the sensor device, the data processing unit further comprising an interface for receiving physiological factors of the user, wherein the execution of the instructions causes the data processing unit to determine the desired value of the melanopic light quantity taking into account the physiological factors. In an example, the physiological factors may comprise but are not limited to the age of the subject, the skin tone of the subject, the sex of the subject, or the eye color of the subject. Dependent on the physiological factors, the desired value of the melanopic light quantity may be determined, as certain characteristics may pose the need for either higher or lower quantities of melanopic light.
[0039] For example, the system further comprises a user communication interface. The user communication interface may comprise means for receiving a user communication from a user. The determination of the selected behavioral element may comprise any one of:
-in case the user communication comprises a planned future behavior of the user regarding a deselection of a behavioral element of the multiple behavioral elements, removing from the multiple behavioral elements the element comprising the planned future behavior; or
-in case the user communication comprises a planned future behavior of the user regarding a planned user activity corresponding to a certain melanopic light quantity, decreasing the difference between the desired value and the determined value of the melanopic light quantity by the certain melanopic light quantity; or
-in case the user communication comprises an altered user light sensitivity, altering the difference between the desired value and the determined value of the melanopic light quantity to compensate for the altered user light sensitivity.
[0040] One advantage of the use of the user communication interface could be that e.g., by allowing the user to communicate planned future behaviors to the system, the system may tailor its recommendations more precisely to individual needs and circumstances. This level of personalization could ensure that the system's output is more relevant and useful to the user, potentially enhancing their melanopic light uptake. For example, recommending the user a certain behavior which the user anyhow has planned to be performed before bedtime may lead to an overexposure to melanopic light before bedtime which can lead to sleep problems.
[0041] Another advantage could be that the system's ability to potentially adjust behavioral recommendations based on user input (e.g., deselecting a behavioral element or specifying activities with specific melanopic light requirements) could enable the system to dynamically respond to changes in user preferences or conditions. This adaptability could make the system more effective in supporting user goals over time, even as those goals may evolve. For example, the user thus has the possibility to have a one-time activity not being registered as one of the behavioral elements being considered for his recommendations. Thus, this may enable the user to achieve his goal of the desired value of melanopic light quantity more effectively.
[0042] By e.g., accounting for changes in a user's light sensitivity, the system may offer more personalized and accurate recommendations for light exposure. This may be especially beneficial for users with conditions that potentially affect their sensitivity to light, such as migraines, eye disorders, sunburns, having a tan, or taking medication such as tetracyclines that alter the user's light sensitivity. An advantage could be that by e.g., tailoring the light exposure based on the
user's current sensitivity, comfort may be improved, and symptoms associated with overexposure or underexposure to certain light types may be reduced. Another advantage could be that the overall health of the user may be increased as the user may be exposed to more light or less light in accordance with their current individual light sensitivity.
[0043] For example, the behavioral elements may differentiate between at least anyone of activity types comprising indoor and outdoor activity based on the light sensor data of the melanopic light sensor having been captured indoor or outdoor, the differentiating being performed using the light sensor data of the UV light sensor; activity locations of a user of the wearable sensor device based on the location data (e.g. using GNSS data as described above); sportive motion activities of a user of the wearable sensor device based on the sensor data fromll the accelerometer.
[0044] As per the aforementioned examples, indoor activities may not only be limited to the bare classification indoor or outdoor but may comprise but are not limited to watching television or playing video games (as could be identified via a specific frequency of changes in the light intensity or color as captured by the light sensors), performing indoor sports (identified via the respective movements detected using the accelerometer), while outdoor activities may comprise but are not limited to going for a walk, riding a bike, jogging, or skiing which all may be identified via the respective movements detected using the accelerometer or using GNSS sensor data. So, many of these indoor or outdoor activities may or may not be a sportive motion activity, which can be determined based on the sensor data from the accelerometer.
[0045] The differentiation between indoor and outdoor may be performed by using the light sensor data of the UV light sensor, as the sun emits UV light which is captured by the UV sensor and is usually absorbed by glass, so that only a minimal amount of UV light may be captured when a subject is inside of the building even if the room is illuminated by the sun through e.g., the windows. The activity type "indoor" may be determined comparing the UV sensor data (photometric reading) with a threshold that is representative for the respective time of the day and location where the UV sensor data is acquired. In a rather simplified example, in case e.g. at lpm the photometric reading of the UV sensor is below a certain threshold, it is concluded that the sensor device is indoor.
[0046] In an example, these behavioral elements may be user-specific and if the system detects that a benefit regarding the melanopic light quantity may be achieved by going e.g., outside or inside, it may offer a behavioral recommendation to achieve said benefit.
[0047] The system may further be configured to determine whether the sensor device has been discarded by a user based on the sensor data from the accelerometer, wherein the light sensor data is disregarded for the determining of the behavioral pattern in case a determined likelihood of the sensor device being discarded is above a predetermined threshold. In an example, when the sensor device is not worn by the subject, the captured melanopic light quantity does not reliably reflect the light to which the subject was exposed during that time. An automatic detection if the subject is currently wearing the device may be a convenient way to filter out any irrelevant data, because the subject may not be required to automatically switch off the device during periods where the device may not be worn and used.
[0048] The system may further be configured to determine whether the sensor device has been moved by a user using a motorized transportation system based on the location data from the GNSS sensor, wherein the light sensor data is disregarded for the determining of the behavioral pattern in case a determined likelihood of the sensor device being moved by the user using a motorized transportation system is above a predetermined threshold. In case of using a motorized transportation system, the data accuracy of the light sensor readings may be low, frequently and unpredictably changing and/or subjected to artifacts. Hence, in an example, the device would automatically discard the data during a motorized transportation and may not offer any form of motorized transportation as a behavioral recommendation. This may be limited to such kind of motorized transportation within an enclosed space, including but not limited to driving a car, flying in an airplane, or riding a train. Other kinds of transportation, where the subject may not be within an enclosed space, including but not limited to driving an electric scooter or riding an electric bike, may still be determined as a behavioral pattern, e.g. based on the velocity of the transportation system.
[0049] Preferably, the system further comprises a physical button adapted for indicating a predefined behavioral element upon being pushed, the determining of the behavioral pattern further comprising analyzing the pushing of the physical button, the indicated predefined behavioral element upon being pushed preferably indicating the beginning or end of a resting phase of a user of the wearable sensor device. In an example, during a resting phase the subject may be sleeping. The dose of melanopic irradiance that is captured during that phase may still be relevant for determining a behavioral pattern as well as for giving behavioral recommendations. However, by means of the acceleration sensor the system may assume that a non-movement of the sensor device corresponds of a discarding of the sensor device. The usage of the physical
button can avoid such a situation by manually indicating the correct usage of the sensor device avoiding disregarding of captures light sensor data.
[0050] For example, the wearable sensor device is battery powered and configured to communicate via a wireless connection with the data processing unit, wherein the data processing unit is comprised in a mobile telecommunication device. Especially when miniaturizing the system, there may be only limited space available for a battery and a microprocessor with a high processing power. In that case, operations that require high processing power may either be difficult to be carried out or may require too much power drawing the battery quickly empty. In an example, where the data processing unit is comprised in a smartphone, the wearable sensor device itself may still be miniaturized and communicate wirelessly with the smartphone via the Bluetooth (low energy) protocol, but such kind of operations that require high processing power, including but not limited to the detection of behavioral patterns, the prediction and forecasting, and the behavioral recommendations, may be carried out and/or displayed by the smartphone. This is the advantage of conserving energy within the wearable sensor device and allowing for the usage of smaller components with less processing power.
[0051] In general, a (portable) mobile telecommunication device may be a mobile phone, PDA, laptop, smartwatch.
[0052] In another example, the wearable sensor device comprises a mounting mechanism, wherein the mounting mechanism is adapted for mounting of the wearable sensor device on a helmet or on spectacle frames or a headband of a user of the sensor device. In an example, during activities inside of the building, the wearable sensor device may be mounted on the spectacle frames. In another example outside of the building and/or during sportive motion activities, the wearable sensor device may be mounted on a helmet, e.g. a bicycle or skiing helmet. Such kind of mounting mechanism may represent an easy and convenient way to wear and use the system. Since in general, the plane of measurements to determine physiologically relevant light exposure is the corneal plane, sensor measurements near the eye are beneficial for reliable data analysis and behavior recommendation.
[0053] For example, the melanopic light sensor may comprise at least 12, preferably in between 16 and 20 light channels operating at different respective wavelengths in the visible and optionally near IR range (410-740, optionally -940 nm), and/or the UV light sensor comprising in between 1 and 4, preferably 2 light channels operating at different respective UV wavelengths (330 nm and 365 nm). By having a high number of channels for the detection of the melanopic
irradiance, a detailed analysis of the melanopic spectrum may be possible. The melanopic light has a spectral peak at approximately 480 nm but also includes light emitted within a broader wavelength range. Hence, more light channels that capture light at given wavelengths are beneficial in order to fully capture the melanopic light range. However, a higher number of light channels may lead to a higher energy consumption, higher costs, the need for higher processing power, and the need for more storage capacity while only slightly improving the data quality. In an example, 16 to 20 light channels represent an optimal range. In another example, preferably two UV light channels are sufficient to capture the UV light of the sun and to determine if a user may be inside or outside of the building, while keeping energy consumption, costs, the need for higher processing power, and the need for more storage capacity at a low level.
[0054] The data processing unit may further comprise at least one neural network processing module configured to provide the melanopic light quantity in response to receiving the melanopic light sensor data. Commonly, melanopic irradiance may be measured using custom filters or may be calculated from spectral measurements. In an example, the conversion of the readings from the melanopic light sensor to the melanopic light quantity may be carried out by a neural network processing module. A calibrated, digitally tunable light source may be used to feed the melanopic light sensor of the sensor array with a known quantity of melanopic light to train the neural network processing module.
[0055] For example, the data processing unit is comprised by a docking station. The wearable sensor device may be configured to dock to the docking station. In an example, the docking station may provide means to charge a battery of the wearable sensor device.
[0056] On advantage of a docking station could be that the user is provided with an easy and convenient way to dock the system during periods in which the wearable sensor device isn't used. Furthermore, the battery may be conveniently charged during periods in which the wearable sensor device isn't used. Another advantage may be that the docking station may provide an easy and convenient high-speed data transfer connection between the wearable sensor device and the data processing unit.
[0057] For example, the determination of the selected behavioral elements comprises the determination of at least one selected behavioral element. In case e.g., the at least one selected behavioral element may not be suitable to fully compensate for the difference between the desired value and the determined value of the melanopic light quantity, the signal could comprise a warning notification.
[0058] The warning notification may act as a preemptive alert and may signal that the current adjustments or behavioral elements may be insufficient to achieve the desired melanopic light exposure. One advantage could be that this may allow for timely intervention in the future before the potential discrepancy may impact the individual's well-being, performance and/or health. Another advantage could be that by e.g., informing the user about the inadequacy of current conditions to meet the potential desired melanopic light levels, the system may educate them on the importance of light exposure to their health. This increased awareness could motivate the user to make conscious adjustments to their environment or behavior in the future.
[0059] The warning notifications may be logged and analyzed over time to e.g., identify patterns or recurring inadequacies in the system's ability to adjust the melanopic light quantity. One advantage could be that such a data-driven approach could guide future improvements in the system's algorithms or could suggest changes in the environment or user behavior.
[0060] In another aspect, a method for operating a system for the measurement and analysis of melanopic light quantity is disclosed. The system is comprising a wearable sensor device, comprising a sensor array, the sensor array comprising sensors, the sensors comprising a melanopic light sensor and at least one of a UV light sensor and an accelerometer, wherein the melanopic light sensor is adapted to capture light sensor data at multiple wavelengths within the visible and optionally near infrared light spectrum, wherein the UV light sensor is adapted to capture light sensor data at specified wavelengths within the UV light spectrum. The sensor device is comprising a data recording unit, wherein the data recording unit is adapted to store time-series sensor data of each of the sensors. The system further comprises a data processing unit configured to determine a behavioral pattern comprising analyzing the time-series sensor data of the melanopic light sensor and at least one of the UV light sensor and the accelerometer, the pattern comprising multiple behavioral elements, each element having assigned a respective melanopic light quantity as obtained from the sensor data of the melanopic light sensor for said element; determine a melanopic light quantity within a predefined time range of the sensor data of the melanopic light sensor; determine a selected behavioral element of the multiple behavioral elements which has assigned a respective one of the melanopic light quantities suitable to at least partially compensate for the difference between a desired value and the determined value of the melanopic light quantity; and output a signal comprising a behavioral recommendation based on the selected behavioral element. The method comprises: operating the wearable sensor device to capture sensor data of each of the sensors; controlling the data
processing unit to perform the determining of the behavioral pattern, the melanopic light quantity, the selected behavioral element and the outputting of the signal.
[0061] The method for operating a system for the measurement and analysis of melanopic light quantity may comprise any of the aforementioned examples of the system for the measurement and analysis of melanopic light quantity.
[0062] In another aspect, a computer program comprising machine executable instructions for execution by one or more processors controlling a system for the measurement and analysis of melanopic light quantity is disclosed. The system is comprising a wearable sensor device, comprising a sensor array, the sensor array comprising sensors, the sensors comprising a melanopic light sensor and at least one of a UV light sensor and an accelerometer, wherein the melanopic light sensor is adapted to capture light sensor data at multiple wavelengths within the visible and optionally near infrared light spectrum, wherein the UV light sensor is adapted to capture light sensor data at specified wavelengths within the UV light spectrum. The sensor device is comprising a data recording unit, wherein the data recording unit is adapted to store time-series sensor data of each of the sensors. The system further comprises a data processing unit configured to determine a behavioral pattern comprising analyzing the time-series sensor data of the melanopic light sensor and at least one of the UV light sensor and the accelerometer, the pattern comprising multiple behavioral elements, each element having assigned a respective melanopic light quantity as obtained from the sensor data of the melanopic light sensor for said element; determine a melanopic light quantity within a predefined time range of the sensor data of the melanopic light sensor; determine a selected behavioral element of the multiple behavioral elements which has assigned a respective one of the melanopic light quantities suitable to at least partially compensate for the difference between a desired value and the determined value of the melanopic light quantity; and output a signal comprising a behavioral recommendation based on the selected behavioral element. Execution of the machine executable instructions causes the system to: operate the wearable sensor device to capture sensor data of each of the sensors; control the data processing unit to perform the determining of the behavioral pattern, the melanopic light quantity, the selected behavioral element, and the outputting of the signal.
[0063] The program instructions comprised by the computer program may further be executable by the processor of the computer device to cause the computer device to execute any of the aforementioned examples of the system for the measurement and analysis of melanopic light quantity.
[0064] In another aspect, a data processing unit is disclosed, comprising a memory storing machine executable instructions. The execution of the instructions causes the data processing unit to receive time-series sensor data comprising time-series sensor data of a melanopic light sensor and at least one of an UV light sensor and an accelerometer. The sensor data of the melanopic light sensor comprises light sensor data of multiple wavelengths within the visible light spectrum. The sensor data of the UV light sensor comprises light sensor data of specified wavelengths within the UV light spectrum. The execution of the instructions further causes the data processing unit to determine a behavioral pattern comprising analyzing the time-series sensor data of the melanopic light sensor and at least one of the UV light sensor and the accelerometer. The pattern comprises multiple behavioral elements. Each element has a respective melanopic light quantity as obtained from the sensor data of the melanopic light sensor for said element assigned. The execution of the instructions further causes the data processing unit to determine a melanopic light quantity within a predefined time range of the sensor data of the melanopic light sensor. The execution of the instructions further causes the data processing unit to determine a selected behavioral element of the multiple behavioral elements which has assigned a respective one of the melanopic light quantities suitable to at least partially compensate for the difference between a desired value and the determined value of the melanopic light quantity. The execution of the instructions further causes the data processing unit to output a signal comprising a behavioral recommendation based on the selected behavioral element.
[0065] The program instructions comprised by the memory of the data processing unit may further be executable by the data processing unit to cause the data processing unit to execute any of the aforementioned examples of the system for the measurement and analysis of melanopic light quantity.
[0066] It is understood that one or more of the aforementioned embodiments may be combined as long as the combined embodiments are not mutually exclusive.
BRIEF DESCRIPTION OF THE DRAWINGS
[0067] In the following, examples are described in greater detail making reference to the drawings in which:
[0068] Figure 1 is a schematic of a system for the measurement and analysis of melanopic light quantity, comprising a wearable sensor device and a data processing unit.
[0069] Figure 2 is a flow chart aiming at the output of a behavioral recommendation.
[0070] Figure 3 is a schematic of an example use case of the system of e.g. figure 1.
[0071] Figure 4 is a schematic of a system for the measurement and analysis of melanopic light quantity, further comprising a user communication interface, a docking station and a weather forecast.
[0072] Figure 5 shows a method of operating a system for the measurement and analysis of melanopic light quantity.
[0073] Figure 6 displays a system equipped with computing and hardware interfaces for example for the measurement and analysis of melanopic light quantity.
[0074] Figure 7 shows a data processing unit comprising a memory storing machine executable instructions for the analysis of melanopic light quantity.
DETAILED DESCRIPTION
[0075] In the following, similar elements are denoted by the same reference numerals.
[0076] Figure 1 shows a system for the measurement and analysis of melanopic light quantity, comprising a wearable sensor device 100 and a data processing unit 112. The wearable sensor device 100 comprises of a sensor array 102 and the sensor array 102 comprises sensors, e.g., a melanopic light sensor 104 and at least one of a UV light sensor 106 and an accelerometer 108. Furthermore, it also includes a data recording unit 110, e.g., a flash memory.
[0077] The wearable sensor device 100 is communicatively coupled to a data processing unit 112, which comprises a memory storing machine executable instructions 114. The data processing unit 112 is controlled by a central processing unit 116. It further comprises an interface 118 that is adapted to output a signal comprising a behavioral recommendation 206. The system may optionally comprise a physical button 120, and/or a battery 122, and/or a mounting mechanism 124, and/or a neural network processing module 126, and/or a GNSS module 128. The physical button 120 and/or the neural network processing module 126 and/or the GNSS module 128 may be comprised in the data processing unit 112 or the sensor device 100.
[0078] The mounting mechanism may provide an easy and convenient way to wear the device during the day e.g., during office work or during sports, by mounting it on a spectacle frame, a headband, or a helmet.
[0079] Figure 4 is a schematic of a system for the measurement and analysis of melanopic light quantity, comprising the discussed features of figure 1 and further illustrating a user communication interface, a docking station and a weather forecast. Optionally, the data processing unit 112 may obtain a weather forecast 402, as depicted in figure 4. The weather forecast may be obtained by a wireless or a wired connection and may be obtained locally, e.g., from a local server, or remotely, e.g., from a remote server, e.g., from a server via the internet.
[0080] The weather forecast 402 may comprise a solar irradiance that may additionally account for atmospheric conditions. This is e.g., the Global Horizontal Irradiance (GHI), which may be defined as the total amount of shortwave radiation potentially received from above by a surface horizontal to the ground. This may include both direct sunlight and diffuse sunlight scattered by the atmosphere. It may have the unit W/m2. The Global Horizontal Irradiance may account for various weather and atmospheric conditions.
[0081] The Global Horizontal Irradiance values may vary significantly depending on atmospheric conditions, geographic location, and time of day. On a sunny day, GHI values could generally be higher and conversely, on a cloudy day, GHI values could potentially be lower.
[0082] The weather forecast 402 may be considered in the determination of the selected behavioral element of the multiple behavioral elements. For example, in case the atmospheric conditions are cloudy, and the weather forecast 402 forecasts a lower GHI, e.g., as compared to when no clouds are present, a behavioral element that takes place e.g., inside a building may be selected. For example, in case the atmospheric conditions are not cloudy and the atmospheric conditions may allow for the sunrays to directly reach the earth's surface, and the weather forecast 402 forecasts a higher GHI, e.g., as compared to when clouds are present, a behavioral element that takes place e.g., outside a building, i.e., a behavioral element that, for example, takes place directly on the earth's surface with no obstruction to the sky, may be selected.
[0083] For example, when the weather forecast 402 comprising e.g., the Global Horizontal Irradiance (GHI), may comprise values between 0- 2000 W/m2, especially 0 - 1000 W/m2. For example, on a sunny day, the Global Horizontal Irradiance may be in the range of 600 - 1000 W/m2. For example, on a cloudy day, the Global Horizontal Irradiance may be in the range of 0 - 300 W/m2.
[0084] For example, in figure 4, the data processing unit 112 is comprised by a docking station 404. The wearable sensor device 100 is configured to dock to the docking station 404 e.g., via a physical docking connector or a wireless connection. For example, the physical docking connector may be a USB-C connection or a proprietary wired connection. The proprietary wired connection may comprise magnets to hold the wearable sensor device 100 in place during docking to the data processing unit 112 (not shown in figure 4). The wireless connection may be e.g., a Bluetooth connection or a proprietary inductive data transfer connection.
[0085] For example, in figure 4, the system for the measurement and analysis of melanopic light quantity further comprises a user communication interface 406. The user communication interface 406 may be comprised by the wearable sensor device 100, the data processing unit 112 or both. In an example, the user communication interface 406 comprises means to display information, such as a display, and physical means to enter information, e.g., buttons. In another example, the user communication interface 406 comprises an a wired or a wireless connection interface and means to communicate with the system via an external device. In an example, the external device is e.g., a smartphone or a home computer.
[0086] The functionality of the modules is explained using the flow chart of figure 2. In the following it is assumed that data was acquired by the sensors of the array 102 and stored as timeseries sensor data. Time-series sensor data may be understood as the sensor data being stored in the data recording unit, tagged or associated with a respective time at which the data was captured or acquired.
[0087] In step 200, a behavioral pattern is determined by the data processing unit from the time-series data of the sensors. For example, the subject or the user of the device has certain habits, such as a riding a bike, going for a walk, or jogging outside of an enclosed space. The determination that these activities are performed outside of an enclosed space can be performed by the time-series data from the UV light sensor 108 and/or the GNSS module 128. The nature of these activities, for example the activity being a recreational activity or a sportive motion, can be determined by the time-series data from the accelerometer 108 and/or the GNSS module 128.
[0088] As an example for step 200, the data processing unit may recognize by the time-series data from the UV light sensor that the subject is outside of an enclosed space, and by the timeseries data from the accelerometer that the subject is moving faster than the speed of walking or jogging, but not as fast as the speed within a motorized vehicle. This determination may further be backed up by the time-series data from the GNSS module 128 by e.g., analyzing the track i.e.,
the route the subject has taken, or the speed at which the subject has been moving, supplementing the information from the accelerometer 108. The data processing unit may conclude that the subject is riding a bike (which assumption may further be supported by a movement pattern detected via the accelerometer 108 that is typical for riding a bike). During the activity, light sensor data of the melanopic light sensor is captured and stored associated with the data from the UV light sensor, accelerometer etc.
[0089] The light sensor data of the melanopic light sensor may then be quantified and associated with the detected activity and time and duration of activity, e.g. riding the bike. In an example, after the behavior "riding a bike" has been recorded at least three times, the mean of the received melanopic light quantity can be calculated and associated with the respective behavioral element as part of the subject's behavioral pattern.
[0090] Then, in step 202, the melanopic light quantity that a subject was subjected to within a predefined time range is determined by the data processing unit 112. The predefined time range may be e.g., a (most) recent time range being in between 6 hours and 72 hours, preferably in between 8 hours and 24 hours.
[0091] In step 204, the data processing unit 112 determines a single behavioral element that is included in the behavioral pattern of step 200 to optimize the melanopic light quantity received by the subject that was determined in step 204. As outlined in step 200, there may be multiple behavioral elements available that are routinely carried out by the subject which are all independently associated with a respective mean quantity of melanopic light which is expected to be received by the subject while carrying out the behavior indicated via that selected behavioral element. Some behavioral elements may be associated with high quantities of melanopic light while others may be associated with low quantities of melanopic light. In addition, the data processing unit may take the time of day into account, because the example "riding a bike" presented in step 200 may not be a viable option in the evening or at night when it is dark outside. In addition, the associated quantity of melanopic light to a behavioral pattern may also be dependent on the time of the day.
[0092] As an example for step 204, the data processing unit may have determined the behavioral pattern "riding a bike" during the daytime outside of an enclosed space in step 200. Furthermore, the data processing unit may have determined in step 202 that the subject has not yet received an adequate quantity of melanopic light in range between the morning and noon of the day (e.g. in the past 6 hours). Hence, it may determine the behavioral element "riding a bike"
as a suitable selection of the behavior to be offered to the subject, as it may have health-related benefits for the subject to be exposed to higher quantities of melanopic light during the afternoon.
[0093] In step 206, the single determined behavioral element of step 204 is output via the interface 118. In an example, the interface 118 may be a small display that is integrated into the unit, or, in the case the data processing unit is an external device such as a smartphone, the recommendation can be a notification on such device.
[0094] Optional steps include the adjustment of the sensitivity of either of the UV light and melanopic light sensor in step 208. To optimally determine the melanopic light quantity in step 202, a frequent adjustment of the sensor's sensitivity may be necessary. In general, the sensor could be operated in a range that leads to usable photometric readings under current illumination conditions, if these illumination conditions change in the usual way. One possibility would be to maintain the sensitivity of the respective sensors in such a range that the respective photometric readings are within the first 10%-20% of the maximal photometric reading of the respective sensor. The sensitivity could be adjusted in a regular way, e.g., at each sensor data capture.
[0095] Another optional step would be to forecast the expected melanopic light quantity in step 210. In that way, by forecasting a melanopic light quantity value that the user will be subjected to during a predefined next time span (future time period), this may help supporting the decision which behavioral element is selected in step 204 or for how long it should be recommended in step 206. In the present example discussed above, in case the forecast results in a probability over 80% that the subject will expose himself/herself within the next 6 hours to sufficient sunlight according his/her usual behavior, outputting the recommendation of "riding a bike now" can be omitted.
[0096] Optional step 212 may further assist in improving the quality of the determination of selected behavioral elements by taking into account physiological factors of the subject, such as age, skin tone, gender, or eye color. Depending on the physiological factors, the desired (optimal) value of the amount of melanopic light may vary, as certain characteristics may require either higher or lower amounts of melanopic light.
[0097] A possible purpose of the physical button 120 could be to accurately signal rest periods of the subject wearing the sensor device 100. When the subject is resting and the system is programmed to interpret a lack of movement of the sensor device for a period of time as the
sensor device being discarded, resting phases, such as at noon when the subject is exposed to natural light, may not be taken into account with respect to the subject's exposure to sunlight during the resting phase. By providing the button 120, the subject could indicate the beginning and the end of the resting period, thus ensuring that the subject's exposure to sunlight during the resting period is correctly considered (recorded) for the evaluation of the determined value of the melanopic light quantity.
[0098] Figure 3 is a schematic of an example situation for the usage of the wearable sensor device 100. A user 302, also referred to as a subject, wearing and using the wearable sensor device 100 is located inside the enclosed space of a building 300 and thus, the UV light sensor 106 of the sensor array 102 is not capturing the UV light rays from the sun 308. Furthermore, the user 302 is working with and looking at a bright illuminated screen 304.
[0099] The data processing unit 112 of the device is then executing the steps as outlined in figure 2. In step 202, the data processing unit determines the melanopic light quantity that the subject was exposed to within a defined time period in e.g. the past 6 hours. In order to optimize the melanopic light quantity to which the subject should have been exposed during that time, a respective behavioral element is selected in step 204. One behavioral element of the behavioral pattern as determined in step 200 comprises being outside of the enclosed space 300 and use the bike while being subjected to natural sunlight from the sun 308. This activity (behavioral element) is associated with a representative mean melanopic light quantity as described above.
[0100] The determined selected behavioral element of step 204 is then offered as a recommendation to the subject using a respective signal via the interface 118 in step 206. In the present example, the output may be the recommendation of the behavioral element "bike riding" as a message.
[0101] Examples for behavioral elements of the pattern are elements such as "going for a walk", "turning off artificial light sources", "turning on artificial light sources", "being in front of the screen", and "jogging", from which the data processing unit may have selected "bike riding" as the most suitable one for the example situation at an example time of the day. The example recommendation may aim at exposing the user to higher melanopic light quantities during the daytime than he or she would receive while being inside of an enclosed space, aiming at having health-related effects such as better sleep and physiological melatonin production.
[0102] Further shown in figure 3 is a light bulb 310 which may be controlled by the signal provided in step 206. For example, the light bulb 310 may be part of a home automation system.
The system (e.g. the data processing unit 112) may send the signal to the home automation system or directly to the light bulb commanding the light bulb to switch color temperature, light intensity, turn on or off etc. This may assist the subject in compensating for the difference between the desired value and the determined value of the melanopic light quantity e.g. in case the suggested behavioral recommendation based on the selected behavioral element is not sufficient to compensate for said difference.
[0103] Figure 5 shows a method of operating a system for the measurement and analysis of melanopic light quantity. The wearable sensor device 100 is operated 502 to capture sensor data of each of the sensors. The data processing unit 112 is controlled 504 to perform the determining of the behavioral pattern, the melanopic light quantity, the selected behavioral element and the outputting of the signal.
[0104] Figure 6 displays a system 600 equipped with computing and hardware interfaces for example for the measurement and analysis of melanopic light quantity. The system 600 is intended to represent one or more computing units, which may be distributed. The system 600 is shown to comprise a computing system 604. The computing system 604 is intended to represent one or more computing systems. The system 600 is further shown to include an optional hardware interface 606. The hardware interface may enable the system 600 to send and receive data from external components. The system 600 is further shown to be in communication with an optional user interface 608. The system 600 may also comprise, for example, a display device. This could include, for example, a two-dimensional computer display, a touch screen, a virtual reality system, and an augmented reality system.
[0105] The system 600 is further shown to be in communication with a memory 610. The memory 610 is intended to represent various types of memory that the computing system 604 may have access to. In one example, the memory 610 is a non-volatile storage medium.
[0106] The memory 610 is configured to contain machine-executable instructions 620. The machine-executable instructions 620 may enable the computing system 604 to perform various numerical and computational tasks. The machine-executable instructions 620 may also enable the computing system 604 to send and receive data from external components via the hardware interface 606. The machine-executable instructions 620 comprise program instructions 630 to operate the wearable sensor device 100 to capture sensor data of each of the sensors. The machine-executable instructions 620 further comprise program instructions 632 to control the
data processing unit 112 to perform the determining of the behavioral pattern, the melanopic light quantity, the selected behavioral element and the outputting of the signal.
[0107] Figure 7 shows a data processing unit 702 comprising a memory storing machine executable instructions 114 for the analysis of melanopic light quantity. The data processing unit 702 may be similar to the data processing unit 112. The data processing unit 702 may have further means to receive time-series sensor data 704 from an external device, such as e.g., an external device comprising sensors. The external device may e.g. be a smartwatch, a smartphone, a wearable, a smart glass, a fitness tracker, a sport and/or action camera, a wearable health device, a smart home device, an automotive dash cam, a gaming controller, a gaming glass, a virtual reality headset, an environmental monitoring device, a smart luggage.
[0108] While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive; the invention is not limited to the disclosed embodiments.
[0109] As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a apparatus, method, computer program or computer program product.
Accordingly, aspects of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, microcode, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a "circuit," "module" or "system." Furthermore, aspects of the present invention may take the form of a computer program product embodied in one or more computer readable medium(s) having computer executable code embodied thereon. A computer program comprises the computer executable code"or "program instruct"ons".
[0110] Any combination of one or more computer readable medium(s) may be utilized. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A 'computer-readable storage medium' as used herein encompasses any tangible storage medium which may store instructions which are executable by a processor of a computing device. The computer-readable storage medium may be referred to as a computer- readable non-transitory storage medium. The computer-readable storage medium may also be referred to as a tangible computer readable medium. In some embodiments, a computer- readable storage medium may also be able to store data which is able to be accessed by the processor of the computing device. Examples of computer-readable storage media include, but are not limited to: a floppy disk, a magnetic hard disk drive, a solid state hard disk, flash memory,
a USB thumb drive, Random Access Memory (RAM), Read Only Memory (ROM), an optical disk, a magneto-optical disk, and the register file of the processor. Examples of optical disks include Compact Disks (CD) and Digital Versatile Disks (DVD), for example CD-ROM, CD-RW, CD-R, DVD- ROM, DVD-RW, or DVD-R disks. The term computer readable-storage medium also refers to various types of recording media capable of being accessed by the computer device via a network or communication link. For example a data may be retrieved over a modem, over the internet, or over a local area network. Computer executable code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
[0111] A computer readable signal medium may include a propagated data signal with computer executable code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including, but not limited to, electromagnetic, optical, or any suitable combination thereof. A computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
[0112] 'Computer memory' or 'memory' is an example of a computer-readable storage medium. Computer memory is any memory which is directly accessible to a processor. 'Computer storage' or 'storage' is a further example of a computer-readable storage medium. Computer storage is any non-volatile computer-readable storage medium. In some embodiments computer storage may also be computer memory or vice versa.
[0113] A 'processor' as used herein encompasses an electronic component which is able to execute a program or machine executable instruction or computer executable code. References to the computing device comprising "a processor" should be interpreted as possibly containing more than one processor or processing core. The processor may for instance be a multi-core processor. A processor may also refer to a collection of processors within a single computer system or distributed amongst multiple computer systems. The term computing device should also be interpreted to possibly refer to a collection or network of computing devices each comprising a processor or processors. The computer executable code may be executed by multiple processors that may be within the same computing device or which may even be distributed across multiple computing devices.
1
[0114] Computer executable code may comprise machine executable instructions or a program which causes a processor to perform an aspect of the present invention. Computer executable code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as "h" "C" programming language or similar programming languages and compiled into machine executable instructions. In some instances the computer executable code may be in the form of a high level language or in a pre-compiled form and be used in conjunction with an interpreter which generates the machine executable instructions on the fly.
[0115] The computer executable code may execute entirely on the 'ser's computer (e.g. data processing unit), partly on the 'ser's computer, as a stand-alone software package, partly on the 'ser's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the 'ser's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
[0116] Generally, the program instructions can be executed on one processor or on several processors. In the case of multiple processors, they can be distributed over several different entities like in the present case the sensor device and the data proceesing unit. Each processor could execute a portion of the instructions intended for that entity. Thus, when referring to a system or process involving multiple entities, the computer program or program instructions are understood to be adapted to be executed by a processor associated or related to the respective entity.
[0117] Aspects of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block or a portion of the blocks of the flowchart, illustrations, and/or block diagrams, can be implemented by computer program instructions in form of computer executable code when applicable. It is further under stood that, when not mutually exclusive, combinations of blocks in different flowcharts, illustrations, and/or block diagrams may be combined. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data
processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
[0118] These computer program instructions may also be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
[0119] The computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
REFERENCE SIGNS LIST
100 wearable sensor device
102 sensor array
104 melanopic light sensor
106 UV light sensor
108 accelerometer
110 data recording unit
112 data processing unit
114 memory storing machine executable instructions
116 central processing unit
118 interface
120 button
122 battery
124 mounting mechanism
126 neural network processing module
200 determine a behavioral pattern
202 determine a melanopic light quantity
204 determine a selected behavioral element
206 output a behavioral recommendation
300 enclosed space
302 user/subject
304 screen
306 bike
308 sun with natural sunlight
310 light bulb
Claims
1. A system for the measurement and analysis of melanopic light quantity, comprising: a wearable sensor device (100), comprising o a sensor array (102), the sensor array (102) comprising sensors, the sensors comprising a melanopic light sensor (104) and at least one of a UV light sensor (106) and an accelerometer (108), wherein the melanopic light sensor (104) is adapted to capture light sensor data at multiple wavelengths within the visible light spectrum, wherein the UV light sensor is adapted to capture light sensor data at specified wavelengths within the UV light spectrum; and o a data recording unit (110), wherein the data recording unit (110) is adapted to store time-series sensor data of each of the sensors; a data processing unit (112) comprising a memory storing machine executable instructions, wherein the execution of the instructions causes the data processing unit to o determine a behavioral pattern comprising analyzing the time-series sensor data of the melanopic light sensor and at least one of the UV light sensor and the accelerometer, the pattern comprising multiple behavioral elements, each element having assigned a respective melanopic light quantity as obtained from the sensor data of the melanopic light sensor for said element; o determine a melanopic light quantity within a predefined time range of the sensor data of the melanopic light sensor; o determine a selected behavioral element of the multiple behavioral elements which has assigned a respective one of the melanopic light quantities suitable to at least partially compensate for the difference between a desired value and the determined value of the melanopic light quantity; and o output a signal comprising a behavioral recommendation based on the selected behavioral element.
2. The system of claim 1, wherein the system is configured to communicate wirelessly via Bluetooth low energy with a host computer, wherein the host computer comprises the data processing unit of claim 1.
3. The system of any of the previous claims, wherein the system comprises a global navigation satellite system, GNSS, sensor, wherein the GNSS sensor is configured to provide as time series sensor data location data to the data processing unit, wherein the execution of the instructions causes the data processing unit to further use the location data for determining the behavioral pattern, wherein optionally the sensors of the sensor array (102) comprise the GNSS sensor.
4. The system of any of the previous claims, wherein the execution of the instructions causes the data processing unit to forecast an expected melanopic light quantity to be sensed by the melanopic light sensor within a predetermined future time period, the determining of the selected behavioral element further taking into account the expected melanopic light quantity as a compensation for the difference between the desired value and the determined value of the melanopic light quantity, the forecasting being e.g. based on the time-series sensor data, the forecasting preferably comprising modeling the time-series sensor data using an autoregressive- moving-average model.
5. The system of claim 4, wherein the system is communicatively coupled with a house automation system, wherein the system is adapted to send a command to the house automation system to switch light, the expected melanopic light quantity resulting from the switching of the light in the predetermined future time period, the signal further comprising the command.
6. The system of any of the previous claims, wherein the sensitivity of the melanopic light sensor and/or the UV light sensor is adjustable, wherein the sensor device is adapted to adjust the sensor sensitivity such that a photometric reading of the sensor is obtained within a predefined range, wherein optionally the adjusting of the sensor sensitivity is comprising an adjustment of the exposure time of the sensor.
7. The system of any of the previous claims, the determining of the selected behavioral element being specific for a user of the sensor device, the data processing unit further comprising an interface for receiving physiological factors of the user, wherein the execution of the instructions causes the data processing unit to
determine the desired value of the melanopic light quantity taking into account the physiological factors.
8. The system of any of the previous claims, the behavioral elements differentiating between at least anyone of o activity types comprising indoor and outdoor activity based on the light sensor data of the melanopic light sensor having been captured indoor or outdoor, the differentiating being performed using the light sensor data of the UV light sensor; o activity locations of a user of the wearable sensor device (100) based on the location data; o sportive motion activities of a user of the wearable sensor device (100) based on the sensor data from the accelerometer.
9. The system of any of the previous claims, the system further being configured to determine whether the sensor device has been discarded by a user based on the sensor data from the accelerometer, wherein the light sensor data is disregarded for the determining of the behavioral pattern in case a determined likelihood of the sensor device being discarded is above a predetermined threshold.
10. The system of any of the previous claims 3-12, the system further being configured to determine whether the sensor device has been moved by a user using a motorized transportation system based on the location data from the GNSS sensor, wherein the light sensor data is disregarded for the determining of the behavioral pattern in case a determined likelihood of the sensor device being moved by the user using a motorized transportation system is above a predetermined threshold.
11. The system of any of the previous claims, further comprising a physical button adapted for indicating a predefined behavioral element upon being pushed, the determining of the behavioral pattern further comprising analyzing the pushing of the physical button, the indicated predefined behavioral element upon being pushed preferably indicating the beginning or end of a resting phase of a user of the wearable sensor device (100).
12. The system of any of the previous claims, wherein the wearable sensor device (100) comprises a mounting mechanism, wherein the mounting mechanism is adapted for mounting of the wearable sensor device (100) on a helmet, a headband or on spectacle frames of a user of the sensor device.
13. The system of any of the previous claims, o the melanopic light sensor comprising at least 12, preferably in between 16 and 20 light channels operating at different respective wavelengths, and/or o the UV light sensor comprising in between 1 and 4, preferably 2 light channels operating at different respective wavelengths.
14. The system of any of the previous claims, the data processing unit further comprising at least one neural network processing module configured to provide the melanopic light quantity in response to receiving the melanopic light sensor data.
15. The system of any of the previous claims, wherein the determination of the selected behavioral element of the multiple behavioral elements further considers a weather forecast (402).
16. The system of claim 15, wherein the memory of the data processing unit (112) further comprises machine executable instructions which, upon execution, cause the data processing unit (112) to obtain the weather forecast (402).
17. The system of any of the previous claims, wherein the data processing unit (112) is comprised by a docking station (404), wherein the wearable sensor device (100) is configured to dock to the docking station (404).
18. The system of any of the previous claims, further comprising a user communication interface (406), wherein the user communication interface (406) comprises means for receiving a user communication from a user, wherein the determination of the selected behavioral element comprises any one of:
-in case the user communication comprises a planned future behavior of the user regarding a deselection of a behavioral element of the multiple behavioral elements, removing from the multiple behavioral elements the element comprising the planned future behavior; or
-in case the user communication comprises a planned future behavior of the user
regarding a planned user activity corresponding to a certain melanopic light quantity, decreasing the difference between the desired value and the determined value of the melanopic light quantity by the certain melanopic light quantity; or
-in case the user communication comprises an altered user light sensitivity, altering the difference between the desired value and the determined value of the melanopic light quantity to compensate for the altered user light sensitivity.
19. The system of any of the previous claims, wherein the determination of the selected behavioral elements comprises the determination of at least one selected behavioral element, wherein in case the at least one selected behavioral element it not suitable to fully compensate for the difference between the desired value and the determined value of the melanopic light quantity, the signal comprises a warning notification.
20. A method of operating a system for the measurement and analysis of melanopic light quantity, the system comprising a wearable sensor device (100), comprising o a sensor array (102), the sensor array (102) comprising sensors, the sensors comprising a melanopic light sensor and at least one of a UV light sensor and an accelerometer, wherein the melanopic light sensor is adapted to capture light sensor data at multiple wavelengths within the visible light spectrum, wherein the UV light sensor is adapted to capture light sensor data at specified wavelengths within the UV light spectrum; and o a data recording unit, wherein the data recording unit is adapted to store time-series sensor data of each of the sensors; a data processing unit (112) configured to o determine a behavioral pattern comprising analyzing the time-series sensor data of the melanopic light sensor and at least one of the UV light sensor and the accelerometer, the pattern comprising multiple behavioral elements, each element having assigned a respective melanopic light quantity as obtained from the sensor data of the melanopic light sensor for said element;
o determine a melanopic light quantity within a predefined time range of the sensor data of the melanopic light sensor; o determine a selected behavioral element of the multiple behavioral elements which has assigned a respective one of the melanopic light quantities suitable to at least partially compensate for the difference between a desired value and the determined value of the melanopic light quantity; and o output a signal comprising a behavioral recommendation based on the selected behavioral element, the method comprising: o operating the wearable sensor device (100) to capture sensor data of each of the sensors; o controlling the data processing unit (112) to perform the determining of the behavioral pattern, the melanopic light quantity, the selected behavioral element and the outputting of the signal.
21. A computer program comprising machine executable instructions for execution by one or more processors controlling a system for the measurement and analysis of melanopic light quantity, the system comprising a wearable sensor device (100), comprising o a sensor array (102), the sensor array (102) comprising sensors, the sensors comprising a melanopic light sensor and at least one of a UV light sensor and an accelerometer, wherein the melanopic light sensor is adapted to capture light sensor data at multiple wavelengths within the visible light spectrum, wherein the UV light sensor is adapted to capture light sensor data at specified wavelengths within the UV light spectrum; and o a data recording unit, wherein the data recording unit is adapted to store time-series sensor data of each of the sensors; a data processing unit (112) configured to
o determine a behavioral pattern comprising analyzing the time-series sensor data of the melanopic light sensor and at least one of the UV light sensor and the accelerometer, the pattern comprising multiple behavioral elements, each element having assigned a respective melanopic light quantity as obtained from the sensor data of the melanopic light sensor for said element; o determine a melanopic light quantity within a predefined time range of the sensor data of the melanopic light sensor; o determine a selected behavioral element of the multiple behavioral elements which has assigned a respective one of the melanopic light quantities suitable to at least partially compensate for the difference between a desired value and the determined value of the melanopic light quantity; and o output a signal comprising a behavioral recommendation based on the selected behavioral element, wherein execution of the machine executable instructions causes the system to: o operate the wearable sensor device (100) to capture sensor data of each of the sensors; o control the data processing unit (112) to perform the determining of the behavioral pattern, the melanopic light quantity, the selected behavioral element and the outputting of the signal.
22. A data processing unit (702) comprising a memory storing machine executable instructions, wherein the execution of the instructions causes the data processing unit to: o receive time-series sensor data comprising time-series sensor data of a melanopic light sensor and at least one of an UV light sensor and an accelerometer, wherein the sensor data of the melanopic light sensor comprises light sensor data of multiple wavelengths within the visible light spectrum, wherein the sensor data of the UV light sensor comprises light sensor data of specified wavelengths within the UV light spectrum;
determine a behavioral pattern comprising analyzing the time-series sensor data of the melanopic light sensor and at least one of the UV light sensor and the accelerometer, the pattern comprising multiple behavioral elements, each element having assigned a respective melanopic light quantity as obtained from the sensor data of the melanopic light sensor for said element; determine a melanopic light quantity within a predefined time range of the sensor data of the melanopic light sensor; determine a selected behavioral element of the multiple behavioral elements which has assigned a respective one of the melanopic light quantities suitable to at least partially compensate for the difference between a desired value and the determined value of the melanopic light quantity; and output a signal comprising a behavioral recommendation based on the selected behavioral element.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP23159999.4A EP4425126A1 (en) | 2023-03-03 | 2023-03-03 | System, method and computer program for the measurement and analysis of melanopic light quantity |
| PCT/EP2024/055339 WO2024184217A1 (en) | 2023-03-03 | 2024-03-01 | System, method and computer program for the measurement and analysis of melanopic light quantity |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4677316A1 true EP4677316A1 (en) | 2026-01-14 |
Family
ID=85462471
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP23159999.4A Withdrawn EP4425126A1 (en) | 2023-03-03 | 2023-03-03 | System, method and computer program for the measurement and analysis of melanopic light quantity |
| EP24707560.9A Pending EP4677316A1 (en) | 2023-03-03 | 2024-03-01 | System, method and computer program for the measurement and analysis of melanopic light quantity |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP23159999.4A Withdrawn EP4425126A1 (en) | 2023-03-03 | 2023-03-03 | System, method and computer program for the measurement and analysis of melanopic light quantity |
Country Status (3)
| Country | Link |
|---|---|
| EP (2) | EP4425126A1 (en) |
| KR (1) | KR20250155607A (en) |
| WO (1) | WO2024184217A1 (en) |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105637332A (en) * | 2013-07-11 | 2016-06-01 | 古德卢克斯科技有限责任公司 | Integrated optical power supply optical monitoring system |
| WO2017037250A1 (en) * | 2015-09-02 | 2017-03-09 | Institut National De La Santé Et De La Recherche Médicale (Inserm) | Wearable health and lifestyle device |
| US11860031B2 (en) | 2019-07-03 | 2024-01-02 | Northwestern University | Miniaturized, light-adaptive, wireless dosimeter systems for autonomous monitoring of electromagnetic radiation exposure and applications of same |
| CN114830637A (en) * | 2019-12-18 | 2022-07-29 | 科鲁斯股份有限公司 | Gaze-based display illumination systems and methods |
-
2023
- 2023-03-03 EP EP23159999.4A patent/EP4425126A1/en not_active Withdrawn
-
2024
- 2024-03-01 WO PCT/EP2024/055339 patent/WO2024184217A1/en not_active Ceased
- 2024-03-01 EP EP24707560.9A patent/EP4677316A1/en active Pending
- 2024-03-01 KR KR1020257032897A patent/KR20250155607A/en active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| EP4425126A1 (en) | 2024-09-04 |
| WO2024184217A1 (en) | 2024-09-12 |
| KR20250155607A (en) | 2025-10-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI752142B (en) | Display systems, electronic machines and lighting systems | |
| CN104427715B (en) | Communication terminal control method, lighting control system and lighting equipment | |
| EP2829161B1 (en) | Improved light control system | |
| CN108024703A (en) | Automatic glasses measure and specify specification | |
| JP7260133B2 (en) | Biorhythm adjustment device, biorhythm adjustment system, and biorhythm adjustment device | |
| US20150212575A1 (en) | Apparatus and method for performing output control according to environment in electronic device | |
| KR102354105B1 (en) | System for smart sleep mood lamp and control method thereof | |
| JP2017531288A (en) | How to determine the right lighting for your activity | |
| CN117653866A (en) | A method and system for monitoring light and sleep and improving sleep and circadian rhythm | |
| EP3626030B1 (en) | Lighting system that maintains melanopic lux levels at the eye regardless of distance to user | |
| WO2016184852A1 (en) | Lamp for sunshine simulation | |
| KR200487934Y1 (en) | Wearable illumination activity recording apparatus | |
| KR20220028321A (en) | Artificial window lighting system in windowless space and control method thereof | |
| EP4425126A1 (en) | System, method and computer program for the measurement and analysis of melanopic light quantity | |
| KR102809652B1 (en) | Heating control system through prediction of user's sleep time based on big data analysis using smartphone | |
| KR20170141003A (en) | LED Control System using Mobile terminal | |
| KR20210003391A (en) | Circadian rhythm maintaining lighting control apparatus and method thereof | |
| KR102344515B1 (en) | Natural light reproduction lighting system by control of indoor light environment and natural light reproduction lighting control method thereof | |
| KR20170100520A (en) | Method of controlling an active filtering device | |
| EP3826432A1 (en) | Headlamp with an ai unit | |
| CN208273108U (en) | A video camera with adjustable brightness | |
| CN114600559B (en) | Adjust the light source from a grow light setting to an operator light setting based on the determined area of interest | |
| KR20230104032A (en) | Method and system for biorhythm improvement | |
| CN119749390B (en) | Vehicle-mounted automatic expansion shelter | |
| CN119889197B (en) | Methods, devices, storage media, and electronic devices for adjusting the brightness of display panels. |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20251006 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC ME MK MT NL NO PL PT RO RS SE SI SK SM TR |