EP3257333B1 - A lighting system controller - Google Patents

A lighting system controller Download PDF

Info

Publication number
EP3257333B1
EP3257333B1 EP16701004.0A EP16701004A EP3257333B1 EP 3257333 B1 EP3257333 B1 EP 3257333B1 EP 16701004 A EP16701004 A EP 16701004A EP 3257333 B1 EP3257333 B1 EP 3257333B1
Authority
EP
European Patent Office
Prior art keywords
task
lighting system
status
sensor
system controller
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP16701004.0A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP3257333A1 (en
Inventor
Jonathan David Mason
Dzmitry Viktorovich Aliakseyeu
Sanae CHRAIBI
Remco MAGIELSE
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Signify Holding BV
Original Assignee
Signify Holding BV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Signify Holding BV filed Critical Signify Holding BV
Publication of EP3257333A1 publication Critical patent/EP3257333A1/en
Application granted granted Critical
Publication of EP3257333B1 publication Critical patent/EP3257333B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
    • H05B47/10—Controlling the light source
    • H05B47/175—Controlling the light source by remote control
    • H05B47/19—Controlling the light source by remote control via wireless transmission
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
    • H05B47/10—Controlling the light source
    • H05B47/175—Controlling the light source by remote control
    • H05B47/19—Controlling the light source by remote control via wireless transmission
    • H05B47/195—Controlling the light source by remote control via wireless transmission the transmission using visible or infrared light

Definitions

  • the present disclosure relates to a lighting system controller and method for controlling a luminaire within a lighting system based on a user's performance of a task.
  • the invention relates to a lighting system controller according to claim 1 and a method for controlling a luminaire within a lighting system according to claim 9. Further aspects of the invention are covered by the dependent claims.
  • Modern luminaires incorporate not only the components necessary to drive the luminous element (e.g. a LED string), but are also capable of integrating significant additional functionality, e.g. including network connectivity.
  • a lighting system controller can receive a lighting input such as from a physical switch or a software defined switch such as implemented as a user interface element in a lighting application. The lighting system controller can then generate suitable control signals based on the lighting input. These control signals then being transmitted over the network to a lighting system luminaire.
  • Lights implemented as indicator or panel lights have been used previously to indicate a condition of a device, and whether a device is being used correctly.
  • US patent application publication number US 2008/0141478 describes a toothbrush with LED lights arranged in a lighted segment configuration which can be sequentially illuminated to indicate a recommended brushing sequence.
  • This sequence can be represented by a sequence of brushing rules and
  • a further publication US 2014/358285 discloses a lighting system with task monitoring.
  • the modern world is governed by rules and tasks such as these. These rules and tasks can be as simple as the rules for brushing teeth. Other tasks or rules require professional tuition and many hours of practice and repetition to learn. However by learning such tasks they assist users in collating pieces of information and reduce the user's cognitive load. For example for a user in an unfamiliar vehicle the tasks or rules associated with driving the vehicle may distract the driver from fully paying attention to the environment in which the vehicle is being driven.
  • the tasks may include starting a vehicle (does the vehicle require the gearbox to be placed in neutral or the clutch engaged before starting the engine), selecting or changing gear (does the clutch need to be engaged before selecting a 'new' gear, does the gearbox require double declutching), and moving off (does the vehicle require the handbrake to be released before fully engaging the drive/disengaging the clutch, does the vehicle have an electronic or automatic handbrake).
  • routines may comprise sets or lists of tasks which need to be performed with little margin for error. Often such routines require checklists or database systems to log the state of tasks so that users can keep track of their progress.
  • An example of such routines can be the operation of machinery in safety critical environments such as control rooms.
  • the frequency of the performance of tasks or routines may furthermore vary. Those tasks being performed very frequently may be learnt quickly because of their very frequent use. However those tasks which are required and performed less frequently are thus more often forgotten or missed.
  • the following provides a technique for providing a controllable lighting system suitable for assisting a user to perform and/or remember tasks by providing suitable light-based feedback via a controllable luminaire. It is based on the principle of using a lighting system controller within a controllable lighting system to help define a routine, sequence or list of tasks with respect to a network of sensor generated signals received at the lighting controller.
  • the lighting system controller can be configured to activate or release control signals for a certain light scene only once a certain sequence of tasks have been observed.
  • the light scene may be generated when the tasks are completed in a particular sequence or order or the light scene may be generated when the tasks are completed in any order.
  • a lighting system controller configured to control at least one controllable luminaire, the lighting system controller comprising: a task definer configured to define at least one task to be performed; a status determiner configured to determine a status of the at least one task based on sensor data received from at least one device physically separated from the lighting system controller; and a control signal controller configured to output at least one lighting system signal to the at least one controllable luminaire based on the status determiner.
  • the lighting system controller further comprises a control signal generator configured to generate the at least one lighting system signal based on (or: according to) a received lighting system signal input, and wherein the control signal controller may be configured to output the at least one lighting system signal to the at least one controllable luminaire based on (or: under the condition of) the status determiner indicating that the at least one task has been completed.
  • the task definer may be further configured to define a task order for the at least one task to be performed, and the control signal controller is configured to output the at least one lighting system signal to the at least one controllable luminaire based on (or: under the condition of) the status determiner indicating that the at least one task has been performed in the defined order.
  • the lighting system controller may further comprise a wireless receiver configured to receive the sensor data from the at least one device physically separated from the lighting system controller.
  • the lighting system controller may further comprise a wireless transmitter configured to transmit the at least one lighting system signal to the at least one controllable luminaire.
  • the task definer may be configured to receive the at least one task to be performed from a physically separate device.
  • the lighting system controller may further comprise a task recorder configured to: analyses the sensor data received from the at least one device physically separated from the lighting system controller to determine a pattern of sensor data associated with at least one task; and determine a definition for the at least one task comprising the determined pattern of sensor data associated with the at least one task.
  • a task recorder configured to: analyses the sensor data received from the at least one device physically separated from the lighting system controller to determine a pattern of sensor data associated with at least one task; and determine a definition for the at least one task comprising the determined pattern of sensor data associated with the at least one task.
  • the lighting system controller may further comprise a task analyzer configured to analyses status output data from the task status determiner and determine a performance analysis of the at least one task.
  • a lighting system may comprise: the lighting system controller as described herein; the at least one controllable luminaire in communication with the lighting system controller; and at least one device in communication with the lighting system controller, the at least one device comprising at least one sensor for generating the sensor data.
  • a computer program product comprising code embodied on one or more computer-readable storage media and/or being downloadable therefrom, and being configured so as when run on a lighting system controller to perform operations of: define at least one task to be performed; determine a status of the at least one task based on sensor data received from at least one device physically separated from the lighting system controller; receive a lighting system signal input; generate at least one lighting system signal based on (or: according to) the received lighting system signal input, and control, based on (or: under the condition of) the determined status indicating that the at least one task has been completed, the output of the at least one lighting system signal associated with the at least one task to the at least one controllable luminaire.
  • a method of controlling a controllable luminaire comprising: defining at least one task to be performed; determining a status of the at least one task based on sensor data received from at least one device physically separated from the lighting system controller; receiving a lighting system signal input; generating at least one lighting system signal based on (or: according to) the received lighting system signal input, and controlling, based on (or: under the condition of) the determined status indicating that the at least one task has been completed, the output of the at least one lighting system signal associated with the at least one task to the at least one controllable luminaire.
  • the method may further comprise: receiving a lighting system signal input; generating the at least one lighting system signal based on the lighting system signal input; and wherein controlling the output the at least one lighting system signal to the at least one controllable luminaire may comprise controlling the output of the at least one lighting system signal to the at least one controllable luminaire based on the status indicating that the at least one task has been completed.
  • the method may further comprise receiving the sensor data from the at least one device physically separated from the lighting system controller.
  • the method may further comprise transmitting the at least one lighting effect control signal to the at least one controllable luminaire.
  • This invention uses the lighting to help a user perform or remember a routine, sequence, or list of tasks. This can be implemented so that once a certain sequence of events has occurred only then the defined or certain light scene (that is not available otherwise) is activated.
  • the lighting system controller 11 suitable for monitoring tasks and controlling a lighting system based on the monitoring of the tasks is shown.
  • the lighting system controller 11 is shown comprising a processor or CPU 13, a memory 15, a user interface 17 and a transceiver 19.
  • the lighting system controller 11 is shown as being wirelessly coupled to the lighting system 41 and furthermore wirelessly coupled to at least one task monitoring sensor 21, at least one monitoring system, and at least one network 41.
  • the processor 13 can in some embodiments be configured to execute various program codes.
  • the implemented program codes in some embodiments comprise task monitoring, and lighting system control code as described herein.
  • the implemented program codes can in some embodiments be stored for example in the memory 15 for retrieval by the processor 13 whenever needed.
  • the memory 15 could further provide a section for storing data, for example sensor or lighting system control signal data in accordance with the application as described herein.
  • the task defining, task monitoring, and lighting system controlling code in embodiments can be implemented at least partially in hardware and/or firmware.
  • the user interface (UI) 17 enables a user to input commands to the lighting system controller 11, for example via a keypad, and/or to obtain information from the lighting system controller 11, for example via a display.
  • a touch screen may provide both input and output functions for the user interface.
  • the lighting system controller 11 in some embodiments comprises a transceiver (TX/RX) 19 suitable for enabling communication with other apparatus, for example via a wireless communication network.
  • the transceiver 19 can communicate with other apparatus by any suitable known communications protocol, for example in some embodiments the transceiver 19 or transceiver means can use a suitable universal mobile telecommunications system (UMTS) protocol, a wireless local area network (WLAN) protocol such as for example IEEE 802.X, a suitable short-range radio frequency communication protocol such as Bluetooth, ZigBee or infrared data communication pathway (IRDA).
  • UMTS universal mobile telecommunications system
  • WLAN wireless local area network
  • IRDA infrared data communication pathway
  • the lighting system 41 can be any suitable controllable lighting system.
  • the lighting system 41 comprises a number of controllable luminaires 43 1 and 43 n .
  • the luminaires may be implemented using any suitable controllable light generating technology.
  • each of the luminaires may for example comprise a controller configured to receive a control signal from the lighting system controller 11 and implement the control signal to produce a desired lighting effect or scene.
  • each luminaire 43 can be individually addressed and controlled.
  • each luminaire comprises different and individually controllable color light sources and therefore controllable to produce a desired color lighting effect or scene.
  • the lighting system controller 11 is shown in Figure 1 as being wirelessly coupled to a sensor 21. It is understood that the lighting system controller 11 may in some embodiments be coupled to more than one sensor 21 or device operating as a sensor.
  • the sensor 21 may in some embodiments be physically separate or separable from the lighting system controller 11.
  • the sensor 21 or device in some embodiments comprises at least one sensor entity or array of sensors 23.
  • the sensor 21 or device may comprise a transceiver 29 (or transmitter where only one way communication is required) configured to transmit the output of the sensor entity of array of sensors 23, in the form of sensor data, to the lighting system controller 11.
  • the senor 21 or device is shown as a device comprising a single sensor, in some embodiments the sensor 21 may comprise or employ a system of sensors.
  • the sensor 21 may represent sensor entities implemented within the lighting system 41.
  • the sensor 21 and the sensor entity or array of sensors 23 may be any suitable sensor type and/or technology for determining the state of a user or an object interacted with by the user within the sensor range.
  • the sensor entity 23 may be a home device monitoring system determining a home device is active or not. For example whether the lights in an area are switched on or off, whether the oven is switched on or off, the heating fire is on or off, the Television is on or off.
  • the sensor 21 may furthermore be implemented within one of the devices being monitored.
  • the lighting system controller 11 may further be coupled to a smart device or computing device 31.
  • the smart device or computing device 31 may wirelessly be in communication with the lighting system controller 11.
  • the smart device 31 in some embodiments may comprise a processor (or CPU) 33, a memory 35, a user interface 37, and a transceiver (or transmitter) 39.
  • the processor 33 can in some embodiments be configured to execute various program codes.
  • the implemented program codes in some embodiments comprise task generation and analysis output code as described herein.
  • the implemented program codes can in some embodiments be stored for example in the memory 35 for retrieval by the processor 33 whenever needed.
  • the memory 35 could further provide a section for storing data, for example sensor or lighting system control signal data in accordance with the application as described herein.
  • the user interface (UI) 37 enables a user to input commands to the smart device 31, for example via a keypad, and/or to obtain information from the smart device 31, for example via a display.
  • a touch screen may provide both input and output functions for the user interface.
  • the smart device in some embodiments comprises a transceiver (TX/RX) 39 suitable for enabling communication with other apparatus, for example via a wireless communication network.
  • the transceiver 39 can communicate with other apparatus by any suitable known communications protocol, for example in some embodiments the transceiver 39 or transceiver means can use a suitable universal mobile telecommunications system (UMTS) protocol, a wireless local area network (WLAN) protocol such as for example IEEE 802.X, a suitable short-range radio frequency communication protocol such as Bluetooth, ZigBee or infrared data communication pathway (IRDA).
  • UMTS universal mobile telecommunications system
  • WLAN wireless local area network
  • IRDA infrared data communication pathway
  • the smart device 31 in some embodiments, comprises or may function as a sensor device.
  • the smart device 31 may be worn or be held by the user being monitored and function in a manner to provide the user's positional and other movement information. For example whether the user is sitting, standing or lying down.
  • the smart device 31 can be configured to assist the defining of the list of tasks being monitored or receive information as whether there are any outstanding tasks and whether there is a 'next' task to be performed.
  • the smart device 31 may be configured to store task definitions (which may or may not be linked to the smart device 31 or the user of the smart device) and supply these task definitions to the lighting system controller 11.
  • the smart device 31 furthermore can be used to provide a suitable lighting system input. In other words to provide to the lighting system controller the indication of the desired lighting output.
  • the smart device 31 may implement a lighting control application and be configured to indicate to the lighting controller a desired light scene to be displayed.
  • the lighting system controller may furthermore be connected or coupled to other devices and/or networks, such as shown in Figure 1 by the communication with the network (Internet) 51. These other devices/networks may provide further information needed to monitor the performance of the tasks.
  • the lighting system controller comprises a task definer 101.
  • the task definer 101 may in some embodiments be configured to receive a task input or task inputs.
  • the task input may for example be used to indicate that a task is to be recorded, captured or defined.
  • the task input may in some embodiments may be an input for triggering the transfer of task definitions or similar to the task status determiner 103.
  • the task input may be a time based trigger input to start an 'end of shift' sequence of tasks to be transferred to the task status determiner 103.
  • the task input may be a user input to start the monitoring of the sequence of tasks to be performed.
  • the definitions within the task list may be associated with a particular person or user of the system.
  • the task list may be associated with a child in a family or a particular employee and their role.
  • the identity of the user may be found or determined either directly where a personal device associated with the user is used, or in case of shared devices then identification may be determined based on proximity between a personal device such as a wearable device and the shared device.
  • the task definitions and therefore the task list is dependent on the location of the user.
  • the definitions and the task lists may need to be transferable to other locations such as when the young family is on holiday or visiting grandparents.
  • the lighting system controller may be configured to enable an auto-search for smart devices that can be tracked.
  • the task definer 101 may be configured to define or associate at least one task with a control function of the lighting system.
  • the association defined by the task definer 101 can in some embodiments be passed to the task status determiner 103.
  • the lighting system controller comprises a task status determiner 103.
  • the task status determiner 103 can be configured to receive the defined task or task list from the task definer 101 and furthermore be configured to receive sensor data or other data from external sources.
  • the sensor data may in some embodiments be from a connected system as a sensor network in a home may also contribute to the identification of tasks and their possible completion or not.
  • the sensor information may be from sensors such as camera vision, presence sensors, magnetic door/window sensors, and so forth.
  • the sensor data may further comprise processed sensor data.
  • data may be received from camera vision analysis or audio processing.
  • Other data may furthermore comprise data from the internet or smart device based inputs.
  • the data may be positional information (geo-fencing), location data, telephone call data (calls made), calendar or agenda items, program or application information (apps opened or closed).
  • the task status determiner 103 can in some embodiments be configured to compare the sensor data and/or other data against the definitions provided by the task definer 101 to determine the current status of the tasks.
  • the task status determiner 103 can thus be configured to determine whether the tasks have been carried out.
  • the task status determiner 103 can be configured to determine whether the tasks have been carried out in the correct order. The determination of the status of the task may for example be performed by comparing the sensor data input against known or recorded sensor data associated with the task.
  • the task status determiner 103 can then be configured to output the determined status to a lighting system signal controller 107 or lighting system signal generator 105.
  • the lighting system controller 11 may comprise a lighting system signal generator 105.
  • the lighting system signal generator 105 can be configured to receive a suitable lighting system signal input.
  • the lighting system signal input can, for example, be a signal from a physical switch transmitted wirelessly (or otherwise) to the lighting system controller.
  • the lighting system signal input may however be a software defined switch or control input generated by a smart device or other suitable computing device (and performing or running a suitable lighting application) and transmitting the input to the lighting system controller 11.
  • the lighting system signal generator 105 may be configured to determine or generate suitable lighting signals or lighting control signals for outputting to the lighting system 41.
  • the lighting signals may be signals configured to generate the suitable lighting effect desired by the user when operating the switch or software defined switch or control and when the task is completed.
  • lighting signals which are generated may be signals configured to generate a warning lighting effect when the switch is operated and when the task has not been completed.
  • the lighting signal may in some embodiments be retrieved from memory on the lighting system controller 11 or received from a further apparatus.
  • the lighting system signal generator 105 may be configured to receive the current status or operation status from the task status determiner 103 and use this information in order to generate the lighting system signals. For example using the 'close office' example the lighting system signal generator 105 having received a light off switch signal from the lighting system signal input and having received the current task status of 'alarm armed' but 'window x open' may be configured to generate a lighting effect signal which would switch all of the lights apart from the one nearest the open window.
  • the lighting system signal generator 105 may further be configured to output this signal to a suitable lighting system signal controller 107.
  • the lighting system controller 11 in some embodiments comprises a lighting system signal controller 107.
  • the lighting system signal controller 107 may be configured to receive the output of the lighting system signal generator 105 and the task status determiner 103.
  • the lighting system signal controller 107 may further be configured to output the lighting system signal to the lighting system based on the output of the task status determiner 103.
  • the lighting system signal controller 107 can be configured to output the lighting system signal enabling the lighting system to produce the desired lighting effect.
  • the lighting system signal controller 107 can be configured to output the lighting system signal enabling the lighting system to produce a 'not-complete' or 'error' effect.
  • the lighting system controller 11 may further comprise a learning module 109.
  • the learning module 109 may be configured to receive sensor data and/or other data and a task input (or task sequence definition value) and learn or produce a defined learnt task or sequence of tasks whereby a task identifier is associated with the sensor data/other data. The learning module may then be configured to pass the learnt task associations to the task definer 101 such that when the task is recalled at a future time that the task status determiner 103 may have sensor and/or other data to test against in order to determine whether the task has been completed.
  • the learning module 109 may also be used to automatically 'optimize' or 'update' existing activities. Thus for example whenever there are detected changes in the task sequence the learning module is configured to change the definitions automatically and without explicit user triggered updates.
  • the lighting system controller 11 may comprise a task analyzer 111.
  • the task analyzer 111 may be configured to receive the output from the task status determiner 103 and compare the output of the status determiner against known patterns of behavior to determine whether there has been a change in behavior for the tasks and/or generate and output a report based on the analysis of the task.
  • the task analyzer 111 may be configured to determine whether a task within a sequence of tasks is being performed accurately and generate a report.
  • the report for example may be stored, for example as a log of the tasks performed which may be retrieved at a later time.
  • the report may furthermore be transmitted or forwarded to a manager or other supervisor to determine whether the tasks have been completed and whether the performance of the tasks has been acceptable.
  • FIG. 3 shows an overview of the lighting system control method based on task monitoring according to some embodiments.
  • the lighting system control method may furthermore in some embodiments be implemented within the functional components shown in Figure 2 .
  • the lighting system controller, and the task definer/task learner may be configured to retrieve or generate a definition for at least one task to be monitored.
  • the at least one task in some embodiments comprises a list of tasks.
  • the list of tasks may be an unordered list of tasks. In such embodiments the tasks are defined as being completed when performed in any order.
  • the list of tasks may furthermore be an ordered or partly ordered list of tasks. In other words the tasks (or a sub-group of the tasks) are defined as only being completed when performed in a defined order.
  • the operation of defining at least one task further comprises associating or allocating at least one sensor signal and/or at least one device signal and/or at least one other signal to the task. This allocation operation may be performed to enable the task status determiner to determine whether the at least one task has been performed.
  • the operation of defining at least one task further comprises associating at least one lighting system output to the task and furthermore the status of the at least one task. For example in some embodiments a first lighting system output, switching all of the lights out, is associated with the at least one task having been performed, and a further lighting system output, flashing or pulsing the lights, is associated with the at least one task not having been performed.
  • step 201 The operation of generating or retrieving the definition of the task is shown in Figure 3 by step 201.
  • the operation of defining the task may be considered to be part of a learning or pre-monitoring process performed by the lighting system controller.
  • the lighting system controller, and the task status determiner may then be configured to receive sensor and/or other data and the task definitions. This data in some embodiments can be conditioned or processed to produce data which is more easily processed by the status determiner.
  • step 203 The operation of receiving the sensor and/or other data is shown in Figure 3 by step 203.
  • the lighting system controller, and the task status determiner may furthermore be configured to determine the task status or status associated with a list of tasks based on the sensor and/or other data.
  • the determination may be performed by comparing the sensor and/or other data against stored or predetermined sensor/other data associated with the task such that when the received sensor data matches the predefined sensor data indicating that the task is completed then the task is determined to have been completed.
  • step 205 The operation of determining the status of the task based on the sensor and/or other data is shown in Figure 3 by step 205.
  • the control lighting system can be configured to control the lighting system signal output based on the determined status.
  • the lighting system controller and the lighting system signal generator 105 may be configured to generate a 'success' lighting system control signal and a 'error' lighting system control signal based on receiving a lighting system input for a desired lighting effect to be generated.
  • the lighting system signal controller 107 may be configured to determine whether the task is completed and output the 'success' lighting system control signal on the task having been completed and output the 'error' lighting system control signal on the task not having been completed or only partially completed.
  • step 207 The operation of controlling the lighting system signal output based on the status is shown in Figure 3 by step 207.
  • the operation can then loop back such that further sensor and/or other data is received and therefore the tasks are monitored continuously.
  • the operation steps 203, 205 and 207 in other words the operations of receiving the sensor and/or other data, determining the status of the task based on the sensor/other data, and controlling the lighting system signal output based on the status may be grouped together in an action or monitoring operation shown in Figure 3 by label 253.
  • the at least one lighting control signal is generated based on a lighting system signal input.
  • a lighting system signal input For example a user attempting to turn off lights when closing the office for the day may activate the 'light toggle switch' (or a timer or received time signal at the specific office closing time) causes the lighting system signal generator to generate an 'off' light control signal as a 'success' lighting control signal and a 'flashing' light control signal as an 'error' lighting control signal.
  • These control signals are passed to the lighting system signal controller and passed to the lighting system based on the determination of the status of a 'closing office' sequence of tasks.
  • the activation of the 'light toggle switch' may furthermore cause the task definer to define the 'closing office' tasks which are passed to the task status determiner and monitored.
  • 'closing office' tasks may be defined by the tasks of 'close windows' and 'arm security alarm' tasks.
  • the lighting system signal generator functionality may be implemented within the task definer.
  • the task definer receives an input such as a light switch, light control input, software defined light switch or control input, or other input for indicating at least one task and associated lighting system control signals based on the status of the task.
  • the task definer then based on the input may define the tasks required to be monitored and furthermore the lighting system control signals associated with possible states of the tasks.
  • the task status determiner may then determine the current status of each task and generate an output for controlling the lighting system signal controller which receives the lighting system control signals.
  • Figure 4 shows a flow diagram of an example method for generating a task definition for the lighting system control method as shown in Figure 3 in further detail.
  • the lighting system controller may receive or determine a define/record task indicator.
  • the define/record task indicator in some embodiments may be in the form of the task input passed to the task definer and information to further associate the status of the task with at least one specific lighting effect.
  • step 301 The operation of defining the task (or recording the task) is shown in Figure 4 by step 301.
  • sensor data associated with the task is received.
  • this sensor data is 'simulated data'.
  • the sensor data may be simulated window magnetic proximity sensor data or the expected output from the security system.
  • the sensor data is the actual sensor data as the task is performed. For example the output from the window sensors or the security system as someone is closing the windows in the office.
  • step 303 The operation of receiving the sensor data (as the task is being performed) is shown in Figure 4 by step 303.
  • this 'real-time' sensor data may be passed to the learning module 109 which is configured to associate the sensor data with the task.
  • the task is defined by the association between the task indicator and the sensor data.
  • the task definitions may be retrieved and any received sensor data compared against the definition sensor data to determine the status of the tasks being performed.
  • Figure 5 shows a flow diagram of the lighting system control method as shown in Figure 3 in further detail according to some embodiments.
  • the lighting system controller can in some embodiments receive the lighting system signal input.
  • the lighting system signal input can as described herein be an input such as a light switch, light control input, software defined light switch or control input, or other input for indicating at least one task (and associated lighting system control signals based on the status of the task).
  • the lighting system signal input may furthermore identify a task or sequence of tasks to be monitored.
  • step 401 The operation of receiving the lighting system input is shown in Figure 5 by step 401.
  • the lighting system controller may then retrieve the definitions associated with the tasks identified by the lighting system signal input.
  • the lighting system controller may, and for example the lighting system signal generator, then generate any lighting system control signals based on the received lighting system input.
  • a user attempting to turn off lights when closing the office for the day may activate the 'light toggle switch' (or a timer or received time signal at the specific office closing time) which causes the task definer to retrieve the definitions associated with a 'close office' sequence of tasks.
  • These definitions may be associated with 'close windows' and 'arm security alarm' tasks and be further defined based on window sensor signals (for the 'close windows' task) and security alarm system signals (for the 'arm security alarm' task)
  • the lighting system signal generator may generate an 'off' light control signal as a 'success' lighting control signal and a 'flashing' light control signal as an 'error' lighting control signal.
  • These control signals are passed to the lighting system signal controller and passed to the lighting system based on the determination of the status of a 'closing office' sequence of tasks.
  • the status of the tasks can then be checked. This can for example be from the output of the task status determiner which compares the task definitions against the received sensor/other data. Thus for example when the window sensors indicate that all of the windows are closed then the status of the task 'close windows' can be determined as complete. Similarly the security alarm can provide an indication that the alarm has been armed to enable the status of the task 'arm alarm' to be determined as being complete.
  • the operation can loop back on to itself. For example the operation may loop back to retrieving the task definitions and generating the lighting system control signals and perform a further check status operation.
  • the lighting system controller may be configured to output a defined lighting effect based on the status being not OK.
  • the 'flashing' light control signal may be output as an 'error' lighting control signal.
  • the lighting effect in some embodiments may assist the user of the lighting system in identifying the 'error' or the incomplete task.
  • the lighting system controller is configured to generate and output a lighting effect flashing a defined number of times indicating the missing or out of order task, or changing the lighting effect color to a defined color, or activating a lighting effect positional light.
  • the luminaires closest to an open or unlocked window can be flashed to indicate any windows still open.
  • the lighting system controller can be configured to output the generated lighting system control signal.
  • the lighting system signal controller may output the 'off' light control signal when the 'close office' task has been completed.
  • step 407 The operation of outputting the lighting system control signal based on the status being OK is shown in Figure 5 by step 407.
  • the embodiments described herein may be applied to 'home' or 'residential' applications.
  • the embodiments may be applied to monitor the 'bed-time' tasks for a child.
  • 'Andy' is getting ready for bed. He knows that he has to complete a few tasks before his bedtime story. He starts with cleaning his teeth which he likes doing as the toothpaste tastes good! Next he washes his hands and face and runs into his bedroom ready for his story. He reaches out and turns the light switch but nothing happens - a gentle flicker is all he gets. Hmmm, what did he forget to do?
  • the tasks may be defined as 'cleaning teeth', 'bedtime wash' and 'clean room - clothes in basket'.
  • a further example may be assisted-care residences. For example in two weeks Jenny will celebrate her 85th birthday and she is looking forward to seeing her family for a dinner at the weekend. She enjoys living independently however, over the past few years she has been getting a little more forgetful. To help her, her family installed a helpful reminder system. After lunch for example, a couple of the lights in her lounge are configured to turn blue to signify that she has a task still to complete. She is then triggered to try and remember what she needed to still do. consulting her list, she may have seen that she had not taken her after lunch medication. Once taken the lights could then return to their original setting. In such an example any control input prior to completing the task would not change the lights from being blue.
  • Such embodiments may be implemented in retail environments. For example Simon runs a small shop and for much of the time it is only him or his assistant managing the store. Since he now has a young family he wants to spend more time with them rather than being at the store all the time and so he trains and trusts his assistant to close up at the end of the day. This requires a particular set of tasks to be completed, but on a few occasions he notices that some tasks have not been completed. To help out, a lighting reminder system is activated. Now, at the end of the day, when the assistant is leaving and attempts to turn off the main lights, if nothing happens or they just flash a color and went back to white when flicking the switch he knows he has forgotten to do something. consulting the light sequence task list on their phone it can point out what has been over looked. Once attended to, the lights can then turn off.
  • the advantage of using light is that it is highly visible. Whether the switch reacted to a command or not is noticeable as the brain is expecting an event to occur (i.e. change in light level) and should this not occur it will be a noticeable break in a pattern causing people to stop and think.
  • the examples described herein feature a lighting control system which links to a lighting system associated with a particular location.
  • the lighting system may be within a vehicle.
  • a delivery driver may have a special light system in his vehicle that can only be turned off when all the parcels in the back of the vehicle have been delivered or processed for the location he is at, thus preventing him forgetting to deliver any and drive off.
  • the task list may be one defined with prioritization of tasks (delivery items) based on the contents of the vehicle and its location.
  • the output of the task status determiner may be analyzed.
  • Figure 6 a flow diagram of a task analysis method for the lighting system control method is shown according to some embodiments.
  • the status associated with the task being performed may be received by the task analyzer 111.
  • step 501 The operation of receiving the status output is shown in Figure 6 by step 501.
  • the status output can then be analyzed to determine whether there is a pattern of behavior or whether the pattern of behavior has changed since the last time the task or sequence of tasks have been performed. This can for example indicate whether the task or tasks have been completed, the order of completion of the tasks within a sequence of tasks, the speed of completion of the task or tasks, the accuracy of the completion of the task or tasks, whether the sequence of tasks were missed or not performed according to defined parameters.
  • the determination of a pattern of behavior or change in pattern of behavior can lead to the generation of a report of the behavior or change of behavior.
  • the task analyzer 111 may be configured to generate a message (for example a short message service (sms) or automated email) and send the message to a user's or designated manager mobile device when it is determined that the task has now been performed accurately or efficiently.
  • a message for example a short message service (sms) or automated email
  • the task analyzer 111 may be configured to determine whether a task within a sequence of tasks is being performed accurately and generate a report.
  • the report for example may be stored, for example as a log of the tasks performed which may be retrieved at a later time.
  • the report may furthermore be transmitted or forwarded to a manager or other supervisor to determine whether the tasks have been completed and whether the performance of the tasks has been acceptable.
  • the task analyzer 111 may be a real-time analysis of the task status (such as generating sms or email messages in real time to provide a further indication when the task has been correctly or incorrectly performed).
  • the task analyzer 111 may be a data analysis tool suitable for analyzing past performance and for task optimization or evaluation purposes (such as the generation of task behavior reports).
  • the lighting system controller may be able to provide suggestions to optimize the pattern of performance. This may for example be performed as part of a time and motion study where time is of the essence. Furthermore as discussed herein the report may identify deviations from the pattern of performance of task. This may be useful in health related contexts as this might identify for example forgetfulness or a decrease in health of the user.
  • Figure 7 shows a flow diagram of a further lighting system control method which differs from the embodiments shown with respect to Figure 5 in that a break condition operation is inserted in between the operations of generating the lighting system control signal and checking the status of the task.
  • the break condition is configured to break the loop of the checking of the status of tasks.
  • the break condition can for example be a time-out or an override or other suitable interrupt.
  • the break condition operation is shown in Figure 7 by the introduction of operation 601 between the operations 403 and 405 with the loop of 405 passing back to the operation 601 rather than the start of operation 405 as shown in Figure 5 .
  • the break condition operation may be an override function which requires user identification and so prevents a complete lock out of all functionality.
  • this override function may be included as there are times when users need the light for other reasons and it may be dangerous to keep the lock on indefinitely until all the tasks have been completed.
  • the override function may have a clear user interaction element so that the user confirms the override and the non-completion of the tasks or a message is sent to others informing them that the task list has not been completed (for example by the generation of a suitable report as described herein).

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Circuit Arrangement For Electric Light Sources In General (AREA)
EP16701004.0A 2015-02-11 2016-01-19 A lighting system controller Active EP3257333B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP15154688 2015-02-11
PCT/EP2016/050998 WO2016128183A1 (en) 2015-02-11 2016-01-19 A lighting system controller.

Publications (2)

Publication Number Publication Date
EP3257333A1 EP3257333A1 (en) 2017-12-20
EP3257333B1 true EP3257333B1 (en) 2020-09-02

Family

ID=52462868

Family Applications (1)

Application Number Title Priority Date Filing Date
EP16701004.0A Active EP3257333B1 (en) 2015-02-11 2016-01-19 A lighting system controller

Country Status (5)

Country Link
US (1) US10285249B2 (zh)
EP (1) EP3257333B1 (zh)
JP (1) JP6746597B2 (zh)
CN (1) CN107211518B (zh)
WO (1) WO2016128183A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4192198A1 (en) 2021-12-01 2023-06-07 BIOT Sp. z o.o. Lighting fixture controller and method for fixture managing

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018095876A1 (en) * 2016-11-25 2018-05-31 Philips Lighting Holding B.V. Lighting control
US11761618B2 (en) * 2019-03-22 2023-09-19 Eaton Intelligent Power Limited Light diagnostics and monitoring using wearables

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140358285A1 (en) * 2013-05-28 2014-12-04 Abl Ip Holding Llc Distributed building control system

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3140911B2 (ja) * 1994-06-22 2001-03-05 東京瓦斯株式会社 人間活動監視補助装置
US6153858A (en) 1999-06-23 2000-11-28 Maytag Corporation Automatic lighting control system for a cooking cavity
JP2006169855A (ja) * 2004-12-17 2006-06-29 Tostem Corp ドア装置
US7480534B2 (en) * 2005-05-17 2009-01-20 The Watt Stopper Computer assisted lighting control system
JP4931190B2 (ja) * 2006-05-31 2012-05-16 Ｔｏｔｏ株式会社 衛生洗浄装置
US8137109B2 (en) 2006-12-13 2012-03-20 Colgate-Palmolive Company Interactive oral care implement system
WO2010063001A1 (en) * 2008-11-26 2010-06-03 Wireless Environment, Llc Wireless lighting devices and applications
US8415897B2 (en) * 2010-07-09 2013-04-09 Daintree Networks, Pty. Ltd. Ambient and task level load control
US20120215328A1 (en) 2011-02-23 2012-08-23 Richard Schmelzer Physical activity monitoring and recording system and device
US8890435B2 (en) * 2011-03-11 2014-11-18 Ilumi Solutions, Inc. Wireless lighting control system
JP2013101779A (ja) * 2011-11-07 2013-05-23 Toshiba Lighting & Technology Corp 照明制御システム
JP5853691B2 (ja) * 2011-12-28 2016-02-09 アイシン・エィ・ダブリュ株式会社 車両用制御装置および方法
US9060409B2 (en) * 2012-02-13 2015-06-16 Lumenetix, Inc. Mobile device application for remotely controlling an LED-based lamp
US10064255B2 (en) * 2012-05-24 2018-08-28 Philips Lighting Holding B.V. Lighting system, particularly for delirium reduction in intensive care units
US20140023363A1 (en) 2012-07-17 2014-01-23 The Procter & Gamble Company Systems and methods for networking consumer devices
WO2014097022A1 (en) * 2012-12-19 2014-06-26 Koninklijke Philips N.V. Dental cleaning implement for detecting plaque and calculus
US9265112B2 (en) * 2013-03-13 2016-02-16 Federal Law Enforcement Development Services, Inc. LED light control and management system
US8928232B2 (en) * 2013-05-28 2015-01-06 Abl Ip Holding Llc Lighting network with autonomous commissioning
CN204014189U (zh) * 2013-07-19 2014-12-10 松下电器产业株式会社 照明系统
US20150033138A1 (en) 2013-07-29 2015-01-29 Monica Manchanda Phone Number Based Task Assignment, Task Tracking And Tasks Management System
US20150040005A1 (en) 2013-07-30 2015-02-05 Google Inc. Mobile computing device configured to output haptic indication of task progress
US10454783B2 (en) * 2014-02-05 2019-10-22 Apple Inc. Accessory management system using environment model
WO2015113003A1 (en) * 2014-01-25 2015-07-30 Innosys, Inc. Solid state lighting systems
EP2919562B1 (en) * 2014-03-11 2019-08-28 Helvar Oy Ab A learning luminaire and a learning control device for a luminaire
US9307621B1 (en) * 2014-12-08 2016-04-05 Cisco Technology, Inc. Networked lighting management
US9699858B2 (en) * 2014-12-08 2017-07-04 Cisco Technology, Inc. Network controlled multi-color lighting services

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140358285A1 (en) * 2013-05-28 2014-12-04 Abl Ip Holding Llc Distributed building control system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4192198A1 (en) 2021-12-01 2023-06-07 BIOT Sp. z o.o. Lighting fixture controller and method for fixture managing

Also Published As

Publication number Publication date
JP6746597B2 (ja) 2020-08-26
US20180242432A1 (en) 2018-08-23
US10285249B2 (en) 2019-05-07
CN107211518B (zh) 2019-12-31
EP3257333A1 (en) 2017-12-20
WO2016128183A1 (en) 2016-08-18
JP2018505536A (ja) 2018-02-22
CN107211518A (zh) 2017-09-26

Similar Documents

Publication Publication Date Title
US10354351B2 (en) Portable system for managing events
US10223878B2 (en) Automatic illuminating user interface device
WO2016155109A1 (zh) 环境控制系统
US20170098354A1 (en) System and method to protect users via light fixture networks
EP3257333B1 (en) A lighting system controller
EP3113070B1 (en) Method and system for optical user recognition
WO2016109138A1 (en) Systems and methods of arming and disarming a home security system
US10770177B2 (en) Dispatch management platform for nurse call system
US11102029B1 (en) Integration of knob sensors in monitoring systems
KR101842963B1 (ko) 사용자-로봇 상호작용을 위한 시스템 및 정보 처리 방법
Ibarra et al. Temporal reasoning for intuitive specification of context-awareness
CN114402268A (zh) 取决于隐私模式呈现设备的当前状态
CN109245987B (zh) 万物协作社交方法
US20210088993A1 (en) Context driven automation
EP2905927A1 (en) Regional control system with manual override
US20220351840A1 (en) Mitigating open space health risk factors
WO2023219649A1 (en) Context-based user interface
CN117897678A (zh) 多设备手势控制
WO2024077010A1 (en) Customizable user interface for a device management system
Nesheim et al. A smarter home, the smarter choice?
McNellis et al. Wearable Internet of Things Badge Device
Daniels et al. Robotic Game Playing Internet of Things Device
Von Dehsen Providing a Camera Stream on an Ancillary Display
VARDHARAJAN Proof-of-concept of a fall detection system based on low-cost IoT devices
McNaull et al. A Context and Situational aware Multi-Agent system for Ambient Assisted Living assistance and support

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20170911

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20180605

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: PHILIPS LIGHTING HOLDING B.V.

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SIGNIFY HOLDING B.V.

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20200103

GRAJ Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602016043125

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: H05B0037020000

Ipc: H05B0047190000

GRAJ Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR1

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTC Intention to grant announced (deleted)
RIC1 Information provided on ipc code assigned before grant

Ipc: H05B 47/19 20200101AFI20200219BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

GRAC Information related to communication of intention to grant a patent modified

Free format text: ORIGINAL CODE: EPIDOSCIGR1

INTG Intention to grant announced

Effective date: 20200327

INTG Intention to grant announced

Effective date: 20200402

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1310373

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200915

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602016043125

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200902

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200902

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200902

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201202

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201203

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201202

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200902

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20200902

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1310373

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200902

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200902

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200902

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200902

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200902

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200902

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210104

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200902

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200902

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200902

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200902

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200902

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210102

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602016043125

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200902

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20210603

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200902

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200902

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200902

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210119

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20210131

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200902

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210131

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210131

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210119

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210131

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230124

Year of fee payment: 8

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230425

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200923

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200902

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20160119

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200902

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240328

Year of fee payment: 9

Ref country code: GB

Payment date: 20240123

Year of fee payment: 9