WO2023274700A1

WO2023274700A1 - A controller for controlling a plurality of lighting devices based on media content and a method thereof

Info

Publication number: WO2023274700A1
Application number: PCT/EP2022/065990
Authority: WO
Inventors: Dzmitry Viktorovich Aliakseyeu; Tobias BORRA
Original assignee: Signify Holding B.V.
Priority date: 2021-06-29
Filing date: 2022-06-13
Publication date: 2023-01-05

Abstract

A method of controlling a plurality of lighting devices based on media content rendered on a media rendering device is disclosed. The method comprises: obtaining a light script associated with the media content, analyzing the media content to generate light settings based on the media content, controlling, while the media content is being rendered on the media rendering device, a first subset of lighting devices of the plurality of lighting devices according to the light script, and controlling, while the media content is being rendered on the media rendering device, a second subset of lighting devices of the plurality of lighting devices according to the generated light settings.

Description

A CONTROLLER FOR CONTROLLING A PLURALITY OF LIGHTING DEVICES BASED ON MEDIA CONTENT AND A METHOD THEREOF

FIELD OF THE INVENTION

The invention relates to a method of controlling a plurality of lighting devices based on media content rendered on a media rendering device, and to a computer program for executig the method. The invention further relates to a controller, a lighting system and a media rendering device for controlling a plurality of lighting devices based on media content.

BACKGROUND

Home entertainment lighting systems have proven to add a great deal to the experience of games, movies and music. For example, the use of light effects that match with and support media content can significantly enhance the media content. Such light effects are typically specified in a predefined light script. Depending on the number of lighting devices in a user’s entertainment lighting system, the light settings defined in the script may be scaled up (or scaled down) to match the number of lighting devices. The lighting devices are then controlled accordingly. However, this may not always have the desired result because each lighting system is different.

US 20190069375 A1 discloses a system comprising multimedia interface of a receiver that obtains multimedia con-tent that includes video data, audio data and embedded lighting information. A re-ceiver includes a processor to generate lighting commands for each of a number of luminaires based on the embedded lighting information from the multimedia content. A network interface of the receiver sends respective lighting commands to each of the luminaires, so that operations of controllable light sources of the luminaires are based on the received respective lighting commands.

SUMMARY OF THE INVENTION

The inventors have realized that mapping a light script onto a lighting system may not always have the desired effect. This may be due to the odd placement of lighting devices, the types of lighting devices, the number of lighting devices, etc. in a user’s entertainment lighting system. It is therefore an object of the present invention to provide a method and a controller for controlling lighting devices based on media content that can be used for different lighting system configurations.

According to a first aspect of the present invention, the object is achieved by a method of controlling a plurality of lighting devices based on media content rendered on a media rendering device, the method comprising: obtaining a light script associated with the media content, analyzing the media content to generate light settings based on the media content, controlling, while the media content is being rendered on the media rendering device, a first subset of lighting devices of the plurality of lighting devices according to the light script, and, simultaneously, controlling, while the media content is being rendered on the media rendering device, a second subset of lighting devices of the plurality of lighting devices according to the generated light settings.

By controlling the first subset of lighting devices according to the light script (which is associated with and based on the media content) and controlling the second subset of lighting devices according to the generated light settings (which are generated based on the media content), a coherent lighting experience is provided. Furthermore, any entertainment lighting system can be controlled based on the media content. The first subset of lighting devices may, for example, controlled to provide an initial (basic) light effect (which may be sufficiently interesting/entertaining for an observing user). The second subset of lighting devices may be controlled to provide an additional light effect. The additional light effects may depend on the number of lighting devices present in the lighting system. If, for example, a lighting system comprises a higher number of lighting devices, the additional effects may be more prominent compared to when a lighting system comprises a lower number of lighting devices. Controlling the first subset of lighting devices according to the light script and controlling the second subset of lighting devices according to the light settings generated based on the media content is beneficial because it enables control of different lighting system configurations.

The method may further comprise: obtaining position information indicative of positions of the plurality of lighting devices relative to the media rendering device and/or a user, assigning lighting devices to the first subset and the second subset based on the positions of the lighting devices relative to the media rendering device and/or the user. The first subset and the second subset may thus be determined based on the locations of the lighting devices relative to the media rendering device and/or the user.

Lighting devices of the plurality of lighting devices located closer to the media rendering device and/or the user may be assigned to the first subset, and lighting devices of the plurality of lighting devices located further away from the media rendering device and/or the user may be assigned to the second subset. Assigning lighting devices that are closer to the media rendering device (e.g. a display, a tv, a smartphone, a speaker, a headset, etc.) to the first subset of lighting devices such that they are controlled based on the light script is beneficial, because then (basic) light effects created based on the script are provided at prominent locations (e.g. at the display, at the speaker). Assigning lighting devices that are closer to a user (located in the environment where the lighting devices are located) to the first subset of lighting devices such that they are controlled based on the light script is beneficial, because (basic) light effects created based on the script are more prominently present for a user compared to light effects that are created based on the analyzed media content. The user and the media rendering device may be located at substantially the same location, for instance when the media rendering device is a wearable or a portable media rendering device.

The position information may be indicative of positions of the plurality of lighting devices relative to user, and the method may further comprise: obtaining information indicative of a field of view of the user, and determining which of the plurality of lighting devices are located inside the field of view of the user, determining which of the plurality of lighting devices are located outside the field of view of the user, wherein lighting devices located inside the field of view of the user are assigned to the first subset, and wherein lighting devices located outside the field of view of the user are assigned to the second subset. This is beneficial, because (basic) light effects created based on the script are more prominently present in the user’s field of view compared to light effects that are created based on the analyzed media content.

The light script may define light settings for a predefined number of lighting devices. The method may further comprise: assigning a number of lighting devices to the first subset based on the predefined number of lighting devices. The number of lighting devices assigned to the first subset of lighting devices may, for example, be at least equal to the predefined number of lighting devices. The number of lighting devices assigned to the first subset of lighting devices may, for example, be equal to the predefined number of lighting devices.

The method may comprise: comparing scripted light settings of the light script with the generated light settings, determining a level of difference between the scripted light settings and the generated light settings, and if the level of difference exceeds a threshold: adjusting the generated light settings to reduce the level of difference and controlling the second subset of lighting devices according to the adjusted generated light settings, or controlling the second subset of lighting devices according to the scripted light settings. If the generated light settings differ too much from the scripted light settings, the generated light settings may be adjusted, or the second subset of lighting devices may be controlled according to the scripted light settings. This is beneficial because coherent light effects are provided in the environment. The threshold may be defined in the script, may be defined by a user, may be based on the media content, etc.

The method may further comprise: determining if the light script is unavailable for a portion of the media content, and if the script is light unavailable for the portion of the media content, controlling the first subset of lighting devices according to the generated light settings. If there is no light script for a portion of the media content (for instance when the light script is streamed and the stream is interrupted, or when no script is available for a certain video fragment or audio fragment) the first subset of lighting devices may be controlled according to the generated light settings. This is beneficial because light effects based on the media content are still provided by the first subset of lighting devices.

The method may further comprise: obtaining type information indicative of the types of the plurality of lighting devices, and selecting the first subset of lighting devices and the second subset of lighting devices based on the types. The types may be indicative of light rendering properties (e.g. colors, brightness, spatial dynamic light effects, etc.) of the lighting devices, and the lighting devices may be assigned to the first or second subset based thereon. The light script may for example be scripted such that it is applicable to certain types of lighting devices. Lighting devices of that certain type of the plurality of lighting devices may be assigned to the first subset, while lighting devices of other types may be assigned to the second subset. The media content may be video content, and the step of analyzing the media content to generate one or more light settings based on the media content may comprise: generating the one or more light settings by extracting color information, saturation information and/or brightness information from the video content. Images of the video content may be analyzed to extract color, saturation and/or brightness levels from the images, and the one or more lighting devices may be controlled based on these levels.

The media content may be audio content, and the step of analyzing the media content to generate one or more light settings based on the media content may comprise: generating the one or more light settings based on one or more audio characteristics of the audio content. The audio characteristics may, for example, comprise one or more of: beat, timbre, pitch, intensity, rhythm, major and minor key.

The media content may be game content, and the step of analyzing the media content to generate one or more light settings based on the media content may comprise: generating the one or more light settings by extracting color information, saturation information and/or brightness information form the game content, and/or generating the one or more light settings based on one or more game events of the game content. Images of the game content may be analyzed to extract color, saturation and/or brightness levels from the images, and the one or more lighting devices may be controlled based on these levels. Additionally or alternatively, (upcoming/predefmed) game events (such as explosions) may be analyzed to determine color, saturation and/or brightness levels, and the one or more lighting devices may be controlled based on these levels.

According to a second aspect of the present invention, the object is achieved by a computer program product for a computing device, the computer program product comprising computer program code to perform any of the above-mentioned methods when the computer program product is run on a processing unit of the computing device.

According to a third aspect of the present invention, the object is achieved by a controller for controlling a plurality of lighting devices based on media content rendered on a media rendering device, the controller comprising: an input configured to obtain a light script associated with the media content, an output, and a processor configured to: analyze the media content to generate light settings based on the media content, control via the output, while the media content is being rendered on the media rendering device, a first subset of lighting devices of the plurality of lighting devices according to the light script, and, simultaneously, control via the output, while the media content is being rendered on the media rendering device, a second subset of lighting devices of the plurality of lighting devices according to the generated light settings.

According to a fourth aspect of the present invention, the object is achieved by a lighting system comprising the controller and a plurality of lighting devices configured to be controlled by the controller. According to a fifth aspect of the present invention, the object is achieved by a media rendering device comprising the controller, wherein the media rendering device is configured to render the media content on the media rendering device.

It should be understood that the computer program product, the controller, the lighting system and the media rendering device may have similar and/or identical features and advantages as the above-mentioned methods.

BRIEF DESCRIPTION OF THE DRAWINGS

The above, as well as additional objects, features and advantages of the disclosed systems, devices and methods will be better understood through the following illustrative and non-limiting detailed description of embodiments of devices and methods, with reference to the appended drawings, in which:

Fig. 1 shows schematically an example of a system comprising a controller, a media rendering device and a plurality of lighting devices;

Fig. 2a shows schematically an example wherein lighting devices are assigned to a subset based on their position relative to a user;

Fig. 2b shows schematically an example wherein lighting devices are assigned to a subset based the orientation of a user relative to the lighting devices;

Fig. 3 shows schematically an example wherein lighting devices are assigned to a subset based on types of the lighting devices; and

Fig. 4 shows schematically a method of controlling a plurality of lighting devices based on media content rendered on a media rendering device.

All the figures are schematic, not necessarily to scale, and generally only show parts which are necessary in order to elucidate the invention, wherein other parts may be omitted or merely suggested.

Fig. 1 shows schematically an example of a system 100 comprising a controller 102, a media rendering device 130 and a plurality of lighting devices 110, 112,

114, 116. The controller 102 is configured to control the plurality of lighting devices 110,

112, 114, 116 based on media content rendered on the media rendering device 130. The controller comprises an input 108 configured to obtain a light script associated with the media content, an output 104 and a processor 106. The processor 106 (e.g. a microchip, circuitry, a microcontroller, etc.) is configured to analyze the media content and to generate light settings based on the analyzed media content. The processor 106 is further configured to control, via the output 104, while the media content is being rendered on the media rendering device 130, a first subset of lighting devices 110, 112 of the plurality of lighting devices 110, 112, 114, 116 according to the light script, and to (simultaneously) control, via the output 104, while the media content is being rendered on the media rendering device 130, a second subset of lighting devices 114, 116 of the plurality of lighting devices 110, 112, 114, 116 according to the generated light settings.

The controller 102 may be comprised in any type of device for controlling the lighting devices 110, 112, 114, 116. The controller 102 may, for example, be comprised in a personal device such as a smartphone, a smartwatch, a tablet pc. The controller 102 may be comprised in a central control device such as a central come control system, a bridge device, etc. In other examples, the controller 102 may be comprised in the media rendering device 130. In other examples, the controller 102 may be located on a remote server configured to communicate with the lighting devices 110, 112, 114, 116 via a network (e.g. via the internet).

The controller 102 is configured to control the plurality of lighting devices 110, 112, 114, 116. The controller 102 comprises an output 104 (e.g. a communication unit such as a transmitter, a transceiver) configured to communicate lighting control commands to the plurality of lighting devices 110, 112, 114, 116 to control the light output of the plurality of lighting devices 110, 112, 114, 116. Each lighting device of the plurality of lighting devices 110, 112, 114, 116 comprises a receiver configured to receive the control commands, and a processing unit configured to adjust the light output of the respective lighting device. The communication unit may comprise hardware for transmitting the control command via any wired or wireless communication protocol. Various wired and wireless communication protocols may be used, for example Ethernet, DMX, DALI, USB, Bluetooth, Wi-Fi, Li-Fi, 3G, 4G, 5G or ZigBee. The controller 102 further comprises an input 108 configured to obtain the light script associated with the media content. The light script may comprise predefined light settings (e.g. color, saturation, brightness, beam width/size, etc.) according to which the lighting devices are to be controlled while the media content is being rendered on the media rendering device 130. The light script may be stored in an internal memory, and the input 108 may be an input of the processor 106, and the processor 106 may obtain the light script from the memory via the input 108. Alternatively, the input 108 may be a receiver and the light script may be streamed to the input 108. The light script may be divided in multiple parts, and upcoming parts (i.e. parts that correspond to upcoming media content that has not yet been rendered) may be buffered in a memory (not shown). This prevents disruptions if there are momentary delays in transmission of the light script from the remote server.

The processor 106 (e.g. a single processor or a plurality of distributed processors) is configured to analyze the media content to generate light settings based on the media content. Examples of media content (video, audio, video gamers) and how light settings are generated based thereon are provided below. Such generation of light settings based on media content are known in the art and will therefore not be discussed in detail. The processor 106 may be further configured to analyze one or more upcoming parts of the media content (e.g. upcoming video scenes or images, upcoming game events, upcoming audio/songs, etc.) and analyze the one or more upcoming parts to generate the one or more light settings based on the media content. The upcoming parts may be buffered (i.e. temporarily stored) in a memory (not shown) when the media content is streamed. The processor 106 may control the lighting devices when the upcoming parts are rendered on the media rendering device 130. The processor 106 may be configured to temporarily store the generated one or more light settings in a memory, and the processor 106 may be configured to remove the stored light settings from the memory after the associated part of the media content has been rendered by the media rendering device 130.

The media rendering device 130 may, for example, be a television, a projector, an audio system, a pc, etc. The media rendering device 130 may be a portable device, such as a smartphone, a tablet pc, etc., or a wearable device such as an (AR) headset, smartglasses, smartwatch, headphones, etc.

The media content may be video content (e.g. a movie, a video clip, a news broadcast, etc.). The video content may be streamed from a video streaming platform. The processor 106 may be configured to analyze the video content and generate the one or more light settings by extracting color information, saturation information and/or brightness information from the video content. The processor 106 may be configured to analyze images/scenes of the video content to extract color, saturation and/or brightness levels from the images, and control lighting devices based on these levels. Techniques for extracting such information from video content is known in the art, and will therefore not be discussed in detail.

The media content may be audio content (e.g. a song, an audiobook, etc.). The audio content may be streamed from a music streaming platform. The processor 106 may be configured to analyze the audio content and generate the one or more light settings based on one or more audio characteristics of the audio content. The audio characteristics may, for example, comprise one or more of: beat, timbre, pitch, intensity, rhythm, major and minor key. Additionally, or alternatively the one or more audio characteristics may comprise audio features. The audio features may comprise direct mood, valence and arousal/energy. Direct mood may be estimated using set of mood labels (which may be user-defined or automatically generated). A combination of valence and arousal may be used for defining mood. Techniques for extracting such information from audio content is known in the art, and will therefore not be discussed in detail.

The media content may be video game content. The video game content may be streamed from a video game streaming platform (e.g. a cloud gaming platform). The processor 106 may be configured to analyze the video game content and generate the one or more light settings by extracting color information, saturation information and/or brightness information form the game content. Additionally or alternatively, the processor 106 may be configured to generate the one or more light settings based on one or more game events of the game content. Similar to the above-mentioned video analysis, images/scenes of the video game content may be analyzed to extract color, saturation and/or brightness levels from the images, and the one or more lighting devices may be controlled based on these levels. Additionally or alternatively, (predefined) game events of the game content may be accessible, and these (predefined) game events (e.g. explosions, change of scenery, opening of a door, etc.) may be analyzed by the processor 106. Color, saturation and/or brightness levels may, for example, be extracted from the game events, and the processor 106 may control the lighting devices accordingly. Alternatively, game events may be associated with predefined light settings, and the processor 106 may control the lighting devices based on the predefined light settings. Techniques for extracting such information from game content is known in the art, and will therefore not be discussed in detail. The processor 106 is further configured to control, while the media content is being rendered on the media rendering device 130, the first subset of lighting devices 110,

112 of the plurality of lighting devices according to the light script, and to control, while the media content is being rendered on the media rendering device 130, the second subset of lighting devices 114, 116 of the plurality of lighting devices according to the generated light settings. In the example of Fig. 1, lighting devices 110 and 112 have been assigned to the first subset of lighting devices 110, 112, and lighting devices 114 and 116 have been assigned to the second subset of lighting devices 114, 116. The subsets may be predefined, user defined, defined by the processor 106 (see examples below), etc. The processor 106 may be configured to obtain information indicative of the first and second subsets from a memory (e.g. a local memory of the controller 102, or a remote memory accessible via a network such as the internet).

The processor 106 may be configured to assign lighting devices of the plurality of lighting devices 110, 112, 114, 116 to the first and/or second subset. The processor 106 may be configured to assign lighting devices of the plurality of lighting devices 110, 112, 114, 116 to the first and/or second subset based on user input received via a user input, based on positions of the lighting devices relative to the media rendering device, based on positions of the lighting devices relative to a user, based on an orientation of a user, based on the types of the lighting devices 110, 112, 114, 116, etc. It should be understood that these are mere examples of how the processor 106 may be configured to assign lighting devices to the first and/or second subset, and that the skilled person is able to design alternatives without departing from the scope of the appended claims.

The processor 106 may for example be configured to assign lighting devices to a subset based on the positions of the lighting devices 110, 112, 114, 116 relative to the media rendering device. The processor 106 may be configured to obtain position information indicative of positions of the plurality of lighting devices relative to the media rendering device 130, and assign lighting devices to the first subset and the second subset based on the positions of the lighting devices relative to the media rendering device 130. The processor 106 may be configured to assign lighting devices closer to the media rendering device 130 to the first subset, and assign lighting devices further away from the media rendering device 130 to the second subset. Referring to the example of Fig. 1, the processor 106 may for example determine that lighting devices 110 and 112 are located closer to the media rendering device 130 compared to lighting devices 114 and 116, and assign lighting devices 110 and 112 to the first subset and assign lighting devices 114 and 116 to the second subset. The positions of the plurality of lighting devices 110, 112, 114, 116 relative to the media rendering device 130 may be obtained (e.g. via the input) from an (indoor) positioning system, for instance an RF- based positioning system, a coded light positioning system, a camera-based positioning system, from an internal memory, etc. Alternatively, the positions of the plurality of lighting devices 110, 112, 114, 116 may be defined by a user via a user interface, wherein the user may provide information about the positions of the plurality of lighting devices 110, 112,

114, 116, for instance by positioning virtual counterparts of the lighting devices on a map of an environment wherein the lighting devices are located. Techniques for determining locations of devices in an environment are known in the art and will therefore not be discussed in detail.

The processor 106 may for example be configured to assign lighting devices to a subset based on the positions of the lighting devices 110, 112, 114, 116 relative to a user. The processor 106 may be configured to obtain position information indicative of positions of the plurality of lighting devices relative to the user, and assign lighting devices to the first subset and the second subset based on the positions of the lighting devices relative to the user. The processor 102 may perform this repeatedly over time, because the position of the user may change over time. The processor 106 may be configured to assign lighting devices closer to user to the first subset, and assign lighting devices further away from the user to the second subset. Referring to the example of Fig. 2, the processor 106 may for example determine that lighting devices 210 and 212 are located closer to the user 240 compared to lighting devices 214 and 216, and assign lighting devices 210 and 212 to the first subset 202 and assign lighting devices 214 and 216 to the second subset 204. The positions of the plurality of lighting devices 110, 112, 114, 116 relative to the user may be obtained (e.g. via the input) from an (indoor) positioning system, for instance an RF -based positioning system, a coded light positioning system, a camera-based positioning system, from an internal memory, etc. The positioning system may determine the location of the user (e.g. based on sensor data, based on a detected position of a device carried by the user, etc.). Alternatively, the positions of the plurality of lighting devices 110, 112, 114, 116 may be defined by a user via a user interface, wherein the user may provide information about the positions of the plurality of lighting devices 110, 112, 114, 116 and a (typical) position of a user, for instance by positioning virtual counterparts of the lighting devices and the user on a map of an environment wherein the lighting devices are located. Techniques for determining locations of devices and users in an environment are known in the art and will therefore not be discussed in detail. Additionally or alternatively, the processor 106 may be configured to obtain information indicative of a field of view (FoV) of the user. The processor 106 may obtain this information via the input 108, or for example from a memory of the controller 102. The processor 106 may be further configured to determine which of the plurality of lighting devices are located inside the field of view of the user, and determine which of the plurality of lighting devices are located outside the field of view of the user. The processor 102 may determine this repeatedly over time, because the position (and orientation) of the user may change over time. The field of view may, for instance, be determined based on the orientation of a user detected by one or more sensors. For example, the user may wear a head-worn device comprising an orientation sensor for detecting the orientation of the user, which orientation may be used to determine the FoV of the user. In another example, a camera may be located in the environment, and one or more images captured by the camera may be analyzed to determine the orientation and therewith the FoV of the user. The position information of the user, the user’s orientation and the position information of the lighting devices may then be used to determine which lighting devices are located inside/outside the FoV. In another example, a camera may be located in a head-worn device, and the camera image may be analyzed to identify which lighting devices are located in the FoV of the user. In this example, the light output of the lighting devices (e.g. a color, a code embedded in the light output, etc.) may be detected and the lighting devices may be identified based on their light output. It should be understood that techniques for detecting a FoV of a user are known in the art and will therefore not be discussed in detail, and these examples are mere examples of detecting the FoV and the skilled person is able to design alternatives without departing from the scope of the appended claims.

The processor 106 may be further configured to assign lighting devices located inside the field of view of the user to the first subset, and assign lighting devices located outside the field of view of the user to the second subset. This has been illustrated in Fig. 2b. The lighting system of Fig. 2b is similar to the lighting system of Fig. 2a. In Fig. 2a, the position of the user 230 relative to the lighting devices determines whether the lighting devices are assigned to the first or the second subset, whereas in Fig. 2b the field of view of the user 240 determines whether lighting devices are assigned to the first or the second subset. In the example of Fig. 2b, lighting devices 214 and 216 are located inside the field of view of the user 240, and lighting devices 210 and 212 are located outside the field of view of the user 240. The processor 106 may therefore assign lighting devices 210 and 212 to the second subset 204, and assign lighting devices 214 and 216 to the first subset 202. The light script may define light settings for a predefined number of lighting devices, and the processor 106 may be configured to assign a number of lighting devices to the first subset based on the predefined number of lighting devices. The light script may, for example, define light settings for two lighting devices. In prior art, if a user would have more than two lighting devices (e.g. four lighting devices), the lighting system controller would scale up the light settings and apply those to all lighting devices of the lighting system. In the present example, the processor 106 may assign two lighting devices to the first subset (which is controlled based on the light script) and assign further lighting devices to the second subset (which is controlled based on the generated light settings). Additionally, the processor 106 may take the positions of the lighting devices relative to a user and/or the media rendering device 130 into account when determining which lighting devices to assign to which subset (see examples above).

It may occur that the generated light settings are different from the light settings defined by the light script. This may result in an undesirable light effect. The processor 106 may therefore be configured to compare the scripted light settings of the light script with the generated light settings and determine a level of difference between the scripted light settings and the generated light settings. If the level of difference exceeds a threshold, the processor 106 may adjust the generated light settings to reduce the level of difference and control the second subset of lighting devices according to the adjusted generated light settings. The processor 106 may, for example, adjust the brightness and/or the color value of the generated light settings to lower the level of difference between the scripted light settings and the generated light settings. The processor 106 may, for example, adjust the generated light settings such that the level of difference does not exceed the threshold. Alternatively, the processor 106 may control the second subset of lighting devices according to the scripted light settings.

It may occur that (a stream of) the light script is not (yet) available, or that a stream of the light script is interrupted while the media content is being rendered. This may be due to bandwidth limitations (e.g. in the local network or in a remote network/server), due to (temporary) unavailability of the script, due to inaccessibility of a remote server, etc. Another reason for the unavailability of the light script may be that the user skips forward to a part of the (streamed) media content (and therewith to a part of the light script) that has not been buffered yet. The processor 106 may therefore be configured to determine if the light script is unavailable for a portion of the media content, and, if the light script is unavailable for the portion of the media content, control both the first subset and the second subset of lighting devices according to the generated light settings.

The processor 106 may be further configured to obtain type information indicative of the types of the plurality of lighting devices, and select the first subset of lighting devices and the second subset of lighting devices based on the types. The type information may be obtained via the input 108, for instance from a central lighting control system or from the lighting devices. Alternatively, the type information may be obtained from a memory comprised in the controller 102, the memory being configured to store information of the types of the lighting devices. Dependent on the type of lighting devices, the lighting devices may be assigned to the first or the second subset. For example, the processor 106 may assign lighting devices to a subset based on the range of the light spectrum the respective lamp can provide. For instance, a first lighting device may be configured to provide different light colors and a second lighting device may be configured to provide white light only. The processor 106 may therefore determine to assign the first lighting device to the first subset (because it can render a wider spectrum) and assign the second lighting device to the second subset. The light script may further define for which type of lighting devices the light script is intended. The light script may, for example, define that the light settings are to be rendered by lighting devices able to render a certain spectrum, and/or that the light settings are to be rendered by lighting devices (such as light strips) comprising individually controllable segments. This has been illustrated in Fig. 3, wherein the processor 106 may determine that light strip 314 is to be assigned to the first subset, while the other light sources 310 and 312 (e.g. light bulbs) may be assigned to the second subset.

Fig. 4 shows a method 400 of controlling a plurality of lighting devices based on media content rendered on a media rendering device. The method 400 comprises: obtaining 402 a light script associated with the media content, analyzing 404 the media content to generate light settings based on the media content, controlling 406, while the media content is being rendered on the media rendering device, a first subset of lighting devices of the plurality of lighting devices according to the light script, and controlling 408, while the media content is being rendered on the media rendering device, a second subset of lighting devices of the plurality of lighting devices according to the generated light settings. The method 400 may be executed by computer program code of a computer program product when the computer program product is run on a processing unit of a computing device, such as the processor 106 of the controller 102.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design many alternative embodiments without departing from the scope of the appended claims.

In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. Use of the verb "comprise" and its conjugations does not exclude the presence of elements or steps other than those stated in a claim. The article "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer or processing unit. In the device claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

Aspects of the invention may be implemented in a computer program product, which may be a collection of computer program instructions stored on a computer readable storage device which may be executed by a computer. The instructions of the present invention may be in any interpretable or executable code mechanism, including but not limited to scripts, interpretable programs, dynamic link libraries (DLLs) or Java classes. The instructions can be provided as complete executable programs, partial executable programs, as modifications to existing programs (e.g. updates) or extensions for existing programs (e.g. plugins). Moreover, parts of the processing of the present invention may be distributed over multiple computers or processors or even the ‘cloud’.

Storage media suitable for storing computer program instructions include all forms of nonvolatile memory, including but not limited to EPROM, EEPROM and flash memory devices, magnetic disks such as the internal and external hard disk drives, removable disks and CD-ROM disks. The computer program product may be distributed on such a storage medium, or may be offered for download through HTTP, FTP, email or through a server connected to a network such as the Internet.

Claims

CLAIMS:

1. A method (400) of controlling a plurality of lighting devices based on media content rendered on a media rendering device, the method (400) comprising: obtaining (402) a light script associated with the media content, analyzing (404) the media content to generate light settings based on the media content, controlling (406), while the media content is being rendered on the media rendering device, a first subset of lighting devices of the plurality of lighting devices according to the light script, and, simultaneously, controlling (408), while the media content is being rendered on the media rendering device, a second subset of lighting devices of the plurality of lighting devices according to the generated light settings.

2. The method (400) of claim 1, further comprising: obtaining position information indicative of positions of the plurality of lighting devices relative to the media rendering device and/or a user, and assigning lighting devices to the first subset and the second subset based on the positions of the lighting devices relative to the media rendering device and/or the user.

3. The method (400) of claim 2, wherein lighting devices of the plurality of lighting devices located closer to the media rendering device and/or the user are assigned to the first subset, and wherein lighting devices of the plurality of lighting devices located further away from the media rendering device and/or the user are assigned to the second subset.

4. The method (400) of claim 2 or 3, wherein the position information is indicative of positions of the plurality of lighting devices relative to user, and wherein the method (400) further comprises: obtaining information indicative of a field of view of the user, determining which of the plurality of lighting devices are located inside the field of view of the user, determining which of the plurality of lighting devices are located outside the field of view of the user, wherein lighting devices located inside the field of view of the user are assigned to the first subset, and wherein lighting devices located outside the field of view of the user are assigned to the second subset.

5. The method (400) of any preceding claim, wherein the light script defines light settings for a predefined number of lighting devices, and wherein the method (400) comprises: assigning a number of lighting devices to the first subset based on the predefined number of lighting devices.

6 The method (400) of any preceding claim, further comprising: comparing scripted light settings of the light script with the generated light settings, determining a level of difference between the scripted light settings and the generated light settings, and if the level of difference exceeds a threshold: adjusting the generated light settings to reduce the level of difference and controlling the second subset of lighting devices according to the adjusted generated light settings, or controlling the second subset of lighting devices according to the scripted light settings.

7. The method (400) of any preceding claim, further comprising: determining if the light script is unavailable for a portion of the media content, and if the light script is unavailable for the portion of the media content, controlling the first subset of lighting devices according to the generated light settings.

8 The method (400) of any preceding claim, further comprising: obtaining type information indicative of the types of the plurality of lighting devices, and selecting the first subset of lighting devices and the second subset of lighting devices based on the types.

9. The method (400) of any preceding claim, wherein the media content is video content, and wherein the step of analyzing the media content to generate one or more light settings based on the media content comprises: generating the one or more light settings by extracting color information, saturation information and/or brightness information from the video content.

10. The method (400) of any preceding claim, wherein the media content is audio content, and wherein the step of analyzing the media content to generate one or more light settings based on the media content comprises: generating the one or more light settings based on one or more audio characteristics of the audio content.

11. The method (400) of any preceding claim, wherein the media content is game content, and wherein the step of analyzing the media content to generate one or more light settings based on the media content comprises: generating the one or more light settings by extracting color information, saturation information and/or brightness information form the game content, and/or generating the one or more light settings based on one or more game events of the game content.

12. A computer program product for a computing device, the computer program product comprising computer program code to perform the method (400) of any preceding claim when the computer program product is run on a processing unit of the computing device.

13. A controller (102) for controlling a plurality of lighting devices (110, 112,

114, 116) based on media content rendered on a media rendering device (130), the controller (102) comprising: an input (108) configured to obtain a light script associated with the media content, an output (104), and a processor (106) configured to: analyze the media content to generate light settings based on the media content, control via the output (104), while the media content is being rendered on the media rendering device (130), a first subset of lighting devices (110, 112) of the plurality of lighting devices according (110, 112, 114, 116) to the light script, and, simultaneously, control via the output (104), while the media content is being rendered on the media rendering device (130), a second subset of lighting devices (114, 116) of the plurality of lighting devices (110, 112, 114, 116) according to the generated light settings.

14. A lighting system comprising the controller (102) of claim 13, and a plurality of lighting devices (110, 112, 114, 116) configured to be controlled by the controller (102).

15. A media rendering device (130) comprising the controller (102) of claim 13, wherein the media rendering device (130) is configured to render the media content on the media rendering device.