TW202001465A - Lighting system with integrated sensor - Google Patents

Abstract

Techniques and devices are provided for sensing image data from a scene and activating primary light sources based on information sensed from the scene. Subsets of a plurality of primary light sources may be activated to emit sensing spectrum of light onto a scene. Combined image data may be sensed from the scene while the subsets of the plurality of primary light sources are activated. Reflectance information for the scene may be determined based on the combined image data and combined sensing spectra. Spectrum optimization criteria for the primary light sources may be determined based on the reference information and a desired output parameter provided by a user or determined by a controller. The plurality of primary light sources may be activated to emit a lighting spectrum based on the spectrum optimization criteria.

Description

Lighting system with integrated sensor

This application relates to a lighting system, and more specifically, this application relates to a lighting system with an integrated sensor.

The tunable lighting system can be used to illuminate one or more scenes containing objects, and can be adjusted so that the light output by these systems varies based on user input. These tunable lighting systems can be adjusted, for example, to increase or decrease the amount and/or type of light shining onto a scene. In addition, these tunable lighting systems may include multiple light sources such as multiple light bulbs to illuminate a scene.

The following description includes techniques and devices provided for sensing image data from a scene and activating primary color light sources based on the image data. A subset of multiple primary color light sources can be activated to emit a sensing spectrum of light onto a scene. The image data can be sensed from the scene when the subsets of the plurality of primary color light sources are activated. The reflection information of the scene can be determined based on the combined image data. The spectral optimization criteria of the primary color light sources can be determined based on the reference information and one of the desired output parameters provided by a user or determined by a controller. The plurality of primary color light sources can be activated to emit an illumination spectrum based on the spectrum optimization criterion.

Cross-reference of related applications This application claims the European Patent Application No. 18186839.9 filed on August 1, 2018 and named ``Lighting System With Integrated Sensor'' and the U.S. patent filed on June 22, 2018 and named ``Lighting System With Integrated Sensor'' The priority right of the application No. 16/015,697, the entire contents of each of these cases are incorporated herein by reference.

Examples of different lighting, tunable lighting, sensors, and/or light emitting diode ("LED") implementations will be described more fully below with reference to the drawings. These examples are not mutually exclusive, and the features seen in one example can be combined with the features seen in one or more other examples to achieve additional implementations. Therefore, it should be understood that the examples shown in the drawings are for illustration only, and they are by no means intended to limit the invention. The same element symbol in all drawings refers to the same element.

It should be understood that although the terms "first", "second", etc. may be used herein to describe various elements, such elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, without departing from the scope of the present invention, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.

It should be understood that when an element (such as a layer, region, or substrate) is considered "on another element" or "extended to another element", it can be directly on the other element or directly extended to the other element Intervening elements may also be present on the element. In contrast, when an element is considered "directly on another element" or "extended directly onto another element", there are no intervening elements. It should also be understood that when an element is considered to be “connected” or “coupled” to another element, it can be directly connected or coupled to the other element or intervening elements may be present. In contrast, when an element is considered "directly connected" or "directly coupled" to another element, there are no intervening elements. It should be understood that, in addition to covering any orientation depicted in the figures, these terms are also intended to cover different orientations of the elements.

Relative terms (such as "below" or "above" or "upper" or "lower" or "horizontal" or "vertical" may be used herein to describe an element, layer or region and another element, layer or region A relationship, as shown in the figure. It should be understood that, in addition to covering the orientation depicted in the figures, these terms are also intended to cover different orientations of the device.

Tunable lighting arrays (including tunable lighting arrays with primary color light sources) can support applications that benefit from distributed intensity, space, and time control of light distribution. The primary color light source may be a light emitting device that emits a given color, such as an LED. Applications based on tunable lighting arrays may include, but are not limited to, precise spatial patterning of light emitted from pixel blocks or individual pixels. Depending on the application, the emitted light can be different in spectrum, adaptive over time and/or environmentally responsive. The light emitting array can provide scene-based light distribution of various intensity, space or time patterns. The emitted light may be based at least in part on the received sensor data, as disclosed herein. The associated optics at a pixel, pixel block or device level can be different. Common applications supported by light emitting arrays include architectural and area lighting, professional lighting, retail lighting and/or exhibition lighting and the like.

Using a tunable lighting system containing primary color light sources can provide controlled lighting of a portion of a scene within a determined amount of time. This may allow the array to, for example, highlight specific colors or color properties within a scene, highlight a white background, highlight moving objects, and/or the like. Architectural and area lighting can also benefit from the lighting disclosed herein.

In various applications where a tunable lighting system is used, an optimal lighting spectrum can vary based on the illumination scene. Variations can be due to the objects, colors, and angles presented in the scene and can also vary based on one or more expected output parameters. Since the lighting spectrum cannot be adjusted manually with each scene change, as disclosed herein, a tunable lighting system can automatically adjust the lighting spectrum based on the scene to be illuminated and/or one or more desired output parameters.

According to the implementation disclosed herein, as shown in flow chart 100 in FIG. 1, a first subset of a plurality of primary color light sources can be activated in 110 to emit a first sensing spectrum onto a scene. As described herein, the sensing spectrum may refer to the light emitted by a subset of the plurality of primary color light sources when collecting image data via an image sensor. The sensing spectrum may include light that is not visible to the person watching the scene. In 120, the first image data may be sensed from the scene when the first subset of the plurality of primary color light sources is activated. In 130, a second subset of the plurality of primary color light sources may be activated to emit a second sensing spectrum onto a scene. In 140, the second image data may be sensed from the scene when the second subset of the plurality of primary color light sources is activated. It is worth noting that multiple light sources in the subset can be activated so that a subset is activated, image data is collected when the subset is activated, and then another subset is activated and additional image data is collected. This procedure can be repeated so that each subset of the plurality of primary color light sources corresponds to the primary color light sources and image data is collected when each primary color light source is activated. Preferably, at least four or five primary color light sources can be provided in one of the lighting systems disclosed herein.

In 150, the reference information of the scene may be determined based on the combined image data, where the combined image data is a combination of the first image data and the second image data. This combined image data can be collected by combining image data when starting different subsets of a plurality of primary color light sources. It should be noted that the combined image data does not necessarily refer to different image data added together, because the combined image data may only be a collection of several different image data. In 160, based on the reference information and one or more desired output parameters, the spectral optimization criteria of the plurality of primary color light sources may be determined. The desired output parameter can be input by a user or a component or can be determined based on the scenario, as further disclosed herein. At 170, a plurality of primary color light sources can be activated to emit an illumination spectrum based on spectral optimization criteria. As described herein, the lighting spectrum may refer to light emitted by a plurality of primary color light sources based on a spectrum optimization criterion so that the lighting spectrum can be seen by a person viewing the scene.

FIG. 2 shows an example diagram of a lighting system 200 disclosed herein. A substrate 210 may be a mount or housing to which components of the lighting system 200 are attached to or placed on. A plurality of primary color light sources 260 may be provided and the others may emit light, as disclosed herein. The plurality of primary color light sources 260 may be individually addressable channels, such that a first channel may correspond to a first primary color light source (such as an LED emitting red light) and a second channel may correspond to a second primary color light source (such as launch treasure) Blue LED). A first optical lens 240 can be close to the primary color light source 260, so that all or part of the light emitted by the primary color light source 260 can pass through the first lens 240 and can be shaped or adjusted by the first optical lens 240. It should be noted that although the first optical lens 240 is shown as one component, it may be a combination of multiple components and multiple components may be configured such that a component or a subset of components and one of a plurality of primary color light sources or A subset is aligned.

In addition, an image sensor 220 may be provided and may be connected to the substrate 210 or substantially within the same housing as the plurality of primary color light sources 260. Alternatively, the image sensor 220 can be separated from the plurality of primary color light sources 260 and can be provided in a separate housing. A second optical lens 230 can be close to the image sensor 220, so that all or part of the image data sensed or collected by the image sensor 220 can pass through the second optical lens 230 and can be shaped or adjusted by the second optical lens 230.

In addition, a controller 250 may be provided and may be connected to the substrate 210 or substantially in the same housing as the plurality of primary color light sources 260 and the image sensor 220. Alternatively, the controller 250 may be separated from the plurality of primary color light sources 260 and/or the image sensor 220 and may be provided in a separate housing. The controller 250 may be configured to receive data from the image sensor 220 and/or the plurality of primary color light sources 260 and may also provide control or other information to the plurality of primary color light sources 260 and/or image sensor 220.

According to one implementation of the disclosed subject, as shown in 110 of FIG. 1, a first subset of a plurality of primary color light sources can be activated to emit a first sensing spectrum onto a scene. The first subset of the plurality of primary color light sources may correspond to activating one channel of one or more light sources corresponding to a primary color (such as red). As an example, the red light emitting diodes (LEDs) of the plurality of primary color light sources 260 of FIG. 2 may be activated in 110. The light sources corresponding to a primary color can be grouped together or, preferably, can be spread across an array of light sources. For example, as shown in FIG. 2, the primary color light source 260 includes a plurality of light sources. The red LED can be deployed in all light sources 260 so that it can reach various sections of a scene. In 110 of FIG. 1, the first subset of the plurality of light sources can be activated, so that its activation is due to, for example, a high frequency, short duration, and/or low amplitude modulation at the time of activation, and the scene cannot be viewed People see. As shown in FIG. 2, light from the first subset of primary color light sources 260 may be emitted through the first optical lens 240.

The primary color light source 260 may include, for example, primary colors sapphire blue, cyan, green yellow, amber, and red. The nature of the primary color light source 260 used according to the targets disclosed herein may already be known to the system, and specifically, for example, may be known to the controller 250. As an example, the primary color light source 260 may have the chromaticity shown in FIG. 3A and the wavelength spectrum shown in FIG. 3B. In this example, each point in FIG. 3A (including 310, 311, 312, 313, and 314) may correspond to one of the five primary colors of the primary color light source 260. The dotted line may correspond to a single wavelength. As shown, a curved blackbody locus 320 can be followed more closely, for example, by using at least three primary colors in a tunable white system. According to an embodiment, the color output by the primary color light source 260 of FIG. 2 may have a chromaticity corresponding to the area enclosed by the points in FIG. 3A (including 310, 311, 312, 313, and 314). In addition, FIG. 3B shows the spectra 341, 342, 343, 344, and 345 corresponding to the five primary colors in this example.

In addition, FIG. 4A shows a graphical depiction of the spectral power distribution 410 generated by activating multiple primary color light sources at different ratios to generate spectra of different color rendering modes according to an embodiment of the present invention. The spectral power distribution 415 corresponds to a color rendering mode that gives the maximum color fidelity within the range of primary colors (specifically, the five primary colors in this example). 4B shows a graphical depiction of one of the color gamut index R _g and the fidelity index R _f 420, where the color gamut index R _g is the average relative color gamut TM-30 measurement and the fidelity index R _f is the average color fidelity TM-30 measurement of degrees. As shown, points 430, 431, 432, 433, and 434 correspond to different color rendering modes and square 435 corresponds to a maximum color fidelity mode. FIG. 4C shows a graphical depiction 440 of R _f values that vary according to the 16 tone divisions of TM-30. As shown, the data lines 442, 443, 444, 445, and 446 correspond to the R _f values of the corresponding tone divisions of different color rendering modes. The data line 441 corresponds to a maximum color fidelity mode. FIG. 4D shows a graphical depiction 450 of R _cs values that vary according to the 16 tone divisions of TM-30. As shown, the data lines 451, 452, 453, 454, and 455 correspond to the R _CS values of the corresponding tonal divisions of different color rendering modes. The data line 456 corresponds to a maximum color fidelity mode.

In 120 of FIG. 1, the first image data can be sensed from the scene when the first subset of the plurality of primary color light sources is activated. As shown in FIG. 2, an image sensor 220 can be used to sense the first image data and the first image data sensed by the image sensor 220 can reach the image sensor 220 through the second optical lens 230 . As further disclosed herein, the image data may include characteristics about the scene, which may enable the controller 250 to approximate the reflection spectrum of each pixel of the image sensor and/or generate a color map of the scene.

The image sensor 220 may be a light sensor with spatial resolution, so that the image sensor 220 and/or the controller 250 can avoid averaging in a scene illuminated by the procedure described in step 110 of FIG. 1 Different colors. It is worth noting that because the controller 250 controls a subset of the plurality of primary color light sources to emit the sensing spectrum onto a scene, the image sensor does not need to have wavelength resolution capability to obtain information. For clarity, the controller 250 may use known information about the primary color light source 260 to obtain color information about the scene when a subset of the primary color light source 260 emits light onto a scene. Therefore, by modulating a subset of the primary color light sources 260 and by sensing reflected images, as further disclosed herein, spectral information about the scene can be obtained without using a spectrally selective sensor. It should be noted that since the spectral information via the image data is obtained based on the light emitted by the subset of primary color light sources 260, the resolution of the spectral information is limited by the bandwidth of the primary color light sources 260. However, it should be noted that this spectral information is sufficient to optimize the color rendering of the primary color light source 260 because the primary color light source 260 will emit a lighting spectrum with the same spectral rendering limit as the spectral rendering limit it has when emitting the sensing spectrum .

In 130, a second subset of the plurality of primary color light sources can be activated to emit a second sensing spectrum onto the scene. The second subset of the plurality of primary color light sources may correspond to a channel that activates one or more light sources corresponding to a color (eg, sapphire blue) that is different from the first subset of the plurality of primary color light sources. As an example, in 130, the blue light emitting diode (LED) of the plurality of primary color light sources 260 of FIG. 2 may be activated. The light sources corresponding to the royal blue can be grouped together or, preferably, can be spread across an array of primary color light sources 260. For example, as shown in FIG. 2, the primary color light source 260 includes a plurality of light sources. The royal blue LED can be deployed in all primary color light sources 260 so that it can reach various sections of a scene. In 130 of FIG. 1, similar to 110, the second subset of the plurality of light sources can be activated so that its activation is due to, for example, a high frequency, short duration, and/or low amplitude modulation when the activation occurs It cannot be seen by the person watching the scene. As shown in FIG. 2, light from the second subset of primary color light sources 260 may be emitted through the first optical lens 240.

In 140 of FIG. 1, the second image data can be sensed from the scene when the second subset of the plurality of primary color light sources 260 of FIG. 2 is activated. An image sensor 220 can be used to sense the second image data and the second image data sensed by the image sensor 220 can reach the image sensor 220 through the second optical lens 230. As further disclosed herein, the image data may include characteristics about the scene, which may enable the controller 250 to approximate the reflection spectrum of each pixel of the image sensor and/or generate a color map of the scene.

As further disclosed herein, the controller 250, which can be factory-programmed or user-programmable to provide the response to the adjustable primary color light source 260, causes the first subset to be activated and the image sensor 220 to collect the first image data And then the second subset is activated and then the image sensor 220 collects the second image data. It should be understood that although the present invention refers to a first image data and a second image data corresponding to a first spectrum and a second spectrum, respectively, the image data can be sensed for additional available primary color light sources. Preferably, four or more and more preferably five or more primary color light sources are available. Therefore, the third image data, the fourth image data, and the fifth image data corresponding to the third spectrum, the fourth spectrum, and the fifth spectrum, respectively, can be sensed and provided to a controller, such as the controller of FIG. 2 250.

In 150 of FIG. 1, the reference information of the scene can be determined based on the combined image data, where the combined image data can be a combination of image data (such as the first image data and the second image data). A controller (such as the controller 250 of FIG. 2) may determine the reference information based on the combined image data (such as the combination of the first image data and the second image data). In addition, according to an embodiment, the controller may also have sensing spectrum information about the primary color light source 260. As described herein, FIGS. 4A-4D provide example graphical depictions of the spectrum and corresponding TM-30 index of the spectrum and corresponding TM-30 index that the controller can have or have access to and can use the primary color light sources of FIGS. 3A and 3B.

The reference information may correspond to an estimate of an approximate reflection spectrum of each pixel of the image sensor and thus may correspond to a color map of the scene. According to an embodiment, the color map can be expressed as the relative response of each pixel to each subset of the primary color light sources 260 of FIG. 2. As an example, Table 1 includes the relative reflection intensities sensed by a single pixel of an image sensor for the reflection spectra of four different examples. As shown in Table 1, the relative intensity of five primary color light sources is sensed so that when a given primary color light source (ie, channel) emits light onto the scene, the relative reflection intensity of one of the primary color light sources is sensed. In this example, the four example reflection spectra correspond to the four color evaluation samples (CES) defined in TM-30 and correspond to CES 5 (approximately maroon), CES 64 (approximately cyan), CES 32 (approximately Brownish yellow) and CES 81 (approximately purple). As a specific example, Table 1 shows the relative reflection intensity of .098 that is sensed by the image sensor 220 that senses a part of a scene when a sapphire primary color light source emits a sapphire blue light onto a maroon part of a scene. Similarly, as shown in Table 1, when a red primary color light source emits red light onto a maroon part of a scene, the relative reflection intensity system sensed by the image sensor 220 sensing that part of the scene. 5468. Because red is closer to the approximate maroon color of the scene, the relative reflection intensity sensed when the red primary color light source is activated (ie, .5468) is higher than when the sapphire primary color light source is activated (ie, .098). Using this technique, according to this implementation, the controller can develop a color map of the scene based on the data collected through the pixel(s) of the image sensor.

According to another embodiment, a color map may be represented in a standardized color space (such as CIE1931, CIE1976, CAM02-UCS, or the like). Representing the color map in this standardized color space may allow more advanced spectral optimization algorithms and/or more intuitive stylization of the desired response. The reflection spectrum of each pixel of an image sensor can be estimated, and then the associated color coordinates of the pixel can be calculated based on the estimated reflection spectrum. FIG. 5 shows an example implementation including the reflection spectra of CES 5, CES 64, CES 32, and CES 81 colors from TM-30 represented by solid lines 511, 512, 513, and 514, respectively. Dotted lines 521, 522, 523, and 524 show the respective estimated reflection spectra using the five primary color light sources of FIGS. 3A and 3B.

The dotted lines 521, 522, 523, and 524 are estimated based on the image data collected by an image sensor. As a specific example, as shown in FIG. 3B, the sapphire primary color channel emits a peak wavelength at 450 nm shown by 541. Therefore, FIG. 5 shows that the relative reflection intensity sensed by an image sensor (such as the image sensor 220 of FIG. 2) senses four different CES color points 531, 532, 533, and 534 when the sapphire primary color channel is activated. And emit a peak wavelength at 450 nm shown by 541. In this example, the four different CES color points correspond to maroon (CES 5) 531, cyan (CES 64) 532, maroon (CES 32) 533, and purple (CES 81) 534. The five wavelengths corresponding to the five primary color light sources are shown by 541 for royal blue, 542 for cyan, 543 for green and yellow, 544 for amber and 545 for red. As a specific example, when the sapphire primary color light source is activated to emit sensing light at 450 nm (shown by 541), the image sensor can register a relative reflection intensity of about .098 corresponding to the maroon CES 5 (as shown in Figure 5). Relative reflection intensity of approximately .3621 corresponding to the blue-green CES 64 (as shown by point 534). Similarly, in the example shown in FIG. 5, the image sensor 220 can capture four CES color points at the peak wavelengths of each of the five primary color light sources of FIGS. 3A and 3B, in this example, a total of 20 SPD data points. In summary, the SPD data points at the centroid wavelength of each primary color are obtained by cycling through the five primary colors and recording the reflection intensity through the image sensor. Subsequently, an approximate reflection spectrum can be estimated based on these data points via polynomial fitting, such as the polynomial fitting shown by dashed lines 521, 522, 523, and 524. Under the conditions defined at 380 nm and 780 nm, each dotted line 521, 522, 523, and 524 represents one of the best polynomial fits of a respective CES color based on the data points collected at the peak wavelengths of the five primary color light sources. It should be noted that other interpolation methods can also be used, such as a linear interpolation, spline interpolation or moving average interpolation.

Generally speaking, the accuracy of the approximation can be increased as the number of primary color light sources increases and can be the highest when the primary color light sources have a narrow bandwidth and spread evenly across the visible spectrum. As a reference, FIG. 6 shows an analysis of polynomial fitting using the five primary colors of FIGS. 3A and 3B, in which all 99 CES color data points from TM-30 are calculated by sequentially starting each of the five primary colors . Figure 6 shows a graph 600 where the 99 CES and 58 CES colors from TM-30 are identified by their correct TM-30 tonal divisions (1-16), and 96 CES colors are correctly identified within ±1 tonal division . In FIG. 6, the dots represent the original CES color points and the corresponding diamonds represent the estimated color points determined by using five primary color light sources.

In 160 of FIG. 1, the spectral optimization criterion of the primary color light source can be determined based on the reference information and one or more desired output parameters. As discussed further herein, the spectrum optimization criterion may be a criterion for operating primary color light sources based on the time it takes to emit an illumination spectrum onto a scene. Therefore, the spectrum optimization criterion is based on the reference information of the scene to achieve the criterion to be output. The reference information may be determined based on the combined image data disclosed herein with reference to 150 of FIG. 1. The desired output parameters can be generated via any suitable means (such as based on user input, based on the location of a device or component, based on image data, based on predetermined criteria, or the like). A user can provide input via a wireless signal (such as via Bluetooth, WiFi, RFID, infrared, or the like). Alternatively, a user may provide input via a keyboard, mouse, touchpad, tactile response, voice command, or the like. A controller (such as the controller 250 of FIG. 2) may use the reference information and the desired output parameter(s) to generate the spectral optimization criterion.

According to an embodiment, the spectral optimization criterion may be pre-computed offline based on the latent image data and output parameters and may be stored in a controller or accessible by the controller via a suitable technique such as a look-up table on. This pre-calculation and storage can reduce the complex computing needs of one of the on-board controllers whose computing power is limited. FIG. 8 shows an example flowchart of this implementation. As shown, factory input data 810 can be provided to an on-board processing system 820. Specifically, factory input data 810 can be provided to a scene color mapping module 821 to generate spectral data points based on, for example, image data and intensity values collected when the primary color light source emits a sensing spectrum and factory input data 810. Factory input data 810 can also be provided to a source spectrum optimization module 822, which can be based on the output from the scene color mapping module 821 and the specified response behavior from the user programming module 815 (Output parameter) to calculate the desired index/spectrum optimization criterion. The spectrum optimization module 822 can also set the channel drive current based on the determined spectrum optimization criterion.

In 170 of FIG. 1, a plurality of primary color light sources can be activated to emit an illumination spectrum based on the spectrum optimization criterion. The spectrum optimization criterion can be provided to the plurality of primary color light sources directly by the controller or via an appropriate communication channel such as one of the wired or wireless communication channels further disclosed herein.

According to one implementation of the disclosed subject matter, the spectral optimization criterion can result in the emission of different color rendering modes. For example, the desired output parameters can maximize the saturation or fidelity of the most contrasting primary colors in a scene. A controller can use the image data to determine the most contrasting primary colors in a given scene and generate spectral optimization criteria for the light source to be emitted to maximize the saturation or fidelity of those colors. As an example, the five primary color light sources of FIGS. 3A to 3B can be used for color saturation. 7A shows a graph 710 that includes estimated and actual color points for several CES colors in each of TM-30 tonal divisions 1, 5, 9, and 13. As shown by graph 710 in FIG. 7A, color saturation can be achieved mainly in either of two directions: along the red-to-cyan axis (e.g. TM-30 tonal division 1 along the horizontal axis shown in FIG. 7A) And 9) or the green-yellow to purple axes (for example, divisions 5 and 13) shown along the vertical axis in FIG. 7A. Therefore, as a specific example, as shown in FIG. 7B, a controller may select a spectral optimization criterion based on one of the three color rendering modes, where the division corresponds to the TM-30 hue division and 730 corresponds to a Perfect TM-30 circle: (1) If red and/or cyan are mainly detected (represented by trace 721), division 1 and division 9 are supersaturated; (2) If mainly green, yellow and/or purple are detected (Represented by trace 722), then division 5 and division 13 are oversaturated; and (3) if the main color is not detected in one of these tonal divisions (represented by trace 723), it is a high security Truth spectrum.

According to an embodiment, a controller may select an optimization criterion that maximizes a spectrum of supersaturation of the detected main color or maximizes a spectrum of supersaturation of all detected colors weighted by its incidence based on output parameters . In some embodiments, slightly supersaturated colors may be subjectively preferred, as may be indicated by output parameters. Furthermore, according to an embodiment, supersaturation can be quantified by a chromatic shift (such as, for example, the Rcs index in TM-30). A typical preferred range for Rcs may be 0% to 20%, and a more preferred range may be 5% to 10%.

In addition, according to an embodiment, the image data and a previously recorded image data can be compared to determine the color of a moving or new object of interest, so that the spectrum can be optimized for this object. Alternatively, the average reflection spectrum of the image can be used to optimize the spectrum of the average color. In the optimization of the spectrum, the chromaticity can be kept constant or allowed to change.

According to an embodiment, the output parameter may correspond to a specific chromaticity for the emitted light based on a given scene (as determined based on image data). For example, a cool white color may be desired when the scene contains cool colors (such as blue, cyan, and green), and a warm white color may illuminate yellow, orange, and red tones. This scheme can enhance the color gamut and visual brightness of the scene. According to this example, a controller can provide spectral optimization criteria corresponding to three or more primary colors.

According to an embodiment, the output parameter may correspond to achieving a desired color point. According to this embodiment, a controller can use the reflected light information in the image to determine the spectral optimization criterion of the emission spectrum required to achieve a desired overall color point. For example, in a space where a colored object or wall is illuminated near a white background, light reflected from the colored object or wall may cause the white background to be non-white, as indicated by the output parameters, which may be undesirable. Therefore, a controller can generate spectrum optimization criteria such that the primary color light source emits an illumination spectrum that maintains the white background as white.

Table 2 shows a summary of example output parameters, example image data, and corresponding example spectrum optimization criteria.

According to an implementation, the lighting system disclosed herein may include a communication interface that enables communication with an external component or system. Communication can be facilitated by wired or wireless transmission and can be incorporated into any suitable mode including Bluetooth, WiFi, cellular, infrared, or the like. According to an embodiment, the controller may be outside the lighting system so that the image data is provided to the external controller and the spectrum optimization criterion is determined and/or provided by the external controller. Additionally or alternatively, the output criteria may be provided via an external input device (eg, a mobile phone) and/or may be provided to an external component (such as an external controller).

According to an embodiment, the sensing spectrum may be emitted by a first subset of the primary color light sources, and an illumination spectrum may be emitted by the remaining or other subset of the primary color light sources. The first subset may emit the sensing spectrum so that the sensing spectrum is not visible to humans (eg, at a high frequency). As disclosed herein, image data may be collected based on a first subset of emission sensing spectra and then image data may be collected when a second subset emits a sensing spectrum after the first subset switches to emitting an illumination spectrum.

Although features and elements are described above in specific combinations, those of ordinary skill should understand that each feature or element may be used alone or in any combination with other features and elements. In addition, the methods described herein may be implemented in a computer program, software, or firmware incorporated in a computer-readable medium to be executed by a computer or processor. Examples of computer-readable media include electronic signals (transmitted through wired or wireless connections) and computer-readable storage media. Examples of computer-readable storage media include, but are not limited to, a read-only memory (ROM), a random access memory (RAM), a register, cache memory, semiconductor memory devices, magnetic media ( Such as internal hard disks and removable disks, magneto-optical media and optical media (such as CD-ROM disks and digital versatile disks (DVD)).

100‧‧‧Flowchart 110‧‧‧Step 120‧‧‧Step 130‧‧‧Step 140‧‧‧Step 150‧‧‧Step 160‧‧‧Step 170‧‧‧Step 200‧‧‧Lighting system 210‧‧‧ substrate 220‧‧‧Image sensor 230‧‧‧Second optical lens 240‧‧‧First optical lens 250‧‧‧Controller 260‧‧‧primary color light source 310‧‧‧ points 311‧‧‧ points 312‧‧‧ points 313‧‧‧ points 314‧‧‧ points 320‧‧‧ Curved blackbody locus 341‧‧‧ Spectrum 342‧‧‧ Spectrum 343‧‧‧ Spectrum 344‧‧‧ Spectrum 345‧‧‧ Spectrum 410‧‧‧Spectral power distribution 415‧‧‧Spectral power distribution 420‧‧‧Graphic depiction 430‧‧‧ 431‧‧‧ points 432‧‧‧ points 433‧‧‧ points 434‧‧‧ points 435‧‧‧square 440‧‧‧Graphic depiction 441‧‧‧Data cable 442‧‧‧Data cable 443‧‧‧Data cable 444‧‧‧Data cable 445‧‧‧Data cable 446‧‧‧Data cable 450‧‧‧Graphic depiction 451‧‧‧Data cable 452‧‧‧Data cable 453‧‧‧Data cable 454‧‧‧Data cable 455‧‧‧Data cable 456‧‧‧Data cable 511‧‧‧Solid line 512‧‧‧Solid line 513‧‧‧Solid line 514‧‧‧Solid line 521‧‧‧ dotted line 522‧‧‧ dotted line 523‧‧‧ dotted line 524‧‧‧ dotted line 531‧‧‧CES color point 532‧‧‧CES color point 533‧‧‧CES color point 534‧‧‧CES color point 600‧‧‧Graphics 710‧‧‧Graph 721‧‧‧trace 722‧‧‧Trace 723‧‧‧trace 730‧‧‧PerfectTM-30 Yuan 810‧‧‧Factory input data 815‧‧‧User programmable module 820‧‧‧Onboard processing system 821‧‧‧Scene color mapping module 822‧‧‧ source spectrum optimization module

A more detailed understanding can be obtained from the following description given by way of example in conjunction with the drawings, in which:

Figure 1 is a flow chart for starting primary color light sources based on spectral optimization criteria;

Figure 2 is an example diagram of an image sensor, controller and a plurality of primary color light sources;

Figure 3A is an example chart of the chromaticity of the five primary colors;

Figure 3B is an example chart of the spectrum of the five primary colors of Figure 3A;

4A is an example graph of the spectrum of the five primary colors of FIGS. 3A and 3B and their corresponding TM-30 index, which includes a graph of spectral power and wavelength;

4B is an example chart of the spectrums of the five primary colors of FIGS. 3A and 3B and their corresponding TM-30 index, which includes Rg and Rf graphs;

4C is an example chart of the spectrums of the five primary colors of FIGS. 3A and 3B and their corresponding TM-30 index, which includes a graph of Rf and hue division;

4D is an example chart of the spectrums of the five primary colors of FIGS. 3A and 3B and their corresponding TM-30 index, which includes a graph of Rcs and hue division;

5 shows an example chart of a reference spectrum with an estimated reference spectrum using the five primary colors of FIGS. 3A and 3B and a polynomial fitting algorithm;

Figure 6 shows the actual color point of TM-30 CES 1-99 in CAM02-USC and the estimated color point using the five primary colors of Figures 3A and 3B;

7A shows example color points of several CES in each of the tonal divisions 1, 5, 9, and 13;

7B shows an example color vector diagram showing the three color rendering modes for the high fidelity hue division and high saturation of FIG. 7A; and

FIG. 8 shows a flowchart of factory input data provided to a processing unit on a board.

100‧‧‧Flowchart

110‧‧‧Step

120‧‧‧Step

130‧‧‧Step

140‧‧‧Step

150‧‧‧Step

160‧‧‧Step

170‧‧‧Step

Claims (16)

A method, including: Starting a first subset of the plurality of primary color light sources to emit a first sensing spectrum onto a scene; When starting the first subset of the plurality of primary color light sources, sensing the first image data of the plurality of pixels from the scene; Starting a second subset of the plurality of primary color light sources to emit a second sensing spectrum onto the scene; When starting the second subset of the plurality of primary color light sources, sensing the second image data of the plurality of pixels from the scene; Generating a color of the scene that assigns a color point in a color space to each of the pixels based on the first sensing spectrum, the first image data, the second sensing spectrum, and the second image data Figure; Determine the spectral optimization criteria for the primary color light sources from the color map and a desired output parameter; and Based on the spectrum optimization criterion, the plurality of primary color light sources are activated to emit an illumination spectrum. The method of claim 1 further includes: Activate a third subset of the plurality of primary color light sources to emit a third sensing spectrum onto a scene; When starting the third subset of the plurality of primary color light sources, sensing the third image data of the plurality of pixels from the scene; Starting a fourth subset of the plurality of primary color light sources to emit a fourth sensing spectrum onto the scene; When starting the fourth subset of the plurality of primary color light sources, sensing the fourth image data of the plurality of pixels from the scene; Starting a fifth subset of the plurality of primary color light sources to emit a fifth sensing spectrum onto the scene; Sensing the fifth image data of the plurality of pixels from the scene when starting the fifth subset of the plurality of primary color light sources; Wherein generating a color map of the scene includes based on the first sensing spectrum, the first image data, the second sensing spectrum, the second image data, the third sensing spectrum, the third image data, the The fourth sensing spectrum, the fourth image data, the fifth sensing spectrum, and the fifth image data are used to assign a color point in a color space to each of the pixels. The method of claim 1 or claim 2, wherein activating a subset of the plurality of primary color light sources to emit a sensing spectrum includes modulating light output from the subset of the plurality of primary color light sources. The method of claim 3, wherein an amplitude modulation substantially invisible to humans is used to amplitude modulate the modulated light output from the subset of primary color light sources. The method of claim 3, wherein a frequency modulation substantially invisible to humans is used to frequency modulate the modulated light output from the subset of primary color light sources. The method of claim 1, wherein the first image data and the second image data are provided to a controller configured to generate the color map. The method of claim 1, wherein the first sensing spectrum, the second sensing spectrum, and the illumination spectrum are emitted through a first optical lens. The method of claim 7, wherein the first image data and the second image data are sensed through a second optical lens. The method of claim 1, wherein the spectrum optimization criterion is determined based on a lookup table. The method of claim 9, wherein the lookup table is stored on a controller or on a memory accessible by a controller. The method of claim 1, wherein the desired output parameter is provided by a user or by a controller based on reference information. An apparatus including: A plurality of primary color light sources, which are configured to transmit a first sensing spectrum, a second sensing spectrum, and an illumination spectrum to a scene through a first optical device; An image sensor configured to sense the first image data of a plurality of pixels from the scene through a second optical device when the scene is illuminated by the first sensing spectrum and configured to be in the scene When illuminating from the second sensing spectrum through the second optical device, the second image data of the plurality of pixels is sensed from the scene; and A controller configured to generate a color map of the scene, determine the spectral optimization criteria of the primary color light sources from the color map and a desired output parameter, and control the plurality of the spectral optimization criteria based on the spectral optimization criteria The primary color light source generates the illumination spectrum. The color map includes a color point in a color space of each pixel. The color points are selected by the controller from the first sensing spectrum, the first image data, and the second sensing spectrum. And the second image data is generated. The device of claim 12, wherein the image sensor does not have wavelength resolution capability. The device of claim 12, which includes a housing in which the controller and the primary color light sources are located. The device of claim 12, wherein the controller and the primary color light sources are separately accommodated. The device of claim 12, wherein the controller accesses a look-up table to determine the spectrum optimization criterion.

Images