WO2008142616A1 - Procédé et unité de commande d'éclairage ambiant - Google Patents

Procédé et unité de commande d'éclairage ambiant Download PDF

Info

Publication number
WO2008142616A1
WO2008142616A1 PCT/IB2008/051912 IB2008051912W WO2008142616A1 WO 2008142616 A1 WO2008142616 A1 WO 2008142616A1 IB 2008051912 W IB2008051912 W IB 2008051912W WO 2008142616 A1 WO2008142616 A1 WO 2008142616A1
Authority
WO
WIPO (PCT)
Prior art keywords
video content
genre
lighting effect
lighting
ambient lighting
Prior art date
Application number
PCT/IB2008/051912
Other languages
English (en)
Inventor
Bram Kater
Ramon A. W. Clout
Dragan Sekulovski
Mauro Barbieri
Srinivas R Gutta
Johannes Weda
Original Assignee
Koninklijke Philips Electronics N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V. filed Critical Koninklijke Philips Electronics N.V.
Publication of WO2008142616A1 publication Critical patent/WO2008142616A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4345—Extraction or processing of SI, e.g. extracting service information from an MPEG stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/64—Constructional details of receivers, e.g. cabinets or dust covers

Definitions

  • the present invention relates to a method and a unit for control of ambient lighting, e.g. ambient lighting for a display device including an image display region. Further, the invention relates to a display device comprising such an ambient lighting control unit.
  • Ambient lighting or ambilight is a well-known concept that enhances the viewing experience when watching TV by means of ambient lighting, i.e. controllable light sources positioned outside the boundaries of the TV screen.
  • lamps are normally located behind the TV set, and an extension of the image is projected on the wall behind the TV.
  • the color and intensity of the ambilight is determined based on the actual video information according to a certain algorithm, such that the ambilight supports the image being displayed on the TV screen.
  • RGB Red-Green-Blue
  • WO 2005/069639 describes an example of a lighting effect concept where the color of the ambient lighting for each of the four sides of the video display is based on an average color of the outer region of the image, and thus the ambient lighting appears to extend the content of the displayed image.
  • the ambient lighting all around the display has the same color and intensity, this color and intensity being determined based on an average color and intensity of the entire image.
  • the ambient lighting has a fixed and preset color and intensity, independent on the image produced by the display.
  • different preset lighting effect concepts can be selected by the user, so as to allow the user to gain the best experience from the ambient lighting according to personal preferences.
  • an object of the present invention may be seen as an object of the present invention to provide an ambient lighting control method and system providing the user with an improved visual ambient lighting experience in which the ambient lighting effect follows the video content without the need for manual involvement in selecting between different lighting effect concepts.
  • the invention provides a method for controlling ambient lighting in response to video content, the method including determining a lighting effect concept based on data representing a genre of the video content, and - calculating control parameters for controlling the ambient lighting according to the lighting effect concept.
  • Such method is advantageous for automatic ambient lighting control since it takes into account the genre of the video content being displayed.
  • the lighting effect concept can be selected depending on the current video content, such that the ambient lighting suits the specific genre of the video content.
  • the preferred lighting effect concept is highly genre dependent.
  • genre dependent determination of the lighting effect concept it is possible to provide a "news bulletin concept” and an "action film concept” that will serve to provide different ambient lighting effects for an explosion scene in a news program and in an action film, e.g. a fixed color with low intensity lighting effect concept for the news program, and a high intensity, fast responding, full color type of lighting effect concept in the action film.
  • the best ambient lighting experience requires different lighting effect concepts for the film and for the commercials.
  • the ambient lighting is dimmed, set to constant light or completely switched off during commercials, while a more dynamic lighting effect concept with higher light intensity and brighter colors may be preferred to underline the content of the film.
  • a more dynamic lighting effect concept with higher light intensity and brighter colors may be preferred to underline the content of the film.
  • 'lighting effect concept' is understood the algorithm, strategy or mapping used to control the ambient lighting, e.g. in response to the video content.
  • the concept may be very simple, e.g. "switched off, or it may include a complicated relationship between parameters controlling the ambient lighting and attributes of the video content.
  • the lighting effect concept may define parameters for influencing the ambient lighting with respect to at least one of: color, light intensity, spatial distribution, and temporal evolution.
  • 'data representing a genre' is understood an indicator of the semantic content of the video content.
  • the indicator can indicate genres such as: news, documentary, film, sports, commercials etc.
  • the genre data may be received for a TV program from an external information source, e.g.
  • the method further includes generating the data representing a genre of the video content.
  • This generation of the data representing the genre may be based on an analysis of the video content, and/or it may be based on external information, e.g. information provided by an Electronic Program Guide (EPG) in case the content is a TV program, e.g. provided from the Internet.
  • EPG Electronic Program Guide
  • the genre data may be provided by as additional data on the same medium, e.g. a DVD, as the video content.
  • the method includes performing an image analysis on the video content, and wherein the calculation of the control parameters is based on a result of the image analysis.
  • Many lighting effect concepts are based on determining the ambient lighting control parameters based on attributes of the images being displayed, and thus such concepts require that the video content is concurrently analyzed with respect to those attributes in order to be able to calculate the control parameters according thereto.
  • a user input is received, and the calculation of the control parameters is then based on this user input.
  • the user can influence the choice of the lighting effect concept and/or influence at least some of the control parameters thereof according to his/her personal preferences.
  • the calculation of the control parameters may be influenced by the user input by the determination of lighting effect concept being based on the user input.
  • the user input may be used to influence the choice of lighting effect concept for a given genre, e.g. by defining a set of relations between genre and lighting effect concepts, or by altering a pre-defined set of relations.
  • the determination of a lighting effect concept is based on selecting one from a predefined set of lighting effect concepts.
  • the method may include determining different lighting effect concepts for separate sections of the video content.
  • the program may include separate sections with different genres or sub genres assigned thereto, and thus the method may determine different lighting effect concepts to these separate sections in order to best possible match the ambient lighting to the content of the separate sections, e.g. "news report” and "weather report” of a news program.
  • the video content is a film, it may be preferred to assign separate lighting effect concepts to "introduction", and "ending” parts, e.g. to use the ambient lighting to emulate normal cinema lighting in such parts.
  • the invention provides a control unit arranged to control ambient lighting in response to video content, the control unit comprising a processor arranged to determine a lighting effect concept based on data representing a genre of the video content, and - calculate control parameters for controlling the ambient lighting according to the lighting effect concept.
  • the invention provides an ambient lighting system arranged for providing ambient lighting in response to video content, the system comprising a control unit according to the second aspect, and light sources arranged to receive the control parameters and emit light accordingly.
  • the invention provides a display device arranged to display video content, the device comprising a display region arranged to display an image according to the video content, and the ambient lighting system according to the third aspect, wherein the light sources at least partly peripherally surround the display region.
  • the display device is selected from: computer monitor display, cathode ray tube (CRT) display, a liquid crystal display (LCD), a plasma discharge display, a projection display, thin-film printed optically-active display, or a display using functionally equivalent display technology.
  • the display device may be a TV set.
  • the invention provides a computer executable program code arranged to perform the method according to the first aspect.
  • the program code may be suited for a dedicated processor or it may be suited for a general purpose processor, e.g. a processor in a Personal Computer (PC).
  • PC Personal Computer
  • the invention provides a data carrier including data representing the computer executable program code according to the fifth aspect.
  • the data carrier may be such as: a hard disk, a CD, a DVD, a memory card, a memory stick etc.
  • Fig. 1 illustrates a block diagram of a first ambient lighting control unit embodiment
  • Fig. 2 illustrates a block diagram of a second ambient lighting control unit embodiment
  • Fig. 3 illustrates a block diagram of a third ambient lighting control unit
  • Fig. 4 illustrates a block diagram of a display device embodiment.
  • Fig. 1 shows a block diagram of a simple ambient lighting control unit embodiment CU for controlling ambient lighting AL in response to a video input signal V.
  • the input signal V representing video content is received by the control unit CU and applied to a genre generator GG that performs an analysis on a sequence of images of the video content according to an algorithm and assigns and generates in response a genre indicative of the video content, e.g. a genre from a predefined set of genres.
  • This genre is applied to a lighting effect concept determining unit DLC that determines a lighting effect concept based on the genre.
  • the DLC unit determines the concept based on a simple tabulated connection between genre and concept.
  • the determined concept is applied to an ambient lighting control parameters calculator CLC that calculates the control parameters to control the ambient lighting AL.
  • the CLC unit takes the video signal V as input and applies the determined concept to the video signal V in the calculation of the ambient lighting control parameters.
  • the process of generating data representing the genre of video content can be performed by analyzing the video content in a variety of ways such as described e.g. in 1) "Cartoon detection using low-level AV features", F. Snijder, P. Merlo, Third International Workshop on Content-Based Multimedia Indexing (CBMI 2003), September 2003, Rennes, France, 2) "Classification of video genre using audio", M. Roach and J. Mason, Eurospeech, 2001, or 3) "Classification of TV programs based on audio information using hidden Markov model," Z. Liu, J. Huang, and Y. Wang, in IEEE Workshop Multimedia Signal Processing (MMSP-98), Los Angeles, CA, Dec. 7-9, 1998, pp. 27-32.
  • MMSP-98 Multimedia Signal Processing
  • genre of a TV program can be determined using Electronic Program Guide service of broadcasts, see e.g. "TV Anytime Forum", http://www.tv- anytime.org.
  • Fig. 2 shows a second control unit CU embodiment, where a video signal V is taken as input and control signals for control of ambient light sources AL are output in response.
  • a genre classification GC is performed based on the video input signal V and a signal representing external information EI from an external source of information.
  • EI external information
  • such source of information may be an EPG service can be used to determine overall genre of a TV program, while the video signal V itself can be analyzed so as to be able to determine sub genres for different sections of the program.
  • the classified genre is then applied to a lighting effect concept determination unit DLC that selects the calculation concept to be used in the color calculation CC, e.g. by adjusting one or a few parameters depending on the genre.
  • the video signal V is analyzed in a color analyzer CA where color features of the video signal are determined. These features are applied to the color calculation unit CC that applies the determined concept to the extracted features and generates ambient lighting control signal accordingly.
  • the lighting concept determination DLC may be based on a simple table as below, describing predefined parameter settings for each genre to be used in the color calculation CC:
  • the "Leaky TV” concept can be used in the case of movie-genre to emphasize the special effects, and in the case of sport events or documentaries the “Lighting Estimation” can be applied to simulate the environment of the video for the viewer.
  • the DLC can take an input UI from the user. This can be used to affect the predefined parameter settings, e.g. with respect to preferred color in case of "constant color" concepts, or with respect to general light intensity. Further, the user input UI may be used to over-rule the automatic genre based lighting effect concept and select another predefined concept. Still further, the user input UI may be used to alter and/or construct the lighting effect concept determination DLC. E.g. the user may re-define the table describing predefined parameter settings for each genre to be used in the color calculation CC, e.g. the user may define or re-define the relation between genre and lighting effect concept to be used for each genre.
  • Fig. 3 illustrates a third control unit embodiment CU.
  • a genre classification GC is performed based on the video signal V and additional external information EI.
  • the video signal is also analyzed in a color analyzer CA to extract specific features of the video signal V. These features are then used in the color calculation CC, which in this embodiment can be a fixed algorithm that calculates control ambient lighting control parameters according to the extracted video features.
  • the genre dependency in this embodiment is introduced by a genre dependent modification filter GDMF which is a filter following the color calculation CC and before applying the control signals to the ambient light sources AL.
  • the properties of this GDMF filter depends on the classified genre and on user input UI in a manner similar to that explained for the second embodiment.
  • This filter GDMF may e.g.
  • the genre dependency according to the third embodiment is easy to implement in existing systems since the CA and CA components of an existing lighting effect concept, e.g. "Leaky TV", can be used and while the GC and GDMF are introduced to genre dependently modify the ambient lighting control parameters generated by the existing components.
  • the user may influence the GDMF filter by a user input UI in order to affect the ambient lighting effect determined by the control unit CU.
  • Fig. 4 illustrates in block diagram form a display device DD, e.g. a TV set with an LCD display region DR and ambient light source ALl, AL2 placed on sides of the TV set.
  • the display device DD includes the control unit CU which can be implemented as one of the mentioned embodiments, or as a combination of the described embodiments.
  • the control unit CU takes a video input signal V as input and generates ambient lighting control parameters for control of the sources ALl, AL2 accordingly.
  • the control unit CU further takes a user input UI that allows the user to influence the ambient lighting effect generated by the control unit CU, such as explained above.
  • a method for control of ambient lighting that can be used to automatically generate ambient lighting effects that in a natural way follow video content.
  • the method includes determining a lighting effect concept based on data representing a genre of the video content, and then calculate control parameters for controlling the ambient lighting according to the determined lighting effect concept.
  • the genre of the video content may be based on analyzing the video content according to known methods, and/or based on external information, e.g. Electronic Program Guide services. It may be preferred to allow different genre classifications at program level as well as section levels so as to allow different lighting effect concepts in different sections of one TV program.
  • the genre dependency is implemented by selecting between different predefined lighting effect concepts, e.g. color calculation concepts.
  • the genre dependency is implemented by a filter modifying at least some of the ambient control parameters generated by a fixed calculation concept.
  • a user input may be used to influence e.g. the determination of lighting effect concept in response to the genre of the video content.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

L'invention propose un procédé de commande d'éclairage ambiant qui peut être utilisé pour générer automatiquement des effets d'éclairage ambiant suivant naturellement un contenu vidéo. Le procédé inclut la détermination d'un concept d'effet d'éclairage selon des données représentant un genre du contenu vidéo; le calcul de paramètres de commande pour commander l'éclairage ambiant selon le concept d'effet d'éclairage déterminé. Le genre du contenu vidéo peut se fonder sur une analyse du contenu vidéo selon des procédés connus et/ou sur des informations externes, par exemple des services de guide de programme électronique. Il peut être préférable d'autoriser différentes classifications de genre au niveau programme ainsi qu'aux niveaux sections de façon à autoriser différents concepts d'effet d'éclairage dans différentes sections d'un seul programme TV. Dans certains modes de réalisation, la dépendance sur le genre est mise en œuvre par une sélection entre différents concepts d'effet d'éclairage prédéfini (10), par exemple des concepts de calcul de couleur. Dans certains modes de réalisation, la dépendance sur le genre est mise en œuvre par un filtre modifiant au moins certains des paramètres de commande d'ambiance générés par un concept de calcul fixe. Une entrée d'utilisateur peut être utilisée pour influer, par exemple sur la détermination du concept d'effet d'éclairage, en réponse au genre du contenu vidéo.
PCT/IB2008/051912 2007-05-22 2008-05-15 Procédé et unité de commande d'éclairage ambiant WO2008142616A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP07108630.0 2007-05-22
EP07108630 2007-05-22

Publications (1)

Publication Number Publication Date
WO2008142616A1 true WO2008142616A1 (fr) 2008-11-27

Family

ID=39739949

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2008/051912 WO2008142616A1 (fr) 2007-05-22 2008-05-15 Procédé et unité de commande d'éclairage ambiant

Country Status (1)

Country Link
WO (1) WO2008142616A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2916557A1 (fr) * 2014-03-05 2015-09-09 Samsung Electronics Co., Ltd Appareil d'affichage et son procédé de commande
GB2557884A (en) * 2016-06-24 2018-07-04 Sony Interactive Entertainment Inc Device control apparatus and method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004006570A1 (fr) * 2002-07-04 2004-01-15 Koninklijke Philips Electronics N.V. Procede et systeme de commande de lumiere ambiante et d'unite d'eclairage
WO2004006578A2 (fr) * 2002-07-04 2004-01-15 Koninklijke Philips Electronics N.V. Procede et systeme de regulation de la lumiere ambiante et unite d'eclairage
WO2005069640A1 (fr) * 2004-01-06 2005-07-28 Koninklijke Philips Electronics, N.V. Codage de commande de scenario de lumiere ambiante
WO2005069637A1 (fr) * 2004-01-05 2005-07-28 Koninklijke Philips Electronics, N.V. Lumiere ambiante derivee d'un contenu video par mise en correspondance de transformations a travers un espace colore non rendu
JP2005295262A (ja) * 2004-03-31 2005-10-20 Toshiba Corp 番組受信システム及び番組受信装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004006570A1 (fr) * 2002-07-04 2004-01-15 Koninklijke Philips Electronics N.V. Procede et systeme de commande de lumiere ambiante et d'unite d'eclairage
WO2004006578A2 (fr) * 2002-07-04 2004-01-15 Koninklijke Philips Electronics N.V. Procede et systeme de regulation de la lumiere ambiante et unite d'eclairage
WO2005069637A1 (fr) * 2004-01-05 2005-07-28 Koninklijke Philips Electronics, N.V. Lumiere ambiante derivee d'un contenu video par mise en correspondance de transformations a travers un espace colore non rendu
WO2005069640A1 (fr) * 2004-01-06 2005-07-28 Koninklijke Philips Electronics, N.V. Codage de commande de scenario de lumiere ambiante
JP2005295262A (ja) * 2004-03-31 2005-10-20 Toshiba Corp 番組受信システム及び番組受信装置

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2916557A1 (fr) * 2014-03-05 2015-09-09 Samsung Electronics Co., Ltd Appareil d'affichage et son procédé de commande
US9900663B2 (en) 2014-03-05 2018-02-20 Samsung Electronics Co., Ltd. Display apparatus and control method thereof
GB2557884A (en) * 2016-06-24 2018-07-04 Sony Interactive Entertainment Inc Device control apparatus and method

Similar Documents

Publication Publication Date Title
RU2460248C2 (ru) Комбинированное управление окружающим освещением на основе видеосодержимого и аудиосодержимого
WO2006129627A1 (fr) Dispositif d’affichage d’image et méthode d’affichage d’image
US11765426B2 (en) Modifying playback of replacement content based on control messages
US11895370B2 (en) Modifying playback of replacement content responsive to detection of remote control signals that control a device providing video to the playback device
KR20060113708A (ko) 주위의 비디오 콘텐트에 기초한 자막 텍스트의 적응
KR20200144775A (ko) 디스플레이장치 및 그 제어방법
US11937026B2 (en) Responsive to detection of remote control signals that modify operation of the playback device
Redi Visual quality beyond artifact visibility
WO2008142616A1 (fr) Procédé et unité de commande d'éclairage ambiant
WO2007113740A1 (fr) Commande de filtre d'éclairage ambiant
JP7508732B2 (ja) 再生装置の動作を変更するリモコン信号の検出に応答した置換メディアコンテンツ再生の変更
KR20160081349A (ko) 디스플레이 제어 방법 및 미디어 재생 장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08751205

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 08751205

Country of ref document: EP

Kind code of ref document: A1