CN101573976A - Transmission device, view environment control device, and view environment control system - Google Patents

Transmission device, view environment control device, and view environment control system Download PDF

Info

Publication number
CN101573976A
CN101573976A CNA2007800488761A CN200780048876A CN101573976A CN 101573976 A CN101573976 A CN 101573976A CN A2007800488761 A CNA2007800488761 A CN A2007800488761A CN 200780048876 A CN200780048876 A CN 200780048876A CN 101573976 A CN101573976 A CN 101573976A
Authority
CN
China
Prior art keywords
data
visual environment
audio visual
mentioned
lighting device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CNA2007800488761A
Other languages
Chinese (zh)
Inventor
岩波琢也
吉田育弘
大木康宽
吉井隆司
石河学
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sharp Corp
Original Assignee
Sharp Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sharp Corp filed Critical Sharp Corp
Publication of CN101573976A publication Critical patent/CN101573976A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4131—Peripherals receiving signals from specially adapted client devices home appliance, e.g. lighting, air conditioning system, metering devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/57—Control of contrast or brightness
    • H04N5/58—Control of contrast or brightness in dependence upon ambient light
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
    • H05B47/10—Controlling the light source
    • H05B47/155—Coordinated control of two or more light sources

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Automation & Control Theory (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Circuit Arrangement For Electric Light Sources In General (AREA)

Abstract

The present invention discloses a data transmission device (1) that sends image data with (i) reference data relating to a position of at least one illumination device in a virtual audio-visual environment space and (ii) illumination control data for controlling each of the at least one illumination device in the virtual audio-visual environment space. An image receiving device (audio-visual environment control device) (4) uses the audio-visual environment reference data and audio-visual environment data for each of a position of at least one illumination device in an actual audio-visual environment space so as to convert the illumination control data into illumination control data for appropriately controlling the illumination device in the actual audio-visual environment. This allows appropriate illumination control according to the actual audio-visual environment.

Description

Dispensing device, audiovisual environment control device and audio-visual environment control system
Technical field
The audio-visual environment control system that the present invention relates to dispensing device, audiovisual environment control device and possess this audiovisual environment control device, wherein, the position corresponding reference data of the lighting device of this dispensing device in looking transmission of hearer side and virtual audio visual environment space, this audiovisual environment control device uses the reference data of sending from transmit leg, generates to be used for illumination control data that the illumination light of the set lighting device in actual audio visual environment space is controlled.
Background technology
In recent years, along with the fast development of video, electronic technology that audio frequency is relevant, maximization, looking away angling, display technology that height becomes more meticulous and the technology of surround sound system have also obtained further developing, thereby the user also can appreciate and has video or the audio frequency that body faces sense.For example, about the present home theater of popularizing,, realized having the audiovisual system that higher body faces sense by giant display or screen and multichannel audio or sound technique are made up.
Particularly recently, except using a display unit to appreciate the video, people have also proposed utilization: a plurality of displays are made up with the system of the wide visual field of audiovisual video and the system that makes the illumination light generation interlock of shown video of display and lighting device.Therefore, people's combination of just being devoted to develop by a plurality of medium further strengthens the system that body faces sense.
Particularly realize that for interlock high body faces the technology of sense, do not face sense even do not use giant display also can obtain high body by display and lighting device, so, the restriction that it is not subjected to cost or the space is set, thus extremely expect and gaze at.
This technology is to control the illumination light of looking set in the hearer room (audio visual environment space) a plurality of lighting devices according to vedio color shown in the display and intensity, therefore, can give and look the hearer and bring as body and face sensation or effect in the shown sdi video of display.Technology about the illumination light that makes shown image of display and lighting device links for example has announcement in patent documentation 1.
The technology that is disclosed in the patent documentation 1 be with provide high body face the sense be purpose, wherein put down in writing following method: in illuminator, controlling a plurality of lighting devices links itself and the video that will show, according to the characteristic quantity (representational color, mean flow rate) of video data, generate the illumination control data that is used to control a plurality of lighting devices.Particularly, can change the picture area that is used to detect the video data characteristic quantity according to predefined arranged illumination devices position.
In addition, in the record of patent documentation 1, not only can come computing to obtain the illumination control data according to the characteristic quantity of video data, also can use the illumination control data that sends separately via the Internet etc., perhaps can also use the illumination control data that sends with video data via the Internet, in addition, also can use by the transmission illumination control data that ripple sent.
Patent documentation 1: the patent application Publication Laid-Open 2001-343900 of Japan communique, open day: December 24 calendar year 2001.
Summary of the invention
As mentioned above, in patent documentation 1 record, the illumination control data can wait from the outside and by the Internet and send.Yet, in above-mentioned patent documentation 1, the illumination control data be only with the corresponding illumination control data of the layout of fixed lighting device (the arranged illumination devices position in the virtual audio visual environment space) in advance, can not control rightly set lighting device in the actual audio visual environment space different with looking hearer's difference.Promptly, in above-mentioned prior art, the illumination control data that external device (ED) sent can't be converted to actual audio visual environment space in the corresponding illumination control data of set arranged illumination devices position/quantity, so can't be corresponding to different and appropriate illumination control is carried out in different actual audio visual environment space with looking the hearer.
The present invention is in view of above-mentioned prior art problems point and developing, purpose is to provide a kind of data sending device, audiovisual environment control device and audio-visual environment control system, wherein, by this data sending device, audiovisual environment control device and audio-visual environment control system, can utilize that external device (ED) sends, with the corresponding illumination control data of virtual audio visual environment, carry out appropriate illumination control accordingly with actual audio visual environment space.
The present invention solves the problems referred to above by following technology.
Promptly, data sending device of the present invention is the device that is used to send video data, it is characterized in that, have: sending part, with reference data be used for the throw light on illumination control data of control of the lighting device of virtual audio visual environment space more than 1 is attached in the above-mentioned video data and sends, wherein, above-mentioned reference data is the data about the lighting device present position more than 1 in above-mentioned virtual audio visual environment space.
Data sending device of the present invention is characterised in that to have: data store, with each programme content accordingly, storage is about the reference data of the lighting device present position more than 1 in virtual audio visual environment space; Acceptance division receives the transmission request that is used to ask to send reference data from external device (ED), and wherein, above-mentioned reference data is corresponding with the programme content of any video data; Sending part, to the external device (ED) that sends the requesting party send be requested to send, with programme content corresponding reference data.
Data sending device of the present invention is characterised in that, have: data store, with each programme content accordingly, storage is about the reference data of the lighting device present position more than 1 in virtual audio visual environment space, and, the storage be used for to the lighting device of above-mentioned virtual audio visual environment space more than 1 throw light on control the illumination control data; Acceptance division is used to ask to send and the programme content corresponding reference data of video data and the transmission request of illumination control data arbitrarily from the external device (ED) reception; Sending part, to the external device (ED) that sends the requesting party send be requested to send, with programme content corresponding reference data and illumination control data.
It is characterized in that of audiovisual environment control device of the present invention, have: acceptance division, the reference data that receiving video data and being attached to sends in this video data and being used for to the throw light on illumination control data of control of the lighting device of virtual audio visual environment space more than 1, wherein, above-mentioned reference data is the data about the lighting device present position more than 1 in above-mentioned virtual audio visual environment space; Storage part, storage is about the audio visual environment data of the arranged illumination devices position more than 1 in actual audio visual environment space; Illumination control data converter section, according to audio visual environment data of being stored in the above-mentioned storage part and the reference data that above-mentioned acceptance division received, with the illumination control data that above-mentioned acceptance division received convert to be used for to the lighting device of above-mentioned actual audio visual environment space more than 1 throw light on control the illumination control data.
Audiovisual environment control device of the present invention is characterised in that, have: that the 1st acceptance division, receiving video data and being attached to send in this video data, be used for the throw light on illumination control data of control of the lighting device of virtual audio visual environment space more than 1; Sending part sends the transmission request be used to ask to send with the programme content corresponding reference data of above-mentioned video data to external device (ED), and this reference data is the data about the lighting device present position more than 1 in above-mentioned virtual audio visual environment space; The 2nd acceptance division receives according to above-mentioned transmission request programme content corresponding reference data that sent and above-mentioned video data; Storage part, storage is about the audio visual environment data of the arranged illumination devices position more than 1 in actual audio visual environment space; Illumination control data converter section, the reference data that is received according to the audio visual environment data of being stored in the above-mentioned storage part and above-mentioned the 2nd acceptance division, the illumination control data that above-mentioned the 1st acceptance division is received convert to and are used for the throw light on illumination control data of control of the lighting device of above-mentioned actual audio visual environment space more than 1.
Audiovisual environment control device of the present invention is characterised in that to have: the 1st acceptance division, receiving video data; Sending part, be used to ask to send and the programme content corresponding reference data of above-mentioned video data and the transmission request of illumination control data to the external device (ED) transmission, wherein, above-mentioned reference data is the data about the lighting device present position more than 1 in virtual audio visual environment space, above-mentioned illumination control data be used for to the lighting device of above-mentioned virtual audio visual environment space more than 1 throw light on control data; The 2nd acceptance division receives according to above-mentioned transmission request programme content corresponding reference data that send and video data and illumination control data; Storage part, storage is about the audio visual environment data of the arranged illumination devices position more than 1 in actual audio visual environment space; Illumination control data converter section, the reference data that is received according to the audio visual environment data of being stored in the above-mentioned storage part and above-mentioned the 2nd acceptance division, the illumination control data that above-mentioned the 2nd acceptance division is received convert to and are used for the throw light on illumination control data of control of the lighting device of above-mentioned actual audio visual environment space more than 1.
According to the present invention, look hearer side by being sent to about the reference data of arranged illumination devices position in virtual audio visual environment space, the hearer that looks who has received this reference data can be enough be used for illumination control data that the lighting device in actual audio visual environment space is controlled with being used for the illumination control data that the lighting device in virtual audio visual environment space is controlled converted to.Its result looks the hearer and can enough carry out appropriate illumination control according to actual audio visual environment.
Description of drawings
Fig. 1 is the block diagram of schematic configuration of the video transmission device of expression first embodiment of the invention.
Fig. 2 is the key diagram of an example of expression audio visual environment reference data.
Fig. 3 is expression, the key diagram of the summary of the part layer structure in the motion video numeralization data of MPEG2 system defined.
Fig. 4 is the block diagram of schematic configuration of the video receiving apparatus of expression first embodiment of the invention.
Fig. 5 is the key diagram of an example that hearer's audio-visual space environment is looked in expression.
Fig. 6 is the key diagram that is used for the audio visual environment data instance in the audio visual environment space shown in the presentation graphs 5.
Fig. 7 is the key diagram of expression by the virtual audio visual environment shown in the audio visual environment reference data among Fig. 2.
Fig. 8 is the key diagram of an example of expression illumination control data.
Fig. 9 is the schematic illustration of an example of illumination control data conversion method.
Figure 10 is the key diagram that is used to illustrate an embodiment of illumination control data conversion.
Figure 11 is a schematic illustration of representing other illumination control data conversion method example.
Figure 12 is schematic illustration when being illustrated in the virtual audio visual environment that uses among Fig. 2 shown in the audio visual environment reference data, other illumination data conversion method examples.
Figure 13 is illustrated in the key diagram shown in Figure 12 lighting device set in the actual audio visual environment space according to the figure when the wall of virtual audio visual environment space.
Figure 14 is illustrated in when using illumination control data conversion method shown in Figure 13 the key diagram that area conversion process to actual audio visual environment space describes.
Figure 15 is schematic illustration of other illumination control datas conversion examples when being illustrated in the represented virtual audio visual environment of the audio visual environment reference data used among Fig. 2.
Figure 16 is the key diagram of other audio visual environment reference data examples of expression.
Figure 17 is the key diagram of expression by the virtual audio visual environment space shown in the audio visual environment reference data among Figure 16.
Figure 18 is a key diagram of representing the two-dimensional arrangement of lighting device set on the ceiling in the audio visual environment space among Figure 17.
Figure 19 is the key diagram of other audio visual environment data examples of expression.
Figure 20 is the key diagram of expression by the actual audio visual environment shown in the audio visual environment data among Figure 19.
Figure 21 is a key diagram of representing the two-dimensional arrangement of lighting device set on the ceiling in the audio visual environment space among Figure 20.
Figure 22 is the flow chart of an example of the action of expression illumination control data converter section.
Figure 23 is the key diagram that expression is used to illustrate the area conversion process in actual audio visual environment space.
Figure 24 is the key diagram that expression is used to illustrate illumination control data switching motion.
Figure 25 is the block diagram of schematic configuration of the video transmission device of expression second embodiment of the invention.
Figure 26 is the block diagram of schematic configuration of the video receiving apparatus of expression second embodiment of the invention.
Figure 27 is the block diagram of the external service apparatus of expression second embodiment of the invention.
Figure 28 is the block diagram of schematic configuration of the video receiving apparatus of expression third embodiment of the invention.
Figure 29 is the block diagram of schematic configuration of the external service apparatus of expression third embodiment of the invention.
(label declaration)
1,31,51 data sending devices
2, the multiple portion of 22 data
3,23 sending parts
4,24,34 video receiving apparatus
5 acceptance divisions
6,26 data separating unit
7 video display devices
8 audio frequency replaying apparatus
9 illumination control data converter sections
10 audio visual environment data store
11 lighting devices
12a, 12b postpone generating unit
21 video transmission devices
25,45 the 1st acceptance divisions
27,47 sending parts
28,48 the 2nd acceptance divisions
29、49 CPU
32,52 acceptance divisions
33,53 data store
34,54 sending parts
101,102 video display devices
Embodiment
Below, describe in detail referring to figs. 1 through Figure 29 and to be used for data receiving-transmitting system of the present invention.
(first execution mode)
Fig. 1 is the block diagram of schematic configuration of the data sending device of expression first embodiment of the invention.This data sending device 1 has data multiple 2 and sending part 3.Multiple 2 of data are incited somebody to action corresponding mutually video data, voice data, illumination control data and audio visual environment reference data with transport stream data packet (TransportStream packet; TSP) after form is cut apart, carry out multipleization processing.
Data multiple 2 video data that is received, voice data, illumination control data and audio visual environment reference data are the data of sending by the device that can communicate with data sending device 1 (for example, be used to broadcast database).
3 pairs of sending parts have carried out the data after multipleization by multiple 2 of data, and additional error is corrected mark, carry out modulation thereafter, and the data after will modulating are sent to delivering path as broadcast data.
The audio visual environment reference data is meant the virtual audio visual environment data that transmit leg is contemplated, and as shown in Figure 2, the position of each lighting device in the virtual audio visual environment space and each ID (identifier) record and narrate with the form of table accordingly.
In other words, the audio visual environment reference data has been represented the configuration of the lighting device more than 1 that disposed in virtual audio visual environment space, wherein, include video display devices in this virtual audio visual environment space.
At this, the position of each lighting device in the virtual audio visual environment space represents that by following coordinate system this coordinate system is meant: the picture center with the video display devices in the virtual audio visual environment space is the coordinate system of initial point (0,0,0).That is to say that the position of each lighting device in virtual audio visual environment space is to represent by the relative position of lighting device and video display devices.
In addition, the illumination control data is meant, is used for data that the illumination of each lighting device in virtual environment space is controlled, in other words, and the control data controlled of each lighting device that the audio visual environment reference data is recorded and narrated exactly.
In this illumination control data, except the ID of 6 bits, also additional be useful on the control lighting device corresponding with this ID, respectively be the control data that the redness (R) of 8 bits, green (G), blueness (B) are controlled.
As mentioned above, we can say that the represented audio visual environment of audio visual environment reference data is the prerequisite that generates the illumination control data.
Fig. 3 is the key diagram of the summary of the part layer structure in the motion video numeralization data of expression MPEG2 (Moving Picture Experts Group 2) system's defined.In the numeralization data of the sequence that constitutes by a plurality of consecutive images, contain sequence layer, GOP (Group Of Pictures: image sets) layer, image layer, as 6 layers layer structure of bar layer (slice layer), macro block (macro block) layer and picture piece layer (not shown).In image layer, be picture header information ahead, contain the data (as bar) of a plurality of picture bar layers thereafter continuously.
In the picture header information zone, except having image head zone (picture header), also be provided with user data (the extensions and user data) zone that to record and narrate any additional information, wherein, record and narrate the predetermined various information such as scale that image type, frame integral body are arranged in this image head zone.For example, in the present embodiment, this user data area is recorded and narrated above-mentioned illumination control data.
As mentioned above, the illumination control data is that unit is affixed to video data with a frame.But, also can be that unit is additional to video data with the audio visual environment reference data with the frame, can be with the audio visual environment reference data with proper spacing, be additional to video data termly or aperiodically, for example, can add according to the scene that is associated with plot in the video data.
For example, with video data and voice data as sending as the bar data, to throw light on control data, audio visual environment reference data adds transmission as user data, but also can carry out multipleization and implement transmission different mutually video data streams, audio data stream, illumination control data stream, audio visual environment reference data stream.
In addition, in the present embodiment, 4 kinds of data are carried out sending as broadcast data after the multipleization processing.But carrying out multipleization processing is not necessary condition, can select suitable sending method as required yet.For example, can not carry out multipleization processing yet and each data is sent separately, video data, voice data and illumination control data can be carried out multipleization processing yet, and only the audio visual environment reference data be sent separately.
Fig. 4 is the block diagram of schematic configuration of the video receiving apparatus (audiovisual environment control device) of expression first embodiment of the invention.In this video receiving apparatus 4, acceptance division 5 receives by the broadcast data after video data, voice data, illumination control data and audio visual environment reference data carry out multipleization, and data separating unit 6 is separated video data, voice data, illumination control data and audio visual environment reference data from broadcast data.
Video data that data separating unit 6 is separated and voice data are sent to video display devices 7 and audio frequency replaying apparatus 8 respectively.Illumination control data that data separating unit 6 is separated and audio visual environment reference data are sent to illumination control data converter section 9.
Audio visual environment information storage part 10 shown in Figure 4 is used for storing the positional information (audio visual environment data) of each set lighting device of the audio visual environment space of looking the hearer, it suitably sends to illumination data converter section 9 according to the order of illumination control data converter section 9 with these audio visual environment data.
For example, as shown in Figure 5, in looking hearer's audio visual environment space, be provided with 7 lighting devices around the video display devices 201, lighting device v3 ' is provided with the lighting device of formula for ceiling, and other lighting devices are the highly different removable lighting devices that formula is set.In this case, as shown in Figure 6, about the audio visual environment data, in the actual audio visual environment space set arranged illumination devices position be with the ID (identifier) of each lighting device accordingly, record and narrate with the form of table.
At this, the position of each lighting device that is provided with in the actual audio visual environment space represents that by following coordinate system this coordinate system is meant: the picture center with the video display devices in the actual audio visual environment space is the coordinate system of initial point (0,0,0).That is to say that the position of each lighting device that is provided with is to represent by the relative position of each lighting device and the video display devices in actual audio visual environment space in actual audio visual environment space.
Obtain the method for the audio visual environment data of above-mentioned reality of looking hearer side about video receiving apparatus 4, for example, the position that is provided with that transducers such as optical sensor automatically detect lighting device 11 can be set on video display devices 7, also can utilize GUI (Graphical User Interface: graphic user interface) wait the position that is provided with of importing lighting device 11 by looking the hearer.About obtaining of audio visual environment data, be not limited to said method, also can use additive method.
In addition, in order to control each lighting device 11 accordingly separately, need to give ID (identifier) to each lighting device 11 respectively with the position that is provided with of each lighting device 11.Or, with each lighting device 11 respectively with separately independently terminal link to each other, sending illumination respectively from each terminal during control data, make each terminal and lighting device 11 possess corresponding relation, thus can be to each lighting device 11 transmission appropriate illumination control data.
Illumination control data converter section 9 separates the audio visual environment reference data that obtains according to data separating unit 6 and from the obtained audio visual environment data of audio visual environment data store 10, the illumination control data that obtains that data separating unit 6 is separated converted to be used for looking the illumination control data that the set lighting device 11 in hearer's actual audio visual environment of living in space is appropriately controlled, and the control data that should throw light on is exported to lighting device 11.
That is to say, illumination control data converter section 9 is obtained the audio visual environment data from audio visual environment data store 10, this audio visual environment data representation the allocation position of the lighting device 11 in actual audio visual environment space, wherein, also be provided with in this actual audio visual environment space and be used for the actual video display devices 7 that video is shown.Then, illumination control data converter section 9 pairs of illumination control datas that received are changed (or generation), make by at the lighting device 11 resulting illuminating effects on the allocation position of the represented reality of audio visual environment data (position of the lighting device 11 that detected of lighting position test section promptly) and utilize illumination control data that acceptance division 5 received to situation about controlling in the illumination of the lighting device that disposes on the position shown in the audio visual environment reference data under resulting illuminating effect be similar to.
In addition, illumination control data converter section 9 uses the illumination control data (particularly, the illumination control data after changing being sent to corresponding each lighting device 11) after the conversion corresponding with each lighting device 11, and each lighting device 11 is controlled.Therefore, video receiving apparatus 4 has the function that the lighting device that is disposed in the actual audio visual environment space is controlled as control device, is provided with the video display devices 7 that carries out actual displayed in this actual audio visual environment space.
In addition, owing to need make the output of the illumination control data that is sent to lighting device 11 regularly regularly consistent with the output of video data, voice data, so, to postpone output to video data and the voice data that data separated part 6 is separated, for synchronous, be provided with and be used to realize synchronous delay generating unit 12a, 12b with the illumination control data.About the output delay time of video data and voice data, when the control data generating unit 9 that for example is equivalent to throw light on is used to generate the illumination control data required in case of necessity between.
In addition, can use arrange with some cycles, can carry out alone that the led light source of the R of light emitting control (red), G (green), B (indigo plant) is used as lighting device 11, can launch illumination light by this trichromatic led light source with the color that requires, brightness.About lighting device 11, as long as can come the illumination look and the brightness of control of video display unit 7 surrounding environment just can by it, it is not defined as the led light source combination of above-mentioned emission institute predetermined color light, it also can be made of White LED and colour filter, also can realize, or also can wait and realize by lampion by the combination of white bulb and colour filter or the combination of fluorescent tube and colour filter.
In addition, video receiving apparatus (audiovisual environment control device) 4 and video display devices 7, audio frequency replaying apparatus 8 can be set to one, also it can be divided separately to be arranged.
As mentioned above, the video receiving apparatus of present embodiment can convert the illumination control data obtained from the outside to the illumination control data corresponding with actual audio visual environment, therefore can control rightly with looking set lighting device 11 in the different and different audio visual environment space of hearer.
Below, illumination control data converter section 9 is utilized audio visual environment reference data and the actual audio visual environment data of looking hearer side, will be from the outside the obtained illumination control data method that converts desired illumination control data to describe.
Fig. 7 is the allocation plan of expression by the virtual audio visual environment shown in the audio visual environment reference data among Fig. 2.Fig. 7 has schematically shown: the position of the lighting device in the contemplated virtual audio visual environment space of transmit leg (broadcasting station side).At this, described audio visual environment reference data has been recorded and narrated the position that is provided with shown in Figure 7, promptly, around video display devices 101 (8 corners in audio visual environment space) dispose 8 lighting device v1 to v8.In addition, as mentioned above, be initial point (0 preferably by picture center with video display devices 101,0,0) x axle, y axle, z axle three-dimensional coordinate come the three-dimensional space position of each lighting device v1 to v8 in the defining virtual audio visual environment space, and preferred y axle is consistent with the normal direction of the picture of video display devices 101.
Fig. 7 has represented an example in virtual audio visual environment space, and the coordinate system of looking actual the audio visual environment space of hearer side also can similarly define.This is because color, the brightness of the light that lighting device will shine are to be determined by the relative position relation between video display devices and the lighting device.Like this coordinate system in definition audio visual environment space, the lighting device position that lighting device position that the audio visual environment reference data recorded and narrated and the audio visual environment data of looking hearer side are recorded and narrated all is relative position relation with video display devices.For example, when the position of lighting device and the position of looking actual lighting device in the audio visual environment of hearer side compare in to virtual audio visual environment space, just need not to make position, the corresponding to computing of picture direction of video display devices in each audio visual environment space.In addition, by foregoing, can from audio visual environment reference data and audio visual environment data, save position data, the picture direction of the video display devices in the audio visual environment space.
The illumination control data is the information that is used for controlling respectively above-mentioned 8 lighting device v1 to v8 shown in Figure 8, this illumination control data that passes through to be generated can carry out optimal illumination control accordingly with the shown video of the video display devices 101 in the virtual audio visual environment.Therefore, when using this illumination control data to control lighting device in the virtual audio visual environment space, can realize optimal illumination control, thereby the body when improving the video demonstration faces sense.
Fig. 5 is the allocation plan of the actual audio visual environment shown in the audio visual environment data among Fig. 6, this audio visual environment data representation in the actual audio visual environment space position of lighting device.Fig. 5 has schematically represented the position of lighting device set in the actual audio visual environment space.Above-mentioned audio visual environment data have been recorded and narrated the situation that is provided with 7 lighting devices around video display devices 201 shown in Figure 5.
Lighting device v3 ' is the lighting device that ceiling is provided with formula, and other lighting devices are highly different, removable lighting devices that formula is set.In addition, as mentioned above, actual audio visual environment space coordinates of looking the hearer shown in Figure 5 also are to be initial point (0,0 by the picture center with video display devices 201,0) x axle, y axle, z axle define, and the y axle is consistent with the normal direction of the picture of video display devices 201.Therefore, the lighting position that the audio visual environment data among Fig. 6 are recorded and narrated is the relative position with respect to video display devices 201, wherein, this audio visual environment data representation the position of the lighting device in the actual audio visual environment space.
As mentioned above, in the virtual audio visual environment space shown in the audio visual environment reference data, as shown in Figure 7, on 8 corners in this virtual audio visual environment space, dispose 8 lighting devices respectively.In looking hearer's actual audio visual environment space, as shown in Figure 5,7 lighting devices are configured on the optional position respectively.That is to say, in these two audio visual environment spaces, therefore lighting position with respect to video display devices is diverse, can not be directly the illumination control data that is used for appropriately controlling the lighting device in virtual audio visual environment space be used as the illumination control data that is used for controlling each set lighting device of the actual audio visual environment space of looking hearer side.So the illumination control data that needs will be corresponding with virtual audio visual environment converts the illumination control data corresponding with actual audio visual environment space to.
Below, describe with regard to the conversion method of the control data that throws light on.
As mentioned above, in the present embodiment, the position of the lighting device in the audio visual environment space specifically is meant, the relative position between this lighting device and the video display devices.For example, if the position of lighting device is stipulated with the absolute position in the audio visual environment space, so, even in the audio visual environment space, moved video display devices, or change its picture towards, the position of lighting device can not change yet.Yet, just need the color or the brightness of the illumination light of each lighting device of change this moment.Otherwise if the relative position relation of video display devices and lighting device is constant, even the position of video display devices or towards changing so, or the size in room changes, and also need not to change the color or the brightness of the illumination light of each lighting device.
As mentioned above, because each arranged illumination devices position need be represented according to the relative position of itself and video display devices, so preferred is initial point (0 by the picture center with video display devices, 0,0) x axle, y axle, z axle define the coordinate system in audio visual environment space, and the y axle is consistent with the normal direction of the picture of video display devices.According to the definition of this coordinate system, the position of lighting device can be represented as the relative position of itself and video display devices.The center that coordinate system is also not necessarily leaveed no choice but with above-mentioned video display devices is an initial point, but, for example with a certain angle in audio visual environment space during as initial point, just need be with the position of video display devices and picture direction as audio visual environment reference data or audio visual environment data.
Next, just the throw light on concrete grammar of the illumination control data conversion in the control data converter section 9 describes.
At first, make the coordinate system of audio visual environment reference data consistent, and synthesize with the coordinate system of the audio visual environment data of looking hearer side.Fig. 9 be expression with the coordinate system of the schematic diagram in virtual audio visual environment shown in Figure 7 space consistent with the coordinate system of the schematic diagram in actual audio visual environment shown in Figure 5 space and synthesize after schematic diagram.The corresponding to reason of each coordinate system is, picture center by making video display devices promptly, the initial point of coordinate system is consistent, just can compare relative position relation in relative position relation in the virtual audio visual environment space, lighting device and video display devices and the actual audio visual environment space, lighting device and video display devices.
Be used to control lighting device v1 ' (x1 shown in Figure 9, y1, z1) illumination control data is to calculate according to the illumination control data that illumination apparatus v1, v3, v5, v7 control, wherein, lighting device v1, v3, v5, v7 are set on 4 corners of the nearest virtual audio visual environment space wall of lighting device v1 '.Particularly, calculate earlier the distance between lighting device v1 ' and lighting device v1, v3, v5, the v7 respectively, obtain the ratio of the inverse of those distances then,, determine with respect to each lighting device v1, v3 of lighting device v1 ', the contribution degree (weighting) of v5, v7 then according to this ratio reciprocal.Then, the illumination control data of controlling based on illumination apparatus v1, v3, v5, v7 (R, G, B), and carry out computing according to above-mentioned definite weighting, thus calculate the illumination control data (R, G, B) that is used to control lighting device v1 '.
That is to say, make the represented coordinate system of represented coordinate system of audio visual environment data and audio visual environment reference data consistent, to form a space, in this space, illumination control data converter section 9 calculates: a certain lighting device in the lighting device shown in the audio visual environment data (the 1st lighting device) and near a plurality of be positioned at the 1st lighting device (or and the 1st lighting device have fixed position concern), by the distance between the lighting device shown in the audio visual environment reference data (the 2nd lighting device).Then, illumination control data converter section 9 uses the distance that is calculated, just the illumination control data value of corresponding each the 2nd lighting device computes weighted, and calculates the value of the illumination control data corresponding with the 1st lighting device according to the value of the illumination control data behind the ranking operation.
Below, the concrete example of operation method is described with reference to Figure 10.
Put down in writing among Figure 10: the ratio of the distance in lighting device v1, the v3 in the virtual audio visual environment space, v5, v7 and the actual audio visual environment space between the set lighting device v1 ', the inverse of those distances and with each lighting device v1, v3, illumination control data (R, G, B) that v5, v7 are corresponding.The distance of lighting device v1, v3, v5, v7 and lighting device v1 ' is respectively 1,3,2,4, and the ratio of the inverse of each distance is respectively 24,8,12,6.The illumination control data that illumination apparatus v1, v3, v5, v7 control is as follows.That is, lighting device v1 is R=250, G=230, B=150; Lighting device v3 is R=170, G=200, B=100; Lighting device v5 is R=90, G=110, B=130; Lighting device v7 is R=150, G=50, B=40.
Understand for convenience,, will be recited as numerical value shown in Figure 10 with the distance of lighting device v1 ' as an example, certainly, in fact more complicated.The ratio of the inverse of distance is obtained by the following method of asking.Promptly, earlier with lighting device v1, v3, v5, v7 respectively and the distance between the lighting device v1 ' carry out multiplying (1 * 3 * 2 * 4=24), the numerical value that this multiplying is obtained be respectively divided by the distance (v1:24/1=24 between each lighting device v1, v3, v5, v7 and the lighting device v1 ' then; V3:24/3=8; V5:24/2=12; V7:24/4=6).
Then, according to the ratio and the illumination control data (R, G, B) of the inverse of above-mentioned each lighting device of obtaining (v1, v3, v5, v7), obtain the illumination control data that is used for illumination apparatus v1 ' and controls (R1 ', G1 ', B1 ').At first, calculate the optimum value of red light source (R).The numerical value of the R of each lighting device v1, v3, v5, v7 is as follows, that is, the numerical value of the R of v1 is 250, and the numerical value of the R of v3 is 170, and the numerical value of the R of v5 is 90, and the numerical value of the R of v7 is 150.The ratio of the inverse of the distance between each lighting device v1, v3, v5, v7 and the lighting device v1 ' be multiply by the numerical value of this R respectively, just can obtain following result.That is v1:250 * 24=6000; V3:170 * 8=1360; V5:90 * 12=1080; V7:150 * 6=900.With those value additions (6000+1360+1080+900=9340), then with this addition and divided by the ratio of the inverse of above-mentioned distance and (that is, 24+8+12+6=50), be 9340/50=186.8.So, just, can calculate the illumination control data R1 ' corresponding with the red light source (R) of lighting device v1 '.
With above-mentioned same, obtain the illumination control data G1 ' corresponding, the illumination control data B1 ' corresponding with blue-light source (B) with green light source (G), so, just, can calculate the illumination control data that is used for illumination apparatus v1 ' and appropriately controls (R1 ': 187; G1 ': 175; B1 ': 124).Also can use this computing for other lighting devices v2 ', v3 ', v4 ', v5 ', v6 ', v7 ', v8 ' in the actual audio visual environment space, therefore, for all set in actual audio visual environment space lighting devices, can both generate and the corresponding illumination control data of this lighting device.In addition, as previously discussed, the illumination control data of obtaining from the outside is that unit is by additional with the one-frame video data, so, also can be that unit carries out above-mentioned illumination control data conversion process repeatedly with the frame, thus, can generate and the corresponding appropriate illumination control data of video in the display frame 201.
In the present embodiment, calculate the distance between the lighting device v1 ' set in lighting device v1, v3, v5, v7 and the actual audio visual environment space in the virtual audio visual environment space, the ratio of the inverse by those distances is weighted interpolation arithmetic then.But be not limited thereto, method of weighting also can be additive method.In addition, in the above-mentioned explanation, though R, G, B data in the imagination illumination control data respectively have the amount of information of 8 bits, the illumination control data is not defined as above-mentioned.
In addition, in the present embodiment, the illumination control data that set lighting device in the actual audio visual environment space is controlled be according to try to achieve near the corresponding illumination control data of 4 lighting devices this lighting device, that on the wall of virtual audio visual environment space, disposed.But also can be as shown in figure 11, try to achieve according to the illumination control data that 8 all lighting devices that disposed on 8 corners to virtual audio visual environment space are controlled, also can carry out interpolation arithmetic, obtain then each lighting device that is disposed in the actual audio visual environment space is controlled the illumination control data according near the illumination control data that 2 or 2 above lighting devices are controlled.
In the record of the illumination control data generation method of present embodiment, be to use recently the computing weighted of inverse of distance between the lighting device v1 ' set in lighting device set on 8 corners in virtual audio visual environment space and the actual audio visual environment space, but the generation method of the illumination control data that illumination control data converter section 9 is carried out is not limited thereto.Below, with reference to Figure 12 to Figure 15,2 kinds of method examples beyond the above-mentioned illumination control data generation method are described.
The generation method of following illumination control data at first is described, that is: the irradiation area when according to lighting device set in the actual audio visual environment space virtual audio visual environment space wall being shone generates the illumination control data.Figure 12 is the figure in virtual audio visual environment space.Identical with the model in aforementioned virtual audio visual environment space, on 8 corners, dispose 8 lighting device v1 ' respectively to v8 '.At this, be initial point (0 preferably by picture center with video display devices 101,0,0) x axle, y axle, z axle three-dimensional coordinate define the three-dimensional space position of each lighting device v1 to v8, and preferred y axle is consistent with the normal direction of the picture of video display devices 101.
In the method, the ceiling in audio visual environment space, ground, 4 space walls all are divided into 4 zones, and those zones are S1 to S24 (S13 to S24 is not expression in the drawings).For divided zone, correspondingly be assigned illumination control data with the nearest lighting device in this zone.For example, in Figure 12,, all correspondingly be assigned the illumination control data of lighting device v3 for 3 zones (S3, S6, S9) that are adjacent to lighting device v3.
Secondly, set lighting device in the actual audio visual environment space is configured in the above-mentioned virtual audio visual environment spatial model, according to the illumination in virtual audio visual environment space, generate the illumination control data that illumination apparatus is controlled in the actual audio visual environment space then.Figure 13 is expression, will be arranged at the allocation plan of lighting device (v8 ', v9 ') when being configured in the above-mentioned virtual audio visual environment space in actual audio visual environment space.The represented zone of T1, T2 is meant among the figure, the irradiation area of illumination when the wall of space of lighting device (v8 ', v9 ').At this, obtain earlier with corresponding, the virtual audio visual environment of irradiation area T1, T2 space in region S 1 to S24, utilize illumination control data then, lighting device set in the actual audio visual environment space (v8 ', v9 ') is controlled the lighting device of being obtained region allocation, in virtual audio visual environment space.
Irradiation area T1, T2 can calculate according to information that the user imported and by video receiving apparatus 4, irradiation area T1, T2 are stored in the audio visual environment data store 10 just can then.For example, make between the lighting device 11 of actual use and the space wall and leave predetermined distance, light this lighting device 11 with predetermined luminous intensity then, and these lighting device 11 photographs are surveyed to the rayed zone of above-mentioned space wall, try to achieve above-mentioned irradiation area T1, T2 with this and get final product.In addition, also can the specification of lighting device 11 and the direction of illumination of illumination be inputed to video receiving apparatus 4 by the user, this video receiving apparatus 4 is calculated irradiation area T1, T2 based on the information of being imported by predetermined computing then.Timing about irradiation area T1, T2 are calculated does not limit especially, just can as long as calculated before receiving broadcast data.
Figure 14 represents in the virtual audio visual environment space example with the cut zone of the corresponding space of irradiation area T1 wall.In Figure 14, irradiation area T1 is by S5, S6 (S5: S6=1: 1) constitute.At this moment, be used for the illumination control data that the set lighting device v8 ' in actual audio visual environment space controls is generated by the following method, that is: according to the area of region S 5 and region S 6 than (in Figure 14, S5: S6=1: 1), be weighted processing respectively to the illumination value (the illumination control data of corresponding lighting device v1) corresponding and with the corresponding illumination value (the illumination control data of corresponding lighting device v3) of region S 6 with region S 5.Particularly, half of the value of the illumination control data that a half-sum of the value of illumination control data that will be corresponding with region S 5 and region S 6 are corresponding adds up to, and resulting aggregate value is the illumination value of field of illumination T1.
That is to say, illumination control data converter section 9 utilize audio visual environment reference data that acceptance division 5 received and with the corresponding illumination control data of this audio visual environment reference data, the three dimensions wall in virtual audio visual environment space is divided into a plurality of cut zone, and illumination control data that will be corresponding with each cut zone (for example, the color of illumination, luminous intensity etc.), for example will be from the illumination control data of the nearest lighting device of this cut zone, use as the illumination control data of this cut zone.Then, illumination control data converter section 9 is obtained the audio visual environment data that wherein contain the irradiation area data from audio visual environment data store 10, and wherein, these irradiation area data are irradiation area (for example, data T1) of expression lighting device 11.Thereafter, under the situation that the irradiation area shown in these field of illumination data and above-mentioned cut zone overlap, illumination control data converter section 9 calculates the area ratio of each cut zone area occupied in this irradiation area.Then, illumination control data converter section 9 uses the area ratio that is calculated, the pairing illumination control data of each cut zone is computed weighted, then according to gained behind the ranking operation, corresponding to the illumination control data of each cut zone, calculate the illumination control data of the lighting device 11 that is used to form above-mentioned irradiation area.
For example, illumination control data converter section 9 is according to the area ratio of each cut zone area occupied in the irradiation area, the illumination intensity corresponding to each cut zone of gained behind the ranking operation added up to processing, thereby calculate the illumination intensity of above-mentioned irradiation area.
By the generation method of this illumination control data,, also can carry out appropriate illumination control even in actual audio visual environment space, adopt indirect lighting.
The generation method of another kind of illumination control data then, is described.The generation method of this illumination control data is simpler than above-mentioned two kinds of methods.In the method, quantity according to lighting device set in the virtual audio visual environment space, should be divided into a plurality of spaces piece in virtual audio visual environment space, and be present in which space piece according to set lighting device in the actual audio visual environment space then and generate the illumination control data.
Figure 15 is the figure in the virtual audio visual environment of expression space, and is identical with aforesaid virtual audio visual environment spatial model, disposes 8 lighting device v1 to v8 on 8 corners respectively.Virtual audio visual environment space is divided into 8 spaces (space piece), and each space piece is assigned to respectively: the illumination value of certain lighting device among the lighting device v1 to v8 that is disposed on the corner of this space piece.For example, about the space piece shown in the B1 among Figure 15, it is assigned to the illumination value of lighting device v3.
Then, set lighting device in the actual audio visual environment space is configured in the above-mentioned virtual audio visual environment space, and being present in which space piece according to the light source portion of this lighting device, the illumination value that will be distributed the space piece that has this light source portion is as the illumination value (illumination control data) of lighting device set in the actual audio visual environment space.
That is to say, virtual audio visual environment space segmentation is become a plurality of spaces, thereby obtain a plurality of partition spaces, contain single lighting device in each partition space respectively, audio visual environment reference data that illumination control data converter section 9 use acceptance divisions 5 are received and the illumination control data corresponding with this audio visual environment reference data are distributed to corresponding with it above-mentioned partition space with the illumination control data of above-mentioned single lighting device.Then, make virtual audio visual environment space and actual audio visual environment space coincidence, at this moment, illumination control data converter section 9 will be distributed to actual illumination device contained in the above-mentioned partition space to the illumination control data that this partition space distributed, wherein, this actual audio visual environment space is meant the space that the audio visual environment data are represented.
By the generation method of above-mentioned illumination control data, need not to carry out complex calculations, and can control the lighting device in the actual audio visual environment space rightly.In addition, when actual audio visual environment space bigger and when causing set lighting device in the actual audio visual environment space to be in virtual audio visual environment space outside than virtual audio visual environment space, 8 spaces being cut apart can be extended, and then the space that exists of definite lighting device gets final product.
In the present embodiment, be to use the throw light on conversion of control data of virtual audio visual environment reference data, in these virtual audio visual environment data, be to have stipulated virtual audio visual environment space, but the audio visual environment reference data is not limited thereto with the position of 8 lighting devices.Below, describe being different from above-mentioned illumination control data conversion process example, in this conversion process example, the audio visual environment reference data that transmit leg sent is different with aforesaid audio visual environment reference data.
In the following description, look actual set lighting device only is configured on the ceiling in audio visual environment space in the audio visual environment space of hearer side, in addition, set lighting device also only is configured on the ceiling in the virtual audio visual environment space.In this conversion method, contemplated space is common audio visual environment space in home theater etc. for example.Compare to above-mentioned conversion method, by can throw light on the very simply conversion process of control data of this conversion method.
Figure 16 is the figure of an example of the audio visual environment reference data in the present embodiment.Figure 17 is the allocation plan in the virtual audio visual environment space shown in the audio visual environment reference data among expression Figure 16.Figure 17 has schematically represented the configuration of the lighting device in the contemplated virtual audio visual environment space of the transmit leg (broadcasting station side) that sends video data.At this, the audio visual environment reference data has been recorded and narrated state shown in Figure 17, in a certain size room, and on (ceiling in audio visual environment space) around the video display devices 101, disposes 16 lighting device v1 to v16 with the spacing of equalization that is:.
For general home theater, owing to consider that acoustics etc., video display devices generally are the middle bodies that is set at a certain space wall in the audio visual environment space, and its display frame is parallel with this space wall.Therefore, at this, as prerequisite, video display devices 101 is configured along a certain space wall in the audio visual environment space.In addition, in the present embodiment, the position of each lighting device in the virtual audio visual environment space also is to represent by the relative position between this lighting device and the video display devices 101.
Figure 18 is the figure that is illustrated in the lighting device of two-dimensional arrangement on the audio visual environment space ceiling shown in Figure 17.
Figure 19 is the figure of an example of audio visual environment data, this audio visual environment data representation in actual audio visual environment space the position of set lighting device.Figure 20 be expression by the allocation plan of the actual audio visual environment shown in the audio visual environment data among Figure 19, wherein, this audio visual environment data representation in the actual audio visual environment space position of set lighting device.And Figure 20 has schematically represented the position of lighting device set in actual audio visual environment space.At this, the audio visual environment reference data has been recorded and narrated state shown in Figure 20, in a certain size room, and around video display devices 201 (ceiling in audio visual environment space), disposes 9 lighting device v1 to v9 with the spacing of equalization that is:.
About the audio visual environment data in the present embodiment, same with above-mentioned audio visual environment reference data, its prerequisite is that video display devices 201 is configured along a certain space wall in the audio visual environment space.In addition, the position of each lighting device in the virtual audio visual environment space is to represent by the relative position between this lighting device and the video display devices 201.
Figure 21 is the figure that is illustrated in the lighting device of two-dimensional arrangement on the ceiling in the audio visual environment space among Figure 20.
As mentioned above, the lighting device that in the virtual audio visual environment space shown in the audio visual environment reference data, is disposed and in actual audio visual environment space set lighting device all be that interval with equalization is configured on the ceiling in each audio visual environment space, and video display devices is configured along a certain wall in the audio visual environment space.When in this case, size, the number of lighting device, the arranged illumination devices position in virtual audio visual environment space (room) being different from number, the arranged illumination devices position of size, the lighting device in actual audio visual environment space (room), illumination control data conversion method describes.
Figure 22 is the figure of the motion flow of illumination control data converter section 9 in the expression present embodiment.At first, obtain that (step 1) obtains the audio visual environment data (step 2) of being stored in the audio visual environment data store 10 thereafter by 6 isolated audio visual environment reference datas of data separating unit.
Then, according to above-mentioned audio visual environment reference data and audio visual environment data, judge both sides' the whether consistent (step 3) of audio visual environment space size.When both sides' audio visual environment space size was consistent, (step 4), wherein, virtual audio visual environment space was by the represented space of audio visual environment reference data to calculate the illumination zone of each lighting device that is disposed in the virtual audio visual environment space.Then, calculate the illumination zone (step 6) of each set in actual audio visual environment space lighting device.About above-mentioned illumination zone, can be that the rectangle center, that shape is identical (matrix) is as above-mentioned illumination zone with each lighting device of equivalent arrangements.
On the other hand, if both sides' the not of uniform size of audio visual environment space causes, as shown in figure 23, the size in the actual audio visual environment space shown in the audio visual environment data is changed, made itself and the big or small consistent (step 5) in the virtual audio visual environment space shown in the audio visual environment reference data.About making both sides' the corresponding to conversion method of audio visual environment space size (area), particularly, change the multiplying power of the longitudinal direction (y direction) and the transverse direction (x direction) in actual audio visual environment space respectively, make the big or small consistent of the size in actual audio visual environment space and the virtual audio visual environment space shown in the audio visual environment reference data.
After the audio visual environment space size that makes both sides was consistent, (step 4), wherein, virtual audio visual environment space was by the represented space of audio visual environment reference data to calculate the illumination zone of each lighting device that is disposed in the virtual audio visual environment space.Calculate the illumination zone (step 6) of each set in actual audio visual environment space lighting device thereafter.
Then, illumination zone according to each set in the illumination zone of each lighting device that is disposed in above-mentioned audio visual environment that calculate, the virtual space and above-mentioned audio visual environment that calculate, actual space lighting device, the illumination control data corresponding with the lighting device that disposed in the virtual audio visual environment space changed, make its convert to actual audio visual environment space in the set corresponding illumination control data (step 7) of lighting device.
Figure 24 is the figure that is used to illustrate the switching motion of illumination control data.At this, " be that example describes with the lighting device v1 in the lighting device set in the actual audio visual environment space.At first, virtual audio visual environment space shown in Figure 24 (a) is overlapped with the actual audio visual environment space shown in Figure 24 (b), wherein, the actual audio visual environment shown in Figure 24 (b) is meant: the size conversion in audio visual environment space is become and big or small actual audio visual environment space after identical, virtual audio visual environment space.In this example because the illumination zone of set lighting device is wider in the actual audio visual environment space, so, lighting device v1 " illumination zone relate to lighting device v1, the v2 that is disposed in the virtual audio visual environment space, the illumination zone of v5, v6.
Lighting device v1 " illumination zone constituted by the lighting device v1, the v2 that are disposed in the virtual audio visual environment space, the illumination zone of v5, v6, its composition is as follows.That is v1: v2: v5: v6 is 9: 3: 3: 1.According to this composition, the pairing illumination control data of lighting device v1, the v2, v5, the v6 that dispose in the virtual audio visual environment space is computed weighted, thereby generate and lighting device v1 " corresponding illumination control data.
Particularly, suppose with virtual audio visual environment space in the lighting device v1 that disposed, v2, v5, the illumination control data that v6 is corresponding respectively is: (R1, G1, B1), (R2, G2, B2), (R5, G5, B5), (R6, G6, B6), then those illumination control datas be multiply by above-mentioned component ratio respectively 9: 3: 3: value corresponding with it in 1, and each product carried out addition and obtain addition and, thereafter, with this addition and divided by each numerical value in above-mentioned each component ratio and (9+3+3+1), thereby obtain and lighting device v1 " corresponding illumination control data.For example, about " corresponding red light source (R) illumination control data can be tried to achieve by (9R1+3R2+3R5+R6)/16 with lighting device v1.Green light source (G) and blue-light source (B) also can be tried to achieve with above-mentioned same method.
Also can use this computing for other lighting devices v2 in the actual audio visual environment space ", v3 ", v4 ", v5 ", v6 ", v7 ", v8 ", v9 ", therefore, for all set in actual audio visual environment space lighting devices, can both generate and the corresponding illumination control data of this lighting device.In addition, as mentioned above, the illumination control data of obtaining from the outside is that unit is by additional with the one-frame video data, therefore, can be that unit carries out above-mentioned illumination control data conversion process repeatedly with a frame, can generate thus and corresponding, the appropriate illumination control data of the video in the display frame.
That is to say that the virtual audio visual environment space wall that illumination control data converter section 9 will dispose a plurality of lighting devices is divided into a plurality of zones of respectively containing a lighting device, thereby generates the virtual dividing zone; Simultaneously, the actual audio visual environment space wall that illumination control data converter section 9 also will dispose a plurality of lighting devices is divided into a plurality of zones of respectively containing a lighting device, thereby generate actual cut zone, then, illumination control data converter section 9 is calculated this virtual dividing zone and this actual cut zone, wherein, above-mentioned virtual audio visual environment space is by the represented space of audio visual environment reference data, and above-mentioned actual audio visual environment space is by the represented space of audio visual environment.Thereafter, illumination data converter section 9 overlaps virtual dividing zone and the actual cut zone calculated, and according to the area ratio of the zone of each virtual dividing more than 1 area occupied in certain actual cut zone, illumination control data to lighting device contained in this virtual dividing zone computes weighted, utilize the illumination control data behind ranking operation then, calculate the illumination control data of lighting device contained in actual cut zone.
(second execution mode)
Below, second execution mode of the present invention is described.In the system of above-mentioned first execution mode, be with the audio visual environment reference data relevant and the illumination control data that the lighting device more than 1 in this virtual audio visual environment space is controlled is additional to video data sends with the position of lighting device more than 1 in the virtual audio visual environment space.By comparison, in the system of second embodiment of the invention, though will be additional to video data to the illumination control data that the lighting device more than 1 in the virtual audio visual environment space is controlled, but the audio visual environment reference data relevant with lighting device more than 1 in the virtual audio visual environment space is not additional to video data, but obtain the audio visual environment reference data from external device (ED) (for example, server unit) by the Internet etc.Below, describe with regard to second embodiment of the invention, about with the identical part of above-mentioned first execution mode, represent with identical label, and omit explanation it.
Figure 25 is the block diagram of schematic configuration of the video transmission device of expression second embodiment of the invention.Video transmission device 21 has data multiple 22 and sending part 23.Multiple 22 of data are used for video data, voice data, illumination control data are carried out multipleization processing.Sending part 23 will send as broadcast data by the data after multiple 22 multipleization of data.
Figure 26 is the block diagram of schematic configuration of the video receiving apparatus (audiovisual environment control device) of expression second embodiment of the invention.Audiovisual environment control device 24 shown in Figure 26 have the 1st acceptance division 25, data separating unit 26, sending part 27, acceptance division 28, CPU (Central Processing Unit: central processing unit) 29, wherein, the 1st acceptance division 25 is used to receive broadcast data; Data separating unit 26 is separated into video data, voice data, illumination control data with the broadcast data that the 1st acceptance division 25 is received; Sending part 27 is sent to the external service apparatus via the transmission request that the Internet etc. will be used to ask to send the audio visual environment reference data; The 2nd acceptance division 28 is used to receive the audio visual environment reference data of sending from the external service apparatus; CPU29 order sending part 27 sends and is used to ask to send the transmission request of audio visual environment reference data, and obtains the audio visual environment reference data that is received by acceptance division 28.
CPU29 is according to user's indication, by sending part 27, the transmission request of audio visual environment reference data (promptly, with the corresponding audio visual environment reference data of illumination control data that obtains that data separating unit 26 is separated) that will be corresponding with the shown video program content of video display devices 7 is notified to the external server device.
Send the timing of the transmission request of above-mentioned audio visual environment reference data about CPU29, be not particularly limited, for example can when the 1st acceptance division 25 receives broadcast datas, carry out.
In addition, above-mentioned programme content is meant the set of the information that contains video data at least, and it generally also contains other voice data except that this video data.In other words, programme content be meant video data and with the set of these video data corresponding audio data.
At this, describe with regard to external service apparatus (data sending device) with reference to Figure 27.External service apparatus 31 possesses acceptance division 32 is arranged, data store 33, sending part 34.Acceptance division 32 is used for receiving the transmission request of sending from video receiving apparatus (audiovisual environment control device) 21.In data store 33, with each programme content accordingly, store with virtual audio visual environment space in the corresponding audio visual environment reference data in position of lighting device more than 1.Sending part 34 will ask corresponding reference data to send to audiovisual environment control device 21 as the requesting party with the transmission that audiovisual environment control device 21 is sent.
External service apparatus 31 accepted from audiovisual environment control device 21, be used to ask to send the transmission request of audio visual environment reference data after, from data store 33, read out be requested to send, with programme content corresponding reference data, then, this reference data is sent to the video receiving apparatus 21 that sends the requesting party.
After the audio visual environment reference data of sending from external service apparatus 31 is received by the 2nd acceptance division 28 of video receiving apparatus 21, be sent to illumination control data converter section 9 by CPU29.Illumination control data converter section 9 uses audio visual environment data corresponding with arranged illumination devices position more than 1 in the actual audio visual environment space and the audio visual environment reference data of sending from said external server unit 31, illumination control data that will separation obtains from broadcast data converts the illumination control data that is used for controlling the lighting device 11 of actual illumination environment space more than 1 to, illumination control data after will changing is then exported to lighting device 11, wherein, above-mentioned audio visual environment data are stored in the audio visual environment data store 10.At this, because the illumination control data conversion method that illumination control data converter section 9 is carried out is identical with above-mentioned first execution mode, so omit its explanation.
According to present embodiment, even be additional under the situation of video data at the control data that only will throw light on, also can obtain the audio visual environment reference data corresponding from external device (ED) with this illumination control data, and can generate:, therefore can carry out appropriate illumination control with the corresponding illumination control data of lighting device set in the actual audio visual environment space of looking hearer side.
In addition, such as being unit with the program, audio visual environment reference data one regularly need not to send by each frame.In the present embodiment, the audio visual environment reference data is sent by external device (ED), the control data that only will throw light on is additional to video data and sends, and therefore, thereby the shared part of capacity that can cut down the audio visual environment reference data from the capacity of broadcast data can suppress the capacity of broadcast data.In addition, because the illumination control data is by the programme content side of making made, so, be additional to video data by the control data that will throw light on and send, just can be according to the control of throwing light on of programme content producer's intention.
(the 3rd execution mode)
Below, describe with regard to the 3rd execution mode of the present invention.In the system of second execution mode, to be additional to video data to the illumination control data that the lighting device more than 1 in the virtual audio visual environment space is controlled, but the audio visual environment reference data relevant with lighting device more than 1 in the virtual audio visual environment space is not additional to video data, and the audio visual environment reference data obtains from the external service apparatus by the Internet etc.By comparison, the system of third embodiment of the invention obtains illumination control data and audio visual environment reference data by the Internet etc. in the lump from external service apparatus etc.Below, describe with regard to third embodiment of the invention, about with the identical part of above-mentioned first, second execution mode, represent with identical label, and omit its explanation.
The video transmission device of third embodiment of the invention carries out video data, voice data after the multipleization processing and sends, itself and the existing dispensing device and the indistinction that send broadcast data.
Figure 28 is the block diagram of schematic configuration of the video receiving apparatus (audiovisual environment control device) of expression third embodiment of the invention.The video receiving apparatus 44 shown in Figure 28 and the difference of the video receiving apparatus 24 in second execution mode are: CPU49 asks to send audio visual environment reference data and illumination control data by sending part 47, and obtains audio visual environment reference data and illumination control data by acceptance division 48.
CPU49 is according to user's indication, and by sending part 47, the transmission request that will be used to ask to send audio visual environment reference data corresponding with the video program content of video display devices 7 demonstrations and illumination control data is notified to external device (ED).
Send the timing of the transmission request be used to ask to send above-mentioned audio visual environment reference data and the illumination control data corresponding with this audio visual environment reference data about CPU49, be not particularly limited, for example can when the 1st acceptance division 45 has received broadcast data, carry out.
At this, outside server unit (data sending device) is described with reference to Figure 29.External service apparatus 51 possesses acceptance division 52 is arranged, data store 53, sending part 54.Acceptance division 52 is used for receiving the transmission request of sending from video receiving apparatus (audiovisual environment control device) 44.In data store 53, with each programme content accordingly, the illumination control data that stores the audio visual environment reference data corresponding and be used for the lighting device of virtual audio visual environment space more than 1 controlled with the position of lighting device more than 1 in the virtual audio visual environment space.Sending part 54 will ask corresponding reference data and illumination control data to send to requesting party's audiovisual environment control device 44 with the transmission that audiovisual environment control device 44 is sent.
External service apparatus 51 is after having accepted from transmission request audiovisual environment control device 44, that be used to ask to send the audio visual environment reference data and throw light on control data, read out audio visual environment reference data relevant and the illumination control data that is requested to send from data store 53, then this audio visual environment reference data and illumination control data are sent to the video receiving apparatus 44 that sends the requesting party with programme content.
The audio visual environment reference data of sending from external service apparatus 51 is sent to illumination control data converter section 9 by CPU49.In addition, the illumination control data that sends from external service apparatus 51 temporarily is stored in the CPU49.Then, the CPU49 corresponding illumination control data of TC (time code) that will separate the video data that obtains with data separating unit 6 sends to illumination control data converter section 9.That is to say, the illumination control data that sends from external service apparatus 51 is that unit is recorded and narrated with a frame, and the TC (time code) that is somebody's turn to do illumination control data and video data forms corresponding relation, thereby can make the output of video data regularly regularly synchronous with the output of this illumination control data.
Illumination control data converter section 9 uses audio visual environment data corresponding with arranged illumination devices position more than 1 in the actual audio visual environment space and the audio visual environment reference data of sending from said external server unit 51, to convert to from the illumination control data that external service apparatus 51 is obtained and be used for illumination control data that the lighting device 11 of actual illumination environment space more than 1 controlled, illumination control data after will changing is then exported to lighting device 11, wherein, above-mentioned audio visual environment data are stored in the audio visual environment information storage part 10.At this, because the illumination control data conversion method that illumination control data converter section 9 is carried out is identical with above-mentioned first execution mode, so omit its explanation.
According to present embodiment, control data is not additional to video data even will not throw light on, also can from external device (ED) obtain with the corresponding illumination control data of this video data and with the corresponding audio visual environment reference data of this illumination control data, and generate and look actual the corresponding illumination control data of lighting device set in the audio visual environment space of hearer side, therefore can carry out appropriate illumination control.
In addition, in the present embodiment, send illumination control data and audio visual environment reference data simultaneously,, can reduce the capacity of broadcast data, can alleviate the burden of programme content making side simultaneously so compare second execution mode from external device (ED).In addition, by the system of present embodiment is provided, can provide service according to looking the judgement whether the needs illumination is controlled of hearer side.
In addition, above-described programme content is not defined as the content of TV program that transmits with television broadcasting, its also can be with medias such as DVD in the relevant content (contents) of works of being stored.That is to say, resulting data when the video data of input is not limited to receiving television broadcasting, even the video data that the data of being imported are outside replay devices resets, the present invention also can be suitable for.
In above-mentioned data sending device of the present invention, above-mentioned reference data is illustrated in lighting device in the above-mentioned virtual audio visual environment space with respect to the relative position of the video display devices in above-mentioned virtual audio visual environment space.
Audio-visual environment control system of the present invention has: above-mentioned audiovisual environment control device; The video display devices that above-mentioned video data is shown; And be arranged on lighting device around the above-mentioned video display devices.
In the present invention, the lighting device in the above-mentioned actual audio visual environment of the above-mentioned audio visual environment data representation space is with respect to the relative position of the video display devices in the above-mentioned actual audio visual environment space.
The present invention is not limited to the respective embodiments described above, can carry out various changes in the claim scope, is also contained in the technical scope of the present invention by the resulting execution mode of technological means that suitably makes up above-mentioned execution mode announcement.
In addition, each functional block of above-mentioned video receiving apparatus 4,24,44, particularly the control data converter section 9 that throws light on can be hardware configurations, also can utilize CPU and realize by software.
That is, video receiving apparatus 4,24,44 has: the CPU (central processing unit) that carries out the order of the control program be used to realize each function; Store the ROM (read-only memory) of above-mentioned control program; Launch the RAM (random access memory) of said procedure; Storage devices (recording medium) such as storage said procedure and various memory of data.
In addition, provide recording medium to above-mentioned video receiving apparatus 4,24,44, this recording medium recording has the software that can be read by computer and be used to realize above-mentioned functions, by its computer (or CPU, MPU) read and the executive logging medium in the software that writes down, so also can realize purpose of the present invention, wherein, the software that aforementioned recording medium write down is the program code (execute form program, intermediate code program, source program) of the control program (visual environment control program) of above-mentioned video receiving apparatus 4,24,44.
As aforementioned recording medium, for example, can be the semiconductor memory class of the card class of the band class of tape, cartridge tape etc., the dish class that comprises CDs such as disks such as floppy disk, hard disk and CD-ROM, MO, MD, DVD, CD-R, IC-card (comprising storage card), light-card etc. or mask model ROM, EPROM, EEPROM, flash rom etc.
In addition, video receiving apparatus 4,24,44 can connect communication network, supplies with the said procedure code by means of communication network.As above-mentioned communication network, not special restriction, for example, can utilize the Internet (int ernet), Intranet (intranet), extranet (extranet), LAN, ISDN, VAN, CATV communication network, VPN (virtual private network) (virtual private network), phone loop line network, mobile communications network, satellite communication network etc.In addition, as the transmission medium that constitutes communication network, not special restriction, for example, can utilize the wire communication of IEEE1394, USB, power line, cable TV loop line, telephone wire, ADSL loop line etc., also can utilize the radio communication of infrared ray such as IrDA or remote controller etc., Bluetooth (registered trade mark), 802.11 radio communications, HDR, mobile telephone network, satellite loop line, received terrestrial digital broadcasting network (terrestrial digital net) etc.In addition, even pass through electric transmission realized the said procedure code, mounting is in the computer digit signal of carrier wave, also can realize the present invention.

Claims (9)

1. a data sending device is used to send video data, it is characterized in that having:
Sending part, with reference data be used for the throw light on illumination control data of control of the lighting device of virtual audio visual environment space more than 1 is attached in the above-mentioned video data and sends, wherein, above-mentioned reference data is the data about the lighting device present position more than 1 in above-mentioned virtual audio visual environment space.
2. data sending device is characterized in that having:
Data store, with each programme content accordingly, storage is about the reference data of the lighting device present position more than 1 in virtual audio visual environment space;
Acceptance division receives the transmission request that is used to ask to send above-mentioned reference data from external device (ED), and wherein, above-mentioned reference data is corresponding with the programme content of any video data;
Sending part, to the external device (ED) that sends the requesting party send be requested to send, with programme content corresponding reference data.
3. data sending device is characterized in that having:
Data store, with each programme content accordingly, storage is about the reference data of the lighting device present position more than 1 in virtual audio visual environment space, and storage is used for the throw light on illumination control data of control of the lighting device of above-mentioned virtual audio visual environment space more than 1;
Acceptance division is used to ask to send and the programme content corresponding reference data of video data and the transmission request of illumination control data arbitrarily from the external device (ED) reception;
Sending part, to the external device (ED) that sends the requesting party send be requested to send, with programme content corresponding reference data and illumination control data.
4. according to any described data sending device in the claim 1 to 3, it is characterized in that:
Above-mentioned reference data is that lighting device in the expression above-mentioned virtual audio visual environment space is with respect to the data of the relative position of the video display devices in the above-mentioned virtual audio visual environment space.
5. audiovisual environment control device is characterized in that having:
Acceptance division, the reference data that receiving video data and being attached to sends in this video data and being used for to the throw light on illumination control data of control of the lighting device of virtual audio visual environment space more than 1, wherein, above-mentioned reference data is the data about the lighting device present position more than 1 in above-mentioned virtual audio visual environment space;
Storage part, storage is about the audio visual environment data of the arranged illumination devices position more than 1 in actual audio visual environment space;
Illumination control data converter section, according to audio visual environment data of being stored in the above-mentioned storage part and the reference data that above-mentioned acceptance division received, with the illumination control data that above-mentioned acceptance division received convert to be used for to the lighting device of above-mentioned actual audio visual environment space more than 1 throw light on control the illumination control data.
6. audiovisual environment control device is characterized in that having:
That the 1st acceptance division, receiving video data and being attached to send in this video data, be used for the throw light on illumination control data of control of the lighting device of virtual audio visual environment space more than 1;
Sending part sends the transmission request be used to ask to send with the programme content corresponding reference data of above-mentioned video data to external device (ED), and this reference data is the data about the lighting device present position more than 1 in above-mentioned virtual audio visual environment space;
The 2nd acceptance division receives according to above-mentioned transmission request programme content corresponding reference data that sent and above-mentioned video data;
Storage part, storage is about the audio visual environment data of the arranged illumination devices position more than 1 in actual audio visual environment space;
Illumination control data converter section, the reference data that is received according to the audio visual environment data of being stored in the above-mentioned storage part and above-mentioned the 2nd acceptance division, the illumination control data that above-mentioned the 1st acceptance division is received convert to and are used for the throw light on illumination control data of control of the lighting device of above-mentioned actual audio visual environment space more than 1.
7. audiovisual environment control device is characterized in that having:
The 1st acceptance division, receiving video data;
Sending part, be used to ask to send and the programme content corresponding reference data of above-mentioned video data and the transmission request of illumination control data to the external device (ED) transmission, wherein, above-mentioned reference data is the data about the lighting device present position more than 1 in virtual audio visual environment space, above-mentioned illumination control data be used for to the lighting device of above-mentioned virtual audio visual environment space more than 1 throw light on control data;
The 2nd acceptance division receives according to above-mentioned transmission request programme content corresponding reference data that sent and above-mentioned video data and illumination control data;
Storage part, storage is about the audio visual environment data of the arranged illumination devices position more than 1 in actual audio visual environment space;
Illumination control data converter section, the reference data that is received according to the audio visual environment data of being stored in the above-mentioned storage part and above-mentioned the 2nd acceptance division, the illumination control data that above-mentioned the 2nd acceptance division is received convert to and are used for the throw light on illumination control data of control of the lighting device of above-mentioned actual audio visual environment space more than 1.
8. audio-visual environment control system is characterized in that having:
Aforesaid right requires any described audiovisual environment control device in 5 to 7;
The video display devices that above-mentioned video data is shown; And
Be arranged on above-mentioned video display devices lighting device on every side.
9. audio-visual environment control system according to claim 8 is characterized in that:
Above-mentioned audio visual environment data are that lighting device in the expression above-mentioned actual audio visual environment space is with respect to the data of the relative position of the video display devices in the above-mentioned actual audio visual environment space.
CNA2007800488761A 2006-12-28 2007-12-25 Transmission device, view environment control device, and view environment control system Pending CN101573976A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2006353877 2006-12-28
JP353877/2006 2006-12-28

Publications (1)

Publication Number Publication Date
CN101573976A true CN101573976A (en) 2009-11-04

Family

ID=39608573

Family Applications (1)

Application Number Title Priority Date Filing Date
CNA2007800488761A Pending CN101573976A (en) 2006-12-28 2007-12-25 Transmission device, view environment control device, and view environment control system

Country Status (5)

Country Link
US (1) US20100031298A1 (en)
EP (1) EP2124444B1 (en)
JP (1) JP4948548B2 (en)
CN (1) CN101573976A (en)
WO (1) WO2008084677A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104540275A (en) * 2014-12-17 2015-04-22 欧普照明股份有限公司 Method, device and system for adjusting site lighting device
CN105163448A (en) * 2015-09-21 2015-12-16 广东小明网络技术有限公司 LED intelligent lamp control method, device and system
CN105245793A (en) * 2015-09-21 2016-01-13 广东小明网络技术有限公司 Lamp control file generation method and device
US20220174800A1 (en) * 2020-11-27 2022-06-02 Savant Technologies Llc Method and Apparatus for Controlling Device, Smart Home Device, System, and Storage Medium

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4922853B2 (en) * 2007-07-12 2012-04-25 シャープ株式会社 Viewing environment control device, viewing environment control system, and viewing environment control method
US8555332B2 (en) * 2010-08-20 2013-10-08 At&T Intellectual Property I, L.P. System for establishing communications with a mobile device server
US8438285B2 (en) 2010-09-15 2013-05-07 At&T Intellectual Property I, L.P. System for managing resources accessible to a mobile device server
US8443420B2 (en) 2010-10-01 2013-05-14 At&T Intellectual Property I, L.P. System for communicating with a mobile device server
US8516039B2 (en) 2010-10-01 2013-08-20 At&T Intellectual Property I, L.P. Apparatus and method for managing mobile device servers
US8989055B2 (en) 2011-07-17 2015-03-24 At&T Intellectual Property I, L.P. Processing messages with a device server operating in a telephone
US8504449B2 (en) 2010-10-01 2013-08-06 At&T Intellectual Property I, L.P. Apparatus and method for managing software applications of a mobile device server
US8478905B2 (en) 2010-10-01 2013-07-02 At&T Intellectual Property I, Lp System for synchronizing to a mobile device server
US9392316B2 (en) 2010-10-28 2016-07-12 At&T Intellectual Property I, L.P. Messaging abstraction in a mobile device server
US9066123B2 (en) 2010-11-30 2015-06-23 At&T Intellectual Property I, L.P. System for monetizing resources accessible to a mobile device server
JP5799232B2 (en) * 2011-08-12 2015-10-21 パナソニックＩｐマネジメント株式会社 Lighting control device
US8646023B2 (en) 2012-01-05 2014-02-04 Dijit Media, Inc. Authentication and synchronous interaction between a secondary device and a multi-perspective audiovisual data stream broadcast on a primary device geospatially proximate to the secondary device
US9137314B2 (en) 2012-11-06 2015-09-15 At&T Intellectual Property I, L.P. Methods, systems, and products for personalized feedback
US9462332B2 (en) 2012-12-05 2016-10-04 At&T Intellectual Property I, L.P. Method and apparatus for controlling a media device
CN104296116B (en) 2014-09-30 2018-03-06 生迪光电科技股份有限公司 A kind of controlled in wireless lighting device with audio playing function
DE102015122878B4 (en) * 2015-12-28 2019-02-07 Deutsche Telekom Ag Lighting effects around a screen
FR3049154A1 (en) * 2016-03-16 2017-09-22 Orange PILOTAGE OF A MODULAR LIGHTING SYSTEM
EP3331325A1 (en) * 2016-11-30 2018-06-06 Thomson Licensing Method and apparatus for creating, distributing and dynamically reproducing room illumination effects
DE102018102125A1 (en) * 2018-01-31 2019-08-01 Technisat Digital Gmbh Control device and arrangement for operating a home automation

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000173783A (en) * 1998-04-13 2000-06-23 Matsushita Electric Ind Co Ltd Illumination control method and lighting system
CN1322437A (en) * 1998-06-12 2001-11-14 阿尼维西奥恩公司 Method and apparatus for generating virtual views of sporting events
JP2001343900A (en) * 2000-05-31 2001-12-14 Matsushita Electric Ind Co Ltd Illumination system and illumination control data preparing method
JP2003086384A (en) * 2001-06-28 2003-03-20 Matsushita Electric Ind Co Ltd Method of providing illumination service, illumination device, recording medium and reproduction device
CN1666506A (en) * 2002-07-04 2005-09-07 皇家飞利浦电子股份有限公司 Method of and system for controlling an ambient light and lighting unit
US20050275626A1 (en) * 2000-06-21 2005-12-15 Color Kinetics Incorporated Entertainment lighting system

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1999053728A1 (en) * 1998-04-13 1999-10-21 Matsushita Electric Industrial Co., Ltd. Illumination control method and illuminator
US6564108B1 (en) * 2000-06-07 2003-05-13 The Delfin Project, Inc. Method and system of auxiliary illumination for enhancing a scene during a multimedia presentation
EP1395975A2 (en) * 2001-06-06 2004-03-10 Color Kinetics Incorporated System and methods of generating control signals
WO2002101702A2 (en) * 2001-06-13 2002-12-19 Color Kinetics Incorporated Systems and methods of controlling light systems
US20040174326A1 (en) * 2001-06-28 2004-09-09 Shinichi Yamamoto Illumination service providing method, illumination apparatus, recording medium, and reproduction apparartus
JP2005229153A (en) * 2004-02-10 2005-08-25 Sony Corp Dimmer system and dimmer method, distributor and distribution method, receiver and reception method, recorder and recording method, and reproducing apparatus and reproducing method
JP4439322B2 (en) * 2004-04-23 2010-03-24 シャープ株式会社 High presence reproduction apparatus and method
CN101258780A (en) * 2005-09-06 2008-09-03 皇家飞利浦电子股份有限公司 Method and device for providing a lighting setting for controlling a lighting system to produce a desired lighting effect
JPWO2007052395A1 (en) * 2005-10-31 2009-04-30 シャープ株式会社 Viewing environment control device, viewing environment control system, viewing environment control method, data transmission device, and data transmission method
EP2018062A4 (en) * 2006-04-21 2010-08-04 Sharp Kk Data transmission device, data transmission method, audio-visual environment control device, audio-visual environment control system, and audio-visual environment control method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000173783A (en) * 1998-04-13 2000-06-23 Matsushita Electric Ind Co Ltd Illumination control method and lighting system
CN1322437A (en) * 1998-06-12 2001-11-14 阿尼维西奥恩公司 Method and apparatus for generating virtual views of sporting events
JP2001343900A (en) * 2000-05-31 2001-12-14 Matsushita Electric Ind Co Ltd Illumination system and illumination control data preparing method
US20050275626A1 (en) * 2000-06-21 2005-12-15 Color Kinetics Incorporated Entertainment lighting system
JP2003086384A (en) * 2001-06-28 2003-03-20 Matsushita Electric Ind Co Ltd Method of providing illumination service, illumination device, recording medium and reproduction device
CN1666506A (en) * 2002-07-04 2005-09-07 皇家飞利浦电子股份有限公司 Method of and system for controlling an ambient light and lighting unit

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104540275A (en) * 2014-12-17 2015-04-22 欧普照明股份有限公司 Method, device and system for adjusting site lighting device
CN105163448A (en) * 2015-09-21 2015-12-16 广东小明网络技术有限公司 LED intelligent lamp control method, device and system
CN105245793A (en) * 2015-09-21 2016-01-13 广东小明网络技术有限公司 Lamp control file generation method and device
CN105245793B (en) * 2015-09-21 2018-08-14 广东小明网络技术有限公司 A kind of generation method and device of lamp control file
US20220174800A1 (en) * 2020-11-27 2022-06-02 Savant Technologies Llc Method and Apparatus for Controlling Device, Smart Home Device, System, and Storage Medium
US11716803B2 (en) * 2020-11-27 2023-08-01 Savant Technologies Llc Method and apparatus for controlling device, smart home device, system, and storage medium

Also Published As

Publication number Publication date
WO2008084677A1 (en) 2008-07-17
JP4948548B2 (en) 2012-06-06
EP2124444A1 (en) 2009-11-25
US20100031298A1 (en) 2010-02-04
EP2124444A4 (en) 2010-10-13
EP2124444B1 (en) 2013-04-03
JPWO2008084677A1 (en) 2010-04-30

Similar Documents

Publication Publication Date Title
CN101573976A (en) Transmission device, view environment control device, and view environment control system
CN104380682B (en) The system and method for media network is formed by the media presentation devices of loose coordination
CN101682709B (en) Delivering and displaying advertisement or other application data to display systems
KR102402370B1 (en) Remotely performance directing system and method
CN101574019A (en) Audio visual environment control device, audio visual environment control system and audio visual environment control method
CA2735333C (en) A method for manipulation of audio or video signals
JP6216513B2 (en) Content transmission device, content transmission method, content reproduction device, content reproduction method, program, and content distribution system
CN106792214A (en) A kind of living broadcast interactive method and system based on digital audio-video place
CN106921866A (en) The live many video guide's methods and apparatus of auxiliary
CN105432098A (en) Panning of audio objects to arbitrary speaker layouts
CN106416239A (en) Methods and apparatus for delivering content and/or playing back content
CN106792228A (en) A kind of living broadcast interactive method and system
CN104202545A (en) Mosaic display system, LED liquid crystal display and television set
DE112018002530T5 (en) DISTRIBUTED AND SYNCHRONIZED CONTROL SYSTEM FOR ENVIRONMENTAL SIGNALS FOR MULTIMEDIA PLAYBACK
WO2018195652A1 (en) System, method and apparatus for co-locating visual images and associated sound
US20240272859A1 (en) Electronic shelf label system with sectional control of display content
CN109547724A (en) A kind of processing method of video stream data, electronic equipment and storage device
CN105122788A (en) Method and system of composite broadcast control
Tsukada et al. Software defined media: Virtualization of audio-visual services
CN101164648A (en) Robot theater
KR20090109310A (en) Multivison System implemented by portable media reproducing devices and Method thereof
KR20140088462A (en) A real time rendering 3d object interactive multi-vision system and method for processing a real time rendering 3d object
Paterson et al. Immersive audio post-production for 360 video: workflow case studies
KR101410976B1 (en) Apparatus and method for positioning of speaker
KR100675417B1 (en) Business method for multi-com-municating of informations or advertisements using unmanned complex moving picture multi-divisional displaying method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
AD01 Patent right deemed abandoned

Effective date of abandoning: 20091104

C20 Patent right or utility model deemed to be abandoned or is abandoned