WO2024016603A1 - 流媒体音/视频数据与灯具的联动系统、方法及存储介质 - Google Patents

流媒体音/视频数据与灯具的联动系统、方法及存储介质 Download PDF

Info

Publication number
WO2024016603A1
WO2024016603A1 PCT/CN2022/142994 CN2022142994W WO2024016603A1 WO 2024016603 A1 WO2024016603 A1 WO 2024016603A1 CN 2022142994 W CN2022142994 W CN 2022142994W WO 2024016603 A1 WO2024016603 A1 WO 2024016603A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
audio
video data
lamp
rendering
Prior art date
Application number
PCT/CN2022/142994
Other languages
English (en)
French (fr)
Inventor
张军君
钱维波
刘吉红
Original Assignee
榜威电子科技（上海）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 榜威电子科技（上海）有限公司 filed Critical 榜威电子科技（上海）有限公司
Publication of WO2024016603A1 publication Critical patent/WO2024016603A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
    • H05B47/10—Controlling the light source
    • H05B47/165—Controlling the light source following a pre-assigned programmed sequence; Logic control [LC]
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
    • H05B47/10—Controlling the light source
    • H05B47/175—Controlling the light source by remote control
    • H05B47/19—Controlling the light source by remote control via wireless transmission
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02B—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
    • Y02B20/00—Energy efficient lighting technologies, e.g. halogen lamps or gas discharge lamps
    • Y02B20/40—Control techniques providing energy savings, e.g. smart controller or presence detection

Definitions

  • the invention belongs to the field of lighting technology, and relates to a linkage system, and in particular to a linkage system, method and storage medium for streaming audio/video data and lamps.
  • the first is to control the lights through wired communication. This method is troublesome to install and the lights participating in the video linkage cannot be changed at will;
  • Philips’ Hue system is based on Zigbee wireless control of light linkage. Since the audio and video linkage part controls the color and brightness of the light, it is a non-Zigbee standard application layer protocol, so only Philips lights can be connected. Zigbee lights from other manufacturers can It is impossible to access; at the same time, because the Philips hue system must add a special video linkage bridge to realize the video linkage function, the use cost is high.
  • the purpose of the present invention is to provide a linkage system, method and storage medium for streaming audio/video data and lamps to solve the problem in the existing technology when realizing linkage between audio/video and lighting. , a special network bridge is required, or the lamps participating in audio/video linkage cannot be changed at will.
  • the present invention provides a linkage system between streaming media audio/video data and lamps.
  • the linkage system between streaming media audio/video data and lamps includes: an HDMI parsing device, and an intelligent terminal. Communication connection, used to receive control instructions sent by the smart terminal; select streaming media content according to the control instructions, and analyze the streaming media content; the analysis results include video data and audio data; wherein, when the control instructions
  • the HDMI parsing device converts the color data of each frame of image in the video data into rendering data corresponding to each distributed plane space according to the plane space distribution, and renders the data corresponding to each distributed plane space.
  • the rendering data is encapsulated into data packets and broadcasted; the rendering data is used to render the immersive lighting effect; when the control instruction is to link the lamp with the audio data, the HDMI parsing device extracts the attribute information of the audio data, according to The attribute information of the audio data searches for the rendering data corresponding to the attribute information, and encapsulates the rendering data into a data packet for broadcast; the rendering data corresponding to each plane space of the rendering data packet; at least one lamp, connected to the HDMI
  • the communication connection of the parsing device is used to receive the data packet, intercept the corresponding rendering data in the data packet according to the display location information of the memory, and display it.
  • the rendering data includes CIE1931 color coordinates and brightness values; the attribute information of the audio data includes audio and sound intensity.
  • the HDMI parsing device includes: an HDMI matrix chip, used to select streaming media content according to the control instructions, and strip the video data and audio data; a downconversion chip, used to convert all the The video data is converted into an RGB array value of a preset frame rate picture; the processor is used to count the number of pixels in area blocks after the video is distributed according to the plane space according to the data, and convert the RGB value of the pixels in each area block Accumulate separately, average the accumulated value of RGB values according to the known total number of pixels to obtain the average RGB value in each area block; calculate the brightness of each area block based on the average RGB value in each area block value, and convert the average RGB value in each area block into the corresponding CIE1931 color coordinates; package the CIE1931 color coordinates and brightness values corresponding to each area block into data packets in the order of plane spatial distribution; communication module , used to broadcast the data packet.
  • an HDMI matrix chip used to select streaming media content according to the control instructions, and strip the video data and audio data
  • a downconversion chip
  • the processor is further configured to search for the RGB value and brightness value in each area block corresponding to the sound intensity according to the sound intensity of the audio data, and add each RGB value and brightness value corresponding to the sound intensity to
  • the RGB values in the area block are converted into corresponding CIE1931 color coordinates; the CIE1931 color coordinates and brightness values corresponding to each area block are encapsulated into data packets; wherein the brightness value changes with the change of sound intensity.
  • the display location information in the memory includes the three-dimensional spatial correspondence between the lamp and the area block.
  • the lamp is used to intercept the corresponding CIE1931 color coordinates and brightness values according to its three-dimensional spatial correspondence in the area block after receiving the data packet broadcast by the communication module, and drive the RGB of the lamp. And the corresponding color and brightness of the lamp bead output.
  • the communication module includes a Zigbee and BLE dual module or a WiFi and BLE dual module.
  • the HDMI parsing device supports HDMI2.1, HDMI2.0 and HDMI1.4 protocols;
  • the streaming media content includes 4K resolution, 120Hz high refresh rate streaming media content and 8K resolution , 60Hz high refresh rate streaming content.
  • Another aspect of the present invention provides a method for linking streaming media audio/video data with lamps, including: receiving control instructions sent by the intelligent terminal; selecting streaming media content according to the control instructions, and parsing the streaming media content ;
  • the analysis results include video data and audio data; wherein, when the control instruction is that the lamp is linked to the video data, the color data of each frame of the image in the video data is converted into a color corresponding to each distributed plane space according to the plane space distribution.
  • Rendering data and encapsulating the rendering data corresponding to each distributed plane space into data packets for broadcast; the rendering data is used to render the immersive lighting effect; when the control instruction is for linkage between lamps and audio data, extract the Find the rendering data corresponding to the attribute information according to the attribute information of the audio data, and encapsulate the rendering data into a data packet for broadcast; the rendering data corresponding to each plane space of the rendering data packet; when At least one lamp receives the data packet, intercepts the corresponding rendering data in the data packet according to the display position information of the memory, and displays it.
  • the last aspect of the present invention provides a computer-readable storage medium on which a computer program is stored.
  • the program is executed by a processor, the linkage method between streaming audio/video data and lamps is implemented.
  • the linkage system, method and storage medium between streaming audio/video data and lamps according to the present invention has the following beneficial effects:
  • the present invention takes advantage of the function that the BLE device can be directly connected to the smart terminal, and configures the main device and the lights that need to participate in video linkage through the smart terminal, simplifying the configuration process and enhancing the configuration visualization function.
  • the present invention utilizes wireless communication dual-mode technology to wirelessly control changes in lamp color and brightness, eliminating the need for tedious wiring and reducing the installation workload.
  • the present invention can be easily connected to third-party smart home or smart lighting systems.
  • BLE adopts a private protocol and can ensure the system's real-time OTA upgrade and update function, ensuring that the equipment is always in the latest functional state.
  • the present invention adopts wireless control technology and full-screen video feature value extraction technology in real time, which can easily realize an immersive linkage experience in three-dimensional space.
  • the lamps can be various types of colorful wireless smart lamps, as well as colored light strips, lamp tubes, floor lamps, table lamps, etc. that support pixel points or pixel segments.
  • the present invention only needs to obtain the corresponding CH according to the corresponding relationship between the lamp and the spatial distribution and directly write it into the memory location of the lamp through communication, so that the lamps participating in the video linkage can be changed at will or without adding a special video linkage network.
  • the bridge can realize the video linkage function, thereby linking the audio data/video data to the lamps in real time, achieving an immersive effect of dynamic atmosphere with ambilight and light changing with shadow.
  • Figure 1 shows a schematic diagram of the application scenario of the present invention.
  • Figure 2 shows a schematic diagram of the division of plane space in the present invention.
  • FIG. 3A shows a schematic structural diagram of the linkage system between streaming audio/video data and lamps in one embodiment of the present invention.
  • FIG. 3B shows a schematic diagram of the internal principle structure of the linkage system between streaming audio/video data and lamps in one embodiment of the present invention.
  • FIG. 4 shows a schematic flowchart of the linkage method between streaming audio/video data and lamps in one embodiment of the present invention.
  • This embodiment provides a linkage system between streaming audio/video data and lamps, including:
  • HDMI parsing equipment is connected to the intelligent terminal for communication and is used to receive the control instructions sent by the intelligent terminal; select the streaming media content according to the control instructions and analyze the streaming media content; the analysis results include video data and audio data;
  • the HDMI parsing device converts the color data of each frame of image in the video data into rendering data corresponding to each distributed plane space according to the plane space distribution, and Rendering data corresponding to each distributed plane space is encapsulated into data packets and broadcast; the rendering data is used to render immersive lighting effects;
  • the HDMI parsing device extracts the attribute information of the audio data, searches for the rendering data corresponding to the attribute information according to the attribute information of the audio data, and converts the rendering data Encapsulated into data packets and broadcasted; rendering data corresponding to each plane space of the rendering data packet;
  • At least one lamp is communicatively connected to the HDMI parsing device, used to receive the data packet, intercept the corresponding rendering data in the data packet according to the display position information of the memory, and display it.
  • FIG. 1 shows a schematic diagram of the application scenario of the linkage system between streaming audio/video data and lighting fixtures.
  • the linkage system 1 for streaming audio/video data and lamps is communicatively connected to a multimedia display device 2 (for example, a television, a game console, a projector, etc.) and a smart terminal 3.
  • the multimedia display device 2 is used to provide streaming media content for the linkage system 1 of the streaming audio/video data and lamps.
  • the smart terminal 3 is used to output control instructions for the linkage system 1 of the streaming audio/video data and lamps through a human-computer interaction interface, so that the linkage system 1 of the streaming audio/video data and lamps can analyze the control instructions.
  • the linkage between the lamps and the audio or video is realized according to the control instructions.
  • the control instructions include selecting a channel for providing streaming media content, selecting a lamp to participate in audio/video linkage and a plane space corresponding to the lamp.
  • the identifier (for example, number) of the lamp has a one-to-one correspondence with the distributed plane space.
  • the plane space is divided into 11 area blocks, namely CH1, CH2,...CH11, as shown in Figure 2.
  • FIG. 3A and FIG. 3B shows a schematic structural diagram and an internal schematic structural diagram of a linkage system between streaming audio/video data and lamps in one embodiment.
  • the linkage system 1 between streaming audio/video data and lamps includes an HDMI parsing device 11 and at least one lamp 12 communicatively connected to the HDMI parsing device 11 .
  • the HDMI parsing device 11 is used to receive control instructions sent by the smart terminal 3; select streaming media content according to the control instructions, and parse the streaming media content; the parsing results include video data and audio data.
  • the HDMI parsing device 11 converts the color data of each frame of image in the video data into rendering data corresponding to each distributed plane space according to the plane space distribution, and converts the color data to the rendering data corresponding to each plane space of the distribution.
  • the rendering data corresponding to each distributed plane space is encapsulated into data packets and broadcasted.
  • the rendering data is used to render immersive lighting effects.
  • the rendering data includes CIE1931 color coordinates and brightness values.
  • the HDMI parsing device 11 supports HDMI2.1, HDMI2.0 and HDMI1.4 protocols; the streaming media content includes 4K resolution, 120Hz high refresh rate streaming media content and 8K resolution, 60Hz High refresh rate streaming content.
  • the HDMI analysis device 11 includes an HDMI matrix chip 111 , a downconversion chip 112 , a processor 113 and a communication module 114 .
  • the processor 113 uses an FPGA with powerful computing power or a CPU with an ARM-cortex A series core.
  • the HDMI matrix chip 111 is used to select streaming media content (for example, select the streaming media content provided by HDMI1 or HDMI2) according to the control instruction, and strip the video data and audio data, and remove the stripped video data. Data and audio data are sent to the downconversion chip 112 .
  • the downconversion chip 112 is used to convert the video data into RGB array values of a preset frame rate picture (for example, a 30 frame rate picture per second).
  • the processor 113 is used to count the number of pixels in area blocks after the video is distributed according to the plane space according to the data, accumulate the RGB values of the pixels in each area block respectively, and calculate the accumulated value of the RGB values according to the known
  • the total number of pixels is averaged to obtain the average of the RGB values in each area block; the brightness value of each area block is calculated based on the average of the RGB values in each area block, and the average of the RGB values in each area block is calculated.
  • the values are converted into corresponding CIE1931 color coordinates; the CIE1931 color coordinates (x, y values) and brightness values corresponding to each area block are encapsulated into data packets in the order of plane spatial distribution.
  • the data packet is encapsulated according to a fixed data structure.
  • the communication module 114 is used to broadcast the data packet to the lamp 12 .
  • the communication module 114 includes a Zigbee&BLE dual-mode technology module or a WiFi&BLE module.
  • the HDMI parsing device 11 extracts the attribute information of the audio data, searches for the rendering data corresponding to the attribute information according to the attribute information of the audio data, and converts the rendering data
  • the data is encapsulated into data packets and broadcasted; the rendering data corresponding to each plane space of the rendering data packet.
  • the attribute information of the audio data includes audio frequency and sound intensity.
  • the processor 113 is also used to search for the RGB value and brightness value in each area block corresponding to the sound intensity according to the sound intensity of the audio data, and compare the values with the sound intensity.
  • the RGB values in each area block with strong correspondence are converted into corresponding CIE1931 color coordinates; the CIE1931 color coordinates and brightness values corresponding to each area block are encapsulated into data packets; wherein the brightness value changes with the change of sound intensity. .
  • the communication module 114 sends the encapsulated data packet to the lamp 12.
  • the processor pre-stores (CH1, CH2,...CH11) RGB in each area block corresponding to the sound intensity of the audio data. value and brightness value.
  • the lamp 12 is used to receive the data packet, intercept the corresponding rendering data from the data packet according to the display location information of the memory, and display it.
  • the display position information of the memory is set according to the setting position and height of the lamp in the actual application scene, and the display position information of the memory corresponds one to one according to the distribution of the plane space.
  • the lamp 12 intercepts the corresponding CIE1931 color coordinates and brightness values according to its three-dimensional spatial correspondence in the area block, and drives the RGB and lamp beads of the lamp to output the corresponding Color and brightness, thereby linking audio data/video data to the lamps in real time, achieving an immersive effect of dynamic atmosphere with overflowing colors and light changing with shadows.
  • the division of various components of the above system is only a division of logical functions. In actual implementation, they can be fully or partially integrated into a physical entity, or they can also be physically separated. And these components can all be implemented in the form of software calling through processing components, or they can all be implemented in the form of hardware. Some components can also be implemented in the form of software calling through processing components, and some components can be implemented in the form of hardware.
  • the x component can be a separate processing element, or it can be integrated into a chip of the above device.
  • the x component can also be stored in the memory of the above-mentioned device in the form of program code, and a certain processing element of the above-mentioned device can call and execute the function of the above x component.
  • the implementation of other components is similar. All or part of these components can be integrated together or implemented independently.
  • the processing element described here may be an integrated circuit with signal processing capabilities. During the implementation process, each step of the above method or each of the above components can be completed by instructions in the form of hardware integrated logic circuits or software in the processor element.
  • the above components may be one or more integrated circuits configured to implement the above methods, such as: one or more application specific integrated circuits (ASIC for short), one or more microprocessors (Digital Singnal Processor, DSP for short), one or more Field Programmable Gate Array (Field Programmable Gate Array, FPGA for short), etc.
  • ASIC application specific integrated circuit
  • DSP Digital Singnal Processor
  • FPGA Field Programmable Gate Array
  • the processing element can be a general-purpose processor, such as a central processing unit (Central Processing Unit, CPU for short) or other processors that can call program code.
  • CPU Central Processing Unit
  • SOC System-on-a-chip
  • the linkage system between streaming audio/video data and lamps described in this embodiment has the following beneficial effects:
  • the linkage system between streaming audio/video data and lamps described in this embodiment utilizes the function of BLE devices that can be directly connected to smart terminals.
  • the smart terminal configures the main device and the lamps that need to participate in video linkage, simplifying the configuration process. , enhanced configuration visualization capabilities.
  • the linkage system between streaming audio/video data and lamps described in this embodiment uses wireless communication dual-mode technology to wirelessly control changes in lamp color and brightness, eliminating the need for tedious wiring and reducing the installation workload. .
  • the linkage system between streaming audio/video data and lamps described in this embodiment can be easily connected to a third-party smart home or smart lighting system.
  • BLE adopts a private protocol and can ensure the system's real-time OTA upgrade and update function, ensuring permanent The device is in the latest functional state.
  • the linkage system between streaming audio/video data and lamps described in this embodiment adopts wireless control technology and full-frame video real-time feature value extraction technology, which can easily realize an immersive linkage experience in three-dimensional space.
  • the linkage system between streaming audio/video data and lamps described in this embodiment realizes an immersive lighting interactive entertainment solution.
  • the lamps can be various types of colorful wireless smart lamps, as well as colored lamps that support pixels or pixel segments. Strips, lamps, floor lamps, table lamps, etc.
  • the linkage system between streaming audio/video data and lamps described in this embodiment only needs to obtain the corresponding CH according to the corresponding relationship between the lamps and the spatial distribution, and directly write it into the memory location of the lamp through communication, so that it can be realized at will.
  • the video linkage function can be realized by changing the lamps participating in the video linkage or without adding a special video linkage bridge, thereby linking the audio data/video data to the lamps in real time, achieving an immersive effect of dynamic atmosphere with overflowing light and changing light and shadow. .
  • This embodiment provides a linkage method between streaming audio/video data and lamps, including:
  • Receive control instructions sent by the smart terminal select streaming media content according to the control instructions, and analyze the streaming media content; the analysis results include video data and audio data;
  • the color data of each frame of the image in the video data is converted into rendering data corresponding to each plane space of the distribution according to the plane space distribution, and the color data of each frame of the video data is converted into rendering data corresponding to each plane space of the distribution.
  • the rendering data corresponding to the space is encapsulated into data packets and broadcasted; the rendering data is used to render immersive lighting effects;
  • control instruction When the control instruction is to link the lamp with audio data, extract the attribute information of the audio data, search for the rendering data corresponding to the attribute information according to the attribute information of the audio data, and encapsulate the rendering data into a data packet. Broadcast; rendering data corresponding to each plane space of the rendering data package;
  • the corresponding rendering data is intercepted from the data packet according to the display location information in the memory and displayed.
  • FIG. 4 is a schematic flowchart of a linkage method between streaming audio/video data and lamps in one embodiment.
  • the linkage method between streaming audio/video data and lamps includes the following steps:
  • S41 Receive the control instruction sent by the smart terminal; select the streaming media content according to the control instruction, and analyze the streaming media content; the analysis result includes video data and audio data.
  • the S42 includes:
  • S421 According to the control instruction, select the streaming media content (for example, select the streaming media content provided by HDMI1 or HDMI2), strip the video data and audio data, and transmit the stripped video data and audio data.
  • select the streaming media content for example, select the streaming media content provided by HDMI1 or HDMI2
  • strip the video data and audio data and transmit the stripped video data and audio data.
  • S422 Convert the video data into RGB array values of a preset frame rate picture (for example, a 30 frame rate picture per second).
  • S423 according to the plane space distribution, count the number of pixels in the area block after the video is distributed according to the data according to the plane space, accumulate the RGB values of the pixels in each area block, and average the accumulated value of the RGB value according to the known total number of pixels.
  • the control instruction is to link the lamp with audio data, extract the attribute information of the audio data, search for the rendering data corresponding to the attribute information according to the attribute information of the audio data, and encapsulate the rendering data into data.
  • the package is broadcast; the rendering data package corresponds to the rendering data of each plane space.
  • the attribute information of the audio data includes audio and sound intensity.
  • the S43 includes:
  • S433 Encapsulate the CIE1931 color coordinates and brightness value corresponding to each area block into a data packet; wherein the brightness value changes with the change of sound intensity.
  • the lamp When the lamp receives the data packet, it intercepts the corresponding rendering data in the data packet according to the display location information of the memory and displays it.
  • the display position information of the memory is set according to the setting position and height of the lamp in the actual application scene, and the display position information of the memory corresponds one to one according to the distribution of the plane space.
  • the lamp after receiving the data packet broadcast by the communication module, the lamp intercepts the corresponding CIE1931 color coordinates and brightness value according to its three-dimensional spatial correspondence in the area block, and drives the RGB and lamp beads of the lamp to output the corresponding color. and brightness, thereby linking audio data/video data to the lamps in real time to achieve a dynamic atmosphere immersive effect of overflowing light and changing light with shadow.
  • This embodiment also provides a computer-readable storage medium on which a computer program is stored.
  • the program is executed by a processor, the linkage method between streaming audio/video data and lamps as shown in Figure 4 is implemented.
  • the present application may be a system, method and/or computer program product at any possible combination of technical details.
  • the computer program product may include a computer-readable storage medium having thereon computer-readable program instructions for causing a processor to implement various aspects of the present application.
  • Computer-readable storage media may be tangible devices that can retain and store instructions for use by an instruction execution device.
  • the computer-readable storage medium may be, for example, but not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the above. More specific examples (non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM) or Flash memory), Static Random Access Memory (SRAM), Compact Disk Read Only Memory (CD-ROM), Digital Versatile Disk (DVD), Memory Stick, Floppy Disk, Mechanical Coding Device, such as a printer with instructions stored on it.
  • RAM random access memory
  • ROM read-only memory
  • EPROM erasable programmable read-only memory
  • Flash memory Static Random Access Memory
  • CD-ROM Compact Disk Read Only Memory
  • DVD Digital Versatile Disk
  • Memory Stick
  • Computer-readable storage media are not to be construed as transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or through electrical wires transmitted electrical signals.
  • the computer-readable programs described herein may be downloaded from a computer-readable storage medium to various computing/processing devices, or to an external computer or external storage device through a network, such as the Internet, a local area network, a wide area network, and/or a wireless network.
  • the network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers.
  • a network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage on a computer-readable storage medium in the respective computing/processing device .
  • Computer program instructions for performing the operations of this application may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, integrated circuit configuration data, or in one or more Source code or object code written in any combination of programming languages, including object-oriented programming languages such as Smalltalk, C++, etc., and procedural programming languages such as the "C" language or similar programming languages.
  • the computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server implement.
  • the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as an Internet service provider through the Internet). connect).
  • LAN local area network
  • WAN wide area network
  • an external computer such as an Internet service provider through the Internet. connect
  • an electronic circuit such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA)
  • the electronic circuit can Computer readable program instructions are executed to implement various aspects of the application.
  • the protection scope of the linkage method between streaming audio/video data and lamps according to the present invention is not limited to the execution sequence of the steps listed in this embodiment. Any addition, deletion, or replacement of steps in the prior art based on the principles of the present invention The implemented solutions are all included in the protection scope of the present invention.
  • the present invention also provides a linkage system between streaming media audio/video data and lamps.
  • the linkage system between streaming media audio/video data and lamps can realize the linkage method between streaming media audio/video data and lamps according to the present invention.
  • the device for realizing the linkage method between streaming audio/video data and lamps according to the present invention includes but is not limited to the structure of the linkage system between streaming audio/video data and lamps listed in this embodiment. Structural modifications and replacements made in the prior art are included in the protection scope of the present invention.
  • the linkage system, method and storage medium between streaming audio/video data and lamps according to the present invention has the following features:
  • the present invention takes advantage of the function that the BLE device can be directly connected to the smart terminal, and configures the main device and the lights that need to participate in video linkage through the smart terminal, simplifying the configuration process and enhancing the configuration visualization function.
  • the present invention utilizes wireless communication dual-mode technology to wirelessly control changes in lamp color and brightness, eliminating the need for tedious wiring and reducing the installation workload.
  • the present invention can be easily connected to third-party smart home or smart lighting systems.
  • BLE adopts a private protocol and can ensure the system's real-time OTA upgrade and update function, ensuring that the equipment is always in the latest functional state.
  • the present invention adopts wireless control technology and full-screen video feature value extraction technology in real time, which can easily realize an immersive linkage experience in three-dimensional space.
  • the lamps can be various types of colorful wireless smart lamps, as well as colored light strips, lamp tubes, floor lamps, table lamps, etc. that support pixel points or pixel segments.
  • the present invention only needs to obtain the corresponding CH according to the corresponding relationship between the lamp and the spatial distribution and directly write it into the memory location of the lamp through communication, so that the lamps participating in the video linkage can be changed at will or without adding a special video linkage network.
  • the bridge can realize the video linkage function, thereby linking the audio data/video data to the lamps in real time, achieving an immersive effect of dynamic atmosphere with ambilight and light changing with shadow. Therefore, the present invention effectively overcomes various shortcomings in the prior art and has high industrial utilization value.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

一种流媒体音/视频数据与灯具的联动系统、方法及存储介质，所述系统包括HDMI解析设备，用于将流媒体内容进行解析；解析结果包括视频数据和音频数据；当控制指令为灯具与视频数据联动时，将视频数据中每一帧图像的色彩数据按照平面空间分布转换为与分布的各平面空间对应的渲染数据；当控制指令为灯具与音频数据联动时，提取所述音频数据的属性信息，根据音频数据的属性信息查找与该属性信息对应的渲染数据，将该渲染数据封装成数据包予以广播；至少一灯具，用于接收数据包，根据内存的展示位置信息于数据包中截取对应的渲染数据，并予以展示。所述系统实现把音频/视频数据实时联动到灯具上，达到流光溢彩、光随影变的动感氛围沉浸式效果。

Description

流媒体音/视频数据与灯具的联动系统、方法及存储介质 技术领域
本发明属于照明技术领域，涉及一种联动系统，特别是涉及一种流媒体音/视频数据与灯具的联动系统、方法及存储介质。
背景技术
随着现代人的生活水平的提高，对灯光的体验已不仅仅满足于照明的基本需求。现在灯光在完成了照明功能的同时还要根据实际场景的变化渲染出相应的氛围。目前市面上有一种可以设定灯光根据视频颜色和声音联动而改变相应颜色的产品。此类产品的方案主要分为两种：
第一种，通过有线通信的方式控制灯，此方法安装麻烦，无法随意更改参与视频联动的灯；
第二种，飞利浦的hue系统基于zigbee无线控制灯光联动，由于音视频联动部分控制灯光变颜色变亮度的命令为非zigbee标准应用层协议，所以只有飞利浦的灯能够接入，其它厂商的zigbee灯则无法接入；同时由于飞利浦hue系统必须要添加特制的视频联动网桥才能实现视频联动功能，使用成本较高。
因此，如何提供一种流媒体音/视频数据与灯具的联动系统、方法及存储介质，以解决现有技术在实现音/视频与灯光联动时，需采用特制网桥，或无法随意更改参与音/视频联动的灯具等缺陷，实已成为本领域技术人员亟待解决的技术问题。
发明内容
鉴于以上所述现有技术的缺点，本发明的目的在于提供一种流媒体音/视频数据与灯具的联动系统、方法及存储介质，用于解决现有技术在实现音/视频与灯光联动时，需采用特制网桥，或无法随意更改参与音/视频联动的灯具的问题。
为实现上述目的及其他相关目的，本发明一方面提供一种流媒体音/视频数据与灯具的联动系统，所述流媒体音/视频数据与灯具的联动系统包括：HDMI解析设备，与智能终端通信连接，用于接收所述智能终端发送的控制指令；根据所述控制指令选取流媒体内容，将所述流媒体内容进行解析；解析结果包括视频数据和音频数据；其中，当所述控制指令为灯具与视频数据联动时，所述HDMI解析设备将视频数据中每一帧图像的色彩数据按照平面空间分布转换为与分布的各平面空间对应的渲染数据，并将与分布的各平面空间对应的渲染数据封 装成数据包予以广播；所述渲染数据用于渲染沉浸式照明效果；当所述控制指令为灯具与音频数据联动时，所述HDMI解析设备提取所述音频数据的属性信息，根据所述音频数据的属性信息查找与该属性信息对应的渲染数据，并将该渲染数据封装成数据包予以广播；所述渲染数据包各平面空间对应的渲染数据；至少一灯具，与所述HDMI解析设备通信连接，用于接收所述数据包，根据内存的展示位置信息于所述数据包中截取对应的渲染数据，并予以展示。
于本发明的一实施例中，所述渲染数据包括CIE1931色坐标及亮度值；所述音频数据的属性信息包括音频和音强。
于本发明的一实施例中，所述HDMI解析设备包括：HDMI矩阵芯片，用于根据所述控制指令，选取流媒体内容，并将视频数据和音频数据剥离；降频芯片，用于将所述视频数据转换为预设帧率画面的RGB阵列值；处理器，用于按照平面空间分布，统计视频按数据照平面空间分布后的区域块像素个数，将每个区域块像素的RGB值分别累加，将RGB值的累加值按照已知的像素总数做平均计算，以获取每个区域块内RGB值的平均值；根据每个区域块内RGB值的平均值计算每个区域块的亮度值，并将每个区域块内RGB值的平均值转换为成对应的CIE1931色坐标；将每个区域块对应的CIE1931色坐标及亮度值按照平面空间分布的顺序封装成数据包；通信模组，用于广播所述数据包。
于本发明的一实施例中，所述处理器还用于根据音频数据的音强查找与该音强对应的每个区域块内RGB值和亮度值，并将与该音强对应的每个区域块内RGB值转换为成对应的CIE1931色坐标；将每个区域块对应的CIE1931色坐标和亮度值封装成数据包；其中，所述亮度值随音强的变化而变化。
于本发明的一实施例中，内存的展示位置信息包括所述灯具与区域块的立体空间对应关系。
于本发明的一实施例中，所述灯具用于接收到通信模组广播的数据包后，根据其于区域块的立体空间对应关系截取对应的CIE1931色坐标及亮度值，驱动该灯具的RGB及灯珠输出对应的色彩及亮度。
于本发明的一实施例中，所述通信模组包括Zigbee和BLE双模组或WiFi和BLE双模组。
于本发明的一实施例中，所述HDMI解析设备支持HDMI2.1、HDMI2.0及HDMI1.4协议；所述流媒体内容包括4K分辨率、120Hz高刷新率的流媒体内容及8K分辨率、60Hz高刷新率的流媒体内容。
本发明另一方面提供一种流媒体音/视频数据与灯具的联动方法，包括：接收所述智能终 端发送的控制指令；根据所述控制指令选取流媒体内容，将所述流媒体内容进行解析；解析结果包括视频数据和音频数据；其中，当所述控制指令为灯具与视频数据联动时，将视频数据中每一帧图像的色彩数据按照平面空间分布转换为与分布的各平面空间对应的渲染数据，并将与分布的各平面空间对应的渲染数据封装成数据包予以广播；所述渲染数据用于渲染沉浸式照明效果；当所述控制指令为灯具与音频数据联动时，提取所述音频数据的属性信息，根据所述音频数据的属性信息查找与该属性信息对应的渲染数据，并将该渲染数据封装成数据包予以广播；所述渲染数据包各平面空间对应的渲染数据；当至少一灯具到接收所述数据包，根据内存的展示位置信息于所述数据包中截取对应的渲染数据，并予以展示。
本发明最后一方面提供一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现所述流媒体音/视频数据与灯具的联动方法。
如上所述，本发明所述的流媒体音/视频数据与灯具的联动系统、方法及存储介质，具有以下有益效果：
第一，本发明利用了BLE设备可以与智能终端直连的功能，通过智能终端配置主设备和需要参加视频联动的灯，简化了配置流程，增强了配置可视化功能。
第二，本发明利用了无线通信双模技术，通过无线控制灯颜色和亮度的变化，省去了布线的繁琐，减轻了安装的工作量。
第三，本发明能轻松对接到第三方智能家居或智能照明系统，同时BLE采用私有协议，又能保证系统的实时OTA升级更新功能，永保设备在最新功能状态。
第四，本发明采用无线控制技术及视频全画面实时提取特征值技术，能轻易实现立体空间的沉浸式联动体验。
第五，本发明实现了沉浸式灯光互动娱乐方案，灯具可以是彩色的各种类型无线智能灯具，以及支持像素点或像素段的彩色灯带、灯管、落地灯、桌灯等。
第六，本发明仅需要按照灯具与空间分布的对应关系就可以得到对应的CH并通过通信方式直接写入灯具的内存位置，实现可以随意更改参与视频联动的灯或无需添加特制的视频联动网桥便能实现视频联动功能，从而把音频数据/视频数据实时联动到灯具上，达到流光溢彩、光随影变的动感氛围沉浸式效果。
附图说明
图1显示为本发明的应用场景示意图。
图2显示为本发明的平面空间的划分示意图。
图3A显示为本发明的流媒体音/视频数据与灯具的联动系统于一实施例中的原理结构图。
图3B显示为本发明的流媒体音/视频数据与灯具的联动系统于一实施例中内部原理结构示意图。
图4显示为本发明的流媒体音/视频数据与灯具的联动方法于一实施例中的流程示意图。
元件标号说明
1        流媒体音/视频数据与灯具的联动系统
2        多媒体显示设备
3        智能终端
11       HDMI解析设备
12       灯具
111      HDMI矩阵芯片
112      降频芯片
113      处理器
114      通信模组
S41～S43 步骤
具体实施方式
以下通过特定的具体实例说明本发明的实施方式，本领域技术人员可由本说明书所揭露的内容轻易地了解本发明的其他优点与功效。本发明还可以通过另外不同的具体实施方式加以实施或应用，本说明书中的各项细节也可以基于不同观点与应用，在没有背离本发明的精神下进行各种修饰或改变。需说明的是，在不冲突的情况下，以下实施例及实施例中的特征可以相互组合。
需要说明的是，以下实施例中所提供的图示仅以示意方式说明本发明的基本构想，遂图式中仅显示与本发明中有关的组件而非按照实际实施时的组件数目、形状及尺寸绘制，其实际实施时各组件的型态、数量及比例可为一种随意的改变，且其组件布局型态也可能更为复杂。
实施例一
本实施例提供一种流媒体音/视频数据与灯具的联动系统，包括：
HDMI解析设备，与智能终端通信连接，用于接收所述智能终端发送的控制指令；根据所述控制指令选取流媒体内容，将所述流媒体内容进行解析；解析结果包括视频数据和音频数据；
其中，当所述控制指令为灯具与视频数据联动时，所述HDMI解析设备将视频数据中每一帧图像的色彩数据按照平面空间分布转换为与分布的各平面空间对应的渲染数据，并将与分布的各平面空间对应的渲染数据封装成数据包予以广播；所述渲染数据用于渲染沉浸式照明效果；
当所述控制指令为灯具与音频数据联动时，所述HDMI解析设备提取所述音频数据的属性信息，根据所述音频数据的属性信息查找与该属性信息对应的渲染数据，并将该渲染数据封装成数据包予以广播；所述渲染数据包各平面空间对应的渲染数据；
至少一灯具，与所述HDMI解析设备通信连接，用于接收所述数据包，根据内存的展示位置信息于所述数据包中截取对应的渲染数据，并予以展示。
以下将结合图示对本实施例所提供的流媒体音/视频数据与灯具的联动系统进行详细描述。请参阅图1，显示为流媒体音/视频数据与灯具的联动系统的应用场景示意图。如图1所示，所述流媒体音/视频数据与灯具的联动系统1与多媒体显示设备2(例如，电视视、游戏机、投影机等等)和智能终端3通信连接。其中，所述多媒体显示设备2用于为所述流媒体音/视频数据与灯具的联动系统1提供流媒体内容。所述智能终端3用于通过人机交互界面输出针对所述流媒体音/视频数据与灯具的联动系统1的控制指令，以便在所述流媒体音/视频数据与灯具的联动系统1解析所述控制指令后，根据该控制指令实现灯具与音频或视频的联动。其中，所述控制指令包括选择提供流媒体内容的通道，选择参加音/视频联动的灯具及与该灯具对应的平面空间。其中，灯具的标识符(例如，编号)与分布的平面空间是一一对应的。在本实施例中，平面空间的划分如图2所示，分为包括11个区域块，即CH1，CH2，…CH11。
请参阅图3A和图3B，显示为流媒体音/视频数据与灯具的联动系统于一实施例中的原理结构图和内部原理结构示意图。
如图3A所示，所述流媒体音/视频数据与灯具的联动系统1包括HDMI解析设备11和与所述HDMI解析设备11通信连接的至少一个灯具12。
所述HDMI解析设备11用于接收所述智能终端3发送的控制指令；根据所述控制指令选取流媒体内容，将所述流媒体内容进行解析；解析结果包括视频数据和音频数据。
当所述控制指令为灯具与视频数据联动时，所述HDMI解析设备11将视频数据中每一帧图像的色彩数据按照平面空间分布转换为与分布的各平面空间对应的渲染数据，并将与分 布的各平面空间对应的渲染数据封装成数据包予以广播。所述渲染数据用于渲染沉浸式照明效果。在本实施例中，所述渲染数据包括CIE1931色坐标及亮度值。
在本实施例中，所述HDMI解析设备11支持HDMI2.1、HDMI2.0及HDMI1.4协议；所述流媒体内容包括4K分辨率、120Hz高刷新率的流媒体内容及8K分辨率、60Hz高刷新率的流媒体内容。
请参阅图3B，所述HDMI解析设备11包括HDMI矩阵芯片111、降频芯片112、处理器113及通信模组114。在本实施例中，所述处理器113采用采用算力强劲的FPGA或者ARM-cortex A系列内核的CPU等。
其中，所述HDMI矩阵芯片111用于根据所述控制指令，选取流媒体内容(例如，从HDMI1或者HDMI2中选择其提供的流媒体内容)，并将视频数据和音频数据剥离，将剥离的视频数据和音频数据送入所述降频芯片112。
所述降频芯片112用于将所述视频数据转换为预设帧率画面(例如，每秒30帧率画面)的RGB阵列值。
所述处理器113用于按照平面空间分布，统计视频按数据照平面空间分布后的区域块像素个数，将每个区域块像素的RGB值分别累加，将RGB值的累加值按照已知的像素总数做平均计算，以获取每个区域块内RGB值的平均值；根据每个区域块内RGB值的平均值计算每个区域块的亮度值，并将每个区域块内RGB值的平均值转换为成对应的CIE1931色坐标；将每个区域块对应的CIE1931色坐标(x,y值)及亮度值按照平面空间分布的顺序封装成数据包。在本实施例中，所述数据包按照固定数据结构封装。
在本实施例中，每个区域块的亮度值的转换公式为Y＝0.2990R+0.5870G+0.1140B。
所述通信模组114用于广播所述数据包至所述灯具12。在本实施例中，所述通信模组114包括Zigbee&BLE双模技术模组或WiFi&BLE模组。
当所述控制指令为灯具与音频数据联动时，所述HDMI解析设备11提取所述音频数据的属性信息，根据所述音频数据的属性信息查找与该属性信息对应的渲染数据，并将该渲染数据封装成数据包予以广播；所述渲染数据包各平面空间对应的渲染数据。在本实施例中，所述音频数据的属性信息包括音频和音强。
当所述控制指令为灯具与音频数据联动时，所述处理器113还用于根据音频数据的音强查找与该音强对应的每个区域块内RGB值和亮度值，并将与该音强对应的每个区域块内RGB值转换为成对应的CIE1931色坐标；将每个区域块对应的CIE1931色坐标和亮度值封装成数据包；其中，所述亮度值随音强的变化而变化。所述通信模块114将封装后的数据包予以发 送至灯具12。
在本实施例中，若所述控制指令为灯具与音频数据联动时，所述处理器中预存有与音频数据的音强一一对应的每个区域块内(CH1，CH2，…CH11)RGB值和亮度值。
所述灯具12用于接收所述数据包，根据内存的展示位置信息于所述数据包中截取对应的渲染数据，并予以展示。
在本实施例中，内存的展示位置信息根据所述灯具于实际应用场景的设置位置和高度设置，且该内存的展示位置信息根据平面空间的分布一一对应。
具体地，所述灯具12在接收到通信模组广播的数据包后，根据其于区域块的立体空间对应关系截取对应的CIE1931色坐标及亮度值，驱动该灯具的RGB及灯珠输出对应的色彩及亮度，从而把音频数据/视频数据实时联动到灯具上，达到流光溢彩、光随影变的动感氛围沉浸式效果。
需要说明的是，应理解以上系统的各个部件的划分仅仅是一种逻辑功能的划分，实际实现时可以全部或部分集成到一个物理实体上，也可以物理上分开。且这些部件可以全部以软件通过处理元件调用的形式实现，也可以全部以硬件的形式实现，还可以部分部件通过处理元件调用软件的形式实现，部分部件通过硬件的形式实现。例如：x部件可以为单独设立的处理元件，也可以集成在上述装置的某一个芯片中实现。此外，x部件也可以以程序代码的形式存储于上述装置的存储器中，由上述装置的某一个处理元件调用并执行以上x部件的功能。其它部件的实现与之类似。这些部件全部或部分可以集成在一起，也可以独立实现。这里所述的处理元件可以是一种集成电路，具有信号的处理能力。在实现过程中，上述方法的各步骤或以上各个部件可以通过处理器元件中的硬件的集成逻辑电路或者软件形式的指令完成。以上这些部件可以是被配置成实施以上方法的一个或多个集成电路，例如：一个或多个特定集成电路(Application Specific Integrated Circuit，简称ASIC)，一个或多个微处理器(Digital Singnal Processor，简称DSP)，一个或者多个现场可编程门阵列(Field Programmable Gate Array，简称FPGA)等。当以上某个部件通过处理元件调度程序代码的形式实现时，该处理元件可以是通用处理器，如中央处理器(Central Processing Unit，简称CPU)或其它可以调用程序代码的处理器。这些部件可以集成在一起，以片上系统(System-on-a-chip，简称SOC)的形式实现。
本实施例所述流媒体音/视频数据与灯具的联动系统具有以下有益效果：
第一，本实施例所述流媒体音/视频数据与灯具的联动系统利用了BLE设备可以与智能终端直连的功能，通过智能终端配置主设备和需要参加视频联动的灯，简化了配置流程，增 强了配置可视化功能。
第二，本实施例所述流媒体音/视频数据与灯具的联动系统利用了无线通信双模技术，通过无线控制灯颜色和亮度的变化，省去了布线的繁琐，减轻了安装的工作量。
第三，本实施例所述流媒体音/视频数据与灯具的联动系统能轻松对接到第三方智能家居或智能照明系统，同时BLE采用私有协议，又能保证系统的实时OTA升级更新功能，永保设备在最新功能状态。
第四，本实施例所述流媒体音/视频数据与灯具的联动系统采用无线控制技术及视频全画面实时提取特征值技术，能轻易实现立体空间的沉浸式联动体验。
第五，本实施例所述流媒体音/视频数据与灯具的联动系统实现了沉浸式灯光互动娱乐方案，灯具可以是彩色的各种类型无线智能灯具，以及支持像素点或像素段的彩色灯带、灯管、落地灯、桌灯等。
第六，本实施例所述流媒体音/视频数据与灯具的联动系统仅需要按照灯具与空间分布的对应关系就可以得到对应的CH并通过通信方式直接写入灯具的内存位置，实现可以随意更改参与视频联动的灯或无需添加特制的视频联动网桥便能实现视频联动功能，从而把音频数据/视频数据实时联动到灯具上，达到流光溢彩、光随影变的动感氛围沉浸式效果。
实施例二
本实施例提供一种流媒体音/视频数据与灯具的联动方法，包括：
接收智能终端发送的控制指令；根据所述控制指令选取流媒体内容，将所述流媒体内容进行解析；解析结果包括视频数据和音频数据；
其中，当所述控制指令为灯具与视频数据联动时，将视频数据中每一帧图像的色彩数据按照平面空间分布转换为与分布的各平面空间对应的渲染数据，并将与分布的各平面空间对应的渲染数据封装成数据包予以广播；所述渲染数据用于渲染沉浸式照明效果；
当所述控制指令为灯具与音频数据联动时，提取所述音频数据的属性信息，根据所述音频数据的属性信息查找与该属性信息对应的渲染数据，并将该渲染数据封装成数据包予以广播；所述渲染数据包各平面空间对应的渲染数据；
当至少一灯具到接收所述数据包，根据内存的展示位置信息于所述数据包中截取对应的渲染数据，并予以展示。
以下将结合图示对本实施例所提供的流媒体音/视频数据与灯具的联动方法进行详细描述。请参阅图4，显示为流媒体音/视频数据与灯具的联动方法于一实施例中的流程示意图。如图4所示，所述流媒体音/视频数据与灯具的联动方法包括以下步骤：
S41，接收智能终端发送的控制指令；根据所述控制指令选取流媒体内容，将所述流媒体内容进行解析；解析结果包括视频数据和音频数据。
S42，当所述控制指令为灯具与视频数据联动时，将视频数据中每一帧图像的色彩数据按照平面空间分布转换为与分布的各平面空间对应的渲染数据，并将与分布的各平面空间对应的渲染数据封装成数据包予以广播；所述渲染数据用于渲染沉浸式照明效果。
具体地，所述S42包括：
S421，根据所述控制指令，选取流媒体内容(例如，从HDMI1或者HDMI2中选择其提供的流媒体内容)，并将视频数据和音频数据剥离，并传输剥离的视频数据和音频数据。
S422，将所述视频数据转换为预设帧率画面(例如，每秒30帧率画面)的RGB阵列值。S423,按照平面空间分布，统计视频按数据照平面空间分布后的区域块像素个数，将每个区域块像素的RGB值分别累加，将RGB值的累加值按照已知的像素总数做平均计算，以获取每个区域块内RGB值的平均值；根据每个区域块内RGB值的平均值计算每个区域块的亮度值，并将每个区域块内RGB值的平均值转换为成对应的CIE1931色坐标；将每个区域块对应的CIE1931色坐标(x,y值)及亮度值按照平面空间分布的顺序封装成数据包。
在本实施例中，每个区域块的亮度值的转换公式为Y＝0.2990R+0.5870G+0.1140B。
S424，广播所述数据包至所述灯具。
S43，当所述控制指令为灯具与音频数据联动时，提取所述音频数据的属性信息，根据所述音频数据的属性信息查找与该属性信息对应的渲染数据，并将该渲染数据封装成数据包予以广播；所述渲染数据包各平面空间对应的渲染数据。在本实施例中，所述音频数据的属性信息包括音频和音强。
具体地，所述S43包括：
S431，当所述控制指令为灯具与音频数据联动时，根据音频数据的音强查找与该音强对应的每个区域块内RGB值和亮度值。
S432，将与该音强对应的每个区域块内RGB值转换为成对应的CIE1931色坐标。
S433，将每个区域块对应的CIE1931色坐标和亮度值封装成数据包；其中，所述亮度值随音强的变化而变化。
S434，将封装后的数据包予以发送至灯具。
当所述灯具接收所述数据包，根据内存的展示位置信息于所述数据包中截取对应的渲染数据，并予以展示。
在本实施例中，内存的展示位置信息根据所述灯具于实际应用场景的设置位置和高度设 置，且该内存的展示位置信息根据平面空间的分布一一对应。
具体地，所述灯具在接收到通信模组广播的数据包后，根据其于区域块的立体空间对应关系截取对应的CIE1931色坐标及亮度值，驱动该灯具的RGB及灯珠输出对应的色彩及亮度，从而把音频数据/视频数据实时联动到灯具上，达到流光溢彩、光随影变的动感氛围沉浸式效果。
本实施例还提供一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现如图4所述的流媒体音/视频数据与灯具的联动方法。
在任何可能的技术细节结合层面，本申请可以是系统、方法和/或计算机程序产品。计算机程序产品可以包括计算机可读存储介质，其上载有用于使处理器实现本申请的各个方面的计算机可读程序指令。
计算机可读存储介质可以是可以保持和存储由指令执行设备使用的指令的有形设备。计算机可读存储介质例如可以是(但不限于)电存储设备、磁存储设备、光存储设备、电磁存储设备、半导体存储设备或者上述的任意合适的组合。计算机可读存储介质的更具体的例子(非穷举的列表)包括：便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、静态随机存取存储器(SRAM)、便携式压缩盘只读存储器(CD-ROM)、数字多功能盘(DVD)、记忆棒、软盘、机械编码设备、例如其上存储有指令的打孔卡或凹槽内凸起结构、以及上述的任意合适的组合。这里所使用的计算机可读存储介质不被解释为瞬时信号本身，诸如无线电波或者其他自由传播的电磁波、通过波导或其他传输媒介传播的电磁波(例如，通过光纤电缆的光脉冲)、或者通过电线传输的电信号。
这里所描述的计算机可读程序可以从计算机可读存储介质下载到各个计算/处理设备，或者通过网络、例如因特网、局域网、广域网和/或无线网下载到外部计算机或外部存储设备。网络可以包括铜传输电缆、光纤传输、无线传输、路由器、防火墙、交换机、网关计算机和/或边缘服务器。每个计算/处理设备中的网络适配卡或者网络接口从网络接收计算机可读程序指令，并转发该计算机可读程序指令，以供存储在各个计算/处理设备中的计算机可读存储介质中。用于执行本申请操作的计算机程序指令可以是汇编指令、指令集架构(ISA)指令、机器指令、机器相关指令、微代码、固件指令、状态设置数据、集成电路配置数据或者以一种或多种编程语言的任意组合编写的源代码或目标代码，所述编程语言包括面向对象的编程语言—诸如Smalltalk、C++等，以及过程式编程语言—诸如“C”语言或类似的编程语言。计算机可读程序指令可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服 务器上执行。在涉及远程计算机的情形中，远程计算机可以通过任意种类的网络—包括局域网(LAN)或广域网(WAN)—连接到用户计算机，或者，可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。在一些实施例中，通过利用计算机可读程序指令的状态信息来个性化定制电子电路，例如可编程逻辑电路、现场可编程门阵列(FPGA)或可编程逻辑阵列(PLA)，该电子电路可以执行计算机可读程序指令，从而实现本申请的各个方面。
本发明所述的流媒体音/视频数据与灯具的联动方法的保护范围不限于本实施例列举的步骤执行顺序，凡是根据本发明的原理所做的现有技术的步骤增减、步骤替换所实现的方案都包括在本发明的保护范围内。
本发明还提供一种流媒体音/视频数据与灯具的联动系统，所述流媒体音/视频数据与灯具的联动系统可以实现本发明所述的流媒体音/视频数据与灯具的联动方法，但本发明所述的流媒体音/视频数据与灯具的联动方法的实现装置包括但不限于本实施例列举的流媒体音/视频数据与灯具的联动系统的结构，凡是根据本发明的原理所做的现有技术的结构变形和替换，都包括在本发明的保护范围内。
综上所述，本发明所述流媒体音/视频数据与灯具的联动系统、方法及存储介质具有以下
有益效果：
第一，本发明利用了BLE设备可以与智能终端直连的功能，通过智能终端配置主设备和需要参加视频联动的灯，简化了配置流程，增强了配置可视化功能。
第二，本发明利用了无线通信双模技术，通过无线控制灯颜色和亮度的变化，省去了布线的繁琐，减轻了安装的工作量。
第三，本发明能轻松对接到第三方智能家居或智能照明系统，同时BLE采用私有协议，又能保证系统的实时OTA升级更新功能，永保设备在最新功能状态。
第四，本发明采用无线控制技术及视频全画面实时提取特征值技术，能轻易实现立体空间的沉浸式联动体验。
第五，本发明实现了沉浸式灯光互动娱乐方案，灯具可以是彩色的各种类型无线智能灯具，以及支持像素点或像素段的彩色灯带、灯管、落地灯、桌灯等。
第六，本发明仅需要按照灯具与空间分布的对应关系就可以得到对应的CH并通过通信方式直接写入灯具的内存位置，实现可以随意更改参与视频联动的灯或无需添加特制的视频联动网桥便能实现视频联动功能，从而把音频数据/视频数据实时联动到灯具上，达到流光溢彩、光随影变的动感氛围沉浸式效果。因此，本发明有效克服了现有技术中的种种缺点而具高度产业利用价值。
上述实施例仅例示性说明本发明的原理及其功效，而非用于限制本发明。任何熟悉此技术的人士皆可在不违背本发明的精神及范畴下，对上述实施例进行修饰或改变。因此，举凡所属技术领域中具有通常知识者在未脱离本发明所揭示的精神与技术思想下所完成的一切等效修饰或改变，仍应由本发明的权利要求所涵盖。

Claims (10)

  1. 一种流媒体音/视频数据与灯具的联动系统，其特征在于，所述流媒体音/视频数据与灯具的联动系统包括：
    HDMI解析设备，与智能终端通信连接，用于接收所述智能终端发送的控制指令；根据所述控制指令选取流媒体内容，将所述流媒体内容进行解析；解析结果包括视频数据和音频数据；
    其中，当所述控制指令为灯具与视频数据联动时，所述HDMI解析设备将视频数据中每一帧图像的色彩数据按照平面空间分布转换为与分布的各平面空间对应的渲染数据，并将与分布的各平面空间对应的渲染数据封装成数据包予以广播；所述渲染数据用于渲染沉浸式照明效果；
    当所述控制指令为灯具与音频数据联动时，所述HDMI解析设备提取所述音频数据的属性信息，根据所述音频数据的属性信息查找与该属性信息对应的渲染数据，并将该渲染数据封装成数据包予以广播；所述渲染数据包各平面空间对应的渲染数据；
    至少一灯具，与所述HDMI解析设备通信连接，用于接收所述数据包，根据内存的展示位置信息于所述数据包中截取对应的渲染数据，并予以展示。
  2. 根据权利要求1所述的流媒体音/视频数据与灯具的联动系统，其特征在于，
    所述渲染数据包括CIE1931色坐标及亮度值；
    所述音频数据的属性信息包括音频和音强。
  3. 根据权利要求2所述的流媒体音/视频数据与灯具的联动系统，其特征在于，所述HDMI解析设备包括：
    HDMI矩阵芯片，用于根据所述控制指令，选取流媒体内容，并将视频数据和音频数据剥离；
    降频芯片，用于将所述视频数据转换为预设帧率画面的RGB阵列值；
    处理器，用于按照平面空间分布，统计视频按数据照平面空间分布后的区域块像素个数，将每个区域块像素的RGB值分别累加，将RGB值的累加值按照已知的像素总数做平均计算，以获取每个区域块内RGB值的平均值；根据每个区域块内RGB值的平均值计算每个区域块的亮度值，并将每个区域块内RGB值的平均值转换为成对应的CIE1931色坐标；将每个区域块对应的CIE1931色坐标及亮度值按照平面空间分布的顺序封装成数据包；
    通信模组，用于广播所述数据包。
  4. 根据权利要求3所述的流媒体音/视频数据与灯具的联动系统，其特征在于，所述处理器还用于根据音频数据的音强查找与该音强对应的每个区域块内RGB值和亮度值，并将与该音强对应的每个区域块内RGB值转换为成对应的CIE1931色坐标；将每个区域块对应的CIE1931色坐标和亮度值封装成数据包；其中，所述亮度值随音强的变化而变化。
  5. 根据权利要求3或4所述的流媒体音/视频数据与灯具的联动系统，其特征在于，内存的展示位置信息包括所述灯具与区域块的立体空间对应关系。
  6. 根据权利要求5所述的流媒体音/视频数据与灯具的联动系统，其特征在于，所述灯具用于接收到通信模组广播的数据包后，根据其于区域块的立体空间对应关系截取对应的CIE1931色坐标及亮度值，驱动该灯具的RGB及灯珠输出对应的色彩及亮度。
  7. 根据权利要求3所述的流媒体音/视频数据与灯具的联动系统，其特征在于，所述通信模组包括Zigbee和BLE双模组或WiFi和BLE双模组。
  8. 根据权利要求3所述的流媒体音/视频数据与灯具的联动系统，其特征在于，所述HDMI解析设备支持HDMI2.1、HDMI2.0及HDMI1.4协议；所述流媒体内容包括4K分辨率、120Hz高刷新率的流媒体内容及8K分辨率、60Hz高刷新率的流媒体内容。
  9. 一种流媒体音/视频数据与灯具的联动方法，其特征在于，包括：
    接收智能终端发送的控制指令；根据所述控制指令选取流媒体内容，将所述流媒体内容进行解析；解析结果包括视频数据和音频数据；
    其中，当所述控制指令为灯具与视频数据联动时，将视频数据中每一帧图像的色彩数据按照平面空间分布转换为与分布的各平面空间对应的渲染数据，并将与分布的各平面空间对应的渲染数据封装成数据包予以广播；所述渲染数据用于渲染沉浸式照明效果；
    当所述控制指令为灯具与音频数据联动时，提取所述音频数据的属性信息，根据所述音频数据的属性信息查找与该属性信息对应的渲染数据，并将该渲染数据封装成数据包予以广播；所述渲染数据包各平面空间对应的渲染数据；
    当至少一灯具到接收所述数据包，根据内存的展示位置信息于所述数据包中截取对应的渲染数据，并予以展示。
  10. 一种计算机可读存储介质，其上存储有计算机程序，其特征在于，该程序被处理器执行时实现权利要求9所述流媒体音/视频数据与灯具的联动方法。
PCT/CN2022/142994 2022-07-20 2022-12-28 流媒体音/视频数据与灯具的联动系统、方法及存储介质 WO2024016603A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210863273.3 2022-07-20
CN202210863273.3A CN115334099B (zh) 2022-07-20 2022-07-20 流媒体音/视频数据与灯具的联动系统、方法及存储介质

Publications (1)

Publication Number Publication Date
WO2024016603A1 true WO2024016603A1 (zh) 2024-01-25

Family

ID=83919239

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/142994 WO2024016603A1 (zh) 2022-07-20 2022-12-28 流媒体音/视频数据与灯具的联动系统、方法及存储介质

Country Status (2)

Country Link
CN (1) CN115334099B (zh)
WO (1) WO2024016603A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115334099B (zh) * 2022-07-20 2024-02-27 榜威电子科技（上海）有限公司 流媒体音/视频数据与灯具的联动系统、方法及存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113573442A (zh) * 2021-07-16 2021-10-29 广东和音元视电子科技有限公司 音频控制场景的方法、设备和计算机可读存储介质
WO2022013131A1 (en) * 2020-07-13 2022-01-20 Signify Holding B.V. Selecting lighting devices for rendering entertainment lighting based on relative distance information
CN114126135A (zh) * 2021-12-23 2022-03-01 深圳市迈捷物联光电有限公司 灯光视频画面智能互动系统、灯光视频画面智能互动控制方法、电视机
CN114158160A (zh) * 2021-11-26 2022-03-08 杭州当虹科技股份有限公司 基于视频内容分析的沉浸式氛围灯系统
CN114666936A (zh) * 2022-04-01 2022-06-24 深圳随升扬科技有限公司 通过hdmi音视频流做出混合现实氛围效果的系统及方法
CN115334099A (zh) * 2022-07-20 2022-11-11 榜威电子科技（上海）有限公司 流媒体音/视频数据与灯具的联动系统、方法及存储介质

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8225362B2 (en) * 2008-05-08 2012-07-17 Sony Corporation Distributed diagnostics for internet video link
CN101578001B (zh) * 2009-06-05 2013-01-02 彩虹集团公司 一种直下式led背光源色彩调整方法及其调整装置
US10542598B2 (en) * 2015-08-07 2020-01-21 Signify Holding B.V. Lighting control
US11202050B2 (en) * 2016-10-14 2021-12-14 Lg Electronics Inc. Data processing method and device for adaptive image playing
KR20200028532A (ko) * 2018-09-06 2020-03-17 주식회사 비즈모델라인 영상 투영 기능을 구비한 카메라장치
WO2020078793A1 (en) * 2018-10-18 2020-04-23 Signify Holding B.V. Determining a light effect impact based on a determined input pattern
JP7080399B2 (ja) * 2018-11-01 2022-06-03 シグニファイ ホールディング ビー ヴィ ビデオ及びオーディオの重みに依存したビデオ及びオーディオ情報に基づく光効果の決定
CN109640465A (zh) * 2018-11-07 2019-04-16 萤火虫（深圳）灯光科技有限公司 自动识别音乐的灯光控制方法、装置、设备及存储介质
WO2020165331A1 (en) * 2019-02-15 2020-08-20 Signify Holding B.V. Determining light effects based on a light script and/or media content and light rendering properties of a display device
CN112512187A (zh) * 2020-03-17 2021-03-16 苏州安澜展览展示有限公司 一种智能灯光控制系统
WO2022144171A1 (en) * 2021-01-04 2022-07-07 Signify Holding B.V. Adjusting light effects based on adjustments made by users of other systems
CN113286405B (zh) * 2021-04-30 2022-06-28 深圳市凯润智能照明有限公司 实现音频与图像同步控制灯光的系统及方法
CN114040249A (zh) * 2021-11-26 2022-02-11 康佳集团股份有限公司 基于画面的氛围灯调节方法、装置、智能终端及存储介质
CN114727452B (zh) * 2022-06-09 2022-09-02 杭州罗莱迪思科技股份有限公司 基于rgb模式的多基色灯光控制方法及其应用

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022013131A1 (en) * 2020-07-13 2022-01-20 Signify Holding B.V. Selecting lighting devices for rendering entertainment lighting based on relative distance information
CN113573442A (zh) * 2021-07-16 2021-10-29 广东和音元视电子科技有限公司 音频控制场景的方法、设备和计算机可读存储介质
CN114158160A (zh) * 2021-11-26 2022-03-08 杭州当虹科技股份有限公司 基于视频内容分析的沉浸式氛围灯系统
CN114126135A (zh) * 2021-12-23 2022-03-01 深圳市迈捷物联光电有限公司 灯光视频画面智能互动系统、灯光视频画面智能互动控制方法、电视机
CN114666936A (zh) * 2022-04-01 2022-06-24 深圳随升扬科技有限公司 通过hdmi音视频流做出混合现实氛围效果的系统及方法
CN115334099A (zh) * 2022-07-20 2022-11-11 榜威电子科技（上海）有限公司 流媒体音/视频数据与灯具的联动系统、方法及存储介质

Also Published As

Publication number Publication date
CN115334099B (zh) 2024-02-27
CN115334099A (zh) 2022-11-11

Similar Documents

Publication Publication Date Title
US10250858B2 (en) Stage lamp based on TCP/IP protocol and control system thereof
WO2021057097A1 (zh) 图像渲染和编码方法及相关装置
WO2024016603A1 (zh) 流媒体音/视频数据与灯具的联动系统、方法及存储介质
JP7359521B2 (ja) 画像処理方法および装置
WO2019233314A1 (zh) 一种电视墙图像回显方法、服务器件及电视墙系统
WO2013120331A1 (zh) 屏幕内容的显示方法及装置
CN110012336B (zh) 直播界面的图片配置方法、终端及装置
CN103237179A (zh) 一种拼接墙视频窗口字幕显示方法及装置
CN104219118A (zh) 家电设备控制装置和系统
CN104244029B (zh) 具有远程截屏功能的广告机系统及其方法
CN104244047A (zh) 无屏超级电视和家电设备控制系统
CN105446680A (zh) 一种屏幕镜像及其扩展方法、系统及终端设备
WO2023214718A1 (ko) 무선 통신 시스템에서 ar 스플릿 렌더링을 제공하기 위한 방법 및 장치
CN111586927A (zh) 灯光控制系统及方法
CN204669548U (zh) 网络投影仪
CN103986957A (zh) 激光智能电视
WO2018080042A1 (en) Electronic apparatus and control method thereof
CN103517019A (zh) 电子设备的成像系统、包括上述成像系统的手机
CN111294628B (zh) 一种多通道沉浸式影音视频控制系统
CN113490040A (zh) 一种基于hdmi的传输方法及相关装置
CN111026497A (zh) 一种用于提供多屏幕的设备和动态配置多屏幕的方法
WO2023185856A1 (zh) 数据传输方法、装置、电子设备及可读存储介质
CN111385504A (zh) 一种拼接电视及控制方法
CN111818140B (zh) 一种基于5g的多媒体墙控制系统及方法、电子设备
CN107835379A (zh) 影院播控及多通道融合系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22951858

Country of ref document: EP

Kind code of ref document: A1