CN110493090B - Method and system for realizing intelligent home theater - Google Patents

Method and system for realizing intelligent home theater Download PDF

Info

Publication number
CN110493090B
CN110493090B CN201910778417.3A CN201910778417A CN110493090B CN 110493090 B CN110493090 B CN 110493090B CN 201910778417 A CN201910778417 A CN 201910778417A CN 110493090 B CN110493090 B CN 110493090B
Authority
CN
China
Prior art keywords
information
iot
video
environment
operation instruction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910778417.3A
Other languages
Chinese (zh)
Other versions
CN110493090A (en
Inventor
黎安
赵言
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics China R&D Center
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics China R&D Center
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics China R&D Center, Samsung Electronics Co Ltd filed Critical Samsung Electronics China R&D Center
Priority to CN201910778417.3A priority Critical patent/CN110493090B/en
Publication of CN110493090A publication Critical patent/CN110493090A/en
Application granted granted Critical
Publication of CN110493090B publication Critical patent/CN110493090B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00—Systems controlled by a computer
    • G05B15/02—Systems controlled by a computer electric
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/20—Pc systems
    • G05B2219/26—Pc applications
    • G05B2219/2642—Domotique, domestic, home control, automation, smart house

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Manufacturing & Machinery (AREA)
  • Quality & Reliability (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The application discloses a method for realizing intelligent home theater, which comprises the following steps: when a video is played, detecting whether the video contains playing environment suggestion information; if the video contains the playing environment suggestion information, generating an operation instruction according to the playing environment suggestion information, and controlling IOT equipment in the current family to realize an environment corresponding to the playing environment suggestion information; if the video does not contain the playing environment suggestion information, analyzing the content of the video to obtain the playing environment suggestion information matched with the video, generating an operation instruction according to the playing environment suggestion information, and controlling the IOT equipment in the current family to realize the environment corresponding to the playing environment suggestion information. The application also discloses an intelligent home theater system. By applying the technical scheme disclosed by the application, the vivid and real intelligent home theater can be realized, and the intelligence of the intelligent home theater is improved.

Description

Method and system for realizing intelligent home theater
Technical Field
The application relates to the technical field of intelligent home, in particular to a method and a system for realizing an intelligent home theater.
Background
The home theater is a professional audiovisual projection site simulated at home. The audio-visual equipment of a common family is a television which is integrally formed, and when a video is watched at the family, visual and auditory experiences are provided for a user mainly through a display screen of a terminal and a sound box device connected with the terminal.
According to the prior art, the current home film watching effect can only adjust the video definition and the audio effect, the form is single, no more innovation is provided, and along with the development of the technology, people have higher requirements on film watching experience. For example: there is a need for home theaters that provide the ability to interact with currently playing content in real time, and the prior art does not adequately address these new needs.
Disclosure of Invention
The application provides a method and a system for realizing intelligent home theater, which are used for improving the intelligence of the intelligent home theater.
The application discloses a method for realizing intelligent home theater, which comprises the following steps:
when a video is played, detecting whether the video contains playing environment suggestion information;
if the video contains the playing environment suggestion information, generating an operation instruction according to the playing environment suggestion information, and controlling IOT equipment in the current family to realize an environment corresponding to the playing environment suggestion information;
if the video does not contain the playing environment suggestion information, analyzing the content of the video to obtain the playing environment suggestion information matched with the video, generating an operation instruction according to the playing environment suggestion information, and controlling the IOT equipment in the current family to realize the environment corresponding to the playing environment suggestion information.
Preferably, the method further comprises:
and acquiring actual environment information of the current family in real time from IOT equipment of the current family, iteratively generating an operation instruction according to the difference between the acquired environment information and the playing environment suggestion information, and controlling the IOT equipment to realize the environment corresponding to the playing environment suggestion information.
Preferably, the playback environment recommendation information includes: physical scene information and atmosphere information of the video; wherein:
the physical scene information includes at least one of: brightness level, temperature level, humidity level, wind power level and smoke condition of the scene;
the ambience information includes at least one of: warm, nervous, horror, anxious, happy, romantic.
Preferably, the method further comprises:
detecting IOT equipment in the family, and classifying the detected IOT equipment according to the physical scene information; the classification includes at least one of: brightness related devices, temperature related devices, humidity related devices, wind power related devices, smoke related devices;
respectively setting a set of corresponding physical parameters corresponding to each atmosphere information, wherein each physical parameter corresponds to at least one IOT device; wherein the physical parameter comprises at least one of: temperature, volume, humidity, brightness, wind power.
Preferably, the generating the operation instruction comprises:
obtaining a set of physical parameters corresponding to the atmosphere information according to the atmosphere information of the video; determining each IOT device corresponding to each physical parameter in the set of physical parameters, and generating a first operation instruction corresponding to each IOT device;
determining corresponding IOT equipment according to the physical scene information of the video, and generating second operation instructions corresponding to the IOT equipment;
and combining the first operation instruction and the second operation instruction to generate a final operation instruction, and sending the final operation instruction to the corresponding IOT equipment.
The application also discloses intelligent home theater system, include: the system comprises an environmental information extraction module and an IOT decision control module; wherein:
the environment information extraction module is used for detecting whether a video currently played contains playing environment suggestion information, and if the video contains the playing environment suggestion information, the environment information extraction module sends the playing environment suggestion information to the IOT decision control module; if the video does not contain the playing environment suggestion information, the environment information extraction module analyzes the content of the video through a pre-trained AI model to obtain the playing environment suggestion information matched with the video, and sends the playing environment suggestion information to the IOT decision control module;
the IOT decision control module is used for generating an operation instruction according to the playing environment suggestion information and controlling IOT equipment in the current family to realize the environment corresponding to the playing environment suggestion information.
Preferably, the system further comprises an IOT feedback module;
the IOT feedback module is used for acquiring the actual environmental information of the current family in real time from the IOT equipment of the current family and sending the actual environmental information to the IOT decision control module;
and the IOT decision control module generates an operation instruction according to the difference iteration of the environment information and the playing environment suggestion information.
Preferably, the playback environment recommendation information includes: physical scene information and atmosphere information of the video; wherein:
the physical scene information includes at least one of: brightness level, temperature level, humidity level, wind power level and smoke condition of the scene;
the ambience information includes at least one of: warm, nervous, horror, anxious, happy, romantic.
Preferably, the IOT decision control module is further configured to:
detecting IOT equipment in the family, and classifying the detected IOT equipment according to the physical scene information; the classification includes at least one of: brightness related devices, temperature related devices, humidity related devices, wind power related devices, smoke related devices;
respectively setting a set of corresponding physical parameters corresponding to each atmosphere information, wherein each physical parameter corresponds to at least one IOT device; wherein the physical parameter comprises at least one of: temperature, volume, humidity, brightness, wind power.
Preferably, the IOT decision control module is specifically configured to:
obtaining a set of physical parameters corresponding to the atmosphere information according to the atmosphere information of the video; determining each IOT device corresponding to each physical parameter in the set of physical parameters, and generating a first operation instruction corresponding to each IOT device;
determining corresponding IOT equipment according to the physical scene information of the video, and generating second operation instructions corresponding to the IOT equipment;
and combining the first operation instruction and the second operation instruction to generate a final operation instruction, and sending the final operation instruction to the corresponding IOT equipment.
Preferably, the system further comprises: an environment information adding module;
the environment information adding module is used for adding the playing environment suggestion information into the video.
According to the technical scheme, the method and the system for realizing the intelligent home theater detect and analyze the playing environment suggestion information in the video, and control the existing IOT equipment in the intelligent home system by combining the playing environment suggestion information, so that the IOT equipment can manufacture a more real and vivid environment corresponding to the environment information in the currently played video to match with a video scene, immersive viewing experience is provided for a user, and the intelligence of the intelligent home theater is improved by fully utilizing the IOT equipment in the existing home.
Drawings
FIG. 1 is a schematic flow chart of the IOT-based method for realizing an immersive intelligent home theater;
FIG. 2 is a schematic diagram of the structure of the intelligent home theater system according to the present invention;
fig. 3 is a schematic view of the cooperation process of the modules in the intelligent home theater system according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is further described in detail below by referring to the accompanying drawings and examples.
In recent years, with the rapid development of Internet of Things (IoT) technology, IoT devices have spread over various aspects of people's lives. The inventors of the present application noted that: all IOT devices in the intelligent home system can be sensed and classified, and the IOT devices can be controlled; the information contained in the video stream played by the home theater may also be extensible. However, the IOT devices in the existing smart home systems do not have the capability of interacting with the content played by the tv in real time, and a large amount of IOT device resources are actually idle, and therefore, the IOT devices cannot be used to provide better experience for the user to watch the video, and the IOT devices cannot be used to enrich the experience of the user in watching the tv at home to the maximum extent.
In order to provide richer sensory experience for a user when the user watches videos at home, the invention provides a technical scheme for realizing an intelligent home theater, and the scheme controls the prior IOT equipment in an intelligent home system by detecting and analyzing environmental information in the videos and combining the environmental information, so that the IOT equipment produces a more real and vivid environment corresponding to the environmental information in the currently played videos to match with video scenes, and thus, immersive movie viewing experience is provided for the user. Such as: controlling the brightness or color of the light to create an environment that more closely conforms to the video scene; the rotation of the electric fan is controlled to create a real environment which is linked with and interacts with the video content, and the like.
Fig. 1 is a schematic flow chart of the method for realizing the immersive intelligent home theater based on the IOT of the present invention, which includes the following steps:
step 101: when playing a video, detecting whether the video contains playing environment suggestion information, if the video contains the playing environment suggestion information, executing step 103, otherwise, executing step 102.
Step 102: and analyzing the content of the video to obtain the playing environment suggestion information matched with the video. In this step, the video content may be analyzed using a pre-trained AI model to determine the playback environment recommendation information matching the current video.
Step 103: and generating an operation instruction according to the playing environment suggestion information, and controlling IOT equipment in the current family to realize an environment corresponding to the playing environment suggestion information.
The playback environment recommendation information may include: physical scene information and atmosphere information of the video; wherein:
the physical scene information may include at least one of: brightness level, temperature level, humidity level, wind power level and smoke condition of the scene;
the ambience information may include at least one of: warm, nervous, horror, anxious, happy, romantic.
On the basis of the method shown in fig. 1, a feedback mechanism may also be introduced to further improve the presentation effect of the IOT device on the environment information. Specifically, the actual environment information of the current home can be obtained in real time from the IOT device of the current home, and an operation instruction is iteratively generated according to the detected environment information and the play environment suggestion information, so that the IOT device is controlled to realize the environment corresponding to the play environment suggestion information.
In order to realize effective utilization of the IOT equipment, the IOT equipment in the family can be detected in advance, and the detected IOT equipment is classified according to physical scene information; the classification may include at least one of: brightness related devices, temperature related devices, humidity related devices, wind power related devices, smoke related devices.
In addition, a set of corresponding physical parameters can be respectively set corresponding to each atmosphere information, and each physical parameter corresponds to at least one IOT device; wherein the physical parameter comprises at least one of: temperature, volume, humidity, brightness, wind power.
Based on the above arrangement, the manner of generating the operation instruction of the present invention specifically includes:
obtaining a set of physical parameters corresponding to the atmosphere information according to the atmosphere information of the video; determining each IOT device corresponding to each physical parameter in the set of physical parameters, and generating a first operation instruction corresponding to each IOT device;
determining corresponding IOT equipment according to the physical scene information of the video, and generating second operation instructions corresponding to the IOT equipment;
and combining the first operation instruction and the second operation instruction to generate a final operation instruction, and sending the final operation instruction to the corresponding IOT equipment.
Corresponding to the above method, the present invention also discloses an IOT-based immersive intelligent home theater system, whose composition structure is shown in fig. 2, the system at least includes: the environment information extraction module and the IOT decision control module may optionally further include an IOT feedback module and an environment information addition module. Wherein:
the environment information extraction module can be arranged in the video terminal, when the video terminal plays the video stream, the environment information extraction module analyzes whether the video stream contains playing environment suggestion information, if the video stream contains the playing environment suggestion information, the playing environment suggestion information is extracted and sent to the IOT decision control module, otherwise, the video terminal runs a trained AI model to analyze the content of the video stream, the playing environment suggestion information matched with the video stream is obtained, and the obtained playing environment suggestion information is sent to the IOT decision control module; wherein, the playing environment suggestion information comprises the physical scene information (light, temperature, etc.) of the video and the atmosphere information (romantic, horror, tense, etc.) of the video;
the IOT decision control module detects the existing IOT equipment in the house, generates an IOT equipment operation instruction by combining the acquired playing environment suggestion information, and sends the IOT equipment operation instruction to the corresponding IOT equipment, so that the IOT equipment realizes the environment corresponding to the playing environment suggestion information.
The selectable IOT feedback module is used for acquiring the actual environment information of the family from the IOT equipment of the current family in real time and sending the actual environment information to the IOT decision control module, and the IOT decision control module iteratively generates an IOT equipment operation instruction to control the IOT equipment, so that the actual environment is more suitable for the scene of the video.
The optional environment information adding module is used for adding the playing environment suggestion information to the video stream.
By the technical scheme, the actual environment of the home of the user is matched with the played video content more, and the multi-dimensional immersive film watching experience is provided for the user by fully utilizing the existing IOT equipment in the home under the condition of not increasing the burden of the user.
The following describes the modules in the intelligent home theater system shown in fig. 2 in detail as follows:
1) environmental information adding module
The module is used for adding video playing environment suggestion information in a video stream, and each piece of playing environment suggestion information includes but is not limited to: brightness, temperature, humidity, wind, smoke, and each piece of information contains a corresponding timestamp that specifies the scene time corresponding to the piece of playback environment recommendation information, i.e., the corresponding time in the video stream.
2) Environment information extraction module
The environmental information extraction module analyzes the currently played video stream, and if the video stream contains playing environmental suggestion information, the playing environmental suggestion information is sent to the IOT decision control module;
if the video stream does not contain the playing environment suggestion information, in the process of playing the video stream, analyzing key frames in the video stream according to a trained AI model running on the video terminal, extracting the environment information of the video, and sending the environment information as the playing environment suggestion information to the IOT decision control module. Wherein, the video playing environment suggestion information includes but is not limited to:
physical scene information, including:
a brightness level of the video scene;
temperature level of the video scene;
humidity level of the video scene;
wind power level of the video scene;
smoke conditions in video scenes, etc.
Atmosphere information:
using the AI model to analyze the key frame and the context in the video, and obtaining the atmosphere information of the current video, such as: warm, nervous, horror, anxious, happy, romantic, etc.
3) IOT decision control module
Detecting the existing IOT devices in the home and classifying the existing IOT devices according to video scenes, including but not limited to: brightness related devices, temperature related devices, humidity related devices, wind related devices, smoke related devices, etc.
Obtaining environmental information of the current home from the IOT device, including but not limited to: brightness, temperature, humidity, wind, smoke, etc.
Corresponding to the atmosphere information, a set of corresponding physical parameters (including temperature, volume, humidity, brightness, wind power and the like) can be set for each kind of atmosphere information, and each kind of physical parameters corresponds to one or more IOT devices. Such as: the temperature corresponds to an air conditioner, a hot air fan, an oil tincture, a fan and the like, when a certain atmosphere scene is to be realized, corresponding physical parameters are obtained firstly, then IOT equipment corresponding to the physical parameters is determined by combining the IOT equipment existing at home, and an operation instruction A of the IOT equipment is generated.
For example: assume that a horror scenario is currently in place.
The first matched physical information is: the brightness is low, the sound is quiet and terrorist, or breeze exists, and the IOT equipment matched in the prior period can know that the IOT equipment existing in the home includes: curtains, speakers, fans and doors. According to the currently existing IOT devices, the system may generate corresponding IOT device operation instructions: closing the curtain; terror music is played; the fan is in low-gear wind power, swings the wind direction, and stops when the wind power is on; closing the door of the current room, etc.
Then, for the site information in the TV, it is called physical scene information, such as brightness, temperature, humidity, wind power, smoke, etc., which is still matched to the IOT device of the current home in the same way as above, and generates the operation command B.
And generating a final operation instruction by combining the operation instructions A and B, and sending the final operation instruction to the related IOT equipment, wherein the IOT equipment executes corresponding actions according to the operation instruction.
4) IOT feedback module
The IOT feedback module monitors various environmental information in a current family in real time, continuously returns actual environmental information to the IOT decision control module, the IOT decision control module generates new IOT equipment operation instructions according to the difference between the current actual environment and the target environment, and sends the operation instructions to corresponding IOT equipment to adjust the current viewing environment.
The specific process of implementing the intelligent home theater by the cooperation of the modules in the system shown in fig. 2 is shown in fig. 3, and includes:
step 301: the video begins to play.
Step 302: and detecting whether the video contains the playing environment suggestion information, if so, jumping to a step 304, and if not, continuing to execute the step 303.
Step 303: and the video terminal operates an AI model of a pre-training effect to analyze the video and extracts the playing environment suggestion information from the video frame.
Step 304: and sending the playing environment suggestion information to an IOT decision control module.
Step 305: and the IOT decision control module generates an operation instruction for the IOT equipment according to the difference between the current environment information and the playing environment suggestion information.
Step 306: and the IOT decision control module sends the operation instruction to the corresponding IOT equipment.
Step 307: and the IOT equipment executes corresponding actions according to the operation instructions.
Step 308: the IOT feedback module monitors the current environmental information, sends the current environmental information to the IOT decision control module, and returns to step 305 until the video playing is finished.
The technical solution of the present invention is further described in detail by the following preferred embodiments.
The first embodiment is as follows:
playing video at home, if the video stream contains sound information of environment, the method comprises the following steps: the playing environment suggestion information contained in the video stream is related to the environmental sound and is sent to the IOT decision control module.
The IOT decision control module analyzes the condition of the intelligent sound box contained in the current home environment:
if the intelligent sound box is arranged at home and is connected with the main playing device, the sound information of the environment is transmitted to the intelligent sound box, and a playing instruction is sent to the intelligent sound box;
if the smart speaker is not available at home, no action is taken.
And after receiving the playing instruction, the intelligent sound box plays according to the sound information of the environment.
Example two:
playing the video at home, if the video stream contains the brightness information of the environment, namely: and the playing environment suggestion information contained in the video stream is related to the environment brightness and is sent to the IOT decision control module.
If the video stream does not contain the brightness information of the environment, the trained AI model is operated on the playing terminal, the scene of the video is analyzed to obtain the brightness information of the environment, and then the brightness information is sent to the IOT decision control module.
The IOT decision control module analyzes the actual brightness of the current home environment, generates a corresponding control command according to the difference between the actual brightness and the target brightness, and then sends the control command to the electric lamp and the curtain.
If the target brightness is darker than the actual brightness, dimming the electric lamp and closing the curtain slightly;
if the target brightness is brighter than the actual brightness, the electric lamp is turned on, and the curtain is opened to a larger extent.
The IOT feedback module monitors the current actual brightness condition and sends the adjusted brightness information to the IOT decision control module, and the IOT decision control module generates an operation instruction again according to the current brightness condition to adjust the brightness and sends the instruction again to the electric lamp and the curtain.
Example three:
playing the video at home, if the video stream contains the temperature information of the environment, namely: and if the playing environment suggestion information contained in the video stream is related to the ambient temperature, the playing environment suggestion information is sent to the IOT decision control module.
If the video stream does not contain the environmental temperature information, the trained AI model is operated on the playing terminal, the video scene is analyzed to obtain the environmental temperature information, and then the temperature information is sent to the IOT decision control module.
The IOT decision control module analyzes the actual temperature condition of the current home environment, generates a corresponding control instruction according to the difference between the actual temperature and the target temperature, and then sends the control instruction to the air conditioner.
If the target temperature is lower than the actual temperature, the temperature of the air conditioner is adjusted to be lower;
if the target temperature is higher than the actual temperature, the air conditioner temperature is adjusted to be high.
The IOT feedback module monitors the current actual temperature, sends the adjusted actual temperature to the IOT decision control module, and the IOT decision control module generates an operation instruction again according to the current temperature condition to adjust the temperature and sends the instruction again to the air conditioner.
Example four:
playing the video at home, if the video stream contains humidity information of the environment, namely: and if the playing environment suggestion information contained in the video stream is related to the environmental humidity, the playing environment suggestion information is sent to the IOT decision control module.
If the video stream does not contain the humidity information of the environment, the trained AI model is operated on the playing terminal, the video scene is analyzed to obtain the humidity information of the environment, and then the humidity information is sent to the IOT decision control module.
The IOT decision control module analyzes the humidity condition of the current family environment, calculates the difference between the actual humidity and the target humidity, generates a humidity control command and sends the humidity control command to the air conditioner and the humidifier:
if the target humidity is lower than the actual humidity, starting the dehumidifying function of the air conditioner;
and if the target humidity is higher than the actual humidity, starting the humidifying function of the humidifier.
The IOT feedback module monitors the current actual humidity condition, sends the adjusted humidity information to the IPT decision control module, and the IOT decision control module generates an operation instruction again according to the current condition to adjust the humidity and sends the instruction again to the air conditioner and the humidifier.
Example five:
playing the video at home, if the video stream contains wind information of the environment, namely: and if the playing environment suggestion information contained in the video stream is related to the environment wind power, the playing environment suggestion information is sent to the IOT decision control module.
And if the video stream does not contain the wind power information of the environment, running the trained AI model on the playing terminal, analyzing the scene of the video to obtain the wind power information of the environment, and then sending the wind power information to the IOT decision control module.
The IOT decision control module analyzes the wind power condition of the current home environment, calculates the difference between the actual wind power and the target wind power, generates a wind power control command and sends the wind power control command to the electric fan:
if the target wind power is larger than the actual wind power, the wind power of the electric fan is increased;
and if the target wind power is lower than the actual wind power, the wind power of the electric fan is reduced.
The IOT feedback module monitors the current actual wind power condition, sends the adjusted wind power information to the IOT decision control module, and the IOT decision control module generates an operation instruction again according to the current condition to adjust the wind power and sends the operation instruction again to the electric fan.
Example six:
and playing the video at home, and if the video stream contains sound information of the environment, sending the sound information to the IOT decision control module.
And if the video stream does not contain the sound information of the environment, running the trained AI model on the playing terminal, separating the sound in the scene of the video, acquiring the sound audio and the volume of the environment, and then sending the sound information to the IOT decision control module.
The IOT decision control module sends the target environment audio and the volume as instructions to the intelligent sound box, and the intelligent sound box plays corresponding audio according to the corresponding volume.
The IOT feedback module monitors the current sound condition and sends the current sound condition to the IOT decision control module, and the IOR decision control module adjusts the volume according to the difference condition of the volume of the currently played environmental sound and the target volume and sends a sending instruction to the intelligent sound box again.
Example seven:
and playing the video at home, and if the video stream contains smoke information of the environment, sending the smoke information to the IOT decision control module.
And if the video stream does not contain the smoke information of the environment, running the trained AI model on the terminal, analyzing the scene of the video to obtain the smoke information of the environment, and then sending the smoke information to the IOT decision control module.
The IOT decision control module analyzes the smoke information of the current home environment, generates a smoke control command and sends the smoke control command to the humidifier:
if the target smoke is larger, the exhaust of the humidifier is increased;
if the target smoke is small, the discharge of the humidifier is reduced.
The IOT feedback module monitors the current actual smoke situation, sends the adjusted smoke information to the IOT decision control module, and the IOT decision control module adjusts the smoke information again according to the current situation and sends an instruction to the humidifier again.
Example eight:
and playing videos at home, if the video stream does not contain environmental information, running a trained AI model on the terminal, analyzing scenes of the videos to obtain atmosphere information, assuming that the final result shows that the atmosphere scene information is a horror scene, and sending the horror atmosphere scene information to the IOT decision control module.
After the IOT decision control module acquires the terrorist atmosphere information, matching a set of physical parameters corresponding to the terrorist atmosphere: the IOT equipment which is low in brightness, quiet in sound and terrorist or breeze is combined with the IOT equipment matched in the early stage, and the IOT equipment which exists in the home is known to be as follows: curtains, speakers, fans and doors. Based on this, the IOT decision control module generates a corresponding IOT device operation instruction as follows:
closing the curtain; terror music is played; the fan is in low-gear wind power, swings the wind direction, and stops when the wind power is on; closing the door of the current room, etc.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the scope of protection of the present application.

Claims (9)

1. A method of implementing a smart home theater, comprising:
when a video is played, detecting whether the video contains playing environment suggestion information;
if the video contains the playing environment suggestion information, generating an operation instruction according to the playing environment suggestion information, and controlling IOT equipment in the current family to realize an environment corresponding to the playing environment suggestion information;
if the video does not contain the playing environment suggestion information, analyzing the content of the video to obtain the playing environment suggestion information matched with the video, generating an operation instruction according to the playing environment suggestion information, and controlling the IOT equipment in the current family to realize the environment corresponding to the playing environment suggestion information;
the playback environment recommendation information includes: physical scene information and atmosphere information of the video;
the generating operation instructions comprises:
obtaining a set of physical parameters corresponding to the atmosphere information according to the atmosphere information of the video; determining each IOT device corresponding to each physical parameter in the set of physical parameters, and generating a first operation instruction corresponding to each IOT device;
determining corresponding IOT equipment according to the physical scene information of the video, and generating second operation instructions corresponding to the IOT equipment;
and combining the first operation instruction and the second operation instruction to generate a final operation instruction, and sending the final operation instruction to the corresponding IOT equipment.
2. The method of claim 1, further comprising:
and acquiring actual environment information of the current family in real time from IOT equipment of the current family, iteratively generating an operation instruction according to the difference between the acquired environment information and the playing environment suggestion information, and controlling the IOT equipment to realize the environment corresponding to the playing environment suggestion information.
3. The method according to claim 1 or 2, characterized in that:
the physical scene information includes at least one of: brightness level, temperature level, humidity level, wind power level and smoke condition of the scene;
the ambience information includes at least one of: warm, nervous, horror, anxious, happy, romantic.
4. The method of claim 3, further comprising:
detecting IOT equipment in the family, and classifying the detected IOT equipment according to the physical scene information; the classification includes at least one of: brightness related devices, temperature related devices, humidity related devices, wind power related devices, smoke related devices;
respectively setting a set of corresponding physical parameters corresponding to each atmosphere information, wherein each physical parameter corresponds to at least one IOT device; wherein the physical parameter comprises at least one of: temperature, volume, humidity, brightness, wind power.
5. An intelligent home theater system, comprising: the system comprises an environmental information extraction module and an IOT decision control module; wherein:
the environment information extraction module is used for detecting whether a video currently played contains playing environment suggestion information, and if the video contains the playing environment suggestion information, the environment information extraction module sends the playing environment suggestion information to the IOT decision control module; if the video does not contain the playing environment suggestion information, the environment information extraction module analyzes the content of the video through a pre-trained AI model to obtain the playing environment suggestion information matched with the video, and sends the playing environment suggestion information to the IOT decision control module;
the IOT decision control module is used for generating an operation instruction according to the playing environment suggestion information and controlling IOT equipment in the current family to realize an environment corresponding to the playing environment suggestion information;
the playback environment recommendation information includes: physical scene information and atmosphere information of the video;
the IOT decision control module is specifically configured to:
obtaining a set of physical parameters corresponding to the atmosphere information according to the atmosphere information of the video; determining each IOT device corresponding to each physical parameter in the set of physical parameters, and generating a first operation instruction corresponding to each IOT device;
determining corresponding IOT equipment according to the physical scene information of the video, and generating second operation instructions corresponding to the IOT equipment;
and combining the first operation instruction and the second operation instruction to generate a final operation instruction, and sending the final operation instruction to the corresponding IOT equipment.
6. The system of claim 5, further comprising an IOT feedback module;
the IOT feedback module is used for acquiring the actual environmental information of the current family in real time from the IOT equipment of the current family and sending the actual environmental information to the IOT decision control module;
and the IOT decision control module generates an operation instruction according to the difference iteration of the environment information and the playing environment suggestion information.
7. The system according to claim 5 or 6, characterized in that:
the physical scene information includes at least one of: brightness level, temperature level, humidity level, wind power level and smoke condition of the scene;
the ambience information includes at least one of: warm, nervous, horror, anxious, happy, romantic.
8. The system of claim 7, wherein the IOT decision control module is further configured to:
detecting IOT equipment in the family, and classifying the detected IOT equipment according to the physical scene information; the classification includes at least one of: brightness related devices, temperature related devices, humidity related devices, wind power related devices, smoke related devices;
respectively setting a set of corresponding physical parameters corresponding to each atmosphere information, wherein each physical parameter corresponds to at least one IOT device; wherein the physical parameter comprises at least one of: temperature, volume, humidity, brightness, wind power.
9. The system according to claim 5 or 6, characterized in that the system further comprises: an environment information adding module;
the environment information adding module is used for adding the playing environment suggestion information into the video.
CN201910778417.3A 2019-08-22 2019-08-22 Method and system for realizing intelligent home theater Active CN110493090B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910778417.3A CN110493090B (en) 2019-08-22 2019-08-22 Method and system for realizing intelligent home theater

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910778417.3A CN110493090B (en) 2019-08-22 2019-08-22 Method and system for realizing intelligent home theater

Publications (2)

Publication Number Publication Date
CN110493090A CN110493090A (en) 2019-11-22
CN110493090B true CN110493090B (en) 2022-01-28

Family

ID=68551763

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910778417.3A Active CN110493090B (en) 2019-08-22 2019-08-22 Method and system for realizing intelligent home theater

Country Status (1)

Country Link
CN (1) CN110493090B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114079589A (en) * 2020-08-21 2022-02-22 深圳Tcl新技术有限公司 Play control method, intelligent terminal and storage medium
CN115016310A (en) * 2022-06-30 2022-09-06 深圳市桑尼奇科技有限公司 Intelligent audio-video playing device and control method thereof
CN116366389A (en) * 2023-06-02 2023-06-30 深圳市华翌科技有限公司 Home theater environment atmosphere control method and system based on intelligent home

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007184818A (en) * 2006-01-10 2007-07-19 Sony Corp Audio apparatus, sound reproducing method, and sound reproducing program
CN101547532A (en) * 2008-03-26 2009-09-30 上海国皓电子有限公司 Method for demonstrating lighting scene of home theater
CN104713187A (en) * 2013-12-11 2015-06-17 海尔集团公司 Air conditioner control method according to picture foil scene and air conditioner
CN105263044A (en) * 2015-10-13 2016-01-20 小米科技有限责任公司 Method and device for adjusting smart home equipment
CN105760141A (en) * 2016-04-05 2016-07-13 中兴通讯股份有限公司 Multi-dimensional control method, intelligent terminal and controllers
CN105956170A (en) * 2016-05-20 2016-09-21 微鲸科技有限公司 Real-time scene information embedding method, and scene realization system and method
CN105955045A (en) * 2016-05-31 2016-09-21 微鲸科技有限公司 Intelligent film-watching scene implementation system and method
CN106792168A (en) * 2016-12-09 2017-05-31 北京小米移动软件有限公司 The control method and device of smart machine
CN106909908A (en) * 2017-03-08 2017-06-30 深圳创维－Rgb电子有限公司 A kind of movie scene analogy method, apparatus and system
CN110075552A (en) * 2019-04-30 2019-08-02 中影环球（北京）科技有限公司 A kind of managing device and method of 4D movement packet

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105072483A (en) * 2015-08-28 2015-11-18 深圳创维－Rgb电子有限公司 Smart home equipment interaction method and system based on smart television video scene
CN109862335A (en) * 2019-01-28 2019-06-07 刘莉 A kind of supervisory system of closed and method based on projection audio and video playing

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007184818A (en) * 2006-01-10 2007-07-19 Sony Corp Audio apparatus, sound reproducing method, and sound reproducing program
CN101547532A (en) * 2008-03-26 2009-09-30 上海国皓电子有限公司 Method for demonstrating lighting scene of home theater
CN104713187A (en) * 2013-12-11 2015-06-17 海尔集团公司 Air conditioner control method according to picture foil scene and air conditioner
CN105263044A (en) * 2015-10-13 2016-01-20 小米科技有限责任公司 Method and device for adjusting smart home equipment
CN105760141A (en) * 2016-04-05 2016-07-13 中兴通讯股份有限公司 Multi-dimensional control method, intelligent terminal and controllers
CN105956170A (en) * 2016-05-20 2016-09-21 微鲸科技有限公司 Real-time scene information embedding method, and scene realization system and method
CN105955045A (en) * 2016-05-31 2016-09-21 微鲸科技有限公司 Intelligent film-watching scene implementation system and method
CN106792168A (en) * 2016-12-09 2017-05-31 北京小米移动软件有限公司 The control method and device of smart machine
CN106909908A (en) * 2017-03-08 2017-06-30 深圳创维－Rgb电子有限公司 A kind of movie scene analogy method, apparatus and system
CN110075552A (en) * 2019-04-30 2019-08-02 中影环球（北京）科技有限公司 A kind of managing device and method of 4D movement packet

Also Published As

Publication number Publication date
CN110493090A (en) 2019-11-22

Similar Documents

Publication Publication Date Title
CN110493090B (en) Method and system for realizing intelligent home theater
US9918144B2 (en) Enchanced experience from standard program content
US10462878B2 (en) Method and apparatus and device for implementing television theater mode, and storage medium
US9197918B2 (en) Methods and systems for generating ambient light effects based on video content
EP2330827A2 (en) Method and device for realising sensory effects
CN110326259A (en) Control event in the system of home equipment of networking
JP5442643B2 (en) Data transmission device, data transmission method, viewing environment control device, viewing environment control method, and viewing environment control system
US10560994B2 (en) Lighting control apparatus, corresponding method and computer program product
EP3675504A1 (en) Environmental data for media content
CN206057837U (en) Overall intelligence parlor function system
CN105956170A (en) Real-time scene information embedding method, and scene realization system and method
CN111222044A (en) Information recommendation method and device based on emotion perception and storage medium
CN114608170A (en) Intelligent adjusting method and intelligent adjusting system for indoor environment
CN110109377A (en) Control system and method of household appliance and air conditioner
US20240147001A1 (en) Information processing device, information processing method, and artificial intelligence system
US20140104293A1 (en) Ambient light effect in video gaming
CN105812927A (en) Method for backing up scene atmosphere and television
CN104713187B (en) Air-conditioning sets off the control method and air-conditioning of scene by contrast according to picture
CN109683541A (en) A kind of smart home system based on Internet of Things big data
US12089303B2 (en) Determining a light effect based on a degree of speech in media content
US20140104247A1 (en) Devices and systems for rendering ambient light effects in video
KR101817757B1 (en) Method and System for Interworking Video Subtitle and IoT Device
CN114079589A (en) Play control method, intelligent terminal and storage medium
TWI656789B (en) Video control system
CN107733755B (en) Processing method and system and computing system thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant