WO2017035949A1 - 基于智能电视视频场景的智能家居设备互动方法及系统 - Google Patents

基于智能电视视频场景的智能家居设备互动方法及系统 Download PDF

Info

Publication number
WO2017035949A1
WO2017035949A1 PCT/CN2015/093958 CN2015093958W WO2017035949A1 WO 2017035949 A1 WO2017035949 A1 WO 2017035949A1 CN 2015093958 W CN2015093958 W CN 2015093958W WO 2017035949 A1 WO2017035949 A1 WO 2017035949A1
Authority
WO
WIPO (PCT)
Prior art keywords
smart
home device
smart home
video scene
connection
Prior art date
Application number
PCT/CN2015/093958
Other languages
English (en)
French (fr)
Inventor
付春元
Original Assignee
深圳创维－Rgb电子有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳创维－Rgb电子有限公司 filed Critical 深圳创维－Rgb电子有限公司
Priority to US15/323,840 priority Critical patent/US20170201791A1/en
Priority to AU2015396659A priority patent/AU2015396659B2/en
Publication of WO2017035949A1 publication Critical patent/WO2017035949A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/43615—Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2807—Exchanging configuration information on appliance services in a home automation network
    • H04L12/2812—Exchanging configuration information on appliance services in a home automation network describing content present in a home automation network, e.g. audio video content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2823—Reporting information sensed by appliance or service execution status of appliance services in a home automation network
    • H04L12/2827—Reporting to a device within the home network; wherein the reception of the information reported automatically triggers the execution of a home appliance functionality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H04N21/42684—Client identification by a unique number or address, e.g. serial number, MAC address, socket ID
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440254—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering signal-to-noise parameters, e.g. requantization
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L2012/2847—Home automation networks characterised by the type of home appliance used
    • H04L2012/2849—Audio/video appliances
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L2012/2847—Home automation networks characterised by the type of home appliance used
    • H04L2012/285—Generic home appliances, e.g. refrigerators

Definitions

  • the present invention relates to the field of consumer electronic products, and in particular, to a smart home device interaction method and system based on a smart TV video scene.
  • the user can only watch the video content, and the environment around the user cannot change according to the seasons and weather changes in the TV scene.
  • the TV and the surrounding smart devices cannot interact according to the TV scene.
  • the present invention aims to provide a smart home device interaction method and system based on a smart TV video scene, which aims to solve the problem that the smart home device around the user cannot be based on the prior art when the user watches the smart TV.
  • TV scenes change and change, smart TV and smart home devices can not effectively interact, users can not achieve the defects of TV scene data at home.
  • a smart home device interaction method based on a smart TV video scene comprising:
  • the operation data of the corresponding smart home device in the pre-stored video scene type query the operation data of the corresponding smart home device in the pre-stored video scene type, initiate a connection to the smart home device, and detect whether the smart TV and the smart home device are successfully connected;
  • the smart home device If it is detected that the smart TV and the smart home device are successfully connected, the smart home device is controlled. Perform the corresponding operations stored in advance.
  • the smart home device interaction method based on a smart TV video scene, wherein the acquiring video data currently being played by the smart TV, identifying image features in the current video data through an image, and comparing with different image features of the database, determining
  • the current video scene type specifically includes:
  • Image recognition technology is used to extract image features in the frame image after noise reduction and save;
  • the image features of the saved frame image are compared with the pre-stored video scene image features in the database to determine the current video scene type.
  • the smart home device interaction method based on the smart TV video scene wherein the querying the operation data of the smart home device corresponding to the pre-stored video scene type, initiating a connection to the smart home device, detecting whether the smart TV and the smart home device are Successful connections include:
  • the smart home device interaction method based on a smart TV video scene, wherein the wireless connection comprises a WIFI connection, a Bluetooth connection, a 2.4G connection, or a zigbee connection.
  • the smart TV sends the smart home device id to the server, and the server finds the corresponding ip according to the smart home device id;
  • the server sends a control command to the smart home device.
  • the smart home device interaction method based on the smart TV video scene, wherein if the smart TV and the smart home device are successfully connected, controlling the smart home device to perform the pre-stored corresponding operation further includes:
  • the smart TV sends control commands directly to the smart home device.
  • a smart home device interactive system based on smart TV video scene wherein The system includes:
  • a pre-setting and storage module configured to preset a database to store image characteristics of different video scenes and operation data of the smart home device corresponding to different video scene types
  • the obtaining and judging module is configured to obtain video data currently being played by the smart television, extract image features in the current video data through image recognition, and compare with different image features stored in the database to determine a current video scene type;
  • the querying and judging module is configured to query operation data of the corresponding smart home device in the pre-stored video scene type according to the current video scene type, initiate a connection to the smart home device, and detect whether the smart TV and the smart home device are successfully connected;
  • the control module is configured to control the smart home device to perform a pre-stored corresponding operation if it detects that the smart TV and the smart home device are successfully connected.
  • the smart home device interaction system based on the smart TV video scene wherein the acquiring and determining module specifically includes:
  • An extracting unit configured to acquire video data that is being played by the smart television, and extract a frame image in the video data in real time;
  • a noise reduction processing unit configured to perform noise reduction processing on the extracted frame image
  • a feature extraction and saving unit configured to extract image features in the frame image after noise reduction by image recognition technology and save the image features
  • the comparison and judging unit is configured to compare the image features of the saved frame image with the pre-stored video scene image features in the database to determine the current video scene type.
  • the smart home device interaction system based on the smart TV video scene, wherein the query and the judgment specifically include:
  • the acquiring unit is configured to query operation data of the corresponding smart home device in the pre-stored video scene type according to the current video scene type, and obtain an operation to be performed and a smart home device that needs to be operated;
  • control instruction sending unit configured to send a wireless connection control instruction to the smart home device
  • a determining unit configured to detect whether the smart TV and the smart home device are successfully connected
  • the wireless connection includes a WIFI connection, a Bluetooth connection, a 2.4G connection, or a zigbee connection.
  • control command sending unit specifically includes:
  • a first determining unit configured to: if the smart TV and the smart home device are successfully connected, and the smart home device that needs to be operated is connected to the smart TV by using a wireless connection of the WIFI;
  • the search unit is configured to send the smart home device id to the server by the smart TV, and the server searches for the corresponding ip according to the smart home device id;
  • a first sending unit configured to send, by the server, a control instruction to the smart home device
  • a second determining unit configured to detect that the smart TV and the smart home device are successfully connected, And the smart home device that needs to be operated currently is connected to the smart TV by wireless connection of Bluetooth, 2.4G or zigbee;
  • the second sending unit is configured to send a control instruction to the smart home device directly by the smart television.
  • the present invention can extract scene elements of video and video content played on a television in real time, extract image features of video images by image recognition technology, determine scene types in which video images are located, and automatically control various types of intelligence according to scene types.
  • the home equipment performs corresponding operations to change the surrounding environment conditions of the user, so that the environment in which the user is located is the same as the video scene environment currently played by the television, so that the smart home device can effectively interact according to the playing content of the smart TV, thereby facilitating the user to watch the video. .
  • FIG. 1 is a flowchart of a preferred embodiment of a smart home device interaction method based on a smart TV video scene according to the present invention
  • FIG. 2 is a schematic diagram of scene information, functions, and device correspondence of a specific application embodiment of a smart home device interaction method based on a smart TV video scene according to the present invention
  • FIG. 3 is a flowchart of video scene data extraction according to a specific application embodiment of a smart home device interaction method based on a smart TV video scene according to the present invention
  • FIG. 4 is a flow chart of control of a smart home device according to a specific application embodiment of a smart home device interaction method based on a smart TV video scene;
  • FIG. 5 is a functional block diagram of a preferred embodiment of a smart home device interactive system based on a smart TV video scene according to the present invention.
  • the present invention provides a flow chart of a preferred embodiment of a smart home device interaction method based on a smart TV video scene. As shown in FIG. 1 , the method includes:
  • step S100 a database is preset to store image characteristics of different video scenes and operation data of the smart home device corresponding to different video scene types.
  • a database is set in advance for storing image features of different types of video scenes, so as to conveniently obtain image features extracted from video scenes played by the smart TV for comparison, and determine which scene is currently. At the same time, it is necessary to store in advance what devices are to be operated under different video scene types.
  • the database may be stored in a smart TV or in a server connected to the smart television network.
  • the operation data of the smart home device corresponding to the scene type for example, when the scene type is winter, the air conditioner or the fan is controlled to blow, and the temperature of the air conditioner is also controlled. The level is low.
  • Step S200 Acquire video data currently being played by the smart television, extract image features in the current video data through image recognition, and compare with different image features stored in the database to determine a current video scene type.
  • the frame image of the currently played video is acquired in real time through image processing technology, and the image features of the frame image are extracted by image recognition, and the specific image recognition technology is compared with the image features in the database. , get the video scene type corresponding to the current video.
  • the present invention further provides a specific application embodiment of an image comparison algorithm, which uses a "perceptual hash algorithm” to generate a "fingerprint” string for each picture, and then compares different pictures. fingerprint. The closer the results are, the more similar the picture is.
  • image comparison algorithm uses a "perceptual hash algorithm” to generate a "fingerprint” string for each picture, and then compares different pictures. fingerprint. The closer the results are, the more similar the picture is.
  • the first step is to reduce the size.
  • the purpose of this step is to remove the details of the image, leaving only the basic information such as structure, light and dark, and discarding the differences in the images caused by different sizes and proportions.
  • the second step is to simplify the color.
  • the average is calculated.
  • the fourth step is to compare the gray levels of the pixels.
  • the gray level of each pixel is compared to the average. Greater than or equal to the average value, recorded as 1; less than the average value, recorded as 0.
  • the fifth step is to calculate the hash value.
  • step S200 specifically includes:
  • Step S201 acquiring video data that is being played by the smart television, and extracting a frame image in the video data in real time;
  • Step S202 performing noise reduction processing on the extracted frame image
  • Step S203 extracting image features in the frame image after noise reduction by using image recognition technology, and saving;
  • Step S204 Compare image features of the saved frame image with pre-stored video scene image features in the database to determine a current video scene type.
  • the information in the video scene is extracted, the current frame image is extracted in real time, and the image recognition processing is performed, and the scene category information is obtained through the image recognition method.
  • the scenario information mainly includes the information shown in Table 1.
  • the seasonal information judging the current air quality, etc., time information: judging the current weather brightness, etc., temperature information: judging the current temperature level, etc., weather information: judging that the current is windy or raining, thunder lightning, etc., geographical location information: Judging the current climate, etc., event information: such as vibration, tilt, speed, etc.
  • Step S300 Query the operation data of the corresponding smart home device in the pre-stored video scene type according to the current video scene type, and initiate a connection to the smart home device to detect whether the smart TV and the smart home device are successfully connected.
  • the extracted information determines the current scene, corresponding to different functions according to the current scene, the corresponding device is operated according to different functions. If the current season information is winter, you need to control the air conditioner to lower the temperature.
  • Figure 2 The corresponding relationship between specific scenarios, functions, and devices is shown in Figure 2.
  • the functions that need to be adjusted are blowing, adjusting the temperature, and changing the humidity, and the corresponding functional devices are air conditioners and humidifiers.
  • step S300 specifically includes:
  • Step S301 Query the operation data of the smart home device corresponding to the pre-stored video scene type according to the current video scene type, and obtain the operation to be performed and the smart home device that needs to be operated;
  • Step S302 Send a wireless connection control instruction to the smart home device.
  • Step S303 detecting whether the smart TV and the smart home device are successfully connected.
  • the wireless connection includes a WIFI connection, a Bluetooth connection, a 2.4G connection, or a zigbee connection.
  • control methods of different devices are also different.
  • the device control methods for each different mode are also different, such as wifi.
  • the connected device needs to be controlled by the background server; for example, the device that accesses the TV by using Bluetooth, 2.4G or zigbee can directly control it by specifying the command mode.
  • Step S400 Control the smart home device to perform a pre-stored corresponding operation.
  • the step S400 specifically includes:
  • Step S401 If it is detected that the smart home device that needs to be operated currently is connected to the smart TV by using a wireless connection of WIFI;
  • Step S402 the smart TV sends the smart home device id to the server, and the server searches for the corresponding ip according to the smart home device id;
  • Step S403 The server sends a control instruction to the smart home device.
  • control manner specifically includes:
  • Step S411 if it is detected that the smart home device that needs to be operated currently is connected to the smart TV by using a wireless connection mode of Bluetooth, 2.4G or zigbee;
  • Step S412 The smart TV directly sends a control instruction to the smart home device.
  • step S400 the method further includes:
  • Step S500 If it is detected that the connection between the smart TV and the smart home device fails, the connection failure information is prompted.
  • the user when it is detected that the connection between the smart TV and the smart home device fails, the user does not purchase the smart home device, and the user can be reminded in the form of a pop-up window on the premise that the original smart TV screen does not affect the viewing, the current smart Home equipment has not been purchased.
  • the position of the window can be selected in the center of the screen or in the lower left or lower right corner of the screen.
  • the size of the window is less than 10mm*10mm.
  • the window is automatically closed when the user's operation is not detected within a predetermined time, and the predetermined time is preferably 10-30 s, and can also be set according to user needs.
  • the window can be set to link with the home smart device website, and a home device purchase portal is provided on the window for the user to click and enter the home smart device network to purchase the home smart device.
  • the present invention also provides a flowchart for extracting video scene data according to a specific application embodiment of a smart home device interaction method based on a smart TV video scene. As shown in FIG. 3, the method includes:
  • Step S10 Extracting a frame image in the current video in real time
  • Step S20 performing preprocessing, noise reduction, and the like on the extracted image to provide an accuracy rate of subsequent recognition
  • Step S30 extract corresponding features in the image and save
  • Step S40 comparing the saved image features with the images in the database to determine which scene is currently present
  • Step S50 Acquire a current scene.
  • Step S101 Extract relevant functions according to current scene information.
  • Step S102 calling a specified device according to the corresponding function
  • Step S103 determining to identify the access mode, that is, determining how the devices to be operated are connected to the television, and how to control;
  • Step S104 determining whether it is wifi access, if it is to perform step S106; if not step S105;
  • Step S105 determining whether the device is Bluetooth access, if yes, executing step S109; if not, executing step S108;
  • Step S106 Send the device id to the server, and the server searches for the corresponding ip according to the device id;
  • Step S107 the server sends a control command to the device ip, and performs step S109;
  • Step S108 it is determined whether the device is 2.4G access, if yes, step S109 is performed; if not, step S111 is performed;
  • Step S109 Send a control command to the device end.
  • Step S110 The device controls the device according to the parsing command
  • Step S111 ending the operation.
  • the present invention provides a smart home device interaction method based on a smart TV video scene, which extracts image feature information in a current smart TV broadcast video scene and performs pre-stored scene type image feature information.
  • the current scene type is obtained, and the smart home device that needs to be operated is determined according to the current scene type, and the connection mode of the smart home device and the smart TV according to the need is different, and different control command sending manners are adopted to implement the smart home device.
  • the smart TV in the invention can intelligently identify the currently played video information, and control the smart home device according to the video information, so that the user can feel the scene information in the video in real time, and improve the interaction between the smart TV and the smart home device, for the user. Provided for convenience.
  • the present invention further provides a functional block diagram of a preferred embodiment of a smart home device interaction system based on a smart TV video scene. As shown in FIG. 5, the system includes:
  • Pre-setting and storage module 100 for pre-setting a database to store different views
  • the frequency scene image features and the operation data of the smart home device corresponding to different video scene types; specifically as described above.
  • the obtaining and determining module 200 is configured to obtain video data currently being played by the smart television, extract image features in the current video data through image recognition, and compare with different image features stored in the database to determine a current video scene type; Said.
  • the query and judgment module 300 is configured to query operation data of the smart home device corresponding to the pre-stored video scene type according to the current video scene type, and initiate a connection to the smart home device to detect whether the smart TV and the smart home device are successfully connected; As mentioned above.
  • the control module 400 is configured to control the smart home device to perform a pre-stored corresponding operation if it detects that the smart TV and the smart home device are successfully connected; specifically as described above.
  • the acquiring and determining module specifically includes:
  • the extracting unit is configured to acquire video data that is being played by the smart television, and extract a frame image in the video data in real time; as described above.
  • the noise reduction processing unit is configured to perform noise reduction processing on the extracted frame image; as described above.
  • the feature extraction and saving unit is configured to extract and preserve image features in the frame image after noise reduction by using image recognition technology; as described above.
  • the comparison and judging unit is configured to compare the image features of the saved frame image with the pre-stored video scene image features in the database to determine the current video scene type; as described above.
  • the query and judgment module specifically includes:
  • the acquiring unit is configured to query operation data of the corresponding smart home device in the pre-stored video scene type according to the current video scene type, and obtain an operation to be performed and a smart home device that needs to be operated; as described above.
  • a control instruction sending unit configured to send a wireless connection control instruction to the smart home device; specifically as described above.
  • a determining unit configured to detect whether the smart TV and the smart home device are successfully connected; specifically as described above.
  • the wireless connection includes a WIFI connection, a Bluetooth connection, a 2.4G connection, or a zigbee connection; as described above.
  • control instruction sending unit specifically includes:
  • the first determining unit is configured to: if the smart TV and the smart home device are successfully connected, and the smart home device that needs to be operated is connected to the smart TV by using a wireless connection of the WIFI; as described above.
  • the search unit is configured to send the smart home device id to the server by the smart TV, and the server searches for the corresponding ip according to the smart home device id; as described above.
  • a first sending unit configured to send, by the server, a control instruction to the smart home device;
  • the body is as described above.
  • the second determining unit is configured to: if the smart TV and the smart home device are successfully connected, and the smart home device that needs to be operated currently is connected to the smart TV by using a Bluetooth, 2.4G or zigbee wireless connection; as described above.
  • the second sending unit is configured to send a control instruction to the smart home device directly by the smart television; as described above.
  • the present invention provides a smart home device interaction method and system based on a smart TV video scene, the method comprising: presetting a database to store image features of different video scenes and smart home devices corresponding to different video scene types.
  • the operation data obtain the video data currently being played by the smart TV, determine the current video scene type; initiate a connection to the smart home device according to the current video scene type, and detect whether the smart TV and the smart home device are successfully connected; if the smart TV is detected
  • the smart home device is successfully connected, and the smart home device is controlled to perform corresponding operations.
  • the invention can analyze the scene elements of the film and television content played on the television, automatically control a plurality of smart home devices, change the surrounding environmental conditions of the user, and make the user immersive, thereby improving the interaction between the smart television and the smart home device. It is convenient for users to watch videos.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Automation & Control Theory (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Power Engineering (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Selective Calling Equipment (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

本发明公开了基于智能电视视频场景的智能家居设备互动方法及系统，所述方法包括：预先设置一个数据库存储不同视频场景图像特征及不同视频场景类型对应的智能家居设备的操作数据；获取智能电视当前正在播放的视频数据，判断当前视频场景类型；根据当前视频场景类型，向智能家居设备发起连接，检测智能电视与智能家居设备是否连接成功。本发明可通过分析电视上播放的影视内容的场景元素进行分析，自动控制多种智能家居设备，改变用户周边环境条件，使用户身临其境，提高了智能电视与智能家居设备的互动性，为用户观看视频提供方便。

Description

基于智能电视视频场景的智能家居设备互动方法及系统 技术领域
本发明涉及消费性电子产品技术领域，尤其涉及一种基于智能电视视频场景的智能家居设备互动方法及系统。
背景技术
目前传统用户在电视上看电影的时候，基本上是一直盯着电视上的影视画面，电视则始终在播放影片，基本上没有互动，也没有考虑用户的真实感受，无法让用户真正的身临其境。传统电视影视播放上存在以下缺点：
用户和电视之间缺少交流与互动，用户只能观看影视内容，用户身边的环境也无法根据电视场景中的季节、天气的变化等发生变化，电视与周边智能设备无法根据电视场景进行互动。
因此，现有技术有待改进和提高。
发明内容
鉴于现有技术的不足，本发明目的在于提供一种基于智能电视视频场景的智能家居设备互动方法及系统，旨在解决现有技术中用户在观看智能电视时，用户身边的智能家居设备无法根据电视场景变化而变化，智能电视与智能家居设备也无法有效互动，用户无法在家里也实现电视场景数据的缺陷。
本发明的技术方案如下：
一种基于智能电视视频场景的智能家居设备互动方法，其中，方法包括：
预先设置一个数据库存储不同视频场景图像特征及不同视频场景类型对应的智能家居设备的操作数据；
获取智能电视当前正在播放的视频数据，通过图像识别提取出当前视频数据中的图像特征，并与数据库存储的不同图像特征进行对比，判断当前视频场景类型；
根据当前视频场景类型，查询预先存储的视频场景类型下对应的智能家居设备的操作数据，向智能家居设备发起连接，检测智能电视与智能家居设备是否连接成功；
若检测到智能电视与智能家居设备连接成功，控制智能家居设备 执行预先存储的对应操作。
所述基于智能电视视频场景的智能家居设备互动方法，其中，所述获取智能电视当前正在播放的视频数据，通过图像识别当前视频数据中的图像特征，并与数据库的不同图像特征进行对比，判断当前视频场景类型具体包括：
获取智能电视正在播放的视频数据，并实时提取视频数据中的帧图像；
对提取出的帧图像进行降噪处理；
利用图像识别技术提取出降噪后帧图像中的图像特征并保存；
将保存的帧图像的图像特征与数据库中预先存储的视频场景图像特征进行对比，判断当前视频场景类型。
所述基于智能电视视频场景的智能家居设备互动方法，其中，所述查询预先存储的视频场景类型下对应的智能家居设备的操作数据，向智能家居设备发起连接，检测智能电视与智能家居设备是否连接成功具体包括：
根据当前视频场景类型，查询预先存储的视频场景类型下对应的智能家居设备的操作数据，获取要执行的操作及需要操作的智能家居设备；
向智能家居设备发送无线连接控制指令；
检测智能电视与智能家居设备是否连接成功。
所述基于智能电视视频场景的智能家居设备互动方法，其中，所述无线连接包括WIFI连接、蓝牙连接、2.4G连接或zigbee连接。
所述基于智能电视视频场景的智能家居设备互动方法，其中，若检测到智能电视与智能家居设备连接成功，控制智能家居设备执行预先存储的对应操作具体包括：
若检测到智能电视与智能家居设备连接成功，且当前需要操作的智能家居设备是以WIFI的无线连接方式接入智能电视；
智能电视发送智能家居设备id到服务器，服务器根据智能家居设备id查找相应的ip；
服务器向该智能家居设备发送控制指令。
所述基于智能电视视频场景的智能家居设备互动方法，其中，若检测到智能电视与智能家居设备连接成功，控制智能家居设备执行预先存储的对应操作还包括：
若检测到智能电视与智能家居设备连接成功，且当前需要操作的智能家居设备是以蓝牙、2.4G或zigbee的无线连接方式接入智能电视；
智能电视直接向智能家居设备发送控制指令。
一种基于智能电视视频场景的智能家居设备互动系统，其中，系 统包括：
预先设置与存储模块，用于预先设置一个数据库存储不同视频场景图像特征及不同视频场景类型对应的智能家居设备的操作数据；
获取与判断模块，用于获取智能电视当前正在播放的视频数据，通过图像识别提取出当前视频数据中的图像特征，并与数据库存储的不同图像特征进行对比，判断当前视频场景类型；
查询与判断模块，用于根据当前视频场景类型，查询预先存储的视频场景类型下对应的智能家居设备的操作数据，向智能家居设备发起连接，检测智能电视与智能家居设备是否连接成功；
控制模块，用于若检测到智能电视与智能家居设备连接成功，控制智能家居设备执行预先存储的对应操作。
所述基于智能电视视频场景的智能家居设备互动系统，其中，所述获取与判断模块具体包括：
提取单元，用于获取智能电视正在播放的视频数据，并实时提取视频数据中的帧图像；
降噪处理单元，用于对提取出的帧图像进行降噪处理；
特征提取与保存单元，用于利用图像识别技术提取出降噪后帧图像中的图像特征并保存；
对比与判断单元，用于将保存的帧图像的图像特征与数据库中预先存储的视频场景图像特征进行对比，判断当前视频场景类型。
所述基于智能电视视频场景的智能家居设备互动系统，其中，所述查询与判断具体包括：
获取单元，用于根据当前视频场景类型，查询预先存储的视频场景类型下对应的智能家居设备的操作数据，获取要执行的操作及需要操作的智能家居设备；
控制指令发送单元，用于向智能家居设备发送无线连接控制指令；
判定单元，用于检测智能电视与智能家居设备是否连接成功；
所述无线连接包括WIFI连接、蓝牙连接、2.4G连接或zigbee连接。
所述基于智能电视视频场景的智能家居设备互动系统，其中，所述控制指令发送单元具体包括：
第一判定单元，用于若检测到智能电视与智能家居设备连接成功，且当前需要操作的智能家居设备是以WIFI的无线连接方式接入智能电视；
查找单元，用于智能电视发送智能家居设备id到服务器，服务器根据智能家居设备id查找相应的ip；
第一发送单元，用于服务器向该智能家居设备发送控制指令；
第二判定单元，用于若检测到智能电视与智能家居设备连接成功， 且当前需要操作的智能家居设备是以蓝牙、2.4G或zigbee的无线连接方式接入智能电视；
第二发送单元，用于智能电视直接向智能家居设备发送控制指令。
有益效果：本发明可通过实时提取电视上播放的影视视频内容的场景元素，利用图像识别技术提取视频图像的图像特征进行分析，判断视频图像所处的场景类型，根据场景类型自动控制多种智能家居设备执行相应操作，改变用户周边环境条件，实现用户的所处环境与当前电视播放的视频场景环境相同，使智能家居设备可根据智能电视的播放内容进行有效的互动，为用户观看视频提供方便。
附图说明
图1为本发明的一种基于智能电视视频场景的智能家居设备互动方法的较佳实施例的流程图；
图2为本发明的一种基于智能电视视频场景的智能家居设备互动方法的具体应用实施例的场景信息、功能和设备对应示意图；
图3为本发明的一种基于智能电视视频场景的智能家居设备互动方法的具体应用实施例的视频场景数据提取流程图；
图4为本发明的一种基于智能电视视频场景的智能家居设备互动方法的具体应用实施例的智能家居设备控制流程图；
图5为本发明的一种基于智能电视视频场景的智能家居设备互动系统的较佳实施例的功能原理框图。
具体实施方式
为使本发明的目的、技术方案及效果更加清楚、明确，以下对本发明进一步详细说明。应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。
本发明提供了一种基于智能电视视频场景的智能家居设备互动方法的较佳实施例的流程图，如图1所示，所述方法包括：
步骤S100、预先设置一个数据库存储不同视频场景图像特征及不同视频场景类型对应的智能家居设备的操作数据。
具体实施时，预先设置一个数据库，用于将不同类型的视频场景图像特征进行储存，方便后续获取智能电视播放的视频场景中提取出的图像特征进行对比，而判断出当前是哪种场景。同时也要预先将不同视频场景类型下要对什么设备进行操作也要进行存储。具体地，该数据库可以存储在智能电视中，也可存储于与智能电视网络连接的服务器中。而场景类型对应的智能家居设备的操作数据，例如，场景类型为冬天时，要控制空调或是风扇进行吹风，同时还要控制空调的温 度调低等。
步骤S200、获取智能电视当前正在播放的视频数据，通过图像识别提取出当前视频数据中的图像特征，并与数据库存储的不同图像特征进行对比，判断当前视频场景类型。
具体实施时，检测到当前智能电视正在播放视频数据，通过图像处理技术实时获取当前播放视频的帧图像，通过图像识别提取帧图像的图像特征，具体的图像识别技术与数据库中的图像特征进行对比，得到当前视频所对应的视频场景类型。
具体地，本发明还提供一种图像对比的算法具体应用实施例，用"感知哈希算法"(Perceptual hash algorithm)对每张图片生成一个"指纹"(fingerprint)字符串，然后比较不同图片的指纹。结果越接近，就说明图片越相似。方法包括：:
第一步，缩小尺寸。
将图片缩小到8x8的尺寸，总共64个像素。也可根据需要选取。这一步的作用是去除图片的细节，只保留结构、明暗等基本信息，摒弃不同尺寸、比例带来的图片差异。
第二步，简化色彩。
将缩小后的图片，转为64级灰度。也就是说，所有像素点总共只有64种颜色。
第三步，计算平均值。
计算所有64个像素的灰度平均值。
第四步，比较像素的灰度。
将每个像素的灰度，与平均值进行比较。大于或等于平均值，记为1；小于平均值，记为0。
第五步，计算哈希值。
将上一步的比较结果，组合在一起，就构成了一个64位的整数，这就是这张图片的指纹。组合的次序并不重要，只要保证所有图片都采用同样次序就行了。
得到指纹以后，就可以对比不同的图片，看看64位中有多少位是不一样的。在理论上，这等同于计算"汉明距离"(Hamming distance)。如果不相同的数据位不超过5，就说明两张图片很相似；如果大于10，就说明这是两张不同的图片。当两张图片很相似,则认为当前场景视频中的图片与预先存储的图片特征相同。
实际应用中，往往采用更强大的pHash算法和SIFT算法，它们能够识别图片的变形。只要变形程度不超过25％，它们就能匹配原图。这些算法虽然更复杂，但是原理与上面的简便算法是一样的，就是先将图片转化成Hash字符串，然后再进行比较。
进一步地，所述步骤S200具体包括：
步骤S201、获取智能电视正在播放的视频数据，并实时提取视频数据中的帧图像；
步骤S202、对提取出的帧图像进行降噪处理；
步骤S203、利用图像识别技术提取出降噪后提取帧图像中的图像特征并保存；
步骤S204、将保存的帧图像的图像特征与数据库中预先存储的视频场景图像特征进行对比，判断当前视频场景类型。
具体实施时，主要是针对视频场景中的信息进行提取，实时提取当前帧图片并进行图像识别处理，通过图片的识别方法得出场景类别信息。场景信息主要包括如表1所示的信息
表1
Figure PCTCN2015093958-appb-000001
其中，季节信息：判断当前的空气质量等，时间信息：判断当前天气亮度等，温度信息：判断当前温度高低等，天气信息：判断当前是刮风或下雨、打雷闪电等，地理位置信息：判断当前气候等，事件信息：如震动、倾斜、行驶速度等。
步骤S300、根据当前视频场景类型，查询预先存储的视频场景类型下对应的智能家居设备的操作数据，向智能家居设备发起连接，检测智能电视与智能家居设备是否连接成功。
具体实施时，当提取的信息判断当前场景，在根据当前场景对应到不同的功能，在根据不同的功能去操作相应的设备。如当前季节信息为冬季，则需要控制空调来降低温度。具体场景、功能和设备的对应关系图2所示。
例如，场景信息中对应的是季节的冬天，则需要调整的功能是吹风、调节温度、改变湿度，而对应这些功能设备为空调、加湿器。
进一步地，所述步骤S300具体包括：
步骤S301、根据当前视频场景类型，查询预先存储的视频场景类型下对应的智能家居设备的操作数据，获取要执行的操作及需要操作的智能家居设备；
步骤S302、向智能家居设备发送无线连接控制指令；
步骤S303、检测智能电视与智能家居设备是否连接成功。
其中，所述无线连接包括WIFI连接、蓝牙连接、2.4G连接或zigbee连接。
具体实施时，对不同的设备控制方式也不尽相同，有wifi设备、蓝牙设备和2.4G以及zigbee等不同方式接入设备等，对每种不同方式接入的设备控制方法也不同，如wifi接入的设备需要通过后台服务器才能对其控制；如采用蓝牙、2.4G或是zigbee方式接入电视的设备，可以直接通过指定命令方式对其进行控制。
步骤S400、控制智能家居设备执行预先存储的对应操作。
进一步的实施例中，所述步骤S302中若智能家居设备是以WIFI的方式接入智能电视，则步骤S400具体包括：
步骤S401、若检测到当前需要操作的智能家居设备是以WIFI的无线连接方式接入智能电视；
步骤S402、智能电视发送智能家居设备id到服务器，服务器根据智能家居设备id查找相应的ip；
步骤S403、服务器向该智能家居设备发送控制指令。
具体实施时，所述步骤S402中若智能家居设备是以蓝牙、2.4G或zigbee的方式接入智能电视，则控制方式具体包括：
步骤S411、若检测到当前需要操作的智能家居设备是以蓝牙、2.4G或zigbee的无线连接方式接入智能电视；
步骤S412、智能电视直接向智能家居设备发送控制指令。
步骤S400之后还包括：
步骤S500、若检测到智能电视与智能家居设备连接失败，提示连接失败信息。
具体实施时，当检测到智能电视与智能家居设备连接失败，说明用户并不没有购买该智能家居设备，可在原智能电视屏幕以不影响观看的前提下，用弹出窗口的形式提醒用户，当前智能家居设备未购买。窗口的位置可选择在屏幕的中央或是屏幕的左下角或右下角。窗口的大小范围小于10mm*10mm。该窗口在一预定时间未检测到用户的操作则自动关闭，预定时间优选为10-30s，也可根据用户需要进行设置。
进一步，该窗口可设置与家居智能设备网站链接，并在窗口上提供了家居设备购买入口，供用户点击后进入家居智能设备网络购买家居智能设备。
本发明还提供了一种基于智能电视视频场景的智能家居设备互动方法的具体应用实施例的视频场景数据提取流程图，如图3所示，所述方法包括：
步骤S10、实时提取当前视频中的帧图像；
步骤S20、对提取的图像进行预处理、降噪等操作，提供后续识别的准确率；
步骤S30、提取图像中的相应特征并保存；
步骤S40、将保存的图像特征与数据库中的图像进行对比，判断当前是那种场景；
步骤S50、获取当前场景。
本发明的一种基于智能电视视频场景的智能家居设备互动方法的具体应用实施例的智能家居设备控制的流程图，如图4所示，所述方法包括：
步骤S101、根据当前场景信息，提取相关功能；
步骤S102、根据相应功能调用指定设备
步骤S103、判断识别接入方式，即判断将要操作的这些设备是如何接入电视，以及如何控制；
步骤S104、判断是否是wifi接入的，如果是执行步骤S106；如果不是执行步骤S105；
步骤S105、判断该设备是否是蓝牙接入的，如果是则执行步骤S109；如果不是则执行步骤S108；
步骤S106、发送设备id到服务器，服务器根据设备id查找相应的ip；
步骤S107、服务器向该设备ip发送控制指令，并执行步骤S109；
步骤S108、判断该设备是否是2.4G接入的，如果是则执行步骤S109；如果不是则执行步骤S111；
步骤S109、向设备端发送控制命令；
步骤S110、设备根据解析命令并控制设备；
步骤S111、结束操作。
由以上方法实施例可知，本发明提供了一种基于智能电视视频场景的智能家居设备互动方法，通过实时提取当前智能电视播放视频场景中的图像特征信息，与预先存储的场景类型图像特征信息进行对比，获取当前场景类型，并根据当前场景类型确定需要操作的智能家居设备，根据需要操作的智能家居设备与智能电视的连接方式的不同，采用不同的控制指令发送方式，实现对智能家居设备的控制。本发明中的智能电视可智能识别当前播放的视频信息，并根据视频信息控制智能家居设备，使用户实时感受到与视频内的情景信息，提高了智能电视与智能家居设备的互动性，为用户提供了方便。
在上述方法实施例的基础上，本发明还提供了一种基于智能电视视频场景的智能家居设备互动系统的较佳实施例的功能原理框图，如图5所示，所述系统包括：
预先设置与存储模块100，用于预先设置一个数据库存储不同视 频场景图像特征及不同视频场景类型对应的智能家居设备的操作数据；具体如上所述。
获取与判断模块200，用于获取智能电视当前正在播放的视频数据，通过图像识别提取出当前视频数据中的图像特征，并与数据库存储的不同图像特征进行对比，判断当前视频场景类型；具体如上所述。
查询与判断模块300，用于根据当前视频场景类型，查询预先存储的视频场景类型下对应的智能家居设备的操作数据，向智能家居设备发起连接，检测智能电视与智能家居设备是否连接成功；具体如上所述。
控制模块400，用于若检测到智能电视与智能家居设备连接成功，控制智能家居设备执行预先存储的对应操作；具体如上所述。
进一步的实施例，所述获取与判断模块具体包括：
提取单元，用于获取智能电视正在播放的视频数据，并实时提取视频数据中的帧图像；具体如上所述。
降噪处理单元，用于对提取出的帧图像进行降噪处理；具体如上所述。
特征提取与保存单元，用于利用图像识别技术提取出降噪后帧图像中的图像特征并保存；具体如上所述。
对比与判断单元，用于将保存的帧图像的图像特征与数据库中预先存储的视频场景图像特征进行对比，判断当前视频场景类型；具体如上所述。
具体实施时，所述查询与判断模块具体包括：
获取单元，用于根据当前视频场景类型，查询预先存储的视频场景类型下对应的智能家居设备的操作数据，获取要执行的操作及需要操作的智能家居设备；具体如上所述。
控制指令发送单元，用于向智能家居设备发送无线连接控制指令；具体如上所述。
判定单元，用于检测智能电视与智能家居设备是否连接成功；具体如上所述。
所述无线连接包括WIFI连接、蓝牙连接、2.4G连接或zigbee连接；具体如上所述。
进一步地，所述控制指令发送单元具体包括：
第一判定单元，用于若检测到智能电视与智能家居设备连接成功，且当前需要操作的智能家居设备是以WIFI的无线连接方式接入智能电视；具体如上所述。
查找单元，用于智能电视发送智能家居设备id到服务器，服务器根据智能家居设备id查找相应的ip；具体如上所述。
第一发送单元，用于服务器向该智能家居设备发送控制指令；具 体如上所述。
第二判定单元，用于若检测智能电视与智能家居设备连接成功，且到当前需要操作的智能家居设备是以蓝牙、2.4G或zigbee的无线连接方式接入智能电视；具体如上所述。
第二发送单元，用于智能电视直接向智能家居设备发送控制指令；具体如上所述。
综上所述，本发明提供了一种基于智能电视视频场景的智能家居设备互动方法及系统，所述方法包括：预先设置一个数据库存储不同视频场景图像特征及不同视频场景类型对应的智能家居设备的操作数据；获取智能电视当前正在播放的视频数据，判断当前视频场景类型；根据当前视频场景类型，向智能家居设备发起连接，检测智能电视与智能家居设备是否连接成功；若检测到智能电视与智能家居设备连接成功，控制智能家居设备执行对应操作。本发明可通过分析电视上播放的影视内容的场景元素进行分析，自动控制多种智能家居设备，改变用户周边环境条件，使用户身临其境，提高了智能电视与智能家居设备的互动性，为用户观看视频提供方便。
应当理解的是，本发明的应用不限于上述的举例，对本领域普通技术人员来说，可以根据上述说明加以改进或变换，所有这些改进和变换都应属于本发明所附权利要求的保护范围。

Claims (15)

  1. 一种基于智能电视视频场景的智能家居设备互动方法，其特征在于，方法包括：
    预先设置一个数据库存储不同视频场景图像特征及不同视频场景类型对应的智能家居设备的操作数据；
    获取智能电视当前正在播放的视频数据，通过图像识别提取出当前视频数据中的图像特征，并与数据库存储的不同图像特征进行对比，判断当前视频场景类型；
    根据当前视频场景类型，查询预先存储的视频场景类型下对应的智能家居设备的操作数据，向智能家居设备发起连接，检测智能电视与智能家居设备是否连接成功；
    若检测到智能电视与智能家居设备连接成功，控制智能家居设备执行预先存储的对应操作。
  2. 根据权利要求1所述基于智能电视视频场景的智能家居设备互动方法，其特征在于，所述获取智能电视当前正在播放的视频数据，通过图像识别当前视频数据中的图像特征，并与数据库的不同图像特征进行对比，判断当前视频场景类型具体包括：
    获取智能电视正在播放的视频数据，并实时提取视频数据中的帧图像；
    对提取出的帧图像进行降噪处理；
    利用图像识别技术提取出降噪后帧图像中的图像特征并保存；
    将保存的帧图像的图像特征与数据库中预先存储的视频场景图像特征进行对比，判断当前视频场景类型。
  3. 一种基于智能电视视频场景的智能家居设备互动方法，其特征在于，方法包括：
    预先设置一个数据库存储不同视频场景图像特征及不同视频场景类型对应的智能家居设备的操作数据；
    获取智能电视当前正在播放的视频数据，通过图像识别提取出当前视频数据中的图像特征，并与数据库存储的不同图像特征进行对比，判断当前视频场景类型；
    根据当前视频场景类型，查询预先存储的视频场景类型下对应的智能家居设备的操作数据，向智能家居设备发起连接，检测智能电视与智能家居设备是否连接成功；
    若检测到智能电视与智能家居设备连接成功，控制智能家居设备执行预先存储的对应操作；
    所述查询预先存储的视频场景类型下对应的智能家居设备的操作数据，向智能家居设备发起连接，检测智能电视与智能家居设备是否连接成功具体包括：
    根据当前视频场景类型，查询预先存储的视频场景类型下对应的智能家居设备的操作数据，获取要执行的操作及需要操作的智能家居设备；
    向智能家居设备发送无线连接控制指令；
    检测智能电视与智能家居设备是否连接成功。
  4. 根据权利要求3所述基于智能电视视频场景的智能家居设备互动方法，其特征在于，所述无线连接包括WIFI连接、蓝牙连接、2.4G连接或zigbee连接。
  5. 根据权利要求3所述基于智能电视视频场景的智能家居设备互动方法，其特征在于，若检测到智能电视与智能家居设备连接成功，控制智能家居设备执行预先存储的对应操作具体包括：
    若检测到智能电视与智能家居设备连接成功，且当前需要操作的智能家居设备是以WIFI的无线连接方式接入智能电视；
    智能电视发送智能家居设备id到服务器，服务器根据智能家居设备id查找相应的ip；
    服务器向该智能家居设备发送控制指令。
  6. 根据权利要求3所述基于智能电视视频场景的智能家居设备互动方法，其特征在于，若检测到智能电视与智能家居设备连接成功，控制智能家居设备执行预先存储的对应操作还包括：
    若检测到智能电视与智能家居设备连接成功，且当前需要操作的智能家居设备是以蓝牙、2.4G或zigbee的无线连接方式接入智能电视；
    智能电视直接向智能家居设备发送控制指令。
  7. 根据权利要求4所述基于智能电视视频场景的智能家居设备互动方法，其特征在于，若检测到智能电视与智能家居设备连接成功，控制智能家居设备执行预先存储的对应操作具体包括：
    若检测到智能电视与智能家居设备连接成功，且当前需要操作的智能家居设备是以WIFI的无线连接方式接入智能电视；
    智能电视发送智能家居设备id到服务器，服务器根据智能家居设备id查找相应的ip；
    服务器向该智能家居设备发送控制指令。
  8. 根据权利要求7所述基于智能电视视频场景的智能家居设备互动方法，其特征在于，若检测到智能电视与智能家居设备连接成功，控制智能家居设备执行预先存储的对应操作还包括：
    若检测到智能电视与智能家居设备连接成功，且当前需要操作的 智能家居设备是以蓝牙、2.4G或zigbee的无线连接方式接入智能电视；
    智能电视直接向智能家居设备发送控制指令。
  9. 根据权利要求4所述基于智能电视视频场景的智能家居设备互动方法，其特征在于，若检测到智能电视与智能家居设备连接成功，控制智能家居设备执行预先存储的对应操作还包括：
    若检测到智能电视与智能家居设备连接成功，且当前需要操作的智能家居设备是以蓝牙、2.4G或zigbee的无线连接方式接入智能电视；
    智能电视直接向智能家居设备发送控制指令。
  10. 根据权利要求5所述基于智能电视视频场景的智能家居设备互动方法，其特征在于，若检测到智能电视与智能家居设备连接成功，控制智能家居设备执行预先存储的对应操作还包括：
    若检测到智能电视与智能家居设备连接成功，且当前需要操作的智能家居设备是以蓝牙、2.4G或zigbee的无线连接方式接入智能电视；
    智能电视直接向智能家居设备发送控制指令。
  11. 根据权利要求3所述基于智能电视视频场景的智能家居设备互动方法，其特征在于，所述获取智能电视当前正在播放的视频数据，通过图像识别当前视频数据中的图像特征，并与数据库的不同图像特征进行对比，判断当前视频场景类型具体包括：
    获取智能电视正在播放的视频数据，并实时提取视频数据中的帧图像；
    对提取出的帧图像进行降噪处理；
    利用图像识别技术提取出降噪后帧图像中的图像特征并保存；
    将保存的帧图像的图像特征与数据库中预先存储的视频场景图像特征进行对比，判断当前视频场景类型。
  12. 一种基于智能电视视频场景的智能家居设备互动系统，其特征在于，系统包括：
    预先设置与存储模块，用于预先设置一个数据库存储不同视频场景图像特征及不同视频场景类型对应的智能家居设备的操作数据；
    获取与判断模块，用于获取智能电视当前正在播放的视频数据，通过图像识别提取出当前视频数据中的图像特征，并与数据库存储的不同图像特征进行对比，判断当前视频场景类型；
    查询与判断模块，用于根据当前视频场景类型，查询预先存储的视频场景类型下对应的智能家居设备的操作数据，向智能家居设备发起连接，检测智能电视与智能家居设备是否连接成功；
    控制模块，用于若检测到智能电视与智能家居设备连接成功，控 制智能家居设备执行预先存储的对应操作。
  13. 根据权利要求12所述基于智能电视视频场景的智能家居设备互动系统，其特征在于，所述获取与判断模块具体包括：
    提取单元，用于获取智能电视正在播放的视频数据，并实时提取视频数据中的帧图像；
    降噪处理单元，用于对提取出的帧图像进行降噪处理；
    特征提取与保存单元，用于利用图像识别技术提取出降噪后帧图像中的图像特征并保存；
    对比与判断单元，用于将保存的帧图像的图像特征与数据库中预先存储的视频场景图像特征进行对比，判断当前视频场景类型。
  14. 根据权利要求12所述基于智能电视视频场景的智能家居设备互动系统，其特征在于，所述查询与判断具体包括：
    获取单元，用于根据当前视频场景类型，查询预先存储的视频场景类型下对应的智能家居设备的操作数据，获取要执行的操作及需要操作的智能家居设备；
    控制指令发送单元，用于向智能家居设备发送无线连接控制指令；
    判定单元，用于检测智能电视与智能家居设备是否连接成功；
    所述无线连接包括WIFI连接、蓝牙连接、2.4G连接或zigbee连接。
  15. 根据权利要求14所述基于智能电视视频场景的智能家居设备互动系统，其特征在于，所述控制指令发送单元具体包括：
    第一判定单元，用于若检测到智能电视与智能家居设备连接成功，且当前需要操作的智能家居设备是以WIFI的无线连接方式接入智能电视；
    查找单元，用于智能电视发送智能家居设备id到服务器，服务器根据智能家居设备id查找相应的ip；
    第一发送单元，用于服务器向该智能家居设备发送控制指令；
    第二判定单元，用于若检测到智能电视与智能家居设备连接成功，且当前需要操作的智能家居设备是以蓝牙、2.4G或zigbee的无线连接方式接入智能电视；
    第二发送单元，用于智能电视直接向智能家居设备发送控制指令。
PCT/CN2015/093958 2015-08-28 2015-11-06 基于智能电视视频场景的智能家居设备互动方法及系统 WO2017035949A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US15/323,840 US20170201791A1 (en) 2015-08-28 2015-11-06 Interactive method on intelligent home appliance based on smart tv video scenes and the system thereof
AU2015396659A AU2015396659B2 (en) 2015-08-28 2015-11-06 Interactive method on intelligent home appliance based on smart TV video scenes and the system thereof

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510538524.0A CN105072483A (zh) 2015-08-28 2015-08-28 基于智能电视视频场景的智能家居设备互动方法及系统
CN201510538524.0 2015-08-28

Publications (1)

Publication Number Publication Date
WO2017035949A1 true WO2017035949A1 (zh) 2017-03-09

Family

ID=54501743

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/093958 WO2017035949A1 (zh) 2015-08-28 2015-11-06 基于智能电视视频场景的智能家居设备互动方法及系统

Country Status (4)

Country Link
US (1) US20170201791A1 (zh)
CN (1) CN105072483A (zh)
AU (1) AU2015396659B2 (zh)
WO (1) WO2017035949A1 (zh)

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105760141B (zh) * 2016-04-05 2023-05-09 中兴通讯股份有限公司 一种实现多维控制的方法、智能终端及控制器
CN105955040A (zh) * 2016-05-20 2016-09-21 深圳市大拿科技有限公司 根据实时视频画面可视化控制的智能家居系统及控制方法
CN107332944A (zh) * 2017-06-28 2017-11-07 中科院微电子研究所昆山分所 物联网专用网关的ip和id对应关系的获取方法及系统
EP3435680B1 (en) 2017-07-27 2019-09-04 Vestel Elektronik Sanayi ve Ticaret A.S. Technique for selecting a path of a multipath audio and/or video stream
CN107484005A (zh) * 2017-08-08 2017-12-15 深圳创维数字技术有限公司 监控方法、机顶盒、监控系统及存储介质
EP3448046A1 (en) * 2017-08-23 2019-02-27 Vestel Elektronik Sanayi ve Ticaret A.S. Method for controlling of external devices in dependency of video and/or audio content
CN108875652A (zh) * 2018-06-26 2018-11-23 四川斐讯信息技术有限公司 用户场景分析装置及方法
CN108966007B (zh) * 2018-09-03 2021-08-31 海信视像科技股份有限公司 一种在hdmi下区分视频场景的方法及装置
CN109388719A (zh) * 2018-09-30 2019-02-26 京东方科技集团股份有限公司 基于数字化作品的多维场景数据生成装置及方法
CN109358520B (zh) * 2018-11-01 2022-01-07 南京仁程智能科技有限公司 一种智能家居物联网络局域动态解锁系统
CN109886138A (zh) * 2019-01-27 2019-06-14 武汉星巡智能科技有限公司 基于场景识别的控制方法、装置及计算机可读存储介质
CN109976168B (zh) * 2019-03-08 2022-07-08 佛山市云米电器科技有限公司 一种去中心化的智能家居控制方法及系统
CN110493090B (zh) * 2019-08-22 2022-01-28 三星电子（中国）研发中心 一种实现智能家庭影院的方法和系统
CN112922877B (zh) * 2019-12-05 2022-12-13 佛山市云米电器科技有限公司 风扇控制方法、风扇、系统和存储介质
CN113132813A (zh) * 2019-12-31 2021-07-16 深圳Tcl新技术有限公司 一种视频播放方法、装置、智能电视及存储介质
CN112000024B (zh) * 2020-09-01 2022-08-05 青岛海尔科技有限公司 用于控制家电设备的方法及装置、设备
CN112240636A (zh) * 2020-10-15 2021-01-19 深圳市建滔科技有限公司 一种基于ZigBee的智能家用电器舒适度调节的系统
US20230049120A1 (en) * 2021-08-06 2023-02-16 Rovi Guides, Inc. Systems and methods for determining types of references in content and mapping to particular applications
US11971691B2 (en) 2021-09-24 2024-04-30 International Business Machines Corporation Management of devices in a smart environment
CN116366389A (zh) * 2023-06-02 2023-06-30 深圳市华翌科技有限公司 基于智能家居的家庭影院环境氛围控制方法及系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101193200A (zh) * 2006-11-28 2008-06-04 三星电子株式会社 用于关联基本装置和扩展装置的设备和方法
US20110110641A1 (en) * 2009-11-11 2011-05-12 Electronics And Telecommunications Research Institute Method for real-sense broadcasting service using device cooperation, production apparatus and play apparatus for real-sense broadcasting content thereof
CN203574802U (zh) * 2013-10-11 2014-04-30 深圳创维数字技术股份有限公司 一种多感影音系统
CN103780889A (zh) * 2012-10-17 2014-05-07 索尼公司 用于基于视频内容产生环境光效果的方法和系统
CN104540275A (zh) * 2014-12-17 2015-04-22 欧普照明股份有限公司 一种调节现场照明装置的方法、设备及系统

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1999053728A1 (fr) * 1998-04-13 1999-10-21 Matsushita Electric Industrial Co., Ltd. Procede de regulation d'un eclairage et dispositif d'eclairage
US6522769B1 (en) * 1999-05-19 2003-02-18 Digimarc Corporation Reconfiguring a watermark detector
US9071868B2 (en) * 2009-05-29 2015-06-30 Cognitive Networks, Inc. Systems and methods for improving server and client performance in fingerprint ACR systems
US20130107122A1 (en) * 2011-11-01 2013-05-02 Sungchang HA Apparatus for controlling external device and method thereof
US8831840B2 (en) * 2012-08-31 2014-09-09 United Video Properties, Inc. Methods and systems for producing the environmental conditions of a media asset in a vehicle
US9031975B2 (en) * 2012-11-06 2015-05-12 Rockwell Automation Technologies, Inc. Content management
US8984568B2 (en) * 2013-03-13 2015-03-17 Echostar Technologies L.L.C. Enhanced experience from standard program content
CN103618719B (zh) * 2013-11-29 2016-11-23 北京奇虎科技有限公司 云服务身份认证方法及设备
CN104166396B (zh) * 2014-08-27 2016-09-28 深圳创维－Rgb电子有限公司 一种智能家居控制方法及系统
CN104483851B (zh) * 2014-10-30 2017-03-15 深圳创维－Rgb电子有限公司 一种情景感知控制装置、系统及方法
CN104614637A (zh) * 2015-02-28 2015-05-13 苏州路之遥科技股份有限公司 线束智能测试机微电脑自学习方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101193200A (zh) * 2006-11-28 2008-06-04 三星电子株式会社 用于关联基本装置和扩展装置的设备和方法
US20110110641A1 (en) * 2009-11-11 2011-05-12 Electronics And Telecommunications Research Institute Method for real-sense broadcasting service using device cooperation, production apparatus and play apparatus for real-sense broadcasting content thereof
CN103780889A (zh) * 2012-10-17 2014-05-07 索尼公司 用于基于视频内容产生环境光效果的方法和系统
CN203574802U (zh) * 2013-10-11 2014-04-30 深圳创维数字技术股份有限公司 一种多感影音系统
CN104540275A (zh) * 2014-12-17 2015-04-22 欧普照明股份有限公司 一种调节现场照明装置的方法、设备及系统

Also Published As

Publication number Publication date
CN105072483A (zh) 2015-11-18
US20170201791A1 (en) 2017-07-13
AU2015396659A1 (en) 2017-03-16
AU2015396659B2 (en) 2018-02-15

Similar Documents

Publication Publication Date Title
WO2017035949A1 (zh) 基于智能电视视频场景的智能家居设备互动方法及系统
CN110933490B (zh) 一种画质和音质的自动调整方法、智能电视机及存储介质
US11170210B2 (en) Gesture identification, control, and neural network training methods and apparatuses, and electronic devices
US10136183B2 (en) Dynamic video overlays
US10902234B2 (en) Image recognition method and apparatus
US9036943B1 (en) Cloud-based image improvement
US10592759B2 (en) Object recognition apparatus and control method therefor
US20140348399A1 (en) Image processing system and method of improving human face recognition
US11516554B2 (en) Method and system for enhancing sound and picture quality based on scene recognition, and display
KR101725884B1 (ko) 이미지들에 대한 자동 프로세싱
WO2021244440A1 (zh) 电视画质调整方法、装置和系统及电视机设备
WO2014187223A1 (en) Method and apparatus for identifying facial features
EP3070959A1 (en) Methods and systems for content presentation optimization
CN109544441B (zh) 图像处理方法及装置、直播中的肤色处理方法及装置
KR20150041972A (ko) 디스플레이 장치 및 이의 절전 처리 방법
WO2020220858A1 (zh) 图像处理方法、装置、电子设备和计算机可读存储介质
CN112000024B (zh) 用于控制家电设备的方法及装置、设备
WO2022222510A1 (zh) 交互控制方法、终端设备及存储介质
CN110826355A (zh) 一种图像识别方法、装置和存储介质
US20180025682A1 (en) Display apparatus and method for image processing
WO2021018001A1 (zh) 调整电视白平衡值的方法、装置和计算机可读存储介质
US9613294B2 (en) Control of computer vision pre-processing based on image matching using structural similarity
CN110673720A (zh) 一种护眼显示方法和具有护眼模式的学习机
CN114647983A (zh) 显示设备及基于人像的距离检测方法
US9563252B2 (en) Display apparatus and display method thereof

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 15323840

Country of ref document: US

ENP Entry into the national phase

Ref document number: 2015396659

Country of ref document: AU

Date of ref document: 20151106

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15902756

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15902756

Country of ref document: EP

Kind code of ref document: A1