WO2016065745A1 - 一种情景感知控制装置、系统及方法 - Google Patents

一种情景感知控制装置、系统及方法 Download PDF

Info

Publication number
WO2016065745A1
WO2016065745A1 PCT/CN2015/070776 CN2015070776W WO2016065745A1 WO 2016065745 A1 WO2016065745 A1 WO 2016065745A1 CN 2015070776 W CN2015070776 W CN 2015070776W WO 2016065745 A1 WO2016065745 A1 WO 2016065745A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
environmental
function
terminal device
module
Prior art date
Application number
PCT/CN2015/070776
Other languages
English (en)
French (fr)
Inventor
付春元
Original Assignee
深圳创维－Rgb电子有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳创维－Rgb电子有限公司 filed Critical 深圳创维－Rgb电子有限公司
Priority to AU2015306582A priority Critical patent/AU2015306582B2/en
Priority to US14/916,619 priority patent/US10180671B2/en
Publication of WO2016065745A1 publication Critical patent/WO2016065745A1/zh

Links

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
    • G05B19/042—Programme control other than numerical control, i.e. in sequence controllers or logic controllers using digital processors
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B13/00—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion
    • G05B13/02—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric
    • G05B13/0205—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric not using a model or a simulator of the controlled system
    • G05B13/024—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric not using a model or a simulator of the controlled system in which a parameter or coefficient is automatically adjusted to optimise the performance
    • G05B13/025—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric not using a model or a simulator of the controlled system in which a parameter or coefficient is automatically adjusted to optimise the performance using a perturbation signal
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/20—Pc systems
    • G05B2219/23—Pc programming
    • G05B2219/23288—Adaptive states; learning transitions
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/20—Pc systems
    • G05B2219/23—Pc programming
    • G05B2219/23425—Selection of program, adaptive to process

Definitions

  • the present invention relates to the field of electronic terminal devices, and in particular, to a context awareness control device, system and method.
  • the functional effect of the terminal device has a great relationship with the current use environment. For example, differences in network conditions, number of people, brightness of light, space, location, and ambient temperature all have an impact on the functional experience of the terminal device.
  • Existing terminal devices are difficult to automatically adjust some of their functions according to the surrounding environment and scene. For example, when using a smart TV for voice calls, if the smart TV is playing on the network and the surrounding environment is noisy, the slower network speed will affect the speed of voice recognition, and the ambient noise will affect the voice collection. At this time, the user needs to manually turn off the network and adjust the voice collection and noise filtering function of the microphone. If the usage environment changes, the user needs to manually adjust the related functions of the smart TV according to the actual situation. Some feature users don't know if they are running (such as networking) or how to adjust.
  • the terminal equipment presets the scene mode for the user to select or manually adjust before leaving the factory.
  • This kind of artificial collection of environmental information is too costly, including not only labor costs, but also time costs.
  • information needs to be re-acquired, and there is a large deviation when manually collecting data. If the collected samples are small, it cannot be controlled according to the actual environment, and the control flexibility is poor. If you collect a lot of samples, the cost is too high, and large sample data will consume a lot of resources.
  • the terminal device cannot automatically collect information according to the surrounding environment and automatically make corresponding adjustments.
  • an object of the present invention is to provide a context-aware control device, system and method, which can acquire environment information of a user to adjust surrounding terminal devices, which is used by the terminal device.
  • the function matches the best use environment.
  • a context-aware control device is connected to the terminal device and the electrical device, and includes: a connection module, a sensor module, a transmission control module, an information processing module, and an adjustment control module;
  • the sensor module collects environment information and transmits the information to the information processing module.
  • the information processing module collects the usage information of the terminal device through the connection module, and integrates the environment information into functional context information, and the adjustment control module performs the function according to the detected current function. Comparing the functional scenario information with the pre-stored preferred environmental value, outputting the first environmental control signal according to the comparison result, adjusting the working state of the terminal device, and transmitting the second environmental control signal by the emission control module to adjust the working state of the electrical device. .
  • the information processing module includes an information collection unit and an information storage unit;
  • the information collecting unit receives the environment information, collects the usage information of the terminal device, and associates the environment information and the usage information with the function corresponding to the terminal device to obtain the function scenario information when the function is enabled; the information storage unit performs the function
  • the situation information is classified and saved and updated in real time.
  • the usage information of the terminal device collected by the information collection unit includes: a current network speed of the terminal device, a system and a memory occupation status, an currently executed application program, an application running in the background, and wireless interference.
  • Situation number of people around, age of the user, frequency of use, viewing habits, time, device volume, network security, screen brightness.
  • the adjustment control module includes an application detection unit and a command comparison unit;
  • the application detecting unit detects the currently executed function and the function running state in the background of the system; the command comparing unit calls the information value and the better environment collected in the related information items in the function scenario information according to the detected currently executed function. And comparing the information value with the preferred environmental value, extracting the information item and the information value whose information value is not within the preferred environmental value range, and outputting the first environmental control according to the difference between the information value and the preferred environmental value Signal and second environmental control signal.
  • the sensor module includes a temperature sensor, a humidity sensor, a position sensor, a space sensor, a lighting intensity sensor, a noise sensor, and a wireless interference sensor.
  • the emission control module includes:
  • An infrared emitter for converting a second environmental control signal into an infrared signal and transmitting
  • 2.4G transmitter for wirelessly transmitting a second environmental control signal.
  • a context-aware control system includes a terminal device, an electrical device, and the context-aware control device, wherein the context-aware control device is plugged into a terminal device and wirelessly connected to the electrical device;
  • the context-aware control device acquires surrounding environmental information and usage information of the terminal device, compares the environment information and the usage information with the pre-stored preferred environmental values, and generates a first environmental control signal and a second environmental control signal according to the comparison result. Adjust the functions of the terminal equipment and electrical equipment.
  • a context-aware control method includes:
  • the sensor module collects environmental information and transmits it to the information processing module;
  • the information processing module collects usage information of the terminal device through the connection module, and integrates the environment information into functional scenario information;
  • the adjustment control module compares the function scenario information with the pre-stored preferred environment value according to the detected currently executed function, outputs a first environmental control signal according to the comparison result, adjusts the working state of the terminal device, and transmits through the emission control module
  • the second environmental control signal adjusts the operating state of the electrical device.
  • the step of the information processing module collecting the usage information of the terminal device by using the connection module and integrating the environment information into the function scenario information includes:
  • the information collecting unit receives the environmental information and collects the environmental information of the terminal device
  • the information storage unit classifies the function context information and updates it in real time.
  • the adjustment control module compares the function scenario information with a pre-stored preferred environment value, outputs a first environmental control signal according to the comparison result, adjusts an operating state of the terminal device, and controls by using the emission.
  • the step of the module transmitting the second environmental control signal to adjust the working state of the electrical device specifically includes:
  • the application detecting unit detects the currently executed function and the function running state in the background of the system
  • the command comparing unit calls the information value and the preferred environment value collected in the related information item in the function scenario information according to the detected currently executed function, and compares the information value with the preferred environment value;
  • the emission control module transmits a second environmental control signal to adjust the working state of the electrical device
  • the connection module transmits the first environmental control signal to the terminal device to adjust the working state of the terminal device.
  • the present invention provides a context-aware control device, system and method.
  • the context-aware control device is connected to a terminal device, and the environment information is collected by the sensor module and transmitted to the information processing module, and the information processing module passes
  • the connection module collects the usage information of the terminal device and integrates with the environmental information into functional scenario information, and the adjustment control module compares the functional scenario information with the pre-stored preferred environmental value, and outputs the first environmental control signal adjustment according to the comparison result.
  • the development of smart TVs provides a new intelligent presentation method for terminal devices, which has broad application prospects and practical value.
  • FIG. 1 is a schematic diagram of an application embodiment of a context aware control system according to an embodiment of the present invention
  • FIG. 2 is a structural block diagram of a context-aware control apparatus according to an embodiment of the present invention.
  • FIG. 3 is a diagram of a function-scenario information correspondence relationship in a context-aware control apparatus according to an embodiment of the present invention
  • FIG. 4 is a flowchart of a context-aware control method according to an embodiment of the present invention.
  • FIG. 5 is a flowchart of a method in step S200 in a context-aware control method according to an embodiment of the present invention
  • FIG. 6 is a flowchart of a method in step S300 in a context-aware control method according to an embodiment of the present invention.
  • the present invention provides a context-aware control device, system and method.
  • the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
  • the context-aware control device provided by the present invention is inserted into a terminal device that needs to be controlled, and uses the context-aware collection of the usage information of the terminal device and the environment information surrounding the terminal device, and the currently acquired environmental information, usage information, and pre-stored information.
  • the preferred environment value that is, the optimal environment setting value when using a certain function of the terminal device
  • the related functions of the terminal device such as the system running in the background, sound, etc.
  • the surrounding environment such as temperature and brightness
  • Etc. Make appropriate adjustments to facilitate the functional demonstration and use of the terminal equipment to provide a better environment for users; it is beneficial to guide and promote the development of terminal equipment, especially smart TV, and provide new intelligent demonstrations for terminal equipment.
  • the way has broad application prospects and practical value.
  • the invention is not only applicable to the field of consumer electronic products, such as the field of smart television; but also can be used in all terminals with intelligent control systems such as mobile phones, tablet computers, and intelligent robots.
  • the context-aware control system includes a context-aware control device 1, a terminal device 2, and an electrical device 3, and the context-aware control device 1 is inserted into the terminal device 2 by using a USB method, and Electrical equipment 3 is wirelessly connected.
  • the terminal device 2 may be one of an intelligent control system such as a terminal 1 (such as a smart TV), or a terminal 2 (such as a mobile phone), or a terminal n (such as a tablet computer or an intelligent robot).
  • the electrical device 3 includes a household appliance device, a lighting device, a temperature and humidity adjustment device, a sound device, and the like.
  • the context-aware control device 1 is inserted into the terminal device to be controlled, and the context-aware control device 1 acquires surrounding environmental information (such as temperature, humidity, position, space, illumination intensity, noise, etc. of the surrounding environment); Information about the use of the terminal device (such as the current network speed, system and memory usage, currently executing applications, applications running in the background, device volume, network security, etc.).
  • the context-aware control device 1 compares the environmental information and the usage information with the pre-stored preferred environmental values, and generates a first environmental control signal and a second environmental control signal based on the comparison result.
  • the first environmental control signal is to appropriately adjust related functions of the terminal device 2, such as turning off the current download, increasing the volume, and the like. ).
  • the second environmental control signal adjusts related functions of the electrical device 3, such as adjusting the temperature of the air conditioner, changing the brightness of the illumination, etc., thereby providing a better environment for the user to use.
  • the context-aware control device 1 uses a plug-and-play method to integrate the received environment information and the collected usage information by comparing the received environment information with a preset preferred environment value, according to The comparison result generates a first environmental control signal to adjust a part of the functions of the terminal device, and generates a second environmental control signal to the electrical device to adjust the surrounding environment.
  • the context-aware control device 1 includes a connection module 11, a sensor module 12, a transmission control module 13, an information processing module 21, and an adjustment control module 22.
  • the sensor module 12 is connected to the information processing module 21, and the environment information is collected and transmitted to the information processing module 21.
  • the information processing module 21 is connected to the terminal device through the connection module 11 and is also connected to the adjustment control module 22.
  • the information processing module 21 collects the usage information of the terminal device through the connection module 11, and integrates the environment information and the usage information into functional situation information. It is then transmitted to the adjustment control module 22.
  • the adjustment control module 22 compares the function context information with the pre-stored preferred environment value according to the detected currently executed function, and outputs the first environmental control signal according to the comparison result to adjust the working state of the terminal device through the connection module 11. And transmitting the second environmental control signal through the emission control module 13 to adjust the operating state of the electrical device.
  • the information processing module 21 includes an information collecting unit 211 and an information storage unit 212.
  • the adjustment control module 22 includes an application detection unit 221 and a command comparison unit 222.
  • the information collection unit 211 is connected to the information storage unit 212, the connection module 11 and the sensor module 12.
  • the command comparison unit 222 is connected to the application detection unit 221, the information storage unit 212, the emission control module 13, and the connection module 11. Please refer to FIG. 1 and FIG. 2 .
  • the functional principles of the above modules and units are as follows.
  • the connection module 11 is configured to perform a USB connection with the terminal device and implement data interaction, such as the acquisition instruction of the information processing module 21 to the terminal device, and feedback the terminal device usage information collected according to the acquisition instruction to the information processing module 21 Transmitting the first environmental control signal generated by the control module 22 to the terminal device.
  • data interaction such as the acquisition instruction of the information processing module 21 to the terminal device
  • feedback the terminal device usage information collected according to the acquisition instruction to the information processing module 21 Transmitting the first environmental control signal generated by the control module 22 to the terminal device.
  • the sensor module 12 is configured to collect environmental information, including a temperature sensor, a humidity sensor, a position sensor, a space sensor, a lighting intensity sensor, a noise sensor, a wireless interference sensor, and the like.
  • the emission control module 13 is configured to send the second environmental control signal output by the environment adjustment module 24 to a corresponding electrical device (such as a lamp, an electric curtain, an air conditioner, a fan, etc.) to adjust the surrounding environment (such as light intensity, temperature, Humidity, etc.).
  • a corresponding electrical device such as a lamp, an electric curtain, an air conditioner, a fan, etc.
  • the emission control module 13 includes:
  • the infrared emitter converts the second environmental control signal into an infrared signal and transmits it, and is mainly used for controlling household appliances, lighting and sound equipment in the home or shopping mall adopting infrared control mode.
  • the 2.4G transmitter wirelessly transmits the second environmental control signal to make up for the electrical equipment that the infrared transmitter cannot control.
  • the wireless module is configured to wirelessly control the electrical device according to the second environmental control signal; and can also be connected to a network of surrounding computers, mobile phones, etc., and the user can remotely adjust the environment of a certain place to expand the controllable range.
  • the information collecting unit 211 is configured to receive environment information around the terminal device, collect usage information of the terminal device, associate the information with a function corresponding to the terminal device, and obtain function scenario information when the user enables the function.
  • the functional context information can be converted into a data format that the system can recognize for access and easy reading, and provides the basis for the adjustment of the surrounding environment for the presenter and the user.
  • the information sources in the information collecting unit 211 are classified into two types, one is environmental information collected by various sensors acquired from the sensor module 12, such as temperature, humidity, position, space, lighting intensity, and noise of the surrounding environment. And other information.
  • the other type is the usage information collected by the terminal device itself, including the current network speed of the terminal device, the system and memory usage, the currently executed application, the application running in the background, the wireless interference situation, and the number of surrounding people (through the terminal device).
  • the camera set at the front end captures the surrounding image, the number of users is counted by face recognition technology), the frequency of use, the volume of the device, the network security, the brightness of the screen, etc.; and the age of the user associated with the user (the age of the user can be analyzed by the recognized face, This is the prior art) and the viewing habits (statistics of the programs that the user has watched, the time of viewing) and the like.
  • the information collecting unit 211 transmits the function context information to the information storage unit 212 for classification and storage and updates in real time.
  • the function is mainly classified, and the information storage unit 212 module 22 indexes the function context information and connects to the corresponding function of the terminal device.
  • the information storage unit 212 updates the previous history information with the currently acquired function context information, which can save storage space; saving the function context information to the cache can improve the access speed.
  • the information storage unit 212 also pre-stores the preferred environmental value, that is, the environmental information corresponding to the optimal state when the function is used, and the numerical range of the usage information. For example, when watching a movie, a certain space size corresponds to a better device volume range. If the user is an elderly person, the volume can be appropriately increased, and the child can appropriately lower the volume. These data can be provided by the manufacturer based on multiple experimental data, or can be changed by the user according to actual needs.
  • the right side is a function list of the smart TV, including a plurality of function items.
  • the left side is a collection of functional context information, including a plurality of information items, each of which stores the currently collected actual information value and a preset preferred environmental value.
  • environmental information such as network speed, device memory, temperature, humidity, space, lighting intensity, noise, user age, screen brightness, device volume, time, etc. .
  • the speed of the network and the memory of the device affect the smoothness of the movie playback.
  • the temperature and humidity affect the user's physical comfort.
  • the space affects the vision. The proper viewing distance is good for protecting the vision.
  • the long-term or close-range viewing will damage the vision.
  • Noise, screen The brightness and device volume will affect the user's viewing effect.
  • the length of time to watch the movie also has an impact on the body.
  • the user's age affects the settings of the above various functional scenarios, such as the needs of the elderly and young people for temperature, humidity, and device volume.
  • the speed of the network determines whether the voice function is available and the speed of recognition.
  • the location, device volume and ambient noise mainly affect the effect of voice calls or recordings.
  • the device memory mainly affects the fluency of gesture recognition.
  • the number of surrounding people affects the sampling effect of gesture recognition.
  • the location affects whether the smart TV can detect gestures.
  • each function is more or less affected by several pieces of information in the functional context information. By linking functions to these information items for subsequent control, users can be better served.
  • the application detecting unit 221 detects the currently executed function and the function running state in the background of the system. Then, according to the currently executed function, the corresponding information item can be found to achieve the corresponding environment adjustment. For example, when a smart TV is playing a program, the download operation may be performed in the background. Or when the voice function is turned on, the smart TV still plays video, and the background is downloading data. In order to ensure that the current function is performed more smoothly, the application detecting unit 221 detects the function running state, and may suspend the related background operation to speed up.
  • the command comparison unit 222 is a specific implementation unit that controls the environment, and invokes the information value and the preferred environment value collected in the related information items in the function scenario information according to the detected currently executed function.
  • the information value is compared with the preferred environmental value, and the information item and the information value whose information value is not within the preferred environmental value range are extracted, and the information item is the environmental information and/or the usage information that needs to be adjusted. And outputting a corresponding first environmental control signal and a second environmental control signal according to a difference between the information value and the preferred environmental value.
  • the first environment control signal is directed to the terminal device, that is, the command comparison unit 222 can directly output the first environment control signal through the connection module to control the network, system memory, device volume, usage time, network security, and the like in the terminal device.
  • the first environmental control signal output by the command comparison unit 222 includes a pause download and online function, and an instruction to clear the system memory, so that the movie playback can be smoother.
  • the first environmental control signal may further include an instruction to adjust the device volume to a suitable position according to the size of the space, an instruction to set a rest reminder for the user to watch the movie time, and the like.
  • the second environmental control signal is for an electrical device.
  • information items whose information value is not within the preferred environmental value range include temperature and brightness. If the information value of the temperature (the actual temperature is 30 ° C) is greater than the preferred environmental value of the temperature (26 ° C to 28 ° C), the output is reduced by 3 The temperature command of the degree; if the actual brightness is greater than the preferred environmental value of the brightness, the brightness command for reducing the brightness of the LED light is output; then the temperature command and the brightness command belong to the second environmental control signal.
  • the output is increased by 7 degrees of temperature command; similarly, the brightness is darker, the output is increased to increase the brightness of the LED light.
  • the output second environmental control signal is sent to the emission control module 13, and the corresponding electrical equipment is controlled by infrared transmission, or wireless control, or 2.4G wireless transmission mode, such as controlling the air conditioning temperature, so that the user is in a relatively comfortable viewing environment. in. It can also turn off or reduce ambient lighting and noise at the same time.
  • the command comparison unit 222 may issue a second environmental control signal to suspend some unnecessary downloading and online functions in the smart TV, clean the system memory; simultaneously increase the recording volume, and turn off the smart TV.
  • the noise of the machine itself; and the first environmental control signal is issued, and the surrounding sounding device is turned off or the volume is reduced in an infrared or wireless manner.
  • the command comparison unit 222 may issue a second environmental control signal to control the system to first clear the memory, make the gesture recognition function run smoothly, and then prompt the user to move to a spatial position where the gesture can be detected. And improve the brightness of the TV; at the same time, it can also issue the first environmental control signal, adjust the light around the user through infrared or wireless modules, so that the gesture recognition effect reaches the optimal state.
  • an embodiment of the present invention further provides a context-aware control method.
  • the context-aware control method includes:
  • the sensor module collects environmental information and transmits the information to the information processing module.
  • the information processing module collects usage information of the terminal device through the connection module, and integrates the environment information into functional scenario information.
  • the adjustment control module compares the function scenario information with the pre-stored preferred environment value according to the detected currently executed function, outputs a first environmental control signal according to the comparison result, adjusts an operation state of the terminal device, and controls by using the emission.
  • the module transmits a second environmental control signal to adjust the working state of the electrical device.
  • step S200 specifically includes:
  • the information collection unit receives environment information, and collects environment information of the terminal device.
  • the information storage unit classifies and saves the function scenario information and updates in real time.
  • the function of the terminal device-the context information correspondence diagram is obtained.
  • the right side of the function-scenario information correspondence diagram is a function list, including a plurality of function items
  • the left side is a set of function context information, including a plurality of information items, and each information item stores a current collection.
  • the actual information value and the preset preferred environment value Query this graph to clarify which environmental information and usage information need to be adjusted when performing various functions, and the numerical range of the environmental information and usage information corresponding to the optimal state when the function is used. Therefore, it is necessary to understand the function currently enabled by the terminal system.
  • the step S300 specifically includes:
  • Step 301 The application detecting unit detects the currently executed function and the function running state in the background of the system;
  • Step 302 The command comparison unit invokes the information value and the preferred environment value collected in the related information item in the function scenario information according to the detected currently executed function, and compares the information value with the preferred environment value.
  • Step 303 Extract an information item and an information value whose information value is not within a preferred environmental value range, and output a first environmental control signal and a second environmental control signal according to a difference between the information value and the preferred environmental value;
  • Step 304 The emission control module transmits a second environmental control signal to adjust an operating state of the electrical device, and the connection module transmits the first environmental control signal to the terminal device to adjust the working state of the terminal device.
  • the first environmental control signal belongs to the terminal device, and is transmitted to the terminal device through the connection module to adjust the working state of the terminal device.
  • the second environmental control signal belongs to an electrical device, and the transmission is transmitted to the emission control module to adjust the working state of the electrical device.
  • the context-aware control device is inserted into the USB interface of the smart TV. If the smart TV has no camera, the camera can be inserted into the context-aware control device; then the context-aware control device is activated.
  • a preferred implementation process of the context-aware control method is as follows:
  • the sensor module and the information collection unit respectively start a thread to collect related information in real time.
  • various current information collection programs such as the current network speed, the system and memory usage, the currently executed application, and the background running application are executed, and relevant usage information is obtained.
  • various environmental information such as temperature, humidity, position, space, illumination intensity, and noise are collected to obtain relevant environmental data.
  • the information collection unit associates the environment information and the usage information with the function corresponding to the terminal device, obtains the function scenario information of the function, and transmits the function scenario information to the information storage unit.
  • the usage information and the environment information are saved, and the other two threads are responsible for updating the environment information and the usage information in real time.
  • the application detecting unit detects and records the application function name F1 currently being used in the smart TV, the functions F2...Fn running in the background, and whether there is network data transmission or the like.
  • the information storage unit indexes the function context information and connects to the corresponding function of the terminal device, and stores the actual information value of the function context information into the cached information item. Can improve access speed.
  • the output environmental control signal is used to adjust the working state of the electrical device or the terminal device corresponding to the information item until the information value rises or falls within a preferred environmental value range.
  • the corresponding environmental control signals may be sequentially generated in the order of the information items in FIG. 3, or may be generated at the same time. If it is the second environmental control signal, it is transmitted to the transmission control module, and is transmitted to the corresponding electrical equipment by infrared transmission, or wireless control, or 2.4G wireless transmission to achieve adjustment. If it is the first environmental control signal, it is directly transmitted to the terminal device through the connection module for direct regulation.
  • the context-aware control device, system, and method provided by the present invention collect the currently acquired environmental information, usage information, and pre-stored information by collecting usage information of the terminal device and environmental information surrounding the terminal device.
  • the environmental values are compared, and the related functions of the terminal device (such as the system, sound, etc. running in the background) and the surrounding environment (such as temperature, brightness, etc.) are appropriately adjusted according to the comparison result, so that the function demonstration and use of the terminal device are smoothly performed, Users provide a better environment for use; it is conducive to guiding and promoting the development of smart TV in China, and is conducive to promoting the innovation of product use, with broad application prospects and practical value.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Evolutionary Computation (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Telephone Function (AREA)
  • Telephonic Communication Services (AREA)
  • Selective Calling Equipment (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种情景感知控制装置、系统及方法。情景感知控制装置（1）包括连接模块（11）、传感器模块（12）、发射控制模块（13）、信息处理模块（21）和调整控制模块（22）；所述传感器模块（12）采集环境信息并传输给信息处理模块（21），信息处理模块（21）通过连接模块（11）采集终端设备（2）的使用信息、并与所述环境信息整合为功能情景信息，调整控制模块（22）根据检测出的当前执行的功能，将所述功能情景信息与预存的较佳环境值进行比较，根据比较结果输出第一环境控制信号调整终端设备（2）的工作状态，以及通过发射控制模块（13）发射第二环境控制信号调整电器设备（3）的工作状态；从而对周围环境进行适当调整，为用户提供较佳的使用环境；为终端设备（2）提供新的智能演示方式，具有广阔的应用前景和实用价值。

Description

一种情景感知控制装置、系统及方法
技术领域
本发明涉及电子终端设备技术领域，特别涉及一种情景感知控制装置、系统及方法。
背景技术
众所周知，终端销售人员在演示终端设备功能或者用户买回终端设备在家体验时，终端设备的功能效果与当前的使用环境有很大关系。例如，网络状况、人群数量、光线亮度、空间、位置以及环境温度等的不同，对终端设备的功能体验都有一定影响。现有的终端设备难以自动根据周围的环境和情景调整其部分功能。例如，使用智能电视机进行语音通话时，若智能电视机正进行网络播放，周围环境比较嘈杂，则较慢的网速会影响语音识别的速度，环境噪音会影响语音的采集。此时，需由用户手动关闭网络，调整麦克风的语音采集和滤噪功能。若使用环境改变，用户需再次根据实际情况手动调整智能电视机的相关功能。而某些功能用户并不知其是否运行（如联网）、或如何调整。
目前，有的厂商通过实地采集了解终端设备的使用环境信息，终端设备出厂前预先设置情景模式供用户选择或进行人工调整。这种人为采集使用环境信息的成本过高，不仅包括人力成本，还有时间成本等。周围环境变化时，需要重新采集信息，且人工采集数据时会存在较大偏差。若采集的样本较少，则无法根据实际环境进行控制，控制灵活性较差。若采集样本很多，则成本过高，大样本的数据会耗费大量资源。同时，终端设备不能根据周围环境自动采集信息并自动做出相应调整。
发明内容
鉴于上述现有技术的不足之处，本发明的目的在于提供一种情景感知控制装置、系统及方法，能获取用户所处的环境信息来对周围终端设备进行调整，为所使用的终端设备的功能匹配最佳的使用环境。
为了达到上述目的，本发明采取了以下技术方案：
一种情景感知控制装置，与终端设备和电器设备连接，其包括：连接模块、传感器模块、发射控制模块、信息处理模块和调整控制模块；
所述传感器模块采集环境信息并传输给信息处理模块，信息处理模块通过连接模块采集终端设备的使用信息、并与所述环境信息整合为功能情景信息，调整控制模块根据检测出的当前执行的功能，将所述功能情景信息与预存的较佳环境值进行比较，根据比较结果输出第一环境控制信号调整终端设备的工作状态，以及通过发射控制模块发射第二环境控制信号调整电器设备的工作状态。
所述的情景感知控制装置中，所述信息处理模块包括信息采集单元和信息存储单元；
所述信息采集单元接收环境信息，采集终端设备的使用信息，并将环境信息、使用信息与终端设备对应的功能联系获得启用该项功能时的功能情景信息；所述信息存储单元对所述功能情景信息进行分类保存并实时更新。
所述的情景感知控制装置中，所述信息采集单元采集的终端设备的使用信息包括：终端设备的当前网速、系统和内存占用情况、当前执行的应用程序、后台运行的应用程序、无线干扰情况、周围人群数量、用户年龄、使用频率、观看习惯、时间、设备音量、网络安全、屏幕亮度。
所述的情景感知控制装置中，所述调整控制模块包括应用检测单元和命令比较单元；
所述应用检测单元检测当前执行的功能，以及在系统后台的功能运行状态；命令比较单元根据检测出的当前执行的功能，调用功能情景信息中的相关信息项中采集的信息值和较佳环境值、并将所述信息值与较佳环境值进行比较，提取出信息值不在较佳环境值范围内的信息项和信息值，根据信息值与较佳环境值的差值输出第一环境控制信号和第二环境控制信号。
所述的情景感知控制装置中，所述传感器模块包括温度传感器、湿度传感器、位置传感器、空间传感器、亮照强度传感器、噪音传感器、无线干扰传感器。
所述的情景感知控制装置中，所述发射控制模块包括：
红外发射器，用于将第二环境控制信号转换成红外信号并发射；
2.4G发射器，用于将第二环境控制信号无线发射。
一种情景感知控制系统，其包括终端设备、电器设备和所述的情景感知控制装置，所述情景感知控制装置与终端设备插接、与电器设备无线连接；
所述情景感知控制装置获取周围的环境信息和终端设备的使用信息，将环境信息、使用信息与预存的较佳环境值进行比较，根据比较结果生成第一环境控制信号和第二环境控制信号分别对终端设备和电器设备的功能进行调整。
一种情景感知控制方法，其包括：
传感器模块采集环境信息并传输给信息处理模块；
信息处理模块通过连接模块采集终端设备的使用信息、并与所述环境信息整合为功能情景信息；
调整控制模块根据检测出的当前执行的功能，将所述功能情景信息与预存的较佳环境值进行比较，根据比较结果输出第一环境控制信号调整终端设备的工作状态，以及通过发射控制模块发射第二环境控制信号调整电器设备的工作状态。
所述的情景感知控制方法中，所述信息处理模块通过连接模块采集终端设备的使用信息、并与所述环境信息整合为功能情景信息的步骤具体包括：
信息采集单元接收环境信息，采集终端设备的环境信息；
将环境信息和使用信息与终端设备对应的功能联系、获得启用该项功能时的功能情景信息；
信息存储单元对功能情景信息进行分类保存并实时更新。
所述的情景感知控制方法中，所述调整控制模块将所述功能情景信息与预存的较佳环境值进行比较，根据比较结果输出第一环境控制信号调整终端设备的工作状态，以及通过发射控制模块发射第二环境控制信号调整电器设备的工作状态的步骤具体包括：
应用检测单元检测当前执行的功能，以及在系统后台的功能运行状态；
命令比较单元根据检测出的当前执行的功能，调用功能情景信息中的相关信息项中采集的信息值和较佳环境值、并将所述信息值与较佳环境值进行比较；
提取出信息值不在较佳环境值范围内的信息项和信息值，根据信息值与较佳环境值的差值输出第一环境控制信号和第二环境控制信号；
发射控制模块发射第二环境控制信号来调整电器设备的工作状态，连接模块传输第一环境控制信号给终端设备来调整终端设备的工作状态。
相较于现有技术，本发明提供的情景感知控制装置、系统及方法，所述情景感知控制装置，与终端设备插接，通过传感器模块采集环境信息并传输给信息处理模块，信息处理模块通过连接模块采集终端设备的使用信息、并与所述环境信息整合为功能情景信息，调整控制模块将所述功能情景信息与预存的较佳环境值进行比较，根据比较结果输出第一环境控制信号调整终端设备的工作状态，以及通过发射控制模块发射第二环境控制信号调整电器设备的工作状态；从而对周围环境进行适当调整，为用户提供较佳的使用环境；其有利于引导和促进终端设备、特别是智能电视的发展，为终端设备提供新的智能演示方式，具有广阔的应用前景和实用价值。
附图说明
图1为本发明实施例提供的情景感知控制系统应用实施例的示意图；
图2为本发明实施例提供的情景感知控制装置的结构框图；
图3为本发明实施例提供的情景感知控制装置中功能-情景信息对应关系图；
图4为本发明实施例提供的情景感知控制方法流程图；
图5为本发明实施例提供的情景感知控制方法中步骤S200的方法流程图；
图6为本发明实施例提供的情景感知控制方法中步骤S300的方法流程图。
具体实施方式
本发明提供一种情景感知控制装置、系统及方法，为使本发明的目的、技术方案及效果更加清楚、明确，以下参照附图并举实施例对本发明进一步详细说明。应当理解，此处所描述的具体实施例仅用以解释本发明，并不用于限定本发明。
本发明提供的情景感知控制装置使用时插入需要控制的终端设备中，通过情景感知采集该终端设备的使用信息、以及该终端设备周围的环境信息，将当前获取的环境信息、使用信息与预存的较佳环境值（即使用终端设备某项功能时的最佳环境设置值）进行比较，根据比较结果对终端设备的相关功能（如后台运行的系统、声音等）、周围环境（如温度、亮度等）进行适当调整，促使终端设备的功能演示和使用顺利进行，为用户提供较佳的使用环境；其有利于引导和促进终端设备、特别是智能电视的发展，为终端设备提供新的智能演示方式，具有广阔的应用前景和实用价值。该发明不仅适用于消费性电子产品技术领域，如智能电视领域；还可以在手机、平板电脑、智能机器人等所有具备智能控制系统的终端中使用。
请同时参阅图1和图2，本发明提供的情景感知控制系统包括情景感知控制装置1、终端设备2和电器设备3，所述情景感知控制装置1采用USB方式插入终端设备2中，并与电器设备3无线连接。所述终端设备2可以为终端1（如智能电视机）、或终端2（如手机）、或终端n（如平板电脑、智能机器人）等具备智能控制系统的一种。所述电器设备3包括家用电器设备、灯光照明设备、温湿度调节设备、声音设备等。使用时将情景感知控制装置1插入需要控制的终端设备中，情景感知控制装置1获取周围的环境信息（如周围环境的温度、湿度、位置、空间、亮照强度、噪音等信息）；还获取终端设备的使用信息（如当前网速、系统和内存占用情况、当前执行的应用程序、后台运行的应用程序、设备音量、网络安全等）。情景感知控制装置1将环境信息、使用信息与预存的较佳环境值进行比较，根据比较结果生成第一环境控制信号和第二环境控制信号。第一环境控制信号是对终端设备2的相关功能进行适当调整，如关闭当前下载、提高音量等。）。第二环境控制信号对电器设备3的相关功能进行调整，如调整空调温度，改变照明亮度等，从而为用户提供较佳的使用环境。
本实施例中，所述情景感知控制装置1采用一种即插即用方式，通过采集环境信息，将接收的环境信息和采集的使用信息整合后与预设的较佳环境值进行比较，根据比较结果生成第一环境控制信号调整终端设备的部分功能，以及生成第二环境控制信号给电器设备来调整周围环境。如图2所示，所述情景感知控制装置1包括连接模块11、传感器模块12、发射控制模块13、信息处理模块21和调整控制模块22。所述传感器模块12连接信息处理模块21，其采集环境信息后传输给信息处理模块21。信息处理模块21通过连接模块11与终端设备插接、还与调整控制模块22连接，信息处理模块21通过连接模块11采集终端设备的使用信息，将环境信息与所述使用信息整合为功能情景信息后传输给调整控制模块22。所述调整控制模块22根据检测出的当前执行的功能，将所述功能情景信息与预存的较佳环境值进行比较，根据比较结果输出第一环境控制信号通过连接模块11调整终端设备的工作状态，并且还通过发射控制模块13发射第二环境控制信号调整电器设备的工作状态。
其中，所述信息处理模块21包括信息采集单元211和信息存储单元212。所述调整控制模块22包括应用检测单元221和命令比较单元222。所述信息采集单元211连接信息存储单元212、连接模块11和传感器模块12，所述命令比较单元222连接应用检测单元221、信息存储单元212、发射控制模块13和连接模块11。请继续参阅图1和图2，在具体实施时，上述各模块、单元的功能原理如下。
所述连接模块11采用USB接口，用于与终端设备进行USB连接并实现数据交互，如传输信息处理模块21的获取指令给终端设备，反馈根据获取指令采集的终端设备使用信息给信息处理模块21；传输调整控制模块22生成的第一环境控制信号给终端设备。这样情景感知控制装置即可实现即插即用，能方便、快捷、稳定地与终端设备进行通讯，使终端演示人员或用户可以随时自动地调整终端设备的相关功能。
所述传感器模块12用于采集环境信息，其包括温度传感器、湿度传感器、位置传感器、空间传感器、亮照强度传感器、噪音传感器、无线干扰传感器等。
所述发射控制模块13用于将环境调整模块24输出的第二环境控制信号发送给对应的电器设备（如灯具、电动窗帘、空调、风扇等）来调整周围的环境（如光照强度、温度、湿度等）。具体实施时，所述发射控制模块13包括：
红外发射器，将第二环境控制信号转换成红外信号并发射，主要是用于对采用红外控制方式的家里或者商场中的家用电器、灯光音响设备的控制。
2.4G发射器，将第二环境控制信号无线发射，用于弥补红外发射器无法控制的电器设备。
无线模块，用于根据第二环境控制信号无线控制电器设备；还能与周围的电脑、手机等设备网络连接，用户可以远程遥控调节某处的环境，以扩大可控制范围。
所述信息采集单元211用于接收终端设备周围的环境信息，以及采集终端设备的使用信息，将这些信息与终端设备对应的功能联系在一起、获得用户启用该项功能时的功能情景信息。具体实施时功能情景信息可转换成系统能识别的数据格式以便存取和易于读取，为演示人员和用户提供周围环境调节的依据。该信息采集单元211的中的信息来源分为两类，一类是从传感器模块12中获取的各种传感器采集的环境信息，如周围环境的温度、湿度、位置、空间、亮照强度、噪音等信息。另一类是终端设备自身采集的使用信息，包括终端设备的当前网速、系统和内存占用情况、当前执行的应用程序、后台运行的应用程序、无线干扰情况、周围人群数量（可通过终端设备前端设置的摄像头拍摄周围图像，以人脸识别技术统计用户数量）、使用频率、设备音量、网络安全、屏幕亮度等；以及与用户相关的用户年龄（可通过识别出的人脸分析用户年龄，此为现有技术）以及观看习惯（统计用户观看过的节目、观看的时间）等信息。
信息采集单元211将所述功能情景信息传输给信息存储单元212进行分类保存并实时更新。本实施例以功能为主来进行分类，信息存储单元212模块22对功能情景信息建立索引并连接到终端设备的对应的功能中。这样就可以建立一张终端设备的功能—情景信息对应关系图，如图3所示。当终端设备启动某项功能时，查询该图就能找出执行该功能时需要调整的环境信息和使用信息。信息存储单元212以当前获取的功能情景信息更新前次的历史信息，可节省存储空间；将这些功能情景信息保存至缓存中，可提高访问速度。
应当理解的是，所述信息存储单元212还预先存储了较佳环境值，即使用该功能时的最佳状态对应的环境信息和使用信息的数值范围。如观看电影时，一定的空间大小对应一较佳的设备音量范围，若用户是老年人可适当提高音量，是小孩可适当降低音量。这些数据可由厂商根据多次实验数据提供经验值，也可由用户根据实际需求更改。
以智能电视为例，如图3所示，右边为智能电视的功能列表，包括多个功能项。左边为功能情景信息的集合，包括多个信息项，每个信息项中存储有当前采集的实际的信息值和预设的较佳环境值。从图3中可以看出，当用户在看电影时，会受到网速、设备内存、温度、湿度、空间、亮照强度、噪音、用户年龄、屏幕亮度、设备音量、时间等环境信息的影响。网速和设备内存影响了电影播放的流畅度，温度、湿度影响用户的身体舒适度，空间影响视力（适宜的观看距离对保护视力有益，长时间或近距离观看会损伤视力），噪音、屏幕亮度和设备音量会影响用户观看效果，观看电影的时间长度同样对身体有影响，用户年龄则影响上述各功能情景信息的设置，如老年人和年轻人对温度、湿度、设备音量的需求不同。
当用户在使用语音功能时，会受到网速、位置、设备音量和周围噪音等环节因素的影响。网速决定了语音功能是否可用以及识别速度，位置、设备音量和环境噪音主要影响语音通话或录音的效果。
当用户在使用手势识别的时候，会受到设备内存、周围人群数量、位置、亮照强度等因素的影响。设备内存主要影响手势识别的流畅度，周围人群数量影响手势识别的采样效果，位置会影响智能电视是否可以检测到手势。
从图3中可以得出，每个功能实现时都或多或少的受到功能情景信息中几项信息的影响。通过将功能与这些信息项联系起来以便后续调控，可为用户提供更好的使用环境。
请继续参阅图2，在具体实施时，由所述应用检测单元221检测当前执行的功能，以及在系统后台的功能运行状态。之后根据当前执行的功能找出对应的信息项即可实现相应的环境调整。例如，智能电视在播放节目时，可能后台正执行下载操作。或者开启语音功能时，智能电视仍进行视频播放，同时后台正下载数据。为了确保当前执行某功能时能更加顺畅，通过应用检测单元221检测出功能运行状态，可在后续暂停相关后台操作来提速。
所述命令比较单元222是对环境进行控制的具体实施单元，其根据检测出的当前执行的功能，调用功能情景信息中的相关信息项中采集的信息值和较佳环境值。将信息值与较佳环境值进行比较，提取出信息值不在较佳环境值范围内的信息项和信息值，这些信息项即是需要调整的环境信息和/或使用信息。根据信息值与较佳环境值的差值输出对应的第一环境控制信号和第二环境控制信号。
所述第一环境控制信号针对终端设备，即命令比较单元222可通过连接模块直接输出第一环境控制信号来控制终端设备中的网络、系统内存、设备音量、使用时间、网络安全等使用状态，以提高电视功能的使用流畅度和用户体验感。例如，用户当前在观看电影，命令比较单元222输出的第一环境控制信号包括暂停下载和在线功能，清理系统内存的指令，这样可使电影播放更加流畅。同时，第一环境控制信号还可以包括根据空间的大小将设备音量调节到一个合适的位置的指令，设置用户观看电影时间的休息提醒的指令等。
所述第二环境控制信号针对电器设备。例如，信息值不在较佳环境值范围内的信息项包括温度和亮度，若温度的信息值（实际温度为30℃）大于温度的较佳环境值（26℃~28℃），则输出降低3度的温度指令；实际的亮度大于亮度的较佳环境值，则输出降低LED灯光亮的亮度指令；则温度指令和亮度指令属于第二环境控制信号。若温度的信息值（实际温度为20℃）小于较佳环境值（26℃~28℃），则输出的提高7度的温度指令；同理，亮度较暗则输出提高LED灯光亮的亮度指令。输出的第二环境控制信号发送至发射控制模块13中，以红外发射、或无线控制、或2.4G无线发射方式控制相应的电器设备，如控制空调升降温度，使用户处于较为舒适的观影环境中。还可以同时关闭或者减低周围灯光和噪音。
如果应用检测单元221检测当前是语音功能，则命令比较单元222可发出第二环境控制信号暂停智能电视中一些不必要的下载和在线功能，清理系统内存；同时增大录音音量，并关闭智能电视机本身的噪音；以及发出第一环境控制信号、以红外或者无线方式对周围发音设备进行关闭或者减低音量等控制。
如果应用检测单元221检测当前是手势识别功能，则命令比较单元222可发出第二环境控制信号控制系统先清理内存，使手势识别功能运行流畅，然后提示用户移动到可以检测出手势的空间位置上，并提高电视亮度；同时，还可发出第一环境控制信号、通过红外或者无线等模块对用户周围的灯光进行调节，使手势识别效果达到最佳状态。
应当理解的是，在具体实施时，还可以针对智能电视机的其他功能进行调节，确保使每一项功能的流畅度和用户体验感达到最佳。
基于上述的情景感知控制系统，本发明实施例还相应提供一种情景感知控制方法。请参阅图4，所述情景感知控制方法包括：
S100、传感器模块采集环境信息并传输给信息处理模块；
S200、信息处理模块通过连接模块采集终端设备的使用信息、并与所述环境信息整合为功能情景信息。
S300、调整控制模块根据检测出的当前执行的功能，将所述功能情景信息与预存的较佳环境值进行比较，根据比较结果输出第一环境控制信号调整终端设备的工作状态，以及通过发射控制模块发射第二环境控制信号调整电器设备的工作状态。
请参阅图5，所述步骤S200具体包括：
S201、信息采集单元接收环境信息，采集终端设备的环境信息；
S202、将环境信息和使用信息与终端设备对应的功能联系、获得启用该项功能时的功能情景信息；
S203、信息存储单元对功能情景信息进行分类保存并实时更新。
在所述步骤203中分类保存后，获得终端设备的功能—情景信息对应关系图。如图3所示，所述功能—情景信息对应关系图的右边为功能列表，包括多个功能项，左边为功能情景信息的集合，包括多个信息项，每个信息项中存储有当前采集的实际的信息值和预设的较佳环境值。查询该图即可明确执行各种功能时需要调整哪些环境信息和使用信息，以及使用该功能时的最佳状态对应的环境信息和使用信息的数值范围。因此，需要了解终端系统当前启用的功能，则请参阅图6，所述步骤S300具体包括：
步骤301、应用检测单元检测当前执行的功能，以及在系统后台的功能运行状态；
步骤302、命令比较单元根据检测出的当前执行的功能，调用功能情景信息中的相关信息项中采集的信息值和较佳环境值、并将所述信息值与较佳环境值进行比较；
步骤303、提取出信息值不在较佳环境值范围内的信息项和信息值，根据信息值与较佳环境值的差值输出第一环境控制信号和第二环境控制信号；
步骤304、发射控制模块发射第二环境控制信号来调整电器设备的工作状态，连接模块传输第一环境控制信号给终端设备来调整终端设备的工作状态。
所述第一环境控制信号属于终端设备，其通过连接模块传输给终端设备，以调整终端设备的工作状态。所述第二环境控制信号属于电器设备，其传输给发射控制模块发射，以调整电器设备的工作状态。
以智能电视机实现看电影功能为例，将情景感知控制装置插入智能电视机的USB接口，若智能电视机无摄像头，可在情景感知控制装置上插上摄像头；之后启动情景感知控制装置。所述情景感知控制方法一较佳实施的流程如下：
1、启动传感器模块采集环境信息并传输给信息采集单元，同时启动信息采集单元采集使用信息。
传感器模块和信息采集单元分别启动一个线程实时循环采集相关信息。启动信息采集单元后，执行当前网速、系统和内存占用情况、当前执行的应用程序、后台运行的应用程序等各种信息的采集程序，获得相关的使用信息。启动传感器模块后，执行温度、湿度、位置、空间、亮照强度、噪音等各种环境信息的采集，获得相关环境数据。
2、信息采集单元将环境信息和使用信息与终端设备对应的功能联系，获得该项功能的功能情景信息并传输给信息存储单元。
保存使用信息和环境信息，另起两个线程分别负责实时更新环境信息和使用信息的数据。
同时，应用检测单元检测并记录智能电视中当前正在使用的应用功能名称F1，后台正在运行的功能F2…Fn，以及是否有网络数据传输等。
3、信息存储单元对功能情景信息建立索引并连接到终端设备的对应的功能中，将功能情景信息的实际的信息值存储至缓存的信息项中。能提高访问速度。
4、提取智能电视当前正在使用的功能F1对应的各信息项的信息值，与预存的较佳环境值进行比较。
如果当前正在使用的功能F1的各个信息值均在较佳环境值的数据范围内，则断定当前功能F1可以流畅运行。
如果当前正在使用的功能F1的各个信息值中有的不在较佳环境值的数据范围内，则需对不在范围内的信息项进行调整。
5、提取功能F1的信息值不在较佳环境值范围内的信息项和信息值，根据信息值与较佳环境值的差值输出第一环境控制信号和第二环境控制信号。
若某个信息值小于或大于较佳环境值，则输出的环境控制信号用于调整信息项对应的电器设备或终端设备的工作状态，直至信息值上升或下降至较佳环境值范围内。
在所述步骤S5中，可以按照图3中信息项的顺序依次生成对应的环境控制信号，也可以同时生成。若是第二环境控制信号，则传输至发射控制模块中，以红外发射、或无线控制、或2.4G无线发射方式发射给相应的电器设备实现调整。若是第一环境控制信号，则通过连接模块传输至终端设备中直接调控。
6、执行结束。
综上所述，本发明提供的情景感知控制装置、系统及方法，通过采集该终端设备的使用信息、以及该终端设备周围的环境信息，将当前获取的环境信息、使用信息与预存的较佳环境值进行比较，根据比较结果对终端设备的相关功能（如后台运行的系统、声音等）、周围环境（如温度、亮度等）进行适当调整，促使终端设备的功能演示和使用顺利进行，为用户提供较佳的使用环境；其有利于引导和促进我国智能电视的发展，有利于促进产品使用方式的创新，具有广阔的应用前景和实用价值。
可以理解的是，对本领域普通技术人员来说，可以根据本发明的技术方案及其发明构思加以等同替换或改变，而所有这些改变或替换都应属于本发明所附的权利要求的保护范围。

Claims (12)

  1. 一种情景感知控制装置，用于与终端设备和电器设备连接，其特征在于，包括：连接模块、传感器模块、发射控制模块、信息处理模块和调整控制模块；
    所述传感器模块采集环境信息并传输给信息处理模块，信息处理模块通过连接模块采集终端设备的使用信息、并与所述环境信息整合为功能情景信息，调整控制模块根据检测出的当前执行的功能，将所述功能情景信息与预存的较佳环境值进行比较，根据比较结果输出第一环境控制信号调整终端设备的工作状态，以及通过发射控制模块发射第二环境控制信号调整电器设备的工作状态。
  2. 根据权利要求1所述的情景感知控制装置，其特征在于，所述传感器模块包括温度传感器、湿度传感器、位置传感器、空间传感器、亮照强度传感器、噪音传感器、无线干扰传感器。
  3. 根据权利要求1所述的情景感知控制装置，其特征在于，所述发射控制模块包括：
    红外发射器，用于将第二环境控制信号转换成红外信号并发射；
    2.4G发射器，用于将第二环境控制信号无线发射。
  4. 一种情景感知控制装置，用于与终端设备和电器设备连接，其特征在于，包括：连接模块、传感器模块、发射控制模块、信息处理模块和调整控制模块；
    所述传感器模块采集环境信息并传输给信息处理模块，信息处理模块通过连接模块采集终端设备的使用信息、并与所述环境信息整合为功能情景信息，调整控制模块根据检测出的当前执行的功能，将所述功能情景信息与预存的较佳环境值进行比较，根据比较结果输出第一环境控制信号调整终端设备的工作状态，以及通过发射控制模块发射第二环境控制信号调整电器设备的工作状态，所述信息处理模块包括信息采集单元和信息存储单元；
    所述信息采集单元接收环境信息，采集终端设备的使用信息，并将环境信息、使用信息与终端设备对应的功能联系获得启用该项功能时的功能情景信息；所述信息存储单元对所述功能情景信息进行分类保存并实时更新。
  5. 根据权利要求4所述的情景感知控制装置，其特征在于，所述信息采集单元采集的终端设备的使用信息包括：终端设备的当前网速、系统和内存占用情况、当前执行的应用程序、后台运行的应用程序、无线干扰情况、周围人群数量、用户年龄、使用频率、观看习惯、时间、设备音量、网络安全、屏幕亮度。
  6. 根据权利要求4所述的情景感知控制装置，其特征在于，所述调整控制模块包括应用检测单元和命令比较单元；
    所述应用检测单元检测当前执行的功能，以及在系统后台的功能运行状态；命令比较单元根据检测出的当前执行的功能，调用功能情景信息中的相关信息项中采集的信息值和较佳环境值、并将所述信息值与较佳环境值进行比较，提取出信息值不在较佳环境值范围内的信息项和信息值，根据信息值与较佳环境值的差值输出第一环境控制信号和第二环境控制信号。
  7. 根据权利要求4所述的情景感知控制装置，其特征在于，所述传感器模块包括温度传感器、湿度传感器、位置传感器、空间传感器、亮照强度传感器、噪音传感器、无线干扰传感器。
  8. 根据权利要求4所述的情景感知控制装置，其特征在于，所述发射控制模块包括：
    红外发射器，用于将第二环境控制信号转换成红外信号并发射；
    2.4G发射器，用于将第二环境控制信号无线发射。
  9. 一种情景感知控制系统，其特征在于，包括终端设备、电器设备和权利要求1-8任一项所述的情景感知控制装置，所述情景感知控制装置与终端设备插接、与电器设备无线连接；
    所述情景感知控制装置获取周围的环境信息和终端设备的使用信息，将环境信息、使用信息与预存的较佳环境值进行比较，根据比较结果生成第一环境控制信号和第二环境控制信号分别对终端设备和电器设备的功能进行调整。
  10. 一种情景感知控制方法，其特征在于，包括：
    传感器模块采集环境信息并传输给信息处理模块；
    信息处理模块通过连接模块采集终端设备的使用信息、并与所述环境信息整合为功能情景信息；
    调整控制模块根据检测出的当前执行的功能，将所述功能情景信息与预存的较佳环境值进行比较，根据比较结果输出第一环境控制信号调整终端设备的功能，以及通过发射控制模块发射第二环境控制信号调整电器设备的工作状态。
  11. 根据权利要求10所述的情景感知控制方法，其特征在于，所述信息处理模块通过连接模块采集终端设备的使用信息、并与所述环境信息整合为功能情景信息的步骤具体包括：
    信息采集单元接收环境信息，采集终端设备的环境信息；
    将环境信息和使用信息与终端设备对应的功能联系、获得启用该项功能时的功能情景信息；
    信息存储单元对功能情景信息进行分类保存并实时更新。
  12. 根据权利要求10所述的情景感知控制方法，其特征在于，所述调整控制模块将所述功能情景信息与预存的较佳环境值进行比较，根据比较结果输出第一环境控制信号调整终端设备的工作状态，以及通过发射控制模块发射第二环境控制信号调整电器设备的工作状态的步骤具体包括：
    应用检测单元检测当前执行的功能，以及在系统后台的功能运行状态；
    命令比较单元根据检测出的当前执行的功能，调用功能情景信息中的相关信息项中采集的信息值和较佳环境值、并将所述信息值与较佳环境值进行比较；
    提取出信息值不在较佳环境值范围内的信息项和信息值，根据信息值与较佳环境值的差值输出第一环境控制信号和第二环境控制信号；
    发射控制模块发射第二环境控制信号来调整电器设备的工作状态，连接模块传输第一环境控制信号给终端设备来调整终端设备的工作状态。
PCT/CN2015/070776 2014-10-30 2015-01-15 一种情景感知控制装置、系统及方法 WO2016065745A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
AU2015306582A AU2015306582B2 (en) 2014-10-30 2015-01-15 Context awareness control device, system and method
US14/916,619 US10180671B2 (en) 2014-10-30 2015-01-15 Context awareness control device, system and method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410595616.8 2014-10-30
CN201410595616.8A CN104483851B (zh) 2014-10-30 2014-10-30 一种情景感知控制装置、系统及方法

Publications (1)

Publication Number Publication Date
WO2016065745A1 true WO2016065745A1 (zh) 2016-05-06

Family

ID=52758409

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/070776 WO2016065745A1 (zh) 2014-10-30 2015-01-15 一种情景感知控制装置、系统及方法

Country Status (4)

Country Link
US (1) US10180671B2 (zh)
CN (1) CN104483851B (zh)
AU (1) AU2015306582B2 (zh)
WO (1) WO2016065745A1 (zh)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3279751A4 (en) * 2015-04-03 2018-05-02 Lucis Technologies Holdings Limited Environmental control system
CN105045140B (zh) * 2015-05-26 2019-01-01 深圳创维－Rgb电子有限公司 智能控制受控设备的方法和装置
CN106358007B (zh) * 2015-07-14 2020-09-11 中兴通讯股份有限公司 视频会议护眼方法及装置
CN105072483A (zh) * 2015-08-28 2015-11-18 深圳创维－Rgb电子有限公司 基于智能电视视频场景的智能家居设备互动方法及系统
CN107025745A (zh) * 2016-01-29 2017-08-08 苏州三星电子有限公司 一种冰箱及智能家居系统
CN105867488A (zh) * 2016-04-20 2016-08-17 永春云河白番鸭保种繁育有限责任公司 一种白番鸭舍在线智能监测系统
CN105979181B (zh) * 2016-07-07 2019-04-09 青岛海信传媒网络技术有限公司 电视音量控制方法、装置及电视
CN107222786A (zh) * 2016-07-12 2017-09-29 壹世通Led有限公司 媒体控制方法和系统
CN106597864B (zh) * 2016-12-15 2021-09-14 北京国承万通信息科技有限公司 虚拟现实系统和智能家居系统
CN108652345A (zh) * 2017-03-28 2018-10-16 松下电气机器（北京）有限公司 镜子
CN107483998A (zh) * 2017-08-17 2017-12-15 深圳市启惠智能科技有限公司 终端控制方法及装置
WO2019033326A1 (zh) * 2017-08-17 2019-02-21 深圳市启惠智能科技有限公司 终端控制方法及装置
CN107632594B (zh) * 2017-11-06 2024-02-06 苏州科技大学 一种基于无线网络的电器集中控制系统和控制方法
CN111223174B (zh) * 2018-11-27 2023-10-24 冠捷视听科技(深圳)有限公司 一种环境渲染系统及渲染方法
CN109828734A (zh) * 2019-01-29 2019-05-31 深圳市海派通讯科技有限公司 智能终端显示屏幕控制方法、系统及存储介质
CN112147921B (zh) * 2019-06-28 2022-06-28 百度在线网络技术（北京）有限公司 机器人及其控制方法
CN110808045A (zh) * 2019-11-07 2020-02-18 深圳创维－Rgb电子有限公司 基于人工智能的检测方法、装置、设备及可读存储介质
CN113490056A (zh) * 2021-07-07 2021-10-08 武汉申子仟电子商务有限公司 一种基于移动端的短视频播放处理方法、系统及计算机存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1074352A2 (en) * 1999-08-04 2001-02-07 Yamaha Hatsudoki Kabushiki Kaisha User-machine interface system for enhanced interaction
JP2005236900A (ja) * 2004-02-23 2005-09-02 Canon Inc テレビ受信装置及び信号処理装置
CN101222394A (zh) * 2007-12-03 2008-07-16 南京大学 一种面向智能家庭环境的情景感知的服务应用层系统
CN101576748A (zh) * 2009-06-12 2009-11-11 深圳创维－Rgb电子有限公司 一种家庭智能控制系统
CN101782772A (zh) * 2010-03-22 2010-07-21 广东九联科技股份有限公司 机顶盒智能家庭系统

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NL8303253A (nl) * 1983-09-22 1985-04-16 Hollandse Signaalapparaten Bv Communicatie-ontvanginrichting ingericht voor het onderdrukken van ruis- en stoorsignalen.
US7006881B1 (en) * 1991-12-23 2006-02-28 Steven Hoffberg Media recording device with remote graphic user interface
TW293227B (zh) * 1994-11-24 1996-12-11 Victor Company Of Japan
US7026957B2 (en) * 2001-10-01 2006-04-11 Advanced Public Safety, Inc. Apparatus for communicating with a vehicle during remote vehicle operations, program product, and associated methods
US7539882B2 (en) * 2005-05-30 2009-05-26 Rambus Inc. Self-powered devices and methods
US7729204B2 (en) * 2007-06-08 2010-06-01 Microsoft Corporation Acoustic ranging
KR101341095B1 (ko) * 2007-08-23 2013-12-13 삼성전기주식회사 야경 환경에서 최적의 화질을 갖는 영상 획득 장치 및 방법
US9129291B2 (en) * 2008-09-22 2015-09-08 Personics Holdings, Llc Personalized sound management and method
KR100989079B1 (ko) * 2008-10-28 2010-10-25 한국전자통신연구원 오케스트라 미디어 서비스 시스템 및 방법
WO2010100735A1 (ja) * 2009-03-05 2010-09-10 キーパー＝スミス エル・エル・ピー 情報サービス提供システム、情報サービス提供装置およびその方法
CN201985991U (zh) * 2010-12-28 2011-09-21 上海华勤通讯技术有限公司 自动调节铃声音量和亮度的手机
CN102073504A (zh) * 2011-01-21 2011-05-25 深圳创维数字技术股份有限公司 一种多场景操作方法、系统及智能设备
CN102760077A (zh) * 2011-04-29 2012-10-31 广州三星通信技术研究有限公司 基于人脸识别自适应应用情景模式的方法和设备
US9171251B2 (en) * 2011-09-16 2015-10-27 Toyota Jidosha Kabushiki Kaisha Context-aware analysis and adaptation
CN102436246A (zh) * 2011-12-19 2012-05-02 厦门万安智能股份有限公司 具有环境适应情景模式的智能家居集控装置
US20140309872A1 (en) * 2013-04-15 2014-10-16 Flextronics Ap, Llc Customization of vehicle user interfaces based on user intelligence
US20150264439A1 (en) * 2012-10-28 2015-09-17 Hillcrest Laboratories, Inc. Context awareness for smart televisions
US9817524B1 (en) * 2012-12-12 2017-11-14 Amazon Technologies, Inc. Touch accuracy of an electronic device
US20140244001A1 (en) * 2013-02-25 2014-08-28 Qualcomm Incorporated Controlling many different devices from a smart controller
CN103345214B (zh) * 2013-06-17 2016-04-13 四川长虹电器股份有限公司 基于中间件的智能家电联动控制方法
CN103616876B (zh) * 2013-12-02 2016-06-08 万众科技有限公司 一种智能家居集控装置和智能家居情景模式的建立方法
US20150172878A1 (en) * 2013-12-12 2015-06-18 Aliphcom Acoustic environments and awareness user interfaces for media devices
US9716939B2 (en) * 2014-01-06 2017-07-25 Harman International Industries, Inc. System and method for user controllable auditory environment customization
US9921557B2 (en) * 2014-01-15 2018-03-20 SILVAIR Sp. z o.o. Automation system comprising a monitoring device and methods therefor
US9690361B2 (en) * 2014-12-24 2017-06-27 Intel Corporation Low-power context-aware control for analog frontend

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1074352A2 (en) * 1999-08-04 2001-02-07 Yamaha Hatsudoki Kabushiki Kaisha User-machine interface system for enhanced interaction
JP2005236900A (ja) * 2004-02-23 2005-09-02 Canon Inc テレビ受信装置及び信号処理装置
CN101222394A (zh) * 2007-12-03 2008-07-16 南京大学 一种面向智能家庭环境的情景感知的服务应用层系统
CN101576748A (zh) * 2009-06-12 2009-11-11 深圳创维－Rgb电子有限公司 一种家庭智能控制系统
CN101782772A (zh) * 2010-03-22 2010-07-21 广东九联科技股份有限公司 机顶盒智能家庭系统

Also Published As

Publication number Publication date
AU2015306582B2 (en) 2017-12-07
CN104483851B (zh) 2017-03-15
AU2015306582A1 (en) 2016-05-19
US20160299480A1 (en) 2016-10-13
CN104483851A (zh) 2015-04-01
US10180671B2 (en) 2019-01-15

Similar Documents

Publication Publication Date Title
WO2016065745A1 (zh) 一种情景感知控制装置、系统及方法
WO2020071712A1 (en) Method for controlling plurality of voice recognizing devices and electronic device supporting the same
WO2018043895A1 (ko) 디스플레이 장치 및 디스플레이 장치의 제어 방법
WO2012036475A2 (ko) 스마트폰을 이용한 디지털기기 제어 시스템
WO2016187964A1 (zh) 智能控制受控设备的方法和装置
WO2017074062A1 (en) Adapting user interface of display apparatus according to remote control device
WO2018199374A1 (ko) 오디오 장치 및 그 제어 방법
WO2019013447A1 (en) REMOTE CONTROL DEVICE AND METHOD FOR RECEIVING VOICE FROM AN ASSOCIATED USER
WO2016182361A1 (en) Gesture recognition method, computing device, and control device
WO2017191894A1 (en) Electronic device and controlling method thereof
WO2015194697A1 (en) Video display device and operating method thereof
WO2018043992A1 (en) Display apparatus and method for controlling of display apparatus
WO2020153766A1 (en) Method for displaying visual information associated with voice input and electronic device supporting the same
WO2019056814A1 (zh) 智能眼镜及其信息采集及传输方法、计算机可读存储介质
WO2019039707A1 (en) METHOD FOR CONFIGURING ACTION OF AN EXTERNAL DEVICE AND ELECTRONIC DEVICE SUPPORTING THE SAME
WO2015186857A1 (ko) 영상 표시 기기 및 그의 동작 방법
WO2020130301A1 (en) Electronic device for tracking user activity and method of operating the same
WO2018205534A1 (zh) 体感遥控器控制方法、智能终端及计算机可读存储介质
WO2019212144A1 (en) Electronic device and operating method thereof
WO2021125784A1 (ko) 전자장치 및 그 제어방법
WO2021010522A1 (ko) 시청 상황을 고려하여, 하나 이상의 가전 기기를 제어하는 디스플레이 장치
WO2024034696A1 (ko) 디스플레이 장치 및 그의 동작 방법
WO2020145536A1 (ko) Em 신호의 특징을 등록하여 외부 장치를 식별하는 방법 및 상기 방법을 적용한 전자 장치
WO2021060570A1 (ko) 가전 기기 및 서버
WO2021033785A1 (ko) 사용자의 음성을 통해 가전 기기를 제어할 수 있는 디스플레이 장치 및 인공 지능 서버

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 2015306582

Country of ref document: AU

WWE Wipo information: entry into national phase

Ref document number: 14916619

Country of ref document: US

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15855050

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 22/09/2017)

122 Ep: pct application non-entry in european phase

Ref document number: 15855050

Country of ref document: EP

Kind code of ref document: A1