WO2021042985A1 - Internet of things control apparatus and method, and electronic device - Google Patents

Internet of things control apparatus and method, and electronic device Download PDF

Info

Publication number
WO2021042985A1
WO2021042985A1 PCT/CN2020/109847 CN2020109847W WO2021042985A1 WO 2021042985 A1 WO2021042985 A1 WO 2021042985A1 CN 2020109847 W CN2020109847 W CN 2020109847W WO 2021042985 A1 WO2021042985 A1 WO 2021042985A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
behavior
internet
thermal image
things control
Prior art date
Application number
PCT/CN2020/109847
Other languages
French (fr)
Chinese (zh)
Inventor
江小夏
刘芬
Original Assignee
北京海益同展信息科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京海益同展信息科技有限公司 filed Critical 北京海益同展信息科技有限公司
Publication of WO2021042985A1 publication Critical patent/WO2021042985A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H04L67/125Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network

Definitions

  • the present disclosure relates to the field of network control technology, and in particular to an Internet of Things control device, an Internet of Things control method, and electronic equipment.
  • the control device for the Internet of Things in the prior art has confusion in the management of smart devices, and may cause people's privacy to be leaked.
  • an IoT control device includes:
  • a behavior sensing module for collecting behavior information, the behavior information including thermal images, distance information, and sound information;
  • a service terminal connected to the behavior sensing module, receives the behavior information and performs a summary analysis to obtain an operation instruction
  • the control platform is connected to the smart device and the service terminal at the same time, and is used to receive the operation instruction and control the smart device according to the operation instruction.
  • the service terminal includes:
  • a receiving module connected to the behavior sensing module, for receiving the behavior information
  • a judging module connected to the receiving module, for judging whether the thermal image is a human thermal image and judging whether the distance information is within a preset range, and obtaining a judgment result;
  • the analysis module is connected to the judgment module and analyzes the behavior information according to the judgment result and issues operation instructions.
  • the analyzing the behavior information and issuing an operation instruction according to the judgment result includes;
  • the analysis module analyzes the thermal image to obtain a coherent human body movement, and sends out the operation in combination with the sound information instruction.
  • the behavior sensing module includes:
  • An infrared sensor for collecting the distance information, where the distance information is the distance between the thermal object and the infrared sensor
  • the crack sensor is used to collect the sound information.
  • the IoT control device further includes:
  • the wireless communication component is used to satisfy the wireless interaction of information between the behavior sensing module, the service terminal, the control platform, and the smart device.
  • control platform is connected to a plurality of the smart devices, and the operation and shutdown of the smart devices are controlled according to the operation instruction.
  • an Internet of Things control method including:
  • the behavior information including thermal images, distance information, and sound information
  • the smart device is controlled according to the operation instruction.
  • performing a summary analysis on the behavior information to generate an operation instruction including:
  • the thermal image and the sound information are analyzed and operation instructions are issued.
  • analyzing the behavior information and issuing operation instructions according to the judgment result includes:
  • the thermal image is a thermal image of a human body, and the distance information is within a preset range, the thermal image is analyzed to obtain a coherent human body motion, and the operation instruction is issued in combination with the sound information.
  • behavior information is collected, and the behavior information includes thermal images, distance information, and sound information; including:
  • the distance information is the distance between the thermally sensitive object and the infrared sensor
  • a crack sensor is used to collect the sound information.
  • the Internet of Things control method further includes:
  • Wireless communication components are used to complete the wireless interaction of information among behavior sensing modules, service terminals, control platforms, and smart devices.
  • an electronic device including:
  • the memory is used to store one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors realize the things described in any one of the above Networking control method.
  • Figure 1 is a schematic diagram of the structure of the Internet of Things control device of the present disclosure
  • Figure 2 is a structural block diagram of the Internet of Things control device of the present disclosure
  • Fig. 3 is a flowchart of the Internet of Things control method of the present disclosure
  • FIG. 4 is a schematic diagram showing the location distribution of behavior sensing modules, service terminals, and smart devices in an embodiment
  • Fig. 5 schematically shows a structural diagram of a computer system suitable for implementing an electronic device of an exemplary embodiment of the present disclosure.
  • Behavior sensing module 11. Infrared sensor; 12. Thermal sensor; 13. Crack sensor; 14. First communication component; 15. Power supply component;
  • Service terminal 21. Receiving module; 22. Judgment module; 23. Analysis module;
  • Control platform 31. The second communication component;
  • the Internet of Things control device uses a camera to collect human body image information, and uses voice recognition to complete the collection of human behavior information.
  • the camera and voice recognition may cause people’s privacy to be leaked.
  • people Unintentionally triggering the control device at a far position may result in a certain loss due to insufficient control accuracy of the control device.
  • the control of the smart device 4 is confusing, and unified control is not performed.
  • the Internet of Things control device may include a behavior sensing module 1, a service terminal 2, and a control platform 3.
  • the behavior sensing module 1 is used to collect behavior information,
  • the behavior information includes thermal images, distance information, and sound information;
  • the service terminal 2 is connected to the behavior sensing module 1, and is used to receive the behavior information and perform a summary analysis to obtain operation instructions;
  • the control platform 3 is connected to the smart device 4 and the service terminal 2 at the same time, It is used to receive operation instructions and control the smart device 4 according to the operation instructions.
  • the present disclosure uses the information collected by the behavior sensing module 1 as thermal images, distance information, and sound information.
  • the use of thermal images not only ensures the integrity of information collection, but also solves the problem of privacy leakage.
  • the control platform 3 uniformly controls multiple smart devices 4, which solves the problem of confusion in the control of smart devices 4 in related technologies.
  • the present disclosure collects distance information.
  • the distance information can be used to determine whether it is necessary to analyze other collected behavior information and issue instructions, which increases the accuracy of control and avoids The loss is caused by the miscontrol of the smart device 4.
  • the behavior sensing module 1 of the present disclosure is used to collect behavior information.
  • human body behavior information is mainly collected, but not limited to human body behavior information; the behavior information may include thermal images, distance information, and sound information.
  • the behavior sensing module 1 may include a thermal sensor 12, an infrared sensor 11, and a crack sensor 13.
  • the thermal sensor 12 is used to collect thermal images
  • the infrared sensor 11 is used to collect distance information
  • the crack sensor 13 is used.
  • the signal collection end of the behavior sensing module can be set in a honeycomb shape, that is, it includes a plurality of regular hexagonal hole-shaped structures, which can collect sound information more accurately.
  • human body imaging is realized by the temperature difference between human body heat and the surrounding environment.
  • a thermal sensor 12 is used to obtain thermal images.
  • the thermal sensor 12 can collect and compare the heat of the human body and the heat of the surrounding environment of the human body. According to the comparison result, a thermal image of the human body is formed. While image collection is realized, privacy is not exposed.
  • the distance information is obtained by combining the speed of light with the time difference between the emission and reception of light, and the infrared sensor 11 can be used to collect the distance information, and the distance information collected by the infrared sensor 11 is used to determine the human body. Whether it is within the preset range of the behavior sensing module 1 can avoid the loss caused by the misrecognition of the thermal sensor 12.
  • the sound information needs to be collected in this solution, it is not suitable to use the ultrasonic distance measurement method, but it is not limited to the above-mentioned infrared sensor 11 to collect distance information. It can also be other sensors capable of measuring distances, such as laser sensors.
  • the vibration generated by the user's behavior is collected and the vibration is analyzed to obtain sound information.
  • a crack sensor 13 is used to collect sound information.
  • the crack sensor 13 is a kind of vibration response based on nanotechnology. Extremely sensitive sensing equipment can obtain tiny sound information through vibration. The sound produced when a person moves is difficult to be recognized by the microphone, because the noise in the daily environment will cover the sound of the movement, but the crack sensor 13 can Various sounds are effectively distinguished and accurately identified; the crack sensor 13 is used to collect sound information, which increases the control accuracy of the Internet of Things control device.
  • the behavior sensing module 1 of the present disclosure further includes a first communication component 14 and a power supply component 15.
  • the power supply component 15 is used to supply power to the behavior sensing module 1.
  • the power supply component 15 can be a rechargeable battery or directly through an external power supply. Powering the behavior sensing module 1 can support the DC interface and the POE interface, which can meet the power supply of more environments and has a wide range of applications.
  • the first communication module can support wireless network transmission and Ethernet network transmission, and is used to transmit behavior information to the service terminal 2.
  • the service terminal 2 will be described in detail below.
  • the service terminal 2 is connected to the behavior sensing module 1, receives the behavior information and performs a summary analysis to obtain an operation instruction.
  • the service terminal 2 may include a receiving module 21, a judgment module 22 and an analysis module 23.
  • the receiving module 21 is connected to the aforementioned behavior sensing module 1 for receiving behavior information, and the receiving module 21 can receive information transmitted via a wireless network or Ethernet. It is compatible with the above-mentioned first communication component 14.
  • the judging module 22 is connected to the receiving module 21, and is used to judge whether the thermal image is a thermal image of a human body and whether the distance information is within a preset range, and obtain the judgment result. If the judgment result is that the thermal image is a human thermal image, and the result is If the distance information is within a preset range, the analysis module 23 analyzes the behavior information and issues an operation instruction. Otherwise, the analysis module 23 does not analyze the behavior information, that is, it does not issue operation instructions.
  • the range of the above distance information is the same room, for example, the person is in the first room, and the behavior sensor module 1 is in the second room, if the behavior sensor module 1 in the second room senses the thermal image and sound
  • the service terminal 2 since the long-distance information exceeds the preset range, the service terminal 2 will not issue a control command.
  • the analysis module 23 analyzes the thermal image to obtain a coherent human body motion, that is, records the human body motion like a video through the thermal image. According to the sound information collected by the crack sensor 13, an operation instruction is generated and issued. At the same time, since the human body image may overlap in the thermal image, at this time, it is impossible to recognize the human body movement by relying on the thermal image for detailed recognition. At this time, it is necessary to combine the sound information of the crack sensor 13 to distinguish, so that the Internet of Things The control precision of the control device is higher.
  • the thermal sensor 12 and the crack sensor 13 are synchronized for identification.
  • the thermal image collected by the thermal sensor 12 shows a suspect action
  • the crack sensor 13 The sound generated by the wave motion in the air is judged. Because the human body structure and intention of the wave motion are different, the sound band generated is very different from the similar motions of applauding and cheering in the sound amplitude. This difference is based on tradition. The video distinction is difficult to identify, and after the crack sensor 13 is added, the accuracy can be improved by double-checking the action behavior of sound, vibration, and floating.
  • the sound propagation speed and frequency change can be used to judge the distance. For example, when a person moves, the audio of the same voiceprint will be enlarged or reduced according to the distance, and the direction of the person’s displacement can be judged by the continuous change of the sound.
  • a smart device 4 it is sufficient to mark the previous positional relationship between the behavior sensing module 1 and the smart device 4 in the background, and there is no need for a very precise location distance, as long as the direction and pattern are marked.
  • the analysis module 23 of the service terminal 2 obtains and issues operating instructions according to the above judgment results and behavior information, and the control platform performs unified control of multiple smart devices 4.
  • the operation instructions need to be preset in advance and cannot be repeated.
  • the service terminal 2 further includes a storage module for storing operating instructions preset in advance.
  • the analysis module 23 directly calls operation instructions from the storage module after analyzing the behavior information and controls the smart device 4.
  • the control platform may be an IOT platform, and may include a second communication component 31 for receiving operation instructions and sending specific implementation signals to the smart device 4.
  • the service terminal 2 may be connected to multiple smart devices 4 through a wireless network to uniformly communicate with the smart device 4 Take control.
  • the smart device 4 may be a TV, an air conditioner, a lamp, etc., and the type of the smart device 4 is not limited in this solution.
  • each room has a corresponding smart device 4, here are smart home appliances, such as TVs, refrigerators, washing machines, etc.; users may be active in any room, so you need to A behavior sensing module 1 is installed in a room.
  • the service terminal 2 can be provided with multiple intermediate positions of the behavior sensing module 1. In this example embodiment, it can be set in the restaurant C or the living room B.
  • the information transmission between the behavior sensing module 1 and the service terminal 2 is Wireless transmission, therefore, the service terminal 2 can be equipped with multiple behavior sensing modules 1 in the middle position, which can prevent the problem of incomplete behavior information transmission caused by too far distance.
  • the service terminal 2 When the service terminal 2 analyzes the behavior information, it first judges whether the thermal image is a human body image, and then judges whether the distance information is within the preset range according to the room where the behavior sensing module 1 is located and the distance information collected by the behavior sensing module 1 ,
  • the preset range here may be the room where the above-mentioned behavior sensing module 1 is located.
  • the behavior sensing module 1 in the first bedroom A1 collects behavior information, and the service terminal 2 first judges the thermal image.
  • the thermal image is a human body image, it further determines whether the person is in the first bedroom A1 with distance information.
  • the service terminal 2 will issue operation instructions based on the continuous actions and sound information formed by the thermal image.
  • the user in the first bedroom A1 can also use actions to control the smart device 4 in other rooms, but the priority of control is from near to far.
  • the priority of control is from near to far.
  • the control is preferentially performed according to the actions of the user in the second bedroom A2.
  • a user in the third bedroom A3 intends to turn on the TV set in the third bedroom A3, and he only needs to tap his hands gently, but If you want to control to turn on the TV in the first bedroom A1, you need to slap your hands heavier in the direction of the first bedroom A1. You can control smart devices 4 in different directions and different rooms through the direction and the size of the sound information.
  • the present disclosure also provides a method for controlling the Internet of Things. As shown in FIG. 3, the method for controlling the Internet of Things may include the following steps:
  • Step S110 Collect behavior information, where the behavior information includes thermal images, distance information, and sound information.
  • Step S120 Collect and analyze the behavior information to obtain an operation instruction.
  • Step S130 controlling the smart device according to the operation instruction.
  • step S110 behavior information is collected, and the behavior information includes thermal images, distance information, and sound information.
  • human body imaging is realized by the temperature difference between human body heat and the surrounding environment, and the thermal sensor 12 may be used to collect thermal images; while image collection is realized, privacy is not exposed.
  • the distance information collected by the infrared sensor 11 is used to determine whether the human body is within the preset range of the sexual behavior sensing module 1, which can avoid the loss caused by the misrecognition of the thermal sensor 12.
  • the infrared sensor 11 can be used to collect distance information, and the distance between the thermal object and the infrared sensor 11 can be determined according to the time difference between the light emitted by the infrared sensor 11 and the light received and the speed of the light to complete the collection of distance information;
  • the distance information collected by 11 is used to determine whether the human body is within the preset range of the behavior sensing module 1, which can avoid the loss caused by the misrecognition of the thermal sensor 12.
  • the crack sensor 13 may be used to collect the sound information, and the crack sensor 13 obtains the sound information by analyzing the vibration generated by the user's behavior.
  • the crack sensor 13 is a sensor device based on nanotechnology that is extremely sensitive to vibration. It can obtain tiny sound information through vibration. The sound generated when a person moves is difficult to be recognized by the microphone because of the daily environment. Noise can cover up the sound of the action, but the crack sensor 13 can effectively distinguish various sounds and accurately identify them; the crack sensor 13 is used to collect sound information, which increases the control accuracy of the Internet of Things control device.
  • step S120 a summary analysis is performed on the behavior information to obtain an operation instruction.
  • step S130 the smart device is controlled according to the operation instruction.
  • the range of the above distance information is the same room, for example, the person is in the first room, and the behavior sensor module 1 is in the second room, if the behavior sensor module 1 in the second room senses the thermal image and sound
  • the service terminal 2 will not issue an operation instruction, or issue an operation instruction but the control platform ignores the operation instruction.
  • the thermal image is a human body thermal image
  • the distance information is within the preset range
  • the thermal image is analyzed to obtain a coherent human body motion, that is, the human body motion is recorded like a video through the thermal image, and according to the crack
  • the sound information collected by the sensor 13 generates and sends out operation instructions.
  • the thermal image When judging the thermal image, first compare the obtained thermal image with the human body information, such as the temperature and shape to judge. At the same time, because the human body image may overlap in the thermal image, at this time, only rely on Thermal images cannot recognize human movements for detailed recognition. At this time, it is necessary to combine sound information to distinguish, so that the control accuracy of the Internet of Things control device is higher.
  • the human body information such as the temperature and shape
  • the thermal sensor 12 and the crack sensor 13 are synchronized for identification.
  • the thermal image collected by the thermal sensor 12 shows a suspect action
  • the crack sensor 13 The sound generated by the wave motion in the air is judged. Because the human body structure and intention used for the wave motion are different, the sound band generated is very different from the similar motions of applauding and cheering in the sound amplitude. This difference is based on tradition. The video distinction is difficult to identify, and after the crack sensor 13 is added, the accuracy can be improved by double-checking the action behavior of sound, vibration, and floating.
  • the sound propagation speed and frequency change can be used to judge the distance. For example, when a person moves, the audio of the same voiceprint will be enlarged or reduced according to the distance, and the direction of the person’s displacement can be judged by the continuous change of the sound.
  • a smart device 4 it is sufficient to mark the previous positional relationship between the behavior sensing module 1 and the smart device 4 in the background, and there is no need for a very precise location distance, as long as the direction and pattern are marked.
  • an operation instruction is generated and issued, and the control platform 3 can control multiple smart devices 4 in a unified manner.
  • the operation instructions need to be preset in advance and cannot be repeated.
  • the service terminal 2 further includes a storage module for storing operating instructions preset in advance.
  • a control platform can be used to control the smart device 4 according to the operating instructions.
  • the control platform can be an IOT platform and can include a second communication component 31 for receiving operating instructions and sending specific implementation signals to the smart device 4.
  • the service terminal 2 It can be connected to multiple immature devices through a wireless network to control the smart device 4 in a unified manner.
  • the smart device 4 may be a TV, an air conditioner, a lamp, etc., and the type of the smart device 4 is not limited in this solution.
  • an electronic device capable of implementing the above-mentioned Internet of Things control method.
  • the electronic device 1900 according to such an embodiment of the present disclosure will be described below with reference to FIG. 5.
  • the electronic device 1900 shown in FIG. 5 is only an example, and should not bring any limitation to the function and scope of use of the embodiments of the present disclosure.
  • the electronic device 1900 is represented in the form of a general-purpose computing device.
  • the components of the electronic device 1900 may include, but are not limited to: the aforementioned at least one processing unit 1910, the aforementioned at least one storage unit 1920, a bus 1930 connecting different system components (including the storage unit 1920 and the processing unit 1910), and a display unit 1940.
  • the storage unit stores program code, and the program code can be executed by the processing unit 1910, so that the processing unit 1910 executes the various exemplary methods described in the "Exemplary Method" section of this specification.
  • the processing unit 1910 may perform step S110 as shown in FIG. 2: collect behavior information, where the behavior information includes thermal images, distance information, and sound information; S120: summarize and analyze the behavior information to obtain operation instructions S130: Control the smart device according to the operation instruction.
  • the storage unit 1920 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 1921 and/or a cache storage unit 1922, and may further include a read-only storage unit (ROM) 1923.
  • RAM random access storage unit
  • ROM read-only storage unit
  • the storage unit 1920 may also include a program/utility tool 1924 having a set of (at least one) program module 1925.
  • program module 1925 includes but is not limited to: an operating system, one or more application programs, other program modules, and program data, Each of these examples or some combination may include the implementation of a network environment.
  • the bus 1930 may represent one or more of several types of bus structures, including a storage unit bus or a storage unit controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local area using any bus structure among multiple bus structures. bus.
  • the electronic device 1900 may also communicate with one or more external devices 1970 (such as keyboards, pointing devices, Bluetooth devices, etc.), and may also communicate with one or more devices that enable a user to interact with the electronic device 1900, and/or communicate with Any device (eg, router, modem, etc.) that enables the electronic device 1900 to communicate with one or more other computing devices. This communication can be done through the input/output (I/O) interface 1950.
  • the electronic device 1900 may also communicate with one or more networks (for example, a local area network (LAN), a wide area network (WAN), and/or a public network, such as the Internet) through the network adapter 1960. As shown in the figure, the network adapter 1960 communicates with other modules of the electronic device 1900 through the bus 1930.
  • LAN local area network
  • WAN wide area network
  • public network such as the Internet
  • the exemplary embodiments described here can be implemented by software, or can be implemented by combining software with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, U disk, mobile hard disk, etc.) or on the network , Including several instructions to make a computing device (which may be a personal computer, a server, a terminal device, or a network device, etc.) execute the method according to the embodiment of the present disclosure.
  • a computing device which may be a personal computer, a server, a terminal device, or a network device, etc.
  • the terms “a”, “an”, “the”, “said” and “at least one” are used to indicate that there are one or more elements/components/etc.; the terms “including”, “including” and “Have” is used to mean open-ended inclusion and means that in addition to the listed elements/components/etc., there may be other elements/components/etc.; the terms “first” and “second “And so on are only used as markers, not as a limit to the number of objects.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Telephonic Communication Services (AREA)
  • Selective Calling Equipment (AREA)

Abstract

The present disclosure relates to the field of network control technology. Provided are an Internet of things control apparatus, an Internet of things control method and an electronic device. The Internet of things control apparatus may comprise a behavior sensing module, a service terminal and a control platform; the behavior sensing module is used for acquiring behavior information, the behavior information comprising a thermal image, distance information and sound information; the service terminal is connected to the behavior sensing module, receives the behavior information, performs summation analysis and then obtains an operation instruction; and the control platform is connected to both a smart device and the service terminal, and is used for receiving the operation instruction and controlling the smart device according to the operation instruction. In the present disclosure, the information acquired by using the behavior sensing module comprises a thermal image, distance information and sound information, solving the problem of privacy leakage.

Description

物联网控制装置和方法、电子设备Internet of things control device and method, electronic equipment
交叉引用cross reference
本公开要求于2019年9月6日提交的申请号为201910843012.3名称为“物联网控制装置和方法、电子设备”的中国专利申请的优先权,该中国专利申请的全部内容通过引用全部并入本文。This disclosure claims the priority of the Chinese patent application filed on September 6, 2019 with the application number 201910843012.3 entitled "Internet of Things control device and method, electronic equipment", and the entire content of the Chinese patent application is incorporated herein by reference. .
技术领域Technical field
本公开涉及网络控制技术领域,尤其涉及一种物联网控制装置、物联网控制方法和电子设备。The present disclosure relates to the field of network control technology, and in particular to an Internet of Things control device, an Internet of Things control method, and electronic equipment.
背景技术Background technique
随着各种家用电器的智能化以及物联网的普及,家庭物联网控制装置的应用也越来越广泛。With the intelligentization of various household appliances and the popularization of the Internet of Things, the application of home Internet of Things control devices has become more and more extensive.
现有技术中的物联网控制装置存在对智能设备的管理混乱,且有可能使得人们的隐私泄露。The control device for the Internet of Things in the prior art has confusion in the management of smart devices, and may cause people's privacy to be leaked.
因此,有必要设计一种新的物联网控制装置、物联网控制方法和电子设备。Therefore, it is necessary to design a new Internet of Things control device, Internet of Things control method and electronic equipment.
所述背景技术部分公开的上述信息仅用于加强对本公开的背景的理解,因此它可以包括不构成对本领域普通技术人员已知的现有技术的信息。The above-mentioned information disclosed in the background section is only used to enhance the understanding of the background of the present disclosure, and therefore it may include information that does not constitute the prior art known to those of ordinary skill in the art.
发明内容Summary of the invention
根据本公开的一个方面,一种物联网控制装置,包括:According to one aspect of the present disclosure, an IoT control device includes:
行为感应模块,用于采集行为信息,所述行为信息包括热图像、距离信息以及声音信息;A behavior sensing module for collecting behavior information, the behavior information including thermal images, distance information, and sound information;
服务终端,连接于所述行为感应模块,接收所述行为信息并进行汇总分析后得到操作指令;A service terminal, connected to the behavior sensing module, receives the behavior information and performs a summary analysis to obtain an operation instruction;
控制平台,同时与智能设备以及所述服务终端连接,用于接收所述操作指令并依据所述操作指令对所述智能设备进行控制。The control platform is connected to the smart device and the service terminal at the same time, and is used to receive the operation instruction and control the smart device according to the operation instruction.
在本公开的一种示例性实施例中,所述服务终端包括:In an exemplary embodiment of the present disclosure, the service terminal includes:
接收模块,连接于所述行为感应模块,用于接收所述行为信息;A receiving module, connected to the behavior sensing module, for receiving the behavior information;
判断模块,连接于所述接收模块,用于判断所述热图像是否为人体热图像以及判断所述距离信息是否在预设范围内,得到判断结果;A judging module, connected to the receiving module, for judging whether the thermal image is a human thermal image and judging whether the distance information is within a preset range, and obtaining a judgment result;
分析模块,连接于所述判断模块,根据所述判断结果分析所述行为信息并发出操作指令。The analysis module is connected to the judgment module and analyzes the behavior information according to the judgment result and issues operation instructions.
在本公开的一种示例性实施例中,所述根据所述判断结果分析所述行为信息并发出操作指令,包括;In an exemplary embodiment of the present disclosure, the analyzing the behavior information and issuing an operation instruction according to the judgment result includes;
若所述判断结果为热图像为人体热图像,且所述距离信息在预设范围内,则所述分析模块分析所述热图像得到连贯的人体动作,并结合所述声音信息发出所述操作指令。If the judgment result is that the thermal image is a human body thermal image, and the distance information is within a preset range, the analysis module analyzes the thermal image to obtain a coherent human body movement, and sends out the operation in combination with the sound information instruction.
在本公开的一种示例性实施例中,所述行为感应模块包括:In an exemplary embodiment of the present disclosure, the behavior sensing module includes:
热感传感器,用于采集所述热图像;A thermal sensor for collecting the thermal image;
红外传感器,用于采集所述距离信息,所述距离信息为热感物体就所述红外传感器之间的距离;An infrared sensor for collecting the distance information, where the distance information is the distance between the thermal object and the infrared sensor;
裂缝传感器,用于采集所述声音信息。The crack sensor is used to collect the sound information.
在本公开的一种示例性实施例中,所述物联网控制装置还包括:In an exemplary embodiment of the present disclosure, the IoT control device further includes:
无线通讯组件,用于满足行为感应模块、服务终端、控制平台以及智能设备之间的信息的无线交互。The wireless communication component is used to satisfy the wireless interaction of information between the behavior sensing module, the service terminal, the control platform, and the smart device.
在本公开的一种示例性实施例中,所述控制平台与多个所述智能设备连接,根据所述操作指令控制所述智能设备的运行与关闭。In an exemplary embodiment of the present disclosure, the control platform is connected to a plurality of the smart devices, and the operation and shutdown of the smart devices are controlled according to the operation instruction.
根据本公开的一个方面,提供一种物联网控制方法,包括:According to an aspect of the present disclosure, there is provided an Internet of Things control method, including:
采集行为信息,所述行为信息包括热图像、距离信息以及声音信息;Collecting behavior information, the behavior information including thermal images, distance information, and sound information;
对所述行为信息进行汇总分析产生操作指令;Collecting and analyzing the behavior information to generate operation instructions;
根据所述操作指令对智能设备进行控制。The smart device is controlled according to the operation instruction.
在本公开的一种示例性实施例中,对所述行为信息进行汇总分析产生操作指令;包括:In an exemplary embodiment of the present disclosure, performing a summary analysis on the behavior information to generate an operation instruction; including:
判断所述热图像是否为人体热图像,判断所述距离信息是否在预设范围内,得到判断结果;Judging whether the thermal image is a human body thermal image, judging whether the distance information is within a preset range, and obtaining a judgment result;
根据所述判断结果分析所述热图像以及所述声音信息并发出操作指令。According to the judgment result, the thermal image and the sound information are analyzed and operation instructions are issued.
在本公开的一种示例性实施例中,根据所述判断结果分析所述行为信息并发出操作指令,包括:In an exemplary embodiment of the present disclosure, analyzing the behavior information and issuing operation instructions according to the judgment result includes:
若所述判断结果为热图像为人体热图像,且所述距离信息在预设范围内,则分析所述热图像得到连贯的人体动作,并结合所述声音信息发出所述操作指令。If the judgment result is that the thermal image is a thermal image of a human body, and the distance information is within a preset range, the thermal image is analyzed to obtain a coherent human body motion, and the operation instruction is issued in combination with the sound information.
在本公开的一种示例性实施例中,采集行为信息,所述行为信息包括热图像、距离信息以及声音信息;包括:In an exemplary embodiment of the present disclosure, behavior information is collected, and the behavior information includes thermal images, distance information, and sound information; including:
采用热感传感器采集热图像;Use thermal sensors to collect thermal images;
采用红外传感器采集距离信息,所述距离信息为热感物体就所述红外传感器之间的距离;Using an infrared sensor to collect distance information, where the distance information is the distance between the thermally sensitive object and the infrared sensor;
采用裂缝传感器采集所述声音信息。A crack sensor is used to collect the sound information.
在本公开的一种示例性实施例中,所述物联网控制方法还包括:In an exemplary embodiment of the present disclosure, the Internet of Things control method further includes:
采用无线通讯组件来完成行为感应模块、服务终端、控制平台以及智能设备之间的信息的无线交互。Wireless communication components are used to complete the wireless interaction of information among behavior sensing modules, service terminals, control platforms, and smart devices.
根据本公开的一个方面,提供一种电子设备,包括:According to an aspect of the present disclosure, there is provided an electronic device, including:
处理器;以及Processor; and
存储器,用于存储一个或多个程序,当所述一个或多个程序被所述一个或多个处理器执行时,使得所述一个或多个处理器实现如上述任意一项所述的物联网控制方法。The memory is used to store one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors realize the things described in any one of the above Networking control method.
附图说明Description of the drawings
此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本公开的实施例,并与说明书一起用于解释本公开的原理。显而易见地,下面描述中的附图仅仅是本公开的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。在附图中:The drawings herein are incorporated into the specification and constitute a part of the specification, show embodiments in accordance with the disclosure, and together with the specification are used to explain the principle of the disclosure. Obviously, the drawings in the following description are only some embodiments of the present disclosure. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work. In the attached picture:
图1是本公开物联网控制装置的结构示意图;Figure 1 is a schematic diagram of the structure of the Internet of Things control device of the present disclosure;
图2是本公开物联网控制装置的结构框图;Figure 2 is a structural block diagram of the Internet of Things control device of the present disclosure;
图3是本公开物联网控制方法的流程图;Fig. 3 is a flowchart of the Internet of Things control method of the present disclosure;
图4是一种是实施例中行为感应模块、服务终端以及智能设备的位置分布示意图;FIG. 4 is a schematic diagram showing the location distribution of behavior sensing modules, service terminals, and smart devices in an embodiment;
图5示意性示出了适于用来实现本公开示例性实施例的电子设备的计算机系统的结构示意图。Fig. 5 schematically shows a structural diagram of a computer system suitable for implementing an electronic device of an exemplary embodiment of the present disclosure.
附图标记说明如下:The reference signs are explained as follows:
1、行为感应模块;11、红外传感器;12、热感传感器;13、裂缝传感器;14、第一通讯组件;15、电源组件;1. Behavior sensing module; 11. Infrared sensor; 12. Thermal sensor; 13. Crack sensor; 14. First communication component; 15. Power supply component;
2、服务终端;21、接收模块;22、判断模块;23、分析模块;2. Service terminal; 21. Receiving module; 22. Judgment module; 23. Analysis module;
3、控制平台;31、第二通讯组件;3. Control platform; 31. The second communication component;
4、智能设备;4. Smart equipment;
A1、第一卧室;A2、第二卧室;A3、第三卧室;A4、第四卧室;B、客厅;C、餐厅;D、厨房;E1、第一浴室;E2、第二浴室。A1, first bedroom; A2, second bedroom; A3, third bedroom; A4, fourth bedroom; B, living room; C, dining room; D, kitchen; E1, first bathroom; E2, second bathroom.
具体实施方式detailed description
现在将参考附图更全面地描述示例实施方式。然而,示例实施方式能够以多种形式实施,且不应被理解为限于在此阐述的实施方式;相反,提供这些实施方式使得本公开将全面和完整,并将示例实施方式的构思全面地传达给本领域的技术人员。图中相同的附图标记表示相同或类似的结构,因而将省略它们的详细描述。Example embodiments will now be described more fully with reference to the accompanying drawings. However, the example embodiments can be implemented in various forms, and should not be construed as being limited to the embodiments set forth herein; on the contrary, these embodiments are provided so that the present disclosure will be comprehensive and complete, and fully convey the concept of the example embodiments To those skilled in the art. The same reference numerals in the figures indicate the same or similar structures, and thus their detailed descriptions will be omitted.
相关技术中物联网控制装置采用摄像头采集人体图像信息,以及采用语音识别功能来完成对人体行为信息的采集,一方面,摄像头以及语音识别有可能会造成人们隐私的泄露,另一方面,如果人在较远的位置非本意的触发了控制装置,可能会导致因为控制装置的控制精度不足从而造成一定的损失。再一方面,相关技术中,对于智能设备4的控制较为混乱,没有进行统一控制。In related technologies, the Internet of Things control device uses a camera to collect human body image information, and uses voice recognition to complete the collection of human behavior information. On the one hand, the camera and voice recognition may cause people’s privacy to be leaked. On the other hand, if people Unintentionally triggering the control device at a far position may result in a certain loss due to insufficient control accuracy of the control device. On the other hand, in the related art, the control of the smart device 4 is confusing, and unified control is not performed.
基于上述缺点,本公开首先一种物联网控制装置,参照图1所示,该物联网控制装置可以包括行为感应模块1、服务终端2以及控制平台3;行为感应模块1用于采集行为信息,行为信息包括热图像、距离信息以及声音信息;服务终端2连接于行为感应模块1,用于接收行为信息并进行汇总分析后得到操作指令;控制平台3同时与智能设备4以及服务终端2连接,用于接收操作指令并依据操作指令对智能设备4进行控制。Based on the above shortcomings, the present disclosure first provides an Internet of Things control device. As shown in FIG. 1, the Internet of Things control device may include a behavior sensing module 1, a service terminal 2, and a control platform 3. The behavior sensing module 1 is used to collect behavior information, The behavior information includes thermal images, distance information, and sound information; the service terminal 2 is connected to the behavior sensing module 1, and is used to receive the behavior information and perform a summary analysis to obtain operation instructions; the control platform 3 is connected to the smart device 4 and the service terminal 2 at the same time, It is used to receive operation instructions and control the smart device 4 according to the operation instructions.
相较于现有技术,一方面,本公开采用行为感应模块1采集到的信息为热图像和距离信息以及声音信息,采用热图像在保证信息采集的完整性的同时,解决了隐私泄露的问题,另一方面,本公开由控制平台3统一对多台智能设备4进行控制,解决了相关技术中对智能设备4控制混乱的问题。Compared with the prior art, on the one hand, the present disclosure uses the information collected by the behavior sensing module 1 as thermal images, distance information, and sound information. The use of thermal images not only ensures the integrity of information collection, but also solves the problem of privacy leakage. On the other hand, in the present disclosure, the control platform 3 uniformly controls multiple smart devices 4, which solves the problem of confusion in the control of smart devices 4 in related technologies.
进一步的,本公开采集了距离信息,在后续的对行为信息的处理过程中,能够通过距离信息来确定是否需要对采集到的其他行为信息进行分析并发出指令,增加了控制的 精确性,避免了由于对智能设备4的误控而造成损失。Further, the present disclosure collects distance information. In the subsequent processing of behavior information, the distance information can be used to determine whether it is necessary to analyze other collected behavior information and issue instructions, which increases the accuracy of control and avoids The loss is caused by the miscontrol of the smart device 4.
本公开行为感应模块1用于采集行为信息,在本方案中主要采集人体行为信息,但不局限于人体行为信息;行为信息可以包括热图像、距离信息以及声音信息。The behavior sensing module 1 of the present disclosure is used to collect behavior information. In this solution, human body behavior information is mainly collected, but not limited to human body behavior information; the behavior information may include thermal images, distance information, and sound information.
其中,参照图2所示,行为感应模块1可以包括热感传感器12、红外传感器11以及裂缝传感器13,热感传感器12用于采集热图像,红外传感器11用于采集距离信息,裂缝传感器13用于采集声音信息。行为感应模块的信号采集端可以设置为蜂巢形状,即包括多个正六边形孔状结构,能够对声音信息的采集更加精确。Wherein, referring to FIG. 2, the behavior sensing module 1 may include a thermal sensor 12, an infrared sensor 11, and a crack sensor 13. The thermal sensor 12 is used to collect thermal images, the infrared sensor 11 is used to collect distance information, and the crack sensor 13 is used. To collect sound information. The signal collection end of the behavior sensing module can be set in a honeycomb shape, that is, it includes a plurality of regular hexagonal hole-shaped structures, which can collect sound information more accurately.
在本示例实施方式中,通过人体热量与周围环境的温度差实现人体成像,例如采用热感传感器12来获取热图像,热感传感器12能够采集人体的热量以及人体周边环境的热量并进行对比,并根据对比结果来形成人体热图像,在实现了图像采集的同时,不会暴露隐私。In this exemplary embodiment, human body imaging is realized by the temperature difference between human body heat and the surrounding environment. For example, a thermal sensor 12 is used to obtain thermal images. The thermal sensor 12 can collect and compare the heat of the human body and the heat of the surrounding environment of the human body. According to the comparison result, a thermal image of the human body is formed. While image collection is realized, privacy is not exposed.
在本示例实施方式中,通过光的发射与接收以及发射与接收之间的时间差,结合光速来获取距离信息,可以采用红外传感器11来采集距离信息,红外传感器11采集的距离信息用来确定人体是否处于行为感应模块1的预设范围内,能够避免由于热感传感器12的误识导致的损失。In this exemplary embodiment, the distance information is obtained by combining the speed of light with the time difference between the emission and reception of light, and the infrared sensor 11 can be used to collect the distance information, and the distance information collected by the infrared sensor 11 is used to determine the human body. Whether it is within the preset range of the behavior sensing module 1 can avoid the loss caused by the misrecognition of the thermal sensor 12.
需要说明的是,由于本方案中需要采集声音信息,所以不宜使用超声波测距的方式,但是,也不局限于上述红外传感器11来采集距离信息。也可以是其他能够测量距离的传感器,例如激光传感器。It should be noted that, since the sound information needs to be collected in this solution, it is not suitable to use the ultrasonic distance measurement method, but it is not limited to the above-mentioned infrared sensor 11 to collect distance information. It can also be other sensors capable of measuring distances, such as laser sensors.
在本示例实施方式中,通过采集用户行为动作产生的振动,并对该振动进行分析来获取声音信息,例如,采用裂缝传感器13来采集声音信息,裂缝传感器13是基于纳米技术的一种对震动极其敏感的传感设备,可以通过震动获得微小的声音信息,当人发生动作时所产生的声音是很难被麦克风识别的,因为日常环境中的杂音会掩盖动作的声音,但是裂缝传感器13可以有效地区分各种声音,并且准确的识别;采用裂缝传感器13来采集声音信息,增加了物联网控制装置的控制精度。In this exemplary embodiment, the vibration generated by the user's behavior is collected and the vibration is analyzed to obtain sound information. For example, a crack sensor 13 is used to collect sound information. The crack sensor 13 is a kind of vibration response based on nanotechnology. Extremely sensitive sensing equipment can obtain tiny sound information through vibration. The sound produced when a person moves is difficult to be recognized by the microphone, because the noise in the daily environment will cover the sound of the movement, but the crack sensor 13 can Various sounds are effectively distinguished and accurately identified; the crack sensor 13 is used to collect sound information, which increases the control accuracy of the Internet of Things control device.
本公开行为感应模块1还包括第一通讯组件14以及电源组件15,电源组件15用于给行为感应模块1供电,电源组件15可以是可重复充电的蓄电池,也可以是直接通过外接电源来实现对行为感应模块1供电,可以支持DC接口和POE接口,能够满足较多环境的电源供给,适用范围较广。The behavior sensing module 1 of the present disclosure further includes a first communication component 14 and a power supply component 15. The power supply component 15 is used to supply power to the behavior sensing module 1. The power supply component 15 can be a rechargeable battery or directly through an external power supply. Powering the behavior sensing module 1 can support the DC interface and the POE interface, which can meet the power supply of more environments and has a wide range of applications.
第一通讯模能够支持无线网路传输和以太网网络传输,用于将行为信息传输至服务终端2。The first communication module can support wireless network transmission and Ethernet network transmission, and is used to transmit behavior information to the service terminal 2.
下面对服务终端2进行详细说明。The service terminal 2 will be described in detail below.
服务终端2连接于所述行为感应模块1,接收所述行为信息并进行汇总分析后得到操作指令,服务终端2可以包括接收模块21、判断模块22以及分析模块23。The service terminal 2 is connected to the behavior sensing module 1, receives the behavior information and performs a summary analysis to obtain an operation instruction. The service terminal 2 may include a receiving module 21, a judgment module 22 and an analysis module 23.
接收模块21连接于上述行为感应模块1,用于接收行为信息,接收模块21能够接收通过无线网络或者以太网传输的信息。与上述第一通讯组件14相适配。The receiving module 21 is connected to the aforementioned behavior sensing module 1 for receiving behavior information, and the receiving module 21 can receive information transmitted via a wireless network or Ethernet. It is compatible with the above-mentioned first communication component 14.
判断模块22连接于上述接收模块21,用于判断热图像是否为人体热图像以及判断所述距离信息是否在预设范围内,得到判断结果,如果判断结果为热图像为人体热图像,且所述距离信息在预设范围内,则所述分析模块23对所述行为信息进行分析并发出操作指令。否则分析模块23不对行为信息进行分析,即不会发出操作指令。例如,上述距离信息的范围为同一个房间,例如人在第一个房间,而行为感应模块1在第二个房间,如果在第二个房间内的行为感应模块1感测到了热图像以及声音信息,但是由于远距离信息超过了预设范围,则服务终端2是不会发出控制指令的。The judging module 22 is connected to the receiving module 21, and is used to judge whether the thermal image is a thermal image of a human body and whether the distance information is within a preset range, and obtain the judgment result. If the judgment result is that the thermal image is a human thermal image, and the result is If the distance information is within a preset range, the analysis module 23 analyzes the behavior information and issues an operation instruction. Otherwise, the analysis module 23 does not analyze the behavior information, that is, it does not issue operation instructions. For example, the range of the above distance information is the same room, for example, the person is in the first room, and the behavior sensor module 1 is in the second room, if the behavior sensor module 1 in the second room senses the thermal image and sound However, since the long-distance information exceeds the preset range, the service terminal 2 will not issue a control command.
在上述判断结果为热图像为人体热图像,且所述距离信息在预设范围内时,分析模块23分析热图像得到连贯的人体动作,即通过热图像的方式像视频一样记录人体的动作,并根据裂缝传感器13采集的声音信息生成操作指令并发出。同时,由于在热图像可能会出现人体图像重叠的情况,此时,仅依靠热图像是无法识别人体动作进行详细识别的,此时需要同时结合裂缝传感器13的声音信息来进行分辨,使得物联网控制装置的控制精度更高。When the above judgment result is that the thermal image is a human body thermal image, and the distance information is within the preset range, the analysis module 23 analyzes the thermal image to obtain a coherent human body motion, that is, records the human body motion like a video through the thermal image. According to the sound information collected by the crack sensor 13, an operation instruction is generated and issued. At the same time, since the human body image may overlap in the thermal image, at this time, it is impossible to recognize the human body movement by relying on the thermal image for detailed recognition. At this time, it is necessary to combine the sound information of the crack sensor 13 to distinguish, so that the Internet of Things The control precision of the control device is higher.
例如,当使用者在看电视时可以通过挥手进行换台的操作,热感传感器12与裂缝传感器13是同步进行识别,当热感传感器12采集的热图像出现疑似动作时,通过裂缝传感器13对挥手动作在空中产生的声音进行判定,由于人的挥手动作动用的人体结构和意图不同,因此产生的声音波段与鼓掌和欢呼时的类似动作在声音振幅上有很大区别,这种区别基于传统的视频区分是很难识别出来的,而加入裂缝传感器13后可以通过声音震动浮动双重校验动作行为提高精准度。For example, when the user is watching TV, the user can wave his hand to change the channel, the thermal sensor 12 and the crack sensor 13 are synchronized for identification. When the thermal image collected by the thermal sensor 12 shows a suspect action, the crack sensor 13 The sound generated by the wave motion in the air is judged. Because the human body structure and intention of the wave motion are different, the sound band generated is very different from the similar motions of applauding and cheering in the sound amplitude. This difference is based on tradition. The video distinction is difficult to identify, and after the crack sensor 13 is added, the accuracy can be improved by double-checking the action behavior of sound, vibration, and floating.
同时,可以用过声音的传播速度和频率变化判断距离远近,例如当人移动时同一个声纹的音频会根据距离放大或缩小,通过声音的持续变化判断人的位移方向,当环境中出现多个智能设备4时只要将行为感应模块1与智能设备4之前的位置关系在后台标出即可,并且无需非常精准的位置距离,只要标注方向和格局即可。At the same time, the sound propagation speed and frequency change can be used to judge the distance. For example, when a person moves, the audio of the same voiceprint will be enlarged or reduced according to the distance, and the direction of the person’s displacement can be judged by the continuous change of the sound. In the case of a smart device 4, it is sufficient to mark the previous positional relationship between the behavior sensing module 1 and the smart device 4 in the background, and there is no need for a very precise location distance, as long as the direction and pattern are marked.
服务终端2的分析模块23根据上述判断结果以及行为信息得到操作指令并发出,由控制平台对多个智能设备4进行统一控制。The analysis module 23 of the service terminal 2 obtains and issues operating instructions according to the above judgment results and behavior information, and the control platform performs unified control of multiple smart devices 4.
在另一种示例实施方式中,由于不同的设备可能会在不同的空间出现,所以操作指令需要提前预设并不能够重复。基于需要提前预设操作指令,所以服务终端2还包括存储模块,用于存储提前预设好的操作指令。分析模块23对行为信息进行分析后直接从存储模块中调用操作指令并对智能设备4进行控制。In another exemplary embodiment, since different devices may appear in different spaces, the operation instructions need to be preset in advance and cannot be repeated. Based on the need to preset operating instructions in advance, the service terminal 2 further includes a storage module for storing operating instructions preset in advance. The analysis module 23 directly calls operation instructions from the storage module after analyzing the behavior information and controls the smart device 4.
控制平台可以是IOT平台,可以包括第二通讯组件31,用于接收操作指令并向智能设备4发出具体实施信号,服务终端2可以通过无线网络与多个智能设备4连接,统一对智能设备4进行控制。The control platform may be an IOT platform, and may include a second communication component 31 for receiving operation instructions and sending specific implementation signals to the smart device 4. The service terminal 2 may be connected to multiple smart devices 4 through a wireless network to uniformly communicate with the smart device 4 Take control.
智能设备4可以是电视、空调、灯等,在本方案中不对智能设备4的种类进行限定。The smart device 4 may be a TV, an air conditioner, a lamp, etc., and the type of the smart device 4 is not limited in this solution.
下面通过一具体的实施方式来对本公开物联网控制装置进行详细说明:The following is a detailed description of the IoT control device of the present disclosure through a specific implementation:
参照图4所示,具有多个房间,四个卧室,分别为第一卧室A1,第二卧室A2、第三卧室A3以及第四卧室A4,还具有客厅B、餐厅B、厨房D、第一浴室E1第二浴室E2等,每个房间内均具有相应的智能设备4,此处为智能家电,例如电视机、冰箱、洗衣机等;用户可能会在任何一个房间内活动,因此,需要在每一个房间内均设置有行为感应模块1。服务终端2可以设置多个行为感应模块1中间位置,在本示例实施方式中,可以设置在餐厅C或客厅B,本实施方式中行为感应模块1与服务终端2之间的信息传输采用的是无线传输,因此将服务终端2可以设置多个行为感应模块1中间位置能够防止由于距离太远而导致的行为信息传输不完全的问题。Referring to Figure 4, there are multiple rooms and four bedrooms, namely the first bedroom A1, the second bedroom A2, the third bedroom A3, and the fourth bedroom A4. It also has a living room B, a dining room B, a kitchen D, and a first bedroom. Bathroom E1, bathroom E2, etc., each room has a corresponding smart device 4, here are smart home appliances, such as TVs, refrigerators, washing machines, etc.; users may be active in any room, so you need to A behavior sensing module 1 is installed in a room. The service terminal 2 can be provided with multiple intermediate positions of the behavior sensing module 1. In this example embodiment, it can be set in the restaurant C or the living room B. In this embodiment, the information transmission between the behavior sensing module 1 and the service terminal 2 is Wireless transmission, therefore, the service terminal 2 can be equipped with multiple behavior sensing modules 1 in the middle position, which can prevent the problem of incomplete behavior information transmission caused by too far distance.
服务终端2对行为信息进行分析时,首先判断热图像是否为人体图像,然后,根据行为感应模块1所在房间以及该行为感应模块1采集的距离信息进行判断,判断距离信息是否在预设范围内,此处的预设范围可以是上述行为感应模块1所在房间。When the service terminal 2 analyzes the behavior information, it first judges whether the thermal image is a human body image, and then judges whether the distance information is within the preset range according to the room where the behavior sensing module 1 is located and the distance information collected by the behavior sensing module 1 , The preset range here may be the room where the above-mentioned behavior sensing module 1 is located.
具体而言,在第一卧室A1的行为感应模块1采集行为信息,服务终端2首先对热图形进行判断,在热图像为人体图像的情况下,更具距离信息判断人是否在第一卧室A1内,若热图像为人体图像且用户在第一卧室A1内,则服务终端2根据热图像所构成的连贯的动作以及声音信息发出操作指令。Specifically, the behavior sensing module 1 in the first bedroom A1 collects behavior information, and the service terminal 2 first judges the thermal image. When the thermal image is a human body image, it further determines whether the person is in the first bedroom A1 with distance information. Inside, if the thermal image is a human body image and the user is in the first bedroom A1, the service terminal 2 will issue operation instructions based on the continuous actions and sound information formed by the thermal image.
在第一卧室A1的用户也能够采用动作控制其他房间的智能设备4,但是控制的优先级是由近到远的,例如,在第一卧室A1内有用户需要控制第二卧室A2的智能设备4的同时,第二卧室A2内也有用户在尝试控制第二卧室A2内的智能设备4,此时,优先根据第二卧室A2内的用户的动作来进行控制。The user in the first bedroom A1 can also use actions to control the smart device 4 in other rooms, but the priority of control is from near to far. For example, in the first bedroom A1, there is a user who needs to control the smart device in the second bedroom A2 At the same time as 4, a user in the second bedroom A2 is also trying to control the smart device 4 in the second bedroom A2. At this time, the control is preferentially performed according to the actions of the user in the second bedroom A2.
当对不同房间的智能设备4进行控制时,可以采用不同的动作来进行,例如,在第三卧室A3的用户意图打开第三卧室A3的电视机,则只需要轻轻拍打双手即可,但是 如想要控制打开第一卧室A1内的电视机,则需要朝向第一卧室A1的方向较重的拍打双手。可以通过方向以及声音信息的分呗大小来控制不同方位以及不同房间的智能设备4。When controlling smart devices 4 in different rooms, different actions can be used. For example, a user in the third bedroom A3 intends to turn on the TV set in the third bedroom A3, and he only needs to tap his hands gently, but If you want to control to turn on the TV in the first bedroom A1, you need to slap your hands heavier in the direction of the first bedroom A1. You can control smart devices 4 in different directions and different rooms through the direction and the size of the sound information.
进一步的本公开还提供一种物联网控制方法,参照图3所示,该物联网控制方法可以包括一下步骤:Further, the present disclosure also provides a method for controlling the Internet of Things. As shown in FIG. 3, the method for controlling the Internet of Things may include the following steps:
步骤S110,采集行为信息,所述行为信息包括热图像、距离信息以及声音信息。Step S110: Collect behavior information, where the behavior information includes thermal images, distance information, and sound information.
步骤S120,对所述行为信息进行汇总分析得到操作指令。Step S120: Collect and analyze the behavior information to obtain an operation instruction.
步骤S130,根据所述操作指令对智能设备进行控制。Step S130, controlling the smart device according to the operation instruction.
下面对上述步骤进行详细说明。The above steps are described in detail below.
在步骤S110中,采集行为信息,所述行为信息包括热图像、距离信息以及声音信息。In step S110, behavior information is collected, and the behavior information includes thermal images, distance information, and sound information.
在本示例实施方式中,参照图2所示,通过人体热量与周围环境的温度差实现人体成像,可以采用热感传感器12采集热图像;在实现了图像采集的同时,不会暴露隐私。红外传感器11采集的距离信息用来确定人体是否处于性行为感应模块1的预设范围内,能够避免由于热感传感器12的误识导致的损失。In this exemplary embodiment, referring to FIG. 2, human body imaging is realized by the temperature difference between human body heat and the surrounding environment, and the thermal sensor 12 may be used to collect thermal images; while image collection is realized, privacy is not exposed. The distance information collected by the infrared sensor 11 is used to determine whether the human body is within the preset range of the sexual behavior sensing module 1, which can avoid the loss caused by the misrecognition of the thermal sensor 12.
可以采用红外传感器11采集距离信息,根据红外传感器11发出光线与接收光线之间的时间差以及光的速度来确定热感物体距离所述红外传感器11之间的距离,完成距离信息的采集;红外传感器11采集的距离信息用来确定人体是否处于行为感应模块1的预设范围内,能够避免由于热感传感器12的误识导致的损失。The infrared sensor 11 can be used to collect distance information, and the distance between the thermal object and the infrared sensor 11 can be determined according to the time difference between the light emitted by the infrared sensor 11 and the light received and the speed of the light to complete the collection of distance information; The distance information collected by 11 is used to determine whether the human body is within the preset range of the behavior sensing module 1, which can avoid the loss caused by the misrecognition of the thermal sensor 12.
可以采用裂缝传感器13采集所述声音信息,裂缝传感器13通过用户行为动作产生的振动,并对该振动进行分析来获取声音信息。裂缝传感器13是基于纳米技术的一种对震动极其敏感的传感设备,可以通过震动获得微小的声音信息,当人发生动作时所产生的声音是很难被麦克风识别的,因为日常环境中的杂音会掩盖动作的声音,但是裂缝传感器13可以有效地区分各种声音,并且准确的识别;采用裂缝传感器13来采集声音信息,增加了物联网控制装置的控制精度。The crack sensor 13 may be used to collect the sound information, and the crack sensor 13 obtains the sound information by analyzing the vibration generated by the user's behavior. The crack sensor 13 is a sensor device based on nanotechnology that is extremely sensitive to vibration. It can obtain tiny sound information through vibration. The sound generated when a person moves is difficult to be recognized by the microphone because of the daily environment. Noise can cover up the sound of the action, but the crack sensor 13 can effectively distinguish various sounds and accurately identify them; the crack sensor 13 is used to collect sound information, which increases the control accuracy of the Internet of Things control device.
在步骤S120中,对所述行为信息进行汇总分析得到操作指令。In step S120, a summary analysis is performed on the behavior information to obtain an operation instruction.
在步骤S130,根据所述操作指令对智能设备进行控制。In step S130, the smart device is controlled according to the operation instruction.
首先,判断所述热图像是否为人体热图像,判断所述距离信息是否在预设范围内,得到判断结果;根据所述判断结果分析所述行为信息并发出操作指令。如果判断结果为热图像为人体热图像,且所述距离信息在预设范围内,发出操作指令。否则不对行为信 息进行分析,即不会发出操作指令。例如,上述距离信息的范围为同一个房间,例如人在第一个房间,而行为感应模块1在第二个房间,如果在第二个房间内的行为感应模块1感测到了热图像以及声音信息,但是由于远距离信息超过了预设范围,则服务终端2是不会发出操作指令的,或者发出操作指令但控制平台忽略该操作指令。First, determine whether the thermal image is a human thermal image, determine whether the distance information is within a preset range, and obtain a judgment result; analyze the behavior information according to the judgment result and issue an operation instruction. If the judgment result is that the thermal image is a human body thermal image, and the distance information is within a preset range, an operation instruction is issued. Otherwise, the behavior information will not be analyzed, that is, no operation instructions will be issued. For example, the range of the above distance information is the same room, for example, the person is in the first room, and the behavior sensor module 1 is in the second room, if the behavior sensor module 1 in the second room senses the thermal image and sound However, because the remote information exceeds the preset range, the service terminal 2 will not issue an operation instruction, or issue an operation instruction but the control platform ignores the operation instruction.
在上述判断结果为热图像为人体热图像,且所述距离信息在预设范围内时,分析热图像得到连贯的人体动作,即通过热图像的方式像视频一样记录人体的动作,并根据裂缝传感器13采集的声音信息生成操作指令并发出。When the above judgment result is that the thermal image is a human body thermal image, and the distance information is within the preset range, the thermal image is analyzed to obtain a coherent human body motion, that is, the human body motion is recorded like a video through the thermal image, and according to the crack The sound information collected by the sensor 13 generates and sends out operation instructions.
在对热图像进行判断时,首先将得到的热图像与人体信息相比对,例如从温度以及形状来进行判断,同时,由于在热图像可能会出现人体图像重叠的情况,此时,仅依靠热图像是无法识别人体动作进行详细识别的,此时需要同时结合声音信息来进行分辨,使得物联网控制装置的控制精度更高。When judging the thermal image, first compare the obtained thermal image with the human body information, such as the temperature and shape to judge. At the same time, because the human body image may overlap in the thermal image, at this time, only rely on Thermal images cannot recognize human movements for detailed recognition. At this time, it is necessary to combine sound information to distinguish, so that the control accuracy of the Internet of Things control device is higher.
例如,当使用者在看电视时可以通过挥手进行换台的操作,热感传感器12与裂缝传感器13是同步进行识别,当热感传感器12采集的热图像出现疑似动作时,通过裂缝传感器13对挥手动作在空中产生的声音进行判定,由于人的挥手动作动用的人体结构和意图不同,因此产生的声音波段与鼓掌和欢呼时的类似动作在声音振幅上有很大区别,这种区别基于传统的视频区分是很难识别出来的,而加入裂缝传感器13后可以通过声音震动浮动双重校验动作行为提高精准度。For example, when the user is watching TV, the user can wave his hand to change the channel, the thermal sensor 12 and the crack sensor 13 are synchronized for identification. When the thermal image collected by the thermal sensor 12 shows a suspect action, the crack sensor 13 The sound generated by the wave motion in the air is judged. Because the human body structure and intention used for the wave motion are different, the sound band generated is very different from the similar motions of applauding and cheering in the sound amplitude. This difference is based on tradition. The video distinction is difficult to identify, and after the crack sensor 13 is added, the accuracy can be improved by double-checking the action behavior of sound, vibration, and floating.
同时,可以用过声音的传播速度和频率变化判断距离远近,例如当人移动时同一个声纹的音频会根据距离放大或缩小,通过声音的持续变化判断人的位移方向,当环境中出现多个智能设备4时只要将行为感应模块1与智能设备4之前的位置关系在后台标出即可,并且无需非常精准的位置距离,只要标注方向和格局即可。At the same time, the sound propagation speed and frequency change can be used to judge the distance. For example, when a person moves, the audio of the same voiceprint will be enlarged or reduced according to the distance, and the direction of the person’s displacement can be judged by the continuous change of the sound. In the case of a smart device 4, it is sufficient to mark the previous positional relationship between the behavior sensing module 1 and the smart device 4 in the background, and there is no need for a very precise location distance, as long as the direction and pattern are marked.
根据上述判断结果以及行为信息生成操作指令并发出,可以由控制平台3对多个智能设备4进行统一控制。According to the above-mentioned judgment result and behavior information, an operation instruction is generated and issued, and the control platform 3 can control multiple smart devices 4 in a unified manner.
在一种示例实施方式中,由于不同的设备可能会在不同的空间出现,所以操作指令需要提前预设并不能够重复。基于需要提前预设操作指令,所以服务终端2还包括存储模块,用于存储提前预设好的操作指令。In an exemplary embodiment, since different devices may appear in different spaces, the operation instructions need to be preset in advance and cannot be repeated. Based on the need to preset operating instructions in advance, the service terminal 2 further includes a storage module for storing operating instructions preset in advance.
可以采用控制平台来根据所述操作指令对智能设备4进行控制,控制平台可以是IOT平台,可以包括第二通讯组件31,用于接收操作指令并想智能设备4发出具体实施信号,服务终端2可以通过无线网络与多个稚嫩该设备连接,统一对智能设备4进行控制。A control platform can be used to control the smart device 4 according to the operating instructions. The control platform can be an IOT platform and can include a second communication component 31 for receiving operating instructions and sending specific implementation signals to the smart device 4. The service terminal 2 It can be connected to multiple immature devices through a wireless network to control the smart device 4 in a unified manner.
智能设备4可以是电视、空调、灯等,在本方案中不对智能设备4的种类进行限定。The smart device 4 may be a TV, an air conditioner, a lamp, etc., and the type of the smart device 4 is not limited in this solution.
此外,在本公开的示例性实施例中,还提供了一种能够实现上述物联网控制方法的电子设备。In addition, in an exemplary embodiment of the present disclosure, there is also provided an electronic device capable of implementing the above-mentioned Internet of Things control method.
所属技术领域的技术人员能够理解,本公开的各个方面可以实现为系统、方法或程序产品。因此,本公开的各个方面可以具体实现为以下形式,即:完全的硬件实施例、完全的软件实施例(包括固件、微代码等),或硬件和软件方面结合的实施例,这里可以统称为“电路”、“模块”或“系统”。Those skilled in the art can understand that various aspects of the present disclosure can be implemented as a system, a method, or a program product. Therefore, various aspects of the present disclosure can be specifically implemented in the following forms, namely: a complete hardware embodiment, a complete software embodiment (including firmware, microcode, etc.), or a combination of hardware and software embodiments, which may be collectively referred to herein as "Circuit", "Module" or "System".
下面参照图5来描述根据本公开的这种实施例的电子设备1900。图5显示的电子设备1900仅仅是一个示例,不应对本公开实施例的功能和使用范围带来任何限制。The electronic device 1900 according to such an embodiment of the present disclosure will be described below with reference to FIG. 5. The electronic device 1900 shown in FIG. 5 is only an example, and should not bring any limitation to the function and scope of use of the embodiments of the present disclosure.
如图5所示,电子设备1900以通用计算设备的形式表现。电子设备1900的组件可以包括但不限于:上述至少一个处理单元1910、上述至少一个存储单元1920、连接不同系统组件(包括存储单元1920和处理单元1910)的总线1930、显示单元1940。As shown in FIG. 5, the electronic device 1900 is represented in the form of a general-purpose computing device. The components of the electronic device 1900 may include, but are not limited to: the aforementioned at least one processing unit 1910, the aforementioned at least one storage unit 1920, a bus 1930 connecting different system components (including the storage unit 1920 and the processing unit 1910), and a display unit 1940.
其中,所述存储单元存储有程序代码,所述程序代码可以被所述处理单元1910执行,使得所述处理单元1910执行本说明书上述“示例性方法”部分中描述的根据本公开各种示例性实施例的步骤。例如,所述处理单元1910可以执行如图2中所示的步骤S110:采集行为信息,所述行为信息包括热图像、距离信息以及声音信息;S120:对所述行为信息进行汇总分析得到操作指令;S130:根据所述操作指令对智能设备进行控制。Wherein, the storage unit stores program code, and the program code can be executed by the processing unit 1910, so that the processing unit 1910 executes the various exemplary methods described in the "Exemplary Method" section of this specification. Example steps. For example, the processing unit 1910 may perform step S110 as shown in FIG. 2: collect behavior information, where the behavior information includes thermal images, distance information, and sound information; S120: summarize and analyze the behavior information to obtain operation instructions S130: Control the smart device according to the operation instruction.
存储单元1920可以包括易失性存储单元形式的可读介质,例如随机存取存储单元(RAM)1921和/或高速缓存存储单元1922,还可以进一步包括只读存储单元(ROM)1923。The storage unit 1920 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 1921 and/or a cache storage unit 1922, and may further include a read-only storage unit (ROM) 1923.
存储单元1920还可以包括具有一组(至少一个)程序模块1925的程序/实用工具1924,这样的程序模块1925包括但不限于:操作系统、一个或者多个应用程序、其它程序模块以及程序数据,这些示例中的每一个或某种组合中可能包括网络环境的实现。The storage unit 1920 may also include a program/utility tool 1924 having a set of (at least one) program module 1925. Such program module 1925 includes but is not limited to: an operating system, one or more application programs, other program modules, and program data, Each of these examples or some combination may include the implementation of a network environment.
总线1930可以为表示几类总线结构中的一种或多种,包括存储单元总线或者存储单元控制器、外围总线、图形加速端口、处理单元或者使用多种总线结构中 的任意总线结构的局域总线。The bus 1930 may represent one or more of several types of bus structures, including a storage unit bus or a storage unit controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local area using any bus structure among multiple bus structures. bus.
电子设备1900也可以与一个或多个外部设备1970(例如键盘、指向设备、蓝牙设备等)通信,还可与一个或者多个使得用户能与该电子设备1900交互的设备通信,和/或与使得该电子设备1900能与一个或多个其它计算设备进行通信的任何设备(例如路由器、调制解调器等等)通信。这种通信可以通过输入/输出(I/O)接口1950进行。并且,电子设备1900还可以通过网络适配器1960与一个或者多个网络(例如局域网(LAN),广域网(WAN)和/或公共网络,例如因特网)通信。如图所示,网络适配器1960通过总线1930与电子设备1900的其它模块通信。应当明白,尽管图中未示出,可以结合电子设备1900使用其它硬件和/或软件模块,包括但不限于:微代码、设备驱动器、冗余处理单元、外部磁盘驱动阵列、RAID系统、磁带驱动器以及数据备份存储系统等。The electronic device 1900 may also communicate with one or more external devices 1970 (such as keyboards, pointing devices, Bluetooth devices, etc.), and may also communicate with one or more devices that enable a user to interact with the electronic device 1900, and/or communicate with Any device (eg, router, modem, etc.) that enables the electronic device 1900 to communicate with one or more other computing devices. This communication can be done through the input/output (I/O) interface 1950. In addition, the electronic device 1900 may also communicate with one or more networks (for example, a local area network (LAN), a wide area network (WAN), and/or a public network, such as the Internet) through the network adapter 1960. As shown in the figure, the network adapter 1960 communicates with other modules of the electronic device 1900 through the bus 1930. It should be understood that although not shown in the figure, other hardware and/or software modules can be used in conjunction with the electronic device 1900, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives And data backup storage system, etc.
通过以上的实施例的描述,本领域的技术人员易于理解,这里描述的示例实施例可以通过软件实现,也可以通过软件结合必要的硬件的方式来实现。因此,根据本公开实施例的技术方案可以以软件产品的形式体现出来,该软件产品可以存储在一个非易失性存储介质(可以是CD-ROM,U盘,移动硬盘等)中或网络上,包括若干指令以使得一台计算设备(可以是个人计算机、服务器、终端装置、或者网络设备等)执行根据本公开实施例的方法。Through the description of the above embodiments, those skilled in the art can easily understand that the exemplary embodiments described here can be implemented by software, or can be implemented by combining software with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, U disk, mobile hard disk, etc.) or on the network , Including several instructions to make a computing device (which may be a personal computer, a server, a terminal device, or a network device, etc.) execute the method according to the embodiment of the present disclosure.
此外,上述附图仅是根据本公开示例性实施例的方法所包括的处理的示意性说明,而不是限制目的。易于理解,上述附图所示的处理并不表明或限制这些处理的时间顺序。另外,也易于理解,这些处理可以是例如在多个模块中同步或异步执行的。In addition, the above-mentioned drawings are merely schematic illustrations of the processing included in the method according to the exemplary embodiments of the present disclosure, and are not intended for limitation. It is easy to understand that the processing shown in the above drawings does not indicate or limit the time sequence of these processings. In addition, it is easy to understand that these processes can be executed synchronously or asynchronously in multiple modules, for example.
上述所描述的特征、结构或特性可以以任何合适的方式结合在一个或更多实施方式中,如有可能,各实施例中所讨论的特征是可互换的。在上面的描述中,提供许多具体细节从而给出对本公开的实施方式的充分理解。然而,本领域技术人员将意识到,可以实践本公开的技术方案而没有所述特定细节中的一个或更多,或者可以采用其它的方法、组件、材料等。在其它情况下,不详细示出或描述公知结构、材料或者操作以避免模糊本公开的各方面。The features, structures, or characteristics described above can be combined in one or more embodiments in any suitable manner. If possible, the features discussed in each embodiment are interchangeable. In the above description, many specific details are provided to give a sufficient understanding of the embodiments of the present disclosure. However, those skilled in the art will realize that the technical solutions of the present disclosure can be practiced without one or more of the specific details, or other methods, components, materials, etc. can be used. In other cases, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring aspects of the present disclosure.
虽然本说明书中使用相对性的用语,例如“上”“下”来描述图标的一个组件对于另一组件的相对关系,但是这些术语用于本说明书中仅出于方便,例如根据附图 中所述的示例的方向。能理解的是,如果将图标的装置翻转使其上下颠倒,则所叙述在“上”的组件将会成为在“下”的组件。其他相对性的用语。当某结构在其它结构“上”时,有可能是指某结构一体形成于其它结构上,或指某结构“直接”设置在其它结构上,或指某结构通过另一结构“间接”设置在其它结构上。Although relative terms such as "up" and "down" are used in this specification to describe the relative relationship between one component of an icon and another component, these terms are used in this specification only for convenience, for example, according to the drawings. The direction of the example described. It can be understood that if the device of the icon is turned over and turned upside down, the component described as "upper" will become the "lower" component. Other relative terms. When a structure is “on” another structure, it may mean that a certain structure is integrally formed on other structures, or that a certain structure is “directly” installed on other structures, or that a certain structure is “indirectly” installed on other structures through another structure. On other structures.
本说明书中,用语“一个”、“一”、“该”、“所述”和“至少一个”用以表示存在一个或多个要素/组成部分/等;用语“包含”、“包括”和“具有”用以表示开放式的包括在内的意思并且是指除了列出的要素/组成部分/等之外还可存在另外的要素/组成部分/等;用语“第一”、“第二”等仅作为标记使用,不是对其对象的数量限制。In this specification, the terms "a", "an", "the", "said" and "at least one" are used to indicate that there are one or more elements/components/etc.; the terms "including", "including" and "Have" is used to mean open-ended inclusion and means that in addition to the listed elements/components/etc., there may be other elements/components/etc.; the terms “first” and “second "And so on are only used as markers, not as a limit to the number of objects.
本领域技术人员在考虑说明书及实践这里公开的公开后,将容易想到本公开的其他实施例。本公开旨在涵盖本公开的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本公开的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本公开的真正范围和精神由权利要求指出。Those skilled in the art will easily think of other embodiments of the present disclosure after considering the specification and practicing the disclosure disclosed herein. The present disclosure is intended to cover any variations, uses, or adaptive changes of the present disclosure. These variations, uses, or adaptive changes follow the general principles of the present disclosure and include common knowledge or conventional technical means in the technical field that are not disclosed in the present disclosure. . The description and the embodiments are only regarded as exemplary, and the true scope and spirit of the present disclosure are pointed out by the claims.
应当理解的是,本公开并不局限于上面已经描述并在附图中示出的精确结构,并且可以在不脱离其范围进行各种修改和改变。本公开的范围仅由所附的权利要求来限。It should be understood that the present disclosure is not limited to the precise structure that has been described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is limited only by the appended claims.

Claims (12)

  1. 一种物联网控制装置,其中,包括:An Internet of Things control device, which includes:
    行为感应模块,用于采集行为信息,所述行为信息包括热图像、距离信息以及声音信息;A behavior sensing module for collecting behavior information, the behavior information including thermal images, distance information, and sound information;
    服务终端,连接于所述行为感应模块,接收所述行为信息并进行汇总分析后得到操作指令;A service terminal, connected to the behavior sensing module, receives the behavior information and performs a summary analysis to obtain an operation instruction;
    控制平台,同时与智能设备以及所述服务终端连接,用于接收所述操作指令并依据所述操作指令对所述智能设备进行控制。The control platform is connected to the smart device and the service terminal at the same time, and is used to receive the operation instruction and control the smart device according to the operation instruction.
  2. 根据权利要求1所述的物联网控制装置,其中,所述服务终端包括:The Internet of Things control device according to claim 1, wherein the service terminal comprises:
    接收模块,连接于所述行为感应模块,用于接收所述行为信息;A receiving module, connected to the behavior sensing module, for receiving the behavior information;
    判断模块,连接于所述接收模块,用于判断所述热图像是否为人体热图像以及判断所述距离信息是否在预设范围内,得到判断结果;A judging module, connected to the receiving module, for judging whether the thermal image is a human thermal image and judging whether the distance information is within a preset range, and obtaining a judgment result;
    分析模块,连接于所述判断模块,根据所述判断结果分析所述行为信息并发出操作指令。The analysis module is connected to the judgment module and analyzes the behavior information according to the judgment result and issues operation instructions.
  3. 根据权利要求2所述的物联网控制装置,其中,所述根据所述判断结果分析所述行为信息并发出操作指令,包括;The Internet of Things control device according to claim 2, wherein said analyzing said behavior information and issuing operation instructions according to said judgment result comprises;
    若所述判断结果为热图像为人体热图像,且所述距离信息在预设范围内,则所述分析模块分析所述热图像得到连贯的人体动作,并结合所述声音信息发出所述操作指令。If the judgment result is that the thermal image is a human body thermal image, and the distance information is within a preset range, the analysis module analyzes the thermal image to obtain a coherent human body movement, and sends out the operation in combination with the sound information instruction.
  4. 根据权利要求1所述的物联网控制装置,其中,所述行为感应模块包括:The Internet of Things control device according to claim 1, wherein the behavior sensing module comprises:
    热感传感器,用于采集所述热图像;A thermal sensor for collecting the thermal image;
    红外传感器,用于采集所述距离信息,所述距离信息为热感物体就所述红外传感器之间的距离;An infrared sensor for collecting the distance information, where the distance information is the distance between the thermal object and the infrared sensor;
    裂缝传感器,用于采集所述声音信息。The crack sensor is used to collect the sound information.
  5. 根据权利要求1所述的物联网控制装置,其中,所述物联网控制装置还包括:The Internet of Things control device according to claim 1, wherein the Internet of Things control device further comprises:
    无线通讯组件,用于满足行为感应模块、服务终端、控制平台以及智能设备之间的信息的无线交互。The wireless communication component is used to satisfy the wireless interaction of information between the behavior sensing module, the service terminal, the control platform, and the smart device.
  6. 根据权利要求1~5任一项所述的物联网控制装置,其中,所述控制平台与多个所述智能设备连接,根据所述操作指令控制所述智能设备的运行与关闭。The Internet of Things control device according to any one of claims 1 to 5, wherein the control platform is connected to a plurality of the smart devices, and controls the operation and shutdown of the smart devices according to the operation instructions.
  7. 一种物联网控制方法,其中,包括:An Internet of Things control method, which includes:
    采集行为信息,所述行为信息包括热图像、距离信息以及声音信息;Collecting behavior information, the behavior information including thermal images, distance information, and sound information;
    对所述行为信息进行汇总分析产生操作指令;Collecting and analyzing the behavior information to generate operation instructions;
    根据所述操作指令对智能设备进行控制。The smart device is controlled according to the operation instruction.
  8. 根据权利要求7所述的物联网控制方法,其中,对所述行为信息进行汇总分析产生操作指令;包括:The Internet of Things control method according to claim 7, wherein the operation instruction is generated by a summary analysis of the behavior information; comprising:
    判断所述热图像是否为人体热图像,判断所述距离信息是否在预设范围内,得到判断结果;Judging whether the thermal image is a human body thermal image, judging whether the distance information is within a preset range, and obtaining a judgment result;
    根据所述判断结果分析所述热图像以及所述声音信息并发出操作指令。According to the judgment result, the thermal image and the sound information are analyzed and operation instructions are issued.
  9. 根据权利要求8所述的物联网控制方法,其中,根据所述判断结果分析所述行为信息并发出操作指令,包括:The Internet of Things control method according to claim 8, wherein analyzing the behavior information and issuing operation instructions according to the judgment result comprises:
    若所述判断结果为热图像为人体热图像,且所述距离信息在预设范围内,则分析所述热图像得到连贯的人体动作,并结合所述声音信息发出所述操作指令。If the judgment result is that the thermal image is a thermal image of a human body, and the distance information is within a preset range, the thermal image is analyzed to obtain a coherent human body motion, and the operation instruction is issued in combination with the sound information.
  10. 根据权利要求7所述的物联网控制方法,其中,采集行为信息,所述行为信息包括热图像、距离信息以及声音信息;包括:The Internet of Things control method according to claim 7, wherein collecting behavior information, the behavior information including thermal images, distance information, and sound information; including:
    采用热感传感器采集热图像;Use thermal sensors to collect thermal images;
    采用红外传感器采集距离信息,所述距离信息为热感物体就所述红外传感器之间的距离;Using an infrared sensor to collect distance information, where the distance information is the distance between the thermally sensitive object and the infrared sensor;
    采用裂缝传感器采集所述声音信息。A crack sensor is used to collect the sound information.
  11. 根据权利要求7~10任一项所述的物联网控制方法,其中,所述物联网控制方法还包括:The Internet of Things control method according to any one of claims 7 to 10, wherein the Internet of Things control method further comprises:
    采用无线通讯组件来完成行为感应模块、服务终端、控制平台以及智能设备之间的信息的无线交互。Wireless communication components are used to complete the wireless interaction of information among behavior sensing modules, service terminals, control platforms, and smart devices.
  12. 一种电子设备,其中,包括:An electronic device, which includes:
    处理器;以及Processor; and
    存储器,用于存储一个或多个程序,当所述一个或多个程序被所述一个或多个处理器执行时,使得所述一个或多个处理器实现如权利要求7至11中任一项所述的物联网控制方法。The memory is used to store one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors can implement any one of claims 7 to 11 The Internet of Things control method described in item.
PCT/CN2020/109847 2019-09-06 2020-08-18 Internet of things control apparatus and method, and electronic device WO2021042985A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910843012.3 2019-09-06
CN201910843012.3A CN110602197A (en) 2019-09-06 2019-09-06 Internet of things control device and method and electronic equipment

Publications (1)

Publication Number Publication Date
WO2021042985A1 true WO2021042985A1 (en) 2021-03-11

Family

ID=68858055

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/109847 WO2021042985A1 (en) 2019-09-06 2020-08-18 Internet of things control apparatus and method, and electronic device

Country Status (2)

Country Link
CN (1) CN110602197A (en)
WO (1) WO2021042985A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110602197A (en) * 2019-09-06 2019-12-20 北京海益同展信息科技有限公司 Internet of things control device and method and electronic equipment
CN113450785B (en) * 2020-03-09 2023-12-19 上海擎感智能科技有限公司 Implementation method, system, medium and cloud server for vehicle-mounted voice processing
CN116027693A (en) * 2021-10-25 2023-04-28 华为技术有限公司 Automatic control method based on human body perception, first electronic equipment and system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005311864A (en) * 2004-04-23 2005-11-04 Toshiba Corp Household appliances, adapter instrument, and household appliance system
CN104428601A (en) * 2013-05-17 2015-03-18 松下电器(美国)知识产权公司 Sensor mounting device
CN107490127A (en) * 2017-07-27 2017-12-19 广东美的制冷设备有限公司 Air conditioner air blowing control method, electronic equipment and computer-readable recording medium
CN109442683A (en) * 2018-10-31 2019-03-08 深圳市创维群欣安防科技股份有限公司 A kind of sound control method and system of operation of air conditioner
CN110602197A (en) * 2019-09-06 2019-12-20 北京海益同展信息科技有限公司 Internet of things control device and method and electronic equipment

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103152626A (en) * 2013-03-08 2013-06-12 苏州百纳思光学科技有限公司 Far infrared three-dimensional hand signal detecting device of intelligent television set
WO2018013564A1 (en) * 2016-07-12 2018-01-18 Bose Corporation Combining gesture and voice user interfaces
CN109991859B (en) * 2017-12-29 2022-08-23 青岛有屋科技有限公司 Gesture instruction control method and intelligent home control system
CN113791557A (en) * 2018-05-18 2021-12-14 创新先进技术有限公司 Control method and device of intelligent equipment
CN109613977A (en) * 2018-11-19 2019-04-12 常志强 Intelligent controlling device and method based on gesture identification

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005311864A (en) * 2004-04-23 2005-11-04 Toshiba Corp Household appliances, adapter instrument, and household appliance system
CN104428601A (en) * 2013-05-17 2015-03-18 松下电器(美国)知识产权公司 Sensor mounting device
CN107490127A (en) * 2017-07-27 2017-12-19 广东美的制冷设备有限公司 Air conditioner air blowing control method, electronic equipment and computer-readable recording medium
CN109442683A (en) * 2018-10-31 2019-03-08 深圳市创维群欣安防科技股份有限公司 A kind of sound control method and system of operation of air conditioner
CN110602197A (en) * 2019-09-06 2019-12-20 北京海益同展信息科技有限公司 Internet of things control device and method and electronic equipment

Also Published As

Publication number Publication date
CN110602197A (en) 2019-12-20

Similar Documents

Publication Publication Date Title
WO2021042985A1 (en) Internet of things control apparatus and method, and electronic device
US11561519B2 (en) Systems and methods of gestural interaction in a pervasive computing environment
US11586292B2 (en) Systems and methods of tracking moving hands and recognizing gestural interactions
US20210050013A1 (en) Information processing device, information processing method, and program
EP3663903B1 (en) Display method and device
EP3631678B1 (en) Systems and methods for person recognition data management
KR102667645B1 (en) Apparatus and method for providing a notification by interworking a plurality of electronic devices
JP2020523717A (en) Device and method for position determination in thermal imaging system
US11806862B2 (en) Robots, methods, computer programs, computer-readable media, arrays of microphones and controllers
US20200301378A1 (en) Deducing floor plans using modular wall units
KR20130116107A (en) Apparatus and method for remote controlling terminal
US20200322178A1 (en) Location determination for device control and configuration
Vuegen et al. Automatic monitoring of activities of daily living based on real-life acoustic sensor data: A preliminary study
JP7490822B2 (en) Simultaneous acoustic event detection across multiple assistant devices
KR20140081642A (en) Method and system for controlling for external apparatus
WO2018139036A1 (en) Information processing device, information processing method, and program
WO2019054037A1 (en) Information processing device, information processing method and program
US11375275B2 (en) Method and system for using lip sequences to control operations of a device
WO2021199284A1 (en) Information processing device, information processing method, and information processing program
US20210208550A1 (en) Information processing apparatus and information processing method
WO2019187549A1 (en) Information processing device and information processing method
CN116260528A (en) Equipment interaction system and interaction method
WO2021003875A1 (en) Control method, controller, terminal and storage medium
WO2024107059A2 (en) Device positioning

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20860641

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20860641

Country of ref document: EP

Kind code of ref document: A1