KR101709715B1 - Control and monitoring apparatus based internet of things using a camera - Google Patents

Control and monitoring apparatus based internet of things using a camera Download PDF

Info

Publication number
KR101709715B1
KR101709715B1 KR1020150160627A KR20150160627A KR101709715B1 KR 101709715 B1 KR101709715 B1 KR 101709715B1 KR 1020150160627 A KR1020150160627 A KR 1020150160627A KR 20150160627 A KR20150160627 A KR 20150160627A KR 101709715 B1 KR101709715 B1 KR 101709715B1
Authority
KR
South Korea
Prior art keywords
information
smart device
camera
emergency
photographing
Prior art date
Application number
KR1020150160627A
Other languages
Korean (ko)
Inventor
고재수
연성훈
Original Assignee
(주)아이오텍
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by (주)아이오텍 filed Critical (주)아이오텍
Priority to KR1020150160627A priority Critical patent/KR101709715B1/en
Application granted granted Critical
Publication of KR101709715B1 publication Critical patent/KR101709715B1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00—Photometry, e.g. photographic exposure meter
    • G01J1/02—Details
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
    • G01S5/02—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using radio waves
    • G01S5/08—Position of single direction-finder fixed by determining direction of a plurality of spaced sources of known location
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/06—Energy or water supply
    • G06Q50/30—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
    • H04N5/2257—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/08—Mouthpieces; Microphones; Attachments therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/12—Messaging; Mailboxes; Announcements

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Tourism & Hospitality (AREA)
  • Signal Processing (AREA)
  • Economics (AREA)
  • Health & Medical Sciences (AREA)
  • Primary Health Care (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Business, Economics & Management (AREA)
  • Strategic Management (AREA)
  • Marketing (AREA)
  • Human Resources & Organizations (AREA)
  • General Health & Medical Sciences (AREA)
  • Water Supply & Treatment (AREA)
  • Public Health (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Operations Research (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The present invention relates to a control and monitoring apparatus based on internet of things using a camera, accessing an internet of things device via communications through a camera as a main means to be in charge of detection, monitoring and controlling of the internet of things device, and when trespassing is detected or an error of the internet of things device is detected, generates a text message to be transmitted to a user in real time, thereby allowing the user to recognize a situation in real time. The controlling and monitoring apparatus based on the internet of things using a camera comprises: a smart device and a photographing means. The smart device measures the operated state and measurement object to generate state information and controls the operation in accordance with an input operation control signal. The photographing means controls the operation of the corresponding smart device based on the state information measured by the smart device, transmits state monitoring information to an information management server, analyzes the state information to generate an emergency situation message when an emergency situation occurs, transmits the generated emergency situation message to a registered user terminal in real time, and controls the operation of an interlinked smart device in accordance with the operation control command transmitted from the user terminal.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a control and monitoring apparatus based on objects,

The present invention relates to control and monitoring based on Internet of things (IoT) using a camera, and more particularly, to a method and apparatus for controlling, monitoring, and controlling the state of an Internet appliance The present invention relates to a control apparatus and a monitoring apparatus based on a web based on a camera in which a user generates a text message in the event of intrusion detection or detection of a malfunctioning Internet device and sends the text message to the user in real time.

Internet (IoT) refers to the object space network that forms intelligent relationships such as sensing, networking, and information processing, without human intervention among dispersed components such as human, objects, and services. In the IoT era, most devices are equipped with information acquisition and network connection functions, and a variety of new products and services are expected to emerge.

Core technologies of IoT are classified into sensing technology, networking technology, and interface technology. Sensing technology refers to the ability to acquire information from objects and surrounding environment through remote sensing, position / motion tracking, etc. using various sensors such as temperature, humidity, heat, gas, illumination, and ultrasonic waves. Networking technology is a wired and wireless networking function that can connect distributed environment elements such as people, objects and services to each other, and currently uses 4G / LTE, Wi-Fi, and Bluetooth. Interface technology is a role of interworking with application service that performs specific functions through the main components of IoT. It is composed of detection information based technology, location information based technology, which means detecting, enabling, shaping, extracting, Security technologies, data mining technologies, and Web services technologies.

A separate communication relay device, such as a hub or gateway, is used for sensing, networking, and information processing in a cooperative manner without artificial intervention among distributed components such as people, objects, and services using the Internet.

Conventional techniques using the Internet have been disclosed in the following Patent Documents 1 to 4.

The prior art disclosed in Patent Document 1 uses an Internet of objects composed of a wellness IoT application service module, an IoT service platform, an intelligent context aware framework, an IoT broker, a resource browser, a web interface device, Service system.

Through such a configuration, we can detect and analyze lifestyle, eating habits, exercise habits, behavior pattern, and SNS of people, and activate lifestyle and industrial IoT application services. We will build a smart micro-grid efficiency and lifestyle mashup IoT service as a life support assistant.

The conventional technology disclosed in Patent Document 2 includes a composite sensor in which a plurality of sensors are formed of a single module and attached to objects to detect external environment information; A sensing and analyzing unit connected to the complex sensor and a sensor dedicated bus and having data for semantic and ontology formalized to analyze external environment information based on a semantic and an ontology and notify an external device of the analysis result; And an external device having a terminal of a related organization or a person concerned who is notified of the analysis result through the wired / wireless communication means from the analysis unit.

Through such a configuration, peripheral information recognized by a complex sensor composed of a plurality of sensors is collected through a sensor dedicated bus, analyzed based on semantic and ontology, and provided to the user quickly and conveniently.

The prior art disclosed in Patent Document 3 is provided in a server and converts a different interface for each device using a object Internet application unit and an adapter pattern that are connected to devices and exchange data or handle devices and interact with each other, And a device having an adapter for providing a unified general purpose interface to unify the data exchange method with the object internet application unit.

With this configuration, the interface is unified by utilizing the adapter pattern of the design pattern, and the data exchange method is different for each device of the object Internet through the universal interface required by the server, so that the data It is possible to minimize the development cost of the object Internet application, and it is easy to maintain and repair.

In the prior art disclosed in Patent Document 4, when the sensor needs to encrypt and transmit data, the AP and the eSE jointly provide the same time information to the eSE and the smart sensor in order to independently generate the session key used for encryption / decryption , And the AP receives the unique ID (or one-time random number) of the eSE from the eSE and provides it to the smart sensor so that the smart sensor and eSE have the same "time information + ID (or one-time random number)". Based on this, the eSE and the smart sensor generate the same session key, encrypt the smart sensor using the symmetric key algorithm, transmit the information to the network gateway, and the AP of the network gateway transmits this data to the eSE, And returns the decrypted plain text to the AP.

With this configuration, a lightweight smart sensor transmits data to the network gateway securely, and the network gateway also connects the embedded CPU (or Application Processor) and Embedded Security Element (eSE) in the network gateway to securely decrypt the data.

Korean Patent Laid-Open Publication No. 10-2015-0090937 (published on Aug. 20, 2015) (entitled " Korean Patent Laid-Open No. 10-2015-0113243 (published on October 10, 2015) (entitled: Korean Patent No. 10-1453372 (Registered on Oct. 15, 2014) (entitled " Intervention System of Heterogeneous Data Exchange Method between Devices in Internet Environment of Objects) Korean Patent Publication No. 10-2015-0035971 (entitled "Communication Protocol for Secure Data Transmission Between Smart Device or Smart Sensor and Network Gateway in the Internet"

However, the above-described related arts have implemented various network systems based on the Internet of things, but they have a disadvantage that it is difficult for the user to recognize the situation of the place where the network system is implemented in real time from the outside.

In addition, since conventional technologies require a separate communication device such as a hub or a gateway for establishing a network system, there is a disadvantage that it takes a lot of cost to build a network system and complexity of network construction.

In addition, in the conventional technologies, the IoT-based network system is constructed by using the gateway device on the hub, and there is no problem in the network communication with the smart device previously set by the hub or gateway, but the compatibility with the new smart device is weak have.

SUMMARY OF THE INVENTION Accordingly, the present invention has been made to solve the above-mentioned problems occurring in the related art, and it is a main object of the present invention to provide a system and method for controlling a state of an Internet appliance, And an object-Internet-based control and monitoring apparatus using a camera that allows a user to recognize a situation in real time by transmitting a text message to a user in real time by generating a text message upon detection of an intrusion detection or an object Internet apparatus failure.

It is another object of the present invention to provide a device for controlling and monitoring objects based on a digital camera using a camera which becomes a hub for network implementation and which can directly control a smart device.

According to an aspect of the present invention, there is provided an object-based Internet control and monitoring apparatus using a camera, the apparatus comprising: Smart devices; And controlling the operation of the corresponding smart device based on the status information measured by the smart device, transmitting status monitoring information to the information management server, analyzing the status information to generate an emergency status message in the event of an emergency, And a photographing means for controlling the operation of the associated smart device according to an operation control command transmitted from the user terminal in real time.

The smart device may include a communication module connected to the photographing device through communication, for transmitting status information to the photographing device, and receiving an operation control command transmitted from the photographing device; A sensor module for monitoring a measurement object; An energy storage module for storing driving power; A power management module that manages use of energy stored in the energy storage module to implement low power; A driving module for driving the smart device according to the operation control command; And an operation state measurement module for measuring the operation state of the smart device.

In the above, the smart device includes an automatic feeder for feeding food to an animal capable of object internet function, a meter for measuring gas / electric power / water / hot water usage; A lighting controller for controlling illumination; An energy manager for managing energy; A display device for displaying information; Refrigerator; washer; water purifier; Microwave; Kimchi refrigerator; television; An air conditioner, and an audio device.

The photographing means stores the state information transmitted from the smart device in the information management server. The photographing means analyzes the state information to automatically generate an emergency message when an intrusion or an emergency occurs, and transmits the emergency message to the user terminal. The position of the camera is automatically controlled to automatically track the position of the object to be tracked.

The photographing means automatically tracks and controls the photographing position of the camera on the basis of the intruder position information sensed by the intrusion sensing means or the position information of each smart device.

The photographing means is an IoT hub for receiving state information in cooperation with a smart device including an object Internet function, and transmitting a control command to each smart device to implement a network system.

The photographing means may include a camera for photographing an intruding object or an object to be measured and acquiring an image; A microphone for receiving a voice signal; A speaker for sending a feed voice or alarm sound; A communication module for communicating with the smart device and the information management server and transmitting a text message to the user terminal; A video output port for transmitting a display image to a display device; The activity amount information is extracted from the status information transmitted from the automatic feeding device of the smart device. The activity amount information is compared with the activity amount determination information previously stored in the memory to determine the actual activity amount of the companion animal. And a main processor for controlling the automatic feeder, extracting emergency information by analyzing the status information transmitted from each smart device, and controlling the tracking and character transmission of the target to be traced in the event of a chip or an emergency .

The imaging means diagnoses the state of the companion animal through the frequency analysis of the companion animal inputted through the microphone and stores the diagnosis result in the memory through the main processor, And a frequency analyzer for generating abnormal condition information and transmitting the abnormal condition information to the main processor. When the health abnormality status information of the companion animal is generated from the frequency analyzer, the main processor controls the real- .

The photographing unit may further include a character generator for generating an emergency message when an intrusion is detected or when an emergency occurs, in association with the main processor.

In addition, the photographing unit may further include an intrusion detection unit for detecting an intrusion, and the intrusion detection unit may use at least one of a motion detection sensor, an infrared sensor, an ultrasonic sensor, and an image analyzer.

In addition, the photographing means may further include a position-tracking unit for automatically tracking an intruder or an emergency situation-related smart device based on the positional information in cooperation with the main processor, And controls the photographing position of the camera based on the position information.

According to the present invention, the camera can be implemented as an IoT hub device, and the state detection, monitoring, and control of the object Internet device can be collectively controlled directly by the camera by connecting to the object Internet device. The message is generated and transmitted to the user in real time, thereby allowing the user to recognize the situation in real time.

In addition, according to the present invention, since the camera becomes a hub for network implementation and can directly control the smart device, a hub or gateway, which is essentially used to implement a network system based on the object Internet, It is easy to implement a network system based on the object Internet, and there is an advantage that the implementation cost of the network system can be reduced.

In addition, according to the present invention, since only a simple function for storing and controlling data is added to a camera without using a management device such as an expensive server, the camera itself can manage the companion animal and the feed rate of the feeder can be adjusted, And the implementation cost of the management device can be reduced.

Brief Description of Drawings FIG. 1 is a block diagram of an object-based Internet control and monitoring apparatus using a camera according to a preferred embodiment of the present invention;
Fig. 2 is a block diagram of an embodiment of the photographing means of Fig. 1,
FIG. 3 is a block diagram of an embodiment of the smart device of FIG. 1;
FIG. 4 is an exemplary diagram illustrating a control and monitoring apparatus based on the object Internet using a camera according to a preferred embodiment of the present invention. FIG.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an object-based Internet control and monitoring apparatus using a camera according to a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a block diagram of an object-based Internet control and monitoring apparatus using a camera according to a preferred embodiment of the present invention.

The object Internet-based control and monitoring apparatus using a camera according to the present invention includes a smart device 100 including an object Internet function and a photographing means 200.

In addition, the object Internet-based control and monitoring apparatus using the camera according to the present invention may include an information management server (hereinafter, referred to as " object management system ") for cumulatively storing the state information transmitted from the photographing means 200 through the network, 300); A user terminal 400 which is directly connected to the photographing means 200 through the network and receives an emergency situation message and transmits an operation control command according to a user's input to the photographing means 200 through the network, . Here, the user terminal 400 may be a smart phone, which is a mobile device capable of mobile communication.

The smart device 100 is an IoT device having an object Internet function for measuring an operation state and an object to be measured, generating state information, and controlling the operation according to the input operation control signal.

Here, the smart device 100 may include an automatic feeder for feeding food to an animal capable of object internet function, a meter for measuring gas / electric power / water / hot water usage; A lighting controller for controlling illumination; An energy manager for managing energy; A display device for displaying information; Refrigerator; washer; water purifier; Microwave; Kimchi refrigerator; television; An air conditioner, and an audio device. In addition to the smart devices mentioned here, they may also include a variety of smart devices capable of implementing the object Internet functionality.

As shown in FIG. 3, the smart device 100 is connected to the photographing means 200 by communication, transmits state information to the photographing means 200, A communication module (111) for receiving a control command; A sensor module (112) for monitoring an object to be measured; An energy storage module 114 for storing driving power; A power management module 113 for managing the use of energy stored in the energy storage module 114 to implement low power; A driving module 115 for driving the smart device according to the operation control command, and an operation state measurement module 116 for measuring the operation state of the smart device.

Here, the sensor module 112 may be an acceleration sensor, an acoustic sensor, a muscle sensor, an image sensor, a magnetic sensor, a light sensor, a gyroscope, a pressure sensor, a gas RFID sensor, a humidity sensor, a temperature sensor, , And an infrared sensor are preferably used. It is preferable that each smart device adopts an appropriate sensor according to the characteristics of the smart device.

The smart device according to the present invention includes a configuration for performing its functions and a configuration shown in FIG. Figure 3 is an example of an automatic feeder that automatically feeds companion animals. The present invention is not limited to this, and for convenience of explanation, it is assumed that the smart device is an automatic feeder.

The photographing means 200 controls the operation of the corresponding smart device based on the state information measured by the smart device 100, transmits the state monitoring information to the information management server 300, Generates an emergency message in the event of an emergency, transmits the emergency message to the registered user terminal 400 in real time, and controls the operation of the associated smart device according to the operation control command transmitted from the user terminal 400 .

The photographing means 200 stores the state information transmitted from the smart device 100 in the information management server 300 and automatically analyzes the state information to generate an emergency message in the event of an intrusion or an emergency, It is preferable that the photographing position of the camera is automatically controlled to the position where the intruding or emergency situation is detected to automatically track the object to be tracked. It is preferable that the photographing means 200 automatically tracks and controls the photographing position of the camera on the basis of the intruder position information sensed by the intrusion sensing means or the position information of each smart device.

The photographing means 200 serves as an IoT hub for receiving state information in cooperation with the smart device 100 including the object Internet function and transmitting a control command to each smart device 100 to implement a network system .

As shown in FIG. 2, the photographing means 200 includes a camera 201 for photographing an intruding object or an object to be measured and acquiring an image; A microphone 202 for receiving a voice signal; A speaker (203) for transmitting a feeding voice or an alarm sound; A memory 204 for storing information; A communication module 206 for communicating with the smart device 100 and the information management server 300 and transmitting a text message to the user terminal 400; A video output port 207 for transmitting a display image to a display device which is a smart device; The activity amount information is extracted from the status information transmitted from the automatic feeding device of the smart device. The activity amount information is compared with the activity amount determination information previously stored in the memory to determine the actual activity amount of the companion animal. A main processor 205 for controlling the automatic feeder, analyzing state information transmitted from each smart device to extract emergency information, and controlling tracking and character transmission of a tracking object when a chip or emergency occurs .

The photographing means 200 diagnoses the state of the companion animal through frequency analysis of the companion animal inputted through the microphone 202 and outputs the diagnosis result to the memory 204 through the main processor 205 Further comprising a frequency analysis unit (208) for generating health abnormality status information in case of health abnormality of the companion animal and transmitting the health abnormality status information to the main processor (205), and the main processor (205) When the health abnormality state information of the companion animal is generated from the user terminal (208), it is preferable to control the health abnormality state information to be transmitted to the user terminal (400) in real time through the communication module (206).

The photographing unit 200 may include a character generator 210 for generating an emergency message when an intrusion is detected or an emergency occurs in conjunction with the main processor 205 and transmitting the generated emergency message to the main processor 205; An input / output unit 209 for inputting an information input, a function input or a control command; The intrusion detection unit 211 may further include at least one of a motion detection sensor, an infrared sensor, an ultrasonic sensor, and an image analyzer.

The photographing unit 200 further includes a position tracking unit 212 for automatically tracking an intruder or an emergency situation of the smart device 100 based on the positional information in cooperation with the main processor 205 And the main processor 205 controls the photographing position of the camera 201 based on the position information tracked by the position tracking unit 212.

Hereinafter, the operation of the object-based control and monitoring apparatus using the camera according to the present invention will be described in detail.

First, each smart device 100 communicates with the photographing means 200 through the communication means 200 with the smart device 100 having the object Internet function (sensing technology, networking technology, interface function) 200, and receives an operation control command from the photographing means (200).

FIG. 4 is a block diagram illustrating an apparatus for controlling and monitoring the object-based Internet using a camera according to the present invention. Referring to FIG. 4, reference numeral 200 denotes a photographing means serving as an IoT hub and reference numeral 110 denotes a smart device.

The smart device can be an acceleration sensor, an acoustic sensor, a muscle sensor, an image sensor, a magnetic sensor, a light sensor, a gyroscope, a pressure sensor, a gas RFID sensor, a humidity sensor, a temperature sensor, a flow sensor, The sensor module 112 including at least one of the sensors measures an object to be measured or detects an intrusion. In addition, the operation state measurement module 116 self-diagnoses its operation state in real time to generate operation state measurement information. The measurement information generated by measuring the measurement object and the operation state measurement information are combined and transmitted to the photographing means 200 in real time via the communication module 111 as state information. At this time, it is preferable to transmit information including position information for determining the position of the mobile terminal. Here, it is preferable that the smart device 100 and the photographing means 200 transmit and receive data through communication protocols such as Bluetooth, Wi-Fi, ZigBee, and Z-Wave.

Meanwhile, as another feature of the present invention, each smart device can optimally control energy in a low power state to save power. For example, when the energy stored in the energy storage module 114 is supplied to the driving module 115 or consumed for communication or monitoring, the power management module 113 supplies power to the driving module 115 only in a portion requiring driving, Lt; / RTI > Particularly, when the measurement object or the intruder is monitored by the sensor module 112, unless an extra emergency situation is detected, all the modules except the sensor module 112 are turned off to prevent power consumption. When an intruder or an emergency is detected by the sensor module 112, state information is generated and transmitted to the photographing means 200 through the communication module 111. It is preferable that the operation state measurement module 116 generates the diagnostic information by transmitting the state information to the photographing means 200 or performing a self-diagnosis only when the power is supplied and started.

When the status information is received from each smart device 100, the image capturing means 200 stores the status information in the memory 204 and transmits the status information to the information management server 300 through the network. The information management server 300 cumulatively stores the received state information in a database for each photographing means, and analyzes the accumulated state information to derive an analysis result. It is also possible to generate statistical information at the time of analysis. The generated analysis result information may be transmitted to the user terminal 400 or may be transmitted to the specific terminal according to the request of the user. The user can utilize this information for the overall system operation based on the analyzed result information.

The main processor 205 in the photographing means 200 stores state information transmitted from each smart device in a memory and analyzes state information to check whether an emergency or an intrusion is detected. The main processor 205 may detect an intrusion through the intrusion detection unit 211 in addition to interlocking with the smart device. An infrared sensor, an ultrasonic sensor, a motion detection sensor (motion sensor), etc. can be used for intrusion detection.

The main processor 205 analyzes the status information transmitted from the smart device and automatically detects the presence of an intrusion (intrusion, fire, short circuit, overheating, or the like) 212 and the character generator 210. [

The character generation unit 210 generates a character indicating that an emergency has occurred in association with the main processor 205 and transmits the generated character to the main processor 205. [ In this case, it is preferable that the main processor 205 distinguishes from the smart device whether an emergency occurs or an intruder is detected and transmits the emergency character to the character generator 210. The character generator 210 generates an emergency text message corresponding to the transmitted smart device or intruder detection occurrence information. For example, when an intruder is detected, it may be a text message such as an intruder detection, a gas leak message may be a text message, and a fire message may be a text message.

The generated text messages (SMS, MMS) are transmitted to the user terminal 400 carried by the user through the communication module 206 under the control of the main processor 205. Here, the communication module 206 transmits a text message to the user terminal 400 via the network. Alternatively, the image information of the corresponding location photographed by the camera 201 may be attached to the generated text message in the form of an attached file and transmitted in the form of MMS.

The user automatically receives the emergency information through the user terminal 400 carried by the user in real time while being remotely located. Once the emergency information is received, appropriate follow-up measures are taken to prevent loss of property or loss of valuable property from an emergency. If it is possible to control the user terminal 400 according to need, the operation control command is input through the input unit and is transmitted to the photographing means 200. Upon receiving the operation control command transmitted from the user terminal 400, the photographing means 200 transmits an operation control command to the corresponding smart device. According to the operation control command, the smart device operates the driving module 115 to control the driving of the device. For example, if it is determined that the smart device is an air conditioner and the indoor temperature is determined to be overheated, the air conditioner is automatically operated through the air conditioner driving command. Here, the air conditioner set temperature may be directly set through the user terminal, or a preset temperature previously set in the air conditioner may be used.

In another aspect of the present invention, a smart device in which an intrusion is detected or an emergency situation occurs can be automatically photographed while being photographed.

For example, when the main processor 205 detects that an intrusion is detected by the intrusion detection unit 211 or an intrusion detection or emergency situation has occurred from the smart device 100, To track the position.

When the location tracking command is received from the main processor 205, the location tracking unit 212 automatically tracks the location based on the transmitted information, that is, the location information of the smart device or the intruder location information detected first. The position tracking can be interlocked with the intrusion detection unit 211, track the position, or track the position using the detection sensor by itself.

The position information (X and Y coordinates on the plane) generated through the tracking is utilized as control information of the camera 201 through the main processor 205. The camera 201 automatically rotates to the corresponding position based on the position information transmitted through the main processor 205, and photographs the image. If an emergency situation or an intruder is detected as a smart device, the photographing angle of the camera is shifted to the position where the smart device is installed. Alternatively, when intrusion is detected through the intrusion detection unit 211, the intruder is tracked by adjusting the photographing angle of the camera based on the position tracking information generated by the position tracking unit 212. Accordingly, when the intruder is detected, the camera automatically follows the intruder to perform image capturing. The captured image may be stored in the memory or stored in the information management server 300 or may be transmitted to the user terminal 400).

Accordingly, the user can visually check the location or the status of the intruder in real time using the user terminal 400 while remotely located.

In another aspect of the present invention, when the smart device is an automatic feeder that automatically feeds the companion animal, the main processor 205 may automatically feed the feed based on the companion animal status information measured from the smart device 100 By adjusting, the companion animal becomes obese or lacks nutritional support.

For example, the main processor 205 extracts only the state activity amount information from the companion animal state information measured from the smart device 100. The extracted activity amount information is compared with the activity amount determination information previously stored in the memory 204 to determine the actual activity amount of the companion animal. Here, it is preferable to use the reference information acquired in advance through experiments or animal science as the activity amount (or the calorie consumption amount) of the companion animal. The activity amount determination information may be fixed to a specific value, but is preferably set to a certain range.

Then, the food control data is calculated according to the determined actual activity amount.

For example, the extracted activity amount information is compared with the activity amount determination information. If the activity amount information is larger than the activity amount determination information, it is determined that the activity amount is large. If the activity amount information is smaller than the activity amount determination information, If the activity amount information and the activity amount judgment information are the same, it is judged that the activity amount is appropriate. Such activity amount determination information is referred to as actual amount of activity.

Then, the difference between the activity amount information and the activity amount determination information is calculated, and the food control data is extracted from the food table previously stored in the memory 204 by the calculated difference. Here, the feed control data is feed control data in the direction of increasing the feed amount when the activity amount is larger than the reference amount, and the food control data in the direction of reducing the feed amount when the activity amount is smaller than the reference amount.

The feed control data thus calculated is transmitted to the smart device 110, which is an automatic feeder, as a local communication protocol through the communication module 206. The smart device 110 controls the feeding amount by controlling each feeding tray (for example, a feeding box, a snack barrel, a drinking water barrel) in the driving module 115 based on the feeding regulation data (feeding control data) .

Further, as another feature of the present invention, it is possible to diagnose the state of companion animals through voice analysis of companion animals.

For example, the photographing unit 200 transmits the sound of the companion animal input through the microphone 202 to the frequency analyzer 208. The frequency analyzer 208 converts the voice of the companion animal into a frequency through the Fourier transform, analyzes it through a frequency analysis technique, and diagnoses the state of the companion animal. In this case, it is desirable to analyze frequency analysis based on cumulative big data through information of animal science and various experiences according to voice of companion animal. And, as a result of the diagnosis through the frequency analysis, the health abnormality state information of the companion animal in case of health abnormality is generated and transmitted to the user terminal 400 through the communication module 206.

On the other hand, as another feature of the present invention, the main control unit 205 of the photographing means 200 can perform a service (mVoIP service) such as a kakao call. For example, it may transmit a character or a moving picture by MMS, or may transmit a character or an MMS to the user terminal 400 like a cacao talk. Thereafter, there is no response from the user terminal 400 for a predetermined time, and a video call (smart call) is automatically performed. The user can check characters or photographs through the user terminal 400 and can ignore them if there is no abnormality. Alternatively, the user can connect with the photographing means 200 to check various situations.

Therefore, the user can recognize the state of the companion animal without remote monitoring the companion animal in real time. By recognizing the state of the companion animal and taking the appropriate follow-up action, the companion animal can be managed like a family.

Although the present invention has been described in detail with reference to the above embodiments, it is needless to say that the present invention is not limited to the above-described embodiments, and various modifications may be made without departing from the spirit of the present invention.

The present invention is applied to a technique of implementing a camera for image capture as an IoT hub and implementing a system capable of networking, monitoring, and controlling without building a separate server through communication with an IoT-based smart device.

100: Smart devices
111: Communication module
112: Sensor module
113: Power management module
114: Energy storage module
115: drive module
116: Operation status measurement module
200: photographing means
201: camera
204: memory
205: main processor
206: Communication module
210:
211: intrusion detection unit
212:
300: Information management server
400: User terminal

Claims (12)

A device for monitoring and controlling an intruder by using a camera, controlling and monitoring a smart device based on the object Internet,
A smart device for measuring an operation state and a measurement object to generate status information, and controlling the operation according to the input operation control signal; And
And controlling the operation of the corresponding smart device based on the status information measured by the smart device, transmitting status monitoring information to the information management server, analyzing the status information to generate an emergency status message in the event of an emergency, And photographing means for controlling the operation of the associated smart device in accordance with an operation control command transmitted from the user terminal in real time,
The photographing means stores the state information transmitted from the smart device in the information management server, analyzes the state information, automatically generates an emergency message when an intrusion or an emergency occurs, and transmits the emergency message to the user terminal. Automatically controls the shooting position of the camera with the detected position, automatically tracks the tracking target,
The photographing means diagnoses the state of the companion animal through the frequency analysis of the companion animal input through the microphone, stores the result of the diagnosis in the memory through the main processor, and informs the health abnormality state information And transmitting the generated health abnormality information to the main processor, wherein the main processor controls the frequency analyzer to transmit the health abnormality information of the companion animal to the user terminal through the communication module when the health abnormality status information is generated, Based Internet control and monitoring system using camera.
The smart device according to claim 1, wherein the smart device comprises: a communication module connected to the photographing device in communication, for transmitting state information to the photographing device and receiving an operation control command transmitted from the photographing device; A sensor module for monitoring a measurement object; An energy storage module for storing driving power; A power management module that manages use of energy stored in the energy storage module to implement low power; A driving module for driving the smart device according to the operation control command; And an operation state measurement module for measuring an operation state of the smart device.
The smart device according to claim 1, wherein the smart device comprises: an automatic feeder for feeding food to an animal capable of object internet function; a meter for measuring gas / electric power / water / hot water usage; A lighting controller for controlling illumination; An energy manager for managing energy; A display device for displaying information; Refrigerator; washer; water purifier; Microwave; Kimchi refrigerator; television; An air conditioner, and an audio device.
delete The method according to claim 1, wherein the photographing means automatically tracks and controls the photographing position of the camera based on the intruder position information sensed by the intrusion sensing means or the position information of each smart device Control and monitoring device.
Wherein the photographing means serves as an IoT hub for receiving status information in cooperation with a smart device including an object Internet function and transmitting a control command to each smart device to implement a network system. Internet - based control and monitoring system using.
[Claim 2] The system of claim 1, wherein the photographing means comprises: a camera for photographing an intruding object or an object to be measured and acquiring an image; A microphone for receiving a voice signal; A speaker for sending a feed voice or alarm sound; A communication module for communicating with the smart device and the information management server and transmitting a text message to the user terminal; A video output port for transmitting a display image to a display device; The activity amount information is extracted from the status information transmitted from the automatic feeding device of the smart device. The activity amount information is compared with the activity amount determination information previously stored in the memory to determine the actual activity amount of the companion animal. And a main processor for controlling the automatic feeder, extracting emergency information by analyzing the status information transmitted from each smart device, and controlling the tracking and character transmission of the target to be traced in the event of a chip or an emergency An object - based Internet control and monitoring system using a camera.
delete The method as claimed in claim 7, wherein the photographing means further comprises a character generator for generating an emergency message at the time of intrusion detection or emergency occurrence in association with the main processor and transmitting the generated emergency message to the main processor. Control and monitoring device.
[7] The apparatus according to claim 7, wherein the photographing unit further comprises an intrusion detection unit for detecting an intrusion, wherein the intrusion detection unit uses at least one of a motion detection sensor, an infrared sensor, an ultrasonic sensor, Based control and monitoring device.
The main processor may further include a position tracking unit for automatically tracking an intruder or an emergency situation of the smart device based on the positional information in cooperation with the main processor, And controlling the photographing position of the camera on the basis of the position information tracked by the camera.
The method according to claim 1, wherein the photographing means transmits a kakao tok to the user terminal along with a character or MMS, and if there is no response within a preset time, the video camera tries to force a video call connection to the user terminal, Wherein the control unit controls the display unit to display the image transmitted from the user terminal and controls the image captured by the camera to be transmitted to the user terminal.

KR1020150160627A 2015-11-16 2015-11-16 Control and monitoring apparatus based internet of things using a camera KR101709715B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150160627A KR101709715B1 (en) 2015-11-16 2015-11-16 Control and monitoring apparatus based internet of things using a camera

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150160627A KR101709715B1 (en) 2015-11-16 2015-11-16 Control and monitoring apparatus based internet of things using a camera

Publications (1)

Publication Number Publication Date
KR101709715B1 true KR101709715B1 (en) 2017-02-24

Family

ID=58313628

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150160627A KR101709715B1 (en) 2015-11-16 2015-11-16 Control and monitoring apparatus based internet of things using a camera

Country Status (1)

Country Link
KR (1) KR101709715B1 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107302562A (en) * 2017-05-23 2017-10-27 中国科学院计算技术研究所 The adaptive command processing system and method for a kind of internet-of-things terminal equipment
KR20190023544A (en) 2017-08-29 2019-03-08 김승욱 Digital video record apparatus based on sound related iot(internet of things) sensor and method thereof
CN109874100A (en) * 2019-02-20 2019-06-11 视联动力信息技术股份有限公司 A kind of emergency command information labeling method and apparatus
WO2019172565A1 (en) * 2018-03-08 2019-09-12 삼성전자 주식회사 Electronic device and method for connection to external device
WO2019189965A1 (en) * 2018-03-30 2019-10-03 데이터얼라이언스 주식회사 System and method for controlling iot device by using virtual reality and augmented reality
KR20200017778A (en) 2018-08-09 2020-02-19 주식회사 엘지유플러스 IoT-based monitoring apparatus and method using mat type pressure sensor
KR20200053877A (en) * 2018-11-09 2020-05-19 코닉오토메이션 주식회사 IoT supporting apparatus for measuring equipment that is difficult to implement IoT function
CN111612642A (en) * 2020-04-08 2020-09-01 浙江工业大学 Modern urban green plant health therapeutic instrument system
CN112654010A (en) * 2019-09-26 2021-04-13 诺基亚技术有限公司 Method and apparatus for intrusive IoT device detection
WO2021075774A1 (en) * 2019-10-16 2021-04-22 Samsung Electronics Co., Ltd. Method for controlling iot device and electronic device therefor

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20100123492A (en) * 2009-05-15 2010-11-24 김춘효 System and method for detecting invasion using mobile phone
KR101256054B1 (en) * 2012-09-13 2013-04-18 엠케어시스(주) Pet care system and method using two-way communication
KR101272653B1 (en) * 2011-12-19 2013-06-12 윤영제 System for controlling and monitoring household appliances
KR20140014776A (en) * 2012-07-26 2014-02-06 주식회사 케이티 Remote status monitoring and control system for monitoring and controlling facilities of home network based on context aware
KR101453372B1 (en) 2014-04-15 2014-10-22 주식회사 스마티랩 SYSTEM FOR MEDIATE HETEROGENEOUS DATA EXCHANGE OF IoT DEVICES IN INTERNET OF THINGS
KR20150035971A (en) 2015-03-18 2015-04-07 문종섭 A secure Data Communication protocol between IoT smart devices or sensors and a Network gateway under Internet of Thing environment
KR20150090937A (en) 2014-01-29 2015-08-07 주식회사 글로비트 Service system using Internet of Things
KR20150113243A (en) 2014-03-27 2015-10-08 (주) 코콤 Interactive environment complex sensor IoT system

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20100123492A (en) * 2009-05-15 2010-11-24 김춘효 System and method for detecting invasion using mobile phone
KR101272653B1 (en) * 2011-12-19 2013-06-12 윤영제 System for controlling and monitoring household appliances
KR20140014776A (en) * 2012-07-26 2014-02-06 주식회사 케이티 Remote status monitoring and control system for monitoring and controlling facilities of home network based on context aware
KR101256054B1 (en) * 2012-09-13 2013-04-18 엠케어시스(주) Pet care system and method using two-way communication
KR20150090937A (en) 2014-01-29 2015-08-07 주식회사 글로비트 Service system using Internet of Things
KR20150113243A (en) 2014-03-27 2015-10-08 (주) 코콤 Interactive environment complex sensor IoT system
KR101453372B1 (en) 2014-04-15 2014-10-22 주식회사 스마티랩 SYSTEM FOR MEDIATE HETEROGENEOUS DATA EXCHANGE OF IoT DEVICES IN INTERNET OF THINGS
KR20150035971A (en) 2015-03-18 2015-04-07 문종섭 A secure Data Communication protocol between IoT smart devices or sensors and a Network gateway under Internet of Thing environment

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107302562A (en) * 2017-05-23 2017-10-27 中国科学院计算技术研究所 The adaptive command processing system and method for a kind of internet-of-things terminal equipment
KR20190023544A (en) 2017-08-29 2019-03-08 김승욱 Digital video record apparatus based on sound related iot(internet of things) sensor and method thereof
US11095765B2 (en) 2018-03-08 2021-08-17 Samsung Electronics Co., Ltd. Electronic device and method for connection to external device
WO2019172565A1 (en) * 2018-03-08 2019-09-12 삼성전자 주식회사 Electronic device and method for connection to external device
US11262903B2 (en) 2018-03-30 2022-03-01 Data Alliance Co., Ltd. IoT device control system and method using virtual reality and augmented reality
WO2019189965A1 (en) * 2018-03-30 2019-10-03 데이터얼라이언스 주식회사 System and method for controlling iot device by using virtual reality and augmented reality
KR20200017778A (en) 2018-08-09 2020-02-19 주식회사 엘지유플러스 IoT-based monitoring apparatus and method using mat type pressure sensor
KR20200053877A (en) * 2018-11-09 2020-05-19 코닉오토메이션 주식회사 IoT supporting apparatus for measuring equipment that is difficult to implement IoT function
KR102143650B1 (en) * 2018-11-09 2020-08-11 코닉오토메이션 주식회사 IoT supporting apparatus for measuring equipment that is difficult to implement IoT function
CN109874100A (en) * 2019-02-20 2019-06-11 视联动力信息技术股份有限公司 A kind of emergency command information labeling method and apparatus
CN112654010A (en) * 2019-09-26 2021-04-13 诺基亚技术有限公司 Method and apparatus for intrusive IoT device detection
WO2021075774A1 (en) * 2019-10-16 2021-04-22 Samsung Electronics Co., Ltd. Method for controlling iot device and electronic device therefor
CN111612642A (en) * 2020-04-08 2020-09-01 浙江工业大学 Modern urban green plant health therapeutic instrument system

Similar Documents

Publication Publication Date Title
KR101709715B1 (en) Control and monitoring apparatus based internet of things using a camera
US11393327B2 (en) Method for allowing drone activity to modify event detection by a monitoring system
AU2019295856B2 (en) Object tracking using disparate monitoring systems
EP2933953A1 (en) Method and apparatus for home monitoring
TW201331893A (en) Intelligent monitoring system with automatic notification and intelligent monitoring device thereof
WO2019021041A1 (en) Internet of things (iot) based integrated device to monitor and control events in an environment
KR102162364B1 (en) Bridge device supporting alarm format
CN110197732B (en) Remote health monitoring system, method and equipment based on multiple sensors
CN103096044A (en) Monitoring system and webcam
US20210366611A1 (en) Smart monitoring safety system using sensors
CN103957376A (en) Infrared thermal-image probe controlling system and method based on mobile intelligent terminal
AU2022201957B2 (en) Security system communicator and keypad device
JP2013164774A (en) Intelligent monitoring system and intelligent monitoring device with automatic notification function
US10965899B1 (en) System and method for integration of a television into a connected-home monitoring system
CN207097164U (en) A kind of monitoring system
KR20160102914A (en) Wireless security system using smart phone
TW201123827A (en) A surveillance module of a consumer electronic device and the surveillance method of the same
US11521384B1 (en) Monitoring system integration with augmented reality devices
US9594355B2 (en) Wireless monitoring method and device thereof
KR101413730B1 (en) Unmanned surveillance system capable of communication with sns server
WO2016179911A1 (en) Security alarm system and operating method therefor
KR101741240B1 (en) network camera apparatus
KR101444079B1 (en) Hybrid control panel and method thereof
WO2018093802A1 (en) Leveraging secondary wireless communications functionality for system setup and/or diagnostics
KR20150057427A (en) Apparatus and method for home surveillance

Legal Events

Date Code Title Description
E701 Decision to grant or registration of patent right
GRNT Written decision to grant