WO2023200159A1

WO2023200159A1 - Method for detecting object by using low power, and detection device according to same

Info

Publication number: WO2023200159A1
Application number: PCT/KR2023/004340
Authority: WO
Inventors: 정창수
Original assignee: 주식회사 스마트아이캠
Priority date: 2022-04-11
Filing date: 2023-03-31
Publication date: 2023-10-19
Also published as: KR102601637B1; KR102601637B9; KR20230145749A

Abstract

Disclosed is a method for detecting an object by using low power. The present invention comprises: an object detection step; a wake-up signal transmission step; a camera unit driving power applying step for applying a driving power to a media processing unit for encoding an image, and a computer vision categorization processing unit; a step for initializing an image sensor unit; a step for encoding and storing an image to be stored in temporary memory; and an operating system (OS) booting step for booting an OS of a detection device when an object to be monitored is identified. The present invention can effectively and independently monitor the surroundings for a long period of time by means of a provided battery without frequent charging and without power supply via a separate cable, unlike a black box installed in a vehicle, etc. or CCTVs installed in an office or home, etc.

Description

Method for detecting objects using low power and resulting monitoring device

The present invention relates to a method for detecting an object using low power and a monitoring device accordingly. More specifically, the present invention relates to a device and method that can detect and record the motion of an object, etc. with low power.

The present invention relates to a device and method that can accurately detect the motion of an object indoors, such as in a vehicle, store, or home, or outdoors, such as on a road, sidewalk, or open area, and track the object through recording and recording accordingly. Conventionally, equipment such as a black box installed inside a vehicle to observe and record movements of objects outside the vehicle or passengers inside the vehicle has been widely used. However, these conventional monitoring devices must operate while constantly connected to a relatively large capacity battery, so they are sensitive to battery capacity, and in some cases, for example, a monitoring device such as a black box mounted on a car may be operated using the entire battery of the vehicle. This has caused the problem of the vehicle not starting due to the consumption of the engine. In addition, these conventional monitoring devices require constant power input, making them difficult to use in places such as fields or mountains where power supply is difficult. Monitoring devices including solar power modules are sometimes used in environments where it is difficult to receive power at all times, but solar power modules usually do not operate properly due to low power generation when the day is cloudy or at night. Therefore, a monitoring device with low battery consumption is needed.

Meanwhile, in the case of these conventional monitoring devices, there was most cases where there was no need for monitoring when examining the actual monitored and recorded memory. In other words, there was unnecessary battery consumption by recording and monitoring unnecessary surveillance objects, and ultimately, the user had to go through the trouble of checking and deleting them one by one.

In particular, in more detail, the operation of the image sensor in the camera part of the surveillance device consumes the most power, and as mentioned above, the conventional surveillance device monitors all unnecessary surveillance objects, so there is a problem of meaningless power consumption. there was.

In other words, a configuration that can accurately determine the surveillance target is necessary before full-scale operation of the camera unit.

The background technology of the present invention is disclosed in Korean Patent Publication No. 10-2015-0107931 (2015.09.24. Title of invention: Camera image storage device with low power consumption structure). In addition, it is disclosed in Republic of Korea Patent Publication No. 10-2015-0107929 (2015.9.24. Title of invention: Image storage method of vehicle black box). In addition, it is disclosed in U.S. Patent No. 11,182,319 (2021.11.23. Title of invention: Camera system with PWM-activated, burst-self-refresh, DRAM to reduce standby power consumption).

[Prior art literature]

[Patent Document]

(Patent Document 1) Republic of Korea Patent Publication No. 10-2015-0107931

(Patent Document 2) Republic of Korea Patent Publication No. 10-2015-0107929

(Patent Document 3) U.S. Patent No. 11,182,319

The purpose of the present invention is to provide a method for detecting objects using low power.

Additionally, an object of the present invention is to provide a monitoring device that detects an object using low power.

According to one aspect of the present invention, a method of detecting an object by a monitoring device using low power, comprising: an object detection step of detecting an object by a motion sensor included in the monitoring device; When the motion sensor determines the object to be monitored in the object detection step, the motion sensor transmitting a wakeup signal to the camera unit to apply driving power to the camera unit included in the monitoring device; A camera unit driving power application step in which the camera unit applies driving power to an image sensor unit, an image encoding media processing unit, and a computer vision classification processing unit included in the monitoring device; Initializing the image sensor unit by including the camera unit at least one of AF, AE, and AWB; An image encoding and storage step in which the media processing unit encodes the image input to the image sensor unit and stores the generated image data in a temporary memory; A method comprising an operating system booting step in which the operating system (OS) of the monitoring device boots when the computer vision classification processing unit analyzes the image data stored in the temporary memory and determines the existence or range of the object to be monitored. This is provided.

In addition, according to another aspect of the present invention, a method for a monitoring device to detect an object using low power includes an object detection step of detecting an object by a motion sensor included in the monitoring device; When the motion sensor determines the object to be monitored in the object detection step, the motion sensor transmitting a wakeup signal to the camera unit to apply driving power to the camera unit included in the monitoring device; A camera unit driving power application step in which the camera unit applies driving power to an image sensor unit, an image encoding media processing unit, and a computer vision classification processing unit included in the monitoring device; Initializing the image sensor unit including AF, AE, and AWB control; An image encoding and storage step in which the media processing unit encodes the image input to the image sensor unit and stores the generated image data in a temporary memory; If the computer vision classification processing unit cannot determine the existence and range of the object to be monitored by analyzing the image data stored in the temporary memory, a method of switching the camera unit to standby mode is provided.

In addition, in the present invention, in the object detection step, power may not be applied to the camera unit.

Additionally, in the object detection step, the motion sensor may determine whether the object is a person, a vehicle, or another object based on one or more of the size of the detected object, the moving speed of the object, and the moving direction of the object.

Additionally, in the step of applying driving power to the camera unit, the camera unit may operate in a real-time operation system (RTOS) mode that supplies power to components necessary for operation of the camera unit.

Additionally, in the video encoding and storage steps, the temporary memory may not be a removable memory depending on the user's convenience.

In addition, after the operating system booting step, the monitoring device performs a predetermined operation when the monitoring object is within a predetermined range from the monitoring device or the image of the monitoring object is within an imaging area of the image sensor unit. It may further include.

In addition, after the operating system booting step, the monitoring device may further include operating until the object to be monitored moves out of a predetermined range from the monitoring device or the image of the object to be monitored moves out of the imaging area of the image sensor unit. You can.

Additionally, the operation may be recording video or audio.

Additionally, after performing the predetermined operation, the monitoring device may switch the camera unit to a standby mode when the monitoring object meets a second predetermined condition.

In addition, the second predetermined condition is that the object to be monitored moves for a predetermined time while the object to be monitored is within a predetermined range from the monitoring device or the image of the object to be monitored is within the imaging area of the image sensor unit. This may be the case where the monitoring device determines that this is not the case.

In addition, after the operating system booting step, the camera unit transmits event occurrence information to the control unit of the monitoring device; And the monitoring device may further include transmitting the event occurrence information to the outside through a communication unit included in the monitoring device.

Additionally, the motion sensor may be a radar sensor.

According to another aspect of the present invention, it may be a computer program stored in a recording medium that executes the method for detecting an object using low power described above.

According to another aspect of the present invention, in a monitoring device that detects an object using low power, the monitoring device detects an object to be monitored, and when determining the object to be monitored, drives a camera unit included in the monitoring device. A motion sensor that transmits a wakeup signal to apply power to the camera unit; It includes an image sensor unit, a media processing unit for encoding images, a computer vision classification processing unit, and a camera unit including a temporary memory, wherein the camera unit initializes the image sensor unit including at least one of AF, AE, and AWB. , the image data generated by encoding the image input to the image sensor unit is stored in a temporary memory, and the computer vision classification processing unit analyzes the image data stored in the temporary memory to detect one or more of the presence or range of the object to be monitored. If it is determined that the operating system (OS) of the monitoring device can boot.

According to an embodiment of the present invention, a method for detecting an object using low power can be provided.

According to another embodiment of the present invention, a method for detecting an object using low power can be provided.

According to another embodiment of the present invention, unlike black boxes installed in vehicles or CCTV installed in offices or homes, the surroundings can be efficiently monitored independently for a long period of time without power supply through a separate cable and without frequent charging through a provided battery. It can be monitored.

According to another embodiment of the present invention, power consumption can be significantly reduced by identifying surveillance objects that actually require surveillance and monitoring through recording only for situations that require surveillance.

1 is a block diagram showing the configuration of equipment for monitoring an object using low power according to an embodiment of the present invention.

2 to 4 are flowcharts showing the operation of equipment for monitoring an object using low power according to another embodiment of the present invention.

Figure 5 is a diagram showing a monitoring device according to another embodiment of the present invention.

Figure 6 is a conceptual diagram showing the usage of a monitoring device and a user terminal according to another embodiment of the present invention.

Since the present invention can be modified in various ways and can have various embodiments, specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all transformations, equivalents, and substitutes included in the spirit and technical scope of the present invention. In describing the present invention, if it is determined that a detailed description of related known technologies may obscure the gist of the present invention, the detailed description will be omitted.

Terms such as first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another.

The terms used in this application are only used to describe specific embodiments and are not intended to limit the invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as “comprise” or “have” are intended to designate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, but are not intended to indicate the presence of one or more other features. It should be understood that this does not exclude in advance the possibility of the existence or addition of elements, numbers, steps, operations, components, parts, or combinations thereof.

[Explanation of symbols]

100: monitoring device

110: motion sensor

120: camera unit

130: control unit

140: memory

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. In the description with reference to the accompanying drawings, identical or corresponding components will be assigned the same drawing numbers and overlapping descriptions thereof will be omitted. Do this.

In addition, terms such as first, second, etc. used below are merely identifiers to distinguish identical or corresponding components, and the same or corresponding components are not limited by terms such as first, second, etc. no.

In addition, coupling does not mean only the case of direct physical contact between each component in the contact relationship between each component, but also means that another component is interposed between each component, and the component is in that other component. It should be used as a concept that encompasses even the cases where each is in contact.

Additionally, in relation to a computer program, the suffixes "module" and/or "part" for a component are either part of a computer program for making a computer function as a means of a particular function, or a part of a computer program for realizing a particular function on a computer. It may be part of it. For example, module A can be interpreted as a computer program for making a computer function as means A or as a computer program for realizing function A in a computer. As a method, the “steps” may be implemented and executed as a computer program on a computer. Additionally, “modules” and/or “parts” may be gathered together to form a “group.”

Meanwhile, an application refers to a set of computer programs designed to perform a specific task, and is also called an application program. Users can add related functions by installing the application according to an embodiment of the present invention on their electronic devices.

The user's electronic device on which the application is installed is an environment such as a computer, tablet PC, or smartphone, which consists of CPU, RAM, ROM, and storage devices, and the entire system is controlled by a graphical operating system such as Windows, iOS, Android, and Linux. This is desirable, and is especially specialized for smartphones that can send and receive calls and texts to registered contacts.

In addition, the flowchart in the drawings attached to this specification is merely a flowchart for explaining the invention, and does not necessarily need to be a flowchart for perfect implementation without bugs on a computer.

Additionally, the terminals mentioned in this specification are general user terminals and may be smartphones, personal computers, tablet PCs, etc.

Figure 1 is a configuration diagram showing the configuration of equipment for monitoring an object using low power according to an embodiment of the present invention. Referring to Figure 1, a configuration according to the present invention is shown.

The monitoring device according to the present invention may include a motion sensor 110, a camera unit 120, a memory 140, and a control unit 130.

Additionally, the camera unit may include a microphone, an image sensor unit, a media processing unit, a camera processor, a temporary memory, and a computer vision classification processing unit. Additionally, the control unit may include a microcontroller, battery, and communication unit.

The motion sensor detects an object to be monitored, and when it is determined to be an object to be monitored, it can generate a wakeup signal to apply power to the camera included in the monitoring device and transmit it to the camera unit. there is. In addition, based on one or more of the size of the detected object, the moving speed of the object, the distance between the object and the monitoring device according to the present invention, and the moving direction of the object, the object may be a person, a vehicle, an animal such as a companion animal, or other You can determine whether it is an object. The motion sensor may be a radar sensor.

The camera unit may supply power to drive the image sensor unit, media processing unit, and computer vision classification processing unit. The operation of this camera unit can be operated under a real-time operating system (RTOS: Real-Time Operating System). The camera unit to which power is applied can quickly perform an operation to photograph a surveillance object.

The media processing unit may receive data of the image captured by the image sensor unit, encode it, and store it in temporary memory.

Temporary memory may not be an external memory that can be freely inserted or removed from the monitoring device.

If the computer vision classification processor analyzes the image data stored in the temporary memory and determines the existence or range of the object to be monitored, the operating system (OS) of the surveillance device can boot.

The camera processor can control the overall operation of the camera unit.

The microcontroller in the control unit can control the overall operation of the monitoring device, and the battery serves to supply overall power to the monitoring device. Preferably, the battery may be detachable from the monitoring device, or may be charged through a separate power supply line. For example, energy may be charged to the monitoring device of the present invention using a USB (Universal Serial Bus) cable.

The communication unit is responsible for transmitting information about the event of detecting an object to the outside. The information about the event may be not only information about whether the event occurred, the place where the event occurred, time, etc., but in some cases, it may be video information recorded from the event. Meanwhile, the communication unit of the present invention preferably adopts a BLE communication type communication module that can operate at low power.

Each configuration of the monitoring device according to the present invention can be further explained with FIGS. 2 to 4.

Figure 2 is a flow chart showing the sequence of a method for monitoring an object using low power according to an embodiment of the present invention. 2, sequences according to the present invention are shown.

More specifically, the motion sensor included in the monitoring device detects an object to be monitored (S402), and if the motion sensor determines that it is an object to be monitored, the motion sensor applies power to drive the camera included in the monitoring device. A wakeup signal is generated and transmitted to the camera unit (S404). At this time, power may not be applied to the camera unit. It is sufficient for the motion sensor to be supplied with sufficient power to enable the motion sensor to detect an object, and it is sufficient for the camera unit not to be supplied with power. Through this, it is possible to avoid wasting power by applying power to all parts necessary for monitoring, as in the prior invention. For reference, the microcontroller within the monitoring device can determine the operation of the monitored object by processing data generated by the motion sensor.

In addition, the motion sensor detects whether the object is a person, a vehicle, or an animal such as a companion animal based on one or more of the size of the detected object, the moving speed of the object, the distance between the object and the monitoring device according to the present invention, and the moving direction of the object. Or, it can be determined whether it is some other object. More specifically, the motion sensor may be a radar sensor, and the SC1233AR3 chip of Socionext (trademark) may be used. The radar sensor can detect objects at 5 to 10 Hz, which can vary depending on user settings, remaining battery capacity, or future battery charging plans. Meanwhile, the radar sensor is not limited to the motion sensor, and any type of sensor that can identify and determine the detected object, for example, an ultrasonic sensor, a microwave sensor, or a single-layer motion sensor, may be used. In addition, the motion sensor detects an object based on a change in physical space, but is not limited to this and may also detect a visual change in the object, such as a change in color or brightness of the object. For reference, the motion sensor may generate the wake-up signal through a motion sensor control engine (not shown).

The camera unit that receives the wake-up signal applies power to drive the image sensor unit, media processing unit, and computer vision classification processing unit (S406). The applied power can be drawn through a battery provided in the monitoring device. Through this, the camera unit can boot all the components necessary to analyze the video and enter a ready state. Meanwhile, the image sensor unit, media processing unit, and computer vision classification processing unit may be provided inside the camera unit. Meanwhile, it is desirable that the camera unit operates under a real-time operating system.

The camera unit to which power is applied quickly performs an operation to photograph the object to be monitored. Specifically, first, AE (Autoexposure), which automatically obtains appropriate exposure by adjusting the shutter speed and aperture value according to light conditions through automatic exposure, AF (Autofocus), which automatically adjusts the focus of the camera lens through autofocus, and automatically obtains white light. You can reach a state where you can shoot by initializing AWB (Automatic White Balance), which adjusts the balance. Meanwhile, the camera unit may initialize all of the AE, AF, and AWB, but it is not limited to this, and in some cases, only AE and AWB may be initialized. It is enough to initialize the camera unit so that it can take pictures. Additionally, the camera unit can initialize the video encoder of the media processing unit. Additionally, the camera unit can initialize the microphone for use.

The media processing unit may receive data of the image captured by the image sensor unit, encode it, and store it in temporary memory (S410). The temporary memory is not an external memory that can be freely inserted or removed from the monitoring device. Specifically, the temporary memory is not a NAND flash memory. In this way, by not using memory of the NAND flash memory series that can be inserted and separated as temporary memory, the monitoring device can operate relatively quickly and use power efficiently.

Next, when the computer vision classification processor analyzes the image data stored in the temporary memory and determines one or more of the existence or range of the object to be monitored, the operating system (OS) of the surveillance device boots. You can (S414). If the computer vision classification processing unit analyzes the image stored in the temporary memory and determines that no object is detected, the camera unit returns to standby mode and cuts off power consumption. In addition, the process returns to the step where the motion sensor detects the object (S402). Meanwhile, if the computer vision classification processing unit determines that an object to be detected exists, the entire operating system that manages the monitoring device boots and prepares for processing. In this specification, this may be referred to as operation in full operating system mode (Full OS mode). The entire operating system that manages the monitoring device may be Linux, but is not limited to this, and any operating system that can manage all parts of the monitoring device is sufficient.

More specifically, the computer vision classification processing unit can process the first few images of the surveillance object received from the image sensor unit. In addition, the computer vision classification processing unit can determine whether the object to be monitored on the image is a person, a vehicle, an animal, or another object through an algorithm installed through artificial intelligence learning, and the object to be monitored is the surveillance device seen. You can also determine how far away it is. The computer vision classification processing unit of the present invention can determine this through perspective and artificial intelligence learning. As previously explained, data processed in this way may be stored in temporary memory.

Meanwhile, it is desirable for the computer vision classification processing unit to operate under a real-time operating system. However, the present invention is not limited to the computer vision classification processor necessarily operating on a real-time operating system. Features and descriptions of the real-time operating system are omitted.

Next, this monitoring device can record video or perform a given operation in full operating system mode (S416). More specifically, the video input through the camera unit or the voice input through the microphone can be stored in external memory or hard drives, etc., rather than in temporary memory. The external memory may be a NAND flash memory series, and may be Secure Digital, CompactFlash, Memory Stick, UFS card, XQD, USB memory, etc. depending on the commercial classification or product name. Meanwhile, in addition to the above-mentioned memory card type flash memory, SSD (solid-state storage) type memory may be used.

In addition, the video analysis method recorded or processed by this surveillance device in the full operating system mode may be the same as the method used by the computer vision classification processor in the real-time operating system, or other methods such as human face detection or vehicle license plate recognition may be additionally used or other methods may be used. Method alone may be used.

Additionally, this monitoring device can transmit the above data to the outside through a communication unit. Meanwhile, the operation of this monitoring device is not limited to recording video or audio, and all information that can be collected by this monitoring device can be stored or the collected information can be transmitted to the outside. For example, the location of the monitoring device obtained through a positioning sensor such as a GPS sensor that the monitoring device may include, or the time the entire operating system mode was entered, can be stored and transmitted to the outside. Of course, it should be noted that the present invention is not limited to this.

Meanwhile, when this monitoring device enters the full operating system mode and starts operating, the camera unit can transmit event occurrence information to the control unit of the monitoring device, and transmit the event occurrence information to the outside through the communication unit included in the monitoring device. (S422). In the event occurrence information, an event occurs when it is determined that a surveillance target exists through the motion sensor and camera unit of this monitoring device, and this can be referred to as an event occurrence.

Meanwhile, there is no need for any steps to precede S416 and S422, and step S422 may be performed after step S416, or vice versa, or steps S416 and S422 may be performed simultaneously.

This monitoring device determines whether the object to be monitored deviates from a predetermined distance or space, or reaches a predetermined condition (S418), and the monitoring device continuously performs predetermined operations. More specifically, when the monitoring device detects an object to be monitored and determines that it is an object to be monitored, it can track the object to be monitored until it is no longer captured by the image sensor unit or the distance becomes sufficiently far. The concept of tracking in this specification can be the concept of continuously filming focusing on meaningful parts of the object to be monitored. For example, if the surveillance target is a vehicle, continuous filming can be performed focusing on the vehicle's license plate or the driver's seat of the vehicle. Additionally, tracking can be a concept of continuous filming when a surveillance object exists within a predetermined distance from the monitoring device.

The predetermined operation may be an operation of recording or recording an image of a surveillance target, as described above. Meanwhile, in the flowchart of FIG. 2, it is started as determining whether the object is out of range (S418), but the present invention is not limited to this, and as described above, it can be determined whether a predetermined condition is met. For example, if a vehicle appears within the detection area of the surveillance device's motion sensor, the surveillance device can record video of the vehicle in full operating system mode, but after the vehicle appears in the surveillance device's monitoring range, the surveillance device can simply If the vehicle is continuously parked at the same spot after stopping, the monitoring device according to the present invention can determine that the object to be monitored no longer meets the monitoring conditions and stop video recording. Through this, the loss of unnecessary power consumption can be prevented, and the amount of image data that the user must review later can be reduced.

Meanwhile, referring to FIG. 4, the predetermined condition (second predetermined condition) is when the object to be monitored is within a predetermined range from the monitoring device or the image of the object to be monitored is within the imaging area of the image sensor unit. , This is a case where the monitoring device determines that there is no movement for a predetermined period of time (S421). The predetermined time may be, for example, 5 minutes, but is not limited thereto and can be adjusted according to the user's selection.

Meanwhile, the monitoring device according to the present invention may switch the camera unit to standby mode according to the second predetermined condition, but if the monitoring device detects the movement or change of the object to be monitored again, it branches to step S402. You can perform the operation by doing this. The above changes may include the generation of sparks or smoke due to a fire, or changes in the color or brightness of visual indicators that indicate whether various devices such as camcorders or recorders are operating. Through this, even objects to be monitored that exist within the sensing device according to the present invention but do not move quietly, so the need for monitoring is reduced, can be closely monitored by detecting changes or intention of operation of the objects to be monitored.

In some cases, the monitoring device of the present invention includes a radio signal detection module (not shown in the drawing) capable of sensing wireless signals, and when it is determined that the object to be monitored is generating a specific radio signal, according to the present invention The monitoring device can perform predetermined operations such as recording through a camera unit and receiving and storing the specific radio signal.

Referring to Figure 5, the monitoring device according to the present invention may be configured to include a battery 131, a camera unit 120, a fixing unit 129, a connecting unit 128, etc. The fixing part can serve to fix the device by attaching it to the windshield of a vehicle or a place where the monitoring device is to be fixed, and the battery can supply power through the camera part and the connection part. The battery may be fixed to the camera unit through magnetic force, etc., but is not limited to this. Meanwhile, the configuration diagram of FIG. 1 shows that the battery is included in the control unit, but the battery unit can be configured to be separate and detachable as in the embodiment of FIG. 5.

Referring to Figure 6, the concept of a user terminal communicating with a monitoring device according to the present invention through wireless communication such as Bluetooth is shown. Through this, instead of inputting commands through a small-sized display for input and output like a conventional vehicle monitoring device, the commands and controls required for the monitoring device are conveniently transmitted from the user terminal through direct communication with the user terminal. , you can receive the results.

According to an embodiment of the present invention, the monitoring device according to the present invention can be used in a vehicle black box. More specifically, unlike conventional vehicle black boxes, the monitoring device according to the present invention does not draw power from a vehicle battery mounted on the vehicle, but rather detects, judges, and photographs objects through a battery separately provided in the monitoring device according to the present invention. can do.

According to another embodiment of the present invention, the monitoring device according to the present invention can be installed and used in homes, offices, various stores, etc. For example, if a monitoring device according to the present invention is placed at an appropriate location in a home or office, and a person with an unlawful purpose enters the home, office, or warehouse, the person is detected and judged to be a detection target object. You can photograph or record the object under surveillance. In addition, an alarm message can be transmitted to the user of the surveillance device through wireless communication or the like when filming or recording ends or begins. Additionally, in some cases, photographed or recorded data can also be transmitted to the desired destination using various network topologies, such as BLE, WIFI, 3G, and 4G LTE, through the communication unit within the surveillance device. Various methods are conventional methods, and their description is omitted in this specification.

According to another embodiment according to the present invention, in order to consume low power, the monitoring device according to the present invention can accumulate data including event information about the object to be monitored and then transmit it to the user's device at once. there is. More specifically, the monitoring device according to the present invention may not include a WiFi communication module using the 2.4 gigahertz UHF and 5 gigahertz SHF ISM wireless bands to reduce mass production and power consumption. Instead, the monitoring device according to the present invention is in a standby mode in which no object is detected, or when the user's mobile device approaches the monitoring device according to a command according to user operation, it automatically detects the user's mobile device using BLE (Bluetooth Low Energy) method. Communication is established between the device and the monitoring device, allowing data to be sent and received. Among the data, there may be timestamps, location information, types of objects to be monitored, snapshot images for each event, etc.

The methods and processes described above may be encoded, for example, as instructions for execution by a processor, controller, or other processing device, such as compact disk read only memory (CDROM), magnetic or optical disk, flash memory, random access memory. They may be stored in machine-readable or computer-readable media, such as read-only memory (RAM), erasable programmable read-only memory (EPROM), or other machine-readable media.

Such a medium may be implemented as any device that contains, stores, communicates, propagates or transports executable instructions for use by or in connection with an instruction-executable system, apparatus or device. Alternatively or additionally, as analog or digital logic using hardware, such as one or more integrated circuits, or one or more processors executing instructions; or by software whose functions are defined as an application programming interface (API) or a dynamic link library (DLL), either local or remote procedure calls, or available in shared memory; Alternatively, it may be implemented as a combination of hardware and software.

In other implementations, the method may be represented by a signal or radio-signal medium. For example, instructions implementing the logic of any given program may take the form of electrical, magnetic, optical, electromagnetic, infrared, or other types of signals. The above-described system may receive such signals at a communications interface, such as a fiber optic interface, antenna, or other analog or digital signal interface, retrieve instructions from the signals, store them in machine-readable memory, and/or utilize a processor. You can also run them.

Additionally, the present invention may be implemented in hardware or software. Implementation: The present invention can also be implemented as computer-readable code on a computer-readable recording medium. Computer-readable recording media include all types of recording devices that store data that can be read by a computer system. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage devices, and can also be implemented in the form of a carrier wave (e.g., transmitted via the Internet). Includes. Additionally, computer-readable recording media can be distributed across computer systems connected to a network, so that computer-readable code can be stored and executed in a distributed manner. And functional programs, codes, and code segments for implementing the present invention can be easily deduced by programmers in the technical field to which the present invention pertains.

Embodiments of the invention may include a carrier wave with electronically readable control signals that can be operated by a programmable computer system executing one of the methods described herein. Embodiments of the invention may be implemented as a computer program product having program code that operates to execute one of the methods when the computer program runs on a computer. The program code may be stored, for example, on a machine-readable carrier. One embodiment of the invention may be a computer program having program code for executing one of the methods described herein when the computer program is run on a computer. The invention may include a computer, or programmable logic device, for executing one of the methods described above. Programmable logic devices (e.g., field programmable gate arrays, complementary metal oxide semiconductor based logic circuits) may be used to implement some or all of the functions of the methods described above.

Above, an embodiment of the present invention has been described, but those skilled in the art can add, change, delete or add components without departing from the spirit of the present invention as set forth in the patent claims. The present invention may be modified and changed in various ways, and this will also be included within the scope of rights of the present invention.

The present invention can be used in a device that efficiently monitors the surroundings in an environment where power supply is difficult.

Claims

In a method for a monitoring device to detect an object using low power,

An object detection step in which a motion sensor included in the monitoring device detects an object;

When the motion sensor determines the object to be monitored in the object detection step, the motion sensor transmitting a wakeup signal to the camera unit to apply driving power to the camera unit included in the monitoring device;

A camera unit driving power application step in which the camera unit applies driving power to an image sensor unit, an image encoding media processing unit, and a computer vision classification processing unit included in the monitoring device;

Initializing the image sensor unit by including the camera unit at least one of AF, AE, and AWB;

An image encoding and storage step in which the media processing unit encodes the image input to the image sensor unit and stores the generated image data in a temporary memory;

When the computer vision classification processing unit analyzes the image data stored in the temporary memory and determines one or more of the existence or range of the object to be monitored, it includes an operating system booting step in which the operating system (OS) of the surveillance device boots. A method for detecting objects using low power, characterized in that:
The method of claim 1, wherein in the object detection step,

A method of detecting an object using low power, characterized in that no power is applied to the camera unit.
The method of claim 1, wherein in the object detection step,

The motion sensor detects an object using low power, characterized in that it determines whether the object is a person, a vehicle, or another object based on one or more of the size of the detected object, the moving speed of the object, and the moving direction of the object. How to.
The method of claim 1, wherein in the step of applying driving power to the camera unit,

A method of detecting an object using low power, characterized in that the camera unit operates in a real-time operating system (RTOS) mode that supplies power to the components necessary for operation of the camera unit.
The method of claim 1, wherein in the video encoding and storage step,

A method for detecting an object using low power, wherein the temporary memory is not a removable memory according to user convenience.
The method of claim 1, after the operating system booting step,

The monitoring device further comprises performing a predetermined operation when the object to be monitored is within a predetermined range from the monitoring device or when the image of the object to be monitored is within an imaging area of the image sensor unit. A method for detecting objects using low power.
The method of claim 1, after the operating system booting step,

The monitoring device further includes a step of operating until the object to be monitored moves out of a predetermined range from the monitoring device or the image of the object to be monitored moves out of the imaging area of the image sensor unit. How to detect objects.
The method of claim 6, wherein the operation is to record video or audio.
The method of claim 6, wherein after performing the predetermined operation,

A method of detecting an object using low power, wherein the monitoring device switches the camera unit to a standby mode when the object to be monitored meets a second predetermined condition.
According to clause 9,

The second predetermined condition is that the object to be monitored is within a predetermined range from the monitoring device or the image of the object to be monitored is within the imaging area of the image sensor unit and does not move for a predetermined time. A method of detecting an object using low power, characterized in that the monitoring device determines that this is the case.
The method of claim 1, after the operating system booting step,

The camera unit transmitting event occurrence information to a control unit of the monitoring device; and

A method of detecting an object using low power, characterized in that the monitoring device further includes the step of transmitting the event occurrence information to the outside through a communication unit included in the monitoring device.
According to paragraph 1,

A method of detecting an object using low power, wherein the motion sensor is a radar sensor.
In a method for a monitoring device to detect an object using low power,

An object detection step in which a motion sensor included in the monitoring device detects an object;

When the motion sensor determines the object to be monitored in the object detection step, the motion sensor transmitting a wakeup signal to the camera unit to apply driving power to the camera unit included in the monitoring device;

A camera unit driving power application step in which the camera unit applies driving power to an image sensor unit, an image encoding media processing unit, and a computer vision classification processing unit included in the monitoring device;

Initializing the image sensor unit including AF, AE, and AWB control;

An image encoding and storage step in which the media processing unit encodes the image input to the image sensor unit and stores the generated image data in a temporary memory;

A method of detecting an object using low power, wherein when the computer vision classification processing unit cannot determine the existence and range of the object to be monitored by analyzing the image data stored in the temporary memory, the camera unit switches to standby mode. .
A computer program stored in a recording medium that executes the method for detecting an object using low power according to any one of claims 1 to 13.
In a monitoring device that detects an object using low power,

The monitoring device includes a motion sensor that detects a monitoring object and, when the monitoring object is identified, transmits a wakeup signal to the camera unit to apply driving power to the camera unit included in the monitoring device;

It includes an image sensor unit, a media processing unit that encodes images, a computer vision classification processing unit, and a camera unit including temporary memory,

The camera unit initializes the image sensor unit including at least one of AF, AE, and AWB, encodes the image input to the image sensor unit, and stores the generated image data in a temporary memory, and the computer vision classification processing unit stores the image data generated by encoding the image input to the image sensor unit. Characterized in that the operating system (OS) of the monitoring device boots when the existence or range of the object to be monitored is determined by analyzing the image data stored in the temporary memory.

A monitoring device that detects objects using low power.