KR20150029266A - Dangerous situations in real-time video detection and notification system - Google Patents

Dangerous situations in real-time video detection and notification system Download PDF

Info

Publication number
KR20150029266A
KR20150029266A KR20130108183A KR20130108183A KR20150029266A KR 20150029266 A KR20150029266 A KR 20150029266A KR 20130108183 A KR20130108183 A KR 20130108183A KR 20130108183 A KR20130108183 A KR 20130108183A KR 20150029266 A KR20150029266 A KR 20150029266A
Authority
KR
South Korea
Prior art keywords
dangerous situation
present
dangerous
real
vehicle
Prior art date
Application number
KR20130108183A
Other languages
Korean (ko)
Inventor
김양웅
Original Assignee
주식회사 시티캣
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 시티캣 filed Critical 주식회사 시티캣
Priority to KR20130108183A priority Critical patent/KR20150029266A/en
Publication of KR20150029266A publication Critical patent/KR20150029266A/en

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/08—Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
    • B60W30/095—Predicting travel path or likelihood of collision
    • B60W30/0956—Predicting travel path or likelihood of collision the prediction being responsive to traffic or environmental parameters
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/10—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to vehicle motion
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146—Display means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403—Image sensing, e.g. optical camera

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Traffic Control Systems (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

The present invention relates to a dangerous situation detection in a real time and to an alarm system. The present invention detects a dangerous situation from an image inputted through an image photographing device in real time and confirms a user about the dangerous situation. The present invention includes the steps of: recognizing an object from images photographed and continued from the photographing device and dividing the kind of the object (A); determining the driving state of a vehicle from the images continuously photographed object (B); classifying the photographed images of the object (C); determining the operation state of the dangerous situation object (D); determining the dangerous situation according to the operation state of the dangerous situation object (E); and displaying the dangerous situation to a driver (F). According to the present invention, the present invention has an effect of sensing the dangerous situation previously and confirming the user about the dangerous situation by using a black box for vehicle to record a video generally.

Description

실시간 영상에서 위험상황 검출 및 알림 시스템{Dangerous situations in real-time video detection and notification system}[0001] Dangerous situations in real-time video [0002]

본 발명은 차량용 실시간 영상 촬상장치를 통해 입력된 영상으로부터 위험사항을 검출하여 이를 사용자에게 알려주는 실시간 영상에서 위험상황 검출 및 알림 시스템에 관한 것이다.
The present invention relates to a detection and notification system for a dangerous situation in a real-time image that detects a dangerous item from an image input through a real-time image-capturing apparatus for a vehicle and informs the user of the dangerous situation.

최근에는 차량 사고시 사고 정황을 증빙하기 위하여 차량용 실시간 영상 촬상장치(블랙박스)가 널리 보급되어 사용되고 있다. 그러나 종래의 블랙박스는 사고발생 시 증거자료 등으로 사용되기 위한 사후처리용 기기로만 사용되고 있고, 평상시 주행때는 녹화 기능만을 하는 고화질, 고성능의 잉여자원으로만 사용되고 있다.In recent years, a real-time image pickup device (black box) for a vehicle has been widely used and used in order to prove an accident situation in a car accident. However, the conventional black box is used only as a post-processing device for use as evidence in the event of an accident, and is used only as a high-quality, high-performance surplus resource that only performs a recording function in normal driving.

한편, 최근 영상 인식기술은 날로 발전하고 있으며, 이미지의 특정 부분을 실시간으로 추출하는 기술이 개발되어 적용되고 있다. 예를 들어 카메라를 통해 촬영된 영상을 이용하여 자동으로 특정 타겟을 추출하고, 타겟에 대한 정보를 인식하기 위한 기술이 활발하게 연구되고 있다. On the other hand, recent image recognition technology is evolving and a technique of extracting a specific part of an image in real time has been developed and applied. For example, techniques for automatically extracting a specific target using an image captured through a camera and recognizing information about the target have been actively studied.

또한, 이들 영상인식기술을 이용하여 이용자가 입력한 제품이미지와 가장 유사한 이미지를 갖는 제품을 선별하여 검색하는 상품 검색 기술이 대한민국 공개 특허 10-2012-0001285호 등의 선행 기술에 개시되어 있다.Further, a product search technique for selecting and searching products having an image most similar to a product image inputted by a user using these image recognition technologies is disclosed in prior arts such as Korean Patent Laid-Open No. 10-2012-0001285.

이와 같이, 영상 인식 기술은 발전하고 있음에도 불구하고, 차량용 블랙박스는 영상을 사후 증거자료용으로 녹화의 기능만을 수행하고 있으므로, 효율성 면에서 사고를 미연에 방지하고 예방할 수 없는 문제점이 있었다.
As described above, although the image recognition technology has been developed, the vehicle black box has a problem in that it can not prevent an accident from occurring in terms of efficiency and can not prevent it, because the image only performs recording function for post-evident document.

대한민국 공개 특허 10-2012-0001285호Korean Patent Publication No. 10-2012-0001285

본 발명은 상기와 같은 종래의 문제점을 해결하기 위하여 안출된 것으로, 본 발명은 블랙박스를 일반적인 주행 상황에서 사용이 가능하도록 영상인식 기능을 탑재하여 위험 상황 감지시 사용자에게 알람등의 방법으로 알려줄 수 있는 실시간 영상에서 위험상황 검출 및 알림 시스템을 제공하고자 한 것이다.
Disclosure of Invention Technical Problem [8] The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide an image recognition function to enable a black box to be used in a general driving situation, And to provide a risk detection and notification system in real time video.

상기한 바와 같은 목적을 달성하기 위한 본 발명의 특징에 따르면, 본 발명은 (A) 촬상장치로부터 연속하여 촬상된 이미지들로부터 대상체를 인식하여, 상기 대상체의 종류를 구분하는 단계와; (B) 상기 대상체의 연속된 촬상된 이미지들로부터 차량의 운행상태를 판단하는 단계와; (C) 상기 대상체들 중 위험요소 대상체를 분류하는 단계와; (D) 상기 위험요소 대상체의 동작상태를 판단하는 단계와; (E) 상기 차량의 운행상태, 위험요소 대상체의 존부 및 상기 위험요소 대상체의 동작상태레 따라 위험상황을 판단하는 단계와; (F) 상기 위험상황을 운전자에게 표시하는 단계를 포함하여 수행된다.
According to an aspect of the present invention for achieving the above object, the present invention provides an image processing method comprising the steps of: (A) identifying a target object from images continuously picked up from an image pickup device and sorting the target object; (B) judging the running state of the vehicle from the successively captured images of the object; (C) classifying the hazardous object among the objects; (D) judging an operation state of the dangerous object; (E) determining a dangerous situation according to a driving state of the vehicle, a presence of a dangerous object, and an operational state of the dangerous object; (F) displaying the dangerous situation to the driver.

위에서 살핀 바와 같은 본 발명에 의한 실시간 영상에서 위험상황 검출 및 알림 시스템에서는 다음과 같은 효과를 기대할 수 있다.The following effects can be expected in the danger detection and notification system in the real-time image according to the present invention as described above.

즉, 본 발명에서는 일반적으로 영상의 녹화만을 목적으로 하는 차량용 블랙박스를 이용하여, 위험상황을 미연에 감지하여 사용자에게 위험상황을 고지할 수 있는 효과가 있다.
That is, according to the present invention, there is an effect that a dangerous situation can be notified to a user by sensing a dangerous situation in advance by using a black box for a vehicle for video recording only.

도 1은 종래기술에 의한 상품 검색 방법을 도시한 흐름도.
도 2는 본 발명에 의한 실시간 영상에서 위험상황 검출 및 알림 시스템의 동작 상태를 도시한 예시도.Brief Description of the Drawings Fig. 1 is a flow chart showing a product search method according to the prior art; Fig.
BACKGROUND OF THE INVENTION 1. Field of the Invention [0001]

이하에서는 본 발명에 의한 대량의 실시간 영상에서 위험상황 검출 및 알림 시스템을 도면을 참조하여 상세히 설명하기로 한다.DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a risk detection and notification system in a large amount of real-time images according to the present invention will be described in detail with reference to the drawings.

도 2는 본 발명에 의한 실시간 영상에서 위험상황 검출 및 알림 시스템의 동작 상태를 도시한 예시도이다.FIG. 2 is an exemplary view showing an operation state of a dangerous situation detection and notification system in a real-time image according to the present invention.

본 발명에 의한 실시간 영상에서 위험상황 검출 및 알림 시스템은, 도 2에 도시된 바와 같이, 차량의 주행 상태를 구분하고, 촬상된 이미지로부터 대상체를 검출하여, 검출된 대상체의 종류 및 동작상태 판단하여 이들 결과로부터 위험요소를 판단한다.As shown in FIG. 2, the dangerous situation detection and notification system in the real-time image according to the present invention classifies the running state of the vehicle, detects a target object from the sensed image, determines the type and operating state of the detected target object The risk factors are judged from these results.

이후, 판단된 위험요소에 따라 운전자에게 위험요소를 안내하여 운전자가 위험상황을 미리 감지하여 사고를 예방할 수 있도록 한다.Then, according to the determined risk factors, the risk factors are informed to the driver so that the driver can detect the dangerous situation in advance to prevent the accident.

본 발명의 권리는 위에서 설명된 실시예에 한정되지 않고 청구범위에 기재된 바에 의해 정의되며, 본 발명의 분야에서 통상의 지식을 가진 자가 청구범위에 기재된 권리범위 내에서 다양한 변형과 개작을 할 수 있다는 것은 자명하다.
It is to be understood that the invention is not limited to the disclosed embodiment, but is capable of many modifications and variations within the scope of the appended claims. It is self-evident.

본 발명은 차량용 실시간 영상 촬상장치를 통해 입력된 영상으로부터 위험사항을 검출하여 이를 사용자에게 알려주는 실시간 영상에서 위험상황 검출 및 알림 시스템에 관한 것으로, 본 발명에 의하면, 일반적으로 영상의 녹화만을 목적으로 하는 차량용 블랙박스를 이용하여, 위험상황을 미연에 감지하여 사용자에게 위험상황을 고지할 수 있는 효과가 있다.The present invention relates to a risk detection and notification system for detecting a dangerous situation from a video input through a real-time image capturing apparatus for a vehicle and informing a user of the dangerous situation. In accordance with the present invention, A black box for a vehicle is used to detect a dangerous situation and notify the user of a dangerous situation.

Claims (1)

(A) 촬상장치로부터 연속하여 촬상된 이미지들로부터 대상체를 인식하여, 상기 대상체의 종류를 구분하는 단계와;
(B) 상기 대상체의 연속된 촬상된 이미지들로부터 차량의 운행상태를 판단하는 단계와;
(C) 상기 대상체들 중 위험요소 대상체를 분류하는 단계와;
(D) 상기 위험요소 대상체의 동작상태를 판단하는 단계와;
(E) 상기 차량의 운행상태, 위험요소 대상체의 존부 및 상기 위험요소 대상체의 동작상태레 따라 위험상황을 판단하는 단계와;
(F) 상기 위험상황을 운전자에게 표시하는 단계를 포함하여 수행됨을 특징으로 하는 실시간 영상에서 위험상황 검출 및 알림 시스템.(A) recognizing a target object from images continuously picked up from an image pickup device and sorting the target object;
(B) judging the running state of the vehicle from the successively captured images of the object;
(C) classifying the hazardous object among the objects;
(D) judging an operation state of the dangerous object;
(E) determining a dangerous situation according to a driving state of the vehicle, a presence of a dangerous object, and an operational state of the dangerous object;
(F) displaying the dangerous situation to a driver.
KR20130108183A 2013-09-10 2013-09-10 Dangerous situations in real-time video detection and notification system KR20150029266A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR20130108183A KR20150029266A (en) 2013-09-10 2013-09-10 Dangerous situations in real-time video detection and notification system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR20130108183A KR20150029266A (en) 2013-09-10 2013-09-10 Dangerous situations in real-time video detection and notification system

Publications (1)

Publication Number Publication Date
KR20150029266A true KR20150029266A (en) 2015-03-18

Family

ID=53023790

Family Applications (1)

Application Number Title Priority Date Filing Date
KR20130108183A KR20150029266A (en) 2013-09-10 2013-09-10 Dangerous situations in real-time video detection and notification system

Country Status (1)

Country Link
KR (1) KR20150029266A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108944923A (en) * 2017-05-24 2018-12-07 丰田自动车株式会社 Collision elimination control device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108944923A (en) * 2017-05-24 2018-12-07 丰田自动车株式会社 Collision elimination control device
CN108944923B (en) * 2017-05-24 2021-11-30 丰田自动车株式会社 Collision avoidance control device

Similar Documents

Publication Publication Date Title
US9911055B2 (en) Method and system for detection and classification of license plates
US7961953B2 (en) Image monitoring system
JP6764481B2 (en) Monitoring device
KR101935399B1 (en) Wide Area Multi-Object Monitoring System Based on Deep Neural Network Algorithm
US9230180B2 (en) Eyes-off-the-road classification with glasses classifier
US9286512B2 (en) Method for detecting pedestrians based on far infrared ray camera at night
KR101492473B1 (en) Context-aware cctv intergrated managment system with user-based
US9715632B2 (en) Intersection recognizing apparatus and computer-readable storage medium
KR101736173B1 (en) Apparatus and method for fast detection of object of interests
CN110610137B (en) Method and device for detecting vehicle running state, electronic equipment and storage medium
JP2007310706A (en) Vehicle periphery monitoring device
JP2017103748A (en) Image processing method and program
WO2015186395A1 (en) Vehicle periphery monitoring device
US20120056995A1 (en) Method and Apparatus for Stereo-Based Proximity Warning System for Vehicle Safety
KR20150029266A (en) Dangerous situations in real-time video detection and notification system
JP2017058950A (en) Recognition device, image pickup system, and image pickup device, and recognition method and program for recognition
EP3380368B1 (en) Object detection system and method thereof
US9030560B2 (en) Apparatus for monitoring surroundings of a vehicle
JP2000125288A (en) Object tracking method and object tracking device
CN107680118B (en) Image identification tracking method
Tripathi et al. A framework for suspicious object detection from surveillance video
EP2988250A1 (en) Vision system and method for a motor vehicle
JP2008040724A (en) Image processing device and image processing method
KR20150029267A (en) The target and context -aware way to share
US10846840B2 (en) Image recognition device

Legal Events

Date Code Title Description
WITN Application deemed withdrawn, e.g. because no request for examination was filed or no examination fee was paid