TR2022011598A2 - A METHOD AND SYSTEM FOR ANALYSIS OF IN-CAR CAMERA DATA - Google Patents

A METHOD AND SYSTEM FOR ANALYSIS OF IN-CAR CAMERA DATA

Info

Publication number
TR2022011598A2
TR2022011598A2 TR2022/011598A TR2022011598A TR2022011598A2 TR 2022011598 A2 TR2022011598 A2 TR 2022011598A2 TR 2022/011598 A TR2022/011598 A TR 2022/011598A TR 2022011598 A TR2022011598 A TR 2022011598A TR 2022011598 A2 TR2022011598 A2 TR 2022011598A2
Authority
TR
Turkey
Prior art keywords
vehicle
camera
image
damage
accident
Prior art date
Application number
TR2022/011598A
Other languages
Turkish (tr)
Inventor
Türkoğlu Burak
Original Assignee
Visucar Ileri Teknolojiler Yazilim Ve Danismanlik Sanayi Ticaret Anonim Sirketi
Visucar İleri̇ Teknoloji̇ler Yazilim Ve Danişmanlik Sanayi̇ Ti̇caret Anoni̇m Şi̇rketi̇
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Visucar Ileri Teknolojiler Yazilim Ve Danismanlik Sanayi Ticaret Anonim Sirketi, Visucar İleri̇ Teknoloji̇ler Yazilim Ve Danişmanlik Sanayi̇ Ti̇caret Anoni̇m Şi̇rketi̇ filed Critical Visucar Ileri Teknolojiler Yazilim Ve Danismanlik Sanayi Ticaret Anonim Sirketi
Priority to TR2022/011598A priority Critical patent/TR2022011598A2/en
Publication of TR2022011598A2 publication Critical patent/TR2022011598A2/en
Priority to PCT/TR2023/050700 priority patent/WO2024019693A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/59Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0639Performance analysis of employees; Performance analysis of enterprise or organisation operations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation; Time management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0645Rental transactions; Leasing transactions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q40/00Finance; Insurance; Tax strategies; Processing of corporate or income taxes
    • G06Q40/08Insurance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/26Government or public services
    • G06Q50/265Personal security, identity or safety
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/40Business processes related to the transportation industry
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/143Alarm means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403Image sensing, e.g. optical camera
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/229Attention level, e.g. attentive to driving, reading or sleeping
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2756/00Output or target parameters relating to data
    • B60W2756/10Involving external transmission of data to or from the vehicle
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00Machine learning

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Human Resources & Organizations (AREA)
  • Strategic Management (AREA)
  • Economics (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Marketing (AREA)
  • General Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Development Economics (AREA)
  • Tourism & Hospitality (AREA)
  • Finance (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Educational Administration (AREA)
  • General Health & Medical Sciences (AREA)
  • Automation & Control Theory (AREA)
  • Primary Health Care (AREA)
  • Health & Medical Sciences (AREA)
  • Quality & Reliability (AREA)
  • Operations Research (AREA)
  • Game Theory and Decision Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Data Mining & Analysis (AREA)
  • Mechanical Engineering (AREA)
  • Technology Law (AREA)
  • Human Computer Interaction (AREA)
  • Transportation (AREA)
  • Multimedia (AREA)
  • Financial Or Insurance-Related Operations Such As Payment And Settlement (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Traffic Control Systems (AREA)

Abstract

Buluş, başta araç kiralama hizmeti veren şirketlerin kullanımına yönelik olmak üzere, her türlü amaç ile kullanılan araçlarda, araç kullanıcısının, diğer servis kullanıcılarının, filo yöneticilerinin, sigorta şirketlerinin ve emniyet birimlerinin ortaya çıkabilecek kaza, kötü kullanım, hasar gibi durumlarda anlık ve sistematik olarak bilgilendirilmesine yönelik bir sistem ile ilgilidir.The invention is aimed at providing instant and systematic information to the vehicle user, other service users, fleet managers, insurance companies and security units in cases such as accidents, misuse and damage, in vehicles used for all kinds of purposes, especially for the use of companies providing car rental services. relates to a system.

Description

TARIFNAME ARAÇ içi KAMERA VERILERININ ANALIZINE YÖNELIK BIR YÖNTEM VE Teknolojik Alan: Bulus, basta araç kiralama hizmeti veren sirketlerin kullanimina yönelik olmak üzere, her türlü amaç ile kullanilan araçlarda, araç kullanicisinin, diger servis kullanicilarinin, filo yöneticilerinin, sigorta sirketlerinin ve emniyet birimlerinin ortaya çikabilecek kaza, kötü kullanim, hasar gibi durumlarda anlik ve sistematik olarak bilgilendirilmesine yönelik bir sistem ile ilgilidir. Teknigin Bilinen Durumu: Otomotiv araçlari günlük ve is hayatimizin önemli ihtiyaçlarindan biridir. Bu ihtiyaci karsilamak üzere çok sayida araç kiralama hizmet veren firma bulunmaktadir. Ister kiralik araçlarda, isterse de kiralik olmayan araçlarda, güvenlik, iletisim ve acil durumlar önem arz etmektedir. Tarifname konusu bulus burada bahsedilen konularda hizmet veren bir sistemi anlatmaktadir. Bilinen teknikte bazi sistemlerde de kamera içeren sistemler bulunmaktadir. Bu sistemlerde kameradan elde edilen görüntüler ile elde edilen temizlik bilgisi (bkz cleanliness modul) sadece filo yöneticisine ve kisitli durumlarda (bkz behavior modul) araci kullanan kisiye iletilmektedir. Fakat temizlik konusu tüm servis kullanicilarini ilgilendirmektedir. Araçlarin filo yöneticisi tarafindan her an temizlenemeyecegi düsünülürse, bu bilginin tüm kullanicilara paylasilmasi gerekmektedir. Önceki teknikte yaygin olarak gerçeklesen kaza durumundan bahsedilmemistir. Kaza durumunda iç kameradan alinan görüntü hem araç içini hem de aracin isik alan kisimlari sayesinde araç disini gösterebilecektir. Bu bilginin ilgili aktörlere (filo yöneticisi, sigorta sirketi, emniyet birimleri ve kaza yapan kisi) otomatik olarak aktarilmasi gerekmektedir. Bilinen teknikte, ayni sekilde araç içinde kullanici kaynakli bir hasar olmasi durumuna deginilmemistir. Araç içi hasari kontrol edilmemektedir. Bu durumda filo sahibi ve sigorta sirketi bilgilendirilmelidir. Ilave olarak araç içindeki kisilerin acil durumlarda görüntüyü kullanarak ilgili birimlere ulasmasi durumu bilinen teknikte yer almamaktadir. patent dokümaninda, araci kullanan kisinin araç içerisindeki davranisini gözlemek üzere bir iç kamera içeren bir sistemden bahsedilmektedir. Bahsedilen sistemde yemek yeme, içecek içme, sigara içme gibi kullanici davranislari izlenmektedir. Ayni zamanda araç içerisinde evcil hawan olup olmadigi, emniyet kemerinin bagli olup olmadigi gibi kontroller yapilmaktadir. Fakat dokümanda, araç içi ve araç disi hasarlari, acil durum sistemleri, temizlik kontrolü gibi konulardan bahsedilmemis, ayni zamanda bilgiler yalnizca araç kiralama sirketine aktarilmistir. Dokümandaki sistem, verileri ilgili olduklari alanlara göre ayiran ve ilgili birimleri (emniyet, sigorta sirketi, filo yönetimi gibi) bilgilendiren bir yönteme sahip degildir. Sonuç olarak teknigin bilinen durumunun asildigi ve dezavantajlarinin giderildigi yeni bir yöntem ve sisteme ihtiyaç duyulmaktadir. Bulusun Kisa Açiklanmasi: Bulus, basta araç kiralama sirketlerinin kullanimina yönelik olmak üzere her türlü araçlarda, araç içi ve disi kamera verilerini analiz ederek, ilgili birimleri bilgilendiren, teknigin bilinen durumunun asildigi, dezavantajlarinin giderildigi, ilave olarak ekstra avantajlar içeren bir yöntem ve sistemdir. Bulus ile filo yönetimleri, emniyet birimleri, sigorta sirketleri, sürücüler ve diger kullanicilar anlik ve sistematik olarak bilgilendirilebilmektedir. Son kullanimdan sonra elde edilen araç içi görüntüsü tüm sistem kullanicilari ile paylasilmaktadir. Böylece temizlik derecesi tespiti ve buna göre aksiyon alma imkani dogacaktir. Son kullanim sonrasi yapay zeka algoritmasi ile bir araç temizlik skoru hesaplanmakta ve hesaplanan araç temizlik skoru tüm kullanicilar ile paylasilmaktadir. Son kullanim sonrasi iç hasar tespit modülü ile iç hasar olusup olusmadigi degerlendirilmekte ve iç hasar olusmasi durumunda sigorta sirketi ve filo sirketine görüntü ile beraber iletilmektedir. Herhangi bir kaza durumunun tespit edilmesi durumunda ilgili görüntü emniyet birimleri, filo yöneticisi ve sigorta sirketi ile paylasilmaktadir. Acil çagri butonuna basilmasi durumunda görüntü emniyet birimleri ve filo sirketi ile paylasilmaktadir. E-call hizmeti aktif edilecektir (eger araçta varsa entegre edilebilmektedir.). E-call hizmeti görüntülü olarak saglanmaktadir. Sekillerin Açiklanmasi: Bulus, ilisikteki sekillere atifta bulunularak anlatilacaktir, böylece bulusun özellikleri daha net anlasilacaktir. Ancak, bunun amaci bulusu bu belli düzenlemeler ile sinirlamak degildir. Tam aksine, bulusun ilisikteki istemler tarafindan tanimlandigi alani içine dâhil edilebilecek bütün alternatif, degisiklik ve denkliklerinin kapsanmasi da amaçlanmistir. Gösterilen ayrintilar, sadece mevcut bulusun tercih edilen düzenlemelerinin anlatimi amaciyla gösterildigi ve hem yöntemlerin sekillendirilmesinin, hem de bulusun kurallari ve kavramsal özelliklerinin en kullanisli ve kolay anlasilir tanimini saglamak amaciyla sunulduklari anlasilmalidir. Bu çizimlerde; Sekil- 1 Bulus konusu sistemin genel sematik görünümü. Sekil-2 Bulusta yer alan araç temizlik modülünün çalisma adimlarini gösteren sematik görünüm. Sekil-3 Bulusta yer alan iç hasar tespit modülünün çalisma adimlarini gösteren sematik görünüm. Sekil -4 Bulusta yer alan kaza tespit modülü çalisma adimlarini gösteren sematik görünüm. Sekil-5 Bulusta yer alan acil çagri modülü çalisma adimlarini gösteren sematik görünüm. Bu bulusun anlasilmasina yardimci olacak sekiller ekli resimde belirtildigi gibi numaralandirilmis olup isimleri ile beraber asagida verilmistir. Referanslarin Açiklanmasi: .Araç 11.Iç kamera 12.Tavan kamerasi 13.Acil çagri butonu 14.Telematik ünitesi .Bulut sunuculari 21.Araç temizli modülü 22.Iç hasar tespit modülü 23.Kaza tespit modülü 24.Acil çagri modülü B. Diger kullanici C. Filo yönetimi D. Sigorta sirketi E. Emniyet birimi Bulusun Açiklanmasi: Bu detayli açiklamada bulus konusu sistem sadece konunun daha iyi anlasilmasina yönelik olarak, hiçbir sinirlayici etki olusturmayacak örneklerle açiklanmaktadir. Tarifnamede basta araç kiralama hizmeti veren sirketlerin kullanimina yönelik olmak üzere, her türlü amaç ile kullanilan araçlarda (10), sürücünün (A), diger kullanicilarin (B), filo yönetiminin (C), sigorta sirketlerinin (D) ve emniyet birimlerinin (E) ortaya çikabilecek kaza, kötü kullanim, hasar gibi durumlarda anlik ve sistematik olarak bilgilendirilmesine yönelik bir sistem anlatilmaktadir. Bulusa konu sistem, araç (10) içerisinde veya disarindan yer alabilen, sayisi ve konumu bagimsiz kameralar (bir iç kamera (11), bir tavan kamerasi (12) veya dis kamera olabilir), acil çagri butonu (13), kameralardan gelen verileri isleyen bir telematik ünitesi (14), internet baglantisi imkani saglayan telematik ünitesinden (14) meydana gelmektedir. Telematik ünitesi (14) sayesinde veriler, kablosuz iletim yöntemleri ile bulut sunucularinda (20) yer alan araç temizlik modülü (21), iç hasar tespit modülü (22), kaza tespit modülü (23) ve acil çagri modülüne (24) aktarilabilmektedir. Telematik ünitesinin (14) araçta (10) yer alan komponentler ile iletisimi kablosuz (WiFi, 4G, 5G, CAN-Bus, bluetooth, LlN gibi) ve kablolu (ethernet kablosu) olarak saglanabilmektedir. Bulusta yer alan araç temizlik modülünde (21), araç içi kamerasindan alinan görüntü analiz edilerek bir temizlik skor puani hesaplanmaktadir. Araç temizlik modülü, hesapladigi skor puanini sürücü (A), diger kullanicilar (B) ve filo yönetimi (C) ile paylasmaktadir. Hesaplanan skor puani araç kiralama hizmetinin aplikasyonunda, web sitesinde veya uygulama yaziliminda görülebilmektedir. Araç temizlik modülünün (21) çalisma adimlarinda, ilk olarak kiralama öncesi bilgi istendiyse son görüntü ve son skor potansiyel müsteriye gösterilmektedir. Araç (10) kiralandiysa ve kiralama süreci bittiyse, tavan kamerasindan (12) görüntü alinarak görüntüye skor verilmekte ve görüntü ve skor sürücü (A), diger kullanicilar (B) ve filo yönetimi (C) ile paylasilmak üzere sisteme yüklenmektedir. Bulusta yer alan iç hasar tespit modülünde (21), araç (10) kiralamasi bittiginde, tavan kamerasindan (12) gelen görüntü, araç (10) kiralanmadan önce alinan görüntü ile kiyaslanarak analiz edilir ve iç hasarin olup olmadigi tespit edilir. Analiz sonucunda iç hasar tespit edilirse, sürücü (A), diger kullanici (B), filo yönetimi (C) ve sigorta sirketleri (D) tespit edilen hasar konusunda bilgilendirilir. Bulusta yer alan kaza tespit modülünde (23), kaza olustuktan sonra, tavan kamerasindan (12) alinan görüntü ile kaza durumu tespit edilir. Ayni zamanda son tavan kamerasi (12) görüntüsü kaza öncesi alinan görüntü kiyaslanarak dis hasar olup olmadigi tespit edilebilmektedir. Kaza görüntüsü ilk olarak filo yönetimi (C) ve sigorta sirketi (D) ile paylasilmakta, filo yönetiminden onay geldiginde, emniyet birimleri (E) ile paylasilmaktadir. Bulusa konu acil çagri modülünde (24), ilk olarak tavan kamerasindan (12) görüntü alinmakta, acil çagri butonuna (13) basildiginda, E-call aktif ise görüntülü konusma baslatilmakta, aktif degil ise görüntü ilgili birime gönderilmektedir. Sisteme ayrica araç (10) disini gözleyen kameralar eklenebilmektedir. Bu kameralar birden fazla olabilmekte ve 360 derece araç (10) çevresini gözlemleyebilmektedir. Asagida bahsedilen durumlarda araç iç kamerasina ek olarak dis kameralardan gelen görüntüler de eklenebilmektedir. Bu durumda kameralar direkt olarak telematik ünitesine (14) CAN, Ethernet ve benzeri baglanti ile baglanabilmekte veya kameralarin bagli oldugu üçüncü bir elektronik kontrol ünitesi görüntüleri telematik ünitesine (14) aktarabilmektedir. Sisteme ayrica sürücüyü gözleyen ve herhangi bir dalginlik aninda uyari üreten bir sürücü gözetleme kamerasi dahil edilebilmektedir. Bu durumda kamera direkt olarak telematik ünitesine (14) CAN, Ethernet ve benzeri ile baglanabilir veya sürücü gözetleme kamerasinin bagli oldugu elektronik kontrol ünitesi yardimiyla baglanabilir. Araçlarda var olan sürücü destek sistemlerinden gelen veriler sisteme eklenebilir. Bu durumda AEBS (aktif fren yardimi), ACC (Hiz sabitleyici) gibi sistemlerden gelen aktif uyarilar veya bu sistemlere ait kamera, radar gibi sensörlerden gelen islenmis ham veriler telematik ünitesi yardimiyla merkez sunucuya gönderilebilecektir. Merkezi sunucular/sistem gelen görüntüleri isleyerek modüllerde belirlenmis algoritma ile kullanicilar ile paylasir. Bu veri ham görüntü, görüntü içeren analiz ve rapor olabilir. Uyarilarin ve görüntülerin gönderilecegi cihaz sistem kullanicisina ait mobil cihaz veya masaüstü cihaz olabilir. Kullanici bu cihazlari kullanarak araç (10) hakkinda bilgi isteyebilir veya merkezi sistem olusan uyariyi toplu olarak veya bireysel olarak bu cihazlara iletebilir. Araci uygulama üzerinden kiralayan kisi aracin yanina giderek, servis saglayicisi tarafindan kendisine uygulama üzerinden verilen dijital anahtar ve benzeri ile araci açabilecek, anahtara ulasabilecek ve araci çalistirabilecektir. Anahtar olmadigi durumda start/ stop tusunu kullanarak araci çalistirabilecektir. Aracin kilidi açildigi anda veya baska bir tetikleyici ile kamera çalismaya baslayacak ve görüntüyü telematik ünitesi (14) yardimi ile sunuculara gönderecektir. Ayrica kamera ile beraber araca ait seçilmis CAN-Bus sinyalleri de telematik ünitesi (14) yardimiyla bulut sunucularina iletilecektir. Bu CAN-Bus verilerine örnek olarak diyagnostik mesajlari, araç (10) hizi, araç (10) konumu, araç (10) ivmelenmesi, anlik fren miktari verilebilir. TR TR TR TR TR DESCRIPTION A METHOD FOR THE ANALYSIS OF IN-VEHICLE CAMERA DATA AND Technological Field: The invention aims to protect the vehicle user, other service users, fleet managers, insurance companies and law enforcement units from encountering problems that may arise in vehicles used for all purposes, especially for the use of companies providing car rental services. It is about a system for instant and systematic notification in cases such as accident, misuse and damage. Known State of the Technology: Automotive vehicles are one of the important needs of our daily and business lives. There are many companies providing car rental services to meet this need. Whether in rental vehicles or non-rental vehicles, security, communication and emergencies are important. The invention subject to the description describes a system that serves the subjects mentioned here. In the known art, some systems include cameras. In these systems, the images obtained from the camera and the cleaning information obtained (see cleanliness module) are transmitted only to the fleet manager and, in limited cases (see behavior module), to the person using the vehicle. However, the issue of cleaning concerns all service users. Considering that the vehicles cannot be cleaned by the fleet manager at any time, this information must be shared with all users. The accident situation, which commonly occurs in the prior art, is not mentioned. In case of an accident, the image taken from the interior camera will be able to show both the inside of the vehicle and the outside of the vehicle thanks to the light-receiving parts of the vehicle. This information must be automatically transferred to the relevant actors (fleet manager, insurance company, law enforcement units and the person who caused the accident). In the known technique, there is no mention of user-induced damage inside the vehicle. Vehicle interior damage is not checked. In this case, the fleet owner and the insurance company should be informed. In addition, it is not possible for people in the vehicle to reach the relevant units using the image in case of emergency. The patent document mentions a system that includes an interior camera to monitor the behavior of the person driving the vehicle. In the mentioned system, user behaviors such as eating, drinking and smoking are monitored. At the same time, checks are made whether there is a pet inside the vehicle and whether the seat belt is fastened. However, in the document, issues such as interior and exterior damage, emergency systems, and cleaning control were not mentioned, and the information was only transferred to the car rental company. The system in the document does not have a method that separates the data according to the fields they are related to and informs the relevant units (such as police, insurance company, fleet management). As a result, a new method and system is needed that exceeds the known state of the technique and eliminates its disadvantages. Brief Description of the Invention: The invention is a method and system that analyzes the inside and outside camera data of all kinds of vehicles, especially for the use of car rental companies, and informs the relevant units, exceeds the known state of the technology, eliminates its disadvantages, and includes additional advantages. With the invention, fleet management, police departments, insurance companies, drivers and other users can be informed instantly and systematically. The interior image obtained after the last use is shared with all system users. Thus, it will be possible to determine the degree of cleanliness and take action accordingly. After last use, a vehicle cleaning score is calculated with the artificial intelligence algorithm and the calculated vehicle cleaning score is shared with all users. After last use, the internal damage detection module evaluates whether internal damage has occurred, and in case of internal damage, the image is transmitted to the insurance company and fleet company. If any accident is detected, the relevant footage is shared with the police departments, fleet manager and insurance company. If the emergency call button is pressed, the image is shared with law enforcement units and the fleet company. E-call service will be activated (if available in the vehicle, it can be integrated). E-call service is provided via video. Explanation of Drawings: The invention will be explained by referring to the attached figures, so that the features of the invention will be understood more clearly. However, this is not intended to limit the invention to these particular embodiments. On the contrary, it is intended to cover all alternatives, modifications and equivalences that can be included within the scope of the invention as defined by the attached claims. It should be understood that the details shown are for the sole purpose of illustrating preferred embodiments of the present invention and are presented for the purpose of providing the most useful and easily understandable description of both the embodiment of the methods and the rules and conceptual features of the invention. In these drawings; Figure- 1 General schematic view of the system subject to the invention. Figure-2 Schematic view showing the working steps of the vehicle cleaning module included in the invention. Figure-3 Schematic view showing the working steps of the internal damage detection module included in the invention. Figure -4 Schematic view showing the working steps of the accident detection module in the invention. Figure-5 Schematic view showing the working steps of the emergency call module in the invention. The figures that will help understand this invention are numbered as indicated in the attached picture and are given below with their names. Explanation of References: .Vehicle 11.Interior camera 12.Ceiling camera 13.Emergency call button 14.Telematics unit .Cloud servers 21.Vehicle cleaning module 22.Interior damage detection module 23.Accident detection module 24.Emergency call module B. Other user C. Fleet management D. Insurance company E. Police department Description of the Invention: In this detailed explanation, the system subject to the invention is explained only for a better understanding of the subject, with examples that will not create any limiting effect. In the specification, primarily for the use of companies providing car rental services, in vehicles used for all purposes (10), the driver's (A), other users (B), fleet management (C), insurance companies (D) and security units (E) A system for instant and systematic notification in cases such as accidents, misuse and damage that may arise is described. The system subject to the invention consists of cameras that can be located inside or outside the vehicle (10), the number and location of which are independent (it can be an interior camera (11), a ceiling camera (12) or an exterior camera), an emergency call button (13), and a system that processes the data coming from the cameras. A telematics unit (14) consists of a telematics unit (14) that provides internet connection. Thanks to the telematics unit (14), data can be transferred to the vehicle cleaning module (21), interior damage detection module (22), accident detection module (23) and emergency call module (24) located on the cloud servers (20) via wireless transmission methods. The communication of the telematics unit (14) with the components in the vehicle (10) can be provided wirelessly (such as WiFi, 4G, 5G, CAN-Bus, Bluetooth, LlN) and wired (ethernet cable). In the vehicle cleaning module (21) included in the invention, a cleaning score is calculated by analyzing the image taken from the in-car camera. The vehicle cleaning module shares the score it calculates with the driver (A), other users (B) and fleet management (C). The calculated score can be viewed on the car rental service's application, website or application software. In the working steps of the vehicle cleaning module (21), if information is first requested before rental, the final image and final score are shown to the potential customer. If the vehicle (10) is rented and the rental period is over, an image is taken from the ceiling camera (12) and a score is given to the image, and the image and score are uploaded to the system to be shared with the driver (A), other users (B) and fleet management (C). In the interior damage detection module (21) included in the invention, when the vehicle (10) is rented, the image from the ceiling camera (12) is analyzed by comparing it with the image taken before the vehicle (10) was rented, and it is determined whether there is internal damage. If internal damage is detected as a result of the analysis, the driver (A), other user (B), fleet management (C) and insurance companies (D) are informed about the detected damage. In the accident detection module (23) included in the invention, after the accident occurs, the accident situation is detected with the image taken from the ceiling camera (12). At the same time, it can be determined whether there is external damage by comparing the last ceiling camera (12) image with the image taken before the accident. The accident image is first shared with the fleet management (C) and the insurance company (D), and when approval is received from the fleet management, it is shared with the police units (E). In the emergency call module (24), which is the subject of the invention, an image is first taken from the ceiling camera (12), and when the emergency call button (13) is pressed, a video conversation is started if E-call is active, and if it is not active, the image is sent to the relevant unit. Cameras that observe the exterior of the vehicle (10) can also be added to the system. These cameras can be more than one and can observe the vehicle (10) surroundings at 360 degrees. In the cases mentioned below, images from exterior cameras can be added in addition to the interior camera of the vehicle. In this case, the cameras can be directly connected to the telematics unit (14) via CAN, Ethernet or similar connections, or a third electronic control unit to which the cameras are connected can transfer the images to the telematics unit (14). A driver surveillance camera can also be included in the system, which observes the driver and generates a warning in case of any distraction. In this case, the camera can be connected directly to the telematics unit (14) via CAN, Ethernet, etc., or with the help of the electronic control unit to which the driver surveillance camera is connected. Data from existing driver support systems in vehicles can be added to the system. In this case, active warnings from systems such as AEBS (active brake assistance), ACC (Cruise Control) or processed raw data from sensors such as cameras and radar belonging to these systems can be sent to the central server with the help of the telematics unit. Central servers/system process incoming images and share them with users with the algorithm determined in the modules. This data can be raw images, analysis and reports containing images. The device to which alerts and images will be sent may be the mobile device or desktop device belonging to the system user. The user can request information about the vehicle (10) using these devices, or the central system can transmit the resulting warning to these devices collectively or individually. The person renting the vehicle through the application will be able to go to the vehicle, open the vehicle, access the key and start the vehicle with the digital key or similar given to him/her by the service provider through the application. If there is no key, the vehicle can be started by using the start/stop button. As soon as the vehicle is unlocked or with another trigger, the camera will start working and send the image to the servers with the help of the telematics unit (14). In addition, the selected CAN-Bus signals of the vehicle along with the camera will be transmitted to the cloud servers with the help of the telematics unit (14). Examples of this CAN-Bus data include diagnostic messages, vehicle (10) speed, vehicle (10) position, vehicle (10) acceleration, instantaneous braking amount. TR TR TR TR TR

TR2022/011598A 2022-07-20 2022-07-20 A METHOD AND SYSTEM FOR ANALYSIS OF IN-CAR CAMERA DATA TR2022011598A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
TR2022/011598A TR2022011598A2 (en) 2022-07-20 2022-07-20 A METHOD AND SYSTEM FOR ANALYSIS OF IN-CAR CAMERA DATA
PCT/TR2023/050700 WO2024019693A1 (en) 2022-07-20 2023-07-19 A method and system for analysis of in-car camera data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TR2022/011598A TR2022011598A2 (en) 2022-07-20 2022-07-20 A METHOD AND SYSTEM FOR ANALYSIS OF IN-CAR CAMERA DATA

Publications (1)

Publication Number Publication Date
TR2022011598A2 true TR2022011598A2 (en) 2022-08-22

Family

ID=84101114

Family Applications (1)

Application Number Title Priority Date Filing Date
TR2022/011598A TR2022011598A2 (en) 2022-07-20 2022-07-20 A METHOD AND SYSTEM FOR ANALYSIS OF IN-CAR CAMERA DATA

Country Status (2)

Country Link
TR (1) TR2022011598A2 (en)
WO (1) WO2024019693A1 (en)

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11704947B2 (en) * 2019-12-23 2023-07-18 Robert Bosch Gmbh In-vehicle sensing module for monitoring a vehicle
JP7354946B2 (en) * 2020-07-06 2023-10-03 トヨタ自動車株式会社 Vehicle and vehicle interior/exterior monitoring system
CN112885031B (en) * 2021-01-14 2022-10-18 奇瑞商用车(安徽)有限公司 Intelligent alarm system and method based on Internet of vehicles

Also Published As

Publication number Publication date
WO2024019693A1 (en) 2024-01-25

Similar Documents

Publication Publication Date Title
US10404951B2 (en) Vehicle event recorders with integrated web server
CN108810804B (en) Intelligent protection method and system based on network car booking platform
US10049566B2 (en) Systems and methods for intra-vehicle pedestrian and infrastructure communication
US9852636B2 (en) Traffic event data source identification, data collection and data storage
EP2797798B1 (en) Multi-vehicle surveillance system
US9633318B2 (en) Vehicle event recorder systems
US20180308344A1 (en) Vehicle-to-infrastructure (v2i) accident management
US11151396B2 (en) Real time vehicle occupant emergency health data systems and methods
GB2524869A (en) Monitoring system and method
US20150371456A1 (en) System and Method for Detecting and Remotely Assessing Vehicle Incidents and Dispatching Assistance
GB2522728A (en) Monitoring device
JP3674700B2 (en) Data processing system and data processing method
SE1650327A1 (en) Method and system for theft detection in a vehicle
US10134285B1 (en) FleetCam integration
US11778445B2 (en) Vehicle with automatic reporting function
CN113205056A (en) Active image recognition early warning system based on public safety problem and processing method thereof
US20060012679A1 (en) Multifunction vehicle interior imaging system
US20210377383A1 (en) Assembly and method for preventing wireless communication while driving
TR2022011598A2 (en) A METHOD AND SYSTEM FOR ANALYSIS OF IN-CAR CAMERA DATA
KR102051020B1 (en) Vehicle video monitoring system for utilizing driving pattern and the method thereof
US20150116491A1 (en) Private and automatic transmission of photograph via occupant's cell phone following impact event
CN109697836A (en) A key warning device based on ADAS
WO2018025273A1 (en) Vehicle camera system
TWM573308U (en) The fleet monitoring management system and vehicle hosts
US20240144739A1 (en) Information processing apparatus, information processing method, and non-transitory computer readable medium