CN115503609A - 侦测系统 - Google Patents

侦测系统 Download PDF

Info

Publication number
CN115503609A
CN115503609A CN202110632448.5A CN202110632448A CN115503609A CN 115503609 A CN115503609 A CN 115503609A CN 202110632448 A CN202110632448 A CN 202110632448A CN 115503609 A CN115503609 A CN 115503609A
Authority
CN
China
Prior art keywords
blind spot
vehicle
image
user
detection system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110632448.5A
Other languages
English (en)
Inventor
吴政豫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inventec Pudong Technology Corp
Inventec Corp
Original Assignee
Inventec Pudong Technology Corp
Inventec Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inventec Pudong Technology Corp, Inventec Corp filed Critical Inventec Pudong Technology Corp
Priority to CN202110632448.5A priority Critical patent/CN115503609A/zh
Priority to US17/476,483 priority patent/US11884154B2/en
Publication of CN115503609A publication Critical patent/CN115503609A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/10Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/28Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/28Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
    • B60K35/285Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver for improving awareness by directing driver's gaze direction or eye points
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/27Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view providing all-round vision, e.g. using omnidirectional cameras
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00Machine learning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/59Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • G06V40/193Preprocessing; Feature extraction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/30Services specially adapted for particular environments, situations or purposes
    • H04W4/40Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
    • H04W4/48Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P] for in-vehicle communication
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/148Instrument input by voice
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/149Instrument input by detecting viewing direction not otherwise provided for
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16Type of output information
    • B60K2360/176Camera images
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16Type of output information
    • B60K2360/177Augmented reality
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16Type of output information
    • B60K2360/178Warnings
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20Optical features of instruments
    • B60K2360/21Optical features of instruments using cameras
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/26Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using acoustic output
    • B60K35/265Voice
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/802Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring and displaying vehicle exterior blind spot views
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/802Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring and displaying vehicle exterior blind spot views
    • B60R2300/8026Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring and displaying vehicle exterior blind spot views in addition to a rear-view mirror system
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B2027/0178Eyeglass type

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Mechanical Engineering (AREA)
  • Theoretical Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Optics & Photonics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Software Systems (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Ophthalmology & Optometry (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • Mathematical Physics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Medical Informatics (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Emergency Alarm Devices (AREA)
  • Traffic Control Systems (AREA)

Abstract

本发明公开一种侦测系统。其包含有盲点侦测模组及眼镜模组。盲点侦测模组包含有第一录影装置用于纪录车辆周围影像;第一辨识装置用于产生盲点辨识结果;第一判断装置用于判断是否传送车辆周围影像及/或盲点警示信息;以及传送装置用于传送车辆周围影像及/或盲点警示信息。眼镜模组包含有接收装置用于接收车辆周围影像及/或盲点警示信息;第二录影装置用于纪录使用者周围影像;第二辨识装置用于产生眼睛辨识结果;第二判断装置用于透过人工智能判断是否显示使用者周围影像及/或眼睛警示信息;以及显示装置用于显示使用者周围影像及/或眼睛警示信息。

Description

侦测系统
技术领域
本发明涉及一种侦测系统,尤指一种侦测车辆盲点及使用者眼睛的侦测系统。
背景技术
驾驶常因视线或盲点(例如A柱)的死角,或因驾驶精神恍惚,未注意到车辆周遭的人事物,而造成车祸事故。现今车辆的侦测周遭情况及驾驶状况的功能是有限的,难以避免上述车祸事故的发生。因此,如何侦测车辆周遭情况及驾驶状况为一亟待解决的问题。
发明内容
本发明提供一种侦测车辆盲点及使用者眼睛的侦测系统,以解决上述之问题。
根据一实施例,本发明的侦测系统包含有一盲点侦测模组以及一眼镜模组。该盲点侦测模组包含有一第一录影装置,用于纪录一车辆周围影像;一第一辨识装置,用于辨识至少一行车盲点,以产生一盲点辨识结果;一第一判断装置,耦接于该第一录影装置及该第一辨识装置,用于根据该车辆周围影像及该盲点辨识结果,判断是否传送该车辆周围影像及一盲点警示信息中至少一个,以产生一第一判断结果;以及一传送装置,耦接于该第一判断装置,用于根据该第一判断结果,传送该车辆周围影像及该盲点警示信息中该至少一个。该眼镜模组包含有一接收装置,用于从该传送装置接收该车辆周围影像及该盲点警示信息中该至少一个;一第二录影装置,用于纪录一使用者周围影像;一第二辨识装置,用于辨识一使用者的眼睛,以产生一眼睛辨识结果;一第二判断装置,耦接于该第二录影装置及该第二辨识装置,用于根据该使用者周围影像及该眼睛辨识结果,透过一人工智能(artificialintelligence,AI),判断是否显示该使用者周围影像及一眼睛警示信息中至少一个,以产生一第二判断结果;以及一显示装置,耦接于该接收装置及该第二判断装置,用于根据该第二判断结果,显示该使用者周围影像及该眼睛警示信息中该至少一个,以及显示该车辆周围影像及该盲点警示信息中该至少一个。
其中所述车辆周围影像包含有一车辆环景影象。
其中所述盲点警示信息包含有一影像信息及一语音信息中至少一个。
其中所述传送装置包含有:一第一通讯模组,用于执行一毫米波无线传输;其中透过所述毫米波无线传输,所述传送装置传送所述车辆周围影像及所述盲点警示信息中所述至少一个。
其中所述眼镜模组是一扩增实境眼镜模组或一混合实境眼镜模组。
其中所述眼镜模组另包含有:一第三辨识装置,耦接于所述显示装置,用于辨识所述使用者的一语音指令;其中根据所述语音指令,所述显示装置显示对应于所述语音指令的所述车辆周围影像及所述使用者周围影像中至少一个。
其中所述接收装置包含有:一第二通讯模组,用于执行一毫米波无线传输;其中透过所述毫米波无线传输,所述接收装置接收所述车辆周围影像及所述盲点警示信息中所述至少一个。
其中所述第二辨识装置辨识所述使用者的所述眼睛的一眼球转动方向及一眼睑闭合状况中至少一个。
其中所述眼睛警示信息包含有一影像信息及一语音信息中至少一个。
其中所述显示装置是一微发光二极体显示装置。
附图说明
图1为本发明实施例一侦测系统的示意图。
图2为本发明实施例一眼镜模组的示意图。
图3为本发明实施例一侦测方法的示意图。
符号说明:
10:侦测系统
100:盲点侦测模组
102:第一录影装置
104:第一辨识装置
106:第一判断装置
108:传送装置
200,20:眼镜模组
202:接收装置
204:第二录影装置
206:第二辨识装置
208第二判断装置
210:显示装置
212:第三辨识装置
S10,S12,S14,S16,S18,S20,S22,S24:步骤
具体实施方式
图1为本发明实施例一侦测系统10的示意图。侦测系统10包含有盲点侦测模组100及眼镜模组200。盲点侦测模组100包含有第一录影装置102(例如后装车辆录影机)、第一辨识装置104、第一判断装置106及传送装置108。眼镜模组200包含有接收装置202、第二录影装置204(例如录影机)、第二辨识装置206、第二判断装置208及显示装置210。
在图1中,第一录影装置102用于纪录车辆周围影像。第一辨识装置104用于辨识至少一行车盲点,以产生盲点辨识结果。第一判断装置106耦接于第一录影装置102及第一辨识装置104。根据车辆周围影像及盲点辨识结果,第一判断装置106判断是否传送车辆周围影像及盲点警示信息中至少一个,以产生第一判断结果。传送装置108耦接于第一判断装置106。根据第一判断结果,传送装置108传送车辆周围影像及盲点警示信息中至少一个。
在一实施例中,车辆周围影像包含有车辆环景影象。车辆环景影象包含有车辆前方、后方及两侧的影像。在一实施例中,盲点警示信息包含有影像信息及语音信息中至少一个。举例来说,当车辆(例如后装车)转弯以及行车盲点有其他车辆或行人时,或者当车辆偏移车道时,侦测系统10提供行车盲点/车辆偏移的影像(例如影像信息),以及/或者发出警示声(例如语音信息),以提醒使用者(例如驾驶)注意。在一实施例中,传送装置108包含有第一通讯模组,用于执行毫米波(millimeter wave,mm wave)无线传输。透过毫米波无线传输,传送装置108传送车辆周围影像及盲点警示信息中至少一个。
在图1中,接收装置202从传送装置108接收车辆周围影像及盲点警示信息中至少一个。第二录影装置204用于纪录使用者周围影像。第二辨识装置206用于辨识使用者(例如驾驶)的眼睛,以产生眼睛辨识结果。第二判断装置208耦接于第二录影装置204及该第二辨识装置206。根据使用者周围影像及眼睛辨识结果,透过人工智能(artificialintelligence,AI),第二判断装置208判断是否显示使用者周围影像及眼睛警示信息中至少一个,以产生第二判断结果。显示装置210耦接于接收装置202及该第二判断装置210。根据第二判断结果,显示装置210显示使用者周围影像及眼睛警示信息中至少一个,以及显示车辆周围影像及盲点警示信息中至少一个。
在一实施例中,眼镜模组200是扩增实境(augmented reality,AR)眼镜模组或混合实境(mixed reality,MR)眼镜模组。在一实施例中,接收装置202包含有第二通讯模组,用于执行毫米波无线传输。透过毫米波无线传输,接收装置202接收车辆周围影像及盲点警示信息中至少一个。在一实施例中,第二辨识装置206辨识使用者的眼睛的眼球转动方向。举例来说,当车辆转弯时,使用者(例如驾驶)应注意转弯方向的其他车辆或行人。在此情况下,第二辨识装置206辨识使用者的眼球是否转动到对应的方向。举例来说,当车辆行经路口时,第二辨识装置206辨识使用者的眼球的转动方向,以确定使用者是否注意左右方来车。在一实施例中,第二辨识装置206辨识使用者的眼睛的眼睑的闭合状况,以确定使用者是否打瞌睡或精神恍惚。
在一实施例中,根据使用者周围影像,透过人工智能(例如人工智能标示(AIlabeling)),第二判断装置208判断使用者的视线死角是否有其他物体,以及判断车辆是否偏移车道。在一实施例中,眼睛警示信息包含有影像信息及语音信息中至少一个。举例来说,在使用者的视线死角有其他物体或行人的情况下,眼镜模组200提供视线死角的影像(例如影像信息),以及/或者发出警示声(例如语音信息),以提醒使用者注意。举例来说,当使用者打瞌睡或精神恍惚时,眼镜模组200发出警示声(例如语音信息)。在一实施例中,显示装置210是微发光二极体(micro light-emitting diode,micro LED)显示装置。
图2为本发明实施例一眼镜模组20的示意图。眼镜模组200包含有接收装置202、第二录影装置204、第二辨识装置206、第二判断装置208、显示装置210及第三辨识装置212。图2的眼镜模组20可应用于图1的眼镜模组200。接收装置202、第二录影装置204、第二辨识装置206、第二判断装置208、显示装置210可参考图1,于此不赘述。第三辨识装置212耦接于显示装置210,用于辨识使用者的语音指令。根据语音指令,显示装置210显示对应于语音指令的车辆周围影像及使用者周围影像中至少一个。举例来说,当车辆倒车时,根据使用者的语音指令“倒车”,显示装置210显示车辆环景影象或车辆后方影像。举例来说,当车辆转弯(例如左转)时,根据使用者的语音指令“转弯”,显示装置210显示车辆侧边(例如左侧)影像。
图3为本发明实施例一侦测方法的示意图。本发明的显示方法包含有一侦测系统的一盲点侦测模组纪录一车辆周围影像,以及于辨识至少一行车盲点以产生一盲点辨识结果(步骤S10)。根据该车辆周围影像及该盲点辨识结果,该盲点侦测模组判断是否传送该车辆周围影像及一盲点警示信息中至少一个,以产生一第一判断结果(步骤S12)。根据该第一判断结果,该盲点侦测模组传送该车辆周围影像及该盲点警示信息中该至少一个(步骤S14)。接着,根据该第一判断结果,该盲点侦测模组传送该车辆周围影像及该盲点警示信息中该至少一个到该侦测系统的一眼镜模组(步骤S16)。该眼镜模组从该传送装置接收该车辆周围影像及该盲点警示信息中该至少一个(步骤S18)。该眼镜模组纪录一使用者周围影像,以及辨识一使用者的眼睛以产生一眼睛辨识结果(步骤S20)。根据该使用者周围影像及该眼睛辨识结果,透过一人工智能,该眼镜模组判断是否显示该使用者周围影像及一眼睛警示信息中至少一个,以产生一第二判断结果(步骤S22)。根据该第二判断结果,该眼镜模组显示该使用者周围影像及该眼睛警示信息中该至少一个,以及显示该车辆周围影像及该盲点警示信息中该至少一个(步骤S24)。
本发明的侦测方法的实施例可参考图1及图2的实施例,于此不赘述。
综上所述,本发明提供一种侦测系统,根据录影装置纪录的影像及辨识装置的辨识结果,透过人工智能,侦测系统侦测车辆周围(例如行车盲点)情况,以及侦测使用者是否打瞌睡或精神恍惚。如此一来,若行车时有危急情况,侦测系统可立即提醒使用者,因而有效降低车祸事故的发生。
以上所述仅为本发明的较佳实施例,凡依本发明权利要求书所做的均等变化与修饰,皆应属本发明的涵盖范围。

Claims (10)

1.一种侦测系统,其特征在于,包含有:
一盲点侦测模组,包含有:
一第一录影装置,用于纪录一车辆周围影像;
一第一辨识装置,用于辨识至少一行车盲点,以产生一盲点辨识结果;
一第一判断装置,耦接于所述第一录影装置及所述第一辨识装置,用于根据所述车辆周围影像及所述盲点辨识结果,判断是否传送所述车辆周围影像及一盲点警示信息中至少一个,以产生一第一判断结果;以及
一传送装置,耦接于所述第一判断装置,用于根据所述第一判断结果,传送所述车辆周围影像及所述盲点警示信息中所述至少一个;以及
一眼镜模组,包含有:
一接收装置,用于从所述传送装置接收所述车辆周围影像及所述盲点警示信息中所述至少一个;
一第二录影装置,用于纪录一使用者周围影像;
一第二辨识装置,用于辨识一使用者的眼睛,以产生一眼睛辨识结果;
一第二判断装置,耦接于所述第二录影装置及所述第二辨识装置,用于根据所述使用者周围影像及所述眼睛辨识结果,透过一人工智能,判断是否显示所述使用者周围影像及一眼睛警示信息中至少一个,以产生一第二判断结果;以及
一显示装置,耦接于所述接收装置及所述第二判断装置,用于根据所述第二判断结果,显示所述使用者周围影像及所述眼睛警示信息中所述至少一个,以及显示所述车辆周围影像及所述盲点警示信息中所述至少一个。
2.如权利要求1所述的侦测系统,其特征在于,其中所述车辆周围影像包含有一车辆环景影象。
3.如权利要求1所述的侦测系统,其特征在于,其中所述盲点警示信息包含有一影像信息及一语音信息中至少一个。
4.如权利要求1所述的侦测系统,其特征在于,其中所述传送装置包含有:
一第一通讯模组,用于执行一毫米波无线传输;
其中透过所述毫米波无线传输,所述传送装置传送所述车辆周围影像及所述盲点警示信息中所述至少一个。
5.如权利要求1所述的侦测系统,其特征在于,其中所述眼镜模组是一扩增实境眼镜模组或一混合实境眼镜模组。
6.如权利要求1所述的侦测系统,其特征在于,其中所述眼镜模组另包含有:
一第三辨识装置,耦接于所述显示装置,用于辨识所述使用者的一语音指令;
其中根据所述语音指令,所述显示装置显示对应于所述语音指令的所述车辆周围影像及所述使用者周围影像中至少一个。
7.如权利要求1所述的侦测系统,其特征在于,其中所述接收装置包含有:
一第二通讯模组,用于执行一毫米波无线传输;
其中透过所述毫米波无线传输,所述接收装置接收所述车辆周围影像及所述盲点警示信息中所述至少一个。
8.如权利要求1所述的侦测系统,其特征在于,其中所述第二辨识装置辨识所述使用者的所述眼睛的一眼球转动方向及一眼睑闭合状况中至少一个。
9.如权利要求1所述的侦测系统,其特征在于,其中所述眼睛警示信息包含有一影像信息及一语音信息中至少一个。
10.如权利要求1所述的侦测系统,其特征在于,其中所述显示装置是一微发光二极体显示装置。
CN202110632448.5A 2021-06-07 2021-06-07 侦测系统 Pending CN115503609A (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202110632448.5A CN115503609A (zh) 2021-06-07 2021-06-07 侦测系统
US17/476,483 US11884154B2 (en) 2021-06-07 2021-09-16 Detection system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110632448.5A CN115503609A (zh) 2021-06-07 2021-06-07 侦测系统

Publications (1)

Publication Number Publication Date
CN115503609A true CN115503609A (zh) 2022-12-23

Family

ID=84285706

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110632448.5A Pending CN115503609A (zh) 2021-06-07 2021-06-07 侦测系统

Country Status (2)

Country Link
US (1) US11884154B2 (zh)
CN (1) CN115503609A (zh)

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8395529B2 (en) * 2009-04-02 2013-03-12 GM Global Technology Operations LLC Traffic infrastructure indicator on head-up display
KR102118438B1 (ko) * 2013-01-28 2020-06-04 한국전자통신연구원 차량용 헤드업 디스플레이 장치 및 그 방법
US10215583B2 (en) * 2013-03-15 2019-02-26 Honda Motor Co., Ltd. Multi-level navigation monitoring and control
US20150309562A1 (en) * 2014-04-25 2015-10-29 Osterhout Group, Inc. In-vehicle use in head worn computing
US9756319B2 (en) * 2014-02-27 2017-09-05 Harman International Industries, Incorporated Virtual see-through instrument cluster with live video
US20160187651A1 (en) * 2014-03-28 2016-06-30 Osterhout Group, Inc. Safety for a vehicle operator with an hmd
US9906769B1 (en) * 2014-07-31 2018-02-27 Raytheon Company Methods and apparatus for collaborative multi-view augmented reality video
KR101916993B1 (ko) * 2015-12-24 2018-11-08 엘지전자 주식회사 차량용 디스플레이 장치 및 그 제어방법
US20170291543A1 (en) * 2016-04-11 2017-10-12 GM Global Technology Operations LLC Context-aware alert systems and algorithms used therein
KR20200075328A (ko) * 2018-12-18 2020-06-26 현대자동차주식회사 차량의 주행 정보 제공 방법, 장치 및 기록매체
US11506888B2 (en) * 2019-09-20 2022-11-22 Nvidia Corp. Driver gaze tracking system for use in vehicles
US11487968B2 (en) * 2019-12-16 2022-11-01 Nvidia Corporation Neural network based facial analysis using facial landmarks and associated confidence values
US11636609B2 (en) * 2019-12-16 2023-04-25 Nvidia Corporation Gaze determination machine learning system having adaptive weighting of inputs
US11340701B2 (en) * 2019-12-16 2022-05-24 Nvidia Corporation Gaze determination using glare as input

Also Published As

Publication number Publication date
US11884154B2 (en) 2024-01-30
US20220388394A1 (en) 2022-12-08

Similar Documents

Publication Publication Date Title
US20230106673A1 (en) Vehicle and mobile device interface for vehicle occupant assistance
US11562550B1 (en) Vehicle and mobile device interface for vehicle occupant assistance
EP1868139B1 (en) Spectacles detection method
JP3160108B2 (ja) 運転支援システム
JP2004519788A (ja) 運転に対するドライバーの注意力を監視するシステム
US11518305B2 (en) Techniques for generating vehicle-to-pedestrian (V2P) communications based on driver monitoring
US11130502B2 (en) Method for assisting a driver with regard to traffic-situation-relevant objects and motor vehicle
JP2003081039A (ja) 環境危険度演算装置
CN110194107A (zh) 一种集成显示与预警功能的车载智能后视系统
KR20170007001A (ko) 단말의 눈동자 인식 기능을 이용한 안전 운전 제어 방법, 장치 및 기록매체
CN112477870B (zh) 对于具有受损的视场的驾驶员的辅助
TWI773375B (zh) 偵測系統
JP6047727B2 (ja) ネットワークシステムおよび検知システム
CN115503609A (zh) 侦测系统
CN111746526B (zh) 一种后方无人驾驶车辆的预警方法、装置、设备和车辆
JPH11139229A (ja) 走行環境監視警報装置
US11643012B2 (en) Driving assistance device, driving situation information acquisition system, driving assistance method, and program
CN111169483A (zh) 一种辅助驾驶方法、电子设备和具有存储功能的装置
CN111311516A (zh) 图像显示方法和装置
US11807264B2 (en) Driving assistance apparatus, driving assistance method, and medium
JP5120893B2 (ja) 安全運転支援装置
RU2703341C1 (ru) Способ определения опасных состояний на дорогах общего пользования на основе мониторинга ситуации в кабине транспортного средства
KR101636301B1 (ko) 차량 충돌 방지 시스템 및 방법
CN113401057A (zh) 一种场景随动的全息投影系统及其汽车
US20240051562A1 (en) Systems and methods for in-vehicle driver assistance via augmented reality

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination