CN114332831A - Intelligent visual monitoring system of automobile cabin - Google Patents
Intelligent visual monitoring system of automobile cabin Download PDFInfo
- Publication number
- CN114332831A CN114332831A CN202111635083.8A CN202111635083A CN114332831A CN 114332831 A CN114332831 A CN 114332831A CN 202111635083 A CN202111635083 A CN 202111635083A CN 114332831 A CN114332831 A CN 114332831A
- Authority
- CN
- China
- Prior art keywords
- unit
- control unit
- monitoring system
- alarm
- visual monitoring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The application discloses an intelligent visual monitoring system of an automobile cabin, which comprises a camera module, a chip processing module and a human-computer interaction module, wherein the camera module comprises a camera, an image acquisition unit and an ISP image processing unit which are sequentially connected, and the human-computer interaction module comprises a vibration prompting unit, a display unit and an audio unit; the chip processing module comprises a pair of serializer/decoders, a micro-control unit, a power management unit, a motion sensor, a line control unit, an Ethernet switch, a storage unit and a CAN communication unit, wherein the micro-control unit is in communication connection with the ISP image processing unit through the serializer/decoders, and is connected with the vibration prompting unit, the display unit and the audio unit through the CAN communication unit; the line control unit, the power management unit, the motion sensor, the Ethernet switch and the storage unit are respectively connected with the micro control unit. The intelligent visual monitoring system of the automobile cabin has the advantages of being complete in function and high in reliability.
Description
Technical Field
The invention relates to the technical field of vehicle-mounted monitoring equipment, in particular to an intelligent visual monitoring system for an automobile cabin.
Background
The visual monitoring system for the automobile cabin is a system for monitoring the whole environment in the automobile in real time to improve the safety of driving and passengers, and generally, the functions of the visual monitoring system comprise monitoring of a driver, monitoring of passengers in the automobile, detection of other environments in the automobile and the like. The existing visual monitoring system for the automobile cabin is simple in system constitution, can only play a simple monitoring role, is not perfect in function and is far from realizing a real safety monitoring function.
Disclosure of Invention
An object of the application is to provide an intelligent visual monitoring system of car passenger cabin to solve the traditional passenger cabin visual monitoring system who provides in the background art and constitute comparatively simple, the incomplete problem of function.
In order to achieve the above purpose, the present application provides the following technical solutions: an intelligent visual monitoring system of an automobile cabin comprises a camera module, a chip processing module and a human-computer interaction module, wherein the camera module is arranged at a driving position and a riding position and comprises a camera, an image acquisition unit and an ISP image processing unit which are sequentially connected, and the human-computer interaction module comprises a vibration prompt unit, a display unit and an audio unit; the chip processing module comprises a pair of serializer/decoders, a micro-control unit, a power management unit, a motion sensor, a line control unit, an Ethernet switch, a storage unit and a CAN communication unit, wherein the micro-control unit is in communication connection with the ISP image processing unit through the serializer/decoders, and is connected with the vibration prompting unit, the display unit and the audio unit through the CAN communication unit; the wire control unit, the power management unit, the motion sensor, the Ethernet switch and the storage unit are respectively connected with the micro control unit.
Preferably, the chip processing module comprises a pair of serializer/decoders, a micro-control unit, a power management unit, a motion sensor, a line control unit, an ethernet switch, a storage unit and a CAN communication unit, the micro-control unit is in communication connection with the ISP image processing unit through the serializer/decoders, and the micro-control unit is connected with the vibration prompting unit, the display unit and the audio unit through the CAN communication unit; the wire control unit, the power management unit, the motion sensor, the Ethernet switch and the storage unit are respectively connected with the micro control unit.
Preferably, the storage unit comprises DDR and Flash.
Preferably, the micro control unit is connected with an AI deep learning unit for setting corresponding functions according to passenger preferences.
Preferably, the camera is a full high-definition 1080P camera.
Preferably, the working method of the intelligent visual monitoring system for the automobile cabin comprises the following steps: the camera module arranged at the driving position is used for detecting the action of a driver, the chip processing module is used for carrying out fatigue and distraction detection according to facial features in the detected action, when abnormal states of the driver are detected, wherein the abnormal states comprise one or more of smoking, call receiving and making, distraction driving, unbuckled safety belt, drinking, yawning and eye closing, the abnormal states are sent to the micro control unit for processing through the pair of serializer/deserializer, and after the micro control unit processes through the storage unit and the power management unit, the micro control unit converts the abnormal states into image alarm, sound alarm signals and vibration alarm signals and transmits the image alarm, the sound alarm and the seat vibration alarm to the man-machine interaction module through the CAN communication unit; the camera module and the motion sensor which are arranged on the driving position are used for detecting the abnormal conditions of passengers, wherein the abnormal conditions of the passengers comprise one or more of the conditions that the passengers do not wear safety belts, children stay in the vehicle independently and the children do not have adult care, when the abnormal conditions of the passengers are detected, the abnormal conditions are sent to the micro control unit through the pair of serializer/deserializer for processing, after the micro control unit processes through the storage unit and the power management unit, the micro control unit converts the abnormal conditions into image alarm and sound alarm signals and sends the image alarm and sound alarm signals to the man-machine interaction module through the CAN communication unit for sound alarm and image display alarm; when the situation that the driver is not in the driving position and the automobile is in a locked state is detected, the micro control unit carries out network alarm through the Ethernet switch.
Preferably, the fatigue and distraction detection specifically comprises acquiring facial features of the driver, tracking changes of the facial features and extracting symptoms; the facial features include one or more of cheek features, eye features, nose features, brow features, mouth features.
Preferably, the network alarm comprises sending a rescue message to the driver and/or the rescue authority.
Preferably, the working method of the intelligent visual monitoring system for the automobile cabin further comprises the step that a driver and/or a passenger enables the micro control unit to carry out function setting through the AI deep learning unit according to preference, and the function setting comprises one or more of seat adjustment, air conditioner setting, music setting and film watching setting.
Has the advantages that: the application discloses intelligent visual monitoring system of car passenger cabin carries out safety monitoring and warning through dangerous driving to the driver, passenger's unsafe behavior of taking a bus, simultaneously, carries out safety protection and warning to the children who stays alone in the car, has realized the comprehensive control to driver's position and passenger position. It is rational in infrastructure, in the hardware installation, can all adopt antivibration and reinforcement with hardware and plug connector to handle, provide superstrong buffering and antidetonation protection to the hardware of system, combine electronics antidetonation and software antidetonation technique, effectively solve the impact and the vibrations problem of vehicle. At the same time, the system can provide high quality images for reliable visual processing in low light conditions, such as nighttime, tunnels, or inclement weather.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a block diagram of an intelligent visual monitoring system for a vehicle cabin according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Examples
Referring to fig. 1, an intelligent visual monitoring system for an automobile cabin includes a camera module, a chip processing module, and a human-computer interaction module. The camera modules are arranged on a driving position and a riding position, namely, the system can comprise a plurality of groups of camera modules which are respectively used for monitoring a driver, front passengers and rear passengers. The camera module comprises a camera, an image acquisition unit and an ISP image processing unit which are connected in sequence, the camera, the image acquisition unit and the ISP image processing unit can be any one of the cameras in the prior art, the camera is a full-high-definition 1080P camera, and the camera, the image acquisition unit and the ISP image processing unit are in control connection through a connection and control mode in the prior art. The human-computer interaction module comprises a vibration prompting unit, a display unit and an audio unit, wherein the vibration prompting unit, the display unit and the audio unit can be any one of the vibration prompting unit, the vibration prompting unit can be a vibrator arranged in a seat and is used for vibrating when an alarm needs to be sent out, and therefore a driver or a passenger on the seat is reminded. The display unit is a display screen, and the audio unit is a loudspeaker. The chip processing module comprises a pair of serializer/decoders, a micro control unit, a power management unit, a motion sensor, a line control unit, an Ethernet switch, a storage unit and a CAN communication unit, wherein the micro control unit is in communication connection with the ISP image processing unit through the serializer/decoders, and the storage unit comprises DDR and Flash. The micro control unit is connected with the vibration prompt unit, the display unit and the audio unit through the CAN communication unit. The wire control unit, the power management unit, the motion sensor, the Ethernet switch and the storage unit are respectively connected with the micro control unit. The micro control unit CAN be any MCU in the prior art, the MCU host is connected with the camera for communication through the GMSL serializer, and then sends out image alarm, sound alarm and vibration alarm in a CAN communication mode.
In this embodiment, the micro control unit is connected with an AI deep learning unit for setting corresponding functions according to passenger preferences. Through multiple learning of the AI deep learning unit, the system can provide many convenient functions, such as adjusting related function settings in the vehicle according to the preference of the driver and passengers, including seats, air conditioning, music entertainment, and the like.
The working method of the intelligent visual monitoring system for the automobile cabin comprises the following steps:
the camera module installed on the driving seat is used for detecting the action of a driver, the chip processing module carries out fatigue and distraction detection according to facial features in the detected action, the fatigue and distraction detection specifically comprises the steps of obtaining facial features of the driver, tracking the change of the facial features and extracting symptoms, and the facial features comprise one or more of cheek features, eye features, nose features, eyebrow features and mouth features. When an abnormal state of a driver is detected, wherein the abnormal state comprises one or more of smoking, answering and making a call, distracted driving, unbuckled safety belts, drinking, yawning and eye closing, the abnormal state is sent to the micro control unit for processing through the pair of serializer/deserializer, and after the micro control unit processes through the storage unit and the power management unit, the abnormal state is converted into an image alarm, a sound alarm signal and a vibration alarm signal by the micro control unit and is transmitted to the man-machine interaction module through the CAN communication unit to perform sound alarm, image alarm and seat vibration alarm;
the camera module and the motion sensor which are arranged on the driving position are used for detecting the abnormal conditions of passengers, wherein the abnormal conditions of the passengers comprise one or more of the conditions that the passengers do not wear safety belts, children stay in the vehicle independently and the children do not have adult care, when the abnormal conditions of the passengers are detected, the abnormal conditions are sent to the micro control unit through the pair of serializer/deserializer for processing, after the micro control unit processes through the storage unit and the power management unit, the micro control unit converts the abnormal conditions into image alarm and sound alarm signals and sends the image alarm and sound alarm signals to the man-machine interaction module through the CAN communication unit for sound alarm and image display alarm; when the situation that the driver is not in the driving position and the automobile is in a locked state is detected, the micro control unit carries out network alarm through the Ethernet switch, and the network alarm comprises the step of sending rescue short messages to the driver and/or a rescue organization through a 4G network.
The intelligent visual monitoring system of the car cockpit in this embodiment: 1) the multifunctional mobile phone has the advantages that the multifunctional mobile phone has ultra-strong anti-shake, ultra-strong night vision and clearer images, and all hardware and connectors in the multifunctional mobile phone are subjected to anti-vibration and reinforcement processing to meet the requirement of the mobile working condition of the mobile phone. By the aid of a professional anti-seismic structure design, ultra-strong buffering and anti-seismic protection are provided for a machine, and by means of the combination of electronic anti-seismic technology and software anti-seismic technology, the impact and vibration problems of vehicles are effectively solved, namely ultra-strong stability is achieved. 2) The video adopts full high definition 1080P, and supports 30FPS recording speed. 3) And 2-path synchronous video recording, storage, video playing and real-time display functions are supported. 4) The low power consumption is realized by adopting battery power supply or vehicle-mounted power supply and advanced technology processing. 5) The installation is convenient, and the subminiature design is fit for all cars and uses, and application scope is wide. 6) The image at night is clear, and the image of a person can be clearly captured at night by adopting the IR Sensor. 7) The system has multiple alarm functions, and the safety of the personnel in the vehicle is protected more safely and reliably. 8) The system consists of three parts of perception, decision and control, and is in closed-loop control and convenient to operate. 9) The vision inside and outside the vehicle is fused with other sensing data, and the safety inside and outside the vehicle is integrated.
It should be noted that the term "comprises/comprising" is intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Each functional unit/module in the embodiments of the present invention may be integrated into one processing unit/module, or each unit/module may exist alone physically, or two or more units/modules are integrated into one unit/module. The integrated units/modules may be implemented in the form of hardware, or may be implemented in the form of software functional units/modules.
From the above description of embodiments, it is clear for a person skilled in the art that the embodiments described herein can be implemented in hardware, software, firmware, middleware, code or any appropriate combination thereof. For a hardware implementation, the micro control unit may also be implemented in one or more of the following units: an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a processor, a controller, a microprocessor, other electronic units designed to perform the functions described herein, or a combination thereof. For a software implementation, some or all of the procedures of an embodiment may be performed by a computer program instructing associated hardware. In practice, the program may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes computer storage media and communication media including CAN communication units and any medium that facilitates transfer of a computer program from one place to another. Storage media includes storage elements and any available media that can be accessed by a computer, such as, but not limited to, RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer.
Finally, it should be noted that: although the present invention has been described in detail with reference to the foregoing embodiments, it will be apparent to those skilled in the art that modifications may be made to the embodiments or portions thereof without departing from the spirit and scope of the invention.
Claims (8)
1. The intelligent visual monitoring system of the car cockpit is characterized by comprising a camera module, a chip processing module and a human-computer interaction module, wherein the camera module is arranged at a driving position and a riding position and comprises a camera, an image acquisition unit and an ISP image processing unit which are sequentially connected, and the human-computer interaction module comprises a vibration prompt unit, a display unit and an audio unit; the chip processing module comprises a pair of serializer/decoders, a micro-control unit, a power management unit, a motion sensor, a line control unit, an Ethernet switch, a storage unit and a CAN communication unit, wherein the micro-control unit is in communication connection with the ISP image processing unit through the serializer/decoders, and is connected with the vibration prompting unit, the display unit and the audio unit through the CAN communication unit; the wire control unit, the power management unit, the motion sensor, the Ethernet switch and the storage unit are respectively connected with the micro control unit.
2. The intelligent visual monitoring system for an automobile cabin according to claim 1, wherein the storage unit comprises DDR, Flash.
3. The intelligent visual monitoring system for an automobile cabin according to claim 1, characterized in that an AI deep learning unit for setting corresponding functions according to passenger preferences is connected to the micro control unit.
4. The intelligent visual monitoring system for an automobile cabin according to claim 1, wherein the camera is a full high definition 1080P camera.
5. The intelligent visual monitoring system of the automobile cabin according to any one of claims 1-4, characterized in that the working method of the intelligent visual monitoring system of the automobile cabin comprises the following steps:
the camera module arranged at the driving position is used for detecting the action of a driver, the chip processing module is used for carrying out fatigue and distraction detection according to facial features in the detected action, when abnormal states of the driver are detected, wherein the abnormal states comprise one or more of smoking, call receiving and making, distraction driving, unbuckled safety belt, drinking, yawning and eye closing, the abnormal states are sent to the micro control unit for processing through the pair of serializer/deserializer, and after the micro control unit processes through the storage unit and the power management unit, the micro control unit converts the abnormal states into image alarm, sound alarm signals and vibration alarm signals and transmits the image alarm, the sound alarm and the seat vibration alarm to the man-machine interaction module through the CAN communication unit;
the camera module and the motion sensor which are arranged on the driving position are used for detecting the abnormal conditions of passengers, wherein the abnormal conditions of the passengers comprise one or more of the conditions that the passengers do not wear safety belts, children stay in the vehicle independently and the children do not have adult care, when the abnormal conditions of the passengers are detected, the abnormal conditions are sent to the micro control unit through the pair of serializer/deserializer for processing, after the micro control unit processes through the storage unit and the power management unit, the micro control unit converts the abnormal conditions into image alarm and sound alarm signals and sends the image alarm and sound alarm signals to the man-machine interaction module through the CAN communication unit for sound alarm and image display alarm; when the situation that the driver is not in the driving position and the automobile is in a locked state is detected, the micro control unit carries out network alarm through the Ethernet switch.
6. The intelligent visual monitoring system of an automobile cabin according to claim 5, wherein the fatigue and distraction detection specifically comprises obtaining facial features of a driver, tracking changes in the facial features and extracting symptoms; the facial features include one or more of cheek features, eye features, nose features, brow features, mouth features.
7. The intelligent visual monitoring system for an automobile cabin according to claim 5, wherein the network alarm comprises a short rescue message sent to a driver and/or a rescue authority.
8. The system of claim 5, further comprising a driver and/or a passenger to set the micro-control unit to function settings via the AI deep learning unit according to the preference, wherein the function settings include one or more of seat adjustment, air conditioning setting, music setting, and video viewing setting.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111635083.8A CN114332831A (en) | 2021-12-29 | 2021-12-29 | Intelligent visual monitoring system of automobile cabin |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111635083.8A CN114332831A (en) | 2021-12-29 | 2021-12-29 | Intelligent visual monitoring system of automobile cabin |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114332831A true CN114332831A (en) | 2022-04-12 |
Family
ID=81016801
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111635083.8A Pending CN114332831A (en) | 2021-12-29 | 2021-12-29 | Intelligent visual monitoring system of automobile cabin |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114332831A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114710660A (en) * | 2022-05-31 | 2022-07-05 | 远峰科技股份有限公司 | Camera test system of intelligence passenger cabin and autopilot territory |
| CN115277800A (en) * | 2022-09-26 | 2022-11-01 | 联友智连科技有限公司 | Vehicle-mounted domain control device and method and vehicle-mounted system |
| WO2024061137A1 (en) * | 2022-09-19 | 2024-03-28 | 虹软科技股份有限公司 | Vehicle-mounted cabin perception device and control method therefor |
-
2021
- 2021-12-29 CN CN202111635083.8A patent/CN114332831A/en active Pending
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114710660A (en) * | 2022-05-31 | 2022-07-05 | 远峰科技股份有限公司 | Camera test system of intelligence passenger cabin and autopilot territory |
| CN114710660B (en) * | 2022-05-31 | 2022-10-14 | 远峰科技股份有限公司 | Camera test system of intelligence passenger cabin and autopilot territory |
| WO2024061137A1 (en) * | 2022-09-19 | 2024-03-28 | 虹软科技股份有限公司 | Vehicle-mounted cabin perception device and control method therefor |
| CN115277800A (en) * | 2022-09-26 | 2022-11-01 | 联友智连科技有限公司 | Vehicle-mounted domain control device and method and vehicle-mounted system |
| CN115277800B (en) * | 2022-09-26 | 2023-02-03 | 联友智连科技有限公司 | Vehicle-mounted domain control device and method and vehicle-mounted system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114332831A (en) | Intelligent visual monitoring system of automobile cabin | |
| US20160381292A1 (en) | Dash cam | |
| US20070131755A1 (en) | Left/right side direction switching mechanism of traveling data recorder for vehicle | |
| JP2020024532A (en) | Inattentive driving detection device | |
| US20160125250A1 (en) | Apparatus and method for connecting a mobile device camera | |
| WO2021244591A1 (en) | Driving auxiliary device and method, and vehicle and storage medium | |
| WO2019220851A1 (en) | Video output device, video output method, and computer program | |
| CN204978411U (en) | Multi -purpose vehicle(MPV) safety auxiliary system | |
| JP2015128915A (en) | Rear seat occupant monitor system, and rear seat occupant monitor method | |
| WO2022010221A1 (en) | In-cabin safety sensor installed in vehicle and method for providing service platform therefor | |
| CN111137212A (en) | Rearview mirror device and vehicle | |
| JPH1035320A (en) | Vehicle condition recognition method, on-vehicle image processor, and memory medium | |
| WO2024061137A1 (en) | Vehicle-mounted cabin perception device and control method therefor | |
| CN112712043A (en) | Intelligent cabin image processing system | |
| CN107933461A (en) | In-car identification fusing device and method based on single camera | |
| WO2020222317A1 (en) | Electronic device and method for operating electronic device | |
| CN207241573U (en) | Screen intelligent back vision mirror and automobile comprehensively | |
| CN116160980A (en) | Intelligent cabin system for parent-child travel and control method | |
| CN106183733B (en) | A kind of front windshield and automobile of integrated automobile data recorder | |
| JPH09219810A (en) | Inside-cabin photographing device for traveling object | |
| US20220319122A1 (en) | Method for operating a head-mounted display apparatus in a motor vehicle, control device, and head-mounted display apparatus | |
| CN105015408A (en) | Obstacle waning system | |
| CN114500771A (en) | Vehicle-mounted imaging system | |
| CN112078486A (en) | Steering auxiliary device and method based on HUD display | |
| CN218228833U (en) | Vehicle-mounted display device and vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |