KR20200110518A - Advanced driver assistance system and implementation method for the aftermarket, which wirelessly adjusts, maintains, and manages all functions and device settings by installing multi-channel two-way wireless data communication module - Google Patents

Abstract

The present invention relates to an advanced driver assistance system (ADAS). The ADAS implements various intelligent driving assistance and support functions such as a headway monitoring and video image analysis warning function and an intelligence front vehicle stop and go function. The advanced driver assistance system of the present invention can be quickly installed and conveniently managed.

Description

Intelligent driver assistance system and implementation method for the aftermarket, which wirelessly adjusts, maintains, and wirelessly adjusts and manages all functions and device settings by installing a multi-channel two-way wireless data communication module. , and manages all functions and device settings by installing multi-channel two-way wireless data communication module}

The present invention is represented by an intelligent driver assistance system for vehicles (hereinafter referred to as'ADAS'), and after the vehicle is shipped, a camera using a CCD or CMOS as an image pickup device for image analysis on a windshield window (hereinafter (Referred to as'camera'), and using data of vehicle speed, left/right direction indicators, and various sensors, it relates to an independent ADAS that supports various intelligent driver assistance and assistance functions, as shown in FIG. , All individuals, all individuals, such as corporate and business small vehicles, multi-seater minivans, buses, etc., all individuals such as corporate and business vans, trucks and trailers, and dangerous goods transport vehicles, etc. It is installed and installed in the vehicle (collectively referred to as'vehicle') to deal with various emergency situations, collisions, and collisions that may occur during driving due to errors and errors (human errors) such as negligence and negligence of the driver. It relates to a device that supports and assists the vehicle to be safely driven by warning and alerting the driver through means such as cigar and voice.

As shown in Fig. 1, the manufacturer of the vehicle can directly utilize communication and sensor data between many devices of the vehicle, so in the case of an aftermarket that is installed through a separate operation after the vehicle is shipped, a professional installer is required. Most vehicle owners and drivers demand the installation of ADAS in the market, focusing on auxiliary support and warning functions that ensure the safety of the front, and ADAS manufacturers are required to install and install it. Most of the time, focusing on the development and distribution of ADAS based on image analysis attached to the windshield window, it responds to the speed based on the speed data transmitted from the vehicle and detects, classifies, and analyzes if there is an object in front. Forward Collision Warning (hereinafter referred to as'FCW') function that activates the warning device, detects when a vehicle invades or deviates while driving in a lane such as a solid line or dotted line existing on the road. Lane departure warning (Lane Departure Warning, hereinafter referred to as'LDW') function to operate the warning device by classification, analysis, various objects appearing in front of the vehicle through the camera (pedestrians, strollers, adjacent vehicles, traffic lights, traffic signs, (Headway Monitoring & video image analysis Warning, hereinafter referred to as'HMW') function that detects, identifies, identifies, and analyzes crosswalks) and activates the warning device, when the vehicle in front stops waiting for a signal. Various intelligent functions such as Intelligent front vehicle Stop & Go (hereinafter referred to as'ISG') function that detect, classify, identify, and analyze when starting again after a certain period of time and activate a warning device. Implement driving assistance and support functions.

In order to implement various functions such as FCW, LDW, HMW, and ISG described above, ADAS requires various data input and settings such as vehicle information data, camera installation location and image related data, as shown in FIG. Installation is carried out in a specific place that can be installed by a professional installer using a notebook 11 that stores and drives a professional installation program. In particular, it is directly connected to ADAS through a simple wired communication method such as MICRO USB or USB 7 By connecting the laptop 11, a specialized installation program for implementing ADAS functions for each vehicle is driven.

The above video analysis camera-based professional installation program requires data such as vehicle type, vehicle width, engine position, and vehicle height. In particular, the installation position, installation height, and left/right width of the video analysis camera attached to the windshield Since data such as forward monitoring, object recognition, and lane recognition success rates, it is necessary to ensure normal operation by individually inputting all the above-described data into ADAS for each vehicle to be installed through a specialized installation program.

The present invention can easily control all data of ADAS anywhere, anytime, anywhere without the need for a separate wired communication cable such as a notebook 11, MICRO USB or USB 7 in which a designated place, a professional installer and a professional installation program are stored, To manage, a two-way wireless data communication module is attached to the ADAS body (1), and the vehicle owner and driver own mobile communication devices such as smartphones or tablet PCs (10) and connect with a short-range wireless data communication method such as WIFI or Bluetooth. , Through this, by connecting to a wireless mobile communication network such as 3G, 4G LTE, 5G, etc., download the installation and management program from the server 12 in the form of APP (9), and install and use ADAS or connect to the server 12. In the form of installing and using ADAS by registering user information in the form of ID, it maximizes the installation convenience of ADAS, adjusts and manages the setting values of the ADAS function, and allows the vehicle owner or driver to perform installation and maintenance. It is an invention of ADAS that can be directly installed, adjusted, and managed anytime, anywhere, regardless of constraints, and does not require a notebook 11 or other cables or peripheral devices at all.

Most of the causes of vehicle accidents are caused by humans such as driver's mistakes, judgment errors, and carelessness, and the result of research on technology that can prevent them in advance is the intelligent driver assistance system, ADAS, and the core of ADAS. Technology recognizes, classifies, identifies, and analyzes cameras that replace human eyes and image data captured from cameras.Video data recognizes, classifies, identifies, and analyzes roads, lanes, vehicles, obstacles, and pedestrians. , HMW, and ISG are implemented.

Therefore, it is very important to accurately define the camera position for accurate recognition, classification, identification, and analysis of the image data described above, and it is necessary to accurately input the camera position to the ADAS device from the ground on which the ADAS image analysis camera unit is installed. Image data and location data for 3D modeling are indispensable based on data such as height, left vehicle width, right vehicle width, distance to vehicle bumper, distance to front axle and bumper.

Such data must be directly entered into ADAS to realize its original function as ADAS through accurate recognition, classification, identification, and analysis. Existing ADAS products are a separate program for installing the above-described data on the laptop (11). After installing, the notebook 11 and the ADAS device must be connected again with a wired communication cable to input data, so that the general public has disadvantages and inconveniences that cannot be installed.

Therefore, installation support program is absolutely necessary for ADAS installation, and installation is impossible even if ADAS is purchased without being supplied directly from ADAS manufacturers. Even if there is an installation support program, additional data installation equipment such as a laptop is required, and it is again ADAS. It is necessary to connect the cable to be connected with the ADAS manufacturer, and the installation can only be accomplished by a professional installer who has been trained in the entire installation process directly from the ADAS manufacturer and supplied the installation support program. As shown in the figure, it is a reality that there is always an inconvenience in installation that must be directly connected.

On the other hand, manufacturers and installers emphasize product and installation expertise, and explain that it is necessary to connect cables and professional installation work because there is a risk of data contamination, errors, or forgery, but drivers and vehicle owners can easily install and They want to be able to adjust, maintain, and manage simply. Especially, due to the nature of the vehicle, it is often necessary to reinstall after simple moving installation, making it unreasonable to connect the laptop (11), professional installation program, and wired cable. The reality is that it is judged as an installation method.

In addition, since the ADAS function indicator (2) is connected with a wired cable, this is also attached to the vehicle's dashboard, and the wiring arrangement must be added again. Due to the connection, it is impossible to embed or move, it is not visible visually because it is exposed from the inside and outside of the vehicle, and interference with other devices or equipment cannot be avoided due to cables.

The present invention is designed to comprehensively solve the technical limitations of the prior art, various economic and temporal installation problems, mobile installation, maintenance, and management problems as described above. The purpose of the Aftermarket Intelligent Driver Assistance Assistance System (ADAS), which wirelessly adjusts and manages all functions and device settings by installing a data communication module, and its implementation method, is a camera unit and video that must be installed in a conventional vehicle ADAS. It is equipped with a two-way wireless module for processing analysis data and for individual or integrated control units and various interfaces, all in one system for free wireless data communication, and a variety of intelligent driver driving assistance functions. ADAS can be used by the driver or vehicle owner's personal portable mobile communication device (10), such as a smartphone or tablet PC, allowing anyone to easily set up, adjust, and manage functions, so that it is DIY without professional help such as a professional installer or payment of costs. With (Do It Yourself), the driver or vehicle owner can install and move for the first time, and access the server 12 through 3G/4G TLE/5G network, which allows adjustment and management of the provided installation support program, or the Google Play Store After downloading and installing the application (APP) (9) for mobile communication devices provided in the Application Open Market such as (Google Playstore) or iOS, directly through the 3G/4G TLE/5G network, Objects (roads, lanes, roads, lanes, etc.) of ultra-high resolution images provided by a camera mounted inside the ADAS main body (1) installed and attached to the front windshield window directly using the mobile communication device (10) Vehicles, pedestrians, etc.) can be directly checked, installed, adjusted, and managed, and the final set values of installation and adjustment are recorded and stored in the ADAS main body (1) through a two-way wireless data communication module, and at the same time in the server (12). By storing and managing this setting value, By accessing the server 12 or the mobile communication device application 9, you can quickly check anytime, anywhere through the ID registered along with the unique number of the ADAS device, so the efficiency of setting management and device management is very high. You will solve technical challenges.

In addition, the two-way wireless data communication module mounts all of Wi-Fi, Bluetooth, etc. on the ADAS (body), through which it communicates with a portable mobile communication device 10 such as a smartphone or a tablet PC in a short distance, At the same time, the ADAS function indicator (2) and multi-channel communication are performed, so that the driver can freely install and attach it to the driver's optimized position such as the dashboard or the upper part of the instrument panel without the existing ADAS wired cable. There is no obstruction of the view and there is no necessity of wiring arrangement, so it is possible to freely install and attach the ADAS function indicator in the optimal position that meets the driver's needs, thus providing the optimum driving conditions.

Existing ADAS using a wired data cable is very inconvenient when installing, and if there is no separate wired data cable connection, there are disadvantages that it is impossible to install, adjust, and manage. However, the trouble of installation is reduced through the present invention, and a separate notebook Since there is no need for a PC 11, the convenience of installation is guaranteed.

Through the present invention, 1) during installation and construction of the vehicle ADAS system, the intelligent driver driving assistance function can be conveniently checked, adjusted, and managed with only the installation of the ADAS body (1), and 2) anytime, anywhere personal portable mobile communication It is possible to freely attach, install, check, adjust, and manage using the device 10, and 3) access the server 12 via a 3G/4G LTE/5G network through a wireless network or an application for mobile communication devices (APP). Therefore, it is possible to record, store, change, manage and maintain comprehensive data for each registered device and manager. 3) The driver, vehicle owner, and manager can directly Management is possible, and 4) free installation and attachment are possible, so that it does not interfere with the driver's view or other peripheral devices such as navigation, and 5) separate specialized equipment for ADAS installation, laptop (12), wired data There is no need for equipment and materials required for installation and construction, such as preliminary preparation, purchase, and provision of cables, etc., 6) time and cost are drastically reduced, and 7) anyone using the system of the present invention is simple and efficient. Confirmation, installation and movement Installation, management and operation, and operation management are performed.8) Simple maintenance and inspection are possible by simple self-inspection, confirmation, and diagnosis of faults, which will greatly increase the efficiency of equipment operation. 9) Can be interlocked with devices capable of additional wireless communication, so that the expandability of the device can be greatly expanded, and 10) ADAS can be easily and simply improved wirelessly by using a personal portable mobile communication device (10). It can be (upgraded), 11) it can be widely applied from small vehicles to large vehicles, even specially equipped vehicles, and 12) due to the characteristics of communication between devices of mobile communication and short-range wireless communication, fast response speed, high efficiency and convenience, economical efficiency, Since it can meet all the various demands such as operational stability, problems with existing ADAS or function indicators, and technical skills of each individual equipment or device Limitations and problems can be solved.

After-market intelligent driver assistance support system (ADAS) that wirelessly adjusts and manages all functions and device settings by installing a multi-channel bidirectional wireless data communication module, which is the present invention, to achieve the purpose of solving the problems of the existing ADAS as described above. ) And the method for accurate implementation is a powerful SoC processor capable of high-speed computational processing and sufficient large-capacity memory to classify, identify, check, and analyze image data transmitted at high speed and large-capacity from ultra-high resolution cameras. Based on H/W, it executes and applies the corresponding individual or integrated algorithm for intelligent functions such as FCW, LDW, HMW, ISG, and establishes a wireless communication module for two-way wireless data communication such as WIFI and Bluetooth. The entire system is configured to enable wireless communication between the personal portable mobile communication device (10) and the ADAS function indicator (2) by installing it inside, and individuals such as smartphones and tablet PCs to support integrated management and operation of this system An installation support program for portable mobile communication devices, a network server, etc. are comprehensively required.

For this, Figure 2. As shown in Figs. 3, 4, and 5, the problem is solved from individual devices that perform their own tasks and roles, and at the same time, the entire system is configured and implemented. And the explanation of each part are as follows.

(1) ADAS main body: A high-resolution CMOS image sensor and a multi-layer high-resolution wide-angle lens-based camera with high resolution and resolution capable of reproducing ultra-high quality are mounted, and data captured by the camera and transmitted at high speed are checked, classified, and Data processing unit with built-in identification and analysis algorithm, data operation unit, data storage unit and two-way wireless data communication module unit (WIFI and Bluetooth, etc.), voice speaker unit for generating warning and alarm sounds, operation indication LED, MICRO USB (OTG) connector port that enables bi-directional wired data communication that can be used for emergency in case of abnormal wireless data communication, adjusts and fine-tunes the camera in the UP or DOWN direction depending on the mounting height All camera controllers (brackets) with fixing hinges that can be fixed are assembled in a standalone type and mounted in the center of the vehicle's windshield window to provide accurate functions of FCW, LDW, HWM and ISG. It is the core device of the whole system that performs

(2) ADAS function indicator: Existing ADAS products are connected by wire to display the execution status of various ADAS functions. In the present invention, the ADAS main body (1) is selectively connected wirelessly or wired to FCW, LDW, HWM, The performance of ISG functions is displayed in various visual ways, and the contents of the display appear in the front of the vehicle and are identified, identified, identified, and detected by the ultra-high resolution camera, based on the object (vehicle, pedestrian, etc.) and the current driving speed. The estimated collision time assuming that the brake of the vehicle does not operate is displayed in a number of seconds and changes or flashes in red, and displays multiple warnings with a voice speaker to inform the driver. Based on the analysis data on the lane, the indication and warning for the proximity and departure of the left/right lane are changed or flashed in red to a display similar to the lane, and at the same time, the driver is notified by multiple warnings with a voice speaker. The danger of pedestrian proximity and collision detected, identified, identified, and detected by the ultra-high resolution camera is changed to red and displayed in a form similar to the pedestrian mark of a general pedestrian traffic light, and at the same time, multiple warnings are made with the voice speaker. It notifies the driver, and when recognizing a vehicle that appears in front of it, a white display similar to a small vehicle is displayed, and when there is a collision risk, a red display is displayed. At the same time, multiple warnings with a voice speaker are displayed to notify the driver. (Optional) Equipped with a short-range wireless communication module for wireless communication with the ADAS body, an LED light source capable of operation without a wired cable is installed inside, and ADAS function is supported with a visual effect.

(3) ADAS hub: CAN BUS communication with the vehicle or relay box (analog) to check the vehicle speed, the left turn indicator operation, and the right turn indicator operation through the main cable (4) connected to the ADAS body (1). Method/electrical signal), relays the connection and communication with peripheral devices and peripherals equipped with communication means such as RS232 and RS485, and relays the ADAS function indicator (2) and the ADAS body (1). It plays a role as a HUB, such as relaying signals for function display and information sharing.

(4) Main cable: Connect ADAS body (1) and ADAS hub (3), power line for supplying power required for ADAS body (1) and ADAS function indicator (2), ACC line for detecting start, It is a multi-purpose cable with built-in GND line for grounding and cables for CAN BUS communication.

(5) Two-way wireless data communication module: Built-in ADAS body (1) to support short-range wireless data communication, and a smart phone or tablet for wireless data communication in the form of a WiFi module, a Bluetooth module, etc. It is connected to a personal portable mobile communication device 10 such as a PC, and at the same time connected to the wireless communication module 6 of the ADAS function indicator 2.

(6) Wireless communication module: Receives wireless data from the ADAS body (1) in the form of a Wi-Fi module, a Bluetooth module, etc., and supports the visual display of the ADAS function. It performs voice warning and alarm functions along with visual indication.

(7) Data cable: MICRO USB (OTG) or USB type port provided to support bidirectional communication with ADAS body (1) even in emergency situations such as abnormality, damage, breakdown, flooding of the wireless module of ADAS body (1) It is a wired cable to support (Port or Slot).

(8) Speaker: Built in ADAS body (1) or ADAS function indicator (2) for voice alarm and warning along with ADAS function indicator (3) when ADAS is operating.

(9) Installation application for mobile communication devices (Application): This is an application for the driver or vehicle owner to install by DIY (Do It Yourself) and to set and check various data, and a server capable of adjusting and managing the provided installation support program (12) As a means for accessing through the 3G/4G TLE/5G network, the application for mobile communication devices provided in the Application Open Market such as Google Playstore or iOS (APP) (9) is downloaded and installed directly through a 3G/4G TLE/5G network, and is in the same form as in FIGS. 7, 8, 9, 10, 11, 12, 13, and 14.

(10) Personal portable mobile communication device: It is possible to download and install the installation application (9) for the mobile communication device and use it to the network server 12 through a 3G/4G LTE/5G mobile communication wireless network. A device that can be accessed is the driver, vehicle owner, and vehicle management authority grantor.

(11) Laptop: Refers to the PC installed with the ADAS installation support program limitedly provided by the manufacturer for the installation of the existing ADAS.

(12) Network Server: A mobile communication device application (APP) (9) or a server that can be accessed through a wired or wireless network, which supports installation support programs, and IDs vehicle information, driver information, and manager information. It manages in the form of a password and a password, and stores and records all ADAS settings such as the current function setting of ADAS, the current installation location, and installed vehicle information, and operates 24 hours for users to support.

Each unit and each device described above are organically connected to each other based on wireless data communication, and all this data is stored and managed by the server 12, and all these data are integrated and connected to the multi-channel of the present invention. By installing a two-way wireless data communication module, an intelligent driver assistance assistance system (ADAS) for the aftermarket that wirelessly adjusts and manages all functions and device settings, and accurately implements it to solve all technical problems.

Vehicles and vans through an aftermarket intelligent driver assistance support system (ADAS) and an implementation method that wirelessly adjusts and manages all functions and device settings by mounting a multi-channel bidirectional wireless data communication module of the present invention having the above configuration, When applied to vehicles such as buses and trucks, the following effects are achieved.

First, as shown in Figs. 5 and 6, when installing and constructing ADAS, attach the ADS body (1) to the upper or lower center of the vehicle's front windshield window and attach the cable to the ADAS hub (3). After connecting the device according to the purpose, all installation preparations are completed by simply applying power, and access to the server 12 using a personal portable mobile communication device 10 or download the mobile communication device APP 9 ADAS (Intelligent Driver Assistance Assistance System) functions such as FCW, LDW, HMW, and ISG are easily applied by simply installing on the mobile communication device 10, and all data set values are recorded and stored in the server 12 to be adjusted from time to time. , Change, manage,

Second, all functions and settings related to ADAS can be adjusted and changed using a personal portable mobile communication device 10 such as a smartphone or tablet PC that can be connected to a mobile communication wireless network such as 3G, 4G LTE, 5G, etc. , By simply inputting and storing these set values without connecting a wired cable through the two-way wireless communication module (5) built into the ADAS body (1), quick and convenient installation is possible.

Third, it is very convenient to install, adjust, and manage ADAS from time to time because there is no need for a special installation program or a separate device such as a notebook 11, and a wired cable connection is required. Operation and management efficiency is high,

Fourth, it can be conveniently installed and adjusted even when moving and installing ADAS and replacing faults,

Fifth, the wireless communication module built into the ADAS function indicator (2) without any wired connection to the ADAS body (1) and the data cable and the ADAS body (1) and the ADAS function indicator (2), and the ADAS hub (3) 6) is used to visually express all functions of ADAS, so it is possible to freely attach and install the ADAS function indicator (2) without the hassle of wiring arrangement, etc.

Sixth, through the two-way wireless communication module 5 built into the ADAS main body 1, data communication with other peripheral devices or peripheral devices of a vehicle equipped with a communication module such as WiFi or Bluetooth is possible, and is extended. Can increase sex,

Seventh, as shown in Fig. 5, it is possible to eliminate the hassle and inconvenience of the vehicle interior and the dashboard due to the wired connection,

Eighth, for the installation of ADAS, directly connect to the server 12 through the mobile communication device 10 and mobile communication wireless networks such as 3G, 4G LTE, 5G, or connect the mobile communication device APP 9 in the form of ID and password. By using the server 12, you can search, check, adjust, and change functions and setting values, and you can individually store and record setting values for each ID, so you can adjust and manage ADAS without time and place restrictions. ,

Ninth, as shown in Fig. 7, various security access and login such as login through mobile phone number, login through KakaoTalk, login with Naver, login with Facebook, and direct server access login using the mobile communication device 10 are possible. Guarantees sex,

Tenth, through the present invention, all efficient safety management, operation, and operation management are possible by a driver or manager with a simple personal portable mobile communication device 10, and simple maintenance and inspection through various self-inspection and diagnosis functions This makes it possible to greatly increase the operating efficiency of the equipment,

Eleventh, all individuals such as passenger cars and taxis, all individuals such as corporate and business small vehicles, multi-seater minivans, buses, etc., all individuals such as corporate and business vans, trucks and trailers, vehicles for transporting dangerous goods, etc. It can be widely applied to all vehicles, including freight transport vehicles, even specially equipped vehicles, and heavy construction equipment.

Twelfth, it is possible to synchronize data by linking with the present invention and external devices and external devices installed and installed inside and outside the vehicle to synchronize or control data, greatly expanding the use and scope of equipment operation,

The installation and construction of the present invention can wirelessly connect, control, and manage intelligent driver assistance functions such as FCW, LDW, HMW, and ISG while significantly saving installation time and cost. Optimized real-time warning and It is effective in preventing all accidents that may be caused by the driver's carelessness and mistakes as the alarm is activated in a visual and audible form.

The following is a preferred embodiment of an Aftermarket Intelligent Driver Assistance Assistance System (ADAS) that wirelessly adjusts and manages all functions and device settings by installing a multi-channel bidirectional wireless data communication module, which is the present invention, and an implementation method, overall configuration and installation support. A program, APP and RM installation and adjustment method, and implementation method of the entire system are attached, and the following is a brief description of the drawings.
1 is a conceptual diagram and functional description of an ADAS (Intelligent Driver Assistance System) applied to a vehicle, and an installation support program is installed on the notebook 11 to implement the normal functions of ADAS, and functions and settings are performed through a wired data cable. It is a connection diagram for the installation and connection method for the existing ADAS device to be adjusted.
2 is a diagram for a detailed description of the configuration of the main device of the present invention.
3 is a detailed connection and implementation diagram of main devices of the present invention and all peripheral devices required for installation.
4 is a description of main contents visually expressed by the ADAS function indicator 2.
5 is an exemplary embodiment in which the present invention is installed in a vehicle.
6 is an embodiment of a case of applying the present invention to a truck and a bus.
7 is an embodiment of an installation support program installed in a personal portable mobile communication device 10 and an initial login screen of an APP in order to correctly implement the present invention.
FIG. 8 is an embodiment of an initial screen displayed on the mobile communication device 10 after access through login.
9 is a function of viewing a front image photographed through a camera from a position attached to the front windshield window of a vehicle by wirelessly connecting to the ADAS body 1 through a two-way wireless data communication module 5 This is an embodiment displayed on the device 10.
10 shows a lane recognition distance in a front image picture captured through a camera from a position attached to the front windshield window of a vehicle by wirelessly connecting to the ADAS body 1 through a two-way wireless data communication module 5 This is an embodiment in which the setting function for the setting, the lane transplanting distance, and the extinction distance is displayed on the mobile communication device 10.
11 shows the contents of various signal settings, for checking the speed output from the vehicle, the connection method for the analog relay, OBD, etc., to check whether the left/right turn indicator is on, setting the communication speed, etc. This is an embodiment in which the setting function is displayed on the mobile communication device 10.
12 is an embodiment in which functions such as installation location setting values, camera settings, vehicle information, customer information, and function settings of the ADAS body 1 are implemented and set on the mobile communication device 10.
13 is an exemplary embodiment in which a setting for a location of a camera built into the ADAS body 1 and a reference image are displayed on the mobile communication device 10.
Fig. 14 shows the distance and image recognition between the front bumper and the object of the vehicle for the accurate function implementation of ADAS, the distance and image recognition from the object 0.5 meters from the front bumper, and the distance and image recognition from the object 1 meter away from the front bumper. , This is an embodiment displayed on the mobile communication device 10 for adjusting the distance and image recognition, the final camera angle, and the like with an object 2 meters away from the front bumper.
Fig. 15 is a representative diagram of the overall data flow and connection method, as the contents of the overall operation and concept of the present invention.

The following is an aftermarket intelligent driver assistance support system (ADAS) that wirelessly adjusts and manages all functions and device settings by installing a multi-channel bidirectional wireless data communication module, which is the present invention, and details of the implementation method in the entire system. It will be described in detail based on the accompanying drawings and preferred embodiments.

First of all, the present invention provides power to the vehicle through cables (including wires) suitable for each purpose to the ADAS main body 1 that can be attached to the windshield window of the vehicle from a designated seat where the driver can see the front. It connects to and connects to a communication means (including CAN BUS, analog relay, CRACK, external device, OBD terminal, etc.) that can check the operation of the speed, left and right direction indicators in the vehicle. By installing so that it is possible to check whether power is applied, vehicle driving speed information, driver's left and right direction indicators, and operation status information, various ADAS functions based on image cameras including ADAS warning and alarm functions can be accurately implemented. Basic cable connection and wiring work for this is required as shown in FIGS. 3 and 5.

For basic cable connection and wiring work, all vehicles must stop at a certain place and physical time for installation is indispensable, starting with power line connection work by personnel capable of cable connection and wiring work of the vehicle. Several basic tasks are required, such as connection work of ODB2 terminal for communication or connection work through a relay box, and such basic wiring work is implemented as an ADAS (Intelligent Driver Assistance System) function as shown in Figs. It must be installed for this purpose, and additional data is required to complete the 3D modeling algorithm due to the system structure based on detection, recognition, classification, identification, and analysis of objects in front (vehicles, roads, lanes, pedestrians, etc.) through image cameras. Because it does.

Vehicles with ADAS installed and operated do not only analyze fixed images captured in a motionless space, so data on driving conditions are required. The easiest and fastest way to calculate and process this is through vehicle speed data. And, since it is accurate data, it is the most stable relationship for the ADAS body 1 to receive and input information about it from the vehicle. As shown in Fig. 6, FCW, LDW, HWM, which operate through recognition of the front vehicle and object, It is essential for implementing all ADAS functions such as ISG.

In implementing LDW function, the data on whether the left and right turn indicators are instructed to operate, ADAS distinguishes and identifies the vehicle's running speed, road, and lane. , Since the warning and alarm functions are activated in the situation of lane departure, the driver of the vehicle needs to detect the intentional lane movement and departure to the left or right. Since the right turn indicator is directly operated, it is necessary to receive and input signals and data for this to the ADAS body (1).

First of all, after cable connection and wiring arrangement for basic installation as described, after-market intelligent driver assistance that wirelessly adjusts and manages all functions and device settings by installing a multi-channel bidirectional wireless data communication module of the present invention. A support system (ADAS) and the correct function implementation and operation, and setting work is made for the implementation of the invention.First, for the present invention, the ADAS body 1 is equipped with the following functional units, respectively, and a specific configuration and The contents of the ADAS body (1) will be described sequentially as follows.

(1) As shown in Figs. 2 and 3, the ADAS main body 1 has all of the functional units that perform the following functions built-in, thereby implementing the present invention.

1) Image camera part: As the most essential part of ADAS, it is located so that the image pickup device such as CCD or CMOS can be mounted and imaged in front of the vehicle, and accurate high-definition through optical systems such as OLPF (Optical Low Pass Filter) and lenses. The image data is optimized for daytime and nighttime situations and provided to the image data processing and control unit. In ADAS, it is installed at a location to recognize a road, a lane, or an object in front, and mounted on a bracket to enable fine adjustment of the physical up and down.

2) Image data processing unit: Through the image data of the image camera unit, it detects and recognizes whether the object in front of the vehicle is a vehicle, a pedestrian, or an obstacle, and distinguishes whether to calculate or ignore the recognized object in an algorithm, and the selected object is Identify what type of lane, what type, and what color of lane, and perform and process all the above-described operations simultaneously or individually, such as comprehensive analysis of image data for implementing ADAS functions, and process them with other data. It is collected and transmitted to data processing for comprehensive computational processing through an algorithm.

3) Data processing and storage, control unit: Data processed through classification, identification, recognition, detection, analysis, etc. in the image data processing unit, the speed provided by the vehicle such as CAN BUS communication data, relay signal data, etc., left and right directions It stores data on whether the indicator light operates, and based on this, analyzes and processes algorithms equipped with major functions such as FCW, LDW, HWM, and ISG of ADAS (Intelligent Driver Assistance System) to integrate or control each function individually. And, based on the final processed result, it warns and alarms through the operation indicator of the voice speaker (8) or ADAS body (1), and at the same time, controls peripheral devices such as ADAS function indicator (2) at the same time or individually, integrated or individually. Thus, the overall ADAS function is implemented and controlled.

4) Two-way wireless data communication module (5): Built-in modules for mobile communication such as 3G, 4G LTE, and can be connected to the network server 12 via a wireless network 13, and at the same time, a WiFi module and a Bluetooth ( A device built into the ADAS body (1) for two-way wireless data communication with personal portable mobile communication devices 10 such as smartphones or tablet PCs capable of independent wireless connection with short-range wireless communication devices with built-in Bluetooth) modules It supports short-range wireless data communication, is built-in in the form of a Wi-Fi module, a Bluetooth module, etc., and a personal portable mobile communication device 10 such as a smartphone or tablet PC and a wireless communication module 6 ) It is possible to connect wirelessly with the ADAS function indicator (2) mounted at the same time or separately, and it plays the role of receiving or transmitting various wireless data input or output from the ADAS body (1). Through the two-way wireless data communication module, installers and managers connect with personal portable mobile communication devices 10 such as their own smartphones or tablet PCs to automatically connect or manually connect ADAS body 1 to install APP for mobile communication devices. Direct control is possible through (application), through which the installer or administrator can easily install ADAS, and the installation time is innovative because there is no need for a professional installation program required for installation and a laptop with this installation program. It can be shortened to, and even in future maintenance management and previous installation, there is an advantage that ADAS can be used conveniently anywhere, without limitation or restriction of places, just by arranging the wiring of power for basic installation and CAN BUS communication, etc. .

5) Two-way wired data cable connection connector (7): Even if the two-way wireless data communication module (5) is built-in, it is equipped with a wired cable connection means that performs the same function just in case. There is a wired communication means such as, MICRO USB (OTG), etc., and a wired connection through a wired communication cable with a mobile communication device 10 such as a notebook 11 or a smart phone or a tablet PC is possible. In addition, a connector port (or slot) that can be used simultaneously for various purposes such as device upgrade, trouble repair, data verification, etc. is provided at any place such as the left, right, or lower part of the ADAS body (1), and various installation and function settings Is supported together with a two-way wireless data communication module, and can be used separately or simultaneously.

6) SD card insertion part: Used when storing or moving image data implementing ADAS function and event occurrence data such as collision risk like a black box, and used for updating or upgrading ADAS FIRMWARE.

7) Voice speaker unit (8): By implementing and implementing each function of ADAS, warning and alarm sounds are generated, and data are processed and implemented and operated as programmed by the control unit.

8) Main body case and exterior: As shown in Figs. 2 and 5, it has strong durability against shock and vibration, and is molded with CF coated in preparation for the temperature inside the vehicle in summer to rise to 90 degrees due to its strong heat resistance. This product has a camera angle adjustment part for adjusting the angle of the camera on the right or left side, and it is a structure that can be fixed and installed after fine adjustment and adjustment, and there is a sticker to attach, so the protective film is removed and mounted on the windshield.

9) ADAS operation indicator: When power is applied to the ADAS main body (1), the ADAS main body (1) starts booting and the operation indicator lights up, and when a power failure light is detected, it flashes to warn the driver.

10) Camera angle adjustment unit (angle fine adjuster): When attaching the ADAS body (1) to the front windshield of the vehicle, no matter how much the ADAS body (1) is attached to the center to determine the position of the camera, the road, lane, and vehicle in front of the vehicle , In order for objects such as pedestrians to be recognized most accurately, the camera needs to be vertically adjusted and finely adjusted based on the horizon, so the image camera unit is connected, mounted, and fixed bracket and camera angle adjustment unit (angle fine adjuster) are attached and fixed. It is an integral type that makes it easy to move up and down, and the groove of the screw is provided so that the camera does not move even in the form of a fine toothed tooth, and can be fixed secondly using a screwdriver.

11) Main cable (4): As shown in Fig. 3, it is connected to the vehicle connector provided in the ADAS body (1), and a stable power supply is provided by connecting power, ACC, and GND to the ADAS body (1). For convenience of installation, a CAN BUS communication cable (wire) is provided, and it serves as a path through which signals and data input and output from the ADAS hub 3 move.

(2) As shown in Figs. 3 and 4, the ADAS function indicator 2 has both a function unit and a function display unit that perform the following functions, and implements the present invention.

1) Function display unit: As shown in Fig. 4, various functions are implemented and displayed, and various colors such as white and red are implemented using LEDs or similar light sources to display an intense visual effect to the driver. The data for each function transmitted from 1) to the wired cable is displayed, and the data for each function as follows, which is transmitted from the ADAS body 1 using the built-in short-range wireless communication module 6, the same data as the wired cable. Is displayed.

It displays the expected collision and collision time compared to the speed with the front object (vehicle and pedestrian) in seconds, and changes to red when approaching within 1 second, and at the same time warns and alarms with the voice speaker 8 of the ADAS main body (1).

The left and right lanes are recognized and detected on the left and right sides of the vehicle, respectively. Lights up when the vehicle is approached, blinks in case of invasion or departure, and warns and alarms with the voice speaker 8 of the ADAS body (1), It operates based on data transmitted from communication means (including CAN BUS, analog relay, CRACK, external device, OBD terminal, etc.) that can check whether the right turn indicator is working.

When a pedestrian appears or approaches in front of the vehicle, it is changed to red, and at the same time, the voice speaker 8 of the ADAS body 1 warns and alarms.

It displays front vehicle recognition and collision warning, and changes to white when the vehicle in front is detected and recognized, and changes to red when the vehicle's collision or near-collision danger distance is reached, and at the same time, a warning and alarm is made by the voice speaker (8) of the ADAS body (1). do.

2) Short-range wireless communication module (6): A module for short-range wireless communication with the multi-channel bi-directional data-free communication module 5 of the ADAS body 1, and wirelessly transmits data for function display connected by wired cable. To transfer.

3) Voice speaker unit: A voice speaker can be installed in place of the voice speaker 8 installed on the ADAS body (1).

4) Cable part: It serves as a passage for transmitting the function indication data transmitted from the ADAS main body (1).

(3) As shown in Figs. 2, 3, and 5, the ADAS hub 3 has all of the connector parts and connector connection ports (slots) that perform the following functions. Is implemented.

1) ADAS body (1) main cable (4) connector: connected to the ADAS body (1), a communication means (CAN BUS, analog relay, CRACK, etc.) that can check the operation of speed, left and right direction indicators in the vehicle. It relays external devices, OBD terminals, etc.), transmits the above-described communication data to the ADAS body (1), and supports bidirectional communication by connecting with peripheral communication devices using RS232 and RS485 communication methods. On the contrary, the ADAS function indicator (2) performs a function of relaying and transmitting the function display data implemented from the ADAS body (1).

2) ADAS function indicator (2) connector: By connecting the ADAS function indicator (2), the function display data transmitted from the ADAS body (1) is relayed.

3) Relay (analog) signal cable connector: It relays the input of electrical signal data such as speed data produced from the vehicle and the right and left direction indicators, and is connected to the ADAS body (1).

4) CAN BUS communication input cable connector: Relays the input of speed data produced from the vehicle and signal data such as right and left direction indicators, and connects to the ADAS body (1).

5) CAN BUS communication output cable connector: relays the output of data related to the function implementation of ADAS produced from the ADAS body (1), and transmits it to the vehicle's ECU to connect and use the vehicle's data.

6) RS232 communication cable connector: Relays and connects two-way communication or one-way communication with peripheral devices and equipment that use RS232 as a communication method.

7) RS485 communication cable connector: Relays and connects two-way communication or one-way communication with peripheral devices and equipment that use RS485 as a communication method.

(4) Network server 12: As shown in Fig. 15, a mobile communication device 10 such as a smartphone or tablet PC supporting high-speed data communication such as 3G, 4G LTE, 5G, and a wireless network 13 ), and is connected by entering a domain directly into the mobile communication device 10 for data communication connection (internet connection) through the wireless network of the mobile communication device 10, or an APP (application) for a mobile communication device (9 ), and the network server 12 (including all of the DDNS server, data server, client server, etc.) supports the user's access, and the installation support program is used, user information input and storage, device information input and It is possible to save and record various functions such as post management and setting confirmation by inputting and storing various data such as storage and setting data, and confirmation for maintenance. As shown in FIG. 15, all input/output data is transmitted from the network server 12 to the mobile communication device 10 through the wireless network 13 through 3G, 4G LTE, and 5G networks, and the mobile communication device 10 In again, it is connected to the ADAS body 1 through a two-way wireless data communication module or wired cable to implement the ADAS function. Also, input/output data is transmitted to the network server 12 in the reverse order.

(5) Wireless network 13: As shown in FIG. 15, an installer or an administrator refers to two-way data communication such as 3G, 4G LTE, and 5G embedded in the mobile communication device 10, and communication is possible anytime, anywhere. In the region, it is a means that can be connected directly through domain address input or through an APP (application) for mobile communication devices (9).

(6) Mobile communication device APP (application) (9): The present invention uses the mobile communication device 10 described above to connect to the network server 12 through the wireless network 13, and install the ADAS from the server. And installation support program (installation software) for management, each function and location for ADAS, vehicle information, etc. are set, and this data is stored and recorded in ADAS through the two-way wireless data communication module (5). It is characterized by performing intelligent driver assistance and assistance functions optimized for the conditions and types of drivers. To this end, it is necessary to set each information data and function of the installation support program (software) as follows.

1) As shown in Fig. 7, it is based on the ID (user) and password (password), and through the registration of ADAS administrators and users and registration of the unique number displayed on the ADAS body (1), a personal portable communication device ( 10), it is possible to operate and implement functions.Other than those who have registered and granted this administrator authority, access is restricted for stable operation and function implementation of the registered ADAS, while providing various login methods to support simple connection. Is done.

2) As shown in Fig. 8, based on the registered ID and the unique device number of the registered ADAS assigned by the manufacturer, the wireless connection status and the ADAS connection are adjusted, and the vehicle and device status, and basic information related to ADAS It can be viewed as a portal screen for detailed function setting. In order to prevent arbitrary manipulation of ADAS, a wireless communication connection with the ADAS body (1) is established by the administrator.

3) As shown in Fig. 9, the present invention enables two-way communication through a two-way wireless data communication module. After the ADAS main body 1 is first installed on the vehicle's front windshield window, For angle adjustment and fine adjustment, it is possible to acquire information about the location of the horizontal line and the approximate current installation location of the ADAS body 1 through the dividing line view by randomly taking and photographing image data (photo data) captured from the built-in camera. Based on this, the exact location of the camera for implementing the ADAS function can be identified and confirmed. After confirming the data, it can be stored and recorded in the ADAS body.

4) As shown in Fig. 10, after setting the camera's installation position and making fine adjustments to the horizon, set how wide and how long the lane on the road is to be determined. This is possible, and a reference lane displayed in green can be designated by directly touching the screen. Through this, it is possible to designate a distance of lane recognition up to a distance of up to 110m, and by setting the lane recognition distance, it is possible to determine the recognition and detection distance of objects including vehicles in front.

5) As shown in Fig. 11, on the main setting screen, the registered user and device number are checked, and how the cable can be connected to the ADAS hub (3), and whether to connect wirelessly or wired, various connection methods can be set. Can control the communication speed of wired and wireless data, and how to receive data related to speed from the vehicle CAN BUS communication method, relay (analog) signal data communication method, CARACK method, OBD terminal direct connection method , The vehicle data is downloaded from the server 12 by selecting and storing the most optimized method, and data input methods such as direction indicators are also selected and stored in one or more of the aforementioned methods. Additional settings for connection of other additional peripheral devices or equipment are possible. In addition, it is possible to verify the data for an appropriate connection to the above data, and the settings are recorded and stored based on the time indicated on the network server 12.

6) As shown in Fig. 12, in the main setting screen, additionally the above-described camera setting and setting data for camera adjustment, information on a vehicle equipped with a stored device, information on a user, selection and adjustment of functions, SD You can change, adjust and save the black box function settings for video storage through the card.

7) As shown in Fig. 13, it is possible to adjust and set information on the location where the ADAS body (1) is attached and information on the specifications of the vehicle, and the camera built into the ADAS body (1) is the front windshield of the vehicle. Even if it is attached to the center of the windshield window, fine positioning and adjustment are required according to the left and right width of the vehicle, the width of the vehicle, the position of the front wheel and the height of the driver's seat, so based on the vehicle width, camera installation height, and camera installation position. Enter the distance to the left and right ends of the body, the distance to the front of the vehicle, and the distance from the front end of the vehicle to the front axle in meters, and attach the vehicle image for reference to set the exact dimensions. It is provided so that the installer can easily recognize it.

8) As shown in Fig. 14, so that the camera built into the ADAS body 1 can more accurately recognize the object in front, the information of the lane is input, and at the same time, the object recognition image of the closest distance in the front of the vehicle is displayed. Image capture, close-distance object recognition images of 0.5 to 2 meters are captured, each image is recorded, and the angle of view on the left and right is finely adjusted horizontally and vertically, and the result is verified in the form of a photographic image. You can save and record fine adjustment values.

9) Each individual value of the installation support program for all the above-described function settings, location settings, etc. are all stored and recorded in the network server 12 along with the device information, user information, and vehicle information of the ADAS device by ID. All are transmitted and stored to the main body 1, and stored and recorded in the network server 12 through the mobile communication device 10 for future maintenance and management.

Specific structural or functional descriptions of the embodiments according to the concept of the present invention disclosed and illustrated in the present application are exemplified only for the purpose of describing the embodiments according to the concept of the present invention, within the technical scope of the present invention. In addition to other modified implementations are possible, the embodiments according to the concept of the present invention may be partially or substantially modified in various forms and implemented, numbers, steps, operations, components, parts, or a combination of these including ( Unit), device, equipment, function part, etc., in order to implement the same function as the implementation of the present invention, name and name, structure, configuration, connected terminals, ports, slots, connectors, Various changes can be made to the interface, etc., and may have various forms, and since it is not limited to the embodiments described in the present application, the true technical protection scope of the present invention is based on the overall technical spirit and concept of the appended registration claims. It must be decided.

In addition, when a component is referred to as being “connected” to another component, “connected” or “coupled”, and when it is said that it is “mounted”, “attached”, “installed”, “mounted”, When it is referred to as “embedded”, it should be understood that it is directly connected or connected to the other component, but other components may exist in the middle, and other expressions describing components or operations, In other words, “to provide” and “supply” or “as with” and “with” should be interpreted as well.

In addition, the terms "include" or "possible" and the terms "install" or "install" mentioned above refer to implemented features, numbers, steps, actions, components, parts, or a combination of them. It is intended to designate and describe the existence of a device, device, or function part, but includes one or more other features or numbers, steps, actions, components, parts, or It should be understood that the absence, omission, addition or addition of a unit, device, equipment, or function part does not preclude in advance.

In addition, the embodiments of the present invention are only one embodiment of the technical idea of the present invention, and unless explicitly defined newly in the present application, the present invention includes technical or scientific terminology for those skilled in the art. All terms used in the application have the same meaning as commonly understood in the technical field to which the present invention belongs, and terms as defined in a commonly used dictionary have a meaning consistent with the meaning implied in the context of the related technology. It should be interpreted as having.

Claims (5)

A camera unit for capturing a front image of the vehicle and image data, and a data collection unit for motion detection data such as speed data and left and right direction indicators of the vehicle,
Mounting and connecting a module 5 for two-way wireless data communication in a data processing unit and data recording and storage unit for detection, recognition, classification, identification, analysis, and processing of the data,
ADAS body (1) that is all assembled inside one independent case and attached to the front windshield of the vehicle (Front Windshield Window);
A personal portable wireless mobile communication device 10 such as a smart phone and a tablet PC, and a means and method for multi-channel wireless two-way data communication such as WiFi or Bluetooth;
A personal portable wireless communication device 10 capable of accessing an Internet network using a 3G, 4G LTE, 5G wireless mobile communication network or Wi-Fi;
Connect by entering the domain address directly to the network server (SERVER) (12), or download and install and connect the mobile communication device APP (application) (9) that can be connected and connected to the network server (SERVER) (12). , Accessing the server 12 to register a user ID and a password, and set various ADAS information, functions, and installation information in the personal portable wireless communication device 10;
Intelligent driver assistance system for vehicles that transmits, stores, and records all set information and set values such as data to the ADAS main body 1 through a wireless two-way data communication means.
A camera unit for capturing a front image of the vehicle and image data, and a data collection unit for motion detection data such as speed data and left and right direction indicators of the vehicle,
Mounting and connecting a module 5 for two-way wireless data communication in a data processing unit and data recording and storage unit for detection, recognition, classification, identification, analysis, and processing of the data,
ADAS body (1) that is all assembled inside one independent case and attached to the front windshield of the vehicle (Front Windshield Window);
A personal portable wireless mobile communication device 10 such as a smart phone and a tablet PC, and a means and method for multi-channel wireless two-way data communication such as WiFi or Bluetooth;
A personal portable wireless communication device 10 capable of accessing an Internet network using a 3G, 4G LTE, 5G wireless mobile communication network or Wi-Fi;
Connect to the server 12 with a domain address directly to the network server 12, register a user ID and password, and set various ADAS information and functions in the personal portable wireless communication device 10. ;
Intelligent driver assistance system for vehicles that transmits, stores, and records all set information and set values such as data to the ADAS main body 1 through a wireless two-way data communication means. A camera unit for capturing a front image of the vehicle and image data, and a data collection unit for motion detection data such as speed data and left and right direction indicators of the vehicle,
Mounting and connecting a module 5 for two-way wireless data communication in a data processing unit and data recording and storage unit for detection, recognition, classification, identification, analysis, and processing of the data,
ADAS body (1) that is all assembled inside one independent case and attached to the front windshield of the vehicle (Front Windshield Window);
A personal portable wireless mobile communication device 10 such as a smart phone and a tablet PC, and a means and method for multi-channel wireless two-way data communication such as WiFi or Bluetooth;
A personal portable wireless communication device 10 capable of accessing an Internet network using a 3G, 4G LTE, 5G wireless mobile communication network or Wi-Fi;
After downloading and installing an APP (application) for mobile communication devices (9) that can connect and connect to a network server (12), connect and connect to register a user (USER ID) and password, and various ADAS Setting information and functions in the personal portable wireless communication device 10;
Intelligent driver assistance system for vehicles that transmits, stores, and records all set information and set values such as data to the ADAS main body 1 through a wireless two-way data communication means.
In the implementation as described in claims 1, 2, and 3,
The wireless communication module (6) is built into the ADAS function indicator, and the information, data, and signals for visual display of the ADAS function transmitted from the ADAS body (1) are transmitted using the multi-channel bidirectional wireless data communication module (5). Intelligent driver assistance system for vehicles with wireless transmission to the indicator. In the implementation as described in claims 1, 2, and 3,
Built-in various two-way wireless data communication modules 5 such as two-way Wi-Fi, Bluetooth, etc., and additionally equipped with MICRO USB (OTG) terminals for wired data communication in any location of the ADAS body (1). ;
A personal portable wireless communication device (10) equipped with a MICRO USB (OTG) terminal capable of connecting a wired communication cable and capable of accessing a wireless network (13) using a 3G, 4G LTE, 5G wireless mobile communication network or WiFi (WIFI). )on;
A user (USER ID) by connecting directly to the network server (SERVER) (12) with a domain address or by using, connecting and accessing the mobile communication device APP (application) (9) for use with a two-way wireless data module and a two-way wired data cable. And a password (Password) is registered and various ADAS information and functions are set in the personal portable wireless communication device 10;
All set information and set values such as data are transmitted to the ADAS main body (1) through a wireless two-way data communication means, stored and recorded, or provided in an arbitrary location in the ADAS main body (1) through a wired data cable (7). Intelligent driver assistance system for vehicles that saves and records by connecting to the MICRO USB (OTG) terminal.

Images