KR101965578B1 - Portable and Movable Dashboard robot - Google Patents

Abstract

The present invention relates to a mobile desktop robot installed in a vehicle, and when installed in a vehicle, includes a function such as a conventional black box, and recognizes the driver's face to determine whether the driver is drowsy driving and safety through lane detection. To prevent drowsy driving through the role of driving assistant, air freshener, oxygen, warning sound and telephone call connection during drowsy driving, and when installed indoors, it acts like an artificial intelligence home service robot and is mounted on a mobile docking station The present invention relates to a mobile desktop robot that can adjust the situation to a mobile phone or a PC and monitor or transmit a two-way conversation and video.

Description

Portable and Movable Dashboard robot}

The present invention relates to a mobile dashboard robot installed on a dashboard of a vehicle, and when installed in a vehicle, recognizes the driver's face to determine whether the driver's drowsy driving, and when the drowsy driving, the air freshener and oxygen injection, warning and telephone calls The present invention relates to a mobile dashboard robot that prevents drowsy driving through a connection and monitors a desired place on a mobile phone or a PC, transmits images, and has a two-way conversation when the indoor space is used.

In modern society, cars are not just for transportation, but they are used as a hobby and as a recreational means to leave the fields, mountains, and the sea under the five-day work week. For users, it is used as an office space where work can be performed on the go.

As such, the car has become an indispensable element in our daily life, and the car is one of the daily living spaces, and the time to stay there is also a relatively large reality.

However, a car has a very narrow and limited indoor space, and such a limited space has a structural closure that can easily contaminate indoor air. Therefore, in order to maintain a comfortable indoor environment of a car, By opening the window or opening the vents, it is to induce the circulation of indoor air.

However, when the window is opened or the ventilation opening is opened for the ventilation of the indoor air while driving, the harmful exhaust gas emitted from the surrounding cars is directly introduced into the vehicle interior, which is a harmful factor to the driver or passenger's health. It was to give a working problem.

Therefore, in recent years, various kinds of deodorants, fragrances, etc. have been widely developed and used as means for keeping the indoor air of a vehicle comfortable and clean.

However, these deodorants and fragrances merely play a role of temporarily suppressing adverse smells generated in the interior of an automobile by simple fragrance emanation, and do not fundamentally purify or ventilate contaminated air. It does not, in its use, have very limited and inefficient functional closures.

On the other hand, another serious social problem that arises from using a car is the damage of life and property caused by traffic accidents. In particular, according to the statistics of the Korea Expressway Corporation, more than 20 percent of traffic accidents occurring on highways are identified as drowsy driving. Therefore, the drowsiness of the driver while driving takes the lives of not only the driver but also other people. It will lead to terrible consequences.

Therefore, in recent years, products with various techniques have been developed to prevent the causes of traffic accidents due to drowsy driving, but by simply photographing the driver's face image by taking a camera, such image image, such as, It reads the driver's face and pupil changes, and when it is determined that it is drowsy driving, it operates a simple system that outputs an alarm sound or automatically opens a window.

These techniques perform only a very limited single function of reading the captured driver's facial image and, as a result, combating drowsiness, imparting physical comfort or benefit to the mind and body of the driver or occupant during the operation of the vehicle. There was no mention of multiple functions.

Therefore, when installed in a vehicle, it is possible to prevent drowsiness of a driver by using hearing, tactile sense, etc., and it is necessary to develop a product that can be universally used instead of being used only in a vehicle.

1. Korea Patent Publication No. 10-0778059 'Drowsiness operation prevention device using face recognition technology and drowsiness operation prevention system using the same' (application date 2007.05.22) 2. Korean Patent Publication No. 10-1373277 'Vehicle Multifunctional Air Purifier' (Application Date 2012.06.19)

The present invention has been made to solve the above problems, the driver's drowsiness by combining the complex factors such as emotion and state recognition through the driver's face recognition, driving speed of the vehicle, driving lane and steering wheel steering angle direction A mobile dash that identifies whether or not drowsiness and prevents drowsy driving by using hearing and tactile senses, and is not only installed on a vehicle but also installed inside a building to check indoor space in real time. An object is to provide a board robot.

The mobile dashboard robot of the present invention, the upper housing 100 is hollow inside; A shooting guide unit 200 mounted in a hollow inside of the upper housing 100 in a pan tilt structure and capable of rotating up, down, left, and right; A first image photographing unit 300 mounted inside the photographing guide unit 200 and photographing a face of a driver when driving the vehicle; A lower housing 400 in which the upper housing 100 is seated on an upper surface thereof and rotatable in a horizontal direction, and an accommodation space S is formed therein; A second image photographing unit 500 installed in the accommodation space S to photograph driving conditions of the vehicle; An injection part 600 mounted inside the photographing guide part 200 and including a blower part 610 that is operated by receiving power from the outside to inject oxygen or fragrance to the outside; The driver's drowsy operation is judged by artificial intelligence based on the driver's face image and the driver's steering wheel operation image data photographed by the first image photographing unit 300 and the driving situation data photographed by the second image photographing unit 500. It characterized in that it comprises a; main controller unit 800 for operating the injection unit 600.

In the present invention, the main controller 800 includes a face image acquisition unit 810 for storing the face image data of the driver photographed by the first image capture unit 300; And a first drowsiness driving determination unit 830 for determining whether the driver is drowsy using the emotion and status recognition technology using artificial intelligence.

In the lower housing 400 of the present invention, the main controller 800 reproduces the voice data stored in the database when the driver determines the drowsy driving to operate the alarm unit 900 so that the driver can sense the sound reproduced by hearing. ); And a sensor unit 1000 that operates the injection unit 600 when the carbon dioxide concentration reaches the set data or less by measuring the carbon dioxide concentration in the indoor space.

In addition, the alarm unit 900 is equipped with artificial intelligence (artificial intelligence), the voice receiving unit 910 for obtaining a driver's voice signal to communicate with the driver, and analyzes the acquired voice signal; A speaker unit 920 for converting the embedded voice data according to the voice signal analyzed by the voice receiver 910 into sound so that the driver recognizes it as an auditory sound; And a telephone connection unit 930 interworking with the portable terminal and performing a telephone connection to the set contact when it is determined to be drowsy driving or requested by the driver even after the sound is output from the speaker unit 920. do.

In addition, it provides an interface to connect with a smartphone to enable a smartphone's AI service or a chat service using various apps.

In the present invention, the main controller 800 includes a posture sensor 840 consisting of a direction sensor 841 and an acceleration sensor 842 for detecting the lane of the road and the movement of the vehicle; A second drowsiness driving determination unit 850 determining whether the driver's drowsy driving is performed by comparing and analyzing the data obtained by the acceleration sensor 840 and the driving lane change of the vehicle acquired by the second image photographing unit 500; It characterized in that it further comprises.

And the present invention is a mobile docking station 1100 is equipped with a moving means 1110 at the bottom to be movable in the room, the lower housing 400 is mounted on the upper surface; In addition, when the lower housing 400 is seated on the mobile docking station 1100, the main controller 800 controls the driving of the moving unit 1110 to smoothly move the mobile docking station 1100. It is characterized by possible.

The present invention not only recognizes the driver's face but also analyzes various factors such as the vehicle's driving speed, driving direction, etc., and analyzes it step by step to determine whether it is drowsy driving. There is an advantage that can prevent the driver's drowsy driving by connecting to the supply, warning sound, artificial intelligence and conversation and the set phone number.

1 is a perspective view showing the overall appearance of the present invention.
Figure 2 is a schematic diagram showing the main configuration of the present invention.

Hereinafter, with reference to the drawings will be described in detail an embodiment of a mobile dashboard robot of the present invention.

1 is a perspective view showing the overall appearance of the present invention, Figure 2 is a schematic diagram showing the main configuration of the present invention.

The mobile dashboard robot of the present invention is preferably installed on the indoor space of the vehicle, in particular, the dashboard, and corresponds to a device and a black box for determining whether the driver is drowsy driving. In addition, it is installed in an indoor space of a home or building to check the appearance of the indoor space through a desired image, and two-way conversation is possible.

1 and 2, the present invention includes an upper housing 100, a photographing guide 200, and a lower housing 400. First, the upper housing 100 is hollow inside, and forms a shape in which one side is open. The photographing guide 200 is mounted inside the upper housing 100 and rotates up, down, left, and right. At this time, the photographing guide 200 and the upper housing 100 is made of a pan tilt structure, for a detailed description thereof refer to Korean Patent Publication No. 10-2009-0046015 'Pan tilt device'.

1 and 2, the first photographing unit 300 is mounted in the photographing guide 200. The first image capturing unit 300 may be fixed to the inner surface of the capturing guide 200 and may be integrally rotated with the capturing guide 200. The first image capturing unit 300 has an object for photographing a face of a driver driving a vehicle.

1 and 2, the lower housing 400 is hollow so that an accommodation space S is formed therein, and the upper housing 100 is seated on an upper surface thereof. The seated upper housing 100 is guided to the lower housing 400 and is rotated about a vertical axis in a vertical axis so that the rotating direction becomes a horizontal direction.

In this case, a plurality of gear teeth are provided on one side of the upper housing 100, and a second driving motor 101 having gears engaged with the gear teeth on one side is formed. The engaged gear rotates due to the operation of the second drive motor 101, and at the same time, the upper housing 100 is guided and rotated on the upper surface of the lower housing 400. The second drive motor 101 having a gear and a plurality of gear teeth correspond to a general gear and gear tooth meshing structure, and in addition to the above-described method, the upper housing 100 can be rotated by various methods, and the user's design can be changed. The position, shape, and the like can be changed according to this.

In this case, the photographing guide unit 200 includes a motor control unit 210 for controlling the operation of the pan tilt structure and an image sensor 220 including (detecting) the face and the handle of the driver. In the present technology, the face of the driver is tracked so that the first image capturing unit 300 continuously photographs the face of the driver using artificial intelligence in the image information through the image capturing unit.

Referring to FIGS. 1 and 2, a second image capturing unit 500 installed in the accommodation space S of the lower housing 400 is provided. The second image capturing unit 500 continuously photographs the driving situation of the vehicle and stores the data.

1 and 2, the injection unit 600 is further provided at one side of the upper housing 100. The injection unit 600 corresponds to a device for discharging oxygen to the outside, preferably to the driver's face, or a device capable of injecting the fragrance to the outside. The injection unit 600 may spray oxygen and fragrance, respectively, and simultaneously spray oxygen and fragrance. That is, the injection unit 600 includes a blower 610 that operates by receiving electric power to inject oxygen or fragrance to the outside. The blower 610 may be a blower fan having a motor and a fan structure, and may correspond to a piston type electric injection pump.

1 and 2, the main controller unit 600 is located inside the lower housing 400. The main controller 600 receives the driver's face image data photographed by the first image capturing unit 300 and driving situation data captured by the second image capturing unit 500. Thereafter, the received data is compared and analyzed to determine whether the driver is drowsy. When it is determined that the driver performs drowsy driving, the injection unit 600 is operated to prevent the drowsy driving of the driver, and the fragrance spraying unit 700 sprays the fragrance liquid.

At this time, the main controller 600 is divided into the initial stage, the middle stage and the drowsy driving stage according to the frequency, status, etc. of the drowsy operation of the driver to the injection unit 600 and the alarm unit 900 described below according to each step. Selective or sequential operation can prevent the driver's drowsy driving.

Referring to FIG. 2, the main controller 800 equipped with artificial intelligence includes a face image acquisition unit 810 and a first drowsiness driving determination unit 830.

The face image acquisition unit 810 corresponds to a device that receives the face image data of the driver photographed by the first image capture unit 300. The face image acquisition unit 810 may be linked with an application of a portable terminal, preferably a smartphone. As a result, the acquired image data or the stored face image data may be transmitted through wireless communication, and may be connected and confirmed from the outside.

In this case, the main controller 800 includes a face image converter 820 for generating stored face image data as driver template data. Template data refers to data obtained by extracting and quantifying all the feature elements constituting the driver's face through data captured in the image. That is, it corresponds to data for analyzing eye flicker, eyelid size, face angle, and face shake for recognition of drowsiness driving, and AI previously learned to determine driver's condition through deep learning. It is used as data to determine whether the driver is drowsy driving.

The first drowsiness driving determination unit 830 determines the driver's emotion and state based on the deep learning based on the driver's face image, and more accurately determines whether the driver is drowsy, including lane change and steering wheel movement. The more the driver's state using the artificial intelligence is utilized, the higher the accuracy of judgment becomes.

Referring to FIG. 2, the lower housing 400 may further include an alarm unit 900. The alarm unit 900 is controlled by the main controller unit 800, and when the main controller unit 800 determines that the driver is drowsy driving, the artificial intelligence is controlled according to the state and repetition degree of the voice data embedded in the database. Play selectively. As a result, the driver may sense a sound reproduced by hearing to prevent drowsy driving.

In addition, one side of the lower housing 400 is further provided with a sensor unit 1000 for measuring the carbon dioxide concentration of the indoor space of the vehicle. The sensor unit 1000 increases the oxygen concentration of the indoor space by operating the spray unit 600 when the measured carbon dioxide concentration reaches the set data or less.

Referring to FIG. 2, the alarm unit 900 includes a voice receiver 910, a speaker unit 920, and a telephone connection unit 930.

The voice receiver 910 corresponds to an apparatus for acquiring a driver's voice signal so that the driver can communicate with the driver using artificial intelligence. When the driver attempts a conversation, the driver analyzes the acquired voice signal to determine the driver's intention, and according to the intention of the conversation identified by the onboard AI technology, the speaker unit 920 sends a question corresponding to the question. It is linked with the speaker unit 920 to transmit.

The speaker unit 920 corresponds to a device for converting the voice data embedded through the artificial intelligence technology into sound so that the driver recognizes the hearing based on the voice signal analyzed by the voice receiver 910. The speaker unit 920 may be installed inside the lower housing 400.

The telephone connection unit 930 may be linked with the portable terminal through a Bluetooth function. That is, if a predetermined time has elapsed after the sound is output from the speaker unit 920, a voice signal cannot be obtained, or if the driver's voice signal corresponding to the voice signal that is asked through artificial intelligence technology is not set and stored arbitrarily. You can make a call to one contact. It can also be used in conjunction with the smartphone's app to drive by voice or in conjunction with the smartphone's chat service.

1 to 2, the main controller 800 includes an attitude sensor 841 and an acceleration sensor 842 configured to detect a lane of a road and a movement of a vehicle, and a second drowsy driving decision unit ( 850). The posture sensor 840 is preferably installed in the same direction as the direction in which the lower housing 400, that is, the second image capturing unit 500 is photographed, and moves, speeds, directions, and handles of the lanes of the road and the vehicle. It detects movement and saves it as data. In addition, a third image photographing apparatus is installed at the rear of the vehicle and used as a black box equipped with two cameras.

The second drowsy driving determining unit 850 compares the data acquired by the posture sensor 840 and the driving state of the vehicle obtained by the second image capturing unit 500 to determine whether the driver is drowsy driving. For example, when the vehicle proceeds at a specific speed, the driving information of the vehicle acquired by the direction sensor 841 and the acceleration sensor 842 and the information such as the change in the movement of the vehicle and the departure of the lane are compared and analyzed to determine drowsy driving. To judge.

The main controller 800 may selectively operate the injection unit 600 and the alarm unit 900, and only when the injection unit 600 and the fragrance injection unit 700 and the alarm unit are determined to be drowsy driving of the driver. 900) can be operated. It can be selected by the user in the desired direction.

1 and 2 are provided with a mobile docking station 1100, the lower housing 400 is seated. A moving means 1110 is mounted at a lower end of the mobile docking station 1100, and the moving means 1110 may be formed of wheels, tracks, orbits. In this case, a separate driving motor for controlling the driving of the moving unit 1110 may be installed in the mobile docking station 1100.

The moving means 1110 may be provided in plural on the left and right sides of the mobile docking station 1100, and may be steered by a driving speed difference of each moving means 1110, or a plurality of separate driving motors may be provided. It may be provided in the form of a module for controlling each movement means 1110.

In addition, the mobile docking station 1100 includes a docking unit 1120 connecting the moving unit 1110 and the main controller 800 so that the main controller 800 controls the driving of the moving unit 1110. The mobile docking station 1100 further includes an obstacle detecting sensor 1130 that detects obstacles located around the moving means 1110.

In addition, the mobile docking station 1100 includes a power supply unit 1140 that receives power from the outside. The power supply unit 1140 applies power to each of the above components.

Mobile dashboard robot of the present invention by such a configuration can determine whether the drowsy driving through various factors such as the vehicle's driving speed, driving direction movement, as well as the driver's face recognition, and through the various methods There is an advantage to prevent drowsy driving.

100: upper housing 200: shooting guide
300: first image capturing unit 400: lower housing
500: second image pickup unit 600: injection unit
610: blower 800: main controller
810: face image acquisition unit 820: face image conversion unit
830: the first drowsy driving judgment unit 840: attitude sensor
850: the second drowsy driving judgment unit 900: the alarm unit
910: voice receiver 920: speaker
930: telephone connection 1000: sensor
1100: Mobile docking station

Claims (6)

The upper housing 100 is hollow and the one side is open;
A shooting guide unit 200 mounted in a hollow inside of the upper housing 100 in a pan tilt structure and capable of rotating up, down, left, and right;
A first image photographing unit 300 mounted inside the photographing guide unit 200 and photographing a face of a driver while driving the vehicle;
A lower housing 400 in which the upper housing 100 is seated on an upper surface thereof and rotatable in a horizontal direction, and an accommodation space S is formed therein;
A second image photographing unit 500 installed in the accommodation space S to photograph driving conditions of the vehicle;
An injection unit 600 mounted inside the photographing guide unit 200 and including a blower unit 610 which is operated by receiving power from the outside to inject oxygen or air freshener to the outside;
Whether the driver's drowsy driving is artificially made using artificial intelligence by using the driver's face image and driver's steering operation image data photographed by the first image photographing unit 300 and driving situation data photographed by the second image photographing unit 500. A main controller part 800 which determines and operates the injection part 600; Including,
The photographing guide unit 200 includes a motor control unit 210 for controlling the operation of the pan tilt structure;
And an image sensor 220 which detects the driver's face and the handle portion of the vehicle so that the first image capturing unit 300 continuously photographs the driver's face using artificial intelligence.
The main controller 800 may include a face image acquisition unit 810 for storing face image data of a driver photographed by the first image capture unit 300;
A face image converter 820 for extracting feature elements of eye flickering, eyelid size, face angle, and face shake from the face images stored in the face image acquisition unit 810 and generating them as digitized template data;
A first drowsiness driving determination unit 830 determining whether the driver is drowsy driving using an emotion and status recognition technology using template data generated by the face image converter 820 and artificial intelligence;
A mobile moving docking station 1100 on which the lower housing 400 is mounted; Include more,
A plurality of moving means (1110) provided at the lower left and right sides of the movable moving docking station (1100) and controlling the driving of each driving motor to enable steering by different driving speed speed differences;
A docking unit 1120 connecting the moving unit 1110 and the main controller unit 800 so that the main controller unit 800 controls the driving of the moving unit 1110;
An obstacle detection sensor 1130 for detecting an obstacle around the mobile docking station 1100;
Mobile dashboard robot comprising a. delete The method of claim 1,
The lower housing 400 includes an alarm unit 900 which operates the main controller unit 800 to play sound data stored in a database when the driver determines the drowsy driving so that the driver can sense the sound reproduced by hearing;
A sensor unit 1000 for operating the injection unit 600 when the carbon dioxide concentration reaches a predetermined data or less by measuring a carbon dioxide concentration in an indoor space;
Mobile dashboard robot comprising a. The method of claim 3, wherein
The alarm unit 900
An artificial intelligence (artificial intelligence) is mounted, the voice receiving unit 910 for acquiring the driver's voice signal to communicate with the driver, and analyzes the acquired voice signal;
A speaker unit 920 for converting the embedded voice data according to the voice signal analyzed by the voice receiver 910 into sound so that the driver recognizes it as an auditory sound;
A telephone connection unit 930 interworking with the portable terminal and performing a telephone connection to a set contact when it is determined to be drowsy driving or requested by a driver even after sound is transmitted from the speaker unit 920;
Mobile dashboard robot comprising a. The method of claim 1,
The main controller 800 includes an attitude sensor 840 including a direction sensor 841 and an acceleration sensor 842 for detecting a movement of a road lane and a vehicle;
A second drowsiness driving determination unit 850 determining whether the driver is drowsy by comparing the data obtained by the posture sensor 840 with the change in the driving lane of the vehicle acquired by the second image photographing unit 500;
A mobile dashboard robot further comprising a. delete

Images