TWI719330B - Electronic device and driving safety reminding method - Google Patents

Abstract

The present invention provides a driving safety reminding method. The driving safety reminding method includes steps of: obtaining an eye image of a driver and a front scene image; detecting pupil coordinates of the driver according to the eye image; converting the pupil coordinates of the driver into view coordinates in the front scene image; searching an object in a preset distance in front of a vehicle in the front scene image; determining whether the view coordinates are within a safe range corresponding to the object; and sending a prompt signal when the view coordinates are not within the safe range corresponding to the object. An electronic device is also provided.

Description

Electronic device and driving safety reminding method

The invention relates to the field of driving safety, in particular to an electronic device and a driving safety reminding method.

With the increasing popularity of vehicles in daily life, vehicles have become an effective means of transportation in work and life. However, when experiencing fatigue driving or lack of concentration, traffic accidents are likely to occur, and safe driving is particularly important. There are many common ways to avoid traffic accidents, such as drinking refreshing drinks, chewing gum, listening to music or radio, chatting with colleagues, and creating short-term mild pain. However, these methods are relatively risky when there is only one person driving, and how to remind the driving safety when there is only one person driving is particularly important.

In view of the above content, it is necessary to provide an electronic device and a driving safety reminding method that can solve the above problems.

An electronic device including a memory; at least one processor; and a plurality of modules, the plurality of modules are stored in the memory and executed by the at least one processor, and the plurality of modules are stored in the memory and executed by the at least one processor. Each module includes: an acquisition module, which is used to acquire a driver’s eye image and a front scene image; a detection module, which is used to detect the driver’s pupil coordinates based on the eye image; and a conversion module Group, used to convert the pupil coordinates of the driver to the angle of view coordinates in the front scene image according to the preset mapping relationship between the pupil coordinates and the angle of view coordinates in the scene image in front of the vehicle, and the preset mapping relation is stored in advance A mapping table in the electronic device; a search module for finding objects within a preset distance in front of the vehicle in the front scene image; a judging module for judging whether the perspective coordinates are located at the object Within the corresponding safe range, the image of the scene in front of the vehicle is divided into a plurality of areas. The safe range is the area where the object is located. When the view angle coordinates are located in the area where the object is located, it is determined that the The viewing angle coordinates are within the safe range, otherwise the judgment module judges that the viewing angle coordinates are outside the safe range; and a prompt module is used for when the viewing angle coordinates are not within the safe range corresponding to the object , Send out a reminder signal.

A driving safety reminder method, including acquiring a driver’s eye image and a front scene image; detecting the driver’s pupil coordinates according to the eye image; according to the difference between the pupil coordinates and the field of view coordinates in the vehicle’s front scene image The preset mapping relationship of the driver converts the pupil coordinates of the driver into the field of view coordinates in the front scene image. The preset mapping relationship is a mapping table stored in the electronic device in advance; An object within a preset distance; judging whether the viewing angle coordinates are within a safe range corresponding to the object, the image of the scene in front of the vehicle is divided into a plurality of areas, and the safe range is the area where the object is located, wherein , When the viewing angle coordinates are located in the area where the object is located, determining that the viewing angle coordinates are within the safe range; otherwise, the judging module judges that the viewing angle coordinates are outside the safe range; and in the viewing angle When the coordinates are not within the safety range corresponding to the object, a prompt signal is sent out.

The electronic device and the driving safety reminding method can remind the driver when driving fatigue or lack of concentration occurs when the driver is driving alone, so as to achieve the goal of safe driving.

10: Electronic device

11: processor

12: Memory

100: Driving safety reminder system

20: Shooting components

23: Prompt module

25: Wireless communication module

31: Obtain the module

33: Detection module

35: Conversion module

37: Adjustment module

39: Find Module

40: Judgment module

1: the first point

2: second point

3: third point

4: The fourth point

5: The fifth point

FIG. 1 is a system architecture diagram of a preferred embodiment of an electronic device of the present invention.

2 is a functional module diagram of a preferred embodiment of the driving safety reminding system applied by the electronic device of the present invention.

Fig. 3 is a flowchart of a preferred embodiment of the driving safety reminding method of the present invention.

Fig. 4 is a schematic diagram of the front scene projection of the present invention.

Referring to FIG. 1, it is a structural diagram of a preferred embodiment of an electronic device 10 of the present invention. The electronic device 10 is placed or installed in a vehicle. In this embodiment, the electronic device 10 includes, but is not limited to, at least one processor 11, a memory 12, a photographing component 20, a prompting module 23, and a wireless communication module 25. Electrical connections between the above-mentioned components. In this preferred embodiment, the electronic device 10 may be a device with a photographing function, such as a mobile phone and a driving recorder.

The processor 11 may be a central processing unit, a microprocessor, or other chips with data processing functions.

The memory 12 may be the memory of the electronic device 10 itself, or an external memory, such as a smart media card (Smart Media Card), a secure digital card (Secure Digital Card), and a flash memory card (Flash Card). Wait. The memory 12 is installed with a car safety reminding system 100.

The photographing component 20 is used to photograph the eye image of the driver of the vehicle and the image of the scene in front of the vehicle, and can store the photographed image in the memory 12.

In an embodiment, the photographing component 20 includes a first camera and a second camera. The first camera is used to capture images of a scene in front of the vehicle, and the second camera is used to capture images of the driver's eyes.

In another embodiment, the photographing component 20 is used to photograph the driver's eye image. The image of the scene in front of the vehicle is captured by an electronic device (not shown). The electronic device 10 can be The line communication module 25 is wirelessly connected to the electronic device, and is used to obtain an image of a scene in front of the vehicle captured by the electronic device. The electronic device may be other devices with shooting function such as a driving recorder.

In yet another embodiment, the photographing component 20 may be omitted, that is, the electronic device 10 itself may not include the photographing component 20, but is connected to the electronic device to obtain the driver's eye image and the image of the scene in front of the vehicle. . The electronic device 10 may be wirelessly connected to the electronic device through the wireless communication module 25, and is used to obtain the driver's eye image and the image of the scene in front of the vehicle captured by the electronic device.

The prompt module 23 is used to send a prompt signal to the driver. The prompt signal may be a warning sound, and the warning sound is stored in the electronic device 10 in advance.

The wireless communication module 25 is used for the communication connection between the electronic device 10 and the electronic equipment or a wireless network (not shown). The wireless communication module 25 may be a wireless communication module such as a Wi-Fi module, a Bluetooth module, or ZigBee.

In the preferred embodiment, the driving safety reminding system 100 can be divided into a plurality of modules, and the plurality of modules are stored in the memory 12 and executed by the processor 11, so that the electronic The device 10 responds to the driving safety reminder to the user.

Please also refer to FIG. 2, the driving safety reminding system 100 includes an acquisition module 31, a detection module 33, a conversion module 35, an adjustment module 37, a search module 39, and a judgment module 40. The module referred to in the present invention can be a program segment that completes a specific function, which is more suitable for describing the execution process of software in the electronic device 10 than a program. The detailed functions of each module will be specifically combined with the flowchart in FIG. 3 description of.

Referring to FIG. 3, it is a flowchart of a preferred embodiment of a driving safety reminding method used on an electronic device 10 of the present invention. According to different needs, the order of the steps in the flowchart can be changed, and some steps can be omitted or combined.

In step S300, the acquisition module 31 acquires the eye image of the driver and the scene image in front of the vehicle.

In this preferred embodiment, the driver can adjust the position of the electronic device 10 so that the photographing component 20 of the electronic device 10 can capture the eye image of the driver and the image of the scene in front of the vehicle.

In one embodiment, the photographing component 20 is a lens with a direction and angle that can be rotatably adjusted. The acquiring module 31 acquires the eye image of the driver and the scene image in front of the vehicle captured by the photographing component 20.

In another preferred embodiment, the electronic device 10 is wirelessly connected to the electronic device, so that the acquisition module 31 acquires the image of the scene in front of the vehicle photographed by the electronic device and the driver photographed by the photographing component 20 Eye image. The electronic device 10 can communicate and exchange data with the electronic device through the wireless communication module 25.

In the third preferred embodiment, the electronic device 10 is wirelessly connected to the electronic device, so that the acquisition module 31 acquires the image of the scene in front of the vehicle captured by the electronic device and the image of the driver's eyes. The electronic device may include a first camera and a second camera. The first camera may be used to capture images of a scene in front of the vehicle, and the second camera may be used to capture images of the driver's eyes.

In step S301, the detection module 33 detects the pupil coordinates of the driver according to the eye image, that is, the coordinates of the driver's pupil in the eye image.

In step S302, the conversion module 35 converts the pupil coordinates into the angle of view coordinates in the scene image in front of the vehicle. The viewing angle coordinates are used to indicate the corresponding position of the pupil coordinates in the scene image in front of the vehicle, that is, the position where the driver is looking at.

In this preferred embodiment, the scene in front of the vehicle can be divided into multiple areas, such as four, six, eight or more areas. In this embodiment, as shown in FIG. 4, the center 5 of the front scene and/or the front scene image of the vehicle is taken as the origin, and the front scene and/or front scene image is divided into four in a rectangular coordinate system. Areas, namely the first area A, the second area B, the third area C and the fourth area D. By guiding the driver to turn his pupils to observe the first point 1, the second point 2, and the first point on the corners of the four areas respectively. Three points 3, fourth point 4, and central fifth point 5. The fifth point 5 is a point where four areas intersect, the first point 1 is the upper left corner point of the first area A, and the second point 2 is the lower left corner point of the third area C, The third point 3 is the upper right corner point of the second zone B, and the fourth point 4 is the lower right corner point of the fourth zone D. It is understandable that the driver can turn his pupils to view the center point and the four corner points of the windshield of the vehicle. The detection module 33 detects that the driver looks at the front of the vehicle through the first point 1, the second point 2, the third point 3, the fourth point 4, and the fifth point 5 The pupil coordinates in the scene, the conversion module 35 can calculate the preset mapping relationship between the pupil coordinates in the driver's eye image and the angle of view coordinates in the scene image in front of the vehicle based on these pupil coordinates and a linear interpolation method .

In this preferred embodiment, the preset mapping relationship may be a mapping table stored in the electronic device 10 in advance. The conversion module 35 can perform conversion according to the mapping table, and convert the pupil coordinates in the driver's eye image to the angle of view coordinates in the scene image in front of the vehicle.

In step S303, the search module 39 searches for an object within a preset distance in front of the vehicle in the scene image in front of the vehicle. The object may be people, animals, obstacles, and other objects that may cause hidden dangers to driving safety. The search module 39 can determine the distance of the object in front of the vehicle according to the focal length when shooting the image of the scene in front of the vehicle.

In this preferred embodiment, the electronic device 10 is configured with a satellite positioning system, such as a Global Positioning System (GPS), for obtaining vehicle speed information. The adjustment module 37 obtains the current vehicle speed information, and adjusts the preset distance according to the current vehicle speed information. The vehicle speed information may be the speed at which the vehicle is traveling. For example, when the speed of the vehicle is fast, the adjustment module 37 adjusts the preset distance to be longer; when the speed of the vehicle is slow, the adjustment module 37 adjusts the preset distance to be shorter. The search module 39 searches for objects within the preset distance in the scene image in front of the vehicle.

In another preferred embodiment, the electronic device 10 is not equipped with the satellite positioning system. The preset distance may be a fixed value, such as 20m, 30m, 50m, and so on. The preset distance can be It is pre-stored in the memory 12, and can also be set by the driver at any time through the adjustment module 37. The searching module 39 searches for objects within the preset distance in the scene image in front of the vehicle.

In step S304, the judging module 40 judges whether the viewing angle coordinates are within a safe range corresponding to the object within a preset distance in front of the vehicle. The safe range is a preset range in the image of the scene in front of the vehicle. If the viewing angle coordinates are outside the safe range, it means that the driver is not paying attention to the object, and the driver may be in a dangerous state.

In another preferred embodiment, the image of the scene in front of the vehicle is divided into a plurality of areas, and the safe range may be the area where the object is located. As shown in FIG. 4, for example, if there is an animal in front of the first zone A, the judgment module 40 judges whether the driver's perspective coordinates are in the first zone A. If the driver’s perspective coordinates are in the first zone A, it is determined that the perspective coordinates are within the safe range, otherwise the judgment module 40 determines that the perspective coordinates are outside the safe range, and the driver may be in a dangerous state .

In step S305, the prompt module 23 sends a prompt signal when the view angle coordinates are not within the safe range corresponding to the object. The prompt signal may be a warning sound, and the warning sound is stored in the electronic device 10 in advance.

In this preferred embodiment, when the judging module 40 judges that the view angle coordinates in the scene image in front of the vehicle are not within the safe range corresponding to the object, the prompt module 23 sends out the prompt signal to remind the driver.

In addition to the driving safety reminding method of FIG. 3, the detection module 33 can also determine whether the driver is in a dangerous state by using the driver's pupil coordinates. Specifically, when the detection module 33 fails to detect the pupil coordinates, it means that the driver may be dozing off or looking left and right. At this time, the driver may be in a dangerous state, prompting the module 23 The prompt signal is issued to remind the driver. When the detection module 33 detects that the driver’s pupil coordinates remain unchanged for a predetermined period of time, the driver may be in a daze or thinking, and the prompt module 23 will also send out the prompt signal to remind the driver driver.

The electronic device and the driving safety reminding method provided by the present invention can remind the driver when driving fatigue or lack of concentration occurs when the driver is driving alone, thereby achieving the goal of safe driving.

In summary, this creation meets the requirements of an invention patent, and Yan filed a patent application in accordance with the law. However, the above are only the preferred embodiments of this creation, and the scope of this creation is not limited to the above embodiments. For those who are familiar with the techniques of this case, equivalent modifications or changes made in accordance with the spirit of this creation are all Should be covered in the scope of the following patent applications.

100: Driving safety reminder system

31: Obtain the module

33: Detection module

35: Conversion module

37: Adjustment module

39: Find Module

40: Judgment module

Claims (9)

An electronic device comprising: a memory; at least one processor; and multiple modules, the multiple modules are stored in the memory and executed by the at least one processor, and the multiple modules are stored in the memory and executed by the at least one processor. The modules include: an acquisition module, which is used to acquire the driver's eye image and an image of the scene in front of the vehicle; a detection module, which is used to detect the driver's pupil coordinates based on the eye image; and a conversion module , For converting the pupil coordinates to the angle of view coordinates in the vehicle front scene image according to a preset mapping relationship between the pupil coordinates and the view angle coordinates in the vehicle front scene image, and the preset mapping relation is pre-stored in the A mapping table in the electronic device; a search module for finding objects within a preset distance in front of the vehicle in the scene image in front of the vehicle; a judging module for judging whether the perspective coordinates are located in the corresponding object Within a safe range, the image of the scene in front of the vehicle is divided into a plurality of areas. The safe range is the area where the object is located. When the view angle coordinates are located in the area where the object is located, the view angle coordinates are determined Is within the safe range, otherwise the judgment module judges that the viewing angle coordinates are outside the safe range; and a prompt module for issuing when the viewing angle coordinates are not within the safe range corresponding to the object A reminder signal. The electronic device according to claim 1, wherein: the electronic device further includes a photographing component, and the photographing component is used to photograph the eye image of the driver. The electronic device according to claim 2, wherein: the photographing component is also used to photograph an image of a scene in front of the vehicle. The electronic device according to claim 2, wherein: the electronic device further includes a wireless communication module, and the electronic device is connected to an electronic device through the wireless communication module to receive a vehicle photographed by the electronic device The image of the scene ahead. The electronic device according to claim 1, wherein: the electronic device further includes an adjustment module configured to obtain current vehicle speed information and adjust the preset distance according to the current vehicle speed information. The electronic device according to claim 1, wherein: the prompt module is further configured to issue the prompt signal when the viewing angle coordinates cannot be detected or the viewing angle coordinates remain unchanged after a preset period of time. A driving safety reminder method, including: acquiring the driver’s eye image and the image of the scene in front of the vehicle; detecting the driver’s pupil coordinates according to the eye image; and according to the difference between the pupil coordinates and the field of view coordinates in the scene image in front of the vehicle The preset mapping relationship between the two converts the pupil coordinates to the angle of view coordinates in the scene image in front of the vehicle, and the preset mapping relation is a mapping table stored in the electronic device in advance; and finds the one in front of the vehicle in the scene image in front of the vehicle. An object within a preset distance; judging whether the viewing angle coordinates are within a safe range corresponding to the object, the image of the scene in front of the vehicle is divided into a plurality of areas, and the safe range is the area where the object is located, wherein , When the viewing angle coordinates are located in the area where the object is located, determining that the viewing angle coordinates are within the safe range; otherwise, the judging module judges that the viewing angle coordinates are outside the safe range; and in the viewing angle When the coordinates are not within the safety range corresponding to the object, a prompt signal is sent out. The driving safety reminding method according to claim 7, wherein the driving safety reminding method further includes: Obtain current vehicle speed information, and adjust the preset distance according to the current vehicle speed information. The driving safety reminding method according to claim 7, wherein the driving safety reminding method further includes: sending out the said view angle coordinates when the view angle coordinates are not detected or the view angle coordinates have not changed for a preset period of time. Prompt signal.

Images