JP6161562B2 - Electronic device, control method and program - Google Patents

Description

  The present invention relates to an electronic device, a control method, and a program that perform predetermined notification.

  Means for detecting the physical condition of the driver of the vehicle have been considered for the purpose of preventing drowsy driving. As means for detecting the physical condition of the driver of the vehicle, there are means based on the pulse rate of the driver and the electrocardiogram between both hands (see, for example, Patent Document 1).

JP 7-228171 A

By the way, when detecting the driver's heart rate, etc., it is necessary for the driver to wear the detection device, which may interfere with the driver and may be unfavorable for the driver because of complicated settings. There is.
An object of the present invention is to provide an electronic device, a control method, and a program capable of detecting driver's carelessness and achieving safe driving without hindering the driver and without complicated settings. To do.

  In order to solve the above-described problem, an electronic device according to the present invention is included in the image data based on image data transmitted from the first camera unit, the second camera unit, and the first camera unit. A determination unit that determines whether the user being awake is, a traveling state determination unit that determines whether the user is in a traveling state based on the image data transmitted from the second camera unit, Control that controls the notification unit to perform predetermined notification when it is determined by the notification unit and the determination unit that the user has not been awakened and the traveling state determination unit determines that the user is in the traveling state. It is the structure provided with a part.

  The electronic apparatus may include an acceleration sensor, and the traveling state determination unit may determine whether the traveling state is in consideration of an acceleration value acquired by the acceleration sensor.

  In the electronic device, the determination unit determines whether the size of the user's face included in the image data is suitable for determining whether or not the user's face is awake, and determines that the size is not appropriate In this case, a configuration in which the size of the user's face is adjusted to an appropriate size may be used.

  In the electronic device, the determination unit determines whether or not the user's face is included in the image data, and the control unit determines that the user's face is not included in the image data by the determination unit. In this case, the notification unit may be controlled to perform predetermined notification.

  In the electronic device, the determination unit determines whether the user is in a preliminary state where the user is not awake, and the control unit determines that the user is in the preliminary state by the determination unit. In such a case, the notification unit may be controlled to perform predetermined notification.

  In the electronic device, the control unit may be configured to contact a preset contact when the determination unit determines that the user is not awake or the user is in the preliminary state. .

  In the electronic device, when the determination unit determines that the user is not awake or the user is in the preliminary state, the control unit searches for a predetermined location and guides to the predetermined location. It may be configured.

  In order to solve the above-described problem, the control method according to the present invention determines whether or not the user included in the image data is awake based on the image data transmitted from the first camera unit. The user is not awakened by the awakening state determination step, the running state determination step for determining whether or not the vehicle is in a running state based on the image data transmitted from the second camera unit, and the awakening state determination step And a control step of controlling the notification unit so as to perform predetermined notification when it is determined that the vehicle is in the traveling state by the traveling state determination step.

  In order to solve the above-described problem, the program according to the present invention determines whether a user included in the image data is awake based on the image data transmitted from the first camera unit to the computer. The user is awakened by the awakening state determination step, the running state determination step for determining whether or not the vehicle is in a running state based on the image data transmitted from the second camera unit, and the awakening state determination step. If it is determined that the vehicle is in the traveling state by the traveling state determination step, a control step of controlling the notification unit so as to perform predetermined notification is executed.

  According to the present invention, safe driving can be achieved.

It is a block diagram which shows the structure of an electronic device. It is a figure which shows the external appearance of an electronic device.

  In the present embodiment, the electronic device 1 is described as being a smartphone, for example, but is not limited thereto. In the present embodiment, the electronic device 1 exhibits a function of performing route guidance using an installed navigation application. However, the electronic device 1 is not limited thereto, and various functions (telephone communication) can be performed using various installed applications. Function, map display function, etc.).

  The electronic device 1 starts a navigation application in response to a predetermined operation by the user, and starts route guidance to the destination based on the set destination information and the like. In addition, the electronic device 1 has a function of calling attention (hereinafter referred to as an alarm function) according to the user's arousal state.

  The user attaches the electronic device 1 to a position where the map information displayed on the display 18 is easily visible (for example, on the dashboard) when getting on the car. The user drives to the destination while referring to map information and the like displayed on the display 18.

  Here, the electronic apparatus 1 according to the present embodiment has a configuration for detecting user's carelessness and safe driving without hindering the user and making the setting complicated. Below, a structure and operation | movement of the electronic device 1 are demonstrated in detail.

  As shown in FIG. 1, the electronic device 1 includes a first camera unit 11, a second camera unit 12, a determination unit 13, a traveling state determination unit 14, a notification unit 15, and a control unit 16.

The first camera unit 11 and the second camera unit 12 each start shooting when the alarm function is turned on in response to a user operation.
The first camera unit 11 is, for example, an in-camera, and is disposed on one surface side of the electronic device 1 as illustrated in FIG. The 2nd camera part 12 is arrange | positioned at the other surface side of the electronic device 1, as shown in FIG.2 (b). Note that the one side of the electronic device 1 is a side on which the display 18 and various operation buttons 19 are arranged, and means a front side on which a user performs an operation. The one surface side of the electronic device 1 is a side on which a battery or the like is mounted and means the back surface side.

Further, as described above, the electronic device 1 is mounted in the vehicle so that the display 18 faces the user side. Therefore, the image data photographed by the first camera unit 11 disposed on the same surface as the display 18 includes the face of the driver (user).
Further, the image data photographed by the second camera unit 12 disposed on the back side of the display 18 includes a landscape in the traveling direction of the car.
The first camera unit 11 transmits the captured image data to the determination unit 13.
The second camera unit 12 transmits the captured image data to the traveling state determination unit 14.

  The determination unit 13 determines whether or not the user included in the image data is awake based on the image data transmitted from the first camera unit 11. The determination unit 13 analyzes the image data, for example, and moves the user's face, the movement of the eyes, or whether the eyes are open or closed. It is also possible to determine whether the user is awake by the duration of this characteristic action.

  Based on the traveling state determination unit 14 and the image data transmitted from the second camera unit 12, it is determined whether or not the traveling state is present. For example, the running state determination unit 14 may be configured to analyze the image data, compare several frames of image data, and determine that the vehicle is in the running state when there is a change, or is included in the several frames of image data. A configuration may be adopted in which it is determined that the vehicle is traveling based on a change in an object indicating a road (for example, a center line, a traffic light, or the like).

The alerting | reporting part 15 is comprised by a speaker, a vibrator, a light emitting element, etc., and has the function to alert | report outside.
When it is determined by the determination unit 13 that the user is not awake and the traveling state determination unit 14 determines that the user is in the traveling state, the control unit 16 controls the notification unit 15 to perform predetermined notification. . The predetermined notification includes an alarm output, audio data output and / or vibrator output. The voice data is, for example, data such as “Dangerous. Please get up”.

By being configured in this way, the electronic device 1 performs a predetermined notification in a state where the user is not awakened (sleeping state) when the user is traveling in a car, so that safe driving is intended. Can do.
In addition, since the electronic device 1 recognizes the face of the driver (user) based on the image data captured by the first camera unit 11, it can also be determined that the electronic device 1 is looking away without looking straight ahead. it can. The electronic device 1 may be configured to perform a predetermined notification when it is determined that the electronic device 1 is looking away.

As shown in FIG. 1, the electronic device 1 may further include an acceleration sensor 17.
In the case of such a configuration, the traveling state determination unit 14 determines whether or not the traveling state is in consideration of the acceleration value acquired by the acceleration sensor 17.

For example, when the car is in a traffic jam, there is a possibility that even if the image data captured by the second camera unit 12 is analyzed, there is little change and it is erroneously determined that the vehicle is not in a running state.
Therefore, the electronic device 1 can correctly determine the traveling state by taking into account the acceleration value acquired by the acceleration sensor 17.

  The running state determination unit 14 stores an acceleration value pattern indicating the running state in a storage unit (not shown) in advance, and compares the acceleration value pattern acquired by the acceleration sensor 17 with the running state. It may be configured to determine whether or not.

  Further, the determination unit 13 is configured so that the user's face included in the image data captured by the first camera unit 11 has an optimal size when the navigation application is activated and the alarm function is ON. It may be configured to adjust. The adjustment may be a digital zoom or an optical zoom. When adjusting by optical zoom, the determination unit 13 drives the lens of the first camera unit 11 to change the focal length. The lens of the first camera unit 11 may be driven by the control unit 16 instead of the determination unit 13.

  According to such a configuration, since the electronic device 1 adjusts the user's face to an optimal size, it can be reliably determined whether or not the user is not awake (sleeping state), and safe driving can be achieved. .

  The determination unit 13 may be configured to determine whether or not the user's face is included in the image data. When the determination unit 13 determines that the user's face is not included in the image data, the control unit 16 controls the notification unit 15 to perform predetermined notification. The predetermined notification is different from the notification that is output when the user is not awake, and includes an alarm output, audio data output, and / or vibrator output. The audio data is data of contents such as “Please adjust the position so that your face is reflected on the camera”, for example.

  According to such a configuration, the electronic device 1 prompts the user to adjust the orientation of the first camera unit 11 by a predetermined notification, so it is ensured that the user is not awake (sleeping state). It can be determined and safe driving can be achieved.

Moreover, the structure which determines whether the determination part 13 is a preliminary state of a dozing by extension etc. may be sufficient. When the determination unit 13 determines that the user is in a pre-sleep state and the traveling state determination unit 14 determines that the user is in the traveling state, the control unit 16 performs a predetermined notification. 15 is controlled. The predetermined notification may be the same as or different from the notification output in a state of not being awakened, and is an alarm output, audio data output, and / or vibrator output, or the like. The voice data is, for example, data such as “Dangerous. Please get up” or “Would you like to take a break?”
According to such a configuration, the electronic device 1 performs a predetermined notification in a preliminary state in which the electronic device 1 is not awakened (sleeping state), and thus safer driving can be achieved.

In addition, when the control unit 16 detects a state of not being awakened (sleeping state) or a preliminary state thereof, the control unit 16 uses a communication function to set a contact address (phone number or e-mail) set in advance. It may be configured to contact an address or the like. Note that the control unit 16 may be executed after confirmation by the user (for example, a tap on a display) or automatically when contacting a preset contact.
According to such a configuration, the electronic device 1 contacts a preset contact in a preliminary state in which the electronic device 1 is not awakened (sleeping state). By getting, you can get out of the dozing state or its preliminary state, and you can drive safely.

In addition, when the control unit 16 detects a state of not being awakened (sleeping state) or a preliminary state thereof, the control unit 16 obtains a predetermined location (for example, obtains the current location from the GPS information, the nearest parking area, a break spot, etc.) It may be configured to search for and guide to the predetermined place. Note that the predetermined place may preferentially search for a place that the user is likely to like based on the past action history of the user stored in the electronic device 1.
According to such a configuration, the electronic device 1 provides guidance to the nearest parking area or the like in a preliminary state in which the electronic device 1 is not awakened (sleeping state). Can drive safely.

  In the present embodiment, the configuration and operation of the electronic device mainly for safe driving have been described. However, the present invention is not limited to this, and each component is provided as a method and program for safe driving. May be.

  Furthermore, the program for realizing the function of the electronic device may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read by the computer system and executed.

  The “computer system” here includes an OS and hardware such as peripheral devices. The “computer-readable recording medium” refers to a storage device such as a portable medium such as a flexible disk, a magneto-optical disk, a ROM, and a CD-ROM, and a hard disk built in the computer system.

  Furthermore, “computer-readable recording medium” means that a program is dynamically held for a short time, like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. It is also possible to include one that holds a program for a certain time, such as a volatile memory inside a computer system that becomes a server or client in that case. Further, the program may be for realizing a part of the above-described functions, and may be capable of realizing the above-described functions in combination with a program already recorded in the computer system. .

DESCRIPTION OF SYMBOLS 1 Electronic device 11 1st camera part 12 2nd camera part 13 Determination part 14 Running state determination part 15 Notification part 16 Control part 17 Acceleration sensor

Claims (10)

Electronic equipment,
A display on the front side of the electronic device, on which the user operates,
A first camera unit disposed on the front side of the electronic device ;
A second camera unit disposed on the back side of the electronic device ;
A determination unit that determines whether or not the user included in the image data is awake based on the image data transmitted from the first camera unit;
A traveling state determination unit that determines whether the vehicle is in a traveling state based on the image data transmitted from the second camera unit;
A notification unit;
A control unit that controls the notification unit so as to perform a predetermined notification when the determination unit determines that the user is not awake and the driving state determination unit determines that the user is in a running state; Electronics. The electronic device further includes:
The electronic device according to claim 1, wherein map information is displayed on the display in accordance with an operation of the user, and shooting is started by the first camera unit and the second camera unit, respectively. With an acceleration sensor,
The electronic device according to claim 1, wherein the traveling state determination unit determines whether the traveling state is in consideration of an acceleration value acquired by the acceleration sensor. The determination unit determines whether the size of the user's face included in the image data is a size suitable for determining whether or not the user's face is awake. the electronic device according to claim 1 or claim 2, adjusted to a size suitable for the size of the face of. The determination unit determines whether the user's face is included in the image data,
Wherein, when said determination unit is determined not to contain the user's face in the image data, the electronic according to claim 1 or claim 2 for controlling the notification unit to perform a predetermined notification machine. The determination unit determines whether or not the user is in a preliminary state that is not awake,
The control unit according to any one of claims 1 to 5 , wherein the control unit controls the notification unit to perform a predetermined notification when the determination unit determines that the user is in the preliminary state. The electronic device described. The electronic device according to claim 6 , wherein when the determination unit determines that the user is not awake or the user is in the preliminary state, the control unit contacts a preset contact. machine. Wherein, the user is not awake by the determination unit, or if the user is determined to the a preliminary state, to claim 6 searches a predetermined location, it is guided to the predetermined location The electronic device described. An electronic device including a display arranged on a front side on which a user operates, a first camera unit arranged on the front side, a second camera unit arranged on the back side, and a notification unit is executed. A control method,
With the electronic device
An arousal state determination step for determining whether or not a user included in the image data is awake based on the image data transmitted from the first camera unit;
A running state determination step for determining whether or not the vehicle is in a running state based on the image data transmitted from the second camera unit;
When it is determined that the user is not awake by the awake state determination step and is determined to be a travel state by the travel state determination step, a control step of controlling the notification unit so as to perform a predetermined notification. A control method provided. The program for functioning a computer as each part of the electronic device of any one of Claims 1 thru | or 8.

Images