JP2011172195A - Onboard machine, portable device, and control program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an onboard machine that limits the use of a portable device operated by an operator during driving when there are a plurality of portable devices which may be taken in and utilized by a plurality of drivers. <P>SOLUTION: The onboard machine connected to the portable device in the vehicle through a wireless LAN registers a driver's facial image taken by a camera installed in a driver's sheet at the start of driving, achieves the operator's facial image taken by the built-in camera of the portable device from the portable device when it is operated, extracts characteristics between the driver's facial image and the operator's facial image for comparison, and limits the use of the portable device when the characteristics of both facial images are coincident and the vehicle is on driving. <P>COPYRIGHT: (C)2011,JPO&amp;INPIT

Description

  The present invention relates to a technology of a vehicle system having a function of restricting portable devices used by a driver when riding a vehicle.

  Due to the spread of mobile devices such as e-mail, web information browsing, games, etc. in recent years, the situation where a vehicle driver operates a mobile device while driving will occur. became. In such a situation, the driver's attention to the front and around the vehicle is distracted, causing an accident. As techniques for preventing this, the following techniques have been proposed.

  Patent Document 1 discloses a technique for turning off the display of a mobile device or stopping communication when the driver tries to operate the mobile device during driving, depending on the traveling state.

  Patent Document 2 discloses a technology in which a mobile phone handled by a driver is registered in advance, the driver is associated with the mobile phone, and the mobile phone of the driver is set to a driving state mode when driving. .

JP 2005-236655 A Japanese Patent Laying-Open No. 2005-303384

  However, in Patent Document 1, when a portable device possessed by a person at the driver's seat position is identified by analyzing radio waves transmitted from a plurality of antennas installed in the vehicle, the person at the other seat is the driver's seat. There is a risk of restricting the use without distinguishing it from a mobile phone used in the vicinity.

  Further, in Patent Document 2, there is a problem that a plurality of driver candidates bring their respective mobile phones and use restrictions are imposed even in a situation where a driver other than the driver is operating the driver's mobile phone. there were.

  Therefore, in the present invention, in order to solve the above-described problem, in the case where there are a plurality of portable devices that are brought into the vehicle by a plurality of drivers and may be used, the use of the on-vehicle devices operated by the driver is restricted. Machine, portable device, and its control program.

  One aspect of the invention is an in-vehicle device that is wirelessly connected to a portable device in a vehicle interior of a vehicle, and acquires and registers a driver's face image captured by a camera installed in the vehicle interior at the start of operation. Means for acquiring an operator's face image captured by a camera built in the portable device from the portable device when the portable device is operated, the driver's face image and the operator Means for extracting and comparing the respective feature amounts with the face image of the user, and means for restricting the operation of the portable device when the respective feature amounts match and the vehicle is running. It is related with the vehicle equipment characterized by this.

  As described above, according to the present invention, the vehicle driver and the operator of the portable device are specified, and when the driver matches the operator of the portable device, the use of the portable device is restricted. Only when driving the vehicle, it is possible to stop the function of only the portable device held by the driver.

It is a figure which shows the hardware structural example of the vehicle equipment in the vehicle system which becomes embodiment of this invention. It is a figure which shows the hardware structural example of the portable apparatus in the vehicle system which becomes embodiment of this invention. It is a basic functional block diagram of the vehicle system in Example 1 which becomes embodiment of this invention. It is a figure which shows the operation | movement flow of the vehicle equipment in Example 1 which becomes embodiment of this invention. It is a basic functional block diagram of the vehicle system in Example 2 which becomes embodiment of this invention. It is a figure which shows the operation | movement flow of the portable apparatus in Example 2 which becomes embodiment of this invention.

  Hereinafter, embodiments of the portable information terminal of the present invention will be described.

  FIG. 1 shows a hardware configuration example of an in-vehicle device in a vehicle system. The in-vehicle device 1 includes a CPU (Central Processing Unit) 11, a memory 12, a storage device 13, a power supply unit 14, a wireless communication IF (interface) 15, an input / output device 16, a camera 17, a travel sensor 18, and a seat sensor 19. These devices are connected to each other via a bus 10.

  CPU11 controls the whole vehicle equipment. A control program of the vehicle-mounted device 1 stored in a storage device 13 such as a ROM (Read Only Memory) is expanded in the memory 12 when the power is turned on, and is executed by the CPU 11.

  The wireless communication IF 15 communicates with a portable device brought into the vehicle via wireless communication. The radio may be, for example, a wireless local area network (LAN) or Bluetooth (registered trademark).

  The input / output device 16 includes an input device such as a keyboard and a touch panel and a display device as an operation unit necessary for data input / output of the in-vehicle device 1.

  The camera 17 is mounted in the passenger compartment and takes a face image of the driver sitting on the seat. For example, the driver's seat is attached at a position where the driver's seat can be photographed from the front of the vehicle.

  The traveling sensor 18 detects whether or not the vehicle is moving by a vehicle speed sensor. When the vehicle speed is 0 or more during the unit time, it is determined that the vehicle is traveling.

  The seat sensor 19 is attached to the seat of the driver's seat and detects whether or not the driver is sitting on the driver's seat, and a weight sensor or a pressure sensor (piezoelectric element) is used. For example, in the case of a pressure-sensitive sensor, a criterion for determination is whether a point where the pressure is a certain value or more has a certain area or more. If this value continues for a certain time T or more, it is determined that the driver is sitting. It is also possible to determine that the driver has changed by using the sensor.

  FIG. 2 shows a hardware configuration example of a portable device in the vehicle system. The portable device 2 includes a CPU 21, a memory 22, a storage device 23, a power supply unit 24, a wireless communication IF 25, an input / output device 26, a camera 27, an acceleration sensor 28, a microphone & speaker 29, and operation buttons 30. The devices are connected to each other via the bus 20.

  The CPU 21 controls the entire portable device. A control program stored in the storage device 23 such as a ROM is expanded in the memory 22 when the power is turned on, and is executed by the CPU 21.

  The wireless communication IF 25 communicates with the in-vehicle device 1 via wireless. The wireless may be, for example, a wireless local area network (LAN) or Bluetooth.

  The input / output device 26 includes an input device such as a keyboard and a touch panel and a display device as an operation unit necessary for data input / output of the mobile device 2.

  The camera 27 is an example of an imaging unit that can capture a face image of an operator who operates the mobile device 2.

  The acceleration sensor 28 (or tilt sensor) senses the gravity of the portable device 2 when the operator moves the portable device 2 with his / her hand to operate the portable device 2. By monitoring the fluctuation amount per unit time of the sensor, it is detected whether the portable device 2 is in a stationary state or in a state where the operator holds it in order to perform an operation.

Example 1
Example 1 shows the case where the operation restriction of a portable device is determined on the in-vehicle device side.

  FIG. 3 shows a basic functional block diagram of the vehicle system in the first embodiment.

  The vehicle system includes an in-vehicle device 1 mounted on a vehicle and a portable device 2 brought into the vehicle by an occupant, which are connected to each other via a wireless LAN.

  The in-vehicle device 1 includes a wireless communication unit 101, a driver identification unit 102, a portable device restriction determination unit 103, a command instruction unit 104, a portable device ID storage unit 105, and a traveling state determination unit 106. The mobile device 2 includes a wireless communication unit 201, an operator identification unit 202, an operation state determination unit 203, a restriction execution / cancellation unit 204, and a command reception unit 205.

  The in-vehicle device 1 includes, for example, a car navigation system, an operation management terminal, and the like, and driver information that identifies the driver, such as an image of a driver's seat by a camera, can be acquired. On the other hand, examples of the portable device 2 include a mobile phone, a portable game machine, and the like, and information that identifies the operator, such as an image of the operator, can be acquired by a built-in camera.

  Here, it is assumed that the in-vehicle device 1 and the portable device 2 can communicate with each other by a wireless communication means such as a wireless LAN of IEEE 802.11 specifications or Bluetooth. Further, the wireless communication units 101 and 201 are not limited to these as long as they can identify device-specific information such as the other party's ID (identifier). Below, the mechanism of the said vehicle system is demonstrated.

  First, in the in-vehicle device 1, when the wireless communication unit 101 is an IEEE802.11 specification wireless LAN, a beacon is periodically started to be transmitted from the in-vehicle device 1 at a timing such as door opening / closing. The beacon includes the unique network name of the in-vehicle device 1.

  The portable device 2 has an application program (simply referred to as an application) built in, and the application is started when the power is turned on. The network (wireless LAN) of the vehicle-mounted device 1 responds to the beacon. Register with. At that time, information that can identify the mobile device 2 such as its own MAC address is transmitted. In the in-vehicle device 1, the mobile device ID storage unit 105 determines that the mobile device 2 has been brought into the vehicle when the mobile device 2 is connected to its own network, and stores the ID. It is assumed that management is performed using the stored ID.

  In addition, there is a possibility that portable devices around the vehicle will be registered, but when the vehicle is running, confirm the device ID by the same network connection method, and with the device registered at the beginning By confirming the match, it is possible to prevent devices other than the portable device brought into the vehicle from being registered. Further, in addition to the confirmation of the device ID, the in-vehicle device 1 may monitor the change in the received electric field strength of the radio wave transmitted from the mobile device 2.

  In the in-vehicle device 1, the driver identification unit 102 is a driver's face image captured by the driver's seat installation camera 17 at the start of driving (or when the portable device 2 is operated) (simply referred to as information A). ) And register it in the storage unit. The face image file imaged at the driver's seat is stored as a jpeg (Joint Photographic Experts Group) image file in the storage unit in association with the driver name, for example.

  Examples of the start of driving include when the engine is started, when the vehicle speed sensor starts to detect traveling of the vehicle, when the seat sensor detects seating in the driver's seat, and the like.

  Next, the command instruction unit 104 of the in-vehicle device 1 transmits a command to the portable device 2 brought into the vehicle having the stored ID to instruct operation monitoring. On the other hand, in the portable device 2, when the command receiving unit 205 receives a command via the wireless communication unit 201, the built-in application starts monitoring the operation status.

  When the portable device 2 is operated, the operator specifying unit 202 of the portable device 2 activates the built-in camera 27 to periodically capture an image, and the operator enters the image by image recognition processing. When this is determined, an operator's face image (simply referred to as information B) captured by the built-in camera 27 of the portable device 2 is acquired. Further, the operation state determination unit 203 determines an operation state by the operator from the acceleration sensor provided in the mobile device 2 or the operation button 30.

  Next, in the in-vehicle device 1, the driver specifying unit 102 compares the information A and the information B, and determines whether the information A and the information B match. When the information A and the information B match, the portable device restriction determination unit 103 controls the operation function of the portable device 2 (function stop or alarm) after determining the traveling state of the vehicle by the traveling state determination unit 106. .

  When the information A and B are face images, feature amounts of the face images are extracted, and matching is determined based on the similarity of the feature amounts. The information A and B may be the face image itself, or may be information on only the feature amount extracted from the face image.

  According to the present invention, it is not necessary to previously register the portable device handled by the driver in the in-vehicle device, and the driver and the portable device have an N: M relationship with the in-vehicle device (who is the driver Even if the driver does not know the mobile device that the driver may use in advance), the driver's focus on the operation of the mobile device will prevent the driver from paying attention to driving. Bring effect.

  FIG. 4 shows an operation flow of the in-vehicle device in Example 1 according to the embodiment of the present invention.

  As a precondition, it is assumed that the present application is installed in all the mobile devices 2 brought by the passengers who enter the car, and the present application is activated when all the mobile devices 2 are turned on.

  First, in step S11, the driver turns on the power of the vehicle-mounted device 1. This may be turned on synchronously when the vehicle is turned on with the key or when the door is opened.

  In step S <b> 12, the driver specifying unit 102 recognizes the driver's seating on the seat including the alternation by the seat sensor 19 provided in the vehicle. The seat sensor 19 may be a pressure-sensitive sensor (piezoelectric element), an optical sensor, or a seat belt lock sensor.

  In step S13, when the driver is detected at the driver's seat, the driver specifying unit 102 searches for a portable device 2 that can be used such as a mobile phone or a PDA (Personal Digital Assistant) brought by the driver. The portable device ID is acquired and registered in the storage unit. The in-vehicle device 1 searches for the portable device 2 brought into the vehicle by the wireless communication unit 101 when there is a possibility that an occupant gets into the vehicle, such as when the door is opened or closed. ID and the like are stored. The time when the other party is found is the timing when the occupant with the mobile device 2 gets into the car.

  In step S <b> 14, the driver identification unit 102 captures the driver's face image (information A) with a camera provided in the driver's seat and registers it in the storage unit. In this case, it is sufficient that the operator can be specified even if it is not the image itself. Further, image recognition processing may be performed on the face image, and the feature amount of the face image for comparison may be registered.

  Next, in step S15, the command instruction unit 104 instructs the mobile device 2 to start monitoring the operation state.

  In step S <b> 16, the command instruction unit 104 instructs the portable device 2 to transmit the operator's face image (information B).

  In step S <b> 17, the face image (information B) is received from the portable device 2 as a result of the operation being performed on the portable device 2 and the face image being acquired. In addition, the face image may be subjected to image recognition processing in the mobile device 2 to acquire a feature value of the face image for comparison.

  In step S <b> 18, the portable device use restriction determination unit 13 determines whether the information A and the information B as face images match. When they do not match, the process returns to S12 to prepare for driving change or operation determination of the other portable device 2.

  In step S19, if the images of information A and information B match, it is determined whether or not the vehicle is running.

  In step S20, if the vehicle is traveling, the operation restriction of the portable device 1 is instructed. The restriction method is performed by function stop, alarm, screen stop, etc. And after restricting, it is good also as judging stop and canceling a restriction.

  Note that step S14 may be executed at any timing as long as it is after step S12 and before step S18.

  As described above, according to the invention of the first embodiment, it is not necessary to register in advance the portable device handled by the driver, and even if there are a plurality of drivers and portable devices, the portable device used in the driver's seat As a result, the operation can be restricted from the vehicle-mounted device side via the wireless LAN.

(Example 2)
Example 2 shows a case where the mobile device 2 determines its own operation restriction.

  FIG. 5 shows a basic functional block diagram of the vehicle system in the second embodiment.

  Similar to the first embodiment, the vehicle system includes a plurality of functions of the in-vehicle device 1 mounted on the vehicle and the portable device 2 brought into the vehicle by the occupant. The difference from the first embodiment is that the portable device performs matching determination and operation control of the portable device 2.

  The in-vehicle device 1 includes a wireless communication unit 101, a driver identification unit 102, a command instruction unit 104, a portable device ID storage unit 105, and a traveling state determination unit 106. The mobile device 2 includes a wireless communication unit 201, an operator specifying unit 202, an operation state determination unit 203, a restriction execution / cancellation unit 204, a command reception unit 205, and a mobile device restriction determination unit 206.

  Since the role of each device unit is the same as that described in the first embodiment, it is omitted in the following description.

  FIG. 6 shows an operation flow of the portable device in Example 2 according to the embodiment of the present invention.

  As a precondition, it is assumed that the present application is installed in all the mobile devices 2 brought in by the occupant, and the present application is activated when all the mobile devices 2 are powered on.

  First, in step S21, the command receiving unit 205 receives an application activation instruction from the in-vehicle device 1, and the built-in application starts monitoring the operation status. In step S22, the operator specifying unit 202 determines whether or not the mobile phone 2 has been operated at the driver's seat.

  In step S23, the mobile device application always checks whether it has been operated (or whether there has been a change in the attitude of the terminal = whether it has been lifted for operation), and has detected an operation (or a change in attitude). At that time, the operator's face image (information B) captured by the built-in camera 27 is acquired.

  As an example of a means for determining whether or not an operation has been performed, an acceleration sensor 28 (or an inclination sensor) mounted on a portable device is applied.

  In step S24, the application of the mobile device 2 further requests the in-vehicle device 1 to transmit the driver's face image (information A). In step S25, the driver information A is received from the vehicle-mounted device 1.

  In step S <b> 26, the portable device restriction determination unit 206 determines whether or not the operator information B of the portable device 2 matches the driver information A received from the in-vehicle device 1. If they match, in step S27, the in-vehicle device 1 is inquired about the traveling state of the vehicle. In step S28, an answer from the in-vehicle device 1 is received, and based on the result, in step S29, it is determined whether or not the vehicle is running. Restrict the operation.

  Further, in step S31 and step S32, after receiving the same inquiry and answer as in step S27 and step S28, in step S33, it is determined whether the vehicle is stopped. In step S <b> 34, the restriction execution / cancellation unit 206 removes the operation restriction of the mobile device 2. Thereafter, the process returns to step S22 to enter a standby state. If it is determined in step S34 that the vehicle is not in a stopped state, the process returns to step S31, and the vehicle-mounted device is again inquired about the vehicle running state.

  If the information A, B does not match and the vehicle is not traveling in the determinations at steps S26 and S28, the process returns to step S22, enters a standby state, and the subsequent processing is repeated.

  As described above, according to the invention of the second embodiment, on the portable device side, the driver of the car and the operator of the portable device are specified, and only when the information of the driver and the operator of the portable device matches, the restriction is performed. Only when the car is being driven, the function of only the portable device held by the driver is stopped, so that the passenger's portable device is not affected.

  In the first and second embodiments, the face image acquired by the camera is used as an example for collating the information A and the information B. However, the present invention is not limited to this and the face image is not limited thereto. Instead of this, the result of biometric authentication using a fingerprint, a vein or the like may be used. In this case, a sensor for obtaining information necessary for biometric authentication such as a fingerprint sensor or a vein sensor may be used instead of the camera.

  The present invention relates to a vehicle system having a function of restricting portable devices used by a driver when riding a vehicle.

DESCRIPTION OF SYMBOLS 1 In-vehicle apparatus 2 Portable apparatus 10, 20 Bus 11, 21 CPU
12, 22 Memory 13, 23 Storage device 14, 24 Power supply unit 15, 25 Wireless communication IF
16, 26 Input / output device 17, 27 Camera 18 Travel sensor 19 Seat sensor 28 Acceleration sensor 29 Microphone & speaker 30 Operation button 101, 201 Wireless communication unit 102 Driver identification unit 202 Operator identification unit 103, 206 Portable device restriction determination Unit 104 Command Instructing Unit 105 Portable Device ID Storage Unit 106 Traveling State Determination Unit 202 Operator Identification Unit 203 Operation State Determination Unit 204 Restriction Execution / Release Unit 205 Command Receiving Unit

Claims (5)

An in-vehicle device that wirelessly connects to a portable device in a vehicle cabin,
Means for acquiring and registering a driver's face image captured by a camera installed in the passenger compartment at the start of driving;
Means for acquiring, from the portable device, an operator's face image captured by a camera built in the portable device when the portable device is operated;
Means for extracting and comparing respective feature amounts of the driver's face image and the operator's face image;
And a means for restricting the operation of the portable device when the respective feature quantities match and the vehicle is running. A portable device connected wirelessly to an in-vehicle device,
A photographing means for photographing an operator's face image when it is detected that the portable device is operated;
Means for transmitting the imaged face image of the operator to the in-vehicle device in response to a request from the in-vehicle device;
Means for receiving an operation restriction instruction transmitted from the in-vehicle device in response to transmission of the face image;
Means for executing use restriction in accordance with the operation restriction instruction. A control program for an in-vehicle device that is wirelessly connected to a portable device in a vehicle cabin,
On the computer,
Obtaining and registering a driver's face image captured by a camera installed in the passenger compartment at the start of driving;
Obtaining an operator's face image captured by a camera built in the portable device from the portable device when the portable device is operated;
Extracting and comparing the respective feature values of the driver's face image and the operator's face image;
And a step of restricting the operation of the portable device when the respective feature values match and the vehicle is running. A control program for a portable device connected wirelessly to an in-vehicle device,
On the computer,
A photographing step of photographing an operator's face image when it is detected that the portable device is operated;
Transmitting the imaged face image of the operator to the in-vehicle device in response to a request from the in-vehicle device;
Receiving an operation restriction instruction transmitted from the in-vehicle device in response to transmission of the face image;
Executing a use restriction in accordance with the operation restriction instruction. A portable device connected wirelessly to an in-vehicle device,
Means for capturing an operator's face image with a camera built in the portable device when the portable device is operated;
Means for receiving, from the in-vehicle device, driver information in which a driver's face image captured by a camera installed in a vehicle cabin is registered;
Means for extracting and comparing respective feature amounts of the operator's face image and the driver's face image;
Means for restricting the operation of the portable device when the respective feature values match and the vehicle is running.

Images