WO2017179201A1

WO2017179201A1 - Vehicle-mounted information processing device and vehicle-mounted information processing method

Info

Publication number: WO2017179201A1
Application number: PCT/JP2016/062143
Authority: WO
Inventors: 政信大沢; 敬平野; 友美保科
Original assignee: 三菱電機株式会社
Priority date: 2016-04-15
Filing date: 2016-04-15
Publication date: 2017-10-19

Abstract

This vehicle-mounted information processing device is provided with: a detection information acquisition unit (101) which acquires detection information indicating detection of an input operation and an authentication operation performed by an operator; a vehicle information acquisition unit (102) which acquires vehicle information indicating the traveling state of a vehicle; a control unit (103) which, depending on the acquired detection information and vehicle information, controls either output of information for requesting input of an authentication operation, or output of information about detection of an input operation; and an authentication processing unit (104) which verifies an input authentication operation against the output information for requesting input of an authentication operation.

Description

In-vehicle information processing apparatus and in-vehicle information processing method

This invention relates to a technique for controlling an operation input to an in-vehicle device.

The navigation device and audio device mounted on the vehicle are a driver or an assistant seated in the driver's seat via an input operation device such as a touch panel or a hardware switch arranged between the driver's seat and the passenger seat of the vehicle. An input operation by a passenger seated in the seat and the rear seat is accepted. Conventionally, a technique for restricting a predetermined input operation when the vehicle is in a traveling state has been used so that an input operation by an operator does not interfere with the vehicle traveling.

For example, the input operation device described in Patent Literature 1 can detect the shape of the operator touching the display with the touch panel, and the operator who has operated the display with the touch panel from the detected shape can be seated in the driver's seat. When the vehicle is traveling and the vehicle is traveling, it is determined that the operation of the operator hinders traveling of the vehicle, and processing is performed so as not to accept the operation.

JP 2012-32879 A

According to the input operation device described in Patent Document 1, each time the operator touches the display with a touch panel, the touched shape is detected, and the operator who operates the display with the touch panel from the detected shape is the passenger seat. It is necessary to determine whether or not he / she is attached to the mobile phone, and there is a problem that the processing load for specifying the operator is heavy.

The present invention has been made to solve the above-described problems, and an object thereof is to reduce a processing load for specifying an operator who has performed an input operation.

An in-vehicle information processing apparatus according to the present invention includes a detection information acquisition unit that acquires detection information indicating that an input operation and an authentication operation of an operator have been detected, and a vehicle information acquisition unit that acquires vehicle information indicating a running state of the vehicle And control for controlling the output of the information for requesting the input of the authentication operation or the output of the detection information of the input operation according to the detection information acquired by the detection information acquisition unit and the vehicle information acquired by the vehicle information acquisition unit And an authentication processing unit for collating the input authentication operation with respect to the information requesting input of the output authentication operation.

According to this invention, it is possible to reduce the frequency of performing the process for specifying the operator who performed the input operation, and to reduce the processing load for specifying the operator.

1 is a block diagram illustrating a configuration of an in-vehicle information processing apparatus according to Embodiment 1. FIG. 2 is a diagram illustrating a hardware configuration example of an in-vehicle information processing apparatus according to Embodiment 1. FIG. It is a figure which shows the structural example of the authentication database of the vehicle-mounted information processing apparatus which concerns on Embodiment 1. FIG. 3 is a flowchart illustrating an operation of the in-vehicle information processing apparatus according to the first embodiment. 4 is a flowchart illustrating an operation of authentication processing of the in-vehicle information processing apparatus according to the first embodiment. 6A, 6B, and 6D are diagrams illustrating an example of display control by the control unit of the in-vehicle information processing apparatus according to Embodiment 1, and FIG. 6C illustrates authentication of the in-vehicle information processing apparatus according to Embodiment 1. It is a figure which shows an example of the information stored in a database. It is a figure which shows an example in case the control part of the vehicle-mounted information processing apparatus which concerns on Embodiment 1 performs initialization. 4 is a block diagram illustrating a configuration of an in-vehicle information processing apparatus according to Embodiment 2. FIG. FIG. 10 is a block diagram illustrating a configuration of an in-vehicle information processing apparatus according to a third embodiment. It is a figure which shows the structural example of the driver | operator database of the vehicle-mounted information processing apparatus which concerns on Embodiment 3. FIG.

Hereinafter, in order to explain the present invention in more detail, modes for carrying out the present invention will be described with reference to the accompanying drawings.
Embodiment 1 FIG.
FIG. 1 is a block diagram showing the configuration of the in-vehicle information processing apparatus 100 according to the first embodiment.
The in-vehicle information processing apparatus 100 includes a detection information acquisition unit 101, a vehicle information acquisition unit 102, a control unit 103, an authentication processing unit 104, and an authentication database 105. As shown in FIG. 1, the in-vehicle information processing apparatus 100 is connected to a touch panel 200, an in-vehicle apparatus 300, a display apparatus 400, and a speaker 500.

The detection information acquisition unit 101 acquires detection information from the touch panel 200. When the touch panel 200 detects the proximity or contact of an operator's body or a finger (hereinafter referred to as an object), the touch panel 200 outputs detection information. The touch panel 200 is configured by applying a capacitance method capable of detecting the proximity or contact of an object, or a resistive film method capable of detecting contact of an object. The touch panel 200 includes an input operation for bringing an object close to or in contact with the touch panel 200 for an operator to perform an operation input, and an authentication operation for bringing an object close to or in contact with the touch panel 200 for an operator to perform authentication input. Detect. On the touch panel 200, a coordinate value is assigned in advance to a region where an operator's input operation or authentication operation is detected, and information indicating a position or a range where the input operation and authentication operation are detected is output as detection information.
In the example of FIG. 1, the detection information acquisition unit 101 acquires the detection information from the touch panel 200. However, the detection information acquisition unit 101 may be configured to acquire the detection information from a touch pad or the like.

The vehicle information acquisition unit 102 acquires information indicating the traveling state of the vehicle, such as vehicle speed or parking brake state information, via an in-vehicle network (not shown).

When the detection information of the input operation is input from the detection information acquisition unit 101, the control unit 103 performs processing according to the information indicating the traveling state of the vehicle acquired by the vehicle information acquisition unit 102. When the control unit 103 determines that the vehicle is stopped or parked from the information indicating the running state of the vehicle, the control unit 103 uses the input operation detection information input from the detection information acquisition unit 101 as control information to the in-vehicle device 300. Output. Further, when the vehicle is traveling and the operator is not authenticated, the control unit 103 outputs control information for requesting the operator to input an authentication operation to the display device 400 or the speaker 500. The authentication operation requested by the control unit 103 is a preset operation such as “hold the right hand and hold”.

The control unit 103 analyzes the input operation detection information acquired in response to the authentication operation input request, extracts the feature amount of the object at the time of the authentication operation, and outputs it to the authentication processing unit 104. In addition, when the vehicle is traveling and the operator has been authenticated, the control unit 103 outputs the detection information of the input operation input from the detection information acquisition unit 101 to the in-vehicle device 300 as control information.
Here, the feature amount of the object at the time of the authentication operation extracted by the control unit 103 is, for example, when the operator holds the hand open as the authentication operation, For example, the positions of the vertices of the fingers, or combinations of the vertices of each finger of the operator and the shapes of the operator's hand and the contour of the finger. Note that the above-described feature amount is an example, and any information that can identify the authentication operation of the operator can be used as the feature amount.
Note that more detailed control contents of the control unit 103 will be described later.

The authentication processing unit 104 collates the feature amount of the object at the time of the authentication operation extracted by the control unit 103 with the feature amount stored in the authentication database 105, and the operator who performed the authentication operation is the driver. Or whether the passenger is a passenger other than the driver. The authentication processing unit 104 outputs the identification result of the operator who performed the authentication operation to the control unit 103.
Specifically, the authentication processing unit 104, when the extracted feature quantity of the object at the time of the authentication operation matches any one of the feature quantities stored in the authentication database 105, the operator is a rider other than the driver. Identified as a person. On the other hand, if the feature amount of the extracted object at the time of the authentication operation does not match any feature amount stored in the authentication database 105, the authentication processing unit 104 specifies that the operator is a driver.
When the control unit 103 has extracted the contour shape of the operator's hand and finger as the feature amount of the object during the authentication operation, the authentication processing unit 104 determines the extracted shape of the hand and finger contour and the authentication. Matching with the shape data of the hand and finger contours stored in the database 105 is performed to determine whether the operator is a passenger other than the driver.
It should be noted that in the feature amount collation, the feature amount of the object at the time of the authentication operation does not have to be completely coincident with any one of the feature amounts stored in the authentication database 105, and the degree of coincidence is not less than a preset threshold value The feature amounts may be regarded as matching.

The authentication database 105 stores the feature quantity of an object that can be identified as an authentication operation for a passenger other than the driver. For example, it is estimated that the authentication database 105 is extracted from the right hand that is close to or close to the touch panel 200 when the passenger in the passenger seat opens the right hand over the touch panel 200 when the vehicle is a right steering wheel. Stores feature quantities of shapes.

The in-vehicle device 300 is a navigation device, an audio device, or the like mounted on the vehicle. The in-vehicle device 300 controls the device itself based on information indicating the position or range where the input operation indicated by the detection information input from the control unit 103 is detected.

The display device 400 is configured by, for example, a liquid crystal display or an organic EL (electroluminescence), and the like, for notifying the driver and passengers based on control information input from the in-vehicle information processing device 100 and the in-vehicle device 300. Display information. Specifically, based on the control information input from the control unit 103, a screen for prompting an input of an authentication operation, a screen for notifying that the authentication processing has been completed, and the like are displayed.
Further, when the in-vehicle device 300 is a navigation device, the display device 400 displays information such as a map, a departure place, a destination, and a guidance route.
Note that the display device 400 and the touch panel 200 may be integrated, and an input to the touch panel 200 may be received as an operation for selecting information displayed on the display device 400.

Speaker 500 outputs information for notifying the driver and passengers based on control information input from in-vehicle information processing apparatus 100 and in-vehicle apparatus 300. Specifically, based on the control information input from the control unit 103, a voice prompting input of an authentication operation, a voice notifying that the authentication process has been completed, and the like are output.

Next, a hardware configuration example of the in-vehicle information processing apparatus 100 will be described.
FIG. 2 is a diagram illustrating a hardware configuration example of the in-vehicle information processing apparatus 100 according to the first embodiment.
The detection information acquisition unit 101, the vehicle information acquisition unit 102, the control unit 103, and the authentication processing unit 104 in the in-vehicle information processing apparatus 100 are realized by a processing circuit. That is, the detection information acquisition unit 101, the vehicle information acquisition unit 102, the control unit 103, and the authentication processing unit 104 extract the feature points of the object from the authentication operation detection information input in response to the authentication operation request, and A processing circuit for identifying whether the driver is a passenger other than the driver.

When the processing circuit is dedicated hardware, the processing circuit can be, for example, a single circuit, a composite circuit, a programmed processor, a processor programmed in parallel, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-programmable Gate Array). ) Or a combination of these. The functions of the detection information acquisition unit 101, the vehicle information acquisition unit 102, the control unit 103, and the authentication processing unit 104 may be realized by a processing circuit, or the functions of the units may be realized by a processing circuit. .

When the processing circuit is a CPU (Central Processing Unit), the processing circuit is a CPU 110 that executes a program stored in the memory 120 shown in FIG. The functions of the detection information acquisition unit 101, the vehicle information acquisition unit 102, the control unit 103, and the authentication processing unit 104 are realized by software, firmware, or a combination of software and firmware. Software or firmware is described as a program and stored in the memory 120. CPU110 implement | achieves each function of the detection information acquisition part 101, the vehicle information acquisition part 102, the control part 103, and the authentication process part 104 by reading and running the program memorize | stored in the memory 120. FIG. That is, when the detection information acquisition unit 101, the vehicle information acquisition unit 102, the control unit 103, and the authentication processing unit 104 are executed by the CPU 110, each step shown in FIGS. A memory 120 is provided for storing the program to be changed. These programs can be said to cause a computer to execute the procedures or methods of the detection information acquisition unit 101, the vehicle information acquisition unit 102, the control unit 103, and the authentication processing unit 104.

Here, the CPU 110 is, for example, a central processing unit, a processing unit, an arithmetic unit, a processor, a microprocessor, a microcomputer, or a DSP (Digital Signal Processor).
The memory 120 may be a nonvolatile or volatile semiconductor memory such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, an EPROM (Erasable Programmable ROM), and an EEPROM (Electrically EPROM). Further, it may be a magnetic disk such as a hard disk or a flexible disk, or an optical disk such as a mini disk, CD (Compact Disc), or DVD (Digital Versatile Disc).

Next, the control content of the control unit 103 will be described in more detail.
In the following description, five cases are classified according to the traveling state of the vehicle, the authentication state of the operator, and the identification result of the operator.
(1-1) When the vehicle is stopped or parked The control unit 103 refers to the traveling state of the vehicle acquired from the vehicle information acquisition unit 102, and when the vehicle speed is “0” or the parking brake is ON. Determine that the vehicle is parked or parked.
The control unit 103 outputs information indicating the position or range where the input operation is detected, described in the detection information acquired by the detection information acquisition unit 101, to the in-vehicle device 300.
The in-vehicle device 300 identifies the operation of the operator based on the input information indicating the position or range, and executes a process corresponding to the identified operation.

(1-2) When the vehicle is traveling and the operator is not authenticated The control unit 103 refers to the traveling state of the vehicle acquired from the vehicle information acquisition unit 102, and a state equal to or higher than a preset vehicle speed is predetermined. It is determined that the vehicle is traveling when the vehicle continues for a predetermined time. Here, the preset vehicle speed is, for example, 5 km / h. The predetermined time is, for example, 3 seconds. Furthermore, when the operator is not authenticated, the control unit 103 outputs control information for requesting the operator to input an authentication operation to at least one of the display device 400 and the speaker 500.
Here, the authentication operation requested from the operator is, for example, “hold the right hand open” at a position away from the touch panel 200 by a predetermined distance d or a predetermined position on the touch panel 200. The distance d is a distance at which the touch panel 200 can detect the proximity of an object, and is a value satisfying a condition such as 0 cm <d <5 cm.

(1-3) When the vehicle is running and operator authentication is being executed The operator authentication is being executed when the input of the authentication operation described in (1-2) above is required. This is a state in which a transition is made after outputting the control information for doing so.
The control unit 103 analyzes the detection information of the authentication operation acquired by the detection information acquisition unit 101, and extracts the feature amount of the object during the authentication operation. The control unit 103 outputs the extracted feature amount to the authentication processing unit 104.

(1-4) When the vehicle is running, the authentication process is completed, and the operator identification result is a driver. The control unit 103 refers to the operator identification result input from the authentication processing unit 104 and performs an operation. When it is determined that the driver is the driver, the detection information of the input operation input from the detection information acquisition unit 101 is not output to the in-vehicle device 300 thereafter. That is, the control unit 103 does not accept an operator's operation via the touch panel 200.

(1-5) When the vehicle is traveling, the authentication process is completed, and the operator identification result is a passenger other than the driver. The control unit 103 displays the operator identification result input from the authentication processing unit 104. When it is determined that the operator is a passenger other than the driver, the detection information of the input operation input from the detection information acquisition unit 101 is output to the in-vehicle device 300 thereafter. That is, the control unit 103 receives an operator's operation via the touch panel 200.

FIG. 3 is a diagram illustrating an example of an authentication pattern stored in the authentication database 105 of the in-vehicle information processing apparatus 100 according to the first embodiment.
The authentication database 105 stores a plurality of operator states that can be specified as authentication operations for passengers other than the driver as authentication patterns. Although not shown, each authentication pattern stores a feature amount of the object in association with each other.
In the example of FIG. 3, an authentication pattern for performing an authentication operation in which a passenger on the passenger seat in the right-hand drive vehicle opens the right hand, an authentication pattern for performing an authentication operation in which the passenger on the passenger seat in the left-handle vehicle opens the left hand, When an authentication pattern in which the passenger in the left rear seat in the right-hand drive vehicle performs an authentication operation with the right hand open, an authentication pattern in which the passenger in the right rear seat in the vehicle with the left handle performs an authentication operation with the left hand open is stored Is shown. Note that the authentication pattern is not limited to the example shown in FIG. 3, and various authentication patterns can be stored as long as the operator can be identified as a passenger other than the driver.

Next, the operation of the in-vehicle information processing apparatus 100 will be described.
4 and 5 are flowcharts showing the operation of the in-vehicle information processing apparatus 100 according to the first embodiment.
First, the overall operation of the in-vehicle information processing apparatus 100 will be described with reference to the flowchart of FIG.
When the in-vehicle information processing apparatus 100 is activated, the in-vehicle information processing apparatus 100 is initialized (step ST1). Here, initialization of the in-vehicle information processing apparatus 100 includes, for example, processing for setting the authentication state of the operator to unauthenticated when an authenticated operator is set in the control unit 103. Next, the detection information acquisition unit 101 determines whether or not input operation detection information indicating that an object has approached or touched the touch panel 200 has been acquired (step ST2). When the input operation detection information is not acquired (step ST2; NO), the determination process of step ST2 is repeated.

On the other hand, when the input operation detection information is acquired (step ST2; YES), the detection information acquisition unit 101 outputs the acquired input operation detection information to the control unit 103. When the detection information of the input operation is input, the control unit 103 refers to the information indicating the driving state of the vehicle that is input from the vehicle information acquisition unit 102 constantly or at a predetermined interval, and determines whether the vehicle is traveling. A determination is made (step ST3). When the vehicle is not traveling (step ST3; NO), the control unit 103 proceeds to a process of step ST5 described later. On the other hand, when the vehicle is traveling (step ST3; YES), the control unit 103 determines whether or not the operator has been authenticated (step ST4).

When the operator has been authenticated (step ST4; YES), the control unit 103 outputs the input operation detection information to the in-vehicle device 300 as control information (step ST5). The detection information acquisition unit 101 determines whether or not the input operation detection information is acquired again within a predetermined time (step ST6). When the input operation detection information is acquired within the predetermined time (step ST6; YES), the process returns to step ST3. On the other hand, when the detection information of the input operation is not acquired within the predetermined time (step ST6; NO), the process returns to step ST1.
If the operator is not authenticated (step ST4; NO), the control unit 103 performs an authentication process (step ST7) and returns to the process of step ST2.

In step ST6, in determining whether or not the input operation detection information has been acquired again within a predetermined time, for example, the detection information acquisition unit 101 can acquire the detection information for detecting the proximity of an object from the touch panel 200 for a predetermined time. The determination is made based on whether (for example, 1 second) has elapsed. In addition, for example, the determination is performed based on whether or not a predetermined time (for example, 3 seconds) has elapsed since the detection information acquisition unit 101 can no longer acquire detection information for detecting contact of an object from the touch panel 200. Note that the specific example of the predetermined time described above is an example, and can be set as appropriate.

Furthermore, in step ST6, instead of determining whether or not input operation detection information has been acquired again within a predetermined time, it may be determined whether or not a series of operation tasks has been completed. In this case, when it is determined that a series of operation tasks has been completed, the process returns to step ST1, and when it is determined that a series of operation tasks has not been completed, the process returns to step ST2. Constitute.
In addition, for example, in the task of searching for facilities by genre in the navigation device, whether or not the “genre search” button has been pressed or “genre search” This is performed based on whether the “select” button has been pressed or the “search” button has been pressed.

Next, the details of the operation of the authentication process will be described with reference to the flowchart of FIG.
The control unit 103 outputs control information requesting the operator to input an authentication operation to at least one of the display device 400 and the speaker 500 (step ST11). The detection information acquisition unit 101 determines whether or not an authentication operation has been input in response to an input request for the authentication operation displayed or output based on the control information output in step ST11 (step ST12). When the authentication operation is input (step ST12; YES), the detection information acquisition unit 101 outputs the detection information to the control unit 103, and the control unit 103 analyzes the input detection information and detects the shape of the object. Then, the feature amount of the detected shape is extracted (step ST13). The authentication processing unit 104 collates the feature amount extracted in step ST13 with the feature amount associated with each authentication pattern stored in the authentication database 105, and identifies the operator (step ST14). The control unit 103 refers to the identification result of the operator and determines whether or not the operator is a passenger other than the driver (step ST15).

If the operator is not a passenger other than the driver (step ST15; NO), the process proceeds to step ST17. On the other hand, when the operator is a passenger other than the driver (step ST15; YES), the control unit 103 authenticates the operator (step ST16) and ends the authentication process (step ST17). Thereafter, the flow returns to the process of step ST2 in the flowchart of FIG. In step ST16, the control unit 103 may output control information to the display device 400 or the speaker 500 so as to perform at least one of display and sound output for notifying that the operator has been authenticated. .

On the other hand, when the authentication operation is not input (step ST12; NO), the control unit 103 determines whether or not a predetermined time has elapsed after outputting the authentication operation input request (step ST18). If the predetermined time has elapsed (step ST18; YES), the process proceeds to step ST17, and the authentication process is terminated.

On the other hand, when the predetermined time has not elapsed (step ST18; NO), the control unit 103 refers to the information indicating the traveling state of the vehicle input from the vehicle information acquisition unit 102 and determines whether the vehicle is traveling. Is performed (step ST19). When the vehicle is traveling (step ST19; YES), the process returns to step ST12, and the detection information acquisition unit 101 waits for an authentication operation to be input. On the other hand, when the vehicle is not running (step ST19; NO), the process proceeds to step ST17, and the authentication process is terminated.

Next, information displayed on the display device 400 based on the control information output by the control unit 103 of the in-vehicle information processing apparatus 100 will be described.
6A, 6B, and 6D are diagrams illustrating an example of display control by the control unit 103 of the in-vehicle information processing apparatus 100 according to Embodiment 1. FIG. FIG. 6C is a diagram illustrating an example of information stored in the authentication database 105 of the in-vehicle information processing apparatus 100 according to Embodiment 1.
6A and 6B show display examples based on the control information output from the control unit 103 to the display device 400 in step ST5 of the flowchart of FIG. 4 described above.
A comment 402 that prompts the operator to perform an authentication operation is displayed on the screen 401 of the display device 400. Further, an image 403 showing the shape of the hand that guides the authentication operation is displayed on the screen 401 of the display device 400. The operator performs an authentication operation according to the comment 402 or the image 403.

Further, as shown in FIG. 6B, the shape of a hand for guiding the authentication operation may be displayed on the screen 401 of the display device 400 like an image 403a in consideration of the display position. When the display area of the screen 401 of the display device 400 is vertically divided into two

screens

401a and 401b, the control unit 103 displays the screen 401a which is a screen farther away from the position of the driver's seat of the vehicle. Control information for displaying the image 403a is output. In addition, the control unit 103 controls the display of a comment for designating a position where the authentication operation is performed, such as “Please hold your right hand over the position of the hand image” as the comment 402a that prompts the operator to perform the authentication operation. I do.
Note that the above-described screen 401 is divided into two vertically and is set as a screen 401a and a screen 401b. This is an example. When the screen 401 is vertically divided into three, the control unit 103 uses three regions. When the control information for setting the position for performing the authentication operation is output and the screen 401 is divided vertically into two and horizontally into two, the control unit 103 sets the position for performing the authentication operation using four areas. Control information may be output.

When the operator inputs an authentication operation to the image 403a shown in FIG. 6B, the authentication processing unit 104 is an area (in FIG. 6B) in which the feature amount of the object is specified during the authentication operation extracted by the control unit 103. The feature quantity stored in the authentication database 105 is checked in consideration of whether it exists in the screen 401a). For example, as shown in FIG. 6C, when an image 403a is displayed,

areas

405a, 405b, 405c, 405d, and 405e centered on the

vertices

404a, 404b, 404c, 404d, and 404e of each finger of the image 403a are set. And stored in the authentication database 105. In the authentication processing unit 104, the position of the vertex of each finger of the operator extracted as the feature amount by the control unit 103 is located in the

areas

405a, 405b, 405c, 405d, and 405e stored in the authentication database 105. In addition, it is determined that the extracted feature amount of the object at the time of the authentication operation matches the feature amount stored in the authentication database 105.

FIG. 6D shows a display example based on the control information output from the control unit 103 to the display device 400 in step ST16 of the flowchart of FIG. 5 described above.
On the screen 401 of the display device 400, a comment 406 indicating that the operator is authenticated and an input operation for operating the in-vehicle device 300 is received is displayed.

6A, 6B, and 6D illustrate an example in which the comment 402, the comment 402a, or the comment 406 is displayed on the screen 401 of the display device 400. However, the control unit 103 is a voice that prompts the speaker 500 to perform an authentication operation. Or control information for outputting a voice indicating that the operator has been authenticated may be output. The speaker 500 is based on the control information output from the control unit 103, for example, “Perform authentication, hold your right hand up”, “Perform authentication, open your right hand and hold your hand over the position of the image. Please output "," Authenticated, operation is possible ", etc.

In the above description, the configuration in which the detection information acquisition unit 101 acquires detection information from the touch panel 200 or a touch pad as a trigger and the control unit 103 shifts to processing for requesting an authentication operation of the operator based on the detection information. However, the control unit 103 may be configured to shift to a process for requesting an authentication operation of the operator, triggered by the detection information acquisition unit 101 acquiring the detection information from the hardware switch. Specifically, in the block diagram shown in FIG. 1 shown in FIG. 1, the detection information acquisition unit 101 acquires, as detection information, pressing information indicating that a switch has been pressed from a hardware switch (not shown). Based on the detection information, the control unit 103 generates control information that requests the touch panel 200 to input an authentication operation, and outputs the control information to at least one of the display device 400 and the speaker 500. The operator inputs an authentication operation to the touch panel 200. The detection information acquisition unit 101 acquires detection information from the touch panel 200, and an operator authentication process is performed in the control unit 103 and the authentication processing unit 104.

As described above, according to the first embodiment, according to the detection information acquired by the detection information acquisition unit 101 and the vehicle information acquired by the vehicle information acquisition unit 102, It is configured to include a control unit 103 that controls output of output or detection information, and an authentication processing unit 104 that collates the input authentication operation with respect to the information that requests input of the output authentication operation. Therefore, it is possible to suppress the processing load for verifying the authentication operation.

Further, according to the first embodiment, the control unit 103 outputs the information requesting the input of the authentication operation when the vehicle is running and the operator who has performed the input operation is not authenticated. Since it is configured to extract the feature amount of the operator from the authentication operation detection information input to the control request and the authentication operation input requested, every time the operator performs the input operation There is no need to perform an authentication process for the operator, and the load of the process for verifying the authentication operation can be suppressed.

In the first embodiment described above, in a state where the operator is authenticated and the input operation can be accepted, as shown in FIG. When the detection information detected in the area B is acquired, the control unit 103 may be configured to execute initialization to make an authenticated operator unauthenticated.

Embodiment 2. FIG.
In the above-described second embodiment, the configuration in which the authentication process is performed based on the authentication operation input via the touch panel 200 has been described. However, in the second embodiment, a captured image of an infrared camera that images the authentication operation is used. Shows a configuration for performing authentication processing.
FIG. 8 is a block diagram showing the configuration of the in-vehicle information processing apparatus 100 according to the second embodiment.
The detection information acquisition unit 101 of the in-vehicle information processing apparatus 100 according to the second embodiment acquires detection information from the infrared camera 201 and a hardware switch (hereinafter referred to as H / W switch) 202 in addition to the touch panel 200. In FIG. 8, the components of the in-vehicle information processing apparatus 100 are the same as those in the in-vehicle information processing apparatus 100 according to the first embodiment. Is omitted or simplified.

The infrared camera 201 is installed on, for example, the upper part of the touch panel 200, the upper part of the in-vehicle device 300 fitted in the dashboard, or the upper part of the display device 400. The infrared camera 201 is configured to be able to image a wide area so that the operator can image the area where the input operation and the authentication operation are performed. Specifically, a plurality of infrared cameras 201 are arranged or a high angle of view infrared camera 201 is applied.

The H / W switch 202 is a switch provided for operating the in-vehicle device 300. When the switch is pressed, information indicating that the switch is pressed is output as detection information.

Next, the detection information acquisition unit 101 uses the detection information acquired from any one of the touch panel 200, the infrared camera 201, and the H / W switch 202 as a trigger, and the control unit 103 performs an authentication process using the captured image of the infrared camera 201. A configuration to be performed will be described.
Hereinafter, when the detection information acquired from the touch panel 200 is used as a trigger, the detection information acquired from the captured image of the infrared camera 201 is used as a trigger, or the detection information acquired by the H / W switch 202 is used as a trigger. The explanation will be made by dividing cases.
(2-1) Using Detection Information Obtained from Touch Panel 200 as a Trigger Detection information acquisition unit 101 is connected to touch panel 200 and infrared camera 201. The detection information acquisition unit 101 acquires detection information indicating that the proximity or contact of an object has been detected from the touch panel 200. Furthermore, when the control unit 103 determines that the vehicle is running and the operator is not authenticated, the control unit 103 requests control information to be input to the infrared camera 201. Is output to at least one of the display device 400 or the speaker 500.

(2-2) When Detection Information Acquired from Image Captured by Infrared Camera 201 is Triggered The detection information acquisition unit 101 is connected to the infrared camera 201. When the detection information acquisition unit 101 refers to a captured image of the infrared camera 201 and detects a captured image indicating that an object is close to or touches the touch panel 200 or the H / W switch 202, the detected information is used as detection information. get. Furthermore, when the control unit 103 determines that the vehicle is running and the operator is not authenticated, the control unit 103 requests control information to be input to the infrared camera 201. Is output to at least one of the display device 400 or the speaker 500.
In this case, the detection information acquisition unit 101 stores an area set in advance when an object performing an input operation is captured in the captured image of the infrared camera 201, and the captured image of the area has a predetermined luminance or higher. Is detected for a predetermined time (for example, 1 second) or longer, it is detected that the object is close to or in contact with the touch panel 200 or the H / W switch 202, and the captured image is acquired as detection information.
The brightness of the captured image is indicated in 255 levels using values from “0” to “254”, for example. The detection information acquisition unit 101 determines that the object performing the input operation has been captured when the luminance value in a preset region of the captured image is, for example, “150” or more, and the proximity state of the object. Alternatively, the contact state is associated in advance.
When the infrared camera 201 is arranged at a position where the touch panel 200 or the H / W switch 202 can be imaged, the detection information acquisition unit 101 includes the touch panel 200 or the H / W switch 202 in the captured image of the infrared camera 201. An area corresponding to the arrangement position is stored, and it is determined whether or not a predetermined luminance or higher is detected for a predetermined time or longer in a captured image of the area.

(2-3) When the detection information acquired by the H / W switch 202 is used as a trigger The detection information acquisition unit 101 is connected to the infrared camera 201 and the H / W switch 202. The detection information acquisition unit 101 acquires detection information indicating that the switch has been pressed from the H / W switch 202. Furthermore, when the control unit 103 determines that the vehicle is running and the operator is not authenticated, the control unit 103 requests control information to be input to the infrared camera 201. Is output to at least one of the display device 400 or the speaker 500.

In the above (2-1) to (2-3), the authentication operation input to the infrared camera 201 includes the arrival of the operator's hand and arm in addition to the operation capable of recognizing the shape of the operator's hand. An operation capable of recognizing the direction, an operation capable of recognizing the feature amount of the operator's face, and the like are applicable.

The detection information acquisition unit 101 acquires, as detection information, a captured image obtained by capturing the authentication operation input in response to the authentication operation input request displayed or output in (2-1) to (2-3) above. To do. The control unit 103 analyzes the captured image that is the detection information acquired by the detection information acquisition unit 101. For example, the shape of the operator's hand, the shape of the operator's hand and the arrival direction of the arm, or the face of the operator Etc., at least one of the authentications is performed, and the feature amount is extracted. By acquiring a captured image from the infrared camera 201 as detection information, it is possible to recognize the arrival direction of the arm and the face in addition to the detection of the hand shape.

When the feature amount is extracted from the shape of the operator's hand, the control unit 103 analyzes the captured image, and extracts the feature amount of the region whose luminance value is equal to or greater than a predetermined value. When the operator points the palm toward the infrared camera 301, the palm approaches the infrared camera 301. Therefore, when the brightness value of the captured image is shown in 255 levels from 0 to 254, the imaging region of the palm is, for example, 200 or more It shows a high value such as a luminance value. Therefore, the control unit 103 extracts a region having a luminance value of 200 or more, for example, and extracts the contour shape of the hand and finger or the position of the vertex of each finger as a feature amount from this region.

When extracting the feature amount from the arrival direction of the operator's arm, the control unit 103 analyzes the captured image, identifies a region having a luminance value equal to or greater than a predetermined value, and extracts the inclination of the identified region as the feature amount. To do. When the operator points the palm toward the infrared camera 301 and the infrared camera 301 images the palm and arm of the operator, the palm of the operator is closest to the infrared camera 301 and the operator's arm is closer to the infrared camera 301 than the palm. A little away from. When the luminance value of the captured image is shown in 255 levels from 0 to 254, the imaging region of the palm shows a luminance value of 200 or more, for example, and the imaging region of the arm shows a luminance value of 150 to 199, for example. Therefore, the control unit 103 identifies the area where the luminance value is, for example, 200 or more as the palm imaging area, and extracts the above-described feature amount. Further, the control unit 103 identifies an area where the luminance value is, for example, 150 to 199 as an arm imaging area, and extracts a slope of a rectangular area that approximates the identified imaging area as a feature amount. The inclination of the rectangular area is, for example, an inclination with respect to the vertical axis or the horizontal axis of the captured image.

When the feature amount is extracted from the captured image of the face, the control unit 103 analyzes the captured image, and extracts the eyes, the nose, the shape of the jaw, the inclination of the center axis of the face, and the like as the feature amount.

The authentication processing unit 104 collates the feature amount extracted by the control unit 103 with the feature amount associated with each authentication pattern stored in the authentication database 105, and identifies the operator.
In this case, the authentication database 105 stores hand shapes, arm arrival directions, and the like as feature amounts associated with each authentication pattern. Further, the authentication database 105 defines a passenger of a vehicle as an authentication pattern, and stores a feature amount associated with each passenger's face in association with the passenger's authentication pattern.

As in the first embodiment, the authentication processing unit 104 collates the extracted feature value of the hand shape with the feature value stored in the authentication database 105, and the operator is a passenger other than the driver. Determine if there is.
Alternatively, the authentication processing unit 104 collates the feature amount of the operator's hand shape and arm arrival direction with the feature amount stored in the authentication database 105, and the operator is a passenger other than the driver. In addition, it is determined whether the operator's arm has arrived from the driver's seat, and whether the operator is a passenger other than the driver is specified.
Alternatively, the authentication processing unit 104 collates the feature amount as a result of authenticating the operator's face with the feature amount stored in the authentication database 105, and specifies whether the operator is a passenger other than the driver. Do. When identifying the operator, the authentication processing unit 104 performs verification using the result of authenticating the direction of arrival of the hand and arm or the face in addition to the feature amount of the object. Accuracy can be improved.

Further, the authentication processing unit 104 impersonates the passenger by inputting the authentication operation with an unreasonable posture when the inclination of the central axis extracted as the feature amount by the control unit 103 is larger than a predetermined value. The operator is identified as not being a passenger, as possible. The authentication processing unit 104 can improve the accuracy in identifying the operator by considering the inclination of the central axis of the operator's face in identifying whether the passenger is a passenger.

Next, the operation of the in-vehicle information processing apparatus 100 according to Embodiment 2 will be described.
The operation of the in-vehicle information processing apparatus 100 according to Embodiment 2 is the same as that of the in-vehicle information processing apparatus 100 according to Embodiment 1 shown in FIGS.
A case where the detection information of the infrared camera 201 is applied to determine whether or not the input operation detection information has been acquired again within the predetermined time indicated in step ST6 of the flowchart of FIG. 4 will be described.

In the determination of whether or not the input operation detection information has been acquired again within a predetermined time in step ST6, for example, the detection information acquisition unit 101 analyzes the captured image captured by the infrared camera 201 and sets a predetermined imaging. The determination is based on whether or not a portion where the luminance is greater than the predetermined value disappears and a predetermined time has elapsed in the image area. Here, the preset area in the captured image is a preset area when an object is imaged when the operator performs an input operation or an authentication operation, or the touch panel 200 or the H / W switch 202 is arranged. This is the area that has been In this area, when the captured image has no portion where the luminance is greater than the predetermined value and a predetermined time (for example, 5 seconds) has elapsed, the detection information acquisition unit 101 has the operator's hand or the like touch the touch panel 200 or H It can be determined that the operator is not performing an operation of performing an operation away from the / W switch 202.
Here, the predetermined luminance value used for determination by the detection information acquisition unit 101 is a value set based on the correlation between the luminance of the captured image and the distance between the infrared camera 201 and the object to be imaged. For example, it is assumed that the object and the infrared camera 201 are separated by a predetermined distance when the operator is performing an operation. In this case, the detection information acquisition unit 101 is set with a predetermined brightness value (for example, a brightness value “150”) corresponding to the predetermined distance that is set in advance.

Similarly to the first embodiment, in step ST6, instead of determining whether or not the input operation detection information has been acquired again within a predetermined time, it is determined whether or not a series of operation tasks has been completed. You may go.

As described above, according to the second embodiment, the detection information acquisition unit 101 has at least one of the information detected by the touch panel 200 and the H / W switch 202 and the analysis result of the captured image of the infrared camera 201. Information indicating the proximity or contact of the operator's object detected at one point is acquired as detection information, and the control unit 103 determines the input of the authentication operation from the analysis result of the captured image of the infrared camera 201. Extract at least one of the feature amount of the operator's hand shape, the feature amount of the operator's hand and the arrival direction of the arm, or the feature amount of the operator's face from the detected detection information of the authentication operation Since it comprised so, while being able to reduce the processing load for specifying an operator, the precision at the time of specifying an operator can be improved.

Further, according to the second embodiment, the authentication processing unit 104 acquires a captured image of the operator who is performing the authentication operation from the control unit 103, and extracts the inclination of the central axis of the operator's face from the captured image. Since it comprised so, the precision at the time of specifying an operator can be improved further.

Embodiment 3 FIG.
In the third embodiment, a configuration in which the operator is a passenger other than the driver using a feature amount indicating that the authentication processing unit 104 is a driver will be described.
FIG. 9 is a block diagram showing the configuration of the in-vehicle information processing apparatus 100a according to the third embodiment.
The in-vehicle information processing device 100a includes a driver database 106 and an authentication processing unit 104a instead of the authentication database 105 and the authentication processing unit 104 of the in-vehicle information processing device 100 according to the first embodiment shown in FIG. Yes. In the following, the same or corresponding parts as those of the in-vehicle information processing apparatus 100 according to the first embodiment are denoted by the same reference numerals as those used in the first embodiment, and the description thereof is omitted or simplified. To do.

The driver database 106 stores an authentication pattern that can be identified as the driver's authentication operation, and a feature amount of the driver corresponding to each authentication pattern.
FIG. 10 is a diagram illustrating an example of authentication patterns performed in the driver database 106 of the in-vehicle information processing apparatus 100a according to the third embodiment.
In the example of FIG. 10, the authentication pattern includes a pattern in which the driver in the right-hand drive vehicle performs an authentication operation with the left hand open, and a pattern in which the driver in the left-hand drive vehicle performs the authentication operation with the right hand open. Show. Note that the authentication pattern is not limited to the example shown in FIG. 10 and can be variously applied as long as it is an operation pattern that can be identified as a passenger other than the driver.

The authentication processing unit 104a collates the feature amount extracted by the control unit 103 with the feature amount associated with each authentication pattern stored in the driver database 106, and determines whether or not the operator is a driver. The operator is specified based on the above. Specifically, the authentication processing unit 104a specifies that the operator is a driver when the extracted feature value matches the feature value in the driver database 106. On the other hand, if the extracted feature quantity does not match the feature quantity in the driver database 106, the authentication processing unit 104 specifies that the operator is a passenger other than the driver.

Since the hardware configuration example of the in-vehicle information processing apparatus 100a of the third embodiment is the same as that of the first embodiment, the description thereof is omitted.

Further, in the vehicle-mounted information processing apparatus 100a according to the third embodiment, in step ST14 of the flowchart illustrated in FIG. 5, the authentication processing unit 104a includes the feature amount extracted in step ST13 and each stored in the driver database 106. The operator is identified by collating with the feature amount associated with the authentication pattern. The other processes are the same as those in the flowchart shown in FIG.

As described above, according to the third embodiment, the information for requesting the input of the authentication operation according to the detection information acquired by the detection information acquisition unit 101 and the vehicle information acquired by the vehicle information acquisition unit 102. It is configured to include a control unit 103 that controls output of output or detection information, and an authentication processing unit 104a that collates the input authentication operation with respect to the information that requests input of the output authentication operation. Therefore, it is possible to suppress the processing load for verifying the authentication operation.

Further, according to the third embodiment, the control unit 103 outputs the information requesting the input of the authentication operation when the vehicle is running and the operator who has performed the input operation is not authenticated. Since it is configured to extract the feature amount of the operator from the authentication operation detection information input to the control request and the authentication operation input requested, every time the operator performs the input operation There is no need to perform an authentication process for the operator, and the load of the process for verifying the authentication operation can be suppressed.

In the above-described third embodiment, the driver database 106 and the authentication processing unit 104a are provided in place of the authentication database 105 and the authentication processing unit 104 of the in-vehicle information processing apparatus 100 of the first embodiment. Instead of the authentication database 105 and the authentication processing unit 104 of the in-vehicle information processing apparatus 100 according to the second embodiment, a driver database 106 and an authentication processing unit 104a may be provided.

Further, in the first to third embodiments described above, the case where the feature amount previously associated with each authentication pattern is stored in the authentication database 105 or the driver database 106 is described as an example. The passenger and the passenger may determine the shape of the authentication operation and register the feature amount of the shape in the authentication database 105 or the driver database 106.

In the first to third embodiments described above, passengers include passengers seated in the passenger seat and passengers seated in the rear seat.

In addition to the above, within the scope of the present invention, the present invention can be freely combined with each embodiment, modified any component of each embodiment, or omitted any component in each embodiment. Is possible.

The in-vehicle information processing apparatus according to the present invention does not need to specify the operator every time the operator performs an operation, and thus is applied to an apparatus that determines and controls whether or not to accept an input operation to the in-vehicle apparatus. It is suitable for suppressing the processing load for authenticating the operator.

100, 100a In-vehicle information processing apparatus, 101 Detection information acquisition unit, 102 Vehicle information acquisition unit, 103 Control unit, 104, 104a Authentication processing unit, 105 Authentication database, 106 Driver database, 200 Touch panel, 201 Infrared camera, 202 H / W switch, 300 in-vehicle device, 400 display device, 500 speaker.

Claims

A detection information acquisition unit that acquires detection information indicating that the input operation and authentication operation of the operator have been detected;
A vehicle information acquisition unit for acquiring vehicle information indicating a running state of the vehicle;
According to the detection information acquired by the detection information acquisition unit and the vehicle information acquired by the vehicle information acquisition unit, output of information requesting input of the authentication operation or output of detection information of the input operation A control unit for controlling
An in-vehicle information processing apparatus comprising: an authentication processing unit configured to collate the input authentication operation with respect to the output information requesting input of the authentication operation.
The control unit controls output of information requesting input of the authentication operation when the vehicle is running and the operator who has performed the input operation is not authenticated, and the output The in-vehicle information processing apparatus according to claim 1, wherein the feature amount of the operator is extracted from the detection information of the authentication operation input with respect to information requesting input of the authentication operation.
The authentication processing unit checks the feature amount of the operator extracted by the control unit, and whether the operator is a driver of the vehicle or a passenger other than the driver of the vehicle Identify
When the authentication processing unit identifies the operator as the passenger, the control unit authenticates the operator and controls the detection information of the input operation acquired by the detection information acquisition unit. The in-vehicle information processing apparatus according to claim 2, wherein the information is output as information.
The authentication processing unit checks the feature amount of the operator extracted by the control unit, and whether the operator is a driver of the vehicle or a passenger other than the driver of the vehicle Identify
The control unit does not output the detection information of the input operation acquired by the detection information acquisition unit as control information when the authentication processing unit specifies that the operator is the driver. The in-vehicle information processing apparatus according to claim 2.
The in-vehicle information processing apparatus according to claim 1, wherein the control unit outputs the detection information of the input operation acquired by the detection information acquisition unit as control information when the vehicle is not running.
The detection information acquisition unit acquires information indicating proximity or contact of the operator's object detected by at least one of a touch panel, a touch pad, or a hardware switch as detection information of the input operation,
The control unit extracts a feature amount of the operator from detection information of the authentication operation detected on the touch panel or the touch pad with respect to information requesting input of the authentication operation. The in-vehicle information processing apparatus according to claim 2.
The detection information acquisition unit includes information indicating proximity or contact of the operator's object detected by a touch panel, a touch pad, or a hardware switch, or proximity of the operator's object detected from a captured image of an imaging unit or Obtaining information indicating contact as detection information of the input operation,
The control unit extracts a feature amount of the operator from detection information of the authentication operation detected from a captured image of the imaging unit with respect to information requesting input of the authentication operation. The in-vehicle information processing apparatus according to claim 2.
The in-vehicle information processing apparatus according to claim 6, wherein the control unit extracts a feature amount of the operator's object as the feature amount of the operator.
The control unit, as the feature amount of the operator, the feature amount of the shape of the operator's hand, the feature amount of the shape of the operator's hand and the feature amount of the arrival direction of the arm, or the feature amount of the face of the operator 8. The in-vehicle information processing apparatus according to claim 7, wherein at least one of the feature quantities is extracted.
10. The in-vehicle information processing apparatus according to claim 9, wherein the control unit extracts an inclination of a central axis of the operator's face as the feature amount of the operator.
The control unit is a case where an operator who performs the input operation is authenticated, and the detection information of the input operation is not acquired in a preset period in the detection information acquisition unit, or the detection information acquisition The in-vehicle information processing apparatus according to claim 3, wherein when the input operation detection information is acquired in a plurality of areas, the authenticated operator is set to be unauthenticated.
A step of acquiring detection information indicating that the detection information acquisition unit has detected the input operation and authentication operation of the operator;
A vehicle information acquisition unit acquiring vehicle information indicating a running state of the vehicle;
A control unit controlling output of information requesting input of the authentication operation or output of detection information of the input operation according to the detection information and the vehicle information;
An in-vehicle information processing method comprising: an authentication processing unit performing verification of the input authentication operation with respect to the output information requesting input of the authentication operation.