JP2001143051A - Operation input device, operation input processor and controller - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an operation input device for inputting fingerprint images for collation of fingerprints and input of plural operations, on the premise of collation of fingerprints with small-sized and inexpensive structure. SOLUTION: This operation input device is constituted by providing a finger placing part 5a, where fingers of an operator are placed, an image pickup means (such as lenses 7, 8, 9 and an image pickup unit 10) for picking up the fingerprint images of the fingers placed on the finger placing part and to output data of the fingerprint images and finger placement state detecting means (displacement detection sensor 11 or a processing part 50) to detect a placed state (such as a pressed state, posture of the fingers) and to output a signal responding to the placement state.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an operation input device on the premise of fingerprint collation for ensuring security and the like. The present invention relates to an operation input device capable of inputting with one touch, an operation input processing device including the operation input device, and a control device.

[0002]

2. Description of the Related Art In recent years, a fingerprint matching device that is compact, low-cost, and has high speed and high accuracy has been marketed. In addition, a fingerprint matching device that can handle the inclination of an input fingerprint image (input fingerprint image) has been developed. Proposed. However, the function is only fingerprint collation for personal authentication, and the operation in which the operator places a finger on a predetermined finger rest (ie, fingerprint input operation) is accepted only as a fingerprint image input operation. .

[0003]

For this reason, in a system that requires a simple operation input on the premise that fingerprint matching is the same, operation means that is basically separate from the fingerprint input unit of the fingerprint matching device. (For example, a push switch), and the operator has to operate this separate operation means separately from the fingerprint input operation. In particular, in a system in which a plurality of types of operation inputs are set and different operations are executed according to each operation input, a separate operation means operated by an operator separately from the fingerprint input operation is essential. I mean,
One type of operation input (for example, door unlock command only)
(For example, a door unlocking system with a security function using fingerprint collation), one of the conditions is that the collation results by the fingerprint collation device match (personal authentication is approved). If an operation corresponding to an operation input (for example, output of a control signal for unlocking a door) is performed (that is, if a configuration is also adopted in which a fingerprint input operation is also accepted as an operation for unlocking a door), the operation is not necessarily performed. No separate operating means for input is required.

However, in a system that receives a plurality of operation inputs while identifying and executing corresponding processing operations among various processing operations, when performing fingerprint matching to improve security, fingerprints for fingerprint matching are required. Separate operation means for realizing a plurality of operation inputs separately from the input unit is required. For example, a control system including an operation unit of an ignition key of a vehicle (a control system that sequentially turns on a power supply of an accessory device of a vehicle, a power supply of other than the accessory device, and an engine start in accordance with an operation of an operator) enhances security and the like. To add a personal authentication function by fingerprint matching
Even if the configuration is such that the fingerprint matching is also accepted as the power-on operation of the accessory device, a separate operation for instructing power-on and engine start of at least the non-accessory device separately from the fingerprint input unit for fingerprint verification Means (for example, a conventional cylinder key and a press switch) are required, and the operator (for example, the driver of the vehicle) performs the fingerprint input operation by putting a finger on the fingerprint input unit and performs the separate operation. Means need to be manipulated. Therefore, especially when a personal authentication function by fingerprint collation is added to a system that requires a plurality of operation inputs, conventionally, an increase in cost, an increase in size, and an increase in operation complexity are inevitable.

In the field of automobiles, for example, in order to improve the commercial value, in the near future, there is a high possibility that an operation input involving personal authentication by fingerprint collation will be used for a control system of various devices. By performing personal authentication, the security of the vehicle can be improved by preventing unauthorized persons from unlocking the vehicle door or starting the engine, etc., as well as improving the security of the operation position of the power seat and the operating characteristics of the automatic transmission. This is because it is possible to improve convenience and comfort by performing fine control (that is, control of a customizing function) according to the personality of the driver and the passenger, such as automatic adjustment for each time. Therefore, the present invention has been made in order to solve a new problem obtained by focusing on such technology trends expected in the future of the automobile industry, etc., and presupposes fingerprint matching in order to ensure security and the like. An operation input device, which has a simple and small configuration of an operation input unit, enables fingerprint collation and a plurality of operation inputs with a single touch, and an operation input processing device and a control device including the same. It is intended to provide.

[0006]

SUMMARY OF THE INVENTION An operation input device according to the present invention captures an image of a finger placed on an operator's finger, a fingerprint image of the finger placed on the finger placed, and converts the fingerprint image data. And a finger placement mode detection unit that detects the placement mode of the finger on the finger placement unit and outputs a signal corresponding to the placement mode. Here, the manner of placing the finger includes the method of placing and pushing the finger, the pressing state of the finger with respect to the finger placing portion (the magnitude of the pressing force, the direction of the pressing force), the posture of the finger with respect to the finger placing portion, and the finger placing portion. , The position of the finger to be placed on the finger rest (the manner in which part of the finger is placed), the time or number of times the finger is placed on the finger rest, and the like. According to the present invention, only by performing an operation of placing a finger on the finger placement section in a predetermined placement mode (a specific mode among a plurality of preset modes), a fingerprint image of the finger is captured by the imaging unit. The data is output, and at the same time, the finger placement mode detecting means detects the placement of the finger on the finger placement section, and outputs a signal corresponding to the placement mode. For this reason, if a plurality of finger placement modes are set, input of a fingerprint image and two or more types of operation inputs can be easily performed with one touch in one input unit (that is, a configuration including the finger placement unit). Therefore, as compared with the conventional configuration in which a fingerprint image input unit and an operation input input unit are separately provided, the device configuration is significantly simplified, cost is reduced, and operability and comfort are improved. I do.

Next, according to a preferred aspect of the present invention, the manner of placing the finger is a pressing state of the finger against the finger placing section, and the finger placing section is displaced in accordance with the pressed state. The finger placement mode detecting means is constituted by a displacement detecting means for detecting the presence or absence or the amount of the displacement. With this configuration, a plurality of operation inputs and a fingerprint image can be input by the same operation as a normal operation means such as a push switch or a twist type switch, and the operability is further improved. Note that the manner of displacement of the finger rest is not limited to linear movement, but also includes rotation and swing. Accordingly, the displacement detecting means may be of a type that detects a linear movement, a type that detects a rotation angle, or the like.

As the displacement detecting means, for example, a separate sensor such as a limit switch or a potentiometer described later in the section of the embodiment may be provided, but the following configuration may be adopted. For example, the presence or absence of the displacement or the amount of displacement is detected based on data of the detection mark formed on the finger rest portion and taken by the imaging means together with the fingerprint image, and the data of the detection mark outputted from the imaging means. The displacement detection means may be constituted by the displacement detection processing means. Alternatively, the displacement detection means may be constituted by displacement detection processing means for detecting the presence or absence of the displacement or the amount of displacement based on fingerprint image data output from the imaging means. With this configuration, since a separate sensor as the displacement detecting means is not required, further downsizing and cost reduction of the device can be realized.

In another preferred aspect of the present invention, the position of the finger may be a posture of a finger with respect to the finger rest, a position of a finger in the finger rest, or a position of the finger. This is a position of a finger to be placed, and the finger placement mode detection means comprises a finger placement mode detection processing section for detecting the placement mode based on fingerprint image data output from the imaging section. This configuration also eliminates the need for a separate sensor as the finger placement mode detecting means, so that further miniaturization and cost reduction of the device can be realized.

An operation input processing device according to the present invention includes the above-described operation input device according to the present invention, and compares data of a fingerprint image output from the imaging means with reference data of a fingerprint image registered in advance. If the data match, a collation determination processing unit is provided which performs a process according to a signal output from the finger placement mode detection unit among a plurality of set processes. According to this operation input processing device, a simple and compact one-touch operation of the input unit performs fingerprint collation, and any one of a plurality of set processes is performed on the assumption that the result of the fingerprint collation is the same. Is performed.

Note that the processing here is not limited to the output of a control signal for controlling the operation of devices and systems as described later, but includes various processing and operations in various electric circuits or electronic circuits. For example, opening / closing of a circuit by a relay, switching operation of a transistor, execution of a specific program in a computer system, access to the Internet or the like in a personal computer, input of a reset signal to a computer system or a microcomputer chip, memory, Writing data to the memory, reading data from the memory, erasing data from the memory, transmitting and receiving data and e-mail, and the like are possible. Further, it is needless to say that the collation determination processing means does not necessarily need to be constituted by one processing means (microcomputer or the like), but may be constituted by, for example, two processing means. For example, the collation determination processing means may collate the data of the fingerprint image with the reference data, and may be output from the finger placement mode detection means among a plurality of set processes on condition that these data match. It may be divided into means for performing processing according to signals, and each may be constituted by a separate microcomputer, logic circuit, relay sequence circuit, or the like.

According to another aspect of the present invention, there is provided a control device including the above-described operation input processing device according to the present invention, wherein the control device controls the operation of a plurality of devices or systems. , An output of a control signal for operating or stopping each of the plurality of devices or systems. According to this control device, a simple and compact one-touch operation of the input unit performs the fingerprint collation, and on the assumption that the result of the fingerprint collation is the same, a desired device out of a plurality of devices or systems. Control for operating or stopping the device or system is executed. Another aspect of the control device of the present invention is a control device that includes the operation input processing device of the present invention described above and controls the operation of a plurality of modes of one device or system, wherein the plurality of set processes are performed. Is an output of a control signal instructing execution of each operation mode of the one device or system. According to this control device, the fingerprint is collated by a simple and small one-touch operation of the input unit, and on the premise that the result of the fingerprint collation is the same, a plurality of operation modes of the device or system are included. A desired operation mode is performed. Note that the devices and systems here include all machines, devices, plants, electrical devices, electronic devices, and the like, and those with high needs for operation input on the premise of fingerprint matching (for example, door locking devices in vehicles, Engine control system, personal computer system, etc.)
The present invention is not limited to the above, and naturally includes those in which such needs may arise in the future (for example, an air conditioner system in a vehicle, an audio system, a car navigation system, a toll road automatic payment system, and the like).

[0013]

Embodiments of the present invention will be described below with reference to the drawings. The device of the present embodiment is an operation input processing device having a function of personal authentication based on fingerprint collation and a plurality of operation input functions (a device including a configuration corresponding to the operation input device of the present invention. This is a device that is a control device of the present invention), and roughly includes an input unit and a processing unit. Hereinafter, various embodiments will be sequentially described.

(First Embodiment) First, FIG. 1A shows an input section 1a according to a first embodiment. This input unit 1a
Is a cylindrical fixed case 2 and a cylindrical movable case 3 slidably mounted on the outer periphery of one end of the fixed case 2.
A biasing member 4 attached between the opposing surfaces of the fixed case 2 and the movable case 3; a finger rest plate 5 obliquely fixed so as to cover one end side opening of the movable case 3; A luminous body 6 fixed to the inner circumference at one end side and irradiating light toward the finger placing plate 5; (A first lens 7, a second lens 8, a third lens 9) for converging light reflected by the lens and forming an image, and a light guide through each lens provided on the other end side of the fixed case 2. An imaging unit 10 that receives the emitted light at or near the image forming position and outputs image data.

Here, the movable case 3 is fitted around one end of the fixed case 2 and is slidable in the direction of the central axis of the fixed case 2 (hereinafter referred to as the axial direction). 4 (hereinafter referred to as “pressed state”) by a pressing force (external force) opposing the restoring force of the urging member 4 (hereinafter referred to as “pressed state”). Due to the restoring force, the fixed case 2 is displaced to a state where it is pushed to one end side (the left side in FIG. 1) (hereinafter, referred to as a normal state). In this case, for example, both surfaces of the urging member 4 are adhered to the fixed case 2 and the movable case 3, respectively, so that the fixed case 2 is
The movable case 3 is connected to the movable case 3, and by this operation, the relative position of the movable case 3 in the normal state is maintained at a substantially constant position (hereinafter, referred to as a normal position), and the movable case 3 falls off from the fixed case 2. That has been prevented. Needless to say, such positioning and drop prevention can also be achieved by providing a stopper on the fixed case 2 side that contacts the movable case 3 in the normal position and prevents sliding on one end thereof. . The biasing member 4 is formed by molding an elastic material such as rubber or metal (for example, a spring rope) into a ring shape as a whole in this case, and has a cross-sectional shape such as a thin plate folded in two in this case. It is shaped (U-shaped). However, the biasing member 4 is not limited to such a shape, and may be, for example, a disc spring shape or a coil shape, and returns the movable case 3 in the pressed state to the normal state. Any configuration may be used as long as it can be biased in the direction.

The finger rest plate 5 is made of a transparent or translucent synthetic resin or glass that transmits light.
The outer surface of the finger rest plate 5 is a finger rest part 5a. In this case, the finger rest 5
As shown in FIG. 2B, an elliptical enclosing line 5b indicating an appropriate fingerprint input position is attached to a, and in this case, a marking 5c (a detection mark) is included in the encircling line 5b. ) Is attached. In this case, the marking 5c is a small circular mark painted black, and serves as an index for detecting the pressed state (displaced state) of the movable case 3 (see steps S3, S4, etc. described later). .
The light-emitting body 6 is formed of a light-emitting element such as an LED. For example, the power supply from a power supply circuit (not shown) is turned on / off by a control signal output from a processing unit 50 described later, so that the light-emitting state is increased. Or it becomes a non-light emitting state. The imaging unit 10 includes a large number of light receiving elements such as CCD elements arranged in a matrix, and outputs image data as an aggregate of output values of each light receiving element. In this case, the finger placing plate 5, the light emitter 6, the lenses 7, 8, 9 and the imaging unit 10 constitute an imaging unit of the present invention.

In the input section 1a, when there is an object that is in contact with or is opposed to the finger placing section 5a (with a slight gap) when the light-emitting body 6 is in the light-emitting state, An image in a range including the range located within the line 5b is read by the imaging unit 10, and a signal of the image data is output from the imaging unit 10. If the object is a finger, data of a fingerprint image of the finger is output from the imaging unit 10. Then, when the movable case 3 is in the above-described pressed state, compared with the above-described normal state,
Since the finger rest 5a is displaced so as to be slightly closer to each lens and the imaging unit 10, the image data output from the imaging unit 10 changes accordingly (for example, the size of the entire image is enlarged or reduced). ). The image data of the above-mentioned marking 5c is also output from the imaging unit 10 integrally with the image data of the object. Note that the tip of the finger, which does not include the first joint, is set within the surrounding line 5b of the finger rest part 5a with some margin, and the normal area is within the surrounding line 5b of the finger rest part 5a. When a person's finger (usually on the side opposite to the nail) is placed, the image of the fingerprint at the tip of the finger is read, and the image data (in this case, the image data of the detection mark 5c) is captured by the imaging unit 10. Is output to the processing unit 50 (described later). The input unit 1a and a detection function of the processing unit 50 described later (a function as a displacement detection processing unit that detects a displacement of the movable case 3 from a change in image data) constitute an operation input device of the present invention. ing.

Next, the processing section of this embodiment will be described. FIG.
FIG. 3A is a block diagram schematically illustrating a hardware configuration of a processing unit 50 according to the embodiment. In this case, the processing unit 50
U51, ROM52, RAM53, EEPROM54,
This is a microcomputer system including an input circuit 55 and an output circuit 56. The processing unit 50 operates as described below in accordance with a program registered in the ROM 12, and functions as a displacement detection processing unit and a collation determination processing unit of the present invention. The EEPROM 14 in this case is storage means for storing data (reference data) of a registered image (in this case, a fingerprint image serving as a reference for collation).

Next, the operation of the operation input processing device of this embodiment will be described. The present apparatus has, as operation modes, a normal mode for receiving an operation input involving fingerprint collation, and a registration mode for performing processing for storing data of an inputted fingerprint image as reference data serving as a reference for fingerprint collation. The operation mode can be switched to any one of the operation modes according to a signal input to the processing unit 50 from a switching command unit such as a switch (not shown).

In the registration mode, the CP of the processing unit 50
The U51 first outputs a control signal for causing the light emitter 6 of the input unit 1a to emit light to activate the input unit 5a. When image data is input from the imaging unit 10, the image data is read, and preferably After performing a process of correcting the inclination of the image according to the above, and further performing a feature extraction (creation of feature data) of the image data, the feature data is used as reference data A serving as a reference for fingerprint collation.
Register to 4. Although the details of the feature extraction are not particularly limited, a detailed description thereof will be omitted. For example, the spectra of the image data in the X and Y directions may be obtained and the spectra may be used as the feature data. In this example, since the matching is performed based on the feature data, such feature extraction is necessary. However, the matching may be performed based on the image data itself. This feature extraction is unnecessary. Further, as the correction of the inclination of the image, for example, a method of obtaining the center of gravity and the inclination of the image by a known moment method and performing data conversion (for example, a known affine transformation) for rotating the image by the inclination can be adopted.

In this registration mode, the CPU 51
After registering the reference data A, the reference data A
, The reference data B is created from the data and registered in the EEPROM 54. In the processing of the CPU 51, the reference data A is data of a fingerprint image of a finger simply placed on the finger rest 5a (data when the movable case 3 is in a normal state without displacement), and the reference data B is It is assumed that the data is data of a fingerprint image of a finger placed in a pressed state on the finger placing portion 5a (data when the movable case 3 is displaced and is in a pressed state). Lens 7,
From the optical characteristics determined by the specifications 8 and 9, the reference data B is obtained by a predetermined process.

According to the above-described processing in the registration mode, the regular operator (user) sets the registration mode, and then presses his / her prescribed finger on the finger rest 5a of the input unit 1a in a non-pressed state ( That is, by placing the movable case 3 (without displacing the movable case 3), the data of the fingerprint image of the predetermined finger is first registered as the reference data A, and thereafter, in the processing of the processing unit 50,
Fingerprint image data when the predetermined finger is placed on the finger rest 5a in a pressed state (ie, in a state where the movable case 3 is displaced to the pressed position) is automatically generated and registered as the reference data B. . In addition, such reference data A,
The registration of B is not limited to the processing of the registration mode as described above, and may be registered by another method. For example, even when a predetermined finger is pressed and non-pressed, the registration work is performed by placing the finger on the finger placement unit 5a, and the reference data A and B are registered as each composed of actually captured image data. Good (that is, a mode in which none of the reference data is automatically generated). Alternatively, on the contrary, the reference data B is created from the actually imaged image data by performing the registration work by placing the predetermined finger on the finger rest portion 5a in a pressed state without fail, and the reference data A is converted from the reference data B. It can be automatically generated.

Next, the operation of the processing unit 50 in the normal mode (that is, the operation of the operation input process involving fingerprint collation) will be described with reference to the flowchart of FIG. In the normal mode, the CPU 51 repeatedly executes the following processing at, for example, a predetermined cycle. However, such a series of processing by the CPU 51 is started when a start condition (for example, opening / closing operation of a vehicle door) described later is satisfied, and is repeatedly executed in a predetermined cycle. The configuration may be such that the operation is terminated after a certain period of time has elapsed (the operation is terminated without repeating the processing). First, in step S1, when image data is input from the imaging unit 10 in a state where a control signal or the like for causing the light emitting body 6 of the input unit 5a to emit light and the input unit 5a is operated, the image data is read. The process proceeds to the next step S2. Although illustration is omitted, when there is no input of image data, for example, a series of processing (processing for one cycle) is completed, and the processing is executed again from step S1 in the next cycle. The operation of driving the light emitter 6 and the like to bring the input unit 5a into the operating state (the operation of receiving the input of image data) may be continuously performed in the normal mode. May be established for a predetermined period when the signal input is established. By the way, when the present device is applied as a substitute for an ignition key of a vehicle, in order to eliminate useless power consumption, for example, the above operation is performed for a certain period of time under a start condition that an opening / closing operation of a vehicle door is executed. Can be considered. Then, in step S2, preferably, after performing processing for correcting the inclination of the read image as necessary, feature extraction is performed.

Next, in step S3, a marking image determination is performed. That is, the image data of the marking 5c (detection mark) is separated from the image read in step S1, and the image data A of the marking 5c registered in advance is separated.
Or, compare and collate with B. The image data of the marking 5c is separated because the marking 5c is located at a fixed position.
A position in the image data corresponding to the certain position is registered in advance, and a circular dark area (for example, an area having a brightness equal to or less than a certain threshold value) at that position can be separated. . Also, the image data A of the marking 5c
Is the image data of the marking 5c based on the output of the imaging unit 10 when the movable case 3 is at the normal position, and the image data B of the marking 5c is
Are image data of the marking 5c based on the output of the imaging unit 10 in the pressed state (displaced state). The two are different in the size of the image due to the influence of the displacement of the movable case 3.

Next, in step S4, it is determined whether or not the image data of the marking 5c separated from the image read in step S1 matches the image data A of the marking 5c within an allowable error range. Case 3
Is in the normal state, and the process proceeds to step S5. In step S5, the reference data A registered in the above-described registration mode is read, and in the next step S6, the data extracted in step S2 is compared with the reference data A. The content of the collation determination here is not particularly limited. For example, the minimum cumulative distance (dx, dy) in the X direction and the Y direction is obtained by well-known DP matching, and the discrimination value represented by the following equation is obtained. The determination is made based on whether or not d exceeds a threshold value. d = αdx + (1−α) dy (0 ≦ α ≦ 1) Here, the threshold value is set so that, for example, the rejection rate of another person (the probability that the comparison result with the fingerprint of another person does not match) is 99.9%. And the value of α is preferably set experimentally so as to maximize the matching rate.

If the two data match (for example, if the discrimination value d is equal to or less than the threshold value) in the collation determination in step S6, the next step S7 branches to step S7.
8 and if they do not match (for example, if the discrimination value d exceeds the threshold value), the branching process proceeds to step S14.
Proceed to. In step S8, a collation matching signal (a signal indicating that the fingerprint collation has been matched) is output, and a signal A corresponding to an operation input not to press the movable case 3 is output. On the other hand, step S1
In step 4, a verification mismatch signal (a signal indicating that fingerprint verification does not match) is output. Note that the output of the collation mismatch signal in step S14 is not always necessary (the collation coincidence signal need not be output). Also, the output of the collation matching signal in step S8 or step S13 described later is not necessarily required (the signals A and B are output only when the collation is matched, and therefore also function as the collation matching signal). When the present device is used as a substitute for, for example, an ignition key in a vehicle, for example, a power supply of an accessory device of the vehicle is turned on based on the output of the collation coincidence signal and the signal A. That is, for example, the signal A itself may be directly used as, for example, a control signal for turning on the power of the accessory device of the vehicle (in this case, the processing unit 50 itself forms a power supply control device of the accessory device), or , If there is a separate controller to control the power supply to the vehicle accessory equipment,
The signal A may be used as a power-on command to the control device.

On the other hand, in step S9, it is determined whether or not the image data of the marking 5c separated from the image read in step S1 matches the image data B of the marking 5c within an allowable error range. Step S
The process proceeds to step S10, and if they do not match, the process proceeds to step S15.
Then, in step S10, the reference data B registered in the above-described registration mode is read, and in next step S11,
Similar to step S6, the data extracted in step S2 is compared with the reference data B. If the two data match in the collation determination in step S11, the process proceeds to step S13 in the branch process in the next step S12, and if they do not match, the process proceeds to step S14 in the branch process. In step S13, a collation matching signal is output, and a signal B corresponding to the operation input of pressing the movable case 3 is output. Accordingly, when the present device is used as a substitute for, for example, an ignition key in a vehicle, for example, the engine of the vehicle is started based on the output of the collation coincidence signal and the signal B. Also,
In step S15, the marking 5 in the read image
Since the image data of c does not match both the image data A and B of the pre-registered marking 5c (because a random abnormality has occurred), an error signal indicating the abnormality is output. I do. It is preferable that, for example, a warning lamp or the like is turned on based on the error signal to notify the operator of the occurrence of the error.

According to the processing of the processing unit 50 described above,
The finger is placed on the finger rest part 5a in a non-pressed state and the movable case 3
Is not displaced by more than the allowable error, the image data of the marking 5c in the read image matches the image data A of the previously registered marking 5c, and the process proceeds to step S5 in the branching process of step S4. The collation with the reference data A for fingerprint collation when the movable case 3 is not displaced is performed. If the collation results match, a signal A is output together with the collation match output in step S8. When the movable case 3 is displaced by a predetermined amount or more when the finger is placed on the finger placing portion 5a in a pressed state, the image data of the marking 5c in the read image is replaced with the previously registered marking 5c. Since it matches the image data B, the process proceeds to step S10 in the branch processing of steps S4 and S9, and the reference data B for fingerprint collation when the movable case 3 is displaced.
Is checked, and if the result of the check is a match, a signal B is output together with a match output in step S13. For this reason, input of a fingerprint image and two types of operation inputs can be easily performed by one touch with one input unit 1a. That is, when the operator wants to perform an operation input to output the signal A after receiving the personal authentication (for example, to turn on the power of the accessory device of the vehicle), do not press the finger rest 5a. It is only necessary to place the specified part (fingertip) of the specified finger on the finger rest part 5a (within the surrounding line 5b). When the operator wants to perform an operation input for outputting the signal B after receiving the personal authentication (for example, when starting the engine of the vehicle), the operator specifies the finger rest 5a (within the surrounding line 5b). It is only necessary to push the finger rest part 5a (movable case 3) while placing the specified part (fingertip) of the finger.

The normal operation position of the ignition key in the automobile is to access the accessory (power position) for turning on the accessory device and to turn on other powers including power supply to the ignition plug of the engine. (IG position) and an engine start position (ST position) for temporarily starting the engine by turning the starter motor are set in order (that is, there are three operation positions). In the later normal operation state, the operation position of the ignition key is maintained at the second position. However, in the case of the device including the input unit 1a and the processing unit 50 according to the present embodiment, since there are only two positions, that is, whether the movable case 3 is pushed in, there is a concern whether an operation equivalent to the conventional ignition key is possible. However, this problem can be dealt with, for example, as follows. That is, when the signal B is output while the engine is stopped, the engine is started first, and then, when the output of the signal B is stopped due to the operator's finger being released, the operation state of the engine is maintained and (I.e., the operation corresponding to the second operation position of the conventional ignition key is executed). And then
When the signal B is input again, the engine is stopped, and the power of all devices (except a clock that is constantly supplied with power) is turned off. When the signal A is output in a state where all the devices are turned off, only the power of the accessory device such as the radio is turned on, and then the operator's finger separates to output the signal A. Is stopped, the power-on state of the accessory device is maintained, and when the signal A is input again thereafter, the control process of turning off the power of all the devices including the accessory device is performed, for example, in the present apparatus. The processing may be performed by the processing unit 50 or another controller of the vehicle.

It should be noted that the first embodiment can have various modifications. For example, the configuration is such that the pressed state of the movable case 3 of the input unit 1a is maintained, and the movable case 3 is returned to the original state (the normal state described above) for the first time when the operator performs a release operation by pinching and pulling the movable case 3, for example. In the processing shown in FIG. 3, there may be a configuration in which the signal B continues to be output without such a release operation. In addition, as a configuration in which the movable case 3 is displaced in multiple stages with a click feeling and a stop state is maintained at each displacement location, a configuration in which a larger number of signals are output instead of only two types of signals (ie, 3 A configuration that allows more than one type of operation input is also possible.
Further, the mode of displacement of the movable case 3 is not limited to linear movement, but may be rotation (including swing). For example, a guide wall or the like that guides the posture of the fingertip in an appropriate state by contacting both sides of the fingertip in the fingerrest portion 5a is provided, and when the finger placed on the fingerrest portion 5a is tilted, the rotational force of the fingerrest portion 5a or the movable The movable case 3 may be rotated around the central axis of the fixed case 2 after being transmitted to the case 3, and a signal corresponding to the rotational position may be output by the processing of the processing unit. In this case, for example, if various fingerprint images having different finger inclinations are registered as reference images, the same processing as the processing of FIG. 4 described later is performed to determine the finger inclination (rotational position of the movable case 3). By discriminating the difference in operation input, it becomes possible to output a different signal or the like. Alternatively, the inclination of the input fingerprint image is obtained by, for example, the moment method by the same processing as the processing of FIG. 5 described later, whereby the difference in the operation input due to the inclination of the finger (the rotational position of the movable case 3) is identified and different signals are obtained. May be output.

In the processing of the processing unit 50 shown in FIG. 3, the input fingerprint images of the movable case 3 in the pressed state where the movable case 3 is pushed in the axial direction and the normal state where the movable case 3 is not pushed are used as the input fingerprint images for fingerprint collation. However, the fingerprint matching is performed by comparing only the input fingerprint image in one of the states (for example, only the input fingerprint image in the pressed state) with the corresponding reference data, and performing the other The input fingerprint image (including the image of the marking 5c) in the state is
The processing content may be such that it is used only for determining whether the movable case 3 is in the pressed state or the normal state (that is, for determining whether to output the signal A or the signal B). In this case, since the data of the input fingerprint image used for fingerprint collation is data in a state where the characteristics of the optical system are always constant, it is preferable in performing highly reliable collation. That is, the data of the input fingerprint image (or the reference data corresponding to the input fingerprint image) should be collected in a state where the image is more completely formed at the position of the imaging unit 10. However, in the case of the present apparatus, the position of the finger rest 5a is relatively changed with respect to the lens and other optical systems. (Or normal state), the focus of the input fingerprint image is out of focus, and in the processing contents shown in FIG. 3 described above, there may be a problem in securing high reliability of fingerprint collation and the like. Therefore, when such a problem becomes a problem, as described above, for example, a fingerprint collation (personal authentication) should be performed using only the input fingerprint image in one of the states. The same applies to the processing of FIG. 4 described later.

(Second Embodiment) Next, a second embodiment will be described. This embodiment is characterized in the processing content of the processing unit, and the configuration of the input unit and the hardware configuration of the processing unit are the same as those of the first embodiment. In the following, the same elements as those in the first embodiment are denoted by the same reference numerals, and redundant description will be omitted. The configuration of the input unit of the present embodiment is the same as the input unit 1a of the first embodiment shown in FIG. However, since the pressed state is detected without using the marking 5c as described later, the marking 5c is unnecessary. In this case, the input unit 1a and a detection function of the processing unit 50 described later (function as a displacement detection processing unit that detects a displacement of the movable case 3 from a change in image data).
Also constitutes the operation input device of the present invention. In addition, the processing unit 50 in the present embodiment operates as described later according to a program registered in the ROM 12, and functions as a displacement detection processing unit and a collation determination processing unit of the present invention.

Next, the operation of the operation input processing device of this embodiment will be described. This apparatus also has the above-described normal mode and registration mode as operation modes. In the registration mode, as in the first embodiment, the reference data A
And registering the reference data B in the EEPROM 54. Next, the operation of the processing unit 50 in the normal mode (that is,
The operation of the operation input process involving fingerprint collation) will be described with reference to the flowchart of FIG. In the normal mode, the CPU 51 repeatedly executes the following series of processing at, for example, a predetermined cycle, similarly to the processing of FIG. 3 described above. First, in step S21, when image data is input from the imaging unit 10 in a state where a control signal or the like for causing the light emitting body 6 of the input unit 5a to emit light and the input unit 1a is operated, the above-described steps S1 and S1 are performed. Similarly, the image data is read, and the process proceeds to the next step S22. And step S
In step 22, similarly to step S2 described above, preferably, processing for correcting the inclination of the read image is performed as necessary, and then feature extraction is performed.

Next, in step S23, similarly to steps S5 and S10, the reference data A and B registered in the above-described registration mode are read, and the next step S24
Then, the data extracted in step S22 is compared with the reference data A in the same manner as in step S6. If the data match in the collation determination in step S24, the process proceeds to step S26 in the branching process in the next step S25, and if they do not match, the process proceeds to step S27 in the branching process. Then, in step S26, the output of the collation matching signal and the output of the signal A corresponding to the operation input of not pressing the movable case 3 are performed. Further, when the present device is used as a substitute for an ignition key in a vehicle, for example, the accessory device of the vehicle is turned on based on the output of the above-mentioned collation matching signal and the signal A as in the first embodiment. Done. On the other hand, in step S27, the data extracted in step S22 and the reference data B are collated as in step S11 described above. If the data match in the collation determination in step S27, the flow branches to step S29 in the next branching process in step S28.
If it is determined that there is no match, the same branch processing is performed in step S30.
Proceed to. Then, in step S29, a collation matching signal is output, and a signal B corresponding to the operation input of pressing the movable case 3 is output. Accordingly, when the present device is used as a substitute for an ignition key in a vehicle, for example, the engine of the vehicle is started based on the output of the matching match signal and the signal B as in the first embodiment. . On the other hand, in step S30,
Outputs the verification mismatch signal. This step S3
The output of the non-verification signal of 0 or the verification coincidence signal of steps S26 and S29 is not always necessary, as in the processing of FIG. 3 (the same applies to the processing of FIGS. 5 and 6 described later).

According to the processing of the processing unit 50 described above,
If the movable case 3 is not displaced more than the allowable error when a proper finger is placed on the finger rest 5a in a non-pressed state, the read image data matches the reference data A registered in advance. Step S2 in the branch processing of step S25
Proceeding to 6, the signal A is output together with the matching output.
Also, if the movable case 3 is displaced by a predetermined amount or more when an appropriate finger is placed on the finger placing portion 5a in a pressed state, the read image data matches the reference data B registered in advance. Step S2 in the branching process of Step S28
Proceeding to 9, the signal B is output together with the matching output.
Therefore, also in the case of the present embodiment, the input of the fingerprint image and the two types of operation inputs can be easily performed by one touch with one input unit 1a.

(Third Embodiment) Next, a third embodiment will be described. This embodiment is characterized by the configuration of the input unit and the processing content of the processing unit, and the hardware configuration of the processing unit is the same as that of the first embodiment. FIG. 1B shows an input unit 1b according to the third embodiment.
It is. The input unit 1b does not include a movable case or an urging member, and all elements are attached to an integral fixed case 2b, and the finger placement unit 5a is also not displaceable. The input unit 1a and a detection function of a processing unit 50 described later (a function as a finger placement mode detection processing unit that detects a posture of a finger placed on the finger placement unit 5a from image data) are provided by the operation of the present invention. Configure the input device. In addition, the processing unit 50 according to the present embodiment operates as described later according to a program registered in the ROM 12, and functions as a finger placement mode detection processing unit and a collation determination processing unit of the present invention.

Next, the operation of the operation input processing device of this embodiment will be described. This device also operates in the first mode.
As in the embodiment, it has a normal mode and a registration mode. In the registration mode, the CPU 51 of the processing unit 50
However, when there is an input of image data from the imaging unit 10 in a state in which the input unit 1b is operated by outputting a control signal or the like for causing the light emitter 6 of the input unit 1b to emit light, the image data is read, and Performs a process of correcting the inclination of the image as necessary, and further performs a feature extraction (creation of feature data) of the image data. Then, similar to the first embodiment, the feature data is used as a reference for fingerprint matching. Is registered in the EEPROM 54 as reference data A.

Next, the operation of the processing unit 50 in the normal mode (that is, the operation of the operation input process involving fingerprint collation) will be described with reference to the flowchart of FIG. In the normal mode, the CPU 51 repeatedly executes the following processing at a predetermined cycle, for example, similarly to the processing of FIG. First, in step S41, in a state where a control signal or the like for causing the light emitting body 6 of the input unit 1b to emit light and the input unit 1b is operated,
When the image data is input from the image pickup unit 10, the image data is read as in step S1, and the process proceeds to the next step S42. And step S42
Then, feature extraction is performed from the image data (image data without tilt correction) read in step S41. Next, in step S43, the reference data A registered in the above-described registration mode is read, and the data extracted in step S42 is compared with the reference data A.

If the two data match in the collation determination in step S43, the flow advances to step S45 in the branch processing in the next step S44, and if they do not match, the flow advances to step S46 in the same branch processing. In step S45, a collation matching signal is output, and a signal A corresponding to the operation input of placing the finger straight on the finger placing unit 5a is output. When the present device is used in place of, for example, a switch device for an air conditioner in a vehicle, for example, the air conditioner of the vehicle is suitable for the operator who has been personally authenticated based on the output of the matching signal and the signal A. The operation is started with characteristics (for example, those registered in advance).

On the other hand, in step S46, step S4
The data of the input fingerprint image read in step 1 is binarized.
The binarization is performed, for example, by applying data of an input fingerprint image to a Gaussian filter known in image processing technology. Next, in step S47, based on the image data binarized in step S46, the barycentric coordinates (X _G ,
Y _G ) and the inclination θ of the input fingerprint image are calculated by the moment method known in image processing technology.

Next, in step S48, step S4
It is determined whether or not the inclination θ obtained in step 7 is within a preset allowable range. If it is within the allowable range, the process proceeds to step S49, and if not, the process proceeds to step S57. Then, in a step S57, an error signal is output. Note that a warning (voice, character, or symbol display, etc.) indicating that the input state of the input fingerprint image is inappropriate (the angle of the finger placed on the finger placement unit 5a is excessive) is generated by this error signal.
Warning means not shown (speaker, display, etc.)
It is preferable that the output is performed via the. On the other hand, in step S49, the input fingerprint image is rotated by the well-known affine transformation around the barycentric coordinates (X _G , Y _G ) obtained in step S47 so as to cancel the inclination by the inclination θ (the rotation corrected image). ) Create the data.

Next, in step S50, step S49 is executed.
The above-described feature extraction (creation of feature data) is performed based on the rotation-corrected image data created in step S5, and the next step S5
In step 1, the feature data is compared with the reference data A registered in the above-described registration mode. Then, Step S51
If the two data match in the collation determination of step S5, the next step S5
The process proceeds to step S53 in the branching process 2 and, if not, the process proceeds to step S58 in the branching process. Next, in a step S53, it is determined whether or not the inclination θ obtained in the step S47 is larger than a predetermined value θ1, and if it is larger, a step S5 is performed.
The process proceeds to step S4, and if it is equal to or smaller than the predetermined value θ1, the process proceeds to step S55. Then, in step S54, the output of the collation coincidence signal and the output of the signal B are performed. Here, the signal B is, for example, as shown in FIG.
As shown in (c), this is a signal corresponding to an operation input of placing the finger Y on the finger placing portion 5a at an angle equal to or more than the predetermined value θ1. When the present device is used as a substitute for a switch device for an air conditioner in a vehicle, for example, characteristics (for example, characteristics suitable for the operator who has been personally authenticated) based on the output of the matching match signal and the signal B (for example, , The power of the air conditioner of the vehicle is increased.

On the other hand, in step S55, step S47
It is determined whether or not the inclination θ obtained in is smaller than the predetermined value −θ1, and if it is smaller, the process proceeds to step S54, and if not, the process proceeds to step S45. Then, in step S56, the output of the collation matching signal and the output of the signal C are performed. Here, the signal C is a signal corresponding to, for example, an operation input to place the finger Y at the finger rest part 5a at an inclination of the predetermined value −θ1 or more as shown in FIG. 2D. In the case where the present device is used as a substitute for a switch device for an air conditioner in a vehicle, for example, characteristics suitable for the operator who has been personally authenticated (for example, , The power of the air conditioner of the vehicle is reduced. On the other hand, step S
At 58, a collation mismatch signal is output as in step S14 described above.

According to the processing of the processing unit 50 described above,
When an appropriate finger is placed straight on the finger placing portion 5a, the read fingerprint image data matches the reference data A registered in advance, and the process proceeds to step S45 in the branching process of step S44 to perform verification. The signal A is output together with the coincidence output. In addition, even when an appropriate finger is placed in a state where the finger is slightly inclined to the finger placing portion 5a (in a state where the value is equal to or less than the predetermined value θ1 and equal to or more than −θ1), the process proceeds to step S45 via the branching process in step S53 or S55. As the process proceeds, the signal A is output together with the matching match output. And
For example, as shown in FIG. 2C, in a state in which the finger rest 5a is tilted beyond the predetermined value θ1 (but within an allowable range).
When an appropriate finger is placed, the read fingerprint image data matches the fingerprint image data after the rotation correction (after the tilt correction), and the tilt θ obtained in step S47 becomes larger than the default value θ1. The process proceeds to step S54 in the branch processing of steps S52 and S53, and the signal B is output together with the collation match output. Also, for example, as shown in FIG. 2D, when a proper finger is placed on the finger placing portion 5a in a state in which the finger is tilted in the opposite direction beyond the predetermined value -θ1 (with a tilt within an allowable range). Indicates that the read fingerprint image data matches the fingerprint image data after the rotation correction (after the tilt correction), and the tilt θ obtained at step S47 becomes smaller than the predetermined value −θ1, so that the steps S52, S53, and S55 are branched. In the processing, the process proceeds to step S56, and the signal C is output together with the collation match output.

Therefore, input of a fingerprint image and three types of operation inputs can be easily performed with one touch by one input unit 1b. In other words, when the operator wants to perform an operation input to output the signal A after receiving personal authentication (for example, to start the air conditioner of the vehicle), the operator specifies the finger rest part 5a (in the surrounding line 5b). It is only necessary to place the specified part (fingertip) of the finger almost straight. In addition, when the operator wants to perform an operation input to output the signal B after receiving personal authentication (for example, to increase the power of the air conditioner of the vehicle), the finger rest 5a (in the surrounding line 5b). It is only necessary to tilt the specified portion (fingertip) of the specified finger at a predetermined angle or more as shown in FIG. Further, after the operator has received personal authentication, the signal C
Is desired (for example, when the power of the air conditioner of the vehicle is to be reduced), the specified portion (fingertip) of the specified finger is placed on the finger rest 5a (within the surrounding line 5b).
Need only be tilted in a reverse direction or more than a predetermined value as shown in FIG.

It should be noted that the third embodiment can be modified in various ways. For example, a plurality of regions where the finger is to be placed (regions such as the above-described encircling line 5b) are formed in the finger placing portion 5a, and in the processing of the processing unit, the region where the finger is placed is determined.
For example, the judgment is made by comparing the reference data registered in advance for each area with the read image data, and the finger is placed on the premise that the comparison result with any of the reference data matches. There may be a configuration in which different signals are output according to the position of the area. In addition, a normal fingerprint image is an image of a belly portion of a fingertip (a portion directly behind a nail). For example, fingerprint images at different positions of a finger such as a side portion of a fingertip are registered as various reference data. By performing a process of determining which reference data matches, the fingerprint matching is performed while identifying the fingerprint image of which part of the finger has been input, and a different signal corresponding to the difference in the imaging position of the finger is obtained. There may be a configuration for outputting. Further, in the present embodiment, when the inclination of the input fingerprint image exceeds the allowable range in the process of step S48, an error is output and the collation determination after the rotation correction is not performed. May be provided, and the collation determination after rotation correction is always performed regardless of the magnitude of the inclination of the input fingerprint image.

(Fourth Embodiment) Next, a fourth embodiment will be described. This embodiment is characterized by the configuration of the input unit and the processing content of the processing unit, and the hardware configuration of the processing unit is the same as that of the first embodiment. FIG. 1C shows the input unit 1c of the present embodiment. The input unit 1c includes a movable case 3c and a biasing member 4 like the input unit 1a of the first embodiment, and includes a finger rest 5
The finger placing portion 5a is displaced by the pressing force of the finger placed on a. In this case, the movable case 3c is fitted on the inner peripheral side of the fixed case 2c and is slidable.
When the movable case 3a and the movable case 3c are pushed in and displaced by a predetermined amount or more, a displacement detection sensor 11 for detecting this displaced state (in this case, the presence or absence of a displacement exceeding the predetermined amount) is provided.
The displacement detection sensor 11 is, for example, a limit switch that switches the state (ON or OFF) of an internal contact when the contact comes into contact with an end face of the movable case 3c pushed in by a predetermined amount or more. A magnetic sensor (so-called reed switch) that detects the approach of the pushed end of the movable case 3c as a change in the magnetic field in a non-contact manner, or a light emitting element and a light receiving element is provided, and light transmission and reception between these elements is defined. An optical sensor (a so-called photo-interrupter) in which the output signal of the light receiving element is switched by being cut off at the end of the movable case 3c that has been pushed in by an amount or more can be used. In the case of the input unit 1c, the light emitter 6, the lenses 7, 8, 9 and the imaging unit 10 (i.e., a set of imaging means) are fixed to the movable case 3c (mainly inside the movable case 3c), and these elements are also included. It is configured to be displaced integrally with the finger rest 5a and the movable case 3c. In other words, the positional relationship of the optical system elements constituting the imaging means is configured to maintain a constant positional relationship irrespective of the pressing state (displacement state) of the finger placed on the finger placing portion 5a due to the pressing force. The image data does not change due to the pressed state as in the input unit 1a of the embodiment. Since the input unit 1c has the built-in displacement detection sensor 11 corresponding to the displacement detection means of the present invention, the input unit 1c independently constitutes the operation input device of the present invention. In this case, the processing unit 5
0 operates as described later in accordance with the program registered in the ROM 12 and functions as the collation determination processing means of the present invention.

Next, the operation of the operation input processing device of this embodiment will be described. This apparatus also has the above-described normal mode and registration mode as operation modes. In the registration mode, as in the first embodiment, the reference data A
Is registered in the EEPROM 54. Next, the operation of the processing unit 50 in the normal mode (that is, the operation of the operation input process involving fingerprint collation) will be described with reference to the flowchart of FIG. This flowchart differs from the flowchart of the first embodiment (FIG. 3) only in part (steps S3a, S4a, S10a) (however, there are no steps S9 and S15 in FIG. 3). The same steps are denoted by the same step numbers, and redundant description will be omitted. The processing in FIG. 6 is different from the processing in FIG. 3 in that the displacement state of the movable case 3c is determined based on the detection signal of the displacement detection sensor 11 first.

That is, after the fingerprint image input in step S1 and the feature extraction in step S2 are executed, step S3a
Then, the detection signal of the displacement detection sensor 11 is read to determine whether or not the movable case 3c is displaced by a predetermined amount or more.
Next, in step S4a, as a result of the determination, if there is a displacement equal to or more than the specified amount, the process proceeds to step S10a, and if there is no such displacement, the process proceeds to step S5. When the process proceeds to step S5, the subsequent processes (steps S5 to S5)
In S8), the collation based on the reference data A is performed in the same manner as in the above-described first embodiment, and when they match, it corresponds to the output of the collation coincidence signal and the operation input not to press the movable case 3c. The signal A is output. On the other hand, if the collation results do not match, a collation mismatch signal is output in step S14. When the process proceeds to step S10a, in the subsequent processes (steps S10a to S13), collation based on the reference data A (not the reference data B because the positional relationship of the optical system does not change) is performed. The output of the coincidence signal and the output of the signal B corresponding to the operation input of pushing the movable case 3c in the axial direction are performed.

According to the processing of the processing unit 50 described above,
Similar to the first embodiment (the processing of FIG. 3), when the finger is placed on the finger placing portion 5a in a non-pressed state and the movable case 3c is not displaced more than the allowable error, the collation with the reference data A is performed. If the result is a match, the signal A is output together with the matching match output. When the movable case 3c is displaced by a predetermined amount or more when the finger is placed on the finger placing portion 5a in a pressed state, if the matching result with the reference data A matches, the matching match output and the signal B are output. Is output. For this reason, the input of the fingerprint image and the two kinds of operation inputs can be easily performed by one touch with one input unit 1c.

It should be noted that the fourth embodiment can be modified in various ways. For example, the configuration is such that the pressed state of the movable case 3 of the input unit 1a is maintained, and the movable case 3 is returned to the original state (the normal state described above) for the first time when the operator performs a release operation by pinching and pulling the movable case 3, for example. In the processing shown in FIG. 6, there may be a configuration in which the signal B continues to be output without such a release operation. The movable case 3c
Is displaced in multiple stages with a click feeling, the stopped state is maintained at each displacement point, and the displacement state of each displacement point is detected by the built-in displacement detection means, respectively,
A configuration in which a large number of signals are output instead of only two types of signals (that is, a configuration in which three or more types of operation inputs are possible)
It can also be. Further, the mode of displacement of the movable case 3c is not limited to linear movement, but may be rotation (including swing). For example, a guide wall or the like that guides the posture of the fingertip in an appropriate state by contacting both sides of the fingertip in the fingerrest portion 5a is provided, and when the finger placed on the fingerrest portion 5a is tilted, the rotational force of the fingerrest portion 5a or the movable Movable case 3 transmitted to case 3c
c may be rotated around the central axis of the fixed case 2 and a signal corresponding to the rotational position may be output by a built-in displacement detecting means (a device for detecting a rotational angle; for example, a potentiometer). Further, there may be a mode in which a displacement detecting means (for example, a potentiometer) for continuously detecting the displacement amount of the movable case 3c is provided, and the signal is continuously changed according to the displacement amount.

[0052]

According to the present invention, just by performing an operation of placing a finger on the finger placing section in a predetermined placing mode, a fingerprint image of the finger is captured by the image capturing means, and the data is output. The placement mode of the finger on the finger placement unit is detected by the placement mode detection unit, and a signal corresponding to the placement mode is output. For this reason, if a plurality of finger placement modes are set, input of a fingerprint image and two or more types of operation inputs can be easily performed with one touch in one input unit (that is, a configuration including the finger placement unit). Therefore, as compared with the conventional configuration in which a fingerprint image input unit and an operation input input unit are separately provided, the device configuration is significantly simplified, cost is reduced, and operability and comfort are improved. I do.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating a configuration of an input unit of an operation input processing device.

FIG. 2 is a diagram illustrating a configuration and the like of a processing unit of the operation input processing device.

FIG. 3 is a flowchart illustrating an operation of a processing unit of the operation input processing device.

FIG. 4 is a flowchart illustrating an operation of a processing unit of the operation input processing device.

FIG. 5 is a flowchart illustrating an operation of a processing unit of the operation input processing device.

FIG. 6 is a flowchart illustrating an operation of a processing unit of the operation input processing device.

[Explanation of symbols]

1a, 1b, 1c Input unit (operation input device) 11 Displacement detection sensor (displacement detection unit) 50 Processing unit (finger placement mode detection processing unit, displacement detection processing unit, collation determination processing unit)

Claims (8)

[Claims] 1. A finger rest for placing an operator's finger, an image pickup means for picking up a fingerprint image of a finger placed on the finger rest and outputting data of the fingerprint image, An operation input device comprising: a finger placement mode detection unit that detects a placement mode of a finger and outputs a signal corresponding to the placement mode. 2. The finger placement mode is a state in which the finger is pressed against the finger placement unit, and the finger placement unit is configured to be displaced in accordance with the pressed state. The operation input device according to claim 1, wherein the finger placement mode detecting means is configured by the displacement detecting means for detecting. 3. The apparatus according to claim 2, wherein the displacement detection unit is configured to detect the detection mark formed on the finger placement unit and captured by the imaging unit together with the fingerprint image based on data of the detection mark output from the imaging unit. 3. The operation input device according to claim 2, further comprising a displacement detection processing unit that detects the presence or absence or the displacement amount of the displacement. 4. The apparatus according to claim 2, wherein said displacement detection means comprises displacement detection processing means for detecting the presence or absence of said displacement or the amount of displacement based on fingerprint image data output from said imaging means. Operation input device. 5. The finger placement mode detection, wherein the finger placement mode is a posture of a finger with respect to the finger placement section, a position of a finger placed on the finger placement section, or a position of a finger placed on the finger placement section. 2. The operation input device according to claim 1, wherein the means comprises finger placement mode detection processing means for detecting the placement mode based on fingerprint image data output from the imaging section. 6. An operation input device according to any one of claims 1 to 5, wherein the data of the fingerprint image output from the imaging means is collated with reference data of a fingerprint image registered in advance. The operation input processing device, further comprising: a collation determination processing unit that performs a process according to a signal output from the finger placement mode detection unit among a plurality of set processes when the IDs match. 7. A control device comprising the operation input processing device according to claim 6, and controlling operation of a plurality of devices or systems, wherein the plurality of set processes execute each of the plurality of devices or systems. A control device, which is an output of a control signal for starting or stopping. 8. A control system comprising the operation input processing device according to claim 6, and controlling operation of a plurality of modes of one device or system, wherein the plurality of set processes are performed by the one device or system. A control signal for instructing execution of each of the operation modes.