JP2001034767A - Dynamic image processing method, dynamic image processor, medium and user authentication system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To stably track the arbitrary motion of an object in arbitrary shape by selecting a reference point to be defined as a tracing object between the adjacent image frames of the object among points on the contour line of the object by using information obtained from the contour line. SOLUTION: As processing (S1) to the first image frame, first of all, the contour line of the object is extracted from the first image frame and a normal direction at each of points on the contour line is calculated from nearby contour lines (S11). Next, the reference point is selected among the points on the contour line while considering the normal direction (S12). Next, as tracking processing (S2) to the selected reference point, an intersection of the normal of the reference point in the object before movement and the contour line of the object after movement is defined as a temporary corresponding point (S21). Then, a polynomial with the position of the corresponding point capable of the motion of the object on the image frame as a variable is used and the coefficient of the polynomial is found while using the coordinate of the temporary corresponding point (S22). The coefficient of the polynomial is used to track the position, to which the reference point moves.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

TECHNICAL FIELD The present invention relates to a moving image processing method,
The present invention relates to a moving image processing apparatus, a medium, and a user authentication system, and more particularly, to a technique of tracking a subject in a time-series image and extracting a movement thereof.

[0002]

2. Description of the Related Art As a technique for tracking a subject from a time-series image and extracting its movement, an image pattern similar to the image pattern of the subject is identified from adjacent image frames by correlation matching, and the movement is regarded as the movement of the subject. There is a technique for extraction (JP-A-5-197809).

However, this technique has a problem that when the rotation or size of the subject changes, the image pattern appearing in the image frame changes, so that matching cannot be performed properly and tracking processing cannot be performed.

Further, as another technique, a technique of tracking a contour of a subject using an energy minimizing method and extracting a motion of the subject from the obtained contour (Japanese Patent Laid-Open Nos. 5-12443 and 8 -263666).

[0005] These techniques can cope with the rotation and size change of the subject, but when solving the energy minimization problem,
Since the outline in the previous image frame is used as the initial value,
The problem that large movements in which the area occupied by the subject does not overlap between adjacent image frames cannot be handled cannot be solved.

Further, as another technique, there is a technique of setting a reference point in an area where an object is present on an initial screen and tracking this between adjacent image frames (STBarna).
rd, et al.:"Disparity Analysis of Images ", IEEE Tra
nsactions on Pattern Analysis and Machine Intellig
ence ", Vol.PAMI-2, No.4, July 1980). According to this technique, reference points are tracked at individual reference points by correlation matching using an image pattern of a small area around the reference points. A corresponding point candidate is determined, and a corresponding point is determined from the candidates in consideration of the overall consistency, since the tracking is performed using the local feature of the subject, so that the rotation and the size of the subject can be changed. can do.

[0007] In addition, large movements in which the area occupied by the subject does not overlap between adjacent image frames can be tracked.

On the other hand, the conventional technology is applied to a specific device, for example,
Even when applied to an authentication system when using a car, it is necessary to use a key or the like with a magnetic sensor attached.

[0009]

However, in the prior art for tracking a subject based on the correspondence between reference points between adjacent image frames as described above, a major problem is how to determine the reference point. Becomes

Many prior art techniques use points having distinct features, such as corners, as reference points. By using such a reference point, for example, a point corresponding to the reference point in an adjacent image frame can be obtained using an image pattern in a small area around the reference point.

As described above, a point having a distinctive feature such as a corner is effective as a reference point, but the number is limited. Therefore, the upper limit of the number of reference points is determined by the shape of the subject.

Therefore, the reference point may be lost from the image due to occlusion or the like, and tracking may not be performed.

[0013] Furthermore, it is not possible to cope with an object which is constituted by a free curve and does not have a point having a distinct feature such as a corner, so that the shape of the object is restricted.

SUMMARY OF THE INVENTION Accordingly, the present invention has been made in view of the above-mentioned problems, and has a novel moving image processing method, a moving image processing apparatus, a medium, and a user authentication system for stably tracking an arbitrary movement of a subject having an arbitrary shape. The purpose is to provide.

Furthermore, when a specific device (for example, an automobile) is used, a moving image which can be applied to user authentication by calculating a movement information by drawing a figure in a space with a finger or the like and calculating its motion information. An object of the present invention is to provide a processing method, a moving image processing device and a medium, and a user authentication system.

[0016]

According to a first aspect of the present invention, there is provided a moving image processing method, comprising:
In the moving image processing method for extracting the motion, a reference point used as a tracking target between adjacent image frames of the subject captured by the imaging unit is determined from a point on the contour using information obtained from the contour of the subject. It is characterized by selecting.

According to a second aspect of the present invention, there is provided a moving image processing method comprising:
2. The moving image processing method according to claim 1, wherein information on a normal direction of the contour of the subject is used as the information obtained from the contour of the subject.

According to a third aspect of the present invention, there is provided a moving image processing method comprising:
3. The moving image processing method according to claim 2, wherein the reference point is selected such that the normal direction of the reference point includes at least two normal directions having an angle difference of about 90 degrees.

According to a fourth aspect of the present invention, there is provided a moving image processing method comprising:
2. The moving image processing method according to claim 1, wherein a tentative corresponding point corresponding to the reference point is obtained using information obtained from the outline, and the motion of the subject can be expressed on the image frame of the corresponding point. The reference point is tracked by using a polynomial having a position as a variable and obtaining a coefficient of the polynomial using coordinates of the provisional corresponding point.

According to a fifth aspect of the present invention, there is provided a moving image processing method comprising:
5. The moving image processing method according to claim 4, wherein a normal direction of the outline is used as information obtained from the outline.

According to a sixth aspect of the present invention, there is provided a moving image processing method comprising:
The moving image processing method according to claim 4, wherein a polynomial expressing an affine transformation is used as the polynomial.

According to a seventh aspect of the present invention, there is provided a moving image processing method comprising:
7. The moving image processing method according to claim 1, wherein a user is authenticated when using a specific device in accordance with motion information of a subject obtained from a plurality of frames that are different in time series. And

The moving image processing method according to the eighth aspect of the present invention
8. The moving image processing method according to claim 7, wherein the user inputs exercise information from exercise information input means when using the specific device, and exercises the exercise information and a previously input initial registration pattern. The comparison is performed by the information comparing unit, and when it is determined that the exercise information is different from the initial registration pattern, the use permission control unit transmits a signal to disallow use of the specific device to the specific device. It is characterized by.

According to a ninth aspect of the present invention, there is provided a moving image processing apparatus comprising:
In a moving image processing apparatus for tracking a subject in a time-series image and extracting the movement, a reference point used as a tracking target between adjacent image frames of the subject captured by an imaging unit is obtained from an outline of the subject. Is used to select from the points on the contour line.

According to a tenth aspect of the present invention, in the moving image processing apparatus according to the ninth aspect, the information obtained from the contour of the subject is information on a normal direction of the contour of the subject. Is used.

According to an eleventh aspect of the present invention, in the moving image processing apparatus according to the tenth aspect, the normal direction of the reference point is at least two directions having an angle difference of about 90 degrees. It is characterized in that reference points are selected so as to be in a line direction.

According to a twelfth aspect of the present invention, in the moving image processing apparatus according to the ninth aspect, a temporary corresponding point corresponding to the reference point is obtained by using information obtained from the outline. Using a polynomial with the position of the corresponding point on the image frame as a variable, which can express the movement of the subject,
The reference point is tracked by obtaining a coefficient of a polynomial using the coordinates of the provisional corresponding point.

According to a thirteenth aspect of the present invention, in the moving image processing apparatus according to the twelfth aspect, a normal direction of the outline is used as information obtained from the outline. I do.

According to a fourteenth aspect of the present invention, in the moving image processing apparatus according to the twelfth aspect, a polynomial expressing an affine transformation is used as the polynomial.

According to a fifteenth aspect of the present invention, in the moving image processing apparatus according to any one of the ninth to fourteenth aspects, the moving image processing apparatus specifies the moving image processing apparatus according to motion information of a subject obtained from a plurality of frames different in time series. The authentication of the user when operating the device is performed.

According to a sixteenth aspect of the present invention, in the moving image processing apparatus according to the fifteenth aspect, the user inputs motion information from motion information input means when using the specific device. When the exercise information is compared with the initial registration pattern input in advance by the exercise information comparison unit, and when it is determined that the exercise information is different from the initial registration pattern, the use permission control unit A signal for denying use is transmitted to the specific device.

A medium according to a seventeenth aspect of the present invention is a medium readable by information processing means for recording a program for tracking a subject in a time-series image and extracting a motion thereof, wherein the program is information processing means The processing procedure for selecting at least a reference point to be used as a tracking target between adjacent image frames of a subject captured by the imaging means from points on the contour using information obtained from the contour of the subject is stored. It is characterized by doing.

The invention according to claim 18 is the invention according to claim 1.
7. The medium according to 7, wherein information on a normal direction of the contour of the subject is used as the information obtained from the contour of the subject.

The invention according to claim 19 is the invention according to claim 1.
8. The medium according to 8, wherein the reference point is selected such that the normal direction of the reference point includes at least two normal directions having an angle difference of about 90 degrees.

The invention according to claim 20 is the invention according to claim 1.
7. In the medium according to 7, a temporary corresponding point corresponding to the reference point is obtained by using information obtained from the contour line, and a position of the corresponding point on the image frame at which the movement of the subject can be expressed is used as a variable. The tracking of the reference point is performed by using a polynomial and calculating a coefficient of the polynomial using the coordinates of the provisional corresponding point.

The invention according to claim 21 is the invention according to claim 2.
0, wherein a normal direction of the contour is used as information obtained from the contour.

The invention according to claim 22 is the invention according to claim 2
0, wherein a polynomial expressing an affine transformation is used as the polynomial.

The invention according to claim 23 is the invention according to claim 1.
23. The medium according to any one of 7 to 22, wherein authentication of a user when operating a specific device is performed according to subject motion information obtained from a plurality of frames different in time series.

The invention according to claim 24 is the invention according to claim 2
3. In the medium according to 3, the user inputs exercise information from exercise information input means when using the specific device,
The exercise information is compared with the initial registration pattern input in advance by the exercise information comparison unit, and when it is determined that the exercise information is different from the initial registration pattern, the usage permission control unit uses the specific device. Is transmitted to the specific device.

According to a twenty-fifth aspect of the present invention, in the user authentication system according to the sixteenth aspect, the moving image processing apparatus and the specific device are connected via a network. At the time of use, the exercise information is input from the exercise information input means, and the exercise information is compared with the previously registered initial registration pattern by the exercise information comparison means, and it is determined that the exercise information is different from the initial registration pattern. In this case, the use permission control unit transmits a signal for disallowing use of the specific device to the specific device, authenticates a user when operating the specific device, and prevents unauthorized use or theft. When it is determined that there is suspicion, the server notifies the server that processes information for management and security via a network.

According to a twenty-sixth aspect of the present invention, in the user authentication system according to the twenty-fifth aspect, the user authentication device of the specific device includes an initial registration pattern including initial exercise information; By comparing the motion information of the subject input when using the device, the user who operates the specific device is authenticated.As a result of the comparison, if it is determined that the device is illegally used,
The use of the specific device is not permitted, and if it is determined that the use is not unauthorized, the use of the specific device is permitted.

[0042] According to a twenty-seventh aspect of the present invention, in the user authentication system according to the twenty-sixth aspect, the user authentication device for the specific device comprises: Exercise information input means for inputting the specific equipment, use permission control means for permitting or disallowing the use of the specific device, and exercise information input by a user when using the specific device and initial information input in advance. Exercise information comparing means for comparing the registered pattern,
Transmitting means for transmitting radio waves when the use of the specific device is prohibited by the use permission control means, and the user authentication device is connected to a server via a network, Comprises a receiving means for receiving a radio wave transmitted from the transmitting means, and when the user uses the specific device, inputs exercise information from the exercise information input means, and the exercise information and the exercise information storage means The exercise information comparing means compares the initial registration pattern set and registered in the exercise information comparison means. If the exercise information is different from the initial registration pattern set and registered in the exercise information storage means, the use permission control means A use-disapproval signal is transmitted to the device, and the receiving means on the server side receives the radio wave transmitted from the transmitting means and receives the signal of the specific device. And acquiring the information.

According to a twenty-eighth aspect of the present invention, in the user authentication system according to the twenty-seventh aspect, the use permission control means controls the specific device with respect to the specific device.
After transmitting the use-disapproval signal, the user authentication device transmits, to the server, an abnormal signal that intends to illegally use the specific device, and the server receives the signal, whereby the server side Wherein the receiving means starts receiving radio waves transmitted from the transmitting means.

[0044]

Next, a preferred embodiment of the present invention will be described with reference to the drawings.

FIG. 1 is a schematic block diagram of a moving image processing apparatus according to the present invention.

Reference numeral 1 denotes an image pickup means having an image sensor for picking up an image of a subject, and specifically corresponds to a camera.
Reference numeral 2 denotes an A / D converter for converting image information of an analog signal captured by the imaging unit 1 into image information composed of a digital signal. Reference numeral 3 denotes digital image information converted by the A / D converter for each time-series frame. Frame memory to be stored in
Is a central processing unit (CP) that controls and controls the entire processing apparatus.
U), which stores an algorithm comprising a processing flow of the moving image processing method of the present invention. 5 is central processing means 4
The main memory 6 used in the signal processing of the above is a display means for displaying an image processed by the present processing apparatus.

Although the above-mentioned image pickup means 1 has been described by taking an analog camera as an example, a digital camera having both functions of the image pickup means 1 and the A / D conversion means 2 can realize the object of the present invention. It is possible.

FIG. 2 is a flowchart showing a processing procedure of a moving image processing method according to one embodiment of the present invention. Hereinafter, the moving image processing method according to the present invention will be described while describing this procedure.

As shown in the figure, the present method includes two steps of processing for the first image frame (S1) and processing for the subsequent image frames (S2).

First, in step S11, the contour of the subject is extracted from the first image frame, and the normal direction at each point on the contour is calculated from the neighboring contour (S1).
1).

Next, in step S12, a reference point is selected from points on the contour line in consideration of the normal direction (S1).
2). Specifically, the reference point is selected under the condition that the normal direction of the selected point is not biased in one direction and includes two or more normal directions having an angle difference of about 90 degrees. .
In this embodiment, 20 reference points are selected. Also, the angle of the selected reference point was set to about 90 degrees,
However, the present invention is not limited to this. A range of 45 to 135 degrees is possible, and a range of 80 to 100 degrees is possible.

FIG. 3 shows an example of a reference point selected so as to satisfy the above condition in the image of the finger. ○ indicates a reference point, and each line segment at each reference point indicates a normal direction.

In step S2, the tracking process of the reference point obtained in step S1 is performed in the subsequent image frames.

In the present invention, it is assumed that the relationship between a reference point and a corresponding point can be represented by an affine transformation. Actually, if the movement of the finger is a parallel movement and a rotational movement on an arbitrary plane, it can be expressed by affine transformation. Here, the “corresponding point” refers to a point corresponding to the reference point after the finger as the subject has moved.

Here, assuming that the coordinates of the reference point are (X, Y) and the coordinates of the corresponding point are (x, y), the relation between the two is as follows: polynomial x = (1) and (2) a × X + b × Y + e (1) y = c × X + d × Y + f (2) Here, a, b, c, and d are coefficients indicating a rotation component of the motion of the subject, and e and f are coefficients indicating a translation component of the motion of the subject.

Next, in step S21, the intersection of the normal line of the reference point in the subject before moving (the subject in the previous image frame) and the contour line of the subject after moving (the subject in the next image frame) is temporarily determined. A point is set (S21). The intersection of the normal line of the reference point and the contour line is determined as a point where the luminance values of the pixels existing on the normal line of the reference point are examined and the luminance values of the adjacent pixels on the normal line are greatly different. FIG. 4 is a diagram showing reference points and provisional corresponding points corresponding to the reference points. The outline in FIG. 4 indicates the position of the finger in the previous image frame (before movement), ○ indicates a reference point, and + indicates a tentative corresponding point. Note that the normal is the normal of the reference point on the contour of the finger in the previous image frame.

In step S22, the coefficients of the above polynomials (1) and (2) are calculated based on the coordinates of the reference point and the provisional corresponding point.
Find a, b, c, d, e, and f. Since the provisional corresponding points are not true corresponding points, the coefficients a, b, c, d, e, and f cannot be uniquely determined. Therefore, in the present invention, the coordinates of the reference point and the coordinates obtained from the polynomials (1) and (2) using the coefficients a, b, c, d, e, and f obtained here and the provisional corresponding point Coefficients a, b, c, d, so that the error with the coordinates is small, that is, the average of the distances for all 20 reference points is the smallest.
The approximate solution of e and f is obtained by the least square method (S2
2).

Next, in step S23, the coefficients a, b, c, d, e, and f of the polynomial obtained in step S22.
Is used to determine where the 20 reference points move. FIG. 5 shows a transition of the reference points shown in FIG. 4 to which temporary reference points. According to FIG. 5, the “reference point” has moved to the “first temporary reference point”. However, although the “first temporary reference point” is approaching the “corresponding point”, their coordinates do not match. This corresponds to the coefficients a, b, c, d, of the polynomial obtained in step S22.
It is an error that results from e and f being approximate solutions.
This error can be reduced by obtaining a more accurate approximate solution using the “first temporary reference point”.

Therefore, in step S24, if the distance between the “coordinate of the n-th temporary reference point” and the “coordinate of the n-th temporary corresponding point” is equal to or greater than a certain threshold, the reference point is set to the n-th temporary reference point. Is updated (replaced) with the temporary reference point of. When the temporary corresponding points are updated and the processing performed in steps S22 and S23 is repeated, the reference points sequentially transition to a first temporary reference point and a second temporary reference point, The approximate solutions of the coefficients a, b, c, d, e, and f converge, and finally the corresponding points are obtained. (S22, S23, and S24).

In step S25, as a result of the processing in steps S22 and S23, it is found that the "reference point" finally transitions to the "corresponding point", and the corresponding point is determined (S25).

Finally, in step S26, if there is a next image frame, the corresponding point determined in step S25 is used as a reference point in the next image frame (S2).
6).

The movement of the subject can be tracked from the coordinate conversion parameters from the “reference point” to the “corresponding point” obtained as described above. FIG. 6 shows that a specific device (for example, a client device equipped with a user authentication device, for example, a computer or an entrance / exit management system, or an individual or a corporation manages and owns the device by using the exercise information thus obtained. Planes, ships, motorcycles, bicycles,
9 is a flowchart illustrating a processing procedure of a system that authenticates a user of a moving body such as an automobile and permits or denies use of a specific device.

Steps S21 and S22 in FIG.
Is the same as the processing in steps S1 and S2 shown in FIG. 2, and the description is omitted here. In step S23, the motion information of the subject is calculated based on the motion trajectory obtained by the above-described processing. Step S3
The processing procedure for the fourth and subsequent steps will be described with reference to the apparatus configuration diagram of FIG. 7 and the motion trajectory diagram of FIG.

Before starting the processing of FIG. 6, the user of the specific equipment must first input the exercise information input means 10 (the imaging means 1, the A / D conversion means 2, and the frame memory shown in FIG. 1). It is necessary to set and register the exercise information as the initial registration pattern of the subject by using 3), and the exercise information is stored in the exercise information storage unit 11.

First, when using a specific device, in step S34 of FIG. 6, a subject (for example, a finger) is input with exercise information by using the exercise information input means 10 (the left side diagram in FIG. 8). ). Thereafter, the exercise information calculated in the step S23 and the initial registration pattern (initial exercise information) set and registered in the exercise information storage means 11 are compared by the exercise information comparison means 12, whereby the initial registration is performed. It is determined whether exercise information equal to the pattern (initial exercise information) has been input or whether exercise information different from the initial registration pattern has been input.

In this way, if it is determined in step S35 that the user is a legitimate registered user, in step S36 the use permission control means 13 transmits a signal for permitting use to a specific device (see FIG. 6). On the other hand, if it is determined that the unauthorized use is performed by a person other than the authorized registered user, the use permission control unit 13 denies use of the specific device in step S37. The signal is transmitted (lower right side of FIG. 8).

Through these processes, the exercise information can be used as a kind of identification information.
For example, it is released from the fact that the user of the car has the key as in the conventional case.

Next, FIG. 9 is a diagram showing an embodiment in which predetermined data is exchanged between a server for managing security and the above-mentioned specific device via a network (Internet, mobile phone, wireless communication). It is.

In the figure, a user of a specific device initially uses exercise information input means 10 (the imaging means 1, the A / D conversion means 2, and the frame memory 3 shown in FIG. 1) in advance. A registration pattern (initial exercise information) is set and registered in the exercise information storage means 11, and thereafter, a user of a specific device inputs exercise information using a finger or the like when using the specific device. The point that the use permission control unit 13 transmits a use permission / non-permission signal to a specific device has been described with reference to FIG. 7 described above, but the process proceeds further here, and the specific device (hereinafter, “ Car) is stolen and taken away, we have a system that can obtain location information for that particular device.
The operation will be described with reference to FIGS.

In step S41 of FIG. 10, the user of the automobile inputs exercise information from the exercise information input means 10 when using the automobile, and as a result of the comparison by the exercise information comparison means 12, the exercise information becomes the exercise information. It is determined whether the pattern is different from or the same as the initial registration pattern (initial exercise information) set and registered in the storage unit 11. In step S42,
If it is determined that the registration pattern is different from the initial registration pattern (initial exercise information) set and registered in the exercise information storage unit 11, the use disapproval control unit 13 instructs the vehicle to perform the operation in step S43.
A use disapproval signal is transmitted, and in step S44, a signal for locking the door of the automobile or disabling start by the engine starter is transmitted.

In step S45, the central control means 16 of the user authentication device transmits, via the communication means 15, the network, and the communication means 22 of the server, an abnormal signal indicating that a use-disapproval signal has been transmitted, and The identification number (ID) of the vehicle handled by the person authentication device is transmitted. At the same time, the central control means 16 sends a command to the transmitting / receiving means 14 to output a transmission radio wave.

In step S46, upon receiving the abnormal signal and the identification number, the server performs an abnormal response process. Specifically, the receiving / transmitting means 21 on the server side receives the transmitted radio wave transmitted from the transmitting / receiving means 14 on the user authentication device side via the satellite means, and the vehicle handled by the user authentication device. To detect the position information.

As a result, even if the vehicle is taken away while the door of the vehicle is locked, the position of the vehicle can be grasped, so that the vehicle can be easily searched.

In the above description, an example has been described in which the specific device is an automobile.
The following processing may be performed instead of the lock of No. 4. For example, in the case of a computer, it is conceivable to disable login, or to perform a process of closing a gate in an entrance / exit management device or the like, but in addition to this, it also makes it impossible to use a specific device. The processing is not particularly limited to the above-described processing.

Further, the present invention can be applied to a client device equipped with a user authentication device, such as an airplane, a ship, a motorcycle, a bicycle, and a safe deposit box managed and owned by an individual or a corporation. is there.

Further, when the specific device is a computer, a signal for canceling the log-in state may be transmitted from the server side via the network even if the log-in cannot be performed once.

[0077]

As is apparent from the above description, according to the present invention, by tracking an object in a time-series image using information obtained from the shape of the contour of the object, a corner can be set as a reference point. Therefore, there is an effect that stable tracking can be performed even for a subject having an arbitrary shape including a subject formed by a free curve.

When a different pattern is detected by comparing the exercise information input when using a specific device with the previously registered initial registration pattern (initial exercise information), By detecting an abnormal state, unauthorized use of a specific device can be prevented.

[Brief description of the drawings]

FIG. 1 is a schematic configuration diagram of a moving image processing apparatus according to the present invention.

FIG. 2 is a diagram showing a procedure for explaining an embodiment of the present invention.

FIG. 3 is a diagram illustrating an example of a selected reference point.

FIG. 4 is a diagram showing the determined temporary corresponding points.

FIG. 5 is a diagram showing a process in which a reference point transitions to a corresponding point.

FIG. 6 is a diagram showing a procedure for explaining a moving image processing method according to the present invention.

FIG. 7 is a diagram showing a user authentication device of the present invention.

FIG. 8 is a diagram showing input of exercise information to the user authentication device of the present invention.

FIG. 9 is a diagram showing a configuration of a user authentication system of the present invention.

FIG. 10 is a diagram showing a processing procedure of the user authentication system of the present invention.

[Explanation of symbols]

 REFERENCE SIGNS LIST 1 imaging means 2 A / D conversion means 3 frame memory 4 central processing means (CPU) 5 main memory 6 display means

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5C054 AA05 CA04 CC05 CG02 CH02 DA07 EA07 FC14 FF05 HA05 HA18 5L096 CA02 DA02 FA06 GA08 HA04 HA07

Claims (28)

[Claims] 1. A moving image processing method for tracking a subject in a time-series image and extracting its motion, wherein a reference point used as a tracking target between adjacent image frames of the subject captured by an imaging unit is defined as a contour of the subject. A moving image processing method comprising selecting from points on the contour line using information obtained from the line. 2. The moving image processing method according to claim 1, wherein information on a normal direction of the contour of the subject is used as the information obtained from the contour of the subject. . 3. The moving image processing method according to claim 2, wherein the reference point is selected such that the normal direction of the reference point includes at least two normal directions having an angle difference of about 90 degrees. A moving image processing method characterized by the following. 4. The moving image processing method according to claim 1, wherein a temporary corresponding point corresponding to the reference point is obtained by using information obtained from the outline, and the motion of the subject can be expressed. Tracking the reference point by using a polynomial having a position on the image frame as a variable and obtaining a coefficient of the polynomial using coordinates of the provisional corresponding point. 5. The moving image processing method according to claim 4, wherein a normal direction of the outline is used as information obtained from the outline. 6. The moving image processing method according to claim 4, wherein a polynomial expressing an affine transformation is used as the polynomial. 7. The moving image processing method according to claim 1, wherein a user is authenticated when using a specific device in accordance with motion information of a subject obtained from a plurality of frames different in time series. A moving image processing method. 8. The moving image processing method according to claim 7, wherein the user inputs exercise information from an exercise information input means when using the specific device, and inputs the exercise information and the initial information input in advance. The exercise information comparing means compares the registered information with the registered pattern, and when it is determined that the exercise information is different from the initial registered pattern, the use permission control means outputs a signal to disallow use of the specific device to the specific device. A moving image processing method comprising transmitting to a device. 9. A moving image processing apparatus for tracking a subject in a time-series image and extracting its motion, wherein a reference point used as a tracking target between adjacent image frames of the subject captured by an imaging unit is defined as a contour of the subject. A moving image processing apparatus characterized by selecting from points on the contour line using information obtained from the line. 10. The moving image processing apparatus according to claim 9, wherein information on a normal direction of the contour of the subject is used as information obtained from the contour of the subject. . 11. The moving image processing apparatus according to claim 10, wherein the reference point is selected such that the normal direction of the reference point includes at least two normal directions having an angle difference of about 90 degrees. A moving image processing device characterized by the above-mentioned. 12. The moving image processing apparatus according to claim 9, wherein a temporary corresponding point corresponding to the reference point is obtained by using information obtained from the outline, and the motion of the subject can be expressed. A moving image processing apparatus for performing tracking of the reference point by using a polynomial having a position on the image frame as a variable and obtaining a coefficient of the polynomial using coordinates of the provisional corresponding point. 13. The moving image processing apparatus according to claim 12, wherein a normal direction of the outline is used as information obtained from the outline. 14. The moving image processing apparatus according to claim 12, wherein a polynomial expressing an affine transformation is used as the polynomial. 15. The moving image processing apparatus according to claim 9, wherein a user is authenticated when operating a specific device in accordance with motion information of a subject obtained from a plurality of frames different in time series. A moving image processing apparatus. 16. The moving image processing apparatus according to claim 15, wherein the user inputs exercise information from an exercise information input means when using the specific device, and the exercise information and an initial input previously input. The exercise information comparing means compares the registered information with the registered pattern, and when it is determined that the exercise information is different from the initial registered pattern, the use permission control means outputs a signal to disallow use of the specific device to the specific device. A moving image processing device for transmitting to a device. 17. Tracking a subject in a time-series image,
A medium readable by an information processing means for recording a program for extracting the movement, wherein the program is used for the information processing means at least as a tracking target between adjacent image frames of a subject captured by the imaging means. A medium storing a processing procedure for selecting a reference point from a point on the contour using information obtained from the contour of the subject. 18. The medium according to claim 17, wherein information on a normal direction of the contour of the subject is used as the information obtained from the contour of the subject. 19. The medium according to claim 18, wherein the reference point is selected such that a normal direction of the reference point includes at least two normal directions having an angle difference of about 90 degrees. Medium to do. 20. The medium according to claim 17, wherein a temporary corresponding point corresponding to the reference point is obtained using information obtained from the outline, and the motion of the subject can be expressed.
A medium for performing tracking of the reference point by using a polynomial having a position of the corresponding point on an image frame as a variable and obtaining a coefficient of the polynomial using coordinates of the provisional corresponding point. 21. The medium according to claim 20, wherein a normal direction of the outline is used as information obtained from the outline. 22. The medium according to claim 20, wherein a polynomial expressing an affine transformation is used as the polynomial. 23. The medium according to claim 17, wherein a user is authenticated when operating a specific device in accordance with motion information of a subject obtained from a plurality of frames different in time series. A medium characterized by the above. 24. The medium according to claim 23, wherein the user inputs exercise information from exercise information input means when using the specific device, and compares the exercise information with a previously input initial registration pattern. When the exercise information is compared by the exercise information comparing means and it is determined that the exercise information is different from the initial registration pattern, the use permission control means transmits a signal to the specific apparatus to disallow use of the specific apparatus. A medium characterized by the above. 25. The moving image processing apparatus according to claim 16, wherein the specific device is connected via a network, and when the user uses the specific device, the user inputs motion information from motion information input means. The exercise information is compared with the initial registration pattern input in advance by the exercise information comparing means. If it is determined that the exercise information is different from the initial registration pattern, the use permission control means Transmitting a signal to disallow use of the device to the specific device,
Authenticate the user when operating the specific device, and notify the server that processes information for management and security via a network when it is recognized that there is a possibility of unauthorized use or theft. A user authentication system characterized by the following. 26. The user authentication system according to claim 25, wherein the user authentication device of the specific device includes an initial registration pattern including initial exercise information and a subject input when the specific device is used. By comparing with the exercise information, perform authentication of the user who operates the specific device,
As a result of the comparison, if it is determined that the device is unauthorized, use of the specific device is not permitted. If it is determined that the device is not unauthorized, use of the specific device is permitted. User authentication system. 27. The user authentication system according to claim 26, wherein the user authentication device of the specific device is an exercise information input unit for inputting exercise information when a user uses the specific device; Use permission control means for permitting or disallowing use of a specific device; and exercise information comparison means for comparing exercise information input by a user with an initial registration pattern input in advance when using the specific device. And transmission means for transmitting a radio wave when the use of the specific device is prohibited by the use permission control means, and the user authentication device is connected to a server via a network, The server includes a receiving unit that receives a radio wave transmitted from the transmitting unit, and the exercise information input unit when the user uses the specific device. Then, the exercise information is input, and the exercise information is compared with the initial registration pattern set and registered in the exercise information storage unit by the exercise information comparison unit, and the exercise information is initially set and registered in the exercise information storage unit. If the registration pattern is different, the use permission control unit transmits a use rejection signal to the specific device, and the server-side reception unit receives the radio wave transmitted from the transmission unit and receives the radio wave. A user authentication system for acquiring position information of a specific device. 28. The user authentication system according to claim 27, wherein after the use permission control unit transmits a use rejection signal to the specific device, the user authentication device sends a request to the server. The server transmits an abnormal signal that intends to illegally use the specific device, and the server receives the signal, whereby the receiving unit on the server side starts receiving radio waves transmitted from the transmitting unit. User authentication system.