JPH10161524A - Dactylology word pattern dictionary making system and method therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a dactylology word pattern dictionary making system and a method therefor permitting to reduce labor of user in making a dactylology word pattern dictionary and also permitting dactylology recognition with good precision. SOLUTION: When a dactylology word pattern is made, a gesture element extraction part 111 extracts a gesture element which is similar to and replaceable with a gesture element of a dactylology word template defined by a user in a rough structure of the dactylology, and a gesture element recognition part 103 recognizes necessary gesture elements from dactylology data for study, and from this recognized gesture element, a gesture element corresponding to the gesture element extracted in the gesture element extraction part 111 is retrieved, and it is verified whether or not a time relation between these retrieved gesture elements is within a tolerance, and if the time relation is within a tolerance, the dactylology word template is corrected by the gesture element for making a dactylology word pattern dictionary 109.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technique for creating a sign language word pattern dictionary used in a sign language pattern recognition apparatus for recognizing a sign language word corresponding to a sign language operation based on a pattern of sign language data into which an actual sign language operation is input. More particularly, the present invention relates to a sign language word pattern dictionary creating system and method suitable for performing correct recognition while efficiently coping with fluctuations in sign language operation due to situations and individual differences.

[0002]

2. Description of the Related Art Conventionally, regarding sign language recognition technology, for example, Japanese Patent Application No. Hei 6-253457 by the present applicant, and "Development of a non-contact sign language motion recognition algorithm (Measurement and Automatic Control Society: Human Interface Committee
Human Interface News and Report Vol.10 No.1, pp.4
1-46, 1995) ". In these techniques, a sign language word pattern dictionary expressing a sign language motion is used as a combination of symbols representing motion elements (hand shape, direction, position, movement style, etc.) which are basic units of the sign language motion. That is, an action element is recognized from the input sign language data, and the sign of the input sign language is recognized by comparing a combination of the action element and an action element created in advance in the sign language word pattern dictionary.

[0003] In these techniques, how to recognize a motion element from an input sign language motion, how to compare the recognized motion element with a motion element in a sign language word pattern dictionary, and the like. Is disclosed. However, there is no description on how to create a sign language word pattern dictionary described as a combination of motion elements. When creating a sign language word pattern dictionary, manually identify the necessary motion elements and their relationships one by one.
It is conceivable to register one. In this case, in order to increase the recognition accuracy, it is necessary to register the operation elements in the actual sign language by the signer.

[0004] It is relatively easy for a human to manually register an operation element for a rough operation. However, in the actual sign language operation, there are individual differences due to the situation and the habit of the sign language, and even in the case of the sign language operation for the same sign language word, different operation elements may be combined. If the difference is large, the sign language operation may be erroneous, but if some difference cannot be absorbed, it will not be practical.

In order to register an operation element in such an actual sign language operation, it is necessary to select a necessary operation element after recognizing the operation element from the sign language data. Generally, there are many types of operation elements recognized from one pattern data, and the temporal relationship between the operation elements is hardly in an ideal state. For this reason, it is very inefficient if a human manually selects the operation elements one by one. Further, in learning a normal sign language word pattern for recognition, several tens to several hundreds of samples are used for one word, so that it is not practical for a human to manually perform all of them.

[0006]

The problem to be solved is that the prior art cannot automatically create a highly accurate sign language word pattern dictionary capable of coping with an actual sign language operation. An object of the present invention is to provide a sign language word pattern dictionary creation system and method that can solve the problems of the related art, reduce the user's labor involved in creating a sign language word pattern dictionary, and enable accurate sign language recognition. To provide.

[0007]

To achieve the above object, a sign language word pattern dictionary creation system according to the present invention comprises:
(1) Each operation element 911, 912 (1301, 1) of a sign language word W (sign language word template 905) created in advance.
303, 1305, 1307) and replaceable operating elements 1302, 1304, 130 similar to the extracted operating elements at a predetermined degree based on the description contents of the extracted operating elements.
6, 1308, and the actual sign language motion elements 1504 corresponding to the sign language word template 905, in the time zone 150 in which they were generated.
1, 1502, and among the extracted motion elements, the time zone in which each of the extracted motion elements matches the motion element extracted by the motion element extraction unit 111 and the time zone in which the generated motion element occurs is the sign language word template 90.
5, an operation element recognizing unit 103 for selecting an operation element at least slightly overlapping with the occurrence time zone of each operation element;
From the operation elements 1707 to 1712 selected in 03, the respective time zones in which these operation elements 1707 to 1712 occur are not inconsistent with the order in which the operation elements 1301, 1303, 1305, and 1307 of the sign language word template 905 occur. At least a sign language word pattern dictionary creating unit 107 for identifying the motion elements, adding each of the specified motion elements to each of the replaceable sign language word templates 905, and modifying the sign language word template 905; , Sign language word pattern dictionary creation unit 107
Is stored in the sign language word pattern dictionary storage unit 109. (2) In the sign language word pattern dictionary creation system according to the above (1), the motion element extraction unit 111 includes the same type included in a predetermined range of the space around each motion element of the sign language word template 905. Is extracted as a motion element that can be replaced with each motion element of the sign language word template 905. Also, (3)
In the sign language word pattern dictionary creation system according to any one of (1) and (2), the sign language word pattern dictionary creation unit 107 replaces each of the action elements selected by the action element recognition unit 103 with a sign language word that can replace each of the action elements. A combination 1801 of each operation element expressing the sign language word template 905 by replacing each operation element of the template 905
~ 1803 is generated one or more, and among the generated combinations,
The deviation of the arrangement of the time zone of each operation element is a combination 1801 and 1802 within a predetermined allowable value with respect to the time order in which each operation element occurs in the sign language word template 905.
Is extracted, and each of the extracted action elements of the combination is added to each of the action elements of the replaceable sign language word template 905 to modify the sign language word template 905. (4) In the sign language word pattern dictionary creation system according to (3), the sign language word pattern dictionary creation unit 107 can replace each of the operation elements selected by the operation element recognition unit 103 with each of the operation elements. Simultaneous elements 1701 to 1705 are put together for each motion element of the sign language word template 905 created in advance, and this simultaneous element is used to determine the shape, direction,
A static operation element 1707 describing a static state such as a position,
1708, 1709, or a dynamic action element 1710 that describes a dynamic state such as a hand movement in a sign language action.
1712, and classify each of the simultaneous elements 17
It is characterized in that combinations 1801 to 1803 are generated in units of 07 to 1709. (5) In the sign language word pattern dictionary creating system described in (6), each of the operation elements of the sign language word template 905 generated in the same time zone are sequentially elements (906 to 908) in units of simultaneous elements 2601 to 2604. And the sequential element 90
It is characterized in that the sign language word template 905 is expressed by arranging the respective motion elements in units of 6 to 908. Also, (6)
In the sign language word pattern dictionary creation system described in (5) above, the sign language word pattern dictionary creation unit 107 may determine that the simultaneous elements constituting the sequential elements are the same static simultaneous elements composed of static operation elements. A time zone including at least one occurrence time zone of each operation element of the element is determined as a time zone (1605 to 1606) of the static simultaneous element, and the simultaneous element constituting the sequential element is a dynamic If it is a simultaneous element, the time zone 2003 of each operation element of the dynamic simultaneous element is obtained as the time zone of the simultaneous element, and the time zone including all the obtained time zones of the simultaneous elements constituting the sequential element is set as the time of the sequential element. The difference between the arrangement of the obtained time zones 2301 to 2303 of each of the sequential elements and the arrangement of each of the sequential elements 1901 to 1903 of the sign language word template 905 is as follows: And extracting the combination is within the order set threshold. (7) The above (6)
In the sign language word pattern dictionary creation system described in
The sign language word pattern dictionary creating unit 107 determines, among the extracted operating elements constituting the simultaneous element of each of the combinations 1801 to 1802, the operating element generated in a time period other than the time zone obtained by the sequential element including this operating element. (Figure 2
5) Each of the remaining simultaneous elements is added to the sign language word template 905 on a simultaneous element basis and a sequential element basis, and the sign language word template 905 is modified (FIG. 26). The method of creating a sign language word pattern dictionary according to the present invention includes the steps of (8) extracting each operation element (FIG. 9) of the sign language word template 905 created in advance, and adding the description contents of each of the extracted operation elements. A first step (step 1001) of extracting each replaceable action element similar to the extracted action elements with the same type at a predetermined degree based on the extracted action elements, and an actual sign language action corresponding to the sign language word template 905. Each operation element is extracted together with the time zone in which it occurred (FIG. 15).
1. Each of the motion elements extracted in step 1 is identical (each of the motion elements created in advance is naturally included in the actual sign language motion and is extracted), and the time zone in which the motion occurred is generated in advance. A second step (steps 1002 and 1003) of selecting a word template 905 that at least slightly overlaps with the occurrence time zone of each operation element (FIG. 16) and step 1
From the operation elements selected in 002, the operation elements in which the respective time zones in which the respective operation elements are generated are not inconsistent with the generation time of each operation element of the sign language word template 905 created in advance are specified. At least a third step (steps 1004 to 1007) of modifying the sign language word template 905 by adding each of the motion elements to each of the replaceable sign language word templates 905, the sign language modified in step 1007 The word template 905 is stored in the sign language word pattern dictionary storage unit 1
09 is stored. (9) In the sign language word pattern dictionary creating method according to the above (8), the third step is that each operation element of the sign language word template 905 that can replace each of the operation elements selected in the second step. And a fourth step (step 1004) of generating one or more combinations of the respective motion elements expressing the sign language word template 905, and the time zone arrangement of the respective motion elements among the combinations generated in the step 1004. A fifth step (step 1005) of extracting a combination within a predetermined allowable value with respect to a time order in which each operation element occurs in the sign language word template 905, and each operation of the combination extracted in step 1005 Elements are added to each of the action elements of the replaceable sign language word template 905, and the sign language word template is added. Sixth step of modifying over preparative 905 (Step 1
006, 1007). (10) In the sign language word pattern dictionary creation method according to (9), the fourth step (step 1004) includes the second step (step 1002).
1003) The previously created sign language word template 9 capable of replacing each of the motion elements selected in (1003) with each of the motion elements.
05 is a simultaneous element, and the simultaneous element is a static operation element that describes a static state such as the shape, direction, and position of the hand in the sign language operation, or a sign operation of the sign language operation. The method is characterized in that it is classified into which of the dynamic motion elements that describe the dynamic state such as the way of movement of the hand within the group, and a combination is generated for each simultaneous element. Also, (11)
In the sign language word pattern dictionary creation method described in (10) above, each operation element of the sign language word template 905 generated in the same time zone is grouped as a sequential element in a simultaneous element unit, and each operation element is arranged in a unit of the sequential element. It is characterized by expressing the sign language word template 905. (12) In the sign language word pattern dictionary creating method according to the above (11), in the fifth step, if the simultaneous elements constituting the sequential elements are static simultaneous elements composed of static operation elements, the same static The time zone including at least one occurrence time zone of each operation element of the target simultaneous element is determined as the time zone of this static simultaneous element, and the simultaneous element constituting the sequential element is a dynamic simultaneous element comprising a dynamic operation element. If there is, the time zone of each operation element of the dynamic simultaneous element is obtained as the time zone of the simultaneous element, and the time zone including all the obtained time zones of the simultaneous elements constituting the sequential element is obtained as the time zone of the sequential element, It is characterized by extracting a combination in which the difference between the obtained time zone arrangement of each sequential element and the arrangement of each sequential element of the sign language word template 905 is within a preset threshold value.
(13) In the sign language word pattern dictionary creation method described in (12), in the sixth step, each combination extracted in the fifth step (FIGS. 25, 1801, 180)
Of the operation elements constituting the simultaneous element of 2), the operation element that occurs outside the time zone obtained in the fifth step of the sequential element including this operation element is deleted from the simultaneous element (FIG. 2).
5) Each of the remaining simultaneous elements is added to the sign language word template 905 on a simultaneous element basis and a sequential element basis, and the sign language word template 905 is modified (FIG. 26). (14) In the sign language word pattern dictionary creating system according to any one of (8) to (13), the sign language word template 9
When the same sign language operation is repeated two or more predetermined times, the same sign language operation is repeated every predetermined number of times of the actual sign language operation for the sign language word template 905, and there is no contradiction in the order of occurrence time in the second and third steps. The operation elements are repeatedly specified, and each operation element that does not contradict in the order of the occurrence time specified in all the repetitions is added to each of the operation elements of the replaceable sign language word template 905.

[0008]

DESCRIPTION OF THE PREFERRED EMBODIMENTS In the present invention, an operation element obtained from learning sign language data of an actual sign language operation is added to a sign language word template in which correct operation elements are described in advance.
Create a sign language word pattern dictionary. At this time, it is determined whether or not the motion element obtained from the learning sign language data is a thing that can be added to the sign language word template. For example, whether or not the motion elements obtained from the learning sign language data are similar to the motion elements of the sign language word template, and whether there is a large difference in the time relationship between the motion elements in the sign language motion such as the time sequence in which they occur. It is determined whether or not. Those that are not similar or have a large time relationship are not added to the sign language word template as being erroneous.

An embodiment according to the sign language word pattern dictionary creating system of the present invention will be described below in detail with reference to the drawings. FIG. 1 is a block diagram showing one embodiment of the configuration according to the present invention of the sign language word pattern dictionary creating system of the present invention. In FIG. 1, reference numeral 101 denotes a sign language input unit, 10
2 is a learning sign language data storage unit, 103 is an operation element recognition unit according to the present invention, 104 is an operation element recognition pattern storage unit, 105 is an operation element list storage unit, 106 is an operation element storage unit, and 107 is a sign language word pattern. Dictionary creation unit, 108
Is a sign language word template storage unit, 109 is a sign language word pattern dictionary storage unit, 110 is a sign language word template input unit, and 111 is a motion element extraction unit.

A sign language input unit 101 converts a sign motion in a sign language into an electric signal, inputs as sign language data, and stores the sign language data in a learning sign language data storage unit 102. Motion element recognition unit 1
03 recognizes an operation element from the sign language data stored in the learning sign language data storage unit 102 according to the contents of the operation element list in which the operation elements stored in the operation element list storage unit 105 are enumerated. The pattern of the operation element and various parameters necessary for recognition of the operation element by the operation element recognition unit 103 are stored in the operation element recognition pattern storage unit 104.
Is stored in The operation element recognized by the operation element recognition unit 103 is stored in the operation element storage unit 106.

The sign language word pattern dictionary creation unit 107 includes a sign language word template that describes the operation elements stored in the movement element storage unit 106 and the general structure of the sign language operation stored in the sign language word template storage unit 108. , A sign language pattern dictionary is created and stored in the sign language word pattern dictionary storage unit 109. The sign language word template input unit 110 inputs the contents of the sign language word template and stores the contents in the sign language word template storage unit 108.

The motion element extraction unit 111 according to the present invention extracts the motion elements described in the sign language word template stored in the sign language word template storage unit 108, and the motion to be recognized by the motion element recognition unit 103. A list of elements is created and stored in the operation element list storage unit 105.
In particular, the motion element extraction unit 111 not only extracts the motion elements described in the sign language word template in the sign language word template storage unit 108, but also resembles each of the extracted motion elements with a predetermined degree. Each replaceable operation element is extracted based on the description contents of each operation element, and is extracted and put on a list.
5 is stored.

[0013] Then, the motion element recognizing section 103 inputs the actual sign language input from the sign language input section 101 corresponding to the sign language word template stored in the sign language word template storage section 108 and stored in the learning sign language data storage section 102. Each operation element of the operation is extracted together with the time zone in which it occurred, and among the extracted operation elements, the operation element that matches the operation element stored in the operation element list storage unit 105 and the time zone in which the operation element occurs is A sign language word template that is at least slightly overlapped with the occurrence time zone of each action element is selected and stored in the action element storage unit 106.

The sign language word pattern dictionary storage unit 109 stores the time periods in which each of the action elements stored in the action element storage unit 106 occurs in the learning sign language data storage unit 10.
2. Identify the operation elements that do not contradict each other in the order of the occurrence time of each operation element of the actual sign language operation stored in 2 and add each of the specified operation elements to the corresponding operation element to correct the sign language word template. The corrected sign language word template is stored in the sign language word pattern dictionary storage unit 109. Hereinafter, the sign language word pattern dictionary creating system that performs such an operation will be described in further detail.

FIG. 2 is a block diagram showing an example of the hardware configuration of the sign language word pattern dictionary creation system in FIG. In FIG. 2, a sign language input device 201 is a device that converts a hand motion in a sign language into an electric signal. For example, a sign device is installed on a glove, and a device that converts a hand shape and movement into an electric signal is well known. Equipment can be used. With such a sign language input device 201, the hand motion of the sign language is converted into multidimensional time-series data including the bending angle of the finger, the position of the hand, and the like.

The character input device 202 is a device for inputting characters for describing a sign language word template, and may be a commonly used character input device such as a keyboard. The arithmetic device 203 is a device for recognizing an operation element and creating a sign language word pattern dictionary, reads a program from the memory 205, and performs processing according to the program. The output device 204 is a device for displaying and confirming a process of creating a sign language word pattern dictionary and a process result.
A character output device such as a T display can be used.

The memory 205 is a storage device for storing an operation element recognition program 206, an operation element extraction program 207, and a sign language word pattern dictionary creation program 208. The memory 209 is a storage device for storing the motion element recognition pattern 210, the sign language word template 211, and the motion element list 212. The memory 213 is a storage device for storing the sign language data for learning input from the input device 201. Memory 21
Reference numeral 4 denotes a storage device for storing the motion element recognized from the learning sign language data. The memory 215 is a storage device for storing the created sign language word pattern dictionary.

FIG. 3 is an explanatory diagram showing an example of the format of the hand movement data converted by the sign language input unit in FIG. In FIG. 3, reference numeral 301 denotes data relating to the position of the hand. The position 301 of the hand further includes data (x) 302 on the x-axis, data (y) 303 on the y-axis, and data (z) 304 on the z-axis. Have been. 305 is data on the direction of the hand.
Angle (α) 306 around x axis, Angle (β) 3 around y axis
07, an angle (γ) 308 about the z-axis.

Reference numeral 309 denotes data relating to the bending of the finger. The bending 309 of the finger includes the bending angle (α1) 310 of the second joint of the thumb and the bending angle (β1) of the third joint of the thumb.
311, bending angle of the first joint of the index finger (α2) 31
2. Bending angle of the second joint of the index finger (β2) 313, bending angle of the first joint of the middle finger (α3) 314, bending angle of the second joint of the middle finger (β3) 315, bending angle of the first joint of the ring finger ( α4) 316, bending angle of the second joint of the ring finger (β4)
317, the bending angle (α5) 318 of the first joint of the little finger, and the bending angle (β5) 319 of the second joint of the little finger.

Further, 320 to 322 correspond to the time t
Hand position 301, hand direction 30 at 1, t2, tn
2. Information on finger bending 309. As described above, the motion in the sign language is represented as time-series data including the hand position 301, the hand direction 305, and the finger bending 309.

FIG. 4 is an explanatory diagram showing a storage format of a parameter for recognizing an operation element stored in the operation element recognition pattern storage section in FIG. In FIG. 4, an operation element name 401 indicates a name of an operation element that uses the parameter in the recognition process, and a parameter number 402.
Represents the number of parameters used for recognizing the operation element, and 403 to 405 represent each parameter. Hereinafter, FIG.
The format of the sign language word template stored in the sign language word template storage unit 108 in FIG. 1 will be described in detail with reference to FIGS.

FIG. 5 is an explanatory view showing a model of a sign language operation expressed by an operation element. As shown in FIG.
The operation of sign language is a sequential element 501 that occurs continuously in time.
５０503. In addition, each sequential element 5
01-503 are simultaneous elements 504 occurring in the same time range
To 506. Furthermore, each simultaneous element 504-
506 are operating elements 507-5 existing in the same time range.
09. Here, for example, the simultaneous element 5
The operation elements 507 to 509 constituting the same element 04 are the same type and have only different attributes, and if any of the operation elements 507 to 509 in the simultaneous element 504 exists, the simultaneous element 504 exists. Will be considered. On the other hand, the simultaneous elements 504 to 50 included in the sequential element 501
Only when all 6 exist, the sequential element 501 is considered to exist.

FIG. 6 is an explanatory diagram showing the types of operation elements. As shown in FIG. 6, the motion elements are classified into major categories such as a hand shape, a hand direction, a hand position, a straight line, a wavy line, a distance between both hands, a positional relationship between both hands, and specific attributes of each. Is represented by a small classification Some operation elements have more detailed attributes.

FIG. 7 is an explanatory diagram showing an example of a description format of a sign language word template based on the model shown in FIG. In FIG. 7, a sign language word name 701 indicates a sign language word name represented by the combination of the action elements. The number of repetitions 702 indicates how many times the entire operation represented by the combination of the operation elements is repeated. Number of sequential elements 70
3 is the number of sequential elements constituting the sign language word. Sequential elements 704 to 706 represent each sequential element constituting the sign language word. The number of simultaneous elements 707 is the number of simultaneous elements constituting the sequential elements. Simultaneous elements 708-710 are serial elements 7
04 represents each simultaneous element. Number of operating elements 711
Is the number of operating elements that make up the simultaneous element. The operation elements 712 to 714 are operation elements constituting the simultaneous element 708.

FIG. 8 is an explanatory diagram showing an example of a description format of an operation element. In FIG. 8, reference numeral 801 denotes a set of a large classification and a small classification of the operation element shown in FIG.
The type and part of a hand used to represent the motion element, and the type of hand describes either “right” or “left”. In addition, regarding the part, in the case of the movement element related to the direction, “fingertip”, “normal”, “side”, “thumb”, “index finger”, “middle finger”, “ring finger”,
If "little finger" is also a motion element related to position,
Describe any of "palm", "thumb", "index finger", "middle finger", "ring finger", and "little finger". 803, 8 in the figure
04 is an attribute other than the major classification and the minor classification of the operation element, and the number enumerated by the operation element differs.

FIG. 9 is an explanatory diagram showing an example of a sign language word template described in accordance with the description format of the sign language word template described in FIGS. The sign language 901 shown in FIG. 9 is a sign language meaning “very”.
"State at the start of operation" 902, "State of linear motion" 90
3. “State at the time of end of operation” 904 is represented by three sequentially occurring states. Sign language 9 consisting of these states
The sign language word template 01 is shown at 905.

In the sign language word template 905, the sequential elements 906 to 908 correspond to the states 902 to 904 of the sign language 901 respectively. The sequential element 906 is 2
It comprises two simultaneous elements 909 and 910, each of which comprises a “shape” 911 and a “direction” 912 of motion elements, respectively. Similarly, the sequential element 907 is composed of one simultaneous element “straight”, and the sequential element 908 is composed of two sequential elements of “shape” and “direction”, respectively. The motion elements described in the sign language word template 905 are shown in FIG.
Although the attributes described in the above are omitted, some attributes can be actually added according to the operation element. When the small classification and the attribute are described, they are used as reference values when creating a sign language word pattern dictionary.

Next, a method of creating a sign language word pattern dictionary will be described in detail with reference to FIGS. FIG. 10 is a flowchart showing an embodiment of the processing for creating a sign language word pattern dictionary according to the present invention. This figure 1
0, Step 1001 is the operation element extraction unit 111 in FIG. 1, Step 1002 is the operation element recognition unit 103 in FIG. 1, Steps 1003 to 1007
Corresponds to the processing of the sign language word pattern dictionary creating unit 107 in FIG. Hereinafter, Step 1001 to Step 10
The respective processes in 07 will be sequentially described.

In step 1001, the action elements described in the sign language word template are extracted, and an action element list is created. When creating this motion element list, first, for the motion elements in the sign language word template, a list is created as shown in FIG. Note that, for a motion element for which a minor classification is not specified in the sign language word template, the item of the minor classification is omitted. In the list shown in FIG. 11, all attributes are omitted. Then, for each operation element in the list created in this way, the major classification is the same, and
Based on the sub-classification of the operation element, a motion element whose sub-classification is spatially included in a certain range is added to the list.

The addition of such an operation element to the list will be described with reference to FIG. For example, if the major classification is “direction” and the minor classification is “up”, as shown in FIG. 12, “direction” having a small classification included in a certain range 1204 centered on “up” 1201 operates. Selected as an action element to be added to the element list. In the case of FIG. 12, a “direction” having “upper” 1202 and “upper” 1203 is added. Here, the range 1204 can be set arbitrarily. However, in order to reduce the search range at the time of creating the sign language word pattern dictionary, usually, in the feature parameter space, only the small classification adjacent to the central small classification is used. Is set to be selected. In addition, for the operation element from which the minor classification is omitted, all the minor classifications corresponding to the major classification are selected.

FIG. 13 shows an example of the operation element list created in this way. The operation elements 1301, 1303, 1305, and 13 in the operation element list in FIG.
Reference numeral 07 denotes an operation element extracted from the sign language word template shown in FIG. Also, the operation element 13 shown by hatching
02, 1304, 1306 and 1308 are added operation elements.

Returning to FIG. 10, the processing of step 1002 will be described. In step 1002, the operation element in the operation element list shown in FIG. 13 selected in step 1001 is recognized from the learning sign language data. The recognition of the operation element is performed by the operation element recognition unit 103 in FIG. Hereinafter, the operation element recognition unit 103 will be described.

FIG. 14 is a block diagram showing an example of the configuration of the operation element recognition unit in FIG. In the motion element recognition unit 103 of FIG. 14, the feature parameter extraction unit 1401 calculates speed, acceleration,
The parameters necessary for recognizing the motion element such as the curvature are extracted. The parameter selection unit 1402 refers to the operation elements in the operation element list as shown in FIG. 13, for example, selects parameters required for recognition of each operation element, and sends the parameters to the corresponding recognition units. Shape recognition unit 140
3. The direction recognition unit 1404, the position recognition unit 1405, the straight line recognition unit 1406, and the circle recognition unit 1407 are recognition units for recognizing respective operation elements. Be prepared.

In each of these recognition units, the characteristic parameter sent from the parameter selection unit 1402 and the corresponding operation element in the operation element recognition pattern stored in the operation element recognition pattern storage unit 104 in FIG. The operation element is recognized using the pattern of, and the result is output. As a technique for recognizing each operation element, for example, a technique described in Japanese Patent Application No. 6-253457 (“Sign Language Recognition Apparatus”) can be easily used.

FIG. 15 shows an example of the output result of the motion element recognized by the motion element recognition section 103 in this way. As shown in FIG. 15, the operation element recognized by the operation element recognition unit 103 in FIG. 14 is described by a set of four items of a start point 1501, an end point 1502, an evaluation value 1503, and an operation element 1504. The set of items is stored in the operation element storage unit 106 in FIG. 1 in the form of a list.

Returning to FIG. 10, the processing of step 1003 will be described. In this step 1003, the operation element corresponding to the operation element in the sign language word template stored in the sign language word template storage unit 108 in FIG. 1 is searched from the operation elements recognized by the operation element recognition unit 103 in FIG. Then, a correspondence table between the motion elements in the sign language word template and the recognized motion elements is created. In creating this correspondence table, the correspondence between the operation elements is obtained in units of simultaneous elements. Further, the processing for obtaining the correspondence differs depending on whether the motion element included in the simultaneous element is static, such as a shape or direction, or dynamic, such as a straight line or a circle.

For example, in the case of a static operation element, as shown in the example of FIG. 16, the operation element is included in the simultaneous element or within a certain range based on the small classification of the operation element. A continuous section in which any of the motion elements having the small classification is detected is obtained, and a set of the motion elements included therein is set as the motion element corresponding to the simultaneous element. That is, in FIG. 16, the motion element having the minor classification as the center is “shape / a” 1601 and 1602, and the motion element having the minor classification within a certain range centered on the minor classification is referred to as “shape / a”.
Assuming that “mo” 1603 and “shape / sa” 1604, the set of motion elements “shape / a”, “shape / mo”, and “shape / sa” in the section between time 1605 and time 1606 correspond to simultaneous elements Is registered in the correspondence table as an operating element to perform.

In the case of a dynamic motion element, the recognition is performed in units of the entire motion. Therefore, if one recognized motion element is the same as any one of the simultaneous elements, the operation is performed. The element is independently registered in the correspondence table as an operation element corresponding to the simultaneous element. FIG. 17 shows an example of the operation element correspondence table created in this way. The correspondence table in FIG. 17 is a correspondence table obtained from the sign language word template 905 shown in FIG. 9 and the motion element recognition result shown in FIG.

In FIG. 17, the number of combinations 1706 is the number of sets of operation elements corresponding to the simultaneous elements, followed by the combination 1707 of operation elements. Here, the static simultaneous elements are 1701, 1702, 1704, 170
5, and only 1703 is a dynamic simultaneous element. In the simultaneous elements 1701, 1702, and 1705, a set 1707 to 1709 of an action element described in the sign language word template and an action element having a small category included in a certain range centered on the small category of the action element is included in each of the simultaneous elements. Corresponds to the element. On the other hand, for the simultaneous element 1703, the operation element 17
10 to 1712 correspond to each other.

Returning to FIG. 10, the processing of step 1004 will be described. In this step 1004, a combination of the motion elements that are candidates for the sign language word pattern to be stored in the dictionary is obtained by using the motion elements shown in FIG. 17 that are recognized by obtaining the correspondence with the motion elements in the sign language word template. Ask for. Also in this case, similarly to step 1003, a combination as shown in the following FIG. 18 is obtained by selecting a set of operation elements corresponding to the simultaneous element one by one using the simultaneous element as a unit.

FIG. 18 shows candidate sign language word patterns created using the correspondence table shown in FIG. 17, and the correspondence table shown in FIG. Since one set, one set, and one set of motion elements correspond to each other, “1 × 1 × 3 × 1 × 1 = 3” candidates that are the total number of these sign language word pattern candidates Is created. In FIG. 18, three created sign language word pattern combination candidates 1801 to 180
3 is shown. Since there is only one set of motion elements corresponding to the simultaneous element except for the simultaneous element 1703, the three candidate sign language word pattern combinations 1 shown in FIG.
In 801 to 1803, only operation elements 1804 to 1806 corresponding to the simultaneous element 1703 are different.

Returning to FIG. 10, the processing of step 1005 will be described. In this step 1005, it is determined whether or not the temporal relation between the motion elements in the sign language word pattern candidates in FIG. 18 obtained in step 1004 is within an allowable range. This temporal relationship is also determined on a simultaneous element basis. Therefore, first, the time range of the simultaneous element is obtained. Here, in the case of a simultaneous element composed of static operation elements, at least one of the operation elements corresponding to the simultaneous element
A continuous time range in which one exists is defined as a time range in which the simultaneous element exists. Also, for dynamic concurrent elements,
The time range of the operation element corresponding to the simultaneous element is set as the time range in which the simultaneous element exists.

The temporal relationship between simultaneous elements and sequential elements described in the sign language word template represents an ideal state. That is, as shown in FIG. 19, all the simultaneous elements included in the sequential elements exist in the same time range, and the respective sequential elements do not overlap each other in the time range and there is no gap. FIG. 19 shows the relationship between simultaneous elements and sequential elements represented by the sign language word template 905 in FIG.
There are no temporal overlaps or gaps between the sequential elements 1901-1903. However, the simultaneous elements and the sequential elements formed based on the motion elements recognized from the learning sign language data do not have an ideal relationship as shown in FIG. Overlaps and gaps occur between successive elements. Hereinafter, the description will be made.

FIG. 20 is an explanatory diagram showing the temporal relationship of the simultaneous elements in the sign language word pattern candidates of FIG. As shown in FIG. 20, each static simultaneous element 2
001 and the concurrent element 2002 and the concurrent element 20
04 and the simultaneous element 2002 are shifted in time range. Further, the simultaneous element 2001, the simultaneous element 2002, and the simultaneous element 20 considered as ranges corresponding to the respective sequential elements
There is a temporal overlap between 04. For this reason, the candidate of the sign language word pattern is determined by determining whether the overlap or the gap is within the allowable range based on the relationship between the ideal simultaneous elements indicated by the sign language word template and the relation between the sequential elements. Performed by

In order to do this, first, the overlap between the simultaneous elements included in each sequential element is evaluated. In the evaluation of the overlap, the time range of the i-th simultaneous element is defined as (“Si, Ei”), and the overlap degree r shown in the following “Equation 1” is defined. The value of the overlap degree is set in advance. If it is equal to or greater than a certain threshold Ts, it is determined that the sequential element exists.

(Equation 1)

In FIG. 21, the range 2101 is “Equation 1”.
, The range 2102 corresponds to the denominator. The time range of the sequential element for which the relationship between the simultaneous elements is determined to be within the allowable range is a time range common to the simultaneous elements included in the sequential element, that is, a range corresponding to the range 2101 in FIG. In addition, as the degree of overlap between the simultaneous elements, two simultaneous elements are selected from the simultaneous elements included in the sequential elements, and the overlap degree between the two simultaneous elements is calculated for all the combinations using the same formula as in Equation 1. It is also possible to calculate the average and use the average. Further, as the time range of the detected sequential element, an average value of the time range of the simultaneous element included in the sequential element may be used.

If it is determined that the relation between the simultaneous elements in each sequential element is within the allowable range, the relation between the sequential elements is evaluated next. To do this, the i-th and i +
Evaluation value e shown in the following “Equation 2” for the first sequential element
And the range in which the evaluation value e is set in advance
If it is within the range of (“To, Tg”), it is determined that the temporal relationship between the i-th and (i + 1) -th sequential elements is within an allowable value.

(Equation 2)

In FIG. 22, range 2201, range 22
03 corresponds to the numerator of “Equation 2”, and the range 2202 and the range 2204 correspond to the denominator. In FIG. 22, each simultaneous element shows only a part included in the range of the sequential element. FIG. 23 shows a case where the relationship between the detected sequential elements is not within the allowable range. FIG. 23 is a diagram corresponding to the sign language word pattern candidate 1803 shown in FIG.
02 and the sequential element 2303 have a reversed temporal relationship and do not satisfy the condition of “Equation 2”, so that it is determined to be outside the allowable range.

The sign language word pattern candidates for which it has been determined that the relationship between all adjacent sequential elements is within the allowable range by the determination based on "Equation 2" are used to create a sign language word pattern dictionary. . When the number of repetitions is two or more, the same evaluation is performed on the relationship between the sequential elements for the number of repetitions. Further, as the evaluation value of the relationship between the sequential elements, the magnitude of the gap or the overlap between the sequential elements may be used as it is. Further, when a gap or overlap of a certain size always occurs, an average value of the gap or overlap may be used as a reference value, and an evaluation value may be obtained for a magnitude of a deviation from the reference value.

Returning to FIG. 10, the processing of step 1006 will be described. In this step 1006, a correction operation element list for correcting the sign language word template is created by using the sign language word pattern candidates determined to be within the allowable range in step 1005. This process
Basically, the processing is the reverse of that of step 1004. For example, in the case of the candidate for the sign language word pattern shown in FIG. 18, the correspondence table of the simultaneous element and the action element is reconstructed using the candidates 1801 and 1802 other than the candidate 1803 determined to be out of the allowable range. . However, for the simultaneous elements including the static operation elements, the operation elements that are not included in the range of the sequential elements detected by the combination of the operation elements in the candidate are deleted.

Hereinafter, the processing in step 1006 will be described with reference to FIG. In FIG. 24, operation elements 2401 to 2401
The simultaneous element 2403 includes a motion element in a static “direction” and is a simultaneous element included in any of the sequential elements 2404 and 2405. In this case, since the operation element 2403 is not included in the range of the sequential element 2404, the operation element corresponding to this simultaneous element in the sequential element 2404 is:
Only the operation elements 2401 and 4022 are provided. Similarly, the operating element corresponding to this concurrent element in sequential element 2405 is:
Only the operation elements 2402 and 2403 are provided.

FIG. 25 shows the correction operation element list corresponding to the sign language word pattern candidates of FIG. 18 created in this way. By the processing in step 1006 in FIG. 10, the simultaneous element 1807 and the simultaneous element 1808, which are composed of three operation elements in FIG. Only one operating element corresponds.

Returning to FIG. 10, the processing of the last step 1007 will be described. In this step 1007, the sign language word pattern dictionary is created by modifying the contents of the sign language word template using the modifying operation element list created in step 1006. FIG. 2 shows a sign language word pattern dictionary created by modifying the sign language word template 905 of FIG. 9 using the modifying operation element list of FIG.
6 is shown. As shown in FIG. 26, the simultaneous element 2601
To 2604, motion elements recognized from the learning sign language data are added.

As described above with reference to FIGS. 1 to 26, the sign language word pattern dictionary creating system and method of the present embodiment are based on a sign language word template in which only the rough structure of the sign language is defined by the user. Then, the necessary motion elements are recognized from the learning sign language data, and the motion elements corresponding to the motion elements in the sign language word template are searched from the recognized motion elements. If the relationship between the operation elements is within an allowable range, the template is modified by the operation element to create a sign language word pattern dictionary.

As a result, the user only needs to describe the rough structure of the sign language, so that the user's labor required for creating the sign language word pattern dictionary can be reduced.
In addition, since a sign language word pattern dictionary can be created by using motion elements obtained from actual sign language, highly accurate recognition can be performed. The present invention is not limited to the embodiment described with reference to FIGS. 1 to 26, and can be variously modified without departing from the gist thereof.

[0056]

According to the present invention, a high-precision sign language word pattern dictionary capable of coping with an actual sign language operation can be automatically created, and it is possible to efficiently cope with fluctuations in sign language operation due to situations and individual differences. It is possible to easily construct a high-performance sign language recognition device that performs correct recognition.

[Brief description of the drawings]

FIG. 1 is a block diagram showing one embodiment of a configuration according to the present invention of a sign language word pattern dictionary creating system of the present invention.

FIG. 2 is a block diagram showing an example of a hardware configuration of a sign language word pattern dictionary creation system in FIG.

FIG. 3 is an explanatory diagram showing a format example of hand operation data converted by a sign language input unit in FIG. 1;

FIG. 4 is an explanatory diagram showing a format example of a motion element recognition pattern stored in a motion element recognition pattern storage unit in FIG. 1;

FIG. 5 is an explanatory diagram showing a model of a sign language motion expressed by a motion element.

FIG. 6 is an explanatory diagram showing types of motion elements constituting a sign language word.

FIG. 7 is an explanatory diagram showing an example of a description format of a sign language word template based on the model shown in FIG. 5;

FIG. 8 is an explanatory diagram showing an example of a description format of an operation element.

FIG. 9 is an explanatory diagram showing an example of a sign language word template.

FIG. 10 is a flowchart showing an embodiment of a sign language word pattern dictionary creation process according to the present invention.

FIG. 11 is an explanatory diagram showing a format example of an operation element list in a sign language word template.

FIG. 12 is an explanatory diagram showing an example of a selection range of an operation element added to the operation element list in FIG. 11;

FIG. 13 is an explanatory diagram showing an example of an operation element list extracted by the operation element extraction unit in FIG. 1;

FIG. 14 is a block diagram illustrating a configuration example of an operation element recognition unit in FIG. 1;

FIG. 15 is an explanatory diagram showing an example of a recognition result of an operation element by an operation element recognition unit based on learning data stored in a learning sign language data storage unit in FIG. 1;

FIG. 16 is an explanatory diagram showing an example of extracting a simultaneous element composed of intermittent static operation elements by the operation element recognition unit in FIG. 1;

17 is an explanatory diagram showing an example of a correspondence table of operation elements output based on a recognition result of the operation element recognition unit in FIG. 1;

FIG. 18 is an explanatory diagram showing an example of a sign language word pattern candidate created by the sign language word pattern dictionary creating section in FIG. 1;

FIG. 19 is an explanatory diagram showing an example of a relationship between simultaneous elements and sequential elements represented by the sign language word template of FIG. 9;

FIG. 20 is an explanatory diagram showing a temporal relationship between simultaneous elements in the sign language word pattern candidates of FIG. 18;

FIG. 21 is an explanatory diagram showing an example of an overlapping state between simultaneous elements represented by Expression 1.

FIG. 22 is an explanatory diagram illustrating an example of an overlapping state and an example of a gap state between sequential elements represented by Expression 2.

FIG. 23 is an explanatory diagram showing the positional relationship of each sequential element of the third sign language word pattern candidate in FIG. 18;

FIG. 24 is an explanatory diagram showing a positional relationship between a static operation element and a sequential element in a simultaneous element.

FIG. 25 is an explanatory diagram showing an example of a correcting operation element list created by the sign language word pattern dictionary creating section in FIG. 1;

FIG. 26 is an explanatory diagram showing an example of a sign language word pattern dictionary created by the sign language word pattern dictionary creating section in FIG. 1;

[Explanation of symbols]

101: sign language input unit, 102: learning sign language data storage unit, 103: motion element recognition unit, 104: motion element recognition pattern storage unit, 105: motion element list storage unit, 10
6: motion element storage unit, 107: sign language word pattern dictionary creation unit, 108: sign language word template storage unit, 109:
Sign language word pattern dictionary storage unit, 110: sign language word template input unit, 111: motion element extraction unit, 201: sign language input device, 202: character input device, 203: arithmetic device,
204: output device, 205: memory, 206: operation element recognition program, 207: operation element extraction program, 2
08: Sign language word pattern dictionary creation program, 209:
Memory, 210: motion element recognition pattern, 211: sign language word template, 212: motion element list, 213
215: memory, 301: hand position data, 30
2: x-axis data (x), 303: y-axis data (y), 304: z-axis data (z), 305: hand direction data, 306: angle around the x-axis (α), 307: y
Angle around axis (β), 308: Angle around z axis (γ),
309: finger bending data, 310: thumb second joint bending angle (α1), 311: thumb third joint bending angle (β1), 312: index finger first joint bending angle (α)
2), 313: bending angle of the second joint of the index finger (β
2), 314: bending angle (α3) of the first joint of the middle finger, 3
15: Bending angle of the second joint of the middle finger (β3), 316: Bending angle of the first joint of the ring finger (α4), 317: Second ring of the ring finger
Bending angle of joint (β4), 318: Bending angle of first joint of little finger (α5), 319: Bending angle of second joint of little finger (β5), 320-322: Information, 401: Name of motion element, 402: Number of parameters, 403 to 405: Parameter, 501 to 503: Sequential element, 504 to 506: Simultaneous element, 507 to 509: Motion element, 601: Motion element large classification, 602: Motion element small classification, 701: Sign language word name,
702: number of repetitions, 703: number of sequential elements, 704 to
706: sequential element, 707: simultaneous element number, 708 to 71
0: simultaneous elements, 711: number of operating elements, 712 to 714:
Action element, 801: Set of major and small classifications of action elements, 802: Hand type and site, 803, 804: Attributes other than large and small classifications of action elements, 901: Sign language, 902: "At the start of action State, 903: “state of linear motion”, 904: “state at the end of operation” 905: sign language word template, 906 to 908: sequential element, 90
9, 910: simultaneous element, 911: motion element “shape”, 9
12: motion element “direction”, 1101 to 1103: motion element, 1201: “up”, 1202: “upper”, 120
3: “Upper outside”, 1204: Range, 1301 to 1308:
Operation element, 1401: feature parameter extraction unit, 140
2: Parameter selection unit, 1403: Shape recognition unit, 140
4: Direction recognition unit, 1405: Position recognition unit, 1406: Straight line recognition unit, 1407: Circle recognition unit, 1501: Start point, 15
02: end point, 1503: evaluation value, 1504: operation element,
1601, 1602: “shape / a”, 1603: “shape / mo”, 1604: “shape / sa”, 1605, 160
6: time, 1701-1705: simultaneous element, 1706:
Number of combinations, 1707 to 1709: combination of motion elements, 1
710 to 1712: action element, 1801 to 1803: candidate for sign language word pattern combination, 1804 to 1806: action element, 1901 to 1903: sequential element, 2001, 2
002 to 2004: simultaneous elements, 2101 and 2102: range, 2201 to 2204: range, 2301 to 2303:
Sequential element, 2401-2403: operation element, 2404
2405: sequential element, 2601-2604: simultaneous element.

Claims (14)

[Claims] 1. A sign language word pattern dictionary for storing in advance a sign language word expressed by a combination of motion elements describing the shape, direction, position, movement manner, and the like of a hand in a sign language motion in the order of occurrence. Means for extracting the above-mentioned operation elements of the input actual sign language operation in order of time, extracting the sign language words corresponding to the extracted operation elements and the order of time from the sign language word pattern dictionary storage means, and A sign language word pattern dictionary creating system for a sign language recognition device for recognizing a sign language motion of a character language, wherein each of the above-mentioned action elements of a previously created sign language word W is extracted, and a description of each of the extracted action elements is provided. An operation element extracting means for extracting replaceable operation elements similar to the extracted operation elements at a predetermined degree based on the content; Each operation element of the actual sign language operation corresponding to the sign language word W is extracted together with the time zone in which it is generated, and among the extracted operation elements, each of the extracted operation elements matches the operation element extracted by the operation element extraction means. And an operation element recognizing unit that selects a time zone in which the generated time zone slightly overlaps with the generated time zone of each of the operation elements of the previously created sign language word W, and an operation element selected by the operation element recognition unit. It is possible to specify the operation elements in which the respective time zones in which the respective operation elements have occurred are not inconsistent with the generation time of the respective operation elements of the previously created sign language word W, and to replace the specified operation elements. At least a sign language word pattern dictionary creating means for modifying the sign language word W in addition to each of the motion elements of the sign language word W; Language word pattern dictionary generation system words W, characterized in that stored in the sign language word pattern dictionary storage means. 2. The sign language word pattern dictionary creation system according to claim 1, wherein the operation element extracting means includes a predetermined range of a space around each operation element of the previously created sign language word W. A sign language word pattern dictionary creation system, wherein the same kind of action elements to be extracted are extracted as action elements that can be replaced with each action element of the sign language word W. 3. The sign language word pattern dictionary creation system according to claim 1, wherein the sign language word pattern dictionary creation means includes: each of the operation elements selected by the operation element recognition means; One or more combinations of the motion elements expressing the sign language word W are generated by replacing each of the motion elements of the sign language word W that can be replaced, and the arrangement of the time zones of the motion elements among the generated combinations. Of the sign language word W, extracts a combination within a predetermined allowable value with respect to the order of occurrence of each operation element in the sign language word W, and replaces each of the extracted combination of operation elements with the sign language word W. A sign language word pattern dictionary creation system, wherein the sign language word W is corrected in addition to the above-mentioned respective operation elements. 4. The sign language word pattern dictionary creation system according to claim 3, wherein the sign language word pattern dictionary creation means is capable of replacing each of the operation elements selected by the operation element recognition means with each of the operation elements. Each motion element of the sign language word W created in advance is grouped as a simultaneous element, and the simultaneous element is the hand shape in the sign language motion,
Classify whether it consists of a static operation element that describes a static state such as direction and position, or a dynamic operation element that describes a dynamic state such as the way of hand movement in the sign language operation. A sign language word pattern dictionary creation system, wherein the combination is generated for each of the simultaneous elements. 5. The sign language word pattern dictionary creating system according to claim 6, wherein each operation element of the sign language word W which occurs in the same time zone is grouped as a sequential element in the simultaneous element unit. A sign language word pattern dictionary creation system, characterized in that the sign elements are arranged to express the sign language word W. 6. The sign language word pattern dictionary creation system according to claim 5, wherein the sign language word pattern dictionary creation means is configured such that the simultaneous elements constituting the sequential elements are static simultaneous elements composed of the static operation elements. For example, a time zone including at least one occurrence time zone of each operation element of the same static simultaneous element is obtained as a time zone of the static simultaneous element, and the simultaneous element forming the sequential element is the dynamic operation. If it is a dynamic simultaneous element composed of elements, the time zone of each operation element of the dynamic simultaneous element is determined as the time zone of the simultaneous element, and all of the determined time zones of the simultaneous elements constituting the sequential element are calculated. The time zone including the sequential element is obtained as the time zone of the sequential element, and the difference between the obtained sequence of the time zones of the sequential elements and the sequence of the sequential elements of the sign language word W is within the predetermined threshold. A combination A sign language word pattern dictionary creation system characterized by extraction. 7. The sign language word pattern dictionary creating system according to claim 6, wherein the sign language word pattern dictionary creating means includes the operating element among the operating elements constituting the extracted simultaneous elements of each combination. The operation elements of the sequential elements that occur outside of the obtained time zone are deleted from the simultaneous elements, and each of the operation elements of the remaining simultaneous elements is converted to the sign language word W by the simultaneous element unit and the sequential element unit. A sign language word pattern dictionary creation system, wherein the sign language word W is additionally corrected. 8. A sign language word expressed in a combination in which motion elements describing the shape, direction, position, movement manner, and the like of a hand in a sign language motion are stored in advance as a sign language word pattern dictionary. Extracting the above-mentioned respective operation elements of the input actual sign language operation in order of time, extracting the sign language words corresponding to the extracted operation elements and the order of time from the above-described sign language word pattern dictionary, and recognizing the actual sign language operation. A method of creating a sign language word pattern dictionary in a sign language recognition apparatus to perform the method, comprising extracting the above-mentioned operation elements of a sign language word W created in advance, and extracting the above-mentioned extraction elements based on the description contents of each of the extracted operation elements. A first step of extracting each replaceable operation element similar to each of the obtained operation elements at a predetermined degree, and an actual operation corresponding to the sign language word W. Each of the motion elements of the sign language motion is extracted together with the time zone in which each of the motion elements has occurred. A second step of selecting one that at least overlaps with the occurrence time zone of each of the motion elements of the pre-created sign language word W, and each of the motion elements is generated from each of the motion elements selected in the second step. Each time zone specifies an operation element that is not inconsistent with the generation time of each operation element of the sign language word W created in advance,
A third step of adding each of the specified operation elements to each of the replaceable operation elements of the sign language word W to correct the sign language word W.
Storing the sign language word W corrected in step (c) in the sign language word pattern dictionary storage means. 9. The sign language word pattern dictionary creating method according to claim 8, wherein the third step is each operation of the sign language word W capable of replacing each operation element selected in the second step. A fourth step of generating one or more combinations of the respective motion elements expressing the sign language word W by replacing the elements, and of the arrangement of the time zones of the respective motion elements among the combinations generated in the fourth step. The fifth step is a step of extracting a combination within a predetermined allowable value with respect to the time order in which each operation element occurs in the sign language word W, and the operation element of the combination extracted in the fifth step is A sixth step of modifying the sign language word W in addition to each of the action elements of the sign language word W which can be replaced. Law. 10. The sign language word pattern dictionary creating method according to claim 9, wherein, in the fourth step, each of the operation elements selected in the second step can be replaced with each of the operation elements. Of each of the sign language words W as a simultaneous element, and the simultaneous element is
A static motion element that describes a static state such as the shape, direction, and position of the hand in the sign language motion, or a dynamic state such as a way of moving the hand in the sign language motion is described A method for creating a sign language word pattern dictionary, characterized by classifying which one of the dynamic action elements is included and generating a combination for each of the above-mentioned simultaneous elements. 11. The method for creating a sign language word pattern dictionary according to claim 10, wherein each operation element of the sign language word W, which occurs in the same time zone, is grouped as a sequential element for each of the simultaneous elements, and A method for creating a sign language word pattern dictionary, comprising: arranging the above-described respective operation elements to express the sign language word W. 12. The method of creating a sign language word pattern dictionary according to claim 11, wherein in the fifth step, the simultaneous elements constituting the sequential elements are static simultaneous elements composed of the static operation elements. A time zone including at least one occurrence time zone of each operation element of the same static simultaneous element is obtained as a time zone of the static simultaneous element, and the simultaneous element forming the sequential element is the dynamic operation element. In the case of the dynamic simultaneous element, the time zone of each operation element of the dynamic simultaneous element is obtained as the time zone of the simultaneous element, and all the obtained time zones of the simultaneous elements constituting the sequential element are included. A time zone is obtained as the time zone of the sequential element, and the difference between the obtained time zone sequence of each sequential element and the sequence of each sequential element of the sign language word W is within the preset threshold. Extract combinations A method for creating a sign language word pattern dictionary. 13. The sign language word pattern dictionary creating method according to claim 12, wherein, in the sixth step, the operation is performed among the operation elements constituting the simultaneous elements of each combination extracted in the fifth step. The operation element of the sequential element including the element which is generated at a time other than the time zone obtained in the fifth step is deleted from the simultaneous element, and each of the remaining operation elements of the simultaneous element is deleted by the simultaneous element unit and the sequential element A method for creating a sign language word pattern dictionary, wherein the sign language word W is corrected in addition to the sign language word W in units. 14. The sign language word pattern dictionary creating system according to any one of claims 8 to 13, wherein the sign language word W is expressed by repeating the same sign language operation two or more predetermined times. For each of the predetermined number of repetitions of the actual sign language operation for the sign language word W, the operation elements in the second and third steps that do not contradict in the order of the occurrence time are repeatedly specified, and the occurrence time specified in all of the repetitions is specified. A method for creating a sign language word pattern dictionary, characterized by adding operation elements that do not contradict in order to each operation element of the replaceable sign language word W.