JP2005222504A - Information display - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To obtain an information display capable of providing 3D animation with high power of expression of information while maintaining high interactivity. <P>SOLUTION: The information display 1 is characterized in that it is provided with a monitoring part 113 which monitors elements of a 3D model 111 appearing on a two-dimensional screen 18 and notifies a fact that the information lacks when lack of the information is detected and an information lack prevention part 114 which operates the 3D model upon receiving notification of the monitoring part and prevents the lack of meaning expressed by operations by the 3D model. The 3D animation with the high power of expression of the information is provided while maintaining the high interactivity of a system for a user by adding elements to complement the information lost from the operations expressed by the 3D model by another method. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an information display device using a 3D (3-dimension) animation for the purpose of causing a 3D model to express a motion having a specific meaning such as a sign language, a gesture, or a pantomime.

  In the 3D animation display device for presenting information by model movement, change, etc., it is 2D from the relationship between the viewpoint of the user placed in the virtual space and the 3D model having the 3D information also placed in the virtual space. The image projected on the screen is obtained by calculation and displayed on the screen. There is a sign language animation display device as an example of a system that creates and displays a 3D animation that expresses a sentence or a meaning to be expressed. As disclosed in Japanese Patent Laid-Open No. 5-26448, a typical sign language animation display device that uses a sentence as an input and obtains a 3D animation that expresses a sign language by performing an action that represents the meaning of the sentence in a 3D model that imitates a human being. A typical processing process is as follows.

(1) Sentence input: A sentence is input by a sentence input means such as a keyboard.
(2) Sentence analysis: The sentence is morphologically analyzed and the parts of speech are assigned and decomposed into words.
(3) Data reading: The operation command information for the 3D model assigned to the word is read from the registered dictionary, and time-series data serving as an operation command to the 3D model is created.
(4) Data correction: Time series data is completed by complementing and correcting data that cannot be solved by simple assignment of data such as inter-word parts and adverbs.
(5) Animation output: After an instruction to start playback from the user, the 3D model is operated according to time-series data, and a two-dimensional projection image is determined from the relationship with the viewpoint and depicted on the two-dimensional screen.

  In recent years, "a method for improving the readability of sign language animation by dynamically expanding the hand" Tomohiro Kuroda, Kunihiro Chihara: Human Interface Symposium '99 Proceedings, pp. As disclosed in JP-A-8-16821, there is a sign language animation display system that enlarges the hand portion of a 3D human body model that expresses a sign language animation to be generated to improve the readability of the sign language.

JP-A-6-243230 Japanese Patent Laid-Open No. 8-16821 Thesis, “A method for improving the readability of sign language animation by dynamically expanding the hand”, Tomohiro Kuroda, Kunihiro Chihara: Human Interface Symposium '99 Proceedings, pp. 721-724

  Incidentally, the system as disclosed in Patent Document 1 has the following problems. In other words, compared to a system that displays a moving image of actual motion, the 3D model is not sufficiently detailed and does not include 3D information, so the perspective and depth information of the motion is easily lost. There were problems such as. For example, in sign language, the action of extending only two forefinger and middle finger from the hand holding the finger of the dominant arm and bringing it closer to the face means “look” if the action is directed toward the eyes, If you go to the side of your nose, it means “smell”. When the 3D model performs such an operation, the two sign languages may be easily mistaken depending on the positional relationship between the viewpoint and the model. There are many examples of such sign language.

The system as in Patent Document 2 has the following problems.
In addition to motion animation that expresses meaning, an animation effect such as enlargement for emphasis may be added to destroy the meaning of motion animation. That is, in the case of sign language animation, the lip portion of the human body model expressing the important meaning may be hidden by the process of enlarging the hand portion of the 3D human body model, and the meaning may be lost. For example, in a sign language action that represents “Soba” or “Udon”, the hand that is extended from the index finger and the middle finger of the hand of the dominant arm is regarded as a chopstick, with the appearance of having a buckwheat mouth. The action of handing noodles from the non-dominant arm, the shape of the hand is exactly the same, and is distinguished by the difference in the shape of the mouth that merely expresses the sound. In such an operation, the two words cannot be distinguished if the lips may be hidden by the hand enlargement operation.

  Furthermore, as with the problem of Patent Document 1, the sense of distance is lost due to enlargement, and the animation of the process of enlarging the hand is misunderstood by the viewer who sees the 3D model sticking out the hand, There was also a problem that the meaning expressed by motion animation might be broken.

  The present invention has been made in view of the above-described problems of conventional information display devices, and an object of the present invention is a 3D model determined from a 3D model arranged in a virtual space and a viewpoint of viewing the 3D model. By placing an element in the system that constantly monitors projection onto a two-dimensional image, the system user can change the viewpoint and speed freely while displaying a 3D animation. Even if there is a physical limitation such as small or low drawing ability in the image display part that displays the animation, the part of the 3D model that represents important information is always displayed on the screen by controlling the 3D model. It is to provide a new and improved information display device that is possible.

  Another object of the present invention is to add an element for supplementing information lost from the operation represented by the 3D model by another method, while maintaining high interactivity for the user of the system. A new and improved information display device capable of providing 3D animation with high expressive power is provided.

  In order to solve the above problems, according to the present invention, an information display device using 3D animation is provided. An information display device (1) according to the present invention includes a 3D model (19), which includes a plurality of elements and operates according to a command, and a command creation unit (10) that creates a command to be given to the 3D model. The animation image is displayed on the two-dimensional screen from the relationship between the two-dimensional screen (18) on which the animation image on which the 3D model operates is displayed, the 3D model, and the data representing the viewpoint in the virtual space for observing the 3D model. A drawing unit (110) to be displayed, a monitoring unit (113, 25, 33) for monitoring the element of the 3D model appearing on the two-dimensional screen, and notifying the missing fact when the lack of information is detected; An information omission prevention unit (114) that operates the 3D model in response to the notification of the unit and prevents the meaning represented by the operation of the 3D model from being lost (claim 1).

  According to such an information display device, the monitoring unit constantly monitors the elements of the 3D model (for example, the hand and the lips) appearing on the two-dimensional screen, and when the overlap is detected, the information loss prevention unit detects the 3D model. It is possible to prevent the meaning represented by the action from being lost (for example, to issue an instruction to reduce the hand to the 3D model). As a result, the user can expand the hand when the 3D model expresses a finger character even when the 3D model expresses a finger character even if the user can change the viewpoint direction in the screen while displaying the animation by the 3D model. Even when emphasis processing based on simple rules is performed, the lip portion representing the information of sign language to be expressed is displayed on the screen, so that information loss can be prevented.

  In the information display device of the present invention, the following applications are possible.

  As a configuration example of the command creation unit (10), a language input unit (11) that inputs a language that represents a meaning that the user wants to express, and a morpheme analysis unit (12) that decomposes and outputs the input language into words. ), A command for causing the 3D model to perform an operation, and a word dictionary (14) in which a correspondence relationship between word meanings is stored, and information on the word and word dictionary output from the morphological analyzer And a data creation unit (13) for creating a series of commands for performing an operation to express the meaning of the text input to the 3D model. A language (for example, a natural language such as Japanese, English, or Chinese) can be input and a 3D animation representing the meaning can be displayed.

  The command creation unit may include a motion measurement unit that measures a user's motion, and may create a command to be given to the 3D model from data measured by the motion measurement unit. It is possible to display a 3D animation representing the user's action as input.

  The monitoring unit may monitor the overlap of the elements of the 3D model on the two-dimensional screen, and may notify the other elements that information has been lost when the elements overlap (claim 4). When the elements of the 3D model overlap, it is possible to maintain the information represented by the elements appearing on the screen by notifying other elements that information has been lost.

  In addition, the monitoring unit monitors the appearance of perspective between elements of the 3D model on the 2D screen, and when it is determined that the perspective is impaired, notifies other elements that information has been lost. (Claim 5). When it is determined that the perspective between the elements of the 3D model is impaired, it is possible to maintain the information represented by the perspective by notifying other elements that information has been lost.

  In addition, the monitoring unit monitors the operation speed of the element of the 3D model on the two-dimensional screen, and when it is determined that the speed is out of a certain range, notifies the other elements that information has been lost. (Claim 6). When it is determined that the operation speed of the element of the 3D model is out of a certain range, it is possible to maintain the information represented by the speed by notifying other elements that information has been lost.

  You may make it further provide the speed change input part (115) which can change the display speed of an animation (Claim 7). The animation display speed can be changed, improving the convenience for the user.

  You may make it further provide the viewpoint change input part (116) which changes the direction of the 3D model which appears on a two-dimensional screen (Claim 8). The animation display direction can be changed, improving the convenience for the user.

  An attribute dictionary (22) storing data indicating the word, the elements of the 3D model necessary to express the meaning of the word, and the monitoring method of the element, and the output of the morphological analysis unit (21) Monitoring information for creating monitoring information data indicating the elements to be monitored on the two-dimensional screen and the monitoring method corresponding to the operation performed by the 3D model and the time at which the operation is performed using the information of the attribute dictionary And a creation unit (23). Then, the monitoring unit uses the monitoring information data created by the monitoring information creation unit to change the monitoring method and the elements to be monitored according to the operation performed by the 3D model and the time when the operation is performed, Elements on the two-dimensional screen may be monitored based on the changed monitoring method, and notification may be made when it is determined that information is missing (claim 9).

  According to this configuration, the attribute dictionary and the monitoring information creation unit create monitoring information data that specifies the elements to be monitored for each word expressed by the operation of the 3D model and the processing to be taken when information loss may occur. Thus, it is possible to specify a method for preventing information loss in more detail. As a result, it is possible to express a 3D animation that prevents information loss more widely.

  In response to the notification from the monitoring unit, an information missing complementing unit (34) for adding an element for complementing information on the two-dimensional screen may be further provided. When the monitoring information creation unit (23) determines that the monitoring unit lacks information, the monitoring information creation unit (23) further includes data indicating elements of the 3D model to be complemented and a character string representing the meaning to be complemented. Information data is created, and the monitoring unit further includes data indicating the elements of the 3D model to be complemented and character strings to be complemented in accordance with the operation performed by the 3D model and the time at which the operation is performed. When it is determined that information is missing, information to be complemented may be notified to the information missing complement unit (34).

  According to such a configuration, information that should be displayed on the screen may not be displayed on the screen due to the speed command or viewpoint change command from the user by the information missing complement unit that supplements the missing information in response to the command from the monitoring unit. Even in this case, information can be presented to the user.

  The information missing complement unit may receive a notification from the monitoring unit and display a character string for complementing the information on the two-dimensional screen as subtitles (claim 11) or the two-dimensional screen. It may be displayed as a sub-screen on top (claim 12). Or you may make it use a subtitle and a subscreen on a two-dimensional screen together. Displaying information for complementing information on the two-dimensional screen improves user convenience.

  The word dictionary may express the correspondence between language and sign language (claim 13). Further, the 3D model may represent a human body (claim 16). Sign language animation can be displayed by inputting language.

  The word dictionary consists of a modifier dictionary containing adjectives and adverbs with different data structures, and other dictionaries that contain other words, and the data generator needs to change the behavior of modifiers represented by other data. If this is the case, a part of the accumulated data may be changed (claim 14). The data creation unit can not only add data but also change part of the accumulated data.

  The data creation unit may have grammatical knowledge of sign language expressed as a connection rule between words as data (claim 15). Rather than assigning data representing words in the order in which they are entered, it is possible to change the order of the data so that the order is appropriate for sign language.

  According to another aspect of the present invention, there are provided a program for causing a computer to function as the information display device, and a computer-readable recording medium on which the program is recorded. Here, the program may be described in any programming language. In addition, as a recording medium, for example, a recording medium that is currently used as a recording medium capable of recording a program, such as a CD-ROM, a DVD-ROM, or a flexible disk (FD), or any recording medium that is used in the future. Can be adopted.

  In the above description, the reference numerals in parentheses attached to the constituent elements are merely shown as examples of corresponding constituent elements in the embodiments and drawings described below for easy understanding. It is not limited to.

  As described above, according to the present invention, an element that constantly monitors the projection of a 3D model onto a two-dimensional image determined from the 3D model arranged in the virtual space and the viewpoint of viewing the 3D model is arranged in the system. As a result, the system user can change the viewpoint and speed freely while displaying the 3D animation, or the image display part that displays the 3D animation is small, the drawing ability is low, etc. Even when there is a physical limitation, it is possible to control the 3D model so that a part of the 3D model that represents important information always appears on the screen.

  In addition, by adding elements to complement the information lost from the motion represented by the 3D model by another method, 3D animation with high information expressive power is maintained while maintaining high interactivity for users of the system. It is possible to provide.

  Exemplary embodiments of an information display apparatus according to the present invention will be described below in detail with reference to the accompanying drawings. In the present specification and drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant description is omitted.

(First embodiment)
In the first embodiment, a sign language animation representing the meaning of the input Japanese sentence is displayed, and the state of the lips of the 3D human body model and the hand element on the 2D screen is monitored, An example of a system configuration for preventing the information expressed by the lips from being lost by overlapping with the hand will be described.

FIG. 1 is a block diagram showing the first embodiment.
As shown in FIG. 1, the information display apparatus 1 according to the present embodiment includes a command creation unit 10, a timer 17, a two-dimensional screen 18, a 3D model 19, a drawing unit 110, a 3D model 111, , A monitoring unit 113, an information loss prevention unit 114, a viewpoint change input unit 115 that changes the viewpoint 112, and a speed change input unit 116. The command creation unit 10 includes a sentence input unit 11, a morpheme analysis unit 12, a time series data creation unit 13 that creates time series data 16, a word dictionary 14, and a modification dictionary 15. A 3D model 111 is displayed on the two-dimensional screen 18. Each component will be described in detail below.

  The sentence input unit 11 is a functional unit that is used by a user to input a sentence having a meaning that is desired to be represented by a 3D animation. Various forms are assumed, such as accepting character input using a keyboard and inputting voice input into text.

  The morpheme analysis unit 12 is a functional unit that performs morphological analysis on an input sentence, assigns parts of speech, and divides it into words.

  The time series data creation unit 13 searches the word dictionary 14 using the divided words as keys, reads out the time series data corresponding to the words from the dictionary, accumulates them as time series data 16, and corrects and adds the data as necessary. It is a functional part to do.

  The word dictionary 14 is a storage unit that holds data for causing the 3D model 19 to express the actions constituting the sign language word. Details of the word dictionary 14 will be described later with reference to FIGS.

  The modification dictionary 15 is a storage unit that holds data for causing the 3D model 19 to express an action that constitutes a sign language word having an adverb or adjective meaning. The dictionaries 15 for modification include data other than for representing actions representing nouns, verbs, and conjunctions, are referred to by the time-series data creation unit, and are used to create and change time-series data. Details of the decoration dictionary 15 will be described later with reference to FIG.

  The time series data 16 is data for issuing an operation command to the 3D model 19 created by the time series data creation unit 13.

  The timer 17 reads the time series data with the passage of time and updates the state of the 3D model 19.

  The two-dimensional screen 18 is a portion where a 3D animation is displayed.

  The 3D model 19 is an example of a human body model that actually expresses movement. Details of the 3D model 19 will be described later with reference to FIGS.

  The rendering unit 110 is a functional unit that renders the 3D model 19 as the 3D model 111 on the two-dimensional screen 18 from the relationship between the viewpoint 112 and the 3D model 19 at regular intervals independent of the timer 17.

  The viewpoint 112 is data defined as a vector in a three-dimensional space.

  The viewpoint change input unit 115 is a functional unit for the user to change the viewpoint 112 during 3D animation rendering.

  The speed change input unit 116 is a functional unit for the user to change the state update time interval of the timer 17. The speed of the animation can be changed by changing the update time of the timer 17.

  The monitoring unit 113 monitors the part of the 3D model 111 appearing on the two-dimensional screen 18 that is important for expressing the meaning, and notifies the information loss prevention unit 114 when the information loss is detected. It is a functional part to do. In the present embodiment, the elements of the mouth of the 3D model 111 appearing on the two-dimensional screen 18 are monitored, and when the mouth is covered with the hand of the 3D model, it is predicted that the mouth will not appear on the screen due to the operation of the 3D model. In this case, the information loss prevention unit 114 is notified.

  The information loss prevention unit 114 is a functional unit that receives a notification from the monitoring unit 113 and transmits a command for causing the viewpoint 112 or the 3D model 19 to appear on the two-dimensional screen 18.

  In this embodiment, the input to the time-series data creation unit 13 is from the sentence input unit 11, but a user's gesture or the like is used by using a three-dimensional measurement means or a data glove for measuring a human motion. It is also possible to adopt a configuration in which an action is measured, and an animation representing the intention of the action performed by the user is created by using the feature quantity of the measured data as a search key and as an input to the time-series data creation unit 13.

  Next, the 3D model 19, the word dictionary 14, and the modification dictionary 15 that are characteristic components of the present embodiment will be described.

(3D model 19)
FIG. 2 is an explanatory diagram of a 3D model of a human body that actually expresses movement.
The 3D model 19 simulates only the upper body of a human and is largely composed of a head, a neck, a torso, and both arms. The arm part has a three-joint three-link system in which three joints are connected by a rigid link, and is in contact with the body part through a shoulder joint. There is a hand on the end opposite to the shoulder end of the arm link. The joint between the shoulder and the hand is the elbow joint.

  The neck is in contact with the top of the torso and connects the head and torso. It has a joint at the connecting part. The elements of the 3D model 19 are composed of independent parts. When the shoulder joint is rotated, all elements connected to the shoulder have a hierarchical structure that rotates with the axis of the shoulder joint as the rotation axis. It is also possible to change the attributes such as the size and shape of the element.

  Each element constituting the 3D model 19 has three points called representative points. A representative point that is restrained by movement due to connection with another element is called a fixed point. By changing the relative positional relationship between the fixed point and the other two representative points, the position and orientation of the element can be freely specified. If (x0, y0, z0) in FIG. 2 is a fixed point, the posture of the forearm element can be indicated by changing the values of (x1, y1, z1) and (x2, y2, z2).

  FIG. 3 is an explanatory view showing the hand (right hand) 19a of the 3D model 19. As shown in FIG. The left hand has a similar structure with mirror symmetry. As described above, the hand 19a has three operable elements a, b, and c per finger, and a total of 15 elements with five fingers. Data for determining the shape of the finger by designating the posture of each element is stored in a finger shape data dictionary (described later with reference to FIG. 9).

  The 3D model 19 operates using relative position information with respect to two fixed points of representative points of each element for each time as an operation command. The relative position information of the representative point with respect to the fixed point is given as position vector data (described later with reference to FIG. 7). Like the upper arm for the forearm, the fixed point of the lower layer element is determined by the posture and position of the upper layer element. The basic structure of the 3D model is given as a link system in which points are connected by each element, but it is made to appear more three-dimensional by overlaying elements such as ellipsoids on the surface of the link.

  The front of the head of the 3D model is the face. The face is composed of polygons, so-called polygons. Elements on the face such as lips, eyebrows, and cheeks are similarly expressed as polygons composed of a number of vertices. The shape can be changed by changing the three-dimensional position of the vertex of the polygon. Necessary data for deformation is a mouth shape data dictionary (described later with reference to FIG. 11), an eyebrow data dictionary (described later with reference to FIG. 14), a cheek shape data dictionary (described later with reference to FIG. 15), It is given in the form shown in a jaw data dictionary (described later with reference to FIG. 16).

(Word dictionary 14)
Hereinafter, an example of the data structure in the word dictionary 14 will be described with reference to FIGS.
The inside of the word dictionary 14 is composed of a plurality of dictionaries. Here, as an example of the word dictionary 14, a word dictionary (FIG. 4), a time series data dictionary (FIG. 5), a mouth shape time series data dictionary (FIG. 6), a position vector data dictionary (FIG. 7), a hand pattern pattern dictionary (FIG. 8). ), Finger shape data dictionary (FIG. 9), mouth shape pattern dictionary (FIG. 10), mouth shape data dictionary (FIG. 11), facial expression pattern dictionary (FIG. 12), facial expression data dictionary (FIG. 13), eyebrow data dictionary (FIG. 14). ), Cheek data dictionary (FIG. 15), and chin data dictionary (FIG. 16). In the present embodiment, the language to be handled is Japanese, and the sign language expressed is Japanese sign language.

FIG. 4 is an explanatory diagram showing the configuration of the word dictionary.
An index is a number assigned to manage data. The word meaning label indicates the Japanese meaning corresponding to the sign language word represented by the data. The time series data creation unit associates Japanese words with sign language data using this label as a key. The word character label represents a Japanese character corresponding to the sign language represented by the data. This data may be used for later complement processing. The part-of-speech label represents the Japanese part-of-speech corresponding to the sign language word represented by the data. As will be described later, the processing performed by the time-series data creation unit 13 differs depending on the part of speech. The pointer to the time series data represents the configuration of the pointer of the time series data representing the corresponding word.

  In sign language, the meaning of another word may be created by combining actions that represent the meaning of different words. Therefore, two or more time-series data may be used to express one word. For example, the data of the word “park” in the table of FIG. 4 expresses that “park” is represented by a combination of a sign language action “play” and a sign language action “place”.

  The pointer to the mouth shape time series data represents mouth shape time series data representing the sound of the word. Even if the sign language action is the same, the expressed word may be different. In that case, the mouth shape data must be suitable for each word. An example of “park” is shown in the table of FIG. 4 as an example. Unlike time-series data, the pointer to mouth-shaped time-series data points to mouth-shaped data representing “Kouen”, not simply “play” and “place”. Since data can be reused in this way, it is preferable in terms of data management to increase the independence of the word dictionary, time series data, and mouth shape time series data.

FIG. 5 is an explanatory diagram showing the configuration of the time-series data dictionary.
The index is a reference key from a word dictionary or the like. This is a combination of a command expressing a sign language action, a relative time for starting the action indicated by the command, and a relative time for ending. The instruction part stores position vector data, a pointer to a bill pattern, and a pointer to an expression pattern. The type is indicated by the type of data.

FIG. 6 is an explanatory diagram showing the configuration of the mouth shape time series data dictionary.
The configuration is similar to that of the time-series data dictionary of FIG. A pointer to the mouth pattern is stored in the data portion. All keys representing the data type are the same.

FIG. 7 is an explanatory diagram showing the structure of position vector data.
The instructions to be given to the 3D model 19 in order to cause the 3D model 19 to perform a specific operation are listed. The dominant hand side of the sign language speaker is called the strong hand and the opposite hand is called the weak hand, but the representative of each element for specifying the posture, position of the model's shoulder, elbow, wrist, neck, chin in the order of strong hand and weak hand Relative position vector data for two fixed points is stored.

FIG. 8 is an explanatory diagram showing the configuration of the bill pattern dictionary.
The index referenced from the time-series data pointers in FIG. 4 and the pointers to the finger data for expressing the hand shape and the finger shape of the strong side, the weak side, or both are arranged.

FIG. 9 is an explanatory diagram showing a configuration of the finger data dictionary.
The values in each element of FIG. 9 hold the position vector data information for representing the shape of the finger of the hand 19a shown in FIG. The shape of the finger is determined based on the data indicating the posture with respect to each of the elements a, b, and c constituting the finger for the five fingers from the thumb to the little finger. The information for instructing the posture has the same configuration as the position vector data.

FIG. 10 is an explanatory diagram showing the configuration of the mouth shape pattern dictionary.
The index referenced from the time-series data pointers in FIG. 4, the sound corresponding to the mouth shape, and the pointers to the mouth-shaped data are arranged.

FIG. 11 is an explanatory diagram showing the configuration of the mouth shape data dictionary.
The index referred from the mouth shape pattern dictionary of FIG. 10 and the mouth shape are expressed as the vertex coordinates of the polygon when it is expressed as a polygon.

FIG. 12 is an explanatory diagram showing the configuration of the expression pattern dictionary.
The index referred to from the time-series data pointer in FIG. 4 and the meaning label representing the corresponding expression and the pointer to the expression data are arranged.

FIG. 13 is an explanatory diagram showing the structure of the expression data dictionary.
Index and left and right eyebrows, pointers to cheek shape pattern, left and right eyebrows, 3D coordinate position representing cheek position, pointer to pattern representing jaw shape, jaw reference 3D coordinate position is shown. Here, the three-dimensional coordinate position indicates a variable from the initial position of each element.

  FIG. 14 is an explanatory diagram showing the structure of the eyebrow data dictionary. FIG. 15 is an explanatory diagram showing the configuration of the cheek data dictionary. FIG. 16 is an explanatory diagram showing the configuration of the jaw data dictionary. Each has a set of an index referenced from the pointer of the expression data dictionary shown in FIG. 13, a name given to the shape pattern, and a vertex coordinate of the polygon expressing the shape.

(Modification dictionary 15)
Next, the internal structure of the modification dictionary 15 will be described with reference to FIG. The index, word meaning label, word character label, and part-of-speech label are the same as those in the word dictionary.

  The expression of adverb and adjective elements in sign language is different from the expression of simple nouns and verb elements. Therefore, the modification dictionary 15 has a different configuration from the word dictionary 14. Adverbs and adjective elements are expressed by adding sign language words with the meaning of each word to the sign language action sequence and by changing the actions of verbs, nouns and other elements in the sentence. There is a case. Each of the data change methods specifies one of three methods: “change operation speed”, “change operation range”, and “add word”. The changed part of speech indicates the part of speech of the word changed by this action. When adding a word, the data is empty. The last element of the data indicates the parameter of change or a pointer to a word dictionary indicating the word to be inserted.

The information display device 1 according to the present embodiment is configured as described above.
Next, the operation of this embodiment will be described.

  The flow of operation in this embodiment is shown. The flow of time series data creation is shown in FIG. 18, and the flow of animation display is shown in FIG. An example of the actual program screen operation is shown in FIG.

(1. Text input)
In step S181, the user inputs a sentence to be expressed by 3D animation using a sentence input unit such as a keyboard. When a sentence is input by voice input or the like as in step S182, the input voice is converted into a sentence by performing the voice-to-text conversion in step S183, and input to the next step.

(2. Assignment to words)
In step S184, the morpheme analyzer 12 analyzes the input sentence and decomposes it into morphemes. In step S185, parts of speech are assigned to morphemes using a general Japanese dictionary. A morpheme assigned a part of speech is hereinafter referred to as a word.

(3. Creation and editing of time series data)
(3-1. Data allocation)
The time-series data creation unit 13 reads one word, checks the part of speech of the word in step S186, and if it is a non-independent word that is not expressed as a sign language such as “te” “ni” “wo” “ha” Ignored in S187. In other cases, the word is input to the next step S188.

In step S188, it is determined whether the word part of speech is an adjective or an adverb.
If the part of speech of the word is other than an adjective or adverb, the time series data creation unit searches time series data for representing the meaning of the word from the word dictionary using the word meaning label and the part of speech name as keys in step S189. . If it is not registered in the word dictionary as a word, it is expressed by a finger character that expresses the sound represented by the character in step S1810. If it is registered as a word, the time-series data creation unit 13 reads the data from the word dictionary 14 in step S1811 and adds it to the temporary data (1) in step S1812.

  If the word is an adverb or adjective, in step S1813, time series data for representing the meaning of the word is retrieved from the modifier dictionary using the word meaning label and the part of speech name as keys. If it is not registered as a word, the process proceeds to step S1810. If it is registered as a word, the existing data is read in step S1814, and is added to temporary data (2) of a different system from temporary data (1) in step S1815.

  The processes from step S186 to step S1812, and step S1815 are repeated until there are no more words.

(3-2. Expressed with finger characters)
In step S1821, the time-series data creation unit 13 reads one character from the word character label of the word, and in step S1822 reads time-series data for expressing a finger character from the word dictionary using the character as a search key. Finger character data is added until there are no more characters in the word character label.

(3-3. Change of order)
In step S1816, the time-series data creation unit 13 arranges the set of the obtained temporary data (1) by changing the arrangement order according to the grammar expressed as the state transition between words as in the existing research.

(3-4. Complementation of position data)
In step S1817, the time-series data creation unit 13 inserts time-series data indicating a modifier word into the temporary data (1) in accordance with a command instructed by the temporary data (2). Processing is the same as in step S1811. In this step, time series data is also added in the same manner to express the behavior of a nod to show sentence breaks.

(3-5. Correction of position data)
In step S1818, the position data is corrected. For example, the adjective “large” may be applied to the noun “earthquake”. In this case, since the change method of “large” in the modifier dictionary is “change of range”, the time-series data creation section refers to the modifier dictionary and rewrites the word meaning label to “large earthquake” and sets the parameter. The range of motion is expanded by referring to the end point of the motion position of the noun “earthquake” in the sentence as a value changed by the position parameter. Furthermore, command data for expressing emphasis such as a command for causing the 3D model to enlarge the hand in order to improve visibility when the 3D model expresses with a finger character is added.

(3-6. Correction of time data)
In step S1819, the time-series data creation unit 13 assigns the same index to a group of time-series data representing a word, and adds the operation start time and operation end time expressed in relative time to the time when the previous word ended. And absolute time representation. A process for correcting the start time and the operation end time is performed in order to change the operation speed to time-series data in accordance with a command indicated by the provisional data. For example, as shown in FIG. 21, the adverb “slow” may be applied to the verb “say”. In this case, since the “slow” change method in the modification dictionary is “change speed”, the time-series data creation unit refers to the modification dictionary and rewrites the word meaning label as “slow say” and sets the parameter. The time from the start to the end of the verb “say” in the sentence is referred to as a value multiplied by the time parameter.

(3-7. Other corrections)
In step S1820, the time series data creation unit 13 interpolates the position data of the so-called crossing part, which connects the words of the time series data being edited, using a spline or the like so that the operation is smooth with reference to the time data. Process and correct.

(4. Animation display)
After the user issues an animation playback instruction in step S191, the time series data is read out in step S192, and the 3D model is operated accordingly. That is, the time series data is instructed every time the timer 17 is instructed. To tell.

  In step S193, the drawing unit calculates an image projected from the relationship between the 3D model and the vector data representing the viewpoint at a time interval independent of the timer 17, and draws it on the two-dimensional screen.

The user can perform the following operations during the operation of the animation.
a) Change the viewpoint using the viewpoint change input unit 116 on the screen.
b) The operation speed of the model is changed using the speed change input unit 115.
c) The animation display is stopped halfway by pressing the stop button.

  These processes are shown in step S194. An operation command is issued by operating the input unit shown on the screen of FIG. In step S195, a case where the user input is an end instruction is detected, and the process ends in step S196.

(4-1. Information loss prevention by monitoring)
In the case of the configuration of the present embodiment, the monitoring unit 113 constantly monitors how the lip element and the hand element of the 3D model 19 appear on the two-dimensional screen. In step S197, the monitoring unit inspects the overlap between the hand 19a on the two-dimensional screen 18 and the lips using a general overlap detection algorithm, and notifies the information loss prevention unit in step S198 if an overlap is detected. .

  An example of an algorithm for overlap detection is described below. As shown in FIG. 22, the center of gravity of the element representing the hand of the 3D model 19 is set as the center point, and the center point is determined by setting the distance between the center farthest from the center of gravity of the polygon representing the element and the center as the radius. Draw a circle at the center, and obtain the center point and radius projected on the screen from the direction of the line-of-sight vector and the distance between the circle and the screen. Obtain the Euclidean distance between the two center points on the screen, and if it is smaller than the sum of the two circle radii, determine that the two elements overlap.

(4-2. Redraw)
In step S199, the information loss prevention unit 114 receives the notification from the monitoring unit 113 and issues an instruction to the 3D model 19, that is, in the case of the configuration example of this embodiment, the hand that overlaps the lips is placed on the 3D model 19. Command to reduce. In step S1910, the 3D model operates according to the instruction. The drawing unit 110 draws the two-dimensional screen 18 reflecting the state of the 3D model 19, viewpoint, and speed changed in step S1911.

The process of (4) is repeated until there is no time series data or an end instruction is issued from the user.

(Effects of the first embodiment)
As described above, according to the present embodiment, when the monitoring unit 113 constantly monitors the hand 19a and lips of the 3D model 19 appearing on the two-dimensional screen 18, and detects their overlap, the information loss prevention unit 114 instructs the model to reduce the hand. This allows the user to change the viewpoint direction on the screen at all times while the animation is displayed by the 3D model 19, and to expand the hand when the 3D model 19 expresses a finger character. Even when emphasis processing based on the simple rule of doing is performed, the lip portion representing the information of the sign language to be expressed is displayed on the screen, and the loss of information can be prevented.

(Second Embodiment)
In the second embodiment, by adding the elements of the attribute dictionary 22, the monitoring information creation unit 23, and the monitoring information data 24 to the system configuration of the first embodiment, “overlap detection” of the elements of the 3D model 19 is performed. In addition, an example is provided to prevent information loss due to “lack of perspective”.

FIG. 23 is a block diagram showing the second embodiment.
As shown in FIG. 23, the information display device 2 according to the present embodiment includes an attribute dictionary 22 and a monitoring information creation unit 23 in addition to the components of the information display device 1 according to the first embodiment. It is configured to include. In addition, new functions are added to the timer 27, the monitoring unit 25, and the information loss prevention unit 26. In the following, description will be made focusing on these characteristic components of the present embodiment, and components having substantially the same functions as those of the first embodiment will be described with the same reference numerals. Omitted.

  The attribute dictionary 22 stores information such as which elements of the 3D model 19 should be monitored to prevent information loss and what processing should be performed to prevent loss, using words in the input sentence as keys. Storage means.

  The monitoring information creation unit 23 is a functional unit that creates the monitoring information data 24 to be referred to by the monitoring unit 25 with reference to the output of the morphological analysis unit 21 using the attribute dictionary 22 and the time series data 16.

  The monitoring information data 24 has a configuration in which data necessary for monitoring by the monitoring unit 25 is arranged in time series during the operation of the 3D model 111. It includes information about the elements of the 3D model 111 to be monitored and the status to be monitored during the 3D animation display, and contents to be instructed from the information loss prevention unit 26. This is referred to by the monitoring unit 25.

  The monitoring unit 25 refers to the monitoring information data 24 and monitors the 3D model 111 on the two-dimensional screen 18 according to the instruction content. This is a functional unit that notifies the information loss prevention unit when a loss of various types of information is detected.

  The information loss prevention unit 26 is a functional unit that receives a notification from the monitoring unit 25 and issues an instruction to the 3D model 19 or the viewpoint 112 to prevent information loss.

FIG. 24 is an explanatory diagram showing a data structure of the attribute dictionary 22.
The index of the attribute dictionary 22 contains the same value as the index of the corresponding word dictionary. This index is used to associate with a word. The monitoring target indicates an element of the 3D model 19 that the monitoring unit 25 should monitor in order to prevent a loss of information during the operation in which the 3D model 19 represents the word indicated by the index.

  The type of the monitoring algorithm indicates which state of the elements of the 3D model 19 should be monitored. Specifically, “overlap detection” or “perspective detection” is selected.

  Each parameter includes an overlap margin range and an allowable range for expressing perspective. These parameters will be described in detail later.

  The prevention algorithm indicates the type of command to be given to the 3D model 19 when a command is received from the monitoring unit 25. “Enlarged / reduced”, “rotated”, or “transparent” is selected and stored.

Each parameter stores the element transmittance, the enlargement / reduction ratio, and the rotation speed.
The configuration of the monitoring information data 24 is as shown in FIG. The index (index) of the monitoring information data contains the same value as the index of the corresponding time series data. Further, the operation start time and end time indicate the start time and end time of the unit of motion representing meaning, and are obtained from time series data. Other parameters are the same as the data possessed by the attribute dictionary 25.

The information display device 2 according to the present embodiment is configured as described above.
Next, the operation of this embodiment will be described.

  From the flow of operations in the second embodiment, FIG. 26 shows the flow of creating monitoring information data, and FIG. 27 shows the subsequent animation display processing.

(1. Text input), (2. Assignment to word), (3. Creation and editing of time series data) are the same as those in the first embodiment.

(4-b: Creation of monitoring information data)
The monitoring information creation unit 23 creates monitoring information data in the flow shown in FIG.
In step S261, the monitoring information creation unit 23 reads one piece of data from the time series data 16 created.

  In step S262, the monitoring information creation unit 23 searches the attribute dictionary 22 using the index of the read data as a key. If there is no corresponding data, the process returns to step S261 to read the next data. If there is such data, in step S263, the start time and end time of the operation unit expressing the meaning are extracted from the time series data, and the algorithm selection, algorithm target, parameter, prevention for each time are selected from the attribute dictionary. The algorithm and parameters are read out and added to the data in step S264. The processing from step S261 to step S264 is repeated until there is no time series data, and the completed data is set as monitoring information data.

(5-b: Animation display)
Up to step S196, the process is the same as in the first embodiment. In parallel with these processes, data is read from the monitoring information data to the monitoring unit 25.

  In step S <b> 271, the monitoring unit 25 reads the monitoring information data in synchronization with the operation state of the 3D model in response to a command from the timer 27.

  In step S272, the monitoring unit 25 performs a process for preventing loss to be notified to the element to be monitored, the state to be monitored and the algorithm for monitoring, and the information loss prevention unit 26 in accordance with the data read in step S271. When the monitoring information data has a process of “overlap detection”, the algorithm used for detection is the same as that in the first embodiment, but in this embodiment, the elements of the 3D model to be monitored, the margin The range can be specified arbitrarily. Here, the margin range means that a command from the monitoring unit 25 is generated with a margin in a state where overlap occurs by enlarging the radius of a circle actually displayed on the two-dimensional screen 18 by a value specified by a parameter. It is the range of the margin that can be made.

  An algorithm for detecting missing information when the monitoring state specified by the monitoring information data is “perspective detection” will be described with reference to FIG. Three points in connected elements on the 3D model 19 are monitored, and when the movement of the element changed by the movement is linear, the information loss prevention unit 26 is notified that the perspective has been lost. Specifically, two vectors are set for three points on each element, the change in the angle of the vector is calculated, and when the value is less than or equal to the parameter value of the monitoring information data, the information loss prevention unit 26 A command is generated. This vector is calculated from the positional relationship on the two-dimensional plane, ignoring the three-dimensional information of the 3D model 19. Although P2 moves to P2 'by the command of the time series data, it is assumed that a sense of perspective is expressed in the example of FIG. 28A and is missing in the example of FIG.

  In step S273, the monitoring unit 25 observes the specified element based on the specified algorithm, and notifies the information loss prevention unit 26 in step S274 when the information loss is detected. The notification includes information on what information loss prevention processing the information loss prevention unit 26 performs for which element of the 3D model.

  Receiving the command from the monitoring unit 25 in step S275, the information loss prevention unit 26 performs any one of “enlargement / reduction”, “rotation”, and “transmission” on the 3D model. In the case of “enlargement / reduction”, the element is enlarged or reduced using the value of the parameter indicated in the monitoring information data as a magnification. In the case of “rotation”, the 3D model is rotated around the center axis of the body using the parameter value indicated in the monitoring information data as the rotation amount. In the case of “transmission”, the element is made translucent or transparent by using the parameter value indicated in the monitoring information data as the light transmittance of the object.

  In step S276, the 3D model 19 or the viewpoint operates according to the instruction notified by the information loss prevention unit 26.

  In step S277, the drawing unit 110 draws the two-dimensional image again from the updated viewpoint and information on the 3D model 19.

  The process of 5-b is repeated until there is no time series data.

(Effect of the second embodiment)
As described above, according to the present embodiment, the attribute dictionary 22 and the monitoring information creation unit 23 are used when the elements to be monitored for each word expressed by the operation of the 3D model 19 and information loss may occur. By creating monitoring information data that specifies the processing to be performed, it is possible to specify a method for preventing information loss in more detail. As a result, it is possible to express a 3D animation in which information loss is prevented more widely than in the first embodiment.

(Third embodiment)
In the third embodiment, a 3D model is created by a user's operation or the like by adding an element of complementary information to the monitoring information data of the second embodiment and further adding an element of an information missing complement unit 34 to the system. An example of a configuration for complementing information missing from an animation to be represented by information presentation different from the operation of the 3D model is shown.

FIG. 29 is a block diagram showing the third embodiment.
As shown in FIG. 29, the information display device 3 according to the present embodiment includes a sub-screen 35 or a sub screen 35 on the two-dimensional screen 18 in addition to the components of the information display device 2 according to the second embodiment. The subtitle 36 is included. In addition, new functions are added to the monitoring unit 33 and the missing information interpolation unit 34. In the following, description will be made focusing on the components that are characteristic of the present embodiment, and components having substantially the same functions as those of the first and second embodiments will be denoted by the same reference numerals. Duplicate explanation is omitted.

  The monitoring unit 33 monitors the elements specified by the monitoring information data among the elements of the 3D model 111 drawn on the two-dimensional screen 18 according to the monitoring information data 31 according to the same specified algorithm. When it is detected, it is notified to the information loss complementing unit 34. The content of the notification includes the method of completion and the content of the data to be supplemented.

  As the information loss complementing unit 34, two types of display means such as subtitle display means and sub-screen display means are assumed.

  The sub screen 35 is a screen for enlarging only a part of the elements of the 3D model 19 and displaying the enlarged images on the two-dimensional screen 18.

  The caption 36 displays characters representing the meaning of the operation represented by the 3D model 19 in an overlapping manner on the two-dimensional screen 18.

  The configuration of the monitoring information data 31 to which the supplementary information 32 is added is shown in FIG. The character string to be displayed by the caption display means is stored in the caption data. The sub-screen data stores elements to be displayed on the sub-screen, that is, mouth shape data and pointers to bill data. Each is read from the time-series data by the monitoring information creation unit 23.

  Further, “speed detection” is added as a monitoring algorithm of the attribute dictionary 22. This is to obtain the operation speed of the element by differentiating the moving average on the screen at the position of the center of gravity of the element. This will be described with reference to FIG. The center of gravity advances by a distance D0 between time T0 and time T1. From this, the speed can be obtained by the calculation of V = D0 / T1-T0. If this value is outside the range indicated by the parameter, it is determined that the speed information has been lost and notifies the information loss complementing unit 34.

The information display device 3 according to the present embodiment is configured as described above.
Next, the operation of this embodiment will be described.

  The steps up to (1. sentence input), (2. assignment to word), and (3. creation and editing of time series data) are the same as those in the first and second embodiments.

(4-c: Creation of monitoring information data)
The steps themselves are the same as (4-b) in the second embodiment, but the structure of the retrieved monitoring information data is different from that in the second embodiment as described above. Read subtitle data and sub-screen data in the same way as other data.

(5-c: Animation display)
The animation display flow is shown in FIG.

  When the information missing complementing unit 34 is notified by the monitoring unit 33 that the information of the elements of the 3D model 111 appearing on the two-dimensional screen 18 is missing, the information missing complementing unit 34 supplements the missing information on the two-dimensional screen. For the display for the purpose.

  Steps S191 to S196 are the same as those in the first and second embodiments. In parallel with these processes, the monitoring information data is read into the monitoring unit 33.

  In step S <b> 311, the monitoring unit 33 reads the monitoring information data in synchronization with the operation status of the 3D model 19 in response to a command from the timer 27.

  In step S312, the monitoring unit 33 determines the element to be monitored, the state to be monitored and the algorithm for the monitoring, and information on the contents to be complemented to be notified to the information loss complementing unit 34 according to the data read in step S311.

  In step S273, the monitoring unit 33 observes the designated element based on the designated algorithm, and notifies the information missing complementing unit 34 in step S313 when the missing information is detected. The notification includes information on what kind of information complement processing is performed.

  In step S314, the information loss complementing unit 34 that has received a command from the monitoring unit 33 performs either “subtitle display” or “sub screen addition” processing. In the case of the sub-screen display, as shown in FIG. 32, a sub-screen 35 on which the enlarged image of the lips and the enlarged image of the hand are superimposed on the two-dimensional screen 28 is displayed. In the case of subtitle display, as shown in FIG. 33, the meaning of the operation is displayed as the subtitle 36 on the two-dimensional screen 18.

  In step S316, the drawing unit redraws the 2D image from the updated viewpoint and information on the 3D model, and further displays the subtitle or sub-screen on the 2D screen.

  The process of (5-c) is repeated until there is no time series data.

(Effect of the third embodiment)
As described above, according to this embodiment, the model is displayed on the screen by the speed command from the user and the viewpoint change command by the information missing complement unit 34 that supplements the missing information in response to the command from the monitoring unit. Information can be presented to the user even if the information that should have been lost.

  Furthermore, when displaying sign language animation for learning and other purposes, if there are many elements that the user should pay attention to, such as the 3D model moving both hands at the same time, the user changes the viewpoint and looks closely at the elements he / she wants to see The viewpoint may be changed so that it is possible. In this case, information that can be presented to the user as a whole system is maintained by displaying on the sub-screen the information based on the elements that are missing from the screen due to the viewpoint changing operation.

  Similarly, when the user has changed the speed, if information transmitted by the speed of movement such as adverbs is missing, it is possible to maintain information that can be presented to the user as a whole system by complementing the information as subtitles .

  The preferred embodiment of the information display device according to the present invention has been described above with reference to the accompanying drawings, but the present invention is not limited to such an example. It will be obvious to those skilled in the art that various changes or modifications can be conceived within the scope of the technical idea described in the claims, and these are naturally within the technical scope of the present invention. It is understood that it belongs.

  For example, in the above embodiment, an information display device that displays a sign language animation has been described. However, not only a sign language but also an animation display that causes a 3D model to perform an operation for expressing a specific meaning such as a hand flag signal, pantomime, and dance. Applicable to the system.

  In the above embodiment, the dictionary search is performed in Japanese. However, it is also possible to provide an animation display system in other foreign languages by changing the dictionary data.

  In the above embodiment, an example of an information display device expressed as software on a PC is shown. However, the information display device is not limited to a PC, and may be a mobile phone, a tablet PC, a PDA, or the like, or dedicated hardware may be prepared.

  In the above embodiment, the configuration of each dictionary is shown as a table, but a different data structure such as a tree may be used.

  In the above embodiment, an example of an algorithm for overlap detection, perspective detection, and speed detection has been described, but another algorithm that can obtain the same effect may be used.

  In the above embodiment, the operation command for the 3D model is given as a position vector, but it may be specified by another method such as an angle vector for specifying the angle of each joint axis of the model.

  In the second and third embodiments, the system having the information loss prevention unit and the system having the information loss complementation unit are configured separately, but these elements are not exclusive and have both elements. It is good.

  In the above embodiment, a 3D human body model is designed. However, the present invention is not limited to this model, and a system configuration in which a model representing the whole body of a human body or a simplified model of only an arm is possible.

  In the above embodiment, the 3D human body model is integrated, but a plurality of 3D human body models may be provided.

  INDUSTRIAL APPLICABILITY The present invention can be used for an information display device using a 3D (3-dimension) animation for the purpose of expressing a motion having a specific meaning such as a sign language, a gesture, or a mime in a 3D model.

It is a block diagram which shows 1st Embodiment. It is explanatory drawing which shows the representation method of the posture of a human body 3D model and its element. It is explanatory drawing which shows the example of 3D model of a right hand tip. It is explanatory drawing which shows the structure of a word dictionary. It is explanatory drawing which shows the structure of a time series data dictionary. It is explanatory drawing which shows the structure of a mouth shape time series data dictionary. It is explanatory drawing which shows the structure of position vector data. It is explanatory drawing which shows the structure of a bill pattern dictionary. It is explanatory drawing which shows the structure of a finger shape data dictionary. It is explanatory drawing which shows the structure of a mouth shape pattern dictionary. It is explanatory drawing which shows the structure of a mouth shape data dictionary. It is explanatory drawing which shows the structure of an expression pattern dictionary. It is explanatory drawing which shows the structure of an expression data dictionary. It is explanatory drawing which shows the structure of an eyebrow data dictionary. It is explanatory drawing which shows the structure of a cheek shape data dictionary. It is explanatory drawing which shows the structure of a jaw data dictionary. It is explanatory drawing which shows the internal structure of the dictionary for decoration. It is explanatory drawing which shows the flow of time series data creation. It is explanatory drawing which shows the flow of a display of animation. It is explanatory drawing which shows the example of a screen operation | movement of an actual program. It is explanatory drawing which shows the example of the time series data change by an adverb. It is explanatory drawing which shows the example of overlap detection. It is a block diagram which shows 2nd Embodiment. It is explanatory drawing which shows the structure of the data of an attribute dictionary. It is explanatory drawing which shows the structure of monitoring information data. It is explanatory drawing which shows the flow of monitoring information data creation. It is explanatory drawing which shows an animation display process. It is explanatory drawing which shows the example of perspective detection. It is a block diagram which shows 3rd Embodiment. It is explanatory drawing which shows the example of speed detection. It is explanatory drawing which shows the flow of an animation display. It is explanatory drawing which shows the example of the screen where the sub screen was displayed. It is explanatory drawing which shows the example of the screen on which the caption was displayed. It is explanatory drawing which shows the structure of the monitoring information data which added the information for complementation.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Information display apparatus 10 Command preparation part 11 Sentence input part 12 Morphological analysis part 13 Time series data preparation part 14 Word dictionary 15 Dictionary for modification 16 Time series data 17 Timer 18 2D screen 19 3D model 110 Drawing part 111 3D model 112 View point 113 Monitoring Unit 114 Information Loss Prevention Unit 115 Viewpoint Change Input Unit 116 Speed Change Input Unit

Claims (16)

In an information display device,
A 3D model composed of a plurality of elements and operated by commands;
A command creation unit for creating a command to be given to the 3D model;
A two-dimensional screen on which an animation image on which the 3D model operates is displayed;
A drawing unit for displaying an animation image on the two-dimensional screen from the relationship between the 3D model and data representing a viewpoint in a virtual space for observing the 3D model;
A monitoring unit for monitoring elements of the 3D model appearing on the two-dimensional screen and notifying a missing fact when a missing information is detected;
An information loss prevention unit that operates the 3D model in response to the notification from the monitoring unit and prevents the meaning represented by the operation of the 3D model from being lost;
An information display device comprising: The command creation unit
A language input section for inputting a language representing the meaning the user wants to express;
A morphological analyzer that decomposes the input language into words and outputs it,
A word dictionary in which correspondences between commands for causing the 3D model to perform operations and meanings of words are stored;
A data creation unit for creating a series of commands for performing an operation of expressing the meaning of the text input to the 3D model using the word output from the morpheme analysis unit and the information of the word dictionary;
The information display device according to claim 1, further comprising:   The said command creation part is provided with the operation | movement measurement part which measures a user's operation | movement, and produces the instruction | command given to the said 3D model from the data measured by the said operation | movement measurement part, It is characterized by the above-mentioned. The information display device described.   The monitoring unit monitors an overlap of elements of the 3D model on the two-dimensional screen, and notifies the other elements that information has been lost when the elements overlap. The information display apparatus in any one of -3.   The monitoring unit monitors the appearance of perspective between the elements of the 3D model on the two-dimensional screen, and when it is determined that the perspective is impaired, notifies other elements that information has been lost. The information display device according to claim 1, wherein the information display device is an information display device.   The monitoring unit monitors the operation speed of the element of the 3D model on the two-dimensional screen, and when it is determined that the speed is out of a certain range, notifies the other elements that information has been lost. The information display device according to claim 1, characterized in that:   The information display device according to any one of claims 1 to 6, further comprising a speed change input unit capable of changing a display speed of the animation.   The information display device according to claim 1, further comprising a viewpoint change input unit that changes a direction of a 3D model appearing on the two-dimensional screen. An attribute dictionary storing data indicating the elements of the 3D model required to represent the word and the meaning of the word and the method of monitoring the element;
Using the output of the morphological analysis unit and the information held in the attribute dictionary, the elements to be monitored on the two-dimensional screen and the monitoring method are the operations performed by the 3D model and the times at which the operations are performed. A monitoring information creation unit that creates monitoring information data shown corresponding to
Further comprising
The monitoring unit uses the monitoring information data created by the monitoring information creation unit to change the monitoring method and the elements to be monitored according to the operation performed by the 3D model and the time at which the operation is performed. The element on the two-dimensional screen is monitored based on the changed monitoring method, and notification is made when it is determined that information is missing. Information display device. In response to the notification from the monitoring unit, the information processing unit further includes an information missing complementing unit that adds an element for complementing information on the two-dimensional screen,
The monitoring information creation unit further includes data indicating elements of the 3D model to be supplemented and a character string representing a meaning to be supplemented when the monitoring unit determines that the information is missing. Create data,
The monitoring unit further changes the data indicating the elements of the 3D model to be complemented and the character string to be complemented according to the operation performed by the 3D model and the time at which the operation is performed, 10. The information display device according to claim 9, wherein when it is determined that information is missing, information to be complemented is notified to the information missing complement unit.   11. The information display according to claim 10, wherein the missing information complement unit displays a character string for complementing information on the two-dimensional screen as a subtitle in response to a notification from the monitoring unit. apparatus.   The information missing complement unit displays an element for complementing information on the two-dimensional screen as a sub-screen on the two-dimensional screen in response to a notification from the monitoring unit. Or the information display apparatus of 11.   The information display device according to claim 2, wherein the word dictionary expresses a correspondence relationship between a language and sign language. The word dictionary is composed of a modifier dictionary including adjectives and adverbs having different data structures, and other dictionaries including other words.
The said data preparation part changes a part of accumulated data, when a modifier requires the change of the operation | movement represented by other data, The said data creation part changes the part of the stored data, It is characterized by the above-mentioned. Information display device.   The information display device according to claim 13 or 14, wherein the data creation unit has, as data, grammatical knowledge of sign language expressed as a connection rule between words.   The information display device according to claim 1, wherein the 3D model represents a human body.

Images