JP2007034504A - Information processor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information processor capable of handling information, which includes text data, in a user-friendly manner. <P>SOLUTION: When the user carries out a predetermined operation during displaying an animation in an electronic dictionary device, the electronic dictionary device carries out display in a mode, in which a text display column 420 displaying narration data selected by the user are displayed among narration data corresponding to the animation with the displayed animation as shown in a screen 400, and a mode, in which an important word display column 430 displaying only the keyword extracted from the selected narration data is displayed as shown in a screen 401. When the user inputs information for selecting the keyword, the electronic dictionary device carries out dictionary search in relation to the keyword. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an information processing apparatus, and more particularly, to an information processing apparatus capable of displaying text data.

  Conventionally, various techniques for handling information including text data in a user-friendly form have been disclosed.

  For example, in Patent Document 1, in an image processing apparatus, a character can be displayed together with a balloon, text data input by a user can be displayed in the balloon, and displayed in the balloon. A technique is disclosed that displays a warning when the number of characters entered in exceeds the specified value.

  Patent Document 2 discloses a technique for extracting a comment that the user is more interested in based on the frequency of use of the keyword when a comment including the keyword input by the user is extracted in the bulletin board system. ing.

Patent Document 3 discloses a technique in which text data is extracted from image data generated by reading image data with a scanner in a document search device, and is converted into a database.
Japanese Unexamined Patent Publication No. 7-44718 JP 2001-290840 A JP-A-6-348759

  However, since the techniques disclosed in Patent Document 1 and Patent Document 2 require input of text data by a user, for example, the user wishes only to browse information passively, For users who find it cumbersome to figure out if they can input information that is convenient for them, it is difficult to say that it is a technology that handles information including text data in an easy-to-use form. .

  Also, the technique disclosed in Patent Document 3 does not require the user to input text data, but only discloses that the text data extracted from the image data is made into a database. Further consideration is needed as to how the created database is utilized for the user.

  The present invention has been conceived in view of such circumstances, and an object thereof is to provide an information processing apparatus that can handle information including text data in a user-friendly form.

  An information processing apparatus according to the present invention includes an image information storage unit that stores image information, a text information storage unit that stores text information, and a display control unit that displays the image information and the text information on a display unit. The display control means extracts and displays a keyword included in the text information in response to a predetermined condition being satisfied.

  The information processing apparatus according to the present invention further includes selection means for selecting a keyword displayed on the display means, and search means for searching for information related to the keyword selected by the selection means, wherein the display Preferably, the control means displays a search result obtained by the search means.

  In the information processing apparatus according to the present invention, it is preferable that the display control unit performs control in a first display mode in which only the extracted keyword is displayed when the predetermined condition is satisfied.

  Moreover, in the information processing apparatus according to the present invention, the display control means displays the keyword extracted from the text information and a character string other than the keyword in different modes when the predetermined condition is satisfied. It is preferable to perform control in the second display mode.

  In the information processing apparatus according to the present invention, the image information storage unit stores at least one or more pieces of image information, and the text information storage unit stores at least one or more pieces of text information. Timing information storage means for storing timing information related to information and timing for displaying the text information, and the display control means controls the display of the image information and the text information based on the timing information, It is preferable to select a keyword to be extracted from the text information based on the timing information when a predetermined condition is satisfied.

  The information processing apparatus according to the present invention further includes text information selection means for selecting the text information, and the text information selection means displays when the display control means displays a plurality of the text information. It is preferable to select text information from the plurality of text information.

  In the information processing apparatus according to the present invention, the text information storage unit stores at least two or more text information as a group with respect to the image information stored in the image information storage unit, and the display control unit includes: When the predetermined condition is satisfied, it is preferable to select and display the text information from the text information of the group corresponding to the displayed image information.

  In the information processing apparatus according to the present invention, it is preferable that the timing information includes information for displaying text information stored in the text information storage unit in a predetermined order.

  In addition, an information processing apparatus according to the present invention includes a voice information storage unit that stores voice information, a voice output information storage unit that stores information related to a timing of outputting a voice stored in the voice information storage unit, It is preferable to further include voice output control means for outputting the voice information stored in the voice information storage means based on the timing information stored in the voice output information storage means.

  According to the present invention, keywords are extracted and displayed for text information displayed together with image information on the display device.

  Thereby, the user can recognize the keyword without inputting the text information of the keyword himself / herself with respect to the displayed text information.

  Therefore, in the information processing apparatus, the text information is handled in a form that is convenient for the user with respect to keyword recognition.

  Further, according to the present invention, it is possible to search for information and display the search result for the keyword selected by the selection means. Thereby, it is possible to search for information on a keyword desired by the user.

  Further, according to the present invention, only keywords extracted from the text information displayed on the display means are displayed. Thereby, the user can easily recognize a phrase that can be a search target.

  According to the present invention, in the text information displayed on the display means, the extracted keyword is displayed in a mode different from another character string. Thereby, the user can easily recognize a phrase that can be a search target, and can easily recognize a position of a phrase that can be a search target in the displayed text information.

  According to the present invention, image information and text information are displayed based on timing information. Thereby, the keyword display timing can be controlled. Further, according to the present invention, display control corresponding to a plurality of pieces of image information can be performed.

  In addition, according to the present invention, it is possible to display a plurality of pieces of text information, and it is possible to select text information from among them. Thereby, text information desired by the user can be set as a search target.

Further, according to the present invention, text information can be handled as a group.
Further, according to the present invention, it is possible to control the timing and order of displaying text information.

  Further, according to the present invention, the content of the image information can be transmitted more effectively by adding sound. Further, according to the present invention, it is possible to output sound at an appropriate timing.

  FIG. 1 is a perspective view of an electronic dictionary device 100 which is an embodiment of an information processing device of the present invention. Referring to FIG. 1, electronic dictionary device 100 is mainly composed of a first housing 110 and a second housing 120. The first casing 110 and the second casing 120 are connected to each other by a connecting portion 100A so as to be opened and closed. The first housing 110 is provided with a display unit 111 made of a liquid crystal display device or the like.

  FIG. 2 is a plan view of the electronic dictionary device 100. With further reference to FIG. 2, the second casing 120 has a power key 121 for switching on / off the power of the electronic dictionary device 100 and a menu for selecting the operation of the electronic dictionary device 100. A menu key 122 operated by the user is provided.

  One of the operations executed in the electronic dictionary device 100 is an animation display. The animation display is a function of displaying animation on the display unit 111 and displaying text information (narration) related to the animation.

  Further, the second casing 120 further includes an S jump key 123 and a display unit 111 that are operated by the user to search the dictionary for words included in the text information displayed during the animation display as described above. A switching key 124 that is operated by the user when switching displayed contents, an upper key 125A, a lower key 125B for changing a position to be selected with respect to the contents displayed on the display unit 111 in the up, down, left, and right directions, Left / right key 125C, right key 125D, search / decision key 126 for inputting information indicating the intention of determination with respect to the contents displayed on display unit 111, or information for performing dictionary search, display unit 111 The position to be selected for the content displayed in the screen, the backward key 127 for moving the content backward, and the display unit 111 The previous finding key 128 and the next finding key 129 for changing the content to be displayed to the previous item or the next item, the return key 130 for returning the content to be displayed on the display unit 111, and Dictionary application keys 131 to 138 which are keys corresponding to a plurality of dictionaries stored in the electronic dictionary device 100 are provided.

  In the electronic dictionary device 100, as will be described later, a plurality of dictionary data is stored in the storage unit 102 as a dictionary database 102A. The dictionary application keys 131 to 138 correspond to each of a plurality of dictionary data stored in the storage unit 102. Specifically, the dictionary application key 131 is a key related to a kind of national language dictionary called “Kojien”, and the dictionary application key 132 is a key related to an English dictionary such as English-Japanese dictionary and Japanese-English dictionary. The application key 133 is a key related to a kind of encyclopedia “Mypedia”, the dictionary application key 134 is a key related to an encyclopedia related to health, and the dictionary application key 135 is a key for general information about life. The dictionary application key 136 is a key related to an encyclopedia for searching general information about business, and the dictionary application key 137 is called “seven countries conversation”. It is a key related to a dictionary for searching for information about conversations in other languages, and a dictionary application key 138 is used by the user. In a key associated with the dictionary stored in the storage unit 102 by well known methods.

  FIG. 3 is a control block diagram of the electronic dictionary device 100. With reference to FIG. 3, the electronic dictionary device 100 includes a speaker 112 that outputs sound in addition to the display unit 111 described above, and further includes a control unit 101 that controls the overall operation of the electronic dictionary device 100, A storage unit 102 for storing various information, an animation playback unit 103 used for processing for playing back an animation stored in the storage unit 102 on the display unit 111, and a designated word stored in the storage unit 102. A dictionary search unit 104 that executes processing for searching in the dictionary, and a number given to the animation that indicates which title animation is being played back among the animations of a plurality of titles that can be played back in the electronic dictionary device 100 ( Animation number storage unit 105 during playback stored as animation number) and display unit 111 A narration acquisition unit 106 that stores data related to the animation to be displayed, a keyword extraction unit 107 that executes a process of extracting a keyword from narration information corresponding to the animation reproduced on the display unit 111, and the electronic dictionary device 100 Are provided with an input unit 108 for the user to input various information.

  The input unit 108 includes an animation instruction unit 108A for inputting an animation number to be displayed for animation display, and a keyword instruction unit 108B for specifying a keyword from the narration displayed together with the animation in the animation display. However, each of these units is constituted by various keys provided in the second casing 120 described with reference to FIG. In addition, all keys provided in the second housing 120 are included in the input unit 108. Then, when an operation such as pressing is performed on all keys provided in the second housing 120, the control unit 101 can recognize which key is operated.

  The storage unit 102 includes a dictionary database 102A composed of various dictionary data such as a Japanese language dictionary, an English-Japanese dictionary, and an English-English dictionary, and an animation database 102B composed of various animation data displayed on the display unit 111. The narration database 102C is composed of narration text data displayed on the display unit 111 corresponding to various animations stored in the animation database 102B, and is composed of data relating to keywords in the narration stored in the narration database 102C. Keyword database (keyword database for narration) 102D, data defining how animation and narration are displayed on the display unit 111 for each animation number ( Data constituting various databases such as an animation program database 102E composed of (animation program data) and an object pattern database 102F composed of screen configuration resources such as object patterns displayed together with animation and narration on the display unit 111 Is remembered.

  The data constituting the animation program database 102E, the animation database 102B, the narration database 102C, the narration keyword database 102D, and the object pattern database 102F are stored for each animation number. Table 1 shows how data is stored for a certain animation number in these databases.

  As can be seen from Table 1, animation program data is in the animation program database 102E, animation data is in the animation database 102B, narration data is in the narration database 102C, narration keyword data is in the narration keyword database 102D, and The object pattern data is stored in the object pattern database 102F. Each data is given a pattern number such as “0001” or “0002” for each type of data. Each of the animation data, narration data, and object pattern data is associated with contents and symbols representing the type (type) of image (bmp), text (txt), and balloon (box). Narration data consists of text data (text information). In the present embodiment, one narration data is text data displayed as one balloon.

  One animation program data is stored corresponding to one animation number.

  As for the animation data, at least one or a plurality of animation data as shown in Table 1 is stored corresponding to one animation number.

  One or more narration data is stored corresponding to each animation data. That is, in the electronic dictionary device 100, one narration may be displayed while one animation is displayed, or a plurality of narrations may be displayed. In addition, narration keyword data is stored corresponding to each narration data. Depending on the animation, the corresponding narration data may not be stored.

  The number of stored object pattern data is singular or plural regardless of the number of animation data and narration data. Examples of the object pattern data include balloon frame pattern data used when displaying narration.

  FIG. 4 is a diagram illustrating an example of animation program data. The animation program data is a program composed of a plurality of lines, and each line describes processing contents for one display. Here, the contents of each line of the animation program data will be described with reference to FIG.

  In the object pattern data, the screen number, the object type, the pattern number, the display coordinates (x), the display coordinates (y), and the weight count are described by being separated from each other by a comma.

  The screen number is a processing number when processing for animation display is performed, and is information represented by numbers such as 0001 and 0002 according to the order in which the processing is executed.

  The object type is information indicating the type of object to be processed in animation display, and is mainly marked with a three-letter alphabet. For example, an image made up of animation data is marked with bmp, text information including narration data is marked with txt, and an image representing a balloon that is an example of object pattern data is marked with box. In addition to these, voice can be cited as an object type related to animation display.

  The pattern number is a number for specifying data in each object (animation data, narration data, object pattern data). As understood from Table 1, in the electronic dictionary device 100, an object is specified by the type and pattern number of the object.

  The display coordinates (x) and the display coordinates (y) are coordinates for specifying the display position of the processing target object on the display unit 111. In the display unit 111, the x axis and the y axis are defined in advance with the upper left corner of the display unit 111 as a base point, and based on this, the display position of the object is determined by the display coordinates (x) and the display coordinates (y). Is identified.

  The wait count is the time to wait after the process for the screen number is executed until the process for the next screen number is executed.

  For example, in the first line of the animation program data shown in FIG. 4, the screen number is “0001”, the object type is “bmp”, the pattern number is “0001”, the display coordinate (x) is “0”, the display coordinate (Y) is described as “0”, and the wait count is described as “5”. This is because, as the processing of the screen number 0001, the image having the pattern number 0001, the predetermined point of the image is the base point of the display unit 111 ((x coordinate, y coordinate) = (0, 0). The y-coordinate is marked in this way.) After the process is executed, the process for the next screen number is executed after waiting for 5 seconds after the process is executed. means.

  Next, the operation of the electronic dictionary device 100 will be described by explaining the processing contents of the control unit 101. FIG. 6 is a flowchart of the main routine of the control unit 101.

  Referring to FIG. 6, when the electronic dictionary device 100 is turned on by operating the power key 121, first, the control unit 101 omits step S (hereinafter, “step” is omitted). In the electronic dictionary device 100, it is determined whether or not an operation (input) on any of various keys provided in the second casing 120 has been performed. If it is determined that an operation has been performed, the control unit 101 advances the process to S2.

  In S2, the control unit 101 determines whether or not the key input detected in S1 is for starting animation display. If it is determined to be such a key input, the process proceeds to S3. If it is determined that the key input is other than the key input, the control unit 101 executes a process corresponding to the input key in S6, and then returns the process to S1.

  In S <b> 3, the control unit 101 waits for input of information for specifying an animation number to be processed at the time of animation display. If it is determined that information specifying an animation number has been input, the animation number is stored in the reproduction animation number storage unit 105 in S4, an animation display process is performed, and the process proceeds to S5.

  In S5, the control unit 101 determines whether or not a key input for ending the animation display has been performed. If it is determined that such key input has not been made, the process returns to S3, and if it is determined that such key input has been made, the process returns to S1.

  FIG. 7 is a flowchart of a subroutine of the animation display process in S4. Referring to FIG. 7, in the animation display process, control unit 101 first acquires animation program data corresponding to the animation number stored in reproduction animation number storage unit 105 from animation program database 102E in S401. And copying to a predetermined memory in the control unit 101.

  In step S <b> 402, the control unit 101 executes a process for displaying data corresponding to the screen number currently stored in the animation reproduction unit 103 in the program data copied in step S <b> 401. Specifically, in the program data of the screen number to be processed, the information determined based on the object type and the pattern number is determined by the display coordinates (x) and the display coordinates (y) of the display unit 111. Display at the position. Note that the initial value of the screen number in the animation playback unit 103 is 0001.

  In step S <b> 403, the control unit 101 updates the screen number stored in the animation reproduction unit 103 by one.

  In step S <b> 404, the control unit 101 counts up a built-in timer for a time corresponding to the wait count in the program data of the screen number to be processed.

  In step S <b> 405, the control unit 101 determines whether the animation display of the animation number currently being processed has ended. If the control unit 101 determines that it has not ended yet, it returns the process to S402, and if it determines that it has ended, it returns the process. Note that the control unit 101 determines whether or not the animation display has ended, for example, in the program data copied in S401, whether or not the same screen number as the screen number stored in the animation reproduction unit 103 at that time exists. Judgment based on. Specifically, if the same screen number as the screen number stored in the animation playback unit 103 exists, it is determined that the animation display has not ended yet, and if it does not exist, it is determined that the animation display has ended. .

  The contents of the animation display according to the animation program shown in FIG. 4 will be described with reference to FIGS.

  8 and 9, the elapsed time when the animation display process is executed, the number (“screen”) given according to the contents of the screen displayed on the display unit 111, and the actual on the display unit 111 are shown. Are displayed in tabular form, the data of the row to be processed in the program data, and the operation content executed in the electronic dictionary device 100.

  First, referring to FIG. 8, when the animation display process is executed, the program “0001, bmp, 0001,0,0,5” in the top row in the program data shown in FIG. Corresponding to the data, after the image of pattern number 0001 (animation of the human head) is displayed at the base point of the display unit 111 as the screen “1”, the electronic dictionary device 100 remains in that state for 5 seconds. stand by.

  Next, as the screen “1”, the balloon image represented by the pattern number 0001 corresponding to the program data “0002, box, 0001,5,40,0” is displayed on the display unit 111 in FIG. It is displayed at the position (5, 40) defined by the broken lines L1 and L2 in the middle so as to be superimposed on the image of pattern number 0001, and is further referred to as “0003, txt, 0101, 15, 50, 10”. Corresponding to the program data, the narration data represented by the pattern number 0101 (“put food into the mouth”) is defined by the alternate long and short dash lines L3 and L4 in FIG. 50), the electronic dictionary device 100 waits for 10 seconds in that state. The broken lines L1 and L2 and the alternate long and short dash lines L3 and L4 are shown for reference in FIG. 8 and are not actually displayed on the display unit 111.

  Next, on the screen “2”, an image of the pattern number 0002 (animation of the human throat part) is displayed at the base point of the display unit 111 corresponding to the program data “0004, bmp, 0002,0,0,5”. ) Is displayed, the electronic dictionary device 100 stands by for 5 seconds.

  Next, as a screen “2”, a balloon image represented by a pattern number 0002 corresponding to the program data “0005, box, 0002,0,50,0” is displayed on the display unit 111 in FIG. It is displayed so as to be superimposed on the image of pattern number 0002 at the position (0, 50) defined by the broken lines L5 and L6 in the middle, and further, “0006, txt, 0201, 10, 60, 10”. Corresponding to the program data, narration data represented by pattern number 0201 (“food is carried to the stomach by peristalsis. The required time is 1 to several seconds”) is displayed on the display unit 111 in FIG. The electronic dictionary device 100 stands by for 10 seconds after being displayed so as to be further superimposed at the position (10, 60) defined by the one-dot chain lines L7, L8. The broken lines L5 and L6 and the alternate long and short dash lines L7 and L8 are shown for reference in FIG. 8 and are not actually displayed on the display unit 111.

  Next, referring to FIG. 9, an image of pattern number 0003 is displayed on the base point of display unit 111 corresponding to the program data “0007, bmp, 0003, 0, 0, 5” as screen “3”. The electronic dictionary device 100 waits in that state for 5 seconds.

  Next, on the screen “3”, the balloon image represented by the pattern number 0001 corresponding to the program data “0008, box, 0001,5,40,0” is displayed on the display 111 ((5, 5). 40) is displayed so as to be superimposed on the image of pattern number 0003, and is further represented by pattern number 0301 corresponding to the program data “0009, txt, 0301, 10, 50, 10”. Narration data (“food that enters the stomach is digested”) is displayed on the display unit 111 at a position of (10, 50) so as to be further superimposed. Wait in that state for 2 seconds.

  Next, on the screen “3”, the balloon image represented by the pattern number 0003 corresponding to the program data “0010, box, 0003,160,20,0” is displayed on the display unit 111 (160, 20) is displayed so as to be superimposed on the image of pattern number 0003, and is further represented by pattern number 0302 corresponding to the program data “0011, txt, 0302, 170, 30, 10”. Narration data ("The gastric juice contains pepsin, hydrochloric acid, and mucus, which are proteolytic enzymes") is displayed on the display unit 111 at a position of (170, 30). After that, the electronic dictionary device 100 stands by in that state for 10 seconds.

  Next, on the screen “3”, the balloon image represented by the pattern number 0004 corresponding to the data “0012, box, 0004, 0, 100, 0” is called (0, 100) on the display unit 111. The narration data ("3, txt, 0303, 10, 110, 10") corresponding to the program data "0013, txt, 0303, 10, 110, 10" is displayed at the position. The mucus prevents the stomach itself from being digested. ”) Is displayed so as to be further superimposed on the position (10, 110) on the display unit 111, and then the electronic dictionary device 100 is displayed for 10 seconds. Wait in that state.

  In the electronic dictionary device 100, when the user operates a specific key (for example, the S jump key 123) while the animation display process as described above is being executed, the electronic dictionary device 100 is displayed on the display unit 111 at that time. A dictionary search corresponding to the contents can be performed. In the electronic dictionary device 100, in response to the user operating a specific key as described above, the control unit 101 executes the interrupt search process as an interrupt process of the animation display process described above. FIG. 10 is a flowchart of the interrupt search process.

  Referring to FIG. 10, when S jump key 123 is operated, control unit 101 first determines whether there is a balloon displayed in SA1 corresponding to the animation data currently displayed on display unit 111. Determine whether. The control unit 101 detects, for example, which animation data is displayed on the display unit 111 at that time based on the screen number stored in the animation playback unit 103 at that time, and It is determined whether or not there is a balloon by determining whether or not there is narration data corresponding to the animation data displayed in. If it is determined that there is a blowout, the process proceeds to SA2. If it is determined that there is no balloon, the interrupt search process is terminated as it is, and is performed when the interrupt search process of the animation display process (see FIG. 7) is executed. Return processing to where it was.

  Then, in SA2, the control unit 101 executes a balloon selection process for selecting a balloon including a character string to be searched among balloons corresponding to the animation data displayed at that time, and then performs a SA3. Then, a keyword list creation process for creating a keyword list for the narration data included in the selected balloon is executed, and in SA4, a dictionary search is performed for the character string selected by the user and the result is displayed. After executing the keyword search process, the interrupt search process is terminated, and the process is returned to the portion of the animation display process that was being performed when the interrupt search process was executed.

FIG. 11 is a flowchart of the subroutine of the blowing selection process of FIG.
Referring to FIG. 11, in the balloon selection process, control unit 101 first causes SA 201 to display all balloons corresponding to animation data currently displayed on display unit 111 on display unit 111. Thereby, all the narration data corresponding to the animation data currently displayed on the display part 111 is displayed on the display part 111 with required object pattern data.

  In SA201, “all” means all associated narration data in the case shown in Table 1. That is, in SA201, for example, referring to Table 1 further, when an image of pattern number 0001 is displayed, narration data of pattern number 0101 is displayed, and an image of pattern number 0002 is displayed. Shows the narration data of the pattern number 0201, and when the image of the pattern number 0003 is displayed, the narration data of the pattern numbers 0301 to 0303 is displayed.

  In SA201, for example, as shown in FIG. 12, the narration data with the smallest pattern number and the balloon corresponding to the narration data are displayed in a manner different from other balloons displayed at the same time.

  FIG. 12 is a diagram showing a display screen of the display unit 111 in SA 201 when an image having the pattern number 0003 is displayed on the display unit 111 at the start of the interrupt search process. Referring to FIG. 12, balloon 301 corresponding to narration data of pattern number 0301 is displayed on screen 300, and balloons 302 and 303 corresponding to narration data of pattern numbers 0302 and 0303 are further displayed. On the screen 300, the balloon 301 corresponding to the narration data with the smallest pattern number is displayed in a reversed manner and displayed in a manner different from the other balloons (blowing 302, 303).

  In the process of SA201, when there is only one narration data corresponding to the animation data displayed at that time, the balloon corresponding to the one narration data is highlighted.

  Next, in SA202, the control unit 101 determines whether or not only one balloon is displayed on the display unit 111 at that time. Specifically, the control unit 101 determines whether there is one narration data corresponding to the animation data displayed on the display unit 101 at that time. If it is determined that the number is one, the control unit 101 proceeds to SA207, and if it is determined to be plural, the process proceeds to SA203. That is, for example, referring to Table 1 further, if an image with pattern number 0001 or pattern number 0002 is displayed at that time, the process proceeds to SA207 and an image with pattern number 0003 is displayed. In the case, the process proceeds to SA203.

  In SA <b> 203, the control unit 101 determines whether there is an input from the user with respect to any of the keys provided in the second housing 120 with respect to the electronic dictionary device 100. If it is determined that there is an input, the process proceeds to SA204.

  In SA204, the control unit 101 determines whether or not the key determined to be input in SA203 is the search / decision key 126. If so, the control unit 101 proceeds to SA207 and determines that it is not. The process proceeds to SA205.

  In SA205, the control unit 101 determines whether the key determined to have been input in SA203 is any one of the up key 125A, the down key 125B, the left key 125C, and the right key 125D. If it is determined, the process proceeds to SA206, and if not, the process returns to SA203.

  In SA206, in accordance with the key determined to have been input in SA205, the display unit 111 changes the display so as to change the balloon to be displayed in reverse, and the process returns to SA203.

  More specifically, the processing in SA206 will be described in detail. For example, when the right key 125D or the up key 125A is input in the state shown in FIG. 12, the display is reversed as shown as a screen 310 in FIG. The display content of the display unit 111 is updated so that the balloon 301 is changed from the balloon 301 to the balloon 302 displayed on the upper right with respect to the balloon 301.

  On the other hand, in SA207, the control unit 101 stores the pattern number of the narration data corresponding to the balloon highlighted at that time as “selected narration pattern number” in the memory in the control unit 101, and returns. To do.

  FIG. 14 is a flowchart of a subroutine of the keyword list creation process of SA3 in FIG.

  Referring to FIG. 14, in the keyword list creation process, control unit 101 first obtains narration data corresponding to the pattern number stored as the selected narration pattern number (hereinafter referred to as “selected narration data”) in SA301. Copy from the narration database 102C to the narration acquisition unit 106.

  Next, in SA302, the control unit 101 copies narration keyword data corresponding to the selected narration data from the narration keyword database 102D to the narration acquisition unit 106, and returns the process. Here, “corresponding narration keyword data” refers to narration keyword data assigned the same pattern number as the narration data, as described with reference to Table 1.

  FIGS. 15 to 18 are flowcharts of the SA4 keyword search process subroutine of FIG.

  First, referring to FIG. 15, in the keyword search process, control unit 101 first determines in SA401 whether or not the important word list display flag is ON. In the keyword search process, regarding the display of text data, the display unit 111 displays the selected narration data itself, that is, the text display mode in which the text data included in the selected narration data is displayed as it is, and the corresponding keyword data for narration. Are displayed in two modes, ie, an important word display mode for displaying only keywords included in (that is, in a form in which only keywords are listed). The important word list display flag is a flag that can be turned ON / OFF in the control unit 101, and is a flag for displaying in the important word display mode. Display is performed in the display mode, and display is performed in the text display mode when the display is turned off. If the control unit 101 determines in SA401 that the important word list display flag is ON, the control unit 101 proceeds to SA402, and if it is determined to be OFF, the control unit 101 proceeds to SA414 (see FIG. 16).

  FIG. 19A shows an example of a screen displayed in the text display mode, and FIG. 19B shows an example of a screen displayed in the keyword display mode.

  Referring to FIG. 19A and FIG. 19B, a text display column 410 is displayed on each of screens 400 and 401 so as to overlap the animation display shown in FIG.

  Then, as shown in FIG. 19A, on the screen 400, a text display column 420 including a tag 421 is displayed in the text display column 410. The text display column 420 displays the full text of the narration data that "the gastric juice contains pepsin, which is a proteolytic enzyme, hydrochloric acid, and mucus." In the text display column 420, the character strings “gastric juice”, “protein degrading enzyme”, “pepsin” and “hydrochloric acid” extracted as keywords in the corresponding narration keyword data are displayed in the displayed narration data. , In a manner distinguished from other characters, that is, underlined. In the screen 400, the word “stomach” written at the left end is highlighted in the important word display field 430. This means that this character is in a selected state.

  Further, as shown in FIG. 19B, on the screen 401, an important word display field 430 including a tag 431 is displayed in the text display field 410. In the important word display field 430, as described above, only the character strings extracted as keywords are displayed so as to be listed. In the screen 401, the character string (keyword) “gastric juice” written at the left end is highlighted in the important word display field 430. This means that this character string is in a selected state.

  In the electronic dictionary device 100, the display of the screen 400 and the screen 401 is configured to be switched by a user operation (specifically, input to the switching key 124), as will be described later.

  Referring to FIG. 15 again, in SA402, the control unit 101 displays the screen 401 as shown in FIG. 19B on the display unit 111, thereby displaying the important word list, and processing in SA403. Proceed.

  In SA403, the control unit 101 determines whether or not an input has been made on any of the various keys provided in the second casing 120. If it is determined that an input has been made, the control unit 101 advances the process to SA404.

  In SA404, the control unit 101 determines whether or not the key determined to have been input in SA403 is the switch key 124. If so, the process proceeds to SA405, and if not, the process proceeds to SA406.

  In SA405, the control unit 101 turns off the important word list display flag and returns the process to SA401.

  In SA406, the control unit 101 determines whether or not the key determined to have been input in SA403 is either the upper key 125A or the lower key 125B. If so, the process proceeds to SA407. The process proceeds to SA408.

  In SA407, the control unit 101 performs a process of updating the screen display on the display unit 111 so that the keyword in the state selected in the important word display field 430 is changed according to the type of the input key. Thereafter, the process returns to SA403. In SA407, for example, when the input to the upper key 125A is made in the state shown in FIG. 19B, the control unit 101 replaces “gastric fluid” displayed in the currently selected state with the next key. The display content is updated so that the keyword “protein degrading enzyme” displayed on the right side is displayed in a selected state. In addition, when an input is made to the lower key 125B in the state shown in FIG. 19B, the control unit 101 replaces “gastric fluid” displayed in the currently selected state before (usually, normally). The left side of “gastric fluid” is not displayed on the left side, so the right side is displayed.) The display content is updated so that the keyword “hydrochloric acid” displayed on the left side is displayed in a selected state.

  In SA408, the control unit 101 determines whether or not the key determined to have been input in SA403 is the search / decision key 126. If so, the process proceeds to SA409, and if not, the process proceeds to SA410. .

  In SA410, the control unit 101 determines whether the key determined to have been input in SA403 is any of the dictionary application keys 131 to 138. If so, the process proceeds to SA411, and if not, the SA412 is determined. Proceed with the process.

  In SA409, the control unit 101 causes the dictionary search unit 104 to execute a search using all searchable dictionaries for the keyword selected in the important word display field 430, and temporarily displays the search result. And the process proceeds to SA433 (see FIG. 18).

  In SA411, the control unit 101 determines that the keyword that is selected in the keyword display field 430 is input to the dictionary search unit 104 by SA403 in the dictionary application keys 131 to 138. A search using the corresponding dictionary is executed, the search result is temporarily stored, and the process proceeds to SA433 (see FIG. 18).

  Referring to FIG. 15 again, in SA412, the control unit 101 determines whether the key determined to have been input in SA403 is either the previous find key 128 or the next find key 129, and so on. If so, the process proceeds to SA413, and if not, the process returns to SA403.

  In SA413, the control unit 101 updates the pattern number stored in the memory in the control unit 101 as the “selected narration pattern number” in SA207 according to the input key, and causes SA301 (see FIG. 14) to update. Return processing. Specifically, the control unit 101, for example, when the selected narration pattern number is input to the previous finding key 128, the narration data pattern stored immediately before in the narration database 102C. When the next entry key 129 is input, the number is updated to the pattern number of the narration data stored immediately after in the narration database 102C.

  Referring to FIG. 16, in SA414, the control unit 101 displays the full text by displaying the screen 400 as shown in FIG. 19A on the display unit 111, and advances the process to SA415. The full text display is a display for the user to specify a character string to be searched for a dictionary, instead of the keyword displayed in the keyword list display. Therefore, in the following processing (particularly, SA418 to SA420, SA427 to SA429, and SA431), processing for determining a character string to be searched for a dictionary according to a user key input is performed.

  In SA415, the control unit 101 determines whether or not an input has been made on any of the various keys provided in the second casing 120. If it is determined that an input has been made, the control unit 101 advances the process to SA416.

  In SA416, the control unit 101 determines whether or not the key determined to have been input in SA415 is the switch key 124. If so, the process proceeds to SA417, and if not, the process proceeds to SA418.

  In SA417, the control unit 101 turns on the important word list display flag and returns the process to SA401 (see FIG. 15).

  In SA418, the control unit 101 determines whether the key determined to have been input in SA415 is any one of the up key 125A, the down key 125B, the left key 125C, or the right key 125D. If so, the process proceeds to SA419; otherwise, the process proceeds to SA420.

  In SA419, the control unit 101 performs a process of updating the screen display on the display unit 111 so that the character in the state selected in the text display field 420 is changed according to the type of the input key. Return the process to SA415. Specifically, in SA419, the control unit 101 uses the up key 125A, the down key 125B, the left key 125C, or the characters in the selected state in the narration data displayed in the text display field 420, or The display is updated so that the key is moved either up, down, left, or right according to the type of the input key in the right key 125D.

  In SA420, control unit 101 determines whether or not the key determined to have been input in SA415 is search / decision key 126. If so, the process proceeds to SA421, and if not, the process proceeds to SA422. .

  In SA421, the control unit 101 determines the character currently selected at that time as the first character of the character string to be searched as described above, stores it in a predetermined memory, and stores SA424. The process proceeds to (see FIG. 17).

  In SA422, the control unit 101 determines whether the key determined to have been input in SA415 is either the previous find key 128 or the next find key 129. If so, the process proceeds to SA423. Otherwise, the process returns to SA415.

  In SA423, as in SA413, the control unit 101 updates the pattern number stored in the memory in the control unit 101 as the “selected narration pattern number” in SA207 according to the input key. The processing is returned to FIG.

  Referring to FIG. 17, in SA424, control unit 101 determines whether or not an input has been made on any of various keys provided on second housing 120. If it is determined that an input has been made, the control unit 101 advances the process to SA425.

  In SA425, the control unit 101 determines whether or not the key determined to have been input in SA424 is the switching key 124. If so, the process proceeds to SA426, and if not, the process proceeds to SA427.

  In SA426, the control unit 101 turns on the important word list display flag and returns the process to SA401 (see FIG. 15).

  In SA427, the control unit 101 determines whether the key determined to have been input in SA424 is either the left key 125C or the right key 125D. If so, the process proceeds to SA428. Otherwise, the process proceeds to SA429.

  In SA428, the control unit 101 updates the screen display on the display unit 111 so as to change the final position of the range of the character in the selected state in the text display column 420 according to the type of the input key. Then, the process returns to SA424. In the text display column 420, the start position of the character range in the selected state is the position of the character determined as the start position in SA421.

  In SA429, the control unit 101 determines whether the key determined to have been input in SA424 is the search / decision key 126. If so, the process proceeds to SA430, and if not, the process proceeds to SA431. .

  In SA430, the control unit 101 causes the dictionary search unit 104 to execute a search using all searchable dictionaries with the character string within the range currently selected as a search target character string. Then, the search result is temporarily stored, and the process proceeds to SA433 (see FIG. 18).

  In SA431, the control unit 101 determines whether the key determined to have been input in SA424 is one of the dictionary application keys 131 to 138. If so, the process proceeds to SA432, and if not, SA424. Return processing to.

  In SA432, the control unit 101 inputs to the dictionary search unit 104 the character string within the range selected at that time as a search target character string in SA403 in the dictionary application keys 131 to 138. A search using a dictionary corresponding to the key determined to have been performed is executed, the search result is temporarily stored, and the process proceeds to SA433 (see FIG. 18).

  Referring to FIG. 18, in SA433, control unit 101 causes search result stored in dictionary search unit 104 to be displayed on display unit 111, and the process proceeds to SA434.

  For example, in SA409, as shown in FIG. 20, when it is determined that the keyword “pepsin” is selected in the keyword display field 430 and the search / decision key 126 is input, the display unit 111 displays For example, a screen 403 as shown in FIG. 21 is displayed.

  The screen 403 displays the search result of the keyword “pepsin” in the text display field 410 displayed together with the animation display.

  In addition, when a search using a plurality of dictionaries is performed for a keyword or character string that is a search target, such as when information about a search target keyword is described in a plurality of dictionaries in the search result In the text display field 410, the search result is displayed together with the type of dictionary used for the search.

  Referring to FIG. 18 again, in SA434, control unit 101 determines whether or not an input has been made on any of the various keys provided on second housing 120. If it is determined that an input has been made, the control unit 101 advances the process to SA435.

  In SA435, the control unit 101 determines whether or not the key determined to have been input in SA434 is the backward key 127. If so, the process returns to SA401 (see FIG. 15), otherwise returns to SA436. Proceed with the process.

  In SA436, the control unit 101 determines whether or not the key determined to have been input in SA434 is the return key 130. If so, the process proceeds to SA437, and if not, the process returns to SA434.

  In SA437, the control unit 101 further determines whether or not an input is made to the search / decision key 126. If so, the process is returned, and if it is determined that an input is made to other keys. The process returns to SA434.

  In the present embodiment described above, in the electronic dictionary device 100 that is an example of the information processing device, text information that is narration is displayed together with an image that is an animation. As shown in FIG. 19 (B), when an input (operation) to the S jump key 123 is performed, the narration selected by the user from the narration corresponding to the animation displayed at that time is as shown in FIG. The keywords extracted from the narration are displayed.

  In the electronic dictionary device 100, a dictionary search is executed for the keyword selected by the user from the displayed keywords, and the search result is displayed as shown in FIG. 21, for example.

  Note that the character string to be searched is not limited to those listed as keywords, and can be manually specified from the narration by the user.

  Further, the narration that is the source of the keyword or character string to be searched can be changed as shown in the processing of SA412 or SA422.

  In the present embodiment, the animation data stored in the electronic dictionary device 100 is displayed, and the dictionary data stored in the internal dictionary is used for the search. The information processing apparatus is not limited to such a configuration. For example, data corresponding to the animation database 102B, the narration database 102C, the keyword database 102D for narration, the animation program database 102E, and the object pattern database 102F are received via the network and temporarily stored in the buffer memory. In addition, it may be used for animation display, or instead of storing information corresponding to the dictionary database 102A, a corresponding dictionary may be searched via a network. In such a case, the above-mentioned buffer memory constitutes an image information storage unit and a text information storage unit.

  In the present embodiment, keywords are extracted from text information (narration data) in advance, stored separately from the narration data, and the information extracted as keywords is displayed by referring to the information stored separately. However, the present invention is not limited to this.

  For example, as shown in FIG. 22, narration data includes character strings (“gastric juice”, “protein degrading enzyme”, “pepsin”, “hydrochloric acid” in FIG. 22) extracted in advance as keywords. A keyword is extracted in advance, such as being stored with a special symbol (“★” in FIG. 22) attached, etc., but in a format that does not have keyword data independently, that is, the narration data It may be stored in such a manner that it also includes information on how the keyword has been extracted. Furthermore, keywords are not extracted in advance, and the control unit 101 or the like may extract keywords by referring to a predetermined database for narration data as necessary.

  In the present embodiment, text data is displayed along with the display of animation in electronic dictionary apparatus 100. However, the configuration of the information processing apparatus of the present invention is not limited to such a configuration. The electronic dictionary device 100 accompanies an animation display of voice data stored in the electronic dictionary device 100 or at a place where the electronic dictionary device 100 can be acquired via a network (corresponding to the animation display). It may be configured to output at a timing.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

It is a perspective view of the electronic dictionary device which is one embodiment of the information processing device of the invention. It is a top view of the electronic dictionary apparatus of FIG. It is a control block diagram of the electronic dictionary device of FIG. It is a figure which shows an example of the animation program data of FIG. It is a figure for demonstrating the content of each line of the animation program data of FIG. It is a flowchart of the main routine of the control part of the electronic dictionary apparatus of FIG. It is a flowchart of the subroutine of the animation display process of FIG. It is a figure for demonstrating the content of the animation display according to the animation program data shown by FIG. It is a figure for demonstrating the content of the animation display according to the animation program data shown by FIG. It is a flowchart of the interruption search process which the control part of the electronic dictionary apparatus of FIG. 1 performs. It is a flowchart of the subroutine of the blowing selection process of FIG. It is a figure which shows an example of the screen displayed in the display part of the electronic dictionary apparatus of FIG. 1 when the blowing selection process of FIG. 11 is performed. It is a figure which shows the other example of the screen displayed in the display part of the electronic dictionary apparatus of FIG. 1 when the blowing selection process of FIG. 11 is performed. 11 is a flowchart of a keyword list creation process subroutine of FIG. 10. 11 is a flowchart of a keyword search process subroutine of FIG. 10. 11 is a flowchart of a keyword search process subroutine of FIG. 10. 11 is a flowchart of a keyword search process subroutine of FIG. 10. 11 is a flowchart of a keyword search process subroutine of FIG. 10. (A) is a figure which shows an example of the screen display at the time of displaying by the text display mode in the keyword search process of FIGS. 15-18, (B) is a display in important word display mode. It is a figure which shows an example of the screen display at the time of being performed. It is a figure which shows an example of the screen display in the state in which the keyword used as search object was selected in the keyword search process of FIGS. FIG. 19 is a diagram illustrating an example of a screen for displaying a search result in the keyword search processing of FIGS. 15 to 18. It is a figure for demonstrating the modification of the memory | storage aspect of the narration data in the electronic dictionary apparatus of FIG.

Explanation of symbols

  100 Electronic Dictionary Device, 100A Linking Unit, 101 Control Unit, 102 Storage Unit, 102A Dictionary Database, 102B Animation Database, 102C Narration Database, 102D Keyword Database, 102E Program Database, 102F Pattern Database, 103 Animation Playback Unit, 104 Dictionary Search Unit , 105 Animation number storage unit being played back, 106 Narration acquisition unit, 107 Keyword extraction unit, 108 Input unit, 108A Animation instruction unit, 108B Keyword instruction unit, 110 First housing, 111 Display unit, 112 Speaker, 120 2 housings, 121 power key, 122 menu key, 123 S jump key, 124 switching key, 125A up key, 125B down key , 125C left key, 125D right key, 126 search / decision key, 127 backward key, 128 previous find key, 129 next find key, 130 return key, 131-138 dictionary app key, 300, 310, 400, 401 screen , 301-303 Callout, 410 Text display field, 420 Text display field, 421, 431 Tag, 430 Important word display field.

Claims (9)

Image information storage means for storing image information;
Text information storage means for storing text information;
Display control means for displaying the image information and the text information on a display means;
The information processing apparatus, wherein the display control means extracts and displays a keyword included in the text information in response to a predetermined condition being satisfied. Selecting means for selecting a keyword displayed on the display means;
Search means for searching for information relating to the keyword selected by the selection means,
The information processing apparatus according to claim 1, wherein the display control unit displays a search result obtained by the search unit.   3. The information processing according to claim 1, wherein the display control unit performs control in a first display mode in which only the extracted keyword is displayed when the predetermined condition is satisfied. 4. apparatus.   The display control means performs control in a second display mode in which a keyword extracted from the text information and a character string other than the keyword are displayed in different modes when the predetermined condition is satisfied. The information processing apparatus according to any one of claims 1 to 3. The image information storage means stores at least one or more pieces of image information;
The text information storage means stores at least one or more pieces of text information;
Timing information storage means for storing timing information related to the timing for displaying the image information and the text information;
The display control means includes
Control display of the image information and the text information based on the timing information,
The information processing apparatus according to claim 1, wherein a keyword to be extracted is selected from the text information based on the timing information when the predetermined condition is satisfied. Text information selection means for selecting the text information,
6. The text information selecting unit according to claim 5, wherein when the display control unit displays a plurality of the text information, the text information selecting unit selects the text information from the plurality of displayed text information. Information processing device. The text information storage means stores at least two or more text information as a group with respect to the image information stored in the image information storage means,
The said display control means selects and displays the said text information from the text information of the group corresponding to the displayed image information, when the said predetermined conditions are satisfied. Information processing device.   The information processing apparatus according to claim 7, wherein the timing information includes information for displaying the text information stored in the text information storage unit in a predetermined order. Voice information storage means for storing voice information;
Voice output information storage means for storing information relating to timing of outputting the voice stored in the voice information storage means;
The audio output control means for outputting the audio information stored in the audio information storage means based on the information related to the timing stored in the audio output information storage means. Item 9. The information processing device according to any one of Items 8 to 10.

Images