JP2012128789A - Electronic apparatus comprising dictionary function, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic apparatus comprising a dictionary function capable of correctly recognizing a character and retrieving dictionary information corresponding to the character even when the character included in an image which a user wants to check is written in a special style or out of shape.SOLUTION: An electronic apparatus comprising a dictionary function displays image data G of, for example, a notebook, a guide board or the like imaged by a user on a touch panel display part (a main screen) 16. With regard to an arbitrary character string "Ko-sei" meaning a star in Japanese included in the image data G, even when a part of the character string "Ko" meaning constant in Japanese is falsely recognized as "Mei" meaning brightness in Japanese due to dirt or loss of shape thereof, an image of the falsely recognized character "Ko" is displayed on a handwriting input part (a sub screen) 15 to correctly re-recognize the character overwritten by hand, then a built-in dictionary easily performs a headword search and explanation information H of the headword can be displayed.

Description

  The present invention relates to an electronic device having a dictionary function for searching for a headword that matches a search word input by a user and displaying explanation information of the headword and a control program therefor.

  There is a case where a user takes a picture of a signboard or a handwritten notebook, and then looks at the photographed image to examine the contents written on the guide board or notebook.

  A portable information device has been considered in which characters included in a photographed image are converted into text by character recognition, a headword that matches the characters is searched from a built-in dictionary, and the meaning is displayed (for example, see Patent Document 1). .)

  Furthermore, a portable information terminal with a camera capable of recognizing a captured image, converting it into characters corresponding to the image, and displaying it, for example, converting a photographic image of Mt. Fuji to characters of “Mt. Fuji” is also considered. (For example, see Patent Document 2).

JP 2005-301914 A JP 2005-316912 A

  However, if the characters written on the information board, notebook, etc. to be photographed are written in a special way that is not common, or the shape of the character is broken due to dirt, deterioration, etc. A character cannot be recognized well, and dictionary information corresponding to the character cannot be searched.

  The present invention has been made in view of such a problem, and even when a character to be examined included in a photographed image is written in a special form or the character shape is broken, the character is correctly recognized and converted into the same character. It is an object of the present invention to provide an electronic device having a dictionary function that enables retrieval of corresponding dictionary information and a control program thereof.

  An electronic device having a dictionary function according to claim 1 is an electronic device having a touch panel display screen and a dictionary function, and is captured by an image capturing unit that captures image data, and the image capturing unit. Image display means for displaying the obtained image data on the first display screen of the touch panel type, selection means for selecting an arbitrary image pattern on the image displayed by the image display means, and selection by the selection means Selected image display means for displaying an image pattern in the image on the touch panel type second display screen, and the selected image pattern is displayed on the touch panel type second display screen by the selected image display means. A character recognizing means for recognizing a handwritten character corresponding to a change in the touch position on the second display screen, and the character recognizing hand It is characterized and dictionary search means for searching for headwords in the dictionary based on the recognized character display the description information, further comprising a by.

  An electronic device having the dictionary function according to claim 2 is an image in which dictionary search information by the dictionary search unit is displayed by the image display unit in the electronic device having the dictionary function according to claim 1. The search history registration means for registering the image pattern in association with the position information of the image pattern selected by the selection means, and the captured image data by the image display means are displayed on the touch panel type first display screen. A history presence determination means for determining whether or not dictionary search information is registered by the search history registration means in association with the image data, and image data displayed by the image display means by the history presence determination means. When it is determined that dictionary search information is registered in association with the image, the selected image pattern of the displayed image is displayed. Mark display means for displaying a history mark at a position corresponding to the position information, and the dictionary registered in association with the touch position when the position of the history mark displayed by the mark display means is touched And an explanation information display means for displaying the explanation information of the headword based on the search information on the touch panel type second display screen.

  The electronic device having the dictionary function according to claim 3 is the electronic device having the dictionary function according to claim 2, wherein the search history registering unit obtains dictionary search information by the dictionary searching unit as the image Registered in association with the position information of the image pattern selected by the selection unit and the handwritten character recognized by the character recognition unit in the image displayed by the display unit, and displayed by the image display unit by the history determination unit If it is determined that dictionary search information is registered in association with the image data, the selected image pattern on the displayed image is registered in association with the position information of the image pattern. Further, it is characterized by further comprising replacement display means for replacing the handwritten characters and displaying them.

  The electronic device with the dictionary function according to claim 4 is the electronic device with the dictionary function according to any one of claims 1 to 3, wherein the touch panel type first display screen and The second display screen is configured as an independent display unit.

  The program according to claim 5 is a program for controlling a computer of an electronic device having a touch panel type display screen and having a dictionary function, the image capturing means for capturing image data into the computer, and the image Image display means for displaying the image data captured by the capture means on the touch panel type first display screen, selection means for selecting an arbitrary image pattern on the image displayed by the image display means, and the selection means Selection image display means for displaying the image pattern in the selected image on the touch panel type second display screen, and the selected image pattern is displayed on the touch panel type second display screen by the selection image display means. In the displayed state, handwritten characters corresponding to the change of the touch position on the second display screen are displayed. Character recognition means for identification, is characterized in that to function as dictionary search means for searching vocabulary entry and displays the explanatory information of the dictionary on the basis of recognized characters by the character recognition means.

  According to the present invention, even if the character to be examined included in the photographed image is written in a special manner or the shape of the character is broken, the dictionary information corresponding to the same character can be retrieved by correctly recognizing the character. It is possible to provide an electronic device having a dictionary function and a control program thereof.

The front view which shows the external appearance structure of the electronic dictionary apparatus 10 with a camera which concerns on embodiment of the electronic device provided with the dictionary function of this invention. 2 is a block diagram showing a configuration of an electronic circuit of the electronic dictionary device 10. FIG. The figure which shows the content of the search log | history data registered into the log | history data memory 22d of the said electronic dictionary apparatus 10. FIG. 5 is a flowchart showing image capture processing by the electronic dictionary device 10; 5 is a flowchart showing image reading processing by the electronic dictionary device 10; 7 is a flowchart showing dictionary display processing accompanying image reading processing of the electronic dictionary device 10. The figure which shows the display operation (the 1) in the touchscreen type display part (main screen) 16 and the handwriting input part (subscreen) 15 accompanying the dictionary display process of the said electronic dictionary apparatus 10. FIG. The figure which shows the display operation (the 2) in the touchscreen type display part (main screen) 16 and the handwriting input part (subscreen) 15 accompanying the dictionary display process of the said electronic dictionary apparatus 10. FIG. The figure which shows the display operation (the 3) in the touchscreen type display part (main screen) 16 and the handwriting input part (subscreen) 15 accompanying the dictionary display process of the said electronic dictionary apparatus 10. FIG. 5 is a flowchart showing image display processing accompanying image reading processing of the electronic dictionary device 10. The figure which shows the display operation in the touchscreen type display part (main screen) 16 and the handwriting input part (subscreen) 15 accompanying the image display process of the said electronic dictionary apparatus 10. FIG.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a front view showing an external configuration of an electronic dictionary device 10 with a camera according to an embodiment of an electronic device having a dictionary function of the present invention.

  The electronic dictionary device 10 is configured as a portable device dedicated to the electronic dictionary described below, or a PDA (personal digital assistants), a PC (personal computer), a mobile phone, an electronic book, and a portable game machine having a dictionary function. And so on.

  The electronic dictionary device 10 includes a foldable case in which a main body case 11 and a lid case 12 can be expanded / closed via a hinge portion 13. On the surface of the body case 11 where the folding case is developed, a character input key 14a, a dictionary designation key 14b, a [translation / decision] key 14c, a [return] key 14d, a cursor key 14e, a [shooting] key 14f, [ A key input unit (keyboard) 14 provided with an [image] key 14g, a [dictionary] key 14h, and the like, and a handwriting input unit (sub-screen) 15 are provided.

  The handwriting input unit (sub-screen) 15 has a structure in which a touch position detection device that detects a position touched by a user with a pen, a finger, or the like and a display device are integrated. A transparent touch panel 15t is superimposed on a 256 × 64 dot color liquid crystal display screen 15d. The input area of the handwriting input unit 15 includes a handwritten character input area W (see FIGS. 8 and 9) for inputting handwritten characters, button input areas for various functions, or the input areas as necessary. It is switched to the area to do.

  And the locus | trajectory accompanying the handwriting input in the state in which the said handwriting input part 15 was switched to the handwritten character input area is echoed back and displayed on the color liquid crystal display screen 15d.

  An imaging unit 17 is provided on the back surface of the main body case 11, and the imaging unit 17 performs an imaging operation according to an operation of the [shooting] key 14f.

  On the other hand, on the surface of the lid case 12, a touch panel type display unit (main screen) 16 with a backlight of, for example, 480 × 320 dots is provided for almost the entire surface. Similarly to the handwriting input unit (sub-screen) 15, the touch-panel display unit (main screen) 16 is integrated with a touch position detection device that detects a position touched by a user with a pen, a finger, or the like and a display device. The structure is configured by overlapping a transparent touch panel 16t on the color liquid crystal display screen 16d.

  FIG. 2 is a block diagram showing the configuration of the electronic circuit of the electronic dictionary device 10.

  The electronic dictionary device 10 is configured by a computer that reads programs recorded in various storage media and whose operation is controlled by the read programs. The electronic circuit includes a CPU (central processing unit) 21. It is done.

  The CPU 21 is a device control program 22a stored in the main storage device 22 in advance, or a device control program 22a read from the external storage medium 23 such as a ROM card into the main storage device 22 via the storage medium read / write unit 24, Alternatively, according to the device control program 22a read from the Web server 30 (in this case, the program server) 30 on the Internet N via the external interface 25, the operation of each part of the circuit is performed using the RAM 26 as a working memory. Control.

  The main storage device 22 stores the device control program 22a and the dictionary database 22b, and secures an image data memory 22c, a history data memory 22d, a handwritten data memory 22e, and the like.

  The device control program 22a stored in the main storage device 22 is connected via an input signal corresponding to a user operation from the key input unit 14, the handwriting input unit 15, and the touch panel display unit 16, or via the external interface 25. It is started in response to a communication signal with each Web server 30 on N.

  As the device control program 22a, data communication with a system program that controls the overall operation of the electronic dictionary device 10 and each Web server 30 on the Internet N or a user PC (Personal Computer) (not shown) via the external interface 25. A communication program is stored.

  In addition, the dictionary database includes a headword search process in the dictionary function, a list display process of search headwords, and reading and displaying various explanatory information such as translations, meaning contents, and example sentences (examples) corresponding to user-specified headwords. A dictionary search program for controlling the overall search / display processing based on 22b is stored.

  Further, as the device control program 22a, an image capturing program (see FIG. 4) for storing image data captured by the imaging unit 17 in response to an input of the [shooting] key 14f, a plurality of stored images An image reading program (see FIG. 5) for reading out image data arbitrarily selected from the data and displaying it on the touch panel display unit (main screen) 16, and displayed on the touch panel display unit (main screen) 16 A dictionary display program for recognizing an image of a character arbitrarily selected from image data and displaying information retrieved from the dictionary using the recognized character as a search word on the handwriting input unit (sub-screen) 15 (FIG. 6). The image data having a history of dictionary search according to the dictionary display program is displayed on the touch panel display unit (main screen). ) When is displayed in 16, the image display program for displaying handwriting input unit reads out the already retrieved dictionary information (the sub-screen) 15 (see FIG. 10) is also stored.

  In the dictionary database 22b, for example, [Japanese language dictionary] in which Japanese explanation information is described in association with Japanese headwords, and [English-Japanese dictionary in which Japanese explanation information is described in association with English headwords] ], A plurality of types of dictionary data such as [Japanese-English dictionary] in which English explanatory information is described in association with Japanese headwords are stored in advance or downloaded and stored.

  The image data memory 22c stores image data captured by the imaging unit 17 and image data read from the outside.

  In the history data memory 22d, according to the image reading program (see FIG. 5) and the dictionary display program (see FIG. 6), an image of a character arbitrarily selected from the image data read out from the image data memory 22c. When the dictionary information is searched and displayed using the recognized character as a search word, the search history is registered in association with the position of the selected character in the image data.

  In the handwritten data memory 22e, when the selected character is input by handwriting and re-recognized according to the recognition error or the recognition failure in the character recognition of the selected character from the image data, the image data is selected. The handwritten character is registered in association with the position of the character.

  The RAM 26 includes a display data memory 26 a that functions as a frame buffer for each of the touch panel display unit (main screen) 16 and the handwriting input unit (sub-screen) 15.

  As described above, the CPU 21 is connected to the main storage device 22, the storage medium read / write unit 24, the external interface 25, the RAM 26, the key input unit 14, the handwriting input unit 15, the touch panel display unit 16, and the imaging unit 17. .

  FIG. 3 is a diagram showing the contents of the search history data registered in the history data memory 22d of the electronic dictionary device 10. As shown in FIG.

  That is, as the search history data registered in the history data memory 22d, the ID of the image data including the character to be searched for dictionary information, the position information of the search character in the same image data, and the dictionary used for the search Type and headword, and the registration destination of the handwritten character when the character to be searched is re-recognized as a handwritten character.

  In the electronic dictionary device with camera 10 configured as described above, the CPU 21 operates the circuit components in accordance with instructions described in the device control program 22a (including an image capturing program / image reading program / dictionary display program / image display program). And the software and hardware operate in cooperation to realize the function described in the following operation description.

  Next, the operation of the electronic dictionary device with a camera 10 having the above configuration will be described.

  FIG. 4 is a flowchart showing image capture processing by the electronic dictionary device 10.

  When the [Shooting] key 14f is pressed and held, the camera mode is set, and an image captured by the imaging unit 17 is displayed on the touch panel display unit (main screen) 16.

  When the [Shoot] key 14f is pressed, the subject imaged by the imaging unit 17 is photographed each time the key is depressed (Step A1), and the photographed image data is stored in the image data memory 22c. And stored (step A2).

  In the present embodiment, the user of the electronic dictionary device 10 captures and stores an important part of a handwritten note or an interesting guide sentence on a history guide board, for example.

  FIG. 5 is a flowchart showing image reading processing by the electronic dictionary device 10.

  FIG. 6 is a flowchart showing a dictionary display process accompanying the image reading process of the electronic dictionary device 10.

  FIG. 7 is a diagram showing a display operation (part 1) on the touch panel display unit (main screen) 16 and the handwriting input unit (sub screen) 15 associated with the dictionary display process of the electronic dictionary device 10.

  When the [Image] key 14g is pressed, the image reading process in FIG. 5 is activated, and each image data stored in the image data memory 22c is displayed in accordance with, for example, index display, thumbnail display, or the cursor key 14e being pressed. It becomes a selectable state by the switching display (step B1).

  Here, when an arbitrary image is selected and the [translation / decision] key 14c is pressed, the selected image data G is displayed on the touch panel display unit (main screen) 16 as shown in FIG. (Step B2).

  Then, it is determined whether or not search history data associated with the displayed image data G is registered in the history data memory 22d (step B3). If it is determined that history data is registered (step B3). (Yes)), the process proceeds to an image display process described later with reference to FIG. 10 (step BC).

  On the other hand, when it is determined that no history data is registered for the displayed image data G (step B3 (No)), it is determined whether or not the [Dictionary] key 14h is pressed (step B4).

  In the following, an example will be described in which a character written in a note is checked with a dictionary from a state in which an image of a handwritten note shown in FIG. 7 is displayed. The user presses the [Dictionary] key 14h when he wants to look up a desired character (for example, “star”) included in the displayed image data G in the dictionary. If it is determined that the [Dictionary] key 14h is pressed (Step B4 (Yes)), the process proceeds to the dictionary display process in FIG. 6 (Step BS).

  When the dictionary display process is activated, a rectangular selection frame S for selecting a desired character in the image data G is displayed on the image data G displayed on the touch panel display unit (main screen) 16. It is displayed (step S1).

  In addition, a dictionary list Ld for designating the type of dictionary used for the search is displayed on the handwriting input unit (sub-screen) 15 (step S2). The dictionary list Ld can be scrolled in accordance with the touch of the cursor button Bc displayed at the right end of the handwriting input unit (sub-screen) 15, and allows selection of other dictionaries that cannot be displayed.

  FIG. 8 is a diagram showing a display operation (part 2) on the touch panel display unit (main screen) 16 and the handwriting input unit (sub screen) 15 accompanying the dictionary display process of the electronic dictionary device 10.

  FIG. 9 is a diagram showing a display operation (part 3) on the touch panel display unit (main screen) 16 and the handwriting input unit (sub screen) 15 accompanying the dictionary display process of the electronic dictionary device 10.

  The selection frame S displayed on the image data G of the touch panel display unit (main screen) 16 can be moved within the same screen by a touch operation, and the rectangular size can be changed. As shown in FIG. 8A (or FIG. 9A), the frame S is moved to the position of the desired character “constant” and is selected by surrounding the character “constant” (step S3). The selection of the character part on the screen may be performed by the user drawing a line so as to surround the target part directly with a pen or the like.

  After the character is selected, the type of dictionary used for the search (for example, [Encyclopedia]) is specified by touching the dictionary list Ld displayed on the handwriting input unit (sub-screen) 15 (step S4). Then, character recognition is executed for the image pattern of the character “fixed star” selected by the selection frame S (step S5), and it is determined whether or not the character recognition is impossible (recognition is possible) (step S6).

  Then, when it is determined that the image pattern of the selected character “constant” is not character recognizable, that is, is recognizable (step S6 (No)), it matches the character recognized “stellar” at the head. A headword is retrieved from the dictionary [encyclopedia] designated in step S4 and displayed as a headword list Lm on the handwriting input unit (sub-screen) 15 as shown in FIG. S7).

  Here, when a user-desired headword “stellar magnetic field” is touched and selected from the headword list Lm [star / stellar cloud / stellar magnetic field /...], It is determined that re-recognition is not necessary (step S8 ( No)), as shown in FIG. 8C, the description information H of the selected headword “stellar magnetic field” is read from the designated dictionary [encyclopedia] and is written in the handwriting input unit (sub-screen) 15. It is displayed (step S9).

  Then, the ID of the image data G displayed on the touch panel display unit (main screen) 16, the position information of the search target character “constant” on the image data G, the type of the designated dictionary [encyclopedia] and selection A search history associated with the entered headword “stellar magnetic field” is generated and registered in the history data memory 22d (step S10).

  As a result, for any character included in the image data G such as a notebook or a guide board photographed by the user, it is possible to easily search for an entry word in the dictionary and display the explanation information. Then, it is possible to register a search history made up of dictionary searched information in association with the position of the character selected as the search target on the image data G.

  On the other hand, the image pattern of the character “constant star” selected on the image data G is partially missing or distorted due to dirt or the like, and the image pattern of “constant” is erroneously described as “bright”. If it is recognized, a headword list Lm [Meisei / Meisei Gakuen / Meisei Seika / ...] is displayed as shown in FIG. 8D (step S7). Since the user knows that the recognition error has occurred by looking at the headword list, the user inputs a re-recognition command. The re-recognition command is, for example, an operation of the “dictionary” key 14h performed during the headword display. If there is a re-recognition command, then the character “constant” on the erroneously recognized image data G is touched and specified (step S8 (Yes) → S11).

  Then, as shown in FIG. 8 (E), an image of a partially missing character “constant” designated on the image data G is displayed in the handwritten character input area W of the handwriting input unit (sub-screen) 15. (Step S12).

  At this time, on the left side of the handwritten character input area W of the handwritten input section (sub-screen) 15, a [recognition] button Bn for instructing character recognition of characters handwritten in the handwritten character input area W, and handwriting A [correction] button Bt for erasing and correcting the displayed character is displayed.

  Here, as shown in FIG. 8 (F), for the image pattern of the character “constant” lacking a part displayed in the handwritten character input area W of the handwriting input unit (sub-screen) 15, as shown in FIG. As a result of the overwriting, the character “HUN” is rewritten and the [recognition] button Bn is touched (step S13), and the input handwritten character “HUN” is recognized (step S14).

  Then, the headword that first matches the recognized character “constant” corrected by the re-recognized handwritten character “constant” is searched from the dictionary [encyclopedia] designated in step S4, and FIG. ), The headword list Lm [Star / Star Cloud / Star Field / ...] is displayed on the handwriting input unit (sub-screen) 15 (step S15).

  Then, in the headword list Lm displayed on the handwriting input unit (sub-screen) 15, when the headword “stellar magnetic field” desired by the user is touched and selected, as shown in FIG. The explanation information H of the headword “stellar magnetic field” is read from the designated dictionary [encyclopedia] and displayed on the handwriting input unit (sub-screen) 15 (step S16).

  Here, a message prompting the user to determine whether or not to register the handwritten character “constant” re-recognized in step S14 is displayed (step S17), and when registration of the handwritten character is instructed (step S17 (Yes) )), And the handwritten character “HUN” is registered in the handwritten data memory 22e (step S18).

  Then, the ID of the image data G displayed on the touch panel display unit (main screen) 16, the position information of the search target character “constant” on the image data G, the type of the specified dictionary [encyclopedia] and selection A search history in which the registered headword “constant magnetic field” and the registration destination of the handwritten character “constant” are associated is generated and registered in the history data memory 22d (step S10).

  Thereby, even if some characters included in the image data G taken by the user, for example, image data G such as a notebook or a guide board, are misrecognized even if some of the characters are misrecognized due to dirt or shape collapse. It is possible to input characters by handwriting and re-recognize correctly by handwriting recognition, easily search for a headword in the dictionary, and display the explanation information. Then, in association with the position of the character selected as the search target on the image data G, a search history composed of the dictionary searched information and the rewritten handwritten character information can be registered.

  On the other hand, the image pattern of the character “stellar” selected on the image data G has a lack of the whole character due to the overall dirt or drowning, the whole character shape is special, or the character pattern is broken. If it is determined that recognition is not possible (step S6 (Yes)), as shown in FIG. 9B, the image of the unclear character “constant” selected on the image data G is input to the handwriting input unit (sub Is displayed in the handwritten character input area W of the screen 15 (step S19).

  Here, as shown in FIG. 9C, the “stellar” is overwritten on the image pattern of the unclear character “constant” displayed in the handwritten character input area W of the handwriting input unit (sub-screen) 15. When the [recognition] button Bn is touched (step S20), the input handwritten character “fixed star” is recognized (step S21).

  Then, the headword that first matches the re-recognized recognized character “constant star” is searched from the dictionary [encyclopedia] designated in step S4, and as shown in FIG. (Sub-screen) 15 is displayed as a headword list Lm [star / stellar cloud / stellar magnetic field / ...] (step S22).

  Then, in the headword list Lm displayed on the handwriting input unit (sub-screen) 15, when the user-desired headword “stellar magnetic field” is touched and selected, as shown in FIG. The explanation information H of the headword “stellar magnetic field” is read from the designated dictionary [encyclopedia] and displayed on the handwriting input unit (sub-screen) 15 (step S23).

  Here, a message prompting the user to determine whether or not to register the handwritten character “fixed star” re-recognized in step S21 is displayed (step S24), and when registration of the handwritten character is instructed (step S24 (Yes) )), The handwritten character “constant star” is registered in the handwritten data memory 22e (step S25).

  Then, the ID of the image data G displayed on the touch panel display unit (main screen) 16, the position information of the search target character “constant” on the image data G, the type of the specified dictionary [encyclopedia] and selection A search history in which the registered headword “stellar magnetic field” and the handwritten character “stellar” are registered is generated and registered in the history data memory 22d (step S10).

  As a result, even if it is determined that the entire character string included in the image data G taken by the user, such as a notebook or a guide board, is unclear and character recognition is impossible, the unclear character string is input by handwriting. Thus, it is possible to re-recognize correctly and to easily search for a headword in the dictionary and display the explanation information. Then, in association with the position of the character selected as the search target on the image data G, a search history composed of the dictionary searched information and the rewritten handwritten character information can be registered.

  FIG. 10 is a flowchart showing an image display process accompanying the image reading process of the electronic dictionary device 10.

  FIG. 11 is a diagram illustrating a display operation on the touch panel display unit (main screen) 16 and the handwriting input unit (sub screen) 15 accompanying the image display process of the electronic dictionary device 10.

  When the image data G selectively read from the image data memory 22c is displayed on the touch panel display unit (main screen) 16 as shown in FIG. If it is determined that the search history data having the ID of the displayed image data G is registered in the history data memory 22d (step B3 (Yes)), the process proceeds to the image display process in FIG. (Step BC).

  When the image display process is activated, search history data (see FIG. 3) having the ID of the image data G displayed on the touch panel display unit (main screen) 16 is read from the history data memory 22d (step C1). . Then, it is determined whether or not the retrieved search history data includes a handwritten character registration destination (step C2).

  If it is determined that the search history data of the image data G includes a registration destination for handwritten characters (step C2 (Yes)), a handwritten character (from the address of the handwriting data memory 22e indicated by the registration destination ( In this case, “constant” or “constant star”) is read out. Then, according to the position information of the character to be searched on the image data G included in the search history data, the image of the character (“constant” or “constant”) at the corresponding position is replaced with the read handwritten character. Is displayed (step C3).

  In addition, a history mark M indicating that there is a search history is displayed in correspondence with the position of the search target character “fixed star” on the image data G included in the search history data (step C4).

  Here, when the history mark M displayed on the image data G is touched and instructed (step C5 (Yes)), the type of dictionary [encyclopedia] and headword registered as the search history data The explanation information H is read in accordance with the “stellar magnetic field” and displayed on the handwriting input unit (sub-screen) 15 (step C6).

  Thus, when the image data G in which the search history data is registered is read and displayed on the touch panel display unit (main screen) 16, the characters that are difficult to read in the original image are handwritten by the user. By simply touching the history mark M displayed on the image data G, the description information retrieved from the dictionary in the past according to the character indicated by the history mark M can be displayed. It can be read immediately and displayed on the handwriting input unit (sub-screen) 15. For this reason, image data G such as notes, textbooks, and literature can be stored with added explanatory information as an added value, and can be used for self-tests when iteratively learning. It can be used as material for learning in return.

  In the embodiment, the image data G selectively read from the image data memory 22c is displayed on the touch panel display unit (main screen) 16, and the dictionary list Ld, the headword list Lm, and the re-recognition target are displayed. The character image in the image data G and the description information H searched for the headword are both displayed on the handwriting input unit (sub-screen) 15. On the other hand, the screen functioning as the handwriting input unit (subscreen) 15 may be configured to be displayed as a window in the screen of the touch panel display unit (main screen) 16.

  The image data G in the embodiment has been described as an image photographed by the imaging unit 17, but may of course be an image captured from the outside and stored in the image data memory 22c.

  It should be noted that each processing method performed by the electronic dictionary device with camera 10 described in each of the embodiments, that is, the image capturing process shown in the flowchart of FIG. 4, the image reading process shown in the flowchart of FIG. Each method such as dictionary display processing accompanying image readout processing, image display processing accompanying the image readout processing shown in the flowchart of FIG. 10, and various dictionary data (22b) are programs that can be executed by a computer. It can be stored and distributed in an external storage medium 23 such as a memory card (ROM card, RAM card, etc.), magnetic disk (floppy disk, hard disk, etc.), optical disk (CD-ROM, DVD, etc.), semiconductor memory, etc. . The computer of the electronic device reads the program stored in the external storage medium 23 into the storage device (22), and the operation is controlled by the read program, so that the captured image described in each of the embodiments is used. The character recognition / dictionary search / search history registration function can be realized, and the same processing as described above can be executed.

  Further, program data for realizing each of the above methods can be transmitted on the network N in the form of a program code, and this program data is transmitted to a computer of an electronic device connected to the network N by a communication control unit ( 25), it is possible to realize the above-described function for character recognition / dictionary search / search history registration from captured images.

  Note that the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention at the stage of implementation. Further, each of the embodiments includes inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some constituent elements are deleted from all the constituent elements shown in each embodiment or some constituent elements are combined in different forms, the problems described in the column of the problem to be solved by the invention If the effects described in the column “Effects of the Invention” can be obtained, a configuration in which these constituent requirements are deleted or combined can be extracted as an invention.

DESCRIPTION OF SYMBOLS 10 ... Electronic dictionary apparatus 11 ... Main body case 12 ... Cover body case 13 ... Hinge part 14 ... Key input part (keyboard)
14a ... Character input key 14b ... Dictionary designation key 14c ... [Translation / Determination] key 14d ... [Back] key 14e ... Cursor key 14f ... [Shoot] key 14g ... [Image] key 14h ... [Dictionary] key 15 ... Handwritten input (Sub screen)
15d ... Color liquid crystal display unit 15t ... Transparent touch panel 16 ... Touch panel type display unit (main screen)
16d ... Color liquid crystal display unit 16t ... Transparent touch panel 17 ... Imaging unit 21 ... CPU
22 ... Main storage device 22a ... Device control program 22b ... Dictionary database 22c ... Image data memory 22d ... History data memory 22e ... Handwritten data memory 23 ... External storage medium 24 ... Storage medium read / write unit 25 ... External interface 26 ... RAM
26a ... display data memory 30 ... Web server G ... image data S ... selection frame Ld ... dictionary list Lm ... entry word list W ... handwritten character input area Bc ... cursor button Bn ... recognition button Bt ... correction button H ... description information M ... Mark with history

Claims (5)

An electronic device having a touch panel display screen and a dictionary function,
Image capturing means for capturing image data;
Image display means for displaying the image data captured by the image capturing means on the first display screen of the touch panel type;
Selection means for selecting an arbitrary image pattern on the image displayed by the image display means;
Selection image display means for displaying an image pattern in the image selected by the selection means on the second display screen of the touch panel type;
In the state where the selected image pattern is displayed on the touch panel type second display screen by the selected image display means, a handwritten character corresponding to a change in the touch position on the second display screen is recognized. Character recognition means;
A dictionary search means for searching a dictionary entry word based on the characters recognized by the character recognition means and displaying the explanation information;
An electronic device having a dictionary function characterized by comprising Search history registration means for registering the dictionary search information by the dictionary search means in association with the position information of the image pattern selected by the selection means in the image displayed by the image display means;
Whether the search information in the dictionary is registered by the search history registration unit in association with the image data when the image data captured by the image display unit is displayed on the first display screen of the touch panel type. A means for determining whether there is a history, and
When it is determined by the history determination unit that dictionary search information is registered in association with the image data displayed by the image display unit, the selected image pattern on the displayed image is displayed. Mark display means for displaying a history mark at a position corresponding to the position information;
When the position of the history mark displayed by the mark display means is touched, the description information of the headword based on the search information of the dictionary registered in association with the touch position is used as the touch panel type second information. Explanation information display means to be displayed on the display screen,
An electronic apparatus having a dictionary function according to claim 1. The search history registration means includes the dictionary search information by the dictionary search means, the position information of the image pattern selected by the selection means in the image displayed by the image display means, and the handwritten character recognized by the character recognition means Register in association,
When it is determined by the history determination unit that dictionary search information is registered in association with the image data displayed by the image display unit, the selected image pattern on the displayed image is displayed. 3. The electronic apparatus having a dictionary function according to claim 2, further comprising replacement display means for replacing the handwritten characters registered in association with the position information of the image pattern for display.   The dictionary function according to any one of claims 1 to 3, wherein the touch-panel first display screen and the second display screen are configured as independent display units. Electronic equipment provided. A program for controlling a computer of an electronic device having a touch panel display screen and a dictionary function,
The computer,
Image capturing means for capturing image data;
Image display means for displaying the image data captured by the image capture means on the touch panel type first display screen;
Selection means for selecting an arbitrary image pattern on the image displayed by the image display means;
Selection image display means for displaying an image pattern in the image selected by the selection means on the second display screen of the touch panel type;
In the state where the selected image pattern is displayed on the touch panel type second display screen by the selected image display means, a handwritten character corresponding to a change in the touch position on the second display screen is recognized. Character recognition means,
A dictionary search means for searching for a dictionary entry based on the characters recognized by the character recognition means and displaying the explanation information;
Program to function as.

Images