JP2019070914A - Translation display device and translation display method - Google Patents

Abstract

To provide a translation display device and a translation display method which assist an entry person who needs translation in making an entry.SOLUTION: A translation display device comprises: imaging means 31 to image an entry sheet 11 placed; projection means 32 to project expressions D superposed on the sheet 11 and suggesting contents to be entered in each entry column of the sheet 11; language translating means 5 to translate a language used in the expressions D suggesting the contents; and display control means 6 to make the projection means 32 project the expressions D suggesting the contents in neighboring positions to the applicable entry columns.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a translation display device and a translation display method for assisting in filling out a form.

  Generally, in order to perform any procedure at a counter such as a government office, a real estate establishment, a post office, etc., it is necessary to fill in and submit necessary items such as application documents and slips according to the procedure. Such items are generally written in Japanese in the form of items and notes, etc. For foreigners who can not literate Japanese, for example, the person in charge at the window uses an electronic dictionary etc. The contents of the entry form are translated into the language of the foreigner and the presentation of the translation contents is presented to assist in the entry. In addition, in areas where there are many foreign residents of the same country of origin, there is also a counter that responds by preparing in advance an entry form written in the language used by the foreign resident.

  However, when the person in charge at the window assists in the entry using the electronic dictionary etc., the electronic dictionary translated the indication suggesting the content to be entered in the entry field of the entry form for the foreigner Since it is necessary to give explanations while presenting things one after another, it took a long time and effort to assist in the entry. In addition, it is not only costly but also written by the language used by the foreign resident, if an entry form written in multiple languages is prepared at the window in order to support an unspecified number of languages used. In the case of using an entry form, it is difficult to identify an incomplete entry only by a specialized person in charge, and there is a problem that the entry can not be assisted properly.

  The present invention has been made in view of such problems, and an object of the present invention is to provide a translation display apparatus and a translation display method which can assist the entry of a person who needs translation.

In order to solve the above-mentioned subject, the translation display of the present invention,
Imaging means for imaging the placed entry form;
Projection means for projecting an indication indicating the contents to be entered in each entry field of the entry form over the entry form;
Language translation means for translating the language used for the indication indicating the content;
And display control means for causing the projection means to project a display indicating the contents in the vicinity of the corresponding entry field.
According to this feature, it is possible to translate and project a display indicating content to be entered in each entry field of the entry form in the vicinity of the relevant entry field according to the language of the entry person. It is possible to efficiently assist in filling out the filling-in form for those who need it. Furthermore, since the entry form of the language used by the person in charge of the window can be used, it is easy for the person in charge of the window to confirm an incomplete description etc. in the entry form.

The display control means determines the position of the entry field of the entry sheet by image-analyzing at least a part of the frame line of the entry sheet contained in the image based on the image taken by the imaging means. It is characterized in that a determination means is provided.
According to this feature, the position of the entry field of the entry sheet is determined by performing image analysis on a part of the frame of the entry sheet included in the image based on the image captured by the imaging means. Since it is possible to determine the projection position of the indication indicating the content to be entered in the field, the content to be entered for each entry field of the entry sheet regardless of the placement place and the placement angle of the entry form Can be projected to the correct position.

The display control means is characterized in that it comprises coloring display means for coloring and displaying a specific area surrounded by a frame formed on the entry sheet.
According to this feature, it is possible to indicate, for example, entry required items by coloring and displaying a specific area surrounded by a frame formed on the entry form.

The display control means determines based on the image picked up by the image pickup means that a specific area colored and displayed by the color display means is pointed out, and an entry column corresponding to the specific area The projection means projects a display in the vicinity of the data indicating the content to be entered in the entry box.
According to this feature, when the person in charge points out the area colored and displayed on the entry sheet as necessary, a display indicating the content to be entered in the entry field is displayed in the vicinity of the entry field corresponding to the area It can be projected, it is easy to communicate with the writer, and it can effectively assist the entry on the entry form.

The display control means is characterized by comprising display adjustment means for adjusting the position of the display indicating the contents to be entered in each entry column in accordance with the change of the position of the entry sheet determined by the determination means. And
According to this feature, even if the position of the entry sheet changes during entry, the display indicating the content to be entered in the entry column can be adjusted to the correct position and projected, and the entry form of the entry person It is possible to assist the entry correctly.

In order to solve the above-mentioned subject, the translation display method of the present invention,
Imaging the placed form;
Image-analyzing a part of the frame of the entry sheet included in the image based on the captured image;
Determining the position of the entry field of the entry form from a part of the frame line;
Determining the position at which to project the indication suggesting the content to be entered in each entry field of the entry form;
Selecting a language to be used for translating the indication suggesting the content based on the language of the writer's use;
Translating the indication indicative of the content into the selected language;
And projecting the display indicating the translated content in the vicinity of the corresponding entry field of the entry form.
According to this feature, it is possible to translate and project a display indicating content to be entered in each entry field of the entry form in the vicinity of the relevant entry field according to the language of the entry person. It is possible to efficiently assist in filling out the filling-in form for those who need it. Furthermore, since a Japanese-language entry form can be used, it is easy for the person in charge at the window to check for incompleteness in the entry form.

FIG. 2 is a perspective view showing an installation state of a translation display device in Embodiment 1. It is a perspective view showing the structure of a translation display. It is a block diagram which shows the structure of a translation display function part. FIG. 7 is a view showing a state in which a part of the frame line of the entry sheet included in the image captured by the camera in the first embodiment is image-analyzed by the determination unit. It is a figure which shows the flowchart of the determination process of the projection position of a display. It is a figure which shows the flowchart of a translation process of a display. It is a figure which shows the flowchart of the determination process of the projection position of the translated display. FIG. 7 is a diagram showing a state in which a display is projected by being superimposed on an entry sheet by the projector in Embodiment 1. FIG. 7 is a diagram showing a state in which a display is superimposed and additionally projected on an entry sheet by a projector by pointing to a colored area in Example 1; FIG. 7 is a diagram showing a state in which the projection position of the display by the projector is adjusted in accordance with the change in the position of the entry sheet in the first embodiment. FIG. 17 is a diagram showing a state in which the thick line portion of the frame of the entry sheet included in the image captured by the camera in the second embodiment is image-analyzed by the determination unit.

  An embodiment for implementing a translation display device and a translation display method according to the present invention will be described below based on examples.

  The translation display device and the translation display method according to the first embodiment will be described with reference to FIG. 1 to FIG. Hereinafter, the upper side of the sheet of FIG. 1 and the upper side of the sheet of FIG. 4 (upper side of the entry sheet) will be the Japanese person in charge, the lower side of FIG. 1 and the lower side of the sheet of FIG. Explain as the writer.

  As shown in FIG. 1, the translation display device 1 in the present embodiment is, for example, a writing table such as a table or a counter provided at a window at various procedures at a window such as a government office, a real estate office or a post office. In the situation where the Japanese person in charge of the window and the foreigner fill in a face-to-face relationship between the Japanese person in charge and the foreigner in person and the entry form 11 placed on the writing board 10 It is placed sideways and is used to assist foreigners who need translation in order to complete the entry form 11. In the present embodiment, the language used by the foreigner is English, and the foreigner writes on the entry sheet 11 prepared in Japanese as an example.

  As shown in FIG. 1 and FIG. 2, the translation display device 1 is formed into a portable desk lamp, and has a substantially conical support portion 2, a camera 31 (imaging means) and a projector 32 (projection means) And a linking unit 4 linking the support unit 2 and the translation / display function unit 3.

  The connecting portion 4 is formed of a flexible tube capable of holding its shape, and the camera 31 provided adjacent to the front end portion of the case 30 of the translation display function portion 3 with respect to the entry sheet 11 placed on the entry table 10 The orientation and angle of the projector 32 can be adjusted appropriately.

  A battery (not shown) is incorporated in the support portion 2 and power is supplied to the translation display function unit 3 through a wire (not shown) inserted inside the connecting portion 4 by switching a power switch (not shown) to the on state. It is supposed to be. The battery and the power switch may be provided in the translation display function unit 3.

  Next, the structure of the translation display function unit 3 will be described. As shown in FIGS. 2 and 3, the translation display function unit 3 is housed inside the housing 30, the camera 31 and the projector 32 provided adjacent to the tip of the housing 30, and the housing 30. Language translation unit 5 (language translation unit) and display control unit 6 (display control unit). The camera 31 constantly captures an image in a state where power is supplied. In addition, since the camera 31 and the projector 32 that constitute the translation display function unit 3 have well-known configurations, detailed description will be omitted.

  As shown in FIG. 3, in the translation display function unit 3, the camera 31 and the projector 32 are connected to the display control unit 6, and the display control unit 6 is controlled by the projector 32 based on the image captured by the camera 31. Control is performed to project a display D (see FIG. 8) indicating contents to be entered in each entry field of the entry form 11 in the vicinity of the relevant entry field in an overlapping manner. The display D described below is a preset character string that suggests the content to be entered in each entry field of the entry form 11, and specifically, is an item of the entry field. Further, it is assumed that an imaging range by the camera 31 on the writing table 10 is set substantially the same as the projection range R (see FIG. 8) by the projector 32 or wider than the projection range R by the projector 32.

  Further, the display control unit 6 is connected to the language translation unit 5, and the language translation unit 5 translates the language used for the display D projected by the projector 32.

  Next, the structure of the display control unit 6 will be described. As shown in FIG. 3, the display control unit 6 includes a determination unit 60 (determination unit).

  Next, a method of determining the projection position of the display D by the display control unit 6 will be described. The display control unit 6 causes the determination unit 60 to perform image analysis of a part L (see FIG. 4) of the frame 12 of the entry sheet 11 included in the image based on the image captured by the camera 31. In addition, a part L of the frame line 12 of the entry sheet 11 indicates a part formed by crossing the frame line 12 into a rectangular shape. Discrimination unit 60 includes entry form database 63 storing the shape of a specific frame line for each of a plurality of types of entry forms used at the window, and part L of frame line 12 of entry form 11 subjected to image analysis; The type of the entry sheet 11 placed on the entry table 10 is determined by collating the form of the specific frame line for each of a plurality of types of entry sheets stored in the entry sheet database 63. The type of the entry sheet 11 is not limited to the one using the frame 12 of the entry sheet 11, but numbers, symbols, bar codes, two-dimensional codes, etc. set corresponding to the type of entry sheet are used. May be

  Further, the discrimination unit 60 sets the direction of the entry sheet 11 placed on the entry board 10 on the basis of the arrangement of the intersecting frame lines 12 in the part L of the frame line 12 of the entry sheet 11 configured in a rectangular shape. Determine. Further, the determination unit 60 determines the position of the entry sheet 11 placed on the entry table 10 by determining the type and the direction of the entry sheet 11 respectively.

  Further, in the entry form database 63, position information of each entry field of the entry form is stored for each of a plurality of types of entry forms, and the discrimination unit 60 is a part of the frame line 12 of the entry form 11 subjected to image analysis. Based on the position data of L, the respective entry fields of the entry form 11 correspond to the position information of the entry fields in the image of the entry form 11 that has been captured.

  In addition, a part L of the frame line 12 of the entry sheet 11 used for the determination in the determination unit 60 is not limited to the rectangular one, for example, other than the intersection points of the intersecting frame lines and the intersecting frame lines It may be a portion having a shape configured by connecting at least three or more points including one point.

  In the entry form database 63, a display D corresponding to each entry field is stored for each of a plurality of types of entry forms.

  Next, a system flow relating to the process of determining the projection position of the display D in the determination unit 60 of the display control unit 6 will be described with reference to FIG. As illustrated in FIG. 5, the determination unit 60 performs an image process on the image captured by the camera 31 to determine whether or not there is a specific frame line shape of the entry sheet (step SA1). Then, when the shape of a specific frame line of the entry form is detected from the image captured in step SA1, it is determined that the entry form is on the entry table 10, and the process moves to step SA2 and the image analyzed entry The form of the specific frame line of the form is collated with the entry form database 63 in which the form of the specific frame line for each of a plurality of types of entry forms is stored, and the process proceeds to step SA3 and the entry form placed on the entry table 10 The type is determined, and the process proceeds to step SA4, the direction of the entry sheet placed on the entry board 10 is determined, and the step proceeds to step SA5. The entry sheet placed on the entry table 10 based on the type and direction of entry sheet At step SA6, the position information of each entry field of the corresponding entry form is acquired from the entry form database 63. Then, the process proceeds to step SA7, the projection position of the display D corresponding to each entry field of the entry sheet is determined based on the position of the specific frame line of the entry form subjected to image analysis, and the process proceeds to step SA8. The position data is extracted, and the process proceeds to step SA9, where the projection position data of the display D is output to the display control unit 6.

  Next, the structure of the language translation unit 5 will be described. As shown in FIG. 3, the language translation unit 5 combines the directional microphone 50, the speech recognition unit 51, and the translation data of a plurality of types of languages used for translating the display D for each of a plurality of types of entry sheets. And a translation database 52 in which the template is stored.

  Next, a translation method of the language used for display D by the language translation unit 5 will be described. The language translation unit 5 collects conversational speech between a Japanese person in charge at the window and a foreigner by the directional microphone 50, and based on the conversational speech collected by the directional microphone 50, the speech recognition unit 51. By recognizing the language used by the foreigner, the language used by the foreigner is automatically set as the language used for translation. In addition, the language translation unit 5 writes in the discrimination data by acquiring the discrimination data of the type of the entry sheet 11 discriminated by the discrimination unit 60 of the display control unit 6 described above and the corresponding character string data of the display D. A template corresponding to a combination of the type of the sheet 11 and the language used by the foreigner set as the language used for translation is acquired from the translation database 52, and the display D is translated. The language translation unit 5 is not limited to the one provided with the translation database 52. For example, a communication unit may be provided to be able to acquire a template in which translation data are summarized from a server on the Internet.

  Next, a system flow relating to the translation process of the display D in the language translation unit 5 will be described with reference to FIG. As shown in FIG. 6, the voice recognition unit 51 recognizes the language used by the foreigner by the voice recognition unit 51 based on the conversation voice collected by the directional microphone 50 (step SB1). Then, the language used by the foreigner recognized in step SB1 is set as the language to be used for translation (step SB2), and the process proceeds to step SB3 where the entry sheet 11 determined by the determination unit 60 of the display control unit 6 is selected. The discrimination data of the type and the character string data of the corresponding display D are acquired, and the process proceeds to step SB4, and a template corresponding to the combination of the type of the entry sheet 11 in the discrimination data and the language used for the set foreigner Are acquired from the translation database 52. Then, the process proceeds to step SB5, the character string data of display D is translated using the template acquired from translation database 52, the process proceeds to step SB6, the translated character string data of display D translated is extracted, and step SB7 Then, the translated character string data of display D is output to the display control unit 6.

  Next, processing in the display control unit 6 will be described. The display control unit 6 receives the projection position data of the display D output from the determination unit 60 and the translated character string data of the display D output from the language translation unit 5 and projects the display D by the projector 32. ing.

  Next, a system flow related to processing in the display control unit 6 will be described with reference to FIG. As shown in FIG. 7, when the display control unit 6 receives the input of the projection position data of the display D output from the determination unit 60 in step SC1, the display control unit 6 receives the projection position data from the language translation unit 5 in step SC2. If there is an input from the language translation unit 5, the process proceeds to step SC3 where the projection position of the display D translated from the projection position data and the translated character string data is determined. The information on the projection position of the display D translated at step SC4 is output to the projector 32.

  Next, an example of the procedure of using the translation display device 1 will be described. First, the entry sheet 11 is placed on the entry board 10 in a state in which the Japanese person in charge of the window and the foreign entry person face each other across the entry board 10. Next, when the Japanese person in charge performs an operation to switch the power switch (not shown) provided on the support unit 2 to the on state, power is supplied to the translation display function unit 3 and the entry on the writing table 10 by the camera 31 is performed. The imaging of the sheet 11 and the collection of conversational speech by the directional microphone 50 are started, the process of determining the projection position of the display D by the display control unit 6 and the language used by the foreigner recognized by the speech recognition unit 51 After the translation processing of the display D in the language translation unit 5 is performed based on the above, the display D translated by the projector 32 is superimposed and projected in the vicinity of the corresponding entry field of the entry sheet 11 (see FIG. 8). In addition, the setting of the language used for the translation of the display D is not limited to that by voice recognition, and for example, a Japanese person in charge at the window is connected to the translation display device 1 by operating input means such as a keyboard and a mouse. It may be set by selecting the language used by the foreigner from the language options displayed on the separate display terminal.

  According to this, as shown in FIG. 8, the translation display apparatus 1 displays foreign D in the vicinity of the corresponding entry column indicating the indication D which indicates the content to be entered in each entry column of the entry sheet 11. Since it can be translated and projected in accordance with the language used, foreigners who need translation can efficiently assist in filling out the entry form 11. In addition, since it is possible to use an entry form prepared in Japanese, it is easy for a Japanese person in charge at the window to check an incomplete entry etc. in the entry form 11.

  Further, based on the image captured by the camera 31, the determination unit 60 of the display control unit 6 performs image analysis by performing image analysis on at least a portion L of the frame 12 of the entry sheet 11 included in the captured image. Since it is possible to determine the position of the entry column of the form 11 and to determine the position to project the display D suggesting the contents to be entered in each entry column, the position of the entry form 11 and the placement angle The display D can be projected to the correct position for each entry field of the entry form 11. Further, since the frame line 12 having a high contrast with the white paper portion in the entry sheet 11 is used for the determination of the determination unit 60, image analysis is easily performed from the image captured by the camera 31, and the display D The accuracy of the process of determining the projection position can be enhanced.

  Further, as shown in FIG. 3, the display control unit 6 includes a coloring display processing unit 61 (coloring display means), and the coloring display processing unit 61 determines the discrimination unit 60 based on the image captured by the camera 31. The projector 32 can project and color-display specific areas A1, A2 and A3 surrounded by the frame lines 12 formed on the entry sheet 11 to be image-analyzed by the image processing (see FIG. 8). As in the areas A2 and A3, the display may be partially colored so as to include the description positions of the items in the entry field. Further, the coloring display processing unit 61 needs a display D that suggests the content to be entered in each entry field of the entry form 11 based on the position of each entry field of the entry form 11 determined by the determination unit 60. For example, the document name in the entry form 11, the description location of the name, the entry location of the application date, etc. may be displayed in color.

  According to this, since it is possible to color-display the specific area surrounded by the frame 12 formed on the entry sheet 11 and the part where the display D is required to be displayed, for example, the entry required items in the entry sheet 11 It can be shown to guide the entry in the corresponding field in an easy-to-understand manner.

  Further, as shown in FIG. 9, the display control unit 6 displays a specific area (for example, area A3) displayed by the coloring display processing unit 61 by the coloring display processing unit 61 based on the image captured by the camera 31. When it is determined that is pointed, it is possible to perform a so-called pop-up display in which the projector 32 additionally projects the display D 'corresponding to the pointed area to the vicinity of the entry field. In the present embodiment, the display D which is always projected indicates an item in the entry column, and the display D 'which is additionally projected indicates notes on the entry content in the entry column and notes on the entry, etc. Similarly to the display D, the display D 'is projected in a translated state according to the language used by the foreigner. Further, as for the translation data of a plurality of types of languages used for translating the display D ′, templates similar to the display D and stored for each of a plurality of types of entry sheets are stored in the translation database 52.

  According to this, the Japanese person in charge of the window points the area colored and displayed on the entry sheet 11 as necessary, and causes the projector 32 to additionally project the display D 'in the vicinity of the entry column corresponding to the area. It is possible to facilitate communication with foreigners and effectively assist in filling out the entry form 11.

  In addition, the determination unit 60 performs the color display on the basis of whether a predetermined period of time in which the tip of the finger or the writing instrument overlaps the specific area colored and displayed by the color display processing unit 61 has elapsed. It is determined that a specific area has been indicated. Whether or not the tip of a finger, a writing instrument, or the like overlaps a specific area colored and displayed by the coloring display processing unit 61 is colored and displayed based on the image captured by the camera 31. By detecting the deformation of the shape of the frame 12 of the entry sheet 11 due to the overlapping of the tip of the finger or the writing instrument with the specific area, or the change in color or shade of the specific area displayed in color. It is determined.

  It should be noted that, by causing the discrimination unit 60 to recognize the entire hand based on the image captured by the camera 31, the display D 'additionally projected using a lead line or the like may not overlap with the hand on the entry sheet 11. The projection position of the display D ′ may be changed.

  In addition, as shown in FIG. 3, the display control unit 6 includes a display adjustment unit 62 (display adjustment unit), and the display adjustment unit 62 determines an image by the determination unit 60 based on the image captured by the camera 31. The correction data for the projection position data output from the determination unit 60 to the display control unit 6 is added by determining the change in the position of the part L (see FIG. 4) of the frame line 12 of the entry sheet 11 in Output to The display control unit 6 moves and rotates the projection position of the display D within the projection range R of the projector 32 based on the projection position data input from the determination unit 60 and the correction data input from the display adjustment unit 62. It corrects by (refer FIG. 10). The determination unit 60 may determine whether the projection position of the display D is correctly corrected with respect to each entry field of the entry sheet 11 based on the image captured by the camera 31.

  According to this, even if the position of the entry form 11 changes during the entry onto the entry form 11 by the foreigner, the display D is made to follow the change of the position of the entry form 11 and the display D is correct in the vicinity of each entry column. Since the image can be projected to the position, the entry on the entry form 11 of the foreigner can be assisted by the display D more accurately. Although illustration is omitted, the projection position of the display D 'additionally projected by pointing to the specific area colored and displayed by the coloring display processing unit 61 is also corrected according to the projection position of the display D. Ru.

  The adjustment of the projection position of the display D by the display adjustment unit 62 is performed by an area (for example, the area A1) surrounded by the frame 12 of the entry sheet 11 determined by the determination unit 60 based on the image captured by the camera 31. And may be calibrated so as to align the difference between the area displayed in the coloring display processing unit 61 before the change of the position of the entry column of the entry sheet 11.

  In addition, when the type of the entry form on the entry table 10 is changed, the language translation unit 5 newly sets the language used for translating the display D corresponding to the entry field of the entry form before the change. It can be continued as the setting of the language used for translating the display D corresponding to the entry field of the entry form. According to this, every time the type of the entry form is changed for the same foreigner, there is no need to set the language used for translating the display D again, so the processing in the language translation unit 5 It can be simplified and the display D corresponding to the modified form can be projected quickly.

  The translation display device and the translation display method according to the second embodiment will be described with reference to FIG. The same reference numerals are given to the same components as the components shown in the above embodiment, and the redundant description will be omitted.

  A method of determining the projection position of the display D by the display control unit 6 of the translation display device 1 in the second embodiment will be described. As shown in FIG. 11, the display control unit 6 analyzes the image of the thick line portion B of the frame line 112 of the entry sheet 111 included in the image by the determination unit 60 based on the image captured by the camera 31. Discrimination unit 60 is provided with an entry sheet database 63 storing the shape of the thick line portion of the frame for each of a plurality of types of entry sheets used at the window, and the bold line portion B of frame 112 of entry sheet 111 subjected to image analysis The type of the entry sheet 111 placed on the entry table 10 is determined by collating with the shape of the thick line portion of the frame line for each of a plurality of types of entry sheets stored in the entry sheet database 63.

  Further, the determination unit 60 determines the direction of the entry sheet 111 placed on the entry table 10 based on the shape of the thick line portion B of the frame line 112 of the entry sheet 111. The determination unit 60 determines the position of the entry sheet 111 placed on the entry table 10 by determining the type and the direction of the entry sheet 111.

  Further, position information of each entry field of the entry sheet is stored in the entry sheet database 63 for each of a plurality of types of entry sheets, and the discrimination unit 60 determines the thick line portion of the frame line 112 of the entry sheet 111 subjected to image analysis. Based on the position data of B, the respective entry fields of the entry sheet 111 correspond to the position information of the entry fields in the image of the entry sheet 111 that has been captured.

  According to this, generally, determination of the type and position of the entry sheet 111 by the determination unit 60 on the basis of the bold line portion B provided to facilitate recognition of the entry column by the entry person in the entry sheet 111 Therefore, the image analysis can be easily performed based on the image captured by the camera 31, and the accuracy of the process of determining the projection position of the display D by the display control unit 6 can be enhanced.

  Although the embodiments of the present invention have been described above with reference to the drawings, the specific configuration is not limited to these embodiments, and any changes or additions may be made without departing from the scope of the present invention. Be

  For example, although the embodiment has been described as a mode in which the display D translated into English is projected onto an entry form prepared in Japanese, the present invention is not limited to this. The language used may be any combination of language pairs.

  Moreover, in the said Example, although the translation display function part 3 demonstrated as what is integrally equipped with the camera 31 and the projector 32, a camera and a projector may be separate bodies.

  Further, in the above embodiment, the display D is always projected on the entry sheet 11 by the projector 32 and the display D 'is additionally projected by pointing to the specific area colored and displayed by the coloring display processing unit 61. Although the mode has been described, the present invention is not limited to this, and the display D and the display D 'are not always projected on the entry sheet 11, and the display is performed by pointing to a specific area colored and displayed by the coloring display processing unit 61. It may be additionally projected in a state where D and display D 'are combined. Also, all the displays D and displays D 'may be projected at all times.

  Further, in the above embodiment, the translation database 52 is described as a mode in which the template in which the translation data of a plurality of types of languages used for translating the display D and the display D ′ are organized into a plurality of types of entry sheets is stored. Not limited to this, for example, based on the image picked up by the camera 31, the discrimination unit 60 can recognize the character string of the item of the entry field corresponding to each entry field of the entry sheet so that it can be recognized. The translation data corresponding to the character string may be acquired from the translation database 52 and translation may be performed.

  In addition, the determination unit 60 may determine the type, the position, and the like of the entry sheet by analyzing the arrangement pattern of the frame of the entry column in the entry sheet based on the image captured by the camera 31.

DESCRIPTION OF SYMBOLS 1 translation display apparatus 2 support part 3 translation display function part 4 connection part 5 language translation part (language translation means)
6 Display control unit (display control means)
DESCRIPTION OF SYMBOLS 10 entry stand 11,111 entry form 12,112 frame line 30 housing 31 camera (imaging means)
32 Projector (projection means)
50 directional microphone 51 voice recognition unit 52 translation database 60 determination unit (determination means)
61 Coloring Display Processing Unit (Coloring Display Means)
62 Display Adjustment Unit (Display Adjustment Means)
63 Entry Form Databases A1 to A3 Area D, D 'Display L Frame Line Part B Thick Line R Projection Range

Claims (6)

Imaging means for imaging the placed entry form;
Projection means for projecting an indication indicating the contents to be entered in each entry field of the entry form over the entry form;
Language translation means for translating the language used for the indication indicating the content;
And a display control unit for causing the projection unit to project a display indicating the content in the vicinity of the corresponding entry field.   The display control means determines the position of the entry field of the entry sheet by image-analyzing at least a part of the frame line of the entry sheet contained in the image based on the image taken by the imaging means. The translation display apparatus according to claim 1, further comprising a determination unit.   The translation display device according to claim 1 or 2, wherein the display control means includes a coloring display means for coloring and displaying a specific area surrounded by a frame line formed on the entry sheet.   The display control means determines based on the image picked up by the image pickup means that a specific area colored and displayed by the color display means is pointed out, and an entry column corresponding to the specific area 4. The translation display device according to claim 3, wherein the projection means projects a display indicating the contents to be entered in the entry box in the vicinity of.   The display control means is characterized by comprising display adjustment means for adjusting the position of the display indicating the contents to be entered in each entry column in accordance with the change of the position of the entry sheet determined by the determination means. The translation display device according to any one of claims 1 to 4. Imaging the placed form;
Image-analyzing a part of the frame of the entry sheet included in the image based on the captured image;
Determining the position of the entry field of the entry form from a part of the frame line;
Determining the position at which to project the indication suggesting the content to be entered in each entry field of the entry form;
Selecting a language to be used for translating the indication suggesting the content based on the language of the writer's use;
Translating the indication indicative of the content into the selected language;
And projecting the display indicating the translated content in the vicinity of the corresponding entry field of the entry form.

Images