JP2017187586A - Speech display system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display a translation sentence or the like in an easily viewable manner, while displaying the whole image such as comics.SOLUTION: A display device includes image display means for displaying an image on the display screen of a display, display position information acquisition means for acquiring the display position information in the display screen of the image, and text display means for displaying a text associated with the image. A second text corresponding to the text is displayed in a position where the image is not displayed.SELECTED DRAWING: Figure 5

Description

  The present invention relates to a system for displaying comics, magazines, and the like converted into electronic data, and more particularly, to a system, method, and computer program for displaying lines associated with the data.

  In recent years, so-called electronic books such as comics, magazines, and books converted into electronic data are converted into computers (for example, personal computers (hereinafter referred to as “PCs”) having image display functions, portable terminals, etc. (for example, Technology that displays on tablet terminals, smartphones, etc.) has become widespread.

  In particular, with respect to character strings such as words included in the data of the electronic book, for example, a technique for indicating a display area of a curve (hereinafter simply referred to as “speech balloon”) surrounding a speech drawn in a form ballooned from a speaker, The technique regarding the display method of the lines displayed on the screen is disclosed (for example, see Patent Documents 1 to 3).

According to the technique disclosed in Patent Literature 1, when browsing an electronic comic, it is determined whether or not the entire sentence of the translated sentence translated from the original sentence is included in a preset character size. When it is determined that the entire sentence of the translated sentence is entered, the entire sentence of the translated sentence in the speech is displayed in the balloon. On the other hand, if it is determined that the whole sentence of the serif translation sentence does not enter, the speech balloon is enlarged and displayed, and the serif translation sentence is displayed in the enlarged speech balloon.
Further, according to the technique disclosed in Patent Document 2, for example, when browsing an electronic comic, if a translated sentence obtained by translating the original sentence is not contained in a vertically long balloon, the vertically long balloon is The translation is rewritten into a balloon and the translated sentence is displayed in the horizontally long balloon.
Further, according to the technique disclosed in Patent Document 3, for example, when browsing an electronic comic, a balloon that draws a character string of a serif converted from an original language into an arbitrary language is drawn. . In addition, it is possible to freely set dialogues and explanations in other languages without damaging the displayed illustrations, photos, and manga images, and to set the display positions of the dialogues and explanations freely. To.

By the way, in the techniques disclosed in Patent Documents 1 to 3, when the user selects and browses an arbitrary translated sentence, the translated sentence is displayed in the balloon, but the number of characters and the number of lines of the translated sentence are: When there are more characters or lines than the original language, it is necessary to store the number of characters and lines in the balloon.
Therefore, it is necessary to increase the size of the speech balloon, and as a result, the speech balloon overlaps with the illustration, and the image such as a comic is hidden.
Further, even when the speech balloon is arranged at a location that does not overlap the illustration, the translated sentence is displayed in a small size in the speech balloon, and as a result, there is a problem that it is difficult to read. Moreover, even if it is a case where it is comprised so that the whole sentence of a translation can be read by scroll operation, there existed a malfunction that operation was complicated.
Japanese Patent No. 5675451 Japanese Patent No. 5675450 Japanese Patent No. 3522644

  The present invention is for solving the conventional problems as described above, and the problem is to provide a system that can display a translated sentence and the like in an easy-to-view manner while displaying an entire image of a cartoon or the like. It is in.

In order to solve the above-mentioned problem, in the invention according to claim 1, an image display means for displaying an image on a display screen of a display, and a display position for acquiring display position information of the image in the display screen It has an information acquisition means and a text display means for displaying text associated with the image, and displays a second text corresponding to the text at a position where the image is not displayed.
Here, the text is, for example, a character string written in a balloon drawn in a comic image, a sound effect written in the background in the image, or a character string such as a narration.
The second text is a character string such as a translated sentence or commentary of the line.

  According to the display device of claim 1, the image is displayed on the display screen of the display by the image display unit, and display position information of the image in the display screen is acquired by the display position information acquisition unit. Therefore, the second text can be displayed at a position where the image is not displayed on the display screen of the display by the text display means.

The invention according to claim 2 is characterized in that the text is displayed close to the image.
According to the display device of the second aspect, the text and the image can be displayed without overlapping each other.

The invention according to claim 3 is characterized in that the second text is a translation of the text.
According to the display device of the third aspect, the translation of the text can be displayed at a position where the image is not displayed.

According to a fourth aspect of the present invention, when the predetermined position of the image is selected, the image display means displays the image in a reduced size and displays the second text in horizontal writing in the upper direction. It is characterized by.
According to the display device of claim 4, by displaying the image in a reduced size, the second text can be displayed larger than the text while maintaining a state where the entire image of the image is displayed. it can.

  The invention according to claim 5 is characterized in that the image is a cartoon or an illustration. Therefore, for example, a translation corresponding to a comic line can be displayed.

  The invention according to claim 6 is characterized in that the image is a screen shot of a moving image. Therefore, for example, it is possible to display a translation corresponding to a moving image line.

  According to the present invention, it is possible to easily display a translated sentence or the like while displaying an entire image of a cartoon or the like.

FIG. 1 is a diagram illustrating a configuration example of an image display system according to an embodiment of the present invention. FIG. 2 is an image diagram of an image display device in the image display system of FIG. FIG. 3 is a block diagram illustrating an example of a hardware configuration in the image display apparatus illustrated in FIG. FIG. 4 is a diagram illustrating an example of an image displayed on the image display unit in the image display device illustrated in FIG. 2. FIG. 5 is a diagram illustrating an example of an image displayed when a line is selected in the image illustrated in FIG. 4. FIG. 6 is a diagram illustrating an example of an image displayed when a sound effect is selected in the image illustrated in FIG. 4. FIG. 7 is a flowchart illustrating an example of image display processing when the electronic book viewer is activated. FIG. 8 is a diagram illustrating an example of a moving image screenshot displayed on the display screen and an example of an image displayed when subtitles are selected in the image display device illustrated in FIG. 2. FIG. 9 is a flowchart showing an example of image display processing when the moving image screen shot viewer is activated.

  Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the drawings. It should be noted that the image display system of the present invention is not limited to the following embodiments, and it is needless to say that various changes can be made without departing from the gist of the present invention.

<First embodiment>
FIG. 1 is a diagram illustrating a configuration example of an image display system according to an embodiment of the present invention.
The image display system 10 includes a distribution source server 1, a PC 5, an external storage medium 8, and an image display device 20.
The distribution source server 1 is provided with a communication interface (not shown), and so-called electronic books such as comics, magazines, and books converted into electronic data are transferred to a PC 5 or an image via a network 3 such as the Internet or a LAN (Local Area Network). It has a function of delivering to the display device 20.

  The distribution source server 1 stores image data of the electronic book and text data associated with the image (for example, comic lines, sound effects, explanations, etc.). The distribution source server 1 also stores, for example, second text data (for example, translated text) associated with the text data. The storage location of the various data (the image data, the text data associated with the image, and the second text data associated with the text data) is not limited to the distribution source server 1. Alternatively, another device (not shown) included in the distribution source may be used.

  The PC 5 is a computer having a communication interface (not shown) (for example, a personal computer), for example, a wireless communication method (hereinafter referred to as “wireless communication 4”) used in a mobile phone terminal, It has a function of connecting to the network 3 by using a wireless communication system (hereinafter referred to as “wireless communication 9”) used in a so-called wireless LAN. That is, the PC 5 is a device that can be operated by the user and has a function of enabling mutual communication with the distribution source server 1 via the network 3 through the wireless communication 4 and the wireless communication 9.

  Further, the PC 5 can be connected to the image display device 20 via the communication interface and the wireless communication 9 so as to be able to communicate with each other, and has a function of enabling transmission and reception of the various data between the PC 5 and the image display device 20. . Further, the PC 5 includes, for example, a USB (Universal Serial Bus) port (not shown), and can be connected to the external storage medium 8 through communication according to the USB standard so that the PC 5 and the external storage medium 8 can communicate with each other. A function of enabling the transmission and reception of the various data between them.

  The PC 5 has a function of storing the various data obtained from the distribution source server 1, the external storage medium 8, and the image display device 20. The PC 5 has a function of storing an application program for realizing one of the present invention and executing the application program by predetermined control.

  The display 6 includes a display screen that displays the various data output from the PC 5 so as to be visible. The display screen of the display 6 has a function corresponding to a so-called touch panel method in which the user operates the display screen by directly touching the display screen. In the present embodiment, the PC 5 and the display 6 are described as being separated from each other. However, the present invention is not limited to the above configuration.

  The mouse 7 is connected to the PC 5 as one of pointing means on the display screen of the display 6. The mouse 7 can be a general-purpose product that is connected by wireless connection such as Bluetooth (registered trademark) or wired connection using a USB connector or the like.

  The external storage medium 8 is, for example, a flash memory that is a non-volatile semiconductor memory, and is connected to the PC 5 and the image display device 20 through a USB port provided in the PC 5 and the image display device 20 so that they can communicate with each other. it can. The external storage medium 8 stores the various data obtained from the PC 5 and the image display device 20. When the external storage medium 8 is connected to the PC 5 or the image display device 20 via the USB port, data is read from the external storage medium 8 or data under the control of the respective device (PC 5 or image display device 20). Processing such as writing is performed.

  The image display device 20 is a portable terminal that includes a communication interface (not shown) and can be operated by a user such as a tablet terminal or a smartphone. The image display device 20 has a function of connecting to the network 3 using the wireless communication 4 or the wireless communication 9 via the communication interface. That is, the image display device 20 is a device that can be operated by the user and has a function of enabling mutual communication with the distribution source server 1 through the network 3 through the wireless communication 4 and the wireless communication 9.

  The image display device 20 can be connected to the PC 5 via the communication interface and the wireless communication 9 so as to be able to communicate with each other. The image display device 20 has a function that enables transmission and reception of the various data between the image display device 20 and the PC 5. . Further, the image display device 20 includes, for example, the USB port (not shown), and can be connected to the external storage medium 8 through communication according to the USB standard so that the image display device 20 and the external storage medium 8 can communicate with each other. A function of enabling transmission and reception of the various data.

  The image display device 20 has a function of storing the various data obtained from the distribution source server 1, the PC 5, and the external storage medium 8. The image display device 20 has a function of storing an application program for realizing one of the present invention and executing the application program by predetermined control.

FIG. 2 is an image diagram of an image display device in the image display system of FIG.
The image display device 20 includes an image display unit 21 that displays the various data obtained from the distribution source server 1, the PC 5, and the external storage medium 8 so as to be visible. The image display unit 21 corresponds to a so-called touch panel system in which a user operates by directly touching the surface of the image display unit 21. The image displayed on the image display unit 21 will be described in detail after FIG.

FIG. 3 is a block diagram illustrating an example of a hardware configuration in the image display apparatus illustrated in FIG.
The image display device 20 includes a control unit 41, a storage unit 42, a display position information acquisition unit 47, a related text display unit 48, a second text display unit 49, and an operation recognition unit 50. The units (41 to 50) are connected to each other through a bus line 45 so that they can communicate with each other.

The control unit 41 controls the entire image display device 20. Specifically, the control unit 41 is a CPU (Central Processing Unit) as an example, and is connected to hardware components (the units 41 to 50) inside the image display device 20 via the bus line 45. The control unit 41 controls hardware components in the image display device 20 using a RAM (not shown) formed of a volatile memory as a temporary storage work area according to the application program 44 stored in the storage unit 42. Thus, the entire image display apparatus 20 is controlled.
In addition, the control unit 41 performs various readings from the display position information acquisition unit 47, the related text display unit 48, and the second text display unit 49 according to the application program 44 stored in the storage unit 42 as necessary. An arithmetic processing operation requested by the application program 44 is performed using the data.
In addition, the control unit 41 controls the respective units (41 to 50) of the image display device 20 according to various commands transmitted from the user through the operation recognition unit 50 through the image display unit 21.

  The storage unit 42 is, for example, an application program that defines an OS (operating system) (not shown) necessary for the image display device 20 to execute a predetermined processing operation, and an arithmetic processing operation executed by the control unit 41 44 is a memory for storing various applications and various data (not shown), such as a hard disk or a semiconductor memory. Various data stored in the storage unit 42 is written based on a data write command signal output from the control unit 41 via the bus line 45, and is output from the control unit 41 via the bus line 45. Read based on data read command signal.

The application program 44 is, for example, a control program for controlling each unit (41 to 50) of the image display device 20 that is executed by the control unit 41, the distribution source server 1, the PC 5, and the external storage medium 8. And an electronic book viewer program for controlling to display various data and the various data and data related to the various data on the image display unit 21 as the electronic book.
The application program 44 defines the control operation of the control unit 41 based on command information input from the user through the image display unit 21 of the image display device 20. Note that the application program 44 can be executed by the image display device 20 in this embodiment. However, since the application program 44 is a program, it can be executed by a computer including a control unit such as the PC 5.

  The display position information acquisition unit 47 controls the image data in the image display unit 21 from image data relating to the electronic book output from the distribution source server 1, the PC 5, or the external storage medium 8 under the control of the control unit 41. Get information about the position to display. The display position information acquired by the display position information acquisition unit 47 is stored in the storage unit 42 via the bus line 45 under the control of the control unit 41. The display position information acquired by the display position information acquisition unit 47 is appropriately referred to based on the related text display command and the second text display command from the application program 44 under the control of the control unit 41.

  The related text display unit 48 displays text associated with the image data related to the electronic book output from the distribution source server 1, the PC 5, or the external storage medium 8 under the control of the control unit 41. In this embodiment, the text associated with the image data is mainly words, sound effects, explanations, etc., but is not limited to these as long as it is a character string. The text associated with the image data is output in association with the image data of the electronic book when the electronic book is output from the distribution source server 1, the PC 5, or the external storage medium 8. The data is stored in the storage unit 42 via the bus line 45 under the control of the unit 41.

  The related text display unit 48 refers to the text associated with the image data stored in the storage unit 42 based on the related text display command output from the application program 44 under the control of the control unit 41. The referenced text is displayed on the image display unit 21.

  The second text display unit 49 is a second text associated with the text data related to the electronic book output from the distribution source server 1, the PC 5, or the external storage medium 8 under the control of the control unit 41. Is displayed. In the present embodiment, the second text is mainly a translation of text associated with the image data, but is not limited to this. The second text is output in association with the text data of the electronic book when the electronic book is output from the distribution source server 1, the PC 5, or the external storage medium 8. Under control, the data is stored in the storage unit 42 via the bus line 45.

  Also, the second text display unit 49 is controlled by the control unit 41, and based on the second text display command output from the application program 44, the second text display unit 49 is associated with the text data stored in the storage unit 42. With reference to the text, the referenced second text is displayed on the image display unit 21.

  When the operation recognition unit 50 receives a selection command signal from the user through the image display unit 21 under the control of the control unit 41, the operation recognition unit 50 outputs the selection command signal to the control unit 41. In the present embodiment, the selection command signal is a signal output when the user selects various images and texts displayed on the screen display unit 21 and various selections according to the user's screen operation. Although it is set as the signal which instruct | indicates execution of operation | movement (a so-called tap, swipe, flick, pinch in, pinch out, etc.), it is not limited to these.

FIG. 4 is a diagram illustrating an example of an image displayed on the image display unit in the image display device illustrated in FIG. 2.
The page 22 is a page of the comic image displayed on the image display unit 21 based on the image display command of the application program 44 under the control of the control unit 41 of the image display device 20 when the user operates the image display unit 21. It is a part. In the present embodiment, the page 22 is divided into a plurality of so-called frame divisions. However, the frame division may not be provided, and the present invention is not limited to this.

As is apparent from FIG. 4, the comic image of the page 22 includes a person image 23 that is a specific object, a background image 25, and a vehicle image 26 that is a specific object. In the vicinity of the person image 23, for example, text associated with the person image 23 is displayed as a line 24 (A) (for example, “Good morning”). Similarly, for example, in the vicinity of the vehicle image 26, for example, text associated with the vehicle image 26 is displayed as a sound effect 27 (A) (for example, “Bibi!”).
The comic image of the page 22 is associated with, for example, image data of a page to be browsed previously stored in the storage unit 42 or the image data based on an image display command of the application program 44 under the control of the control unit 41. Data / information necessary for browsing is appropriately referred / selected from the text (serif), the second text (translated sentence) associated with the text data, the display position information of the image, etc. Is displayed.
Further, the display size of the page 22 is appropriately adjusted based on a predetermined processing operation of the application program 44 in accordance with the size of the output image display unit.

FIG. 5 is a diagram illustrating an example of an image displayed when a line is selected in the image illustrated in FIG. 4.
The image display unit 21 shown in FIG. 5 shows an image displayed when the user selects a part of the page 22 detailed in FIG. Specifically, the image display unit 21 displays a text display unit 21 (A) that displays text, an image display unit 21 (B) that displays a reduced version of the page 22, and a text display unit 21 (A). The function selection unit 21 (C) for selecting an extended function of text to be displayed is divided into three areas. In the image display unit 21, the areas occupied by the three parts (21 (A) to 21 (C)) are the length of text and the size of characters arranged (displayed) in the respective areas. Alternatively, it is appropriately adjusted based on a predetermined command of the application program 44 under the control of the control unit 41 depending on the size of the image. For this reason, the area allocated in this embodiment is not limited.

The text display unit 21 (A) displays the second text associated with the dialogue 24 (A) in FIG. As described above, the image data is preliminarily associated with the text (serif) associated with the image data and the second text (translated sentence) associated with the text (serif), and the storage unit 42. Stored in For example, when the user selects the line 24 (A) in FIG. 4, the control unit 41 transfers the line 24 (A) from the storage unit 42 to the line 24 (A) based on the second text display command of the application program 44. The associated translated sentence (translated sentence 24 (B) in FIG. 5) is extracted and displayed on the text display unit 21 (A) via the second text display unit 49.
In addition, a scroll bar 28 is arranged in the text display unit 21 (A). For example, when the translated sentence 24 (B) is a long sentence or is set to display a large character size, the scroll bar 28 does not fit in the area of the screen display unit 21 (A). Sometimes, the user operates the scroll bar 28 to check the entire text displayed on the text display unit 21 (A).

  On the image display unit 21 (B), a reduced image of the entire page 22 displayed in FIG. 4 is displayed. As described above, display position information, which is information on a position for displaying the image, is associated with the image data in advance, and stored in the storage unit 42. For example, when the user performs the selection operation of the dialogue 24 (A) in FIG. 4, the control unit 41 displays the text based on the display position information acquired in advance and the image reduction command of the application program 44. The page 22 of FIG. 4 is reduced and displayed on the screen display unit 21 (B) so as not to overlap the unit 21 (A) and the function selection display unit 21 (C).

Various icons (29 (A) to 29 (F)) for executing the extended function of the text displayed on the text display unit 21 (A) are displayed on the function selection unit 21 (C).
For example, when the icon 29 (A) is selected by the user, under the control of the control unit 41, various languages desired by the user for the language of the translated sentence 24 (B) based on a predetermined processing operation of the application program 44. You can switch to the language of the country and display it.
For example, when the icon 29 (B) is selected by the user, a copy of the translated sentence 24 (B) is stored based on a predetermined processing operation of the application program 44 under the control of the control unit 41. be able to.
For example, when the icon 29 (C) is selected by the user, based on a predetermined processing operation of the application program 44 under the control of the control unit 41, the meaning and usage example of the translated sentence 24 (B) are: It is possible to search from the Web via a browser (not shown).
For example, when the icon 29 (D) is selected by the user, the search result from the Web is stored in the browser based on a predetermined processing operation of the application program 44 under the control of the control unit 41. I can keep it.
For example, when the icon 29 (E) is selected by the user, the image display unit 21 (A) is closed based on a predetermined processing operation of the application program 44 under the control of the control unit 41, and the image display unit By enlarging the area 21 (B), the page 22 can be displayed in a large size in accordance with the enlarged area.
For example, when the icon 29 (F) is selected by the user, various functions desired by the user can be added based on predetermined processing operations of the application program 44 under the control of the control unit 41. In the present embodiment, in the description of the icons 29 (A) to 29 (E), 24 (B) is described as a translated sentence, but this is not limited to a translated sentence, and it is effective if it is a character string. The same processing is possible for sounds and commentary.

FIG. 6 is a diagram illustrating an example of an image displayed when a sound effect is selected in the image illustrated in FIG. 4.
Note that the difference between FIG. 5 and FIG. 6 is that the character string displayed on the text display unit 21 (A) is not a translated sentence of the page 22 (24 (A) in FIG. 5) but a specific object. This is a translation of the sound effect 27 (A) displayed in the vicinity of the vehicle image. For this reason, the description is limited to sound effects 27 (A) and translated sentences 27 (B).

  The text display unit 21 (A) displays the second text associated with the sound effect 27 (A) in FIG. As described above, the image data is associated with the text (sound effect) associated with the image data and the second text (translation) associated with the text (sound effect) in advance, and is stored. Stored in the unit 42. For example, when the user selects the sound effect 27 (A) in FIG. 4, the control unit 41 reads the sound effect 27 (A) from the storage unit 42 based on the second text display command of the application program 44. ) Is extracted (translated sentence 27 (B) in FIG. 5) and displayed on the text display unit 21 (A) via the second text display unit 49.

On the image display unit 21 (B), a reduced image of the entire page 22 displayed in FIG. 4 is displayed. As described above, display position information, which is information on a position for displaying the image, is associated with the image data in advance, and stored in the storage unit 42. For example, when the user performs the selection operation of the sound effect 27 (A) in FIG. 4, the control unit 41 reads the text based on the display position information acquired in advance and the image reduction command of the application program 44. The page 22 of FIG. 4 is reduced and displayed on the screen display unit 21 (B) so as not to overlap the display unit 21 (A) and the function selection unit 21 (C).
As already described in detail with reference to FIG. 5, the respective areas (21 (A) to (C)) occupy the lengths of text and characters arranged (displayed) in the respective areas. Depending on the size of the image or the like, it is adjusted as appropriate based on a predetermined command of the application program 44 under the control of the control unit 41. Therefore, the area allocated in this embodiment is not limited.

FIG. 7 is a flowchart illustrating an example of image display processing when the electronic book viewer is activated.
In FIG. 7, first, upon receiving an electronic book viewer activation instruction from the user, the control unit 41 activates the application program 44, thereby starting an image display process described below (step S1).
Next, the control unit 41 performs a predetermined processing operation so as to acquire a so-called electronic book desired by the user from the distribution source server 1, the PC 5, the external storage medium 8, and the like. Next, the control unit 41 is associated with image data, display position information on which the image data is displayed, text information associated with the image data, and the text information from the acquired electronic book. Second text information and the like are acquired (step S2).
Next, the control unit 41 displays the acquired image data on the image display unit 21 based on the processing operation of the application program 44 (step S3). Thereby, the user can browse an image (manga).
For example, when a speech balloon is selected from the image by the user, the control unit 41 refers to the acquired display position information based on the processing operation of the application program 44, and determines a position where the image is not displayed. Recognizing and displaying in advance a second text (for example, a translation) associated with the line in advance in a position where the image is not displayed, and further, the position where the acquired image does not overlap the second text Are reduced and displayed (step S4).
Then, upon receiving an electronic book viewer end instruction from the user, the application program 44 is ended by the control unit 41, and a series of image display processing ends. (Step S5). Note that, when the browsing is continued without ending the electronic book viewer, the control unit 41 continues to execute the processes from step S2 to S4 based on the processing operation of the application program 44.

<Second embodiment>
FIG. 8 is a diagram illustrating an example of a moving image screenshot displayed on the display screen and an example of an image displayed when subtitles are selected in the image display device illustrated in FIG. 2.
FIG. 8A shows a display on the image display unit 21 based on a moving image screenshot display command of the application program 44 under the control of the control unit 41 of the image display device 20 when the user operates the image display unit 21. Is part of the screenshot of the video to be played.
Also in the second embodiment, various data (information) such as image data, text associated with the image data, second text associated with the text, display position information of the image, and the like. The acquisition method is the same as the method described above in the first embodiment. Further, the display method of the various data (information) and the processing method by the application 44 under the control of the control unit 41 are also the same. In other words, in the first embodiment, an object to be displayed is an image (so-called electronic book), but in the second embodiment, it is a screen shot of a Western movie, an overseas drama, a video distributed on the Internet, or the like. .

The image display unit 21 is divided into two areas: a video screen shot display unit 30 (A) that displays a video screen shot, and a subtitle display unit 31 (A) that displays subtitles according to the scene of the video screen shot. Yes. In the image display unit 21, each of the two display units (30 (A) and 31 (A)) occupies the length of text and characters arranged (displayed) in the respective regions. The size is adjusted as appropriate based on a predetermined command of the application program 44 under the control of the control unit 41 depending on the size or the size of the moving image screen shot. Therefore, the area allocated in this embodiment is not limited.
For example, when the screen shot displayed on the moving image screen shot display unit 30 (A) is a Western image, the subtitle display unit 31 (A) displays, for example, the content of the person image 32 that is a specific target object. As subtitles (for example, “Good Morning” 33 (A)).

FIG. 8B shows an application program 44 under the control of the control unit 41 of the image display device 20 by the user operating the image display unit 21 and selecting the caption 33 (A) of FIG. Is a part of the screen shot of the moving image displayed on the image display unit 21 based on the moving image screenshot display command.
The image display unit 21 is displayed on a text display unit 31 (B) that displays text, a moving image screen shot display unit 30 (B) that displays a reduced version of the moving image screenshot, and a text display unit 31 (B). The area is divided into three areas: a function selection unit 31 (C) for selecting an extended function of text. In the image display unit 21, the areas occupied by these three parts (30 (B), 31 (B), 31 (C) are the lengths of texts arranged (displayed) in the respective areas, Depending on the size of the character or the size of the image, etc., it is appropriately adjusted based on a predetermined command of the application program 44 under the control of the control unit 41. Therefore, the area allocated in this embodiment is not limited.

The text display unit 31 (B) displays a sentence obtained by translating the original sentence subtitle associated with 33 (A) in FIG. As described above, the video screen shot is pre-associated with the text (original subtitle) associated with the video screen shot and the second text (translated text) associated with the text (original subtitle). Stored in the storage unit 42. For example, when the user performs the selection operation of the caption 33 (A) in FIG. 8, the control unit 41 relates to the caption 33 (A) from the storage unit 42 based on the second text display command of the application program 44. The attached translation (translation sentence 33 (B) in FIG. 8) is extracted and displayed on the text display section 31 (B) via the second text display section 49.
In addition, a scroll bar 34 is arranged in the text display portion 31 (B). For example, when the translated sentence 33 (B) is a long sentence or is set to display a large character size, the scroll bar 34 does not fit in the area of the text display unit 31 (B). Sometimes, the user operates the scroll bar 34 to check the entire text displayed on the text display unit 31 (B).

  In the moving image screen shot display unit 30 (B), a reduced image of the entire screen shot of the moving image displayed in the moving image screen shot display unit 30 (A) of FIG. 8A is displayed. As described above, display position information, which is information on a position where the moving image screen shot is displayed, is associated with the moving image screen shot in advance, and stored in the storage unit 42. For example, when the user performs the selection operation of the caption 33 (A) in FIG. 8, the control unit 41 displays the text based on the display position information acquired in advance and the image reduction command of the application program 44. The moving image screen shot of FIG. 8A is reduced and displayed on the moving image screen shot display unit 30 (B) so as not to overlap the unit 31 (B) and the function selecting unit 31 (C).

Various icons (35 (A) to 35 (F)) for executing an extended function of the text displayed on the text display unit 31 (B) are displayed on the function selection unit 31 (C).
For example, when the icon 35 (A) is selected by the user, the language of the caption 33 (A) or the translated sentence 33 (B) is controlled based on a predetermined processing operation of the application program 44 under the control of the control unit 41. The language can be switched to various languages desired by the user and displayed.
For example, when the icon 35 (B) is selected by the user, the subtitles 33 (A) and the translated sentence 33 (B) are controlled based on a predetermined processing operation of the application program 44 under the control of the control unit 41. A copy can be stored.
For example, when the icon 35 (C) is selected by the user, the subtitles 33 (A) and the translated sentence 33 (B) are controlled based on a predetermined processing operation of the application program 44 under the control of the control unit 41. Meanings and usage examples can be searched from the Web via a browser (not shown).
Further, for example, when the icon 35 (D) is selected by the user, the search result from the Web is stored in the browser based on a predetermined processing operation of the application program 44 under the control of the control unit 41. I can keep it.
For example, when the icon 35 (E) is selected by the user, the text display unit 31 (B) is closed based on a predetermined processing operation of the application program 44 under the control of the control unit 41, and a moving image screenshot is displayed. The area of the display unit 30 (B) can be enlarged, and a moving image screenshot can be displayed in a large size in accordance with the enlarged area.
For example, when the icon 35 (F) is selected by the user, various functions desired by the user can be added based on predetermined processing operations of the application program 44 under the control of the control unit 41.

FIG. 9 is a flowchart showing an example of image display processing when the moving image screen shot viewer is activated.
In FIG. 9, first, upon receiving a moving image screen shot viewer activation instruction from the user, the control unit 41 activates the application program 44, thereby starting an image display process described below (step S11).
Next, the control unit 41 performs a predetermined processing operation in order to obtain a screen shot of a moving image desired by the user from the distribution source server 1, the PC 5, the external storage medium 8, or the like. Next, the control unit 41 correlates the image data, the display position information on which the image data is displayed, the text information associated with the image data, or the text information from the acquired screen shot of the moving image. The second text information is acquired (step S12).
Next, the control unit 41 displays a screen shot of the acquired moving image on the image display unit 21 based on the processing operation of the application program 44 (step S13). Thereby, the user can browse the screen shot of the moving image.
When the user selects, for example, a caption of a moving image screen shot, the control unit 41 refers to the acquired display position information based on the processing operation of the application program 44, and the moving image screen shot is not displayed. While recognizing the position, the second text (for example, translation) associated with the subtitle in advance is displayed horizontally in a position where the screen shot of the video is not displayed, and the screen shot of the acquired video is displayed. Reduced display is performed at a position that does not overlap the second text (step S14).
Then, upon receiving an instruction to end the moving image screen shot viewer from the user, the control unit 41 ends the application program 44, and a series of image display processing ends. (Step S15). In addition, when continuing browsing without ending the moving image screen shot viewer, the control unit 41 continues to execute the processes from step S12 to S14 based on the processing operation of the application program 44.

  An image display device, an image display system, an image display method, and a computer program according to the present invention can display translated sentences and the like in an easy-to-view manner while displaying an entire image such as a comic. It can be used in the distribution industry.

1 Distribution source server 3 Network 4 Wireless communication (wireless communication method used in mobile phone terminals)
5 PC
6 Display 7 Mouse 8 External storage medium 9 Wireless communication (wireless communication method used in wireless LAN)
DESCRIPTION OF SYMBOLS 10 Image display system 20 Image display apparatus 21 Image display part 21 (A) Text display part 21 (B) Image display part 21 (C) Function selection part 22 Page 23 Person image 24 (A) line which is a specific target object 24 (B) Translated sentence 25 Background image 26 Vehicle image 27 (A) Sound effect 27 (B) Translated sentence 28 Scroll bar 29 (A) to 29 (F) Icon 30 (A) Movie screenshot Display unit 30 (B) Movie screen shot display unit 31 (A) Subtitle display unit 31 (B) Text display unit 31 (C) Function selection unit 32 Human image 33 (A) Subtitle 33 (B) as a specific object Translated sentence 34 Scroll bar 35 (A) to 35 (F) Icon 41 Control unit 42 Storage unit 44 Application program 45 Bus line 47 Display position information acquisition Part 48 related text display part 49 second text display part 50 operation recognition part

Claims (8)

Image display means for displaying an image on a display screen of a display, display position information acquisition means for acquiring display position information of the image in the display screen, and text display means for displaying text associated with the image Have
A display device, wherein a second text corresponding to the text is displayed at a position where the image is not displayed.   The display device according to claim 1, wherein the text is displayed in proximity to the image.   The display device according to claim 2, wherein the second text is a translation of the text.   The display device according to claim 1, wherein when the predetermined position of the image is selected, the image display unit displays the image in a reduced size and displays the second text in a horizontal writing upward.   The display device according to claim 1, wherein the image is a cartoon or an illustration.   The display device according to claim 1, wherein the image is a screen shot of a moving image.   A step of displaying an image on a display screen of a display; a step of acquiring display position information of the image in the display screen; a step of displaying text associated with the image; and a position where the image is not displayed. And displaying a second text corresponding to the text.   A step of displaying an image on a display screen of a display; a step of acquiring display position information of the image in the display screen; a step of displaying text associated with the image; and a position where the image is not displayed. And causing the computer to execute a step of displaying a second text corresponding to the text.