JP2013077075A - Image display system, learning system, image display method and control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display system performing presentation that interests a user, when displaying a character string along with an image.SOLUTION: A server 2 comprises a character area setting part 6 which sets a character area and a character string arrangement part 7 which arranges a first character string in the character area. A user terminal 3 comprises a display control part 12 and an operation part 11. The display control part 12 switches display/non-display of the first character string in a photographic image according to an operation amount by a user.

Description

  The present invention relates to an image display system including a server and / or a user terminal.

  In recent years, some portable terminals synthesize an image such as a message at a predetermined position of the image and send it as a greeting mail. In addition, there is an imaging device that synthesizes dialogue taken out from a database with a captured image (Patent Document 1).

  Moreover, when displaying the hint of a game, there is a program that displays a hint character string at a position touched by a user by superimposing a shielding object on a key word (hint character string) (Patent Document 2). .

JP 2009-88749 A (published April 23, 2009) JP 2010-233959 A (released on October 21, 2010)

  In the configuration of Patent Document 1, a line is simply displayed in a balloon, and cannot be used for learning purposes by switching between display and non-display. In the configuration of Patent Document 2, the hint character string is displayed / hidden, and the character string cannot be displayed as if the character string was taken.

  An object of the present invention is to realize an image display system that produces an effect that attracts the user's interest when displaying a character string together with an image.

  In the image display system according to the present invention, a first character string is associated with a captured image, and a character region for displaying the corresponding first character string in the captured image is set for each captured image. A setting means, a character string arranging means for adjusting the size of the first character string corresponding to the character area so as to fit in the character area, and arranging the first character string in the character area; the first character string; A display control unit that controls display of a captured image; and an operation input unit that receives an operation by a user. The display control unit displays the captured image after displaying the captured image with the first character string hidden. Control is performed to change the first character string in the captured image from a non-display state to a display state in accordance with an operation amount by the user received by the operation input means.

  In the image display method according to the present invention, a first character string is associated with a photographed image, and a character region for displaying the first character string corresponding to the photographed image is set for each photographed image. Adjusting a size of the corresponding first character string so as to fit in the character area, placing the first character string in the character area, and non-setting the first character string. A first display step for displaying the photographed image in a display state, an operation input step for accepting an operation by a user, and the first of the photographed images according to an operation amount by a user accepted by the operation input means. And a second display step for changing the character string from the non-display state to the display state.

  According to said structure, a 1st character string in a picked-up image is hidden, a picked-up image is displayed, and a 1st character string is hidden in the character area in a picked-up image according to a user's operation amount Change from state to display state. Such display effects can attract the user's interest in the captured image and the first character string. In addition, since a character string can be superimposed on a captured image captured in advance, the number of combinations of captured images and character strings can be easily increased. Therefore, it is possible to perform image display that attracts the user's interest in images and character strings.

  The display control means may be configured to control to display a part of the first character string corresponding to the repetition of a specific operation by the user on the captured image.

  The operation input means includes a touch panel that can be touch-operated on the display screen, and the display control means performs control to display a part of the first character string at the touched position on the captured image. It may be a configuration.

  Further, the character area is a rectangular area, and when the character area is inclined, the character string arranging means arranges the first character string in the character area in accordance with the inclination of the character area. It may be a configuration.

  Further, the character string arrangement unit generates a composite image obtained by combining the first character string on the photographed image, and the display control unit controls the display of the shielding image so as to overlap the character region of the composite image. By performing the above, the first character string may be hidden.

  Further, the display control means is configured to gradually display the first character string on the photographed image by increasing the transparency of the shielding image in accordance with an operation by the user received by the operation input means. May be.

  In addition, the display control unit performs control to display the layer including the first character string on the layer including the captured image, and makes the first character string transparent by making the first character string transparent. It may be configured to be in a non-display state.

  Further, the display control means gradually displays the first character string on the photographed image by reducing the transparency of the first character string in accordance with a user operation received by the operation input means. It may be.

  The setting means may be configured to set the character area based on the position and size of a predetermined symbol in the captured image.

  The setting unit may be configured to set a plain rectangular area in the captured image as the character area.

  The image display system includes a server and a user terminal. The server includes the setting unit and the character string arrangement unit. The user terminal includes the display control unit and the operation input unit. It may be a configuration.

  The learning system according to the present invention includes the image display system, and the display control means is configured to display the first character string while or before the first character string is displayed in the non-display state. It may be configured to include a presentation control means for performing control to display the second character string corresponding to the above to the user by display or voice.

  The second character string may be a character string indicating the meaning of the first character string.

  The image display system may be partially realized by a computer. In this case, a control program for causing the image display system to be realized by a computer by causing the computer to operate as each of the means, and the control A computer-readable recording medium in which the program is recorded also falls within the scope of the present invention.

  As described above, according to the present invention, the first character string in the captured image is displayed in a non-display state, and the first character string is displayed in the character area in the captured image according to the operation amount of the user. Is changed from the non-display state to the display state. Such display effects can attract the user's interest in the captured image and the first character string. In addition, since a character string can be superimposed on a captured image captured in advance, the number of combinations of captured images and character strings can be easily increased. Therefore, it is possible to perform image display that attracts the user's interest in images and character strings.

It is a schematic block diagram which shows the structure of the learning system of one Embodiment which concerns on this invention. It is a figure which shows an example of the screen of an English word learning application. It is a figure which shows an example of the screen of the word book mode of an English word learning application. It is a figure which shows an example of the screen of the word book mode of an English word learning application. It is a figure which shows an example of the screen of the learning mode of an English word learning application. It is a figure which shows an example of the screen of the learning mode of an English word learning application. It is a figure which shows an example of the screen of the learning mode of an English word learning application. It is a figure which shows the character area in a picked-up image. It is a figure which shows the picked-up image which image | photographed the board containing a two-dimensional barcode. It is a flowchart which shows the production | generation processing flow of the English word image by a server. It is a flowchart which shows the processing flow in the learning mode by a user terminal. It is a flowchart which shows the processing flow by a server. It is a flowchart which shows the processing flow in the learning mode by a user terminal. It is a schematic block diagram which shows the structure of the learning system of other embodiment which concerns on this invention. It is a flowchart which shows the processing flow in a user terminal. It is a schematic block diagram which shows the structure of the learning system of further another embodiment which concerns on this invention. It is a flowchart which shows the processing flow by a server.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[Embodiment 1]
In this embodiment, a learning system in which the present invention is applied to an English word learning application (application) will be described. The user downloads the English word learning application from the server to the user terminal, installs it on the user terminal, and uses it. The installed English word learning application controls the user terminal to perform various operations and screen displays. Here, the user terminal is a smartphone (high function mobile phone) provided with a touch panel.

<Outline of English word learning app>
The English word learning application of this embodiment displays English words in the photographed image.

  FIG. 2 is a diagram illustrating an example of a screen of the English word learning application of the present embodiment. In the screen shown in FIG. 2, an image 21 in which the English word “delicious” is drawn on a blackboard (board) held by a person is displayed on the display screen 20 of the user terminal. In the image 21, the English word is synthesized with the photographed image as if written on the blackboard held by the person. In the translated word display area 22 below the image 21, Japanese “delicious” indicating the meaning of the English word is displayed. The English word learning application associates one English word with one captured image (person image) and displays a different captured image for each English word. Therefore, the user can learn English words while enjoying images.

  A plurality of menu buttons 23 to 27 are displayed below the translated word display area 22. For example, when the user selects (touches) the menu button 23 on the touch panel, the English word learning application shifts to the new word mode. When the user selects the menu button 24, the English word learning application shifts to the word book mode. When the user selects the menu button 25, the English word learning application shifts to the favorite mode. When the user selects the menu button 26, the English word learning application shifts to a learning mode. When the user selects the menu button 27, the English word learning application shifts to the review mode.

  The screen shown in FIG. 2 is an example of a new arrival word mode screen. The English word learning application can download English words (images corresponding to English words) to be added to the server every predetermined period. For example, the English word learning application checks whether there is a new English word on the server when the English word learning application is activated, and if there is a new English word, downloads the image to the user terminal. The English word learning application displays the downloaded new English word image 21 on the display screen 20 of the user terminal. In addition, when there are a plurality of new English words, the user can display another English image on the display screen 20 by flicking (sliding) left or right on the image.

  On the left side of the image 21, a post button 28 and a favorite registration button 29 are displayed. When the user selects the posting button 28, the English word learning application shifts to a mode for posting to, for example, a blog or SNS (social network service). When the user selects the favorite registration button 29, the English word learning application registers the currently displayed English word image 21 as a favorite. For example, the images 21 and English words registered as favorites are displayed in a list in the favorites mode.

  FIG. 3 is a diagram showing an example of a screen in the word book mode of the English word learning application of the present embodiment. In the word book mode, the English word learning application displays a list of already downloaded English words and their translations. Note that menu buttons 23 to 27 are displayed below the list. The user can scroll the list by flicking up or down on the list. When the user selects one English word from the list, an image of the English word is displayed.

  FIG. 4 is a diagram illustrating an example of a screen in the word book mode of the English word learning application of the present embodiment. In FIG. 4, an image 31 of the English word “link” selected by the user is displayed on the display screen 20. The image 31 of the English word “link” is a photographed image of a person different from the image 21 of the English word “delicious”. On the image display screen in the word book mode, the translated word display area 22, the menu buttons 23 to 27, the posting button 28, and the favorite registration button 29 are displayed as in the new arrival word mode shown in FIG. A list display button 32 is displayed on the left side of the image 31 on the image display screen in the word book mode. When the user selects the list display button 32, the screen shifts to a list display screen of the word book shown in FIG. In addition, the user can display an image of another downloaded English word on the display screen 20 by flicking left or right on the image.

  FIG. 5 is a diagram illustrating an example of a learning mode screen of the English word learning application of the present embodiment. When the English word learning application shifts to the learning mode, the image 41 corresponding to any English word is displayed. The learning mode includes a Japanese display mode that displays only Japanese translations of English words and Japanese translations, and an English display mode that displays only English words. FIG. 5 shows a screen in Japanese display mode in which only Japanese translations are displayed in the translation display area 22. On the image display screen in the learning mode, the menu buttons 23 to 27, the posting button 28, and the favorite registration button 29 are displayed as in the new word mode shown in FIG. On the image display screen in the learning mode, an English button 42, a Japanese button 43, and a review registration button 44 are displayed above the image 41. When the user selects the English button 42, the mode is shifted to an English display mode in which only English words are displayed without displaying Japanese translations. Conversely, when the user selects the Japanese button 43 in the English display mode, the mode shifts to the Japanese display mode in which only Japanese translations are displayed without displaying English words. When the user selects the review registration button 44, the English word of the image 41 currently displayed is registered as the review target English word. In the review mode, an image of English words registered as review targets is displayed.

  In the learning mode screen shown in FIG. 5, another image (shielded image) is displayed superimposed on a rectangular area 45 corresponding to the blackboard held by the person in the captured image, and the English words drawn on the blackboard Is hidden. The occlusion image may be an image of the same color as the background area (blackboard) or an image of a different color. When the user touches the rectangular area 45, the shield image at the touched position disappears, and the English word character at that location is displayed. For example, when the user traces the screen along the line 46 shown in FIG. 5, as shown in FIG. 6, a part of the English word “deli” corresponding to the vicinity of the traced position is displayed. Other parts of English words can be displayed by the same operation. The user analogizes the corresponding English word from the translated word “delicious” in the translated word display area 22 while the original English word is not displayed, and then traces the blackboard in the image to display the English word. Can answer.

  FIG. 7 is a diagram illustrating an example of a learning mode screen of the English word learning application of the present embodiment. In the screen shown in FIG. 7, the English display mode is set and English words are displayed, but the Japanese translation is not displayed. In this case, when the user touches the translated word display area 22, the Japanese translated word is displayed.

<Learning system configuration>
FIG. 1 is a schematic block diagram showing the configuration of the learning system 1 of the present embodiment. A learning system (image display system) 1 includes a server 2 and a user terminal 3. The server 2 and the user terminal 3 can be connected to the network 4 and can communicate with each other via the network 4. Here, although described as one server, each function may be realized by a plurality of servers. The user terminal 3 includes terminals such as a mobile phone terminal, a PC (personal computer) terminal, and a PDA (Personal Digital Assistant).

  The server 2 includes a database 5, a character area setting unit (setting unit) 6, a character string arrangement unit (character string arrangement unit) 7, and a communication unit 8.

  The database 5 mainly stores a plurality of photographed images, English words associated with each image on a one-to-one basis, and information about each image or English word (translation of English words, etc.) in association with each other.

  The character area setting unit 6 acquires a photographed image from the database 5 and sets a character area for displaying English words in the photographed image. Specifically, the character area setting unit 6 detects a plain (color is almost constant) rectangular area from the photographed image, and sets the detected rectangular area as the character area. FIG. 8 is a diagram illustrating the character region 45 in the captured image 50. For example, the character area setting unit 6 extracts a plain area, and sets the extracted area that matches the condition as the character area 45. The conditions include, for example, a rectangular area, a predetermined range size, or a predetermined range color. Note that the character area 45 may be set larger or smaller than the extracted plain area. The character area setting unit 6 stores the captured image 50 and the information on the character area 45 in the database 5 in association with each other.

  The character area setting unit 6 may set the character area according to the position and size of a predetermined symbol in the captured image. For example, a subject having a board on which a two-dimensional barcode is printed is photographed. FIG. 9 is a diagram illustrating a captured image 50 obtained by capturing a board including the two-dimensional barcode 47. The character area setting unit 6 detects the two-dimensional barcode 47 in the photographed image and, for example, doubles in the height direction of the two-dimensional barcode and triples in the width direction with the two-dimensional barcode as the center. May be set as a character area. Further, information such as magnification or information such as board color can be included in the two-dimensional barcode. Note that the character area setting unit 6 overwrites the two-dimensional barcode in the captured image with the surrounding color to make the character area plain as shown in FIG. In addition to the two-dimensional barcode, a predetermined symbol that can discriminate the inclination (direction) and size is attached to the board, and a character region can be set based on the symbol.

  Also, the character area may be set manually. For example, the character area setting unit 6 may receive an instruction from the provider of the English word learning application and set a rectangular character area based on the instruction.

  The character string arrangement unit 7 acquires a captured image, character area information and English words corresponding to the captured image from the database 5. The character string arrangement unit 7 arranges English words so as to fit in the character area. For example, the character string arrangement unit 7 enlarges / reduces the character string image (background is transparent) indicating the English word “delicious” so as to match (contain) the height and width of the character area. The character string arrangement unit 7 synthesizes the character string image of the English word according to the inclination of the rectangular character region, combines it with the photographed image, and combines the English word character at the position of the board (character region). Generate an image. The character string arrangement unit 7 stores a synthesized image (English word image) obtained by synthesizing English word characters in the database 5 in association with English word and character area information. The character string arrangement unit 7 may determine the color of the character string to be synthesized according to the color of the character area of the captured image.

  In response to a request from the user terminal 3, the communication unit 8 transmits an English word image to the user terminal 3 together with associated information (such as English words, their translations, and character area information). The communication unit 8 may transmit the English word learning application itself to the user terminal 3.

  The user terminal 3 includes a storage unit 9, a transmission / reception unit 10, an operation unit (operation input unit) 11, a display control unit (display control unit) 12, and a display unit 13. The transmission / reception unit 10, the operation unit 11, and the display control unit 12 function in cooperation with the memory and arithmetic device provided in the user terminal 3 and the English word learning application.

  The storage unit 9 mainly stores a plurality of English word images in association with associated information (such as English words, their translations, and character area information). In addition, the storage unit 9 stores a shielding image for hiding a character string of English words.

  The transmission / reception unit 10 inquires of the server 2 whether there is a new English word image (new word), and if there is, downloads a new English word image from the server 2. The transmission / reception unit 10 causes the storage unit 9 to store the English word image acquired from the server 2 and the associated information (such as English words, their translations, and character area information).

  The operation unit 11 has a touch panel (not shown) provided so as to overlap the display screen of the user terminal 3. The operation unit 11 receives an input from the touch panel and outputs information on an operation by the user to the display control unit 12.

  The display control unit 12 controls the display unit 13 having a display screen to display images as shown in FIGS. 2 to 7 on the display screen of the display unit 13. Detailed operation of the display control unit 12 will be described later.

(English word image generation)
FIG. 10 is a flowchart showing a processing flow for generating English word images by the server 2.

  For example, a provider (service provider) of an English word learning application captures a person image for synthesizing English words, and registers the captured image in the database 5 in association with information such as English words. When shooting, for example, a person holds a board such as a plain blackboard.

  The character area setting unit 6 acquires a captured image from the database 5, detects a plain rectangular area, and sets the detected rectangular area as a character area (S1).

  The character string arrangement unit 7 adjusts the size of the character string image of the English word so as to fit in the set character region, and synthesizes the character string image of the English word with the photographed image (S2).

  The synthesized image (English word image) is transmitted to the user terminal 3 in response to a request from the user terminal 3.

(Processing in learning mode)
FIG. 11 is a flowchart showing a processing flow in the learning mode by the user terminal 3.

  Here, the English word image stored in the storage unit 9 of the user terminal 3 is a character string of an English word already synthesized with the photographed image.

  When the screen display as shown in FIG. 5 is performed in the learning mode, the display control unit 12 hides the character string of the English word by overlaying the shielding image layer on the character area of the English word image layer (non-display). An English word image is displayed on the display screen (in a display state) (S11). Note that the display control unit 12 adjusts the size of the occlusion image in accordance with the size of the character region and overlays the character region.

  The operation unit 11 receives an operation by the user (S12). When the user touches the touch panel, the operation unit 11 outputs information on the touched position to the display control unit 12.

  When the user touches the occlusion image part (character area part) of the image on the display screen, the display control unit 12 sets the transparency of the occlusion image corresponding to the position touched by the user in the occlusion image layer. Increase (S13). Thereby, as shown in FIG. 6, at least a part of the character string of the English words in the English word image layer is displayed. The display control unit 12 may gradually increase the transparency according to the operation amount of the user. For example, when the user repeatedly traces a portion of the occlusion image, the transparency of that portion may be further increased. Further, the display control unit 12 may gradually increase the portion (area) to be transparent according to the operation amount of the user.

  In the learning system 1 of the present embodiment, the English words in the captured image are hidden, and the English words can be displayed gradually (stepwise) according to the operation amount of the user. Such a display effect can enhance the learning effect. Moreover, the learning system 1 can display the English words in the set character area as if the English words were photographed together with the subject. Therefore, it is possible to attract the user's interest in the image (English word image), and to increase the user's willingness to learn. Moreover, since the learning system 1 uses an image obtained by combining a captured image and a character string, it can also generate another English word image by combining another character string with the captured image that has already been captured. Therefore, it is possible to increase variations of English word images without photographing a subject with another character string.

<Modification>
In addition, although the case where the rectangular character area was set was described, the character area is not limited to a rectangle, and the character area may be an arbitrary shape area, for example, a trapezoid area, a sector area, a polygon area, or a circular (elliptical) area. You can also. Further, for example, a fan-shaped area defined by two concentric arcs having different radii and two straight lines passing through the center of the circle can be used as the character area.

  As shown in FIG. 5, the display control unit (presentation control means) 12 may display the English word translation together with the English word image, or after displaying the English word translation, only the English word image is displayed. May be displayed. In addition, the user terminal 3 may include a presentation control unit that presents translated words of English words to the user by voice or the like.

  In the learning mode, with the English word hidden, the user inputs an answer (English word for the presented translated word) or selects an answer option, and the display control unit determines the result (correct or incorrect). It may be determined whether or not the user has learned. For example, when a correct answer is given, a privilege may be given. For example, it is possible to view an image different from the English word image, to enable a high resolution English word image to be browsed, or to eliminate the shielding area of the English word image in the learning mode after the next time. Good. Alternatively, the English word (English word or its translation) may appear in the word list of the word book only when the answer is correct. Here, when it is possible to browse English word images (photographed images) with high resolution as a privilege, a low-resolution English word image and a corresponding high-resolution English word image (photographed image) are acquired from the server. In the learning mode, the display control unit controls the display of the low-resolution English word image in advance, and when the answer is correct, the high-resolution English word image (captured image) can be viewed. Also good.

  Further, in the above, a part of the non-displayed English word is changed to the display state according to the touch position of the user, but a part of the non-displayed English word may be displayed according to other operations. . For example, the display control unit may perform display control so that English words are gradually displayed according to the number of times the user terminal 3 is shaken or the number of times the user terminal 3 is repeatedly pressed (selected).

  In the above description, the learning system for English words is described as an example. However, the present invention is not limited to this, and a photographed image and an arbitrary character string can be combined.

[Embodiment 2]
In the present embodiment, another method for generating English word images will be described. For convenience of explanation, members / configurations having the same functions as those in the drawings described in the first embodiment are given the same reference numerals, and detailed descriptions thereof are omitted. Hereinafter, the present embodiment will be described in detail with reference to the drawings.

  The configuration of the learning system 1 is the same as that of the first embodiment shown in FIG. In the present embodiment, the processes in the character string arrangement unit 7 and the display control unit 12 are particularly different.

(Processing on the server)
FIG. 12 is a flowchart showing a processing flow by the server 2.

  As in the first embodiment, the character area setting unit 6 acquires a captured image from the database 5, detects a plain rectangular area, and sets the detected rectangular area as a character area (S21).

  The character string arrangement unit 7 generates a character string image in which the size, position, and inclination of the character string of the English word are adjusted so as to fit in the set character area (S22). Here, the background of the character string image is transparent. At this time, the character string image indicating the English word and the captured image in which the character area is set are not synthesized.

  The communication unit 8 transmits the captured image and the corresponding character string image to the user terminal 3 in response to a request from the user terminal 3.

(Processing at user terminal)
FIG. 13 is a flowchart illustrating a processing flow in the learning mode by the user terminal 3.

  Here, the memory | storage part 9 of the user terminal 3 has memorize | stored the picked-up image and the character string image of the English word corresponding to it.

  In the present embodiment, the display control unit 12 puts the character string of the English word into a non-display state by overlaying the layer of the character string image of the English word on the layer of the captured image and making the character string of the character string image transparent. The photographed image is displayed on the display screen (S31).

  The operation unit 11 receives an operation by the user (S32). When the user touches the touch panel, the operation unit 11 outputs information on the touched position to the display control unit 12.

  When the user touches a non-displayed character string portion (or character region portion) of the image on the display screen, the display control unit 12 corresponds to the position touched by the user in the character string image layer. The transparency of the character string is reduced (S33). Thereby, at least a part of the character string of the English words is displayed.

  In this manner, the display / non-display of the character string may be switched by changing the transparency of the character string layer.

[Embodiment 3]
In this embodiment, a mode in which a user himself creates a word book using a user terminal will be described. For convenience of explanation, members / configurations having the same functions as those in the drawings described in the first embodiment are given the same reference numerals, and detailed descriptions thereof are omitted. Hereinafter, the present embodiment will be described in detail with reference to the drawings.

  FIG. 14 is a schematic block diagram showing the configuration of the learning system of the present embodiment. The learning system is configured by the user terminal 14. The user terminal 14 includes a character area setting unit 6, a character string arrangement unit 7, a storage unit 9, an operation unit 11, a display control unit 12, and a display unit 13. The character area setting unit 6, the character string arrangement unit 7, the operation unit 11, and the display control unit 12 function in cooperation with the memory and arithmetic device provided in the user terminal 14 and the English word learning application.

(Processing at user terminal)
FIG. 15 is a flowchart showing a processing flow in the user terminal 14.

  For example, the user prepares a captured image for synthesizing English words by using a camera included in the user terminal 14.

  The character area setting unit 6 acquires a captured image, causes the user to specify a character area, and sets a character area for the captured image (S41). For example, the character area setting unit 6 can specify a rectangular area and set the rectangular area as a character area by allowing the user to input points at three or four corners of the rectangular area. Further, for example, the user can select a rectangular area that matches the captured image from a plurality of rectangular areas whose positions and sizes are determined in advance, so that the selected rectangular area can be set as a character area. Note that, as in the first embodiment, the character area setting unit 6 may detect a plain rectangular area and set the character area.

  The character string arrangement unit 7 receives designation of an English word corresponding to the photographed image from the user, adjusts the size of the character string image of the designated English word so as to fit in the set character region, and A character string image of words is synthesized (S42). The synthesized image is stored in the storage unit 9 as one of English word images. A Japanese translation corresponding to an English word image may be set according to the user's input. The processing in the learning mode is the same as that in the first embodiment.

  In this way, the user can add an English word image to the word book on the user terminal 14. In this way, the user combines not only the photographed person image but also the user's favorite image (for example, a dish photo or a favorite idol photo) with the English word, and the user's favorite English word book Can be created.

  It is also possible to transmit the word book or English word image created by the user in this way to other users between the user terminals 14 by communication. In addition, a word book or English word image can be posted on the server and distributed to a specific user on the server.

[Embodiment 4]
In the present embodiment, a mode in which a server that accepts an image posting from a user creates a word book will be described. For convenience of explanation, members / configurations having the same functions as those in the drawings described in the first embodiment are given the same reference numerals, and detailed descriptions thereof are omitted. Hereinafter, the present embodiment will be described in detail with reference to the drawings.

  FIG. 16 is a schematic block diagram showing the configuration of the learning system 15 of the present embodiment. The learning system 15 includes a server 16 and a user terminal 17. The server 16 includes a database 5, a character area setting unit 6, a character string arrangement unit 7, a communication unit 8, a display control unit 12, and an operation input unit 18. The user terminal 17 includes a storage unit 9, a transmission / reception unit 10, an operation unit 11, and a display unit 13.

(Processing in the learning system)
FIG. 17 is a flowchart showing a processing flow by the server 16.

  The server 16 accepts a posted image from the user (S51). Specifically, the transmission / reception unit 10 of the user terminal 17 acquires a captured image from the storage unit 9 and transmits it to the server 16. The communication unit 8 of the server 16 receives the captured image and outputs the received captured image to the character area setting unit 6.

  The character area setting unit 6 receives the designation of the character area from the user terminal 17 via the communication unit 8 (S52). For example, the character area setting unit 6 sets the selected rectangular area as the character area by causing the user to select a rectangular area that matches the captured image from a plurality of rectangular areas whose positions and sizes are determined in advance. Can do. In addition, for example, the character area setting unit 6 may accept the designation of the character area by providing the captured image as a web page to the user terminal 17 and designating a rectangular area on the web page. The character area setting unit 6 sets a character area for the photographed image and registers it in the database 5 (S53).

  The character string arrangement unit 7 adjusts the size of the character string image of the English word so as to fit in the set character region, and synthesizes the character string image of the English word with the photographed image (S54). Note that the English word associated with the captured image may be designated by the user, or the character string arrangement unit 7 may arbitrarily select from the database 5. The character string arrangement unit 7 stores the synthesized image (English word image) in the database 5. In this way, the posting of the image by the user is accepted and a word book is created in the server 16.

  The server 16 provides the English word image to a specific (authenticated) user as a web page.

  The display control unit 12 displays an English word image on the display unit 13 of the user terminal 17 via the communication unit 8. For example, in order to display the English word image on the display unit 13 of the user terminal 17 with the character string of the English word hidden, the display control unit 12 displays the English word image synthesized by overlaying the shielding image on the character region. Then, the data is transmitted to the user terminal 17 via the communication unit 8 (S55).

  The operation unit 11 of the user terminal 17 receives a user operation. When the user touches the touch panel, the operation unit 11 transmits information on the touched position to the server 16 via the transmission / reception unit 10.

  The operation input unit 18 of the server 16 receives information on an operation by the user from the user terminal 17 via the communication unit 8 (S56). The operation input unit 18 outputs operation information by the user to the display control unit 12.

  When the user touches the occlusion image part (character area part) of the image on the display screen, the display control unit 12 sets the transparency of the occlusion image corresponding to the position touched by the user in the occlusion image layer. The raised image is transmitted to the user terminal 17 via the communication unit 8 (S57). Thereby, the display control unit 12 causes the display unit 13 of the user terminal 17 to display the English word image in which at least a part of the character string of the English word is in the display state.

  In the present embodiment, an English word image can be created based on a photographed image posted by the user. Therefore, a variety of English word images can be provided to the user. Since the user designates a character area, the user can use an image in which an arbitrary object is captured as a captured image.

[Program and recording medium]
Finally, each block of the servers 2 and 16 and the user terminals 3, 14, and 17, particularly the character area setting unit 6, the character string arrangement unit 7, the operation unit 11, the display control unit 12, and the operation input unit 18 You may comprise by a logic and may implement | achieve by software using CPU (central processing unit) as follows.

  That is, the servers 2 and 16 and the user terminals 3, 14, and 17 include a CPU that executes instructions of a control program that realizes each function, a ROM (read only memory) that stores the program, and a RAM ( random access memory), a storage device (recording medium) such as a memory for storing the program and various data. An object of the present invention is to program the program codes (execution format program, intermediate code program, source program) of the control programs of the servers 2 and 16 and the user terminals 3, 14, and 17 that are software that realize the above-described functions. Is supplied to the servers 2 and 16 and the user terminals 3, 14, and 17, and the computer (or CPU or MPU (microprocessor unit)) is recorded on the recording medium. This can also be achieved by reading out and executing.

  Examples of the recording medium include a tape system such as a magnetic tape and a cassette tape, a magnetic disk such as a floppy (registered trademark) disk / hard disk, a CD-ROM (compact disc read-only memory) / MO (magneto-optical) / Disk systems including optical disks such as MD (Mini Disc) / DVD (digital versatile disk) / CD-R (CD Recordable), card systems such as IC cards (including memory cards) / optical cards, or mask ROM / EPROM ( An erasable programmable read-only memory) / EEPROM (electrically erasable and programmable read-only memory) / semiconductor memory system such as a flash ROM can be used.

  Further, the servers 2 and 16 and the user terminals 3, 14 and 17 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN (local area network), ISDN (integrated services digital network), VAN (value-added network), CATV (community antenna television) communication. A network, a virtual private network, a telephone line network, a mobile communication network, a satellite communication network, etc. can be used. In addition, the transmission medium constituting the communication network is not particularly limited. For example, IEEE (institute of electrical and electronic engineers) 1394, USB, power line carrier, cable TV line, telephone line, ADSL (asynchronous digital subscriber loop) line Wireless such as IrDA (infrared data association) and remote control such as remote control, Bluetooth (registered trademark), 802.11 wireless, HDR (high data rate), mobile phone network, satellite line, terrestrial digital network, etc. But it is available.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention.

  The present invention can be used for a learning system including a server and a user terminal.

1,15 Learning system (image display system)
2,16 server (image display system)
3, 14, 17 User terminal (image display system)
4 Network 5 Database 6 Character area setting part (setting means)
7 Character string arrangement part (character string arrangement means)
8 Communication unit 9 Storage unit 10 Transmission / reception unit 11 Operation unit (operation input means)
12 Display control unit (display control means, presentation control means)
13 Display unit 18 Operation input unit (operation input means)
20 Display screen

Claims (15)

The first character string is associated with the captured image,
Setting means for setting, for each of the captured images, a character area for displaying the corresponding first character string in the captured image;
Adjusting the size of the corresponding first character string so as to fit in the character area, and placing the first character string in the character area;
Display control means for controlling display of the first character string and the captured image;
An operation input means for receiving an operation by a user,
The display control means displays the photographed image with the first character string in a non-display state, and then displays the first character in the photographed image according to the operation amount by the user received by the operation input means. An image display system that performs control to change a column from a non-display state to a display state.   The image according to claim 1, wherein the display control unit performs control to display a part of the first character string corresponding to repetition of a specific operation by a user on the captured image. Display system. The operation input means includes a touch panel capable of touch operation on the display screen,
The image display system according to claim 1, wherein the display control unit performs control to display a part of the first character string at the touched position on the photographed image. The character area is a rectangular area,
4. When the character area is inclined, the character string arrangement means arranges the first character string in the character area in accordance with the inclination of the character area. The image display system according to claim 1. The character string arrangement means generates a composite image obtained by combining the first character string on the photographed image,
5. The display control unit according to claim 1, wherein the display control unit makes the first character string in a non-display state by performing a control to display a shielding image superimposed on the character region of the composite image. The image display system according to claim 1.   The display control means gradually displays the first character string on the captured image by increasing the transparency of the shielding image in accordance with an operation by the user received by the operation input means. The image display system according to claim 5.   The display control means controls to display the layer including the first character string on the layer including the captured image, and hides the first character string by making the first character string transparent. The image display system according to claim 1, wherein the image display system is in a state.   The display control means gradually displays the first character string on the photographed image by reducing the transparency of the first character string in response to an operation by the user accepted by the operation input means. The image display system according to claim 7.   The image display system according to any one of claims 1 to 8, wherein the setting unit sets the character region based on a position and a size of a predetermined symbol in the photographed image.   The image display system according to any one of claims 1 to 8, wherein the setting unit sets a plain rectangular area in the photographed image as the character area. Including a server and a user terminal,
The server includes the setting unit and the character string arrangement unit.
The image display system according to any one of claims 1 to 10, wherein the user terminal includes the display control unit and the operation input unit. A learning system including the image display system according to any one of claims 1 to 11,
During or before the display control means displays the captured image with the first character string hidden, the second character string corresponding to the first character string is displayed or presented to the user by voice. A learning system comprising presentation control means for performing control.   The learning system according to claim 12, wherein the second character string is a character string indicating the meaning of the first character string. The first character string is associated with the captured image,
A setting step for setting, for each captured image, a character region for displaying the first character string corresponding to the captured image;
Adjusting the size of the corresponding first character string so that it fits in the character region, and placing the first character string in the character region;
A first display step of displaying the photographed image in a non-display state of the first character string;
An operation input step for accepting an operation by the user;
An image display method comprising: a second display step of changing the first character string in the captured image from a non-display state to a display state according to an operation amount by a user in the operation input step. The first character string is associated with the captured image,
A setting step for setting, for each captured image, a character region for displaying the first character string corresponding to the captured image;
Adjusting the size of the corresponding first character string so that it fits in the character region, and placing the first character string in the character region;
A first display step of displaying the photographed image in a non-display state of the first character string;
An operation input step for accepting an operation by the user;
A control program for causing a computer to execute a second display step of changing the first character string in the photographed image from a non-display state to a display state according to an operation amount by a user in the operation input step.

Images