WO2001095079A1 - Systeme de traitement d'informations au moyen de modeles de bulles, systeme de traitement d'informations par traduction dans lequel les modeles de bulles sont utilisees, systeme de traitement d'informations en ligne au moyen desdits modeles de bulles, et support de stockage d'informations lisible par ordinateur - Google Patents

Systeme de traitement d'informations au moyen de modeles de bulles, systeme de traitement d'informations par traduction dans lequel les modeles de bulles sont utilisees, systeme de traitement d'informations en ligne au moyen desdits modeles de bulles, et support de stockage d'informations lisible par ordinateur Download PDF

Info

Publication number
WO2001095079A1
WO2001095079A1 PCT/JP2001/004743 JP0104743W WO0195079A1 WO 2001095079 A1 WO2001095079 A1 WO 2001095079A1 JP 0104743 W JP0104743 W JP 0104743W WO 0195079 A1 WO0195079 A1 WO 0195079A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
balloon
character information
image
character
Prior art date
Application number
PCT/JP2001/004743
Other languages
English (en)
Japanese (ja)
Inventor
Shoji Hayashi
Original Assignee
Hayashi Office Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hayashi Office Co., Ltd. filed Critical Hayashi Office Co., Ltd.
Priority to AU2001262696A priority Critical patent/AU2001262696A1/en
Priority to JP2002502565A priority patent/JPWO2001095079A1/ja
Publication of WO2001095079A1 publication Critical patent/WO2001095079A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/40—Processing or translation of natural language
    • G06F40/58—Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation

Definitions

  • the present invention relates to an information processing system using a balloon-shaped figure using a terminal such as a computer. More specifically, the present invention relates to an information processing system using speech information 'and character information associated with a balloon-shaped figure such as a manga. A system that performs processing. In addition, using speech and text information translated into languages, users can use networks such as the Internet or electronic media such as CD-ROMs to print images such as cartoons and English including text information. The present invention relates to a language translation information processing system capable of learning a foreign language, and a computer readable information storage medium. Background art
  • Techniques related to such a field include, for example, Japanese Patent Application Laid-Open No. 8-82531 “Guidance device using sound information”, which is offline as a guide for selecting an operation menu of a word processor or a personal computer.
  • a user interface device based on sound information used in the above is disclosed.
  • the configuration of the voice guidance device of the present invention corresponds to an input unit for controlling a cursor or a pointer, a position detecting means for detecting a position of the cursor or the pointer on the screen, and a position detected by the position detecting unit.
  • Music and voice It is composed of a voice control information storage means, a voice generation means for generating the musical sound and voice, and a voice output means such as a speaker.
  • this technology is not used by connecting to a network such as the Internet, but is also provided with software etc. installed in advance in equipment, and is more than a voice guide for their operation. It does not have the function of
  • a user such as a student inputs data from a computer to a form on a web page and transmits the data to a server system.
  • CGI programs read and write and process the received data to and from text-format files, and return text data such as text to a predetermined Web page for display. .
  • uniform translation processing is performed using a single CGI program or the like, and interactive (bidirectional) matching the proficiency of each student is required. It has a problem that it is not possible to deal with the problem, entertainable processing, or complex processing using multimedia files such as images.
  • Japanese Patent Application Laid-Open No. Hei 9-125325 "Translation Correction Support Device” discloses the following technology. According to this, a model answer is decomposed into a plurality of templates having a word / phrase structure using expert knowledge. For each template, a message for the answer that the learner will translate is prepared in advance using the expert's knowledge. Then read these, and then read the answer. Next, the student checks whether the learner has taken the basic usage correctly, then classifies the part of speech for each word in the answer, and finally parses the answer. After that, the answer sentence is evaluated for each template, and a message with the content corresponding to the evaluation is presented to the learner. Since the answer text is evaluated for each template, it is possible to obtain the same correction result as an expert who does it manually.
  • comics such as comics that use image information and character information, for example, are rarely used for secondary use except for commercialization of character dolls and the like of comics.
  • image data obtained by scanning a comic original image and sound data consisting of speech and mimic sounds in the balloon are recorded on an optical compact disc in a format that can be played back simultaneously, and page numbers and frames in magazines are recorded.
  • Codes organized according to numerical values and contents in order are placed at the beginning of each data, and are used as headings for search and playback.
  • a means for recording is provided, and a means for designating a reproduction start position at the beginning of reproduction, a position where reproduction is interrupted, a page number, a heading, or the like is provided. ;
  • the above technology relates to the technology of playing or stopping the contents obtained by digitization, and plays back the speech of the speech bubble selected by the user, and automatically performs other operations in the same way as the speech. It does not have the technical characteristics to display the information of
  • the present invention has been made in view of the above problems, and focuses on the shape of speech balloons used in comics and the like when reproducing content, and sets the association with character information and voice information in the speech balloon.
  • Another object of the present invention is to provide a system in which a user can connect to a computer terminal or the Internet from a terminal, synthesize images, characters, sounds, and the like and perform various reproduction, output, and display.
  • Another object of the present invention is to provide a system in which, in the system of the present invention, when a copyrighted work such as a comic is used, the consent of a copyright holder or the like is obtained and the profit is returned to the right holder.
  • the purpose is to provide and enhance the content of this system.
  • Another object of the present invention is to provide an information storage medium storing data and a program for realizing the above system, and in particular, to provide an information storage medium usable in both a computer device and a portable information terminal. The purpose is also to do. Disclosure of the invention
  • a computer provided with an input means, a control means, a display means, an output means, a storage means, etc.
  • a user terminal such as a portable information terminal
  • information processing is performed by user operation
  • the storage means provided in the user terminal or the storage means connected to the user terminal via a computer network includes:
  • Image information storage means for storing image information
  • Voice information storage means for storing voice information
  • Information processing means for displaying character information and voice information on the user terminal is provided at least;
  • a character information storage unit for storing character information
  • Files such as slideshows including files are displayed on the user terminal.
  • the image file one or a plurality of balloon-shaped figures surrounded by a linear figure having an arbitrary shape and thickness are arranged at an arbitrary position in the image and displayed on the user terminal.
  • One or a plurality of character information display fields for displaying character information as required are arranged in the image file, and the balloon is arranged in the balloon-shaped figure arranged in the image file.
  • a balloon character information field for displaying image information including a balloon character on predetermined coordinates in the image information represented by the shape graphic is arranged, and the image information including the balloon character is stored in the voice information storage unit.
  • the association with the predetermined character information file stored in the character information storage unit is set in advance. It is possible to keep
  • the character information indicating the location in the link information added to the balloon character information field is displayed in the character information display field. And transmitting the data to the user terminal and displaying it on the display means of the user terminal.
  • the information processing system uses a balloon-shaped figure.
  • a computer including an input unit, a control unit, a display unit, an output unit, a storage unit, and the like includes a user terminal such as a portable information terminal.
  • Information by user operation A system in which processing is performed,
  • the storage means provided in the user terminal or the storage means connected to the user terminal via a computer network includes:
  • Image information storage means for storing image information
  • Voice information storage means for storing voice information associated with the character information
  • Information processing means for displaying character information and voice information on the user terminal is provided at least;
  • a character information storage unit for storing character information, and an image file, an image file, a plurality of image files inserted into an HTML file, an XML file, or the like stored in the image information storage unit.
  • An image file displayed on a user terminal such as a file such as a slide show including an aisle may include one or more files enclosed in a linear figure having an arbitrary shape and thickness at an arbitrary position in the image.
  • one or a plurality of character information display fields for displaying character information as necessary are arranged, and the image file is displayed in the image file.
  • the arranged balloon-shaped figure includes a balloon for displaying balloon character information on predetermined coordinates in the image information represented by the balloon-shaped figure.
  • a character information field is arranged, and the balloon character information is associated with a predetermined voice information file stored in the voice information storage means and stored in the character information storage means. It is possible to set the association with a predetermined character information file in advance,
  • the balloon character information file arranged in the balloon graphic The audio information indicating the location indicated by the link information added to the password is output by the audio reproducing means provided in the user terminal, and the processing for reproducing the audio information and the association with a predetermined character information file are set in advance. In this case, a process of displaying the character information indicating the location of the link information added to the balloon character information field in the character information display field by a display unit provided in the user terminal is performed. It is an information processing system using balloon-shaped figures.
  • One or more character information display fields for displaying character information which are arranged in the image file displayed on the user terminal, display image information in which data including character information is used as an image information file.
  • the character information indicating the location in the link information added to the balloon character information field is displayed in the character information display field. And displaying the image information including the image information by a display means provided in the user terminal.
  • the information processing system uses a balloon-shaped figure.
  • a computer including an input unit, a control unit, a display unit, an output unit, a storage unit, and the like includes a user terminal such as a portable information terminal.
  • a user terminal such as a portable information terminal.
  • the storage means provided in the user terminal or the storage means connected to the user terminal via a computer network includes:
  • Image information storage means for storing image information
  • Voice information storage means for storing voice information
  • Information processing means for displaying character information and voice information on a user terminal Is at least provided,
  • a character information storage unit for storing character information is provided, and an image file, an image file, a plurality of image files inserted into an HTML file, an XML file, or the like stored in the image information storage unit.
  • image files displayed on user terminals such as slide shows including aisles, etc.
  • character information or character information consisting of arbitrary shapes and sizes, etc., at arbitrary locations in the images is used as image data.
  • One or more character information display fields for arranging image information are arranged,
  • the character information display field is associated with a predetermined voice information file stored in the voice information storage unit, and is linked to a predetermined character information file stored in the character information storage unit. It is possible to set the association of in advance,
  • the voice information stored in the voice information storage means is post-translation language voice information corresponding to the pre-translation language character information included in the character information field,
  • the character information stored in the character information storage means is post-translation linguistic character information corresponding to pre-translation linguistic character information included in the character information field,
  • the information processing means provided in the storage means according to the user's action such as placing a cursor in a character information field, placing a cursor in a character information field, and clicking on a tick, etc., in the language before translation, A process of detecting a user's action;
  • the link information added to the character information field indicates the location, and the audio information, which is the translated language, is transmitted to the user terminal, and is output by the audio reproduction means included in the user terminal, and the reproduction is performed. Processing,
  • the location is indicated in the link information added to the character information display field. And send it to the display means provided in the user terminal. It is a language translation information processing system.
  • the voice information stored in the voice information storage means is a post-translation language voice information corresponding to the pre-translation language character information included in the balloon character information field,
  • the character information stored in the character information storage means is post-translation language character information corresponding to the pre-translation language character information included in the balloon character information field,
  • the location is indicated in the link information added to the balloon character information field in the character information display field.
  • the balloon according to any one of claims 1 to 4, wherein character information in a language is transmitted to the user terminal and displayed on display means provided in the user terminal. It is characterized by being a language translation information processing system using figures. .
  • the post-translation voice information stored in the voice information storage means includes a pre-translation language character information included in the balloon character information field. Contains translated language audio information consisting of a number of translated languages,
  • the post-translation character information stored in the voice information storage unit includes post-translation language character information including a plurality of post-translation languages corresponding to the pre-translation language character information included in the balloon character information field. Included,
  • the user is required to place the cursor at the balloon character information displayed in the balloon character information field, which is indicated in the pre-translation language placed in the displayed balloon-shaped figure, or to place the cursor and click.
  • the character information display field indicates the location in the link information added to the balloon character information field, 6.
  • the balloon according to claim 4 or 5, wherein the character information that is the translated language is transmitted to the user terminal and displayed by a display unit provided in the user terminal. It is characterized by being a language translation information processing system using figures.
  • balloon character information including a plurality of pre-translation languages is prepared in advance.
  • An image file including the balloon-shaped figure is stored in the image information storage means, A process in which a user selects from which of a plurality of pre-translation languages the pre-translation language character information is translated;
  • the user places the cursor in the balloon character information displayed in the balloon character information field, which is displayed in the balloon character information field, placed in the displayed balloon-shaped figure, or places the cursor and clicks it.
  • Images displayed on the user terminal such as image files inserted into HTML files or XML files stored in the image information storage means, image files, slideshow files including a plurality of image files, etc.
  • Files can be multiple HTML files, multiple image files inserted into XML files, etc., multiple image files consisting of multiple pages, or slide shows including multiple image files that make up multiple pages.
  • a data file The user terminal can select and display a desired page from a plurality of pages,
  • the data file stored in the storage means has a story such as a comic.
  • Content data which can be displayed on the user terminal by selecting a desired page from a plurality of pages,
  • the storage means stores a plurality of pieces of content data having a story, such as comics. 10. Content reproduction information using a balloon-shaped figure according to claim 9, wherein the content is stored and can be selected and displayed / reproduced from a plurality of content data. It is a processing system.
  • the audio information indicating the location in the link information added to the balloon-shaped character information field arranged in the balloon-shaped graphic includes a plurality of audio information having different audio reproduction speeds.
  • a voice playback speed can be selected by setting in advance by a user. It is characterized by being an information processing system using a ladder figure.
  • the selection of the language before translation, the selection of the language after translation, the selection of the audio playback speed, or the selection of the playback control method uses tag information such as XML, and stores the settings selected by the user as a setting file in the storage means.
  • Claims 6 or 7 or 11 or 12 characterized in that, by storing the information, the sound is automatically reproduced in accordance with the audio reproduction speed or reproduction control method selected with reference to the setting file during reproduction. It is an information processing system using the balloon-shaped figure described in (1).
  • the storage means is a server system including a WEB server, an application server, a database server, and the like connected from a user terminal via a computer network,
  • Image information storage means for storing image information
  • Voice information storage means for storing voice information associated with the character information
  • At least an information processing means for transmitting character information and voice information to the user terminal for display is provided.
  • a character information storage means for storing character information is provided, According to a request from the accessing user terminal, a process of transmitting a data file including a balloon-shaped figure to the user terminal and displaying the data file,
  • the character information indicating the location in the link information added to the balloon character information field is displayed in the character information display field.
  • the server system further includes a user terminal via a computer network.
  • Authentication means for authenticating a user accessing the system
  • Usage information storage means capable of storing the number of accesses by users, the usage time, the number of content data used, the number of downloads, other information, and information about users;
  • Usage fee calculation means for calculating a usage fee with reference to the usage information stored in the usage information storage means
  • the system further includes a copyright of text information and image information in a language before translation.
  • Right holder information storage means for storing information about the right holder of
  • the storage unit including the image information storage unit, the voice information storage unit, the information processing unit, and the character information storage unit includes:
  • a data capturing means for capturing, as image information, data of a printed material having image information and balloon character information
  • a first data processing means for setting a balloon character information field in the captured image information and storing the data-processed image information in the image information storage means;
  • Data processing means
  • an image information storage unit that stores image information
  • Voice information storage means for storing voice information
  • Information processing means for displaying character information and voice information on a user terminal Is at least provided,
  • a character information storage unit for storing character information, including an image file, an image file, and a plurality of image files inserted in an HTML file, an XML file, or the like stored in the storage unit.
  • the image file displayed on the user terminal such as a file such as a slideshow, contains one or more files that are surrounded by linear figures of any shape and thickness at any place in the image. Balloon shape is placed,
  • one or a plurality of character information display fields for displaying character information as necessary are arranged, and the balloon-shaped figure arranged in the image information is provided.
  • a balloon character information field for displaying a balloon character at a predetermined coordinate in the image information represented by the balloon-shaped figure or a balloon character information for displaying the balloon character information is arranged, and includes the balloon character.
  • the image information or the balloon character information is associated with a predetermined voice information file stored in the voice information storage unit, and the predetermined character information stored in the character information storage unit.
  • the feature is that the association with the file can be set in advance. It is characterized in.
  • the information storage medium is a mobile phone, a mobile information terminal, an electronic book player,
  • -A small information storage medium that can be loaded into a portable information terminal such as an audio playback player and can be loaded into a computer device such as a personal computer,
  • the image information storage means, the voice information storage means, the image information, the voice information, or the character information stored in the character information storage means provided in the information storage medium can be output or reproduced by a portable information terminal.
  • Files for portable information terminals, or files for morphological information terminals that can be output or reproduced on portable information terminals are stored separately from files for computer devices.
  • the information storage medium further includes authentication information storage means for storing user authentication information
  • the authentication permission information is stored in the authentication information storage means when the accounting process or the user registration process is performed, and the playback is performed.
  • a computer-readable information storage medium according to any one of claims 18 and 19, characterized in that the information storage medium is enabled.
  • FIG. 1 is a system configuration diagram showing a first embodiment of the present invention.
  • FIG. 2 is a diagram showing a configuration of the storage means.
  • FIG. 3 shows an example of an image file displayed using the system of the present invention.
  • FIG. 4 shows an example of an image file displayed using the system of the present invention.
  • FIG. 5 shows an example of an image file displayed using the system of the present invention. .
  • FIG. 6 shows an example of the relationship between the image file that is each page of the content such as comics stored in the image information storage means 15 and the balloon character information field arranged in each image file. It is a data schematic diagram which shows.
  • FIG. 7 is a flowchart showing a basic processing flow of the first embodiment of the present invention.
  • FIG. 8 is a diagram showing an embodiment of the storage area of the storage means.
  • FIG. 7 is a diagram showing a storage area of a storage unit 10 in which speech information composed of words (here, English and French) and character information composed of a plurality of translated language languages are stored.
  • Fig. 10 shows storage means for storing speech information in a plurality of translated language languages (here, English and French) corresponding to the pre-translation language (here, Japanese) and character information consisting of a plurality of translated language languages.
  • FIG. 3 shows a schematic diagram of data stored in 10.
  • FIG. 11 shows a case where there are multiple pre-translation languages, and multiple pre-translation languages (for example, English and Japanese) corresponding to pre-translation language 1 (for example, Japanese) and pre-translation language 2 (for example, English).
  • FIG. 3 is a diagram showing a storage area of a storage unit 10 in which different voice information and character information including a plurality of translated language languages are stored.
  • FIG. 12 shows speech information composed of multiple translated language languages (here, English and Japanese) corresponding to multiple pre-translation languages (here, Japanese and English) displayed in the balloon character information field.
  • FIG. 4 is a schematic diagram of data stored in a storage area of a storage unit 10 in which character information composed of a translated language is stored.
  • Fig. 13 is a diagram showing an example of translating a cartoon whose English is the pre-translation language into Japanese, which is the post-translation language, and automatically reproducing and displaying the voice and characters in the selected speech character information field. is there.
  • FIG. 14 is a flowchart showing an example of a basic processing flow in the second embodiment.
  • FIG. 15 is a basic system configuration diagram of the second embodiment.
  • FIG. 16 is a flowchart showing a basic processing flow of the second embodiment.
  • FIG. 17 is a flowchart showing a basic processing flow of the second embodiment.
  • FIG. 18 is a flowchart showing an example of processing for storing data in the image information storage means, the voice information storage means, and the character information storage means.
  • Fig. 19 shows information storage that can be used in computer devices and personal digital assistants.
  • 5 is a flowchart illustrating an example of a process using a medium.
  • FIG. 20 is a diagram showing a typical example of various forms shown as “balloon-shaped figures” in this specification.
  • FIG. 1 is a system configuration diagram showing a basic configuration in a first embodiment of a system according to the present invention.
  • an information processing system using a balloon-shaped figure is a user terminal such as a computer or a portable information terminal having an input unit, a control unit, a display unit, an output unit, and a storage unit.
  • a user terminal such as a computer or a portable information terminal having an input unit, a control unit, a display unit, an output unit, and a storage unit.
  • reference numeral 1 denotes a user terminal.
  • the user terminal 1 includes a computer terminal such as a personal computer, a wireless communication terminal such as a mobile phone or a PHS, a portable information terminal having these functions, and various other computer terminals. Further, for example, a so-called information home appliance such as an Internet TV may be used.
  • the storage means 10a includes an external storage device such as a CPU, a memory, and a hard disk.
  • the storage means includes a storage means provided in the user terminal, or a storage means connected to the user terminal via a computer network. It includes a storage device connected to the user terminal via the network.
  • the computer network broadly includes the Internet, a network form connected by a dedicated line, a corporate LAN, a corporate LAN, a WAN, and the like.
  • the form of the communication line used here widely includes the form of wired communication and wireless communication, such as satellite communication and Bluetooth. And the like.
  • the storage unit 10b is a storage unit such as a CD-ROM drive, a DVD drive, or an information storage medium that is read via another input unit.
  • the storage means 10b includes, for example, CD-ROM, DVD FD (floppy disk), MO, SmartMedia (trademark), Memory Stick (trademark), electronic book, and any other information storage medium.
  • the storage means included in the user terminal for realizing the system of the present invention include these storage means 10b.
  • the storage means 10a usually stores an operating system (OS), various application programs, various data files, and the like, but is stored in a storage medium 10b such as a CD-ROM or DVD. It is also possible to take a form in which the stored image information, character information, programs as information processing means and the like are stored in the storage means 10a.
  • OS operating system
  • a storage medium 10b such as a CD-ROM or DVD. It is also possible to take a form in which the stored image information, character information, programs as information processing means and the like are stored in the storage means 10a.
  • reference numeral 11 denotes input means such as a keyboard / mouse
  • reference numeral 12 denotes data control, data transmission / reception, hardware control, software control, and the like using a CPU, a bus, and other OS and application programs. The control means for this is shown.
  • Reference numeral 14 denotes an output means for transmitting and receiving data via a network and outputting data such as voice.
  • storage means 10a or 10b (hereinafter, simply referred to as “storage means 10" as necessary) will be described with reference to FIG.
  • the storage means 10 includes at least image information storage means for storing image information, voice information storage means for storing voice information, and information processing means for displaying character information and voice information on the user terminal. Have been.
  • a character information storage means for storing character information is provided, and if provided, voice information and character information can be automatically linked to be displayed and output. Is preferred.
  • reference numeral 15 denotes image information storage means
  • 16 denotes audio information storage means
  • 17 denotes character information storage means
  • 18 denotes information processing means.
  • the image information storage means 15, the voice information storage means 16, and the character information storage means 17 are storage areas provided in a storage means having a hierarchical structure such as a folder in the storage means, and a database structure such as a relational database. It may be a storage area having '
  • the image information storage means 15 is displayed on the user terminal such as an image file inserted in an HTML file or an XML file, an image file, a file such as a slide show including a plurality of image files, or the like. Image file is stored.
  • FIG. 3 shows an image file storing a menu screen to be displayed on a display means provided in the user terminal 1 in order to select and display / reproduce a plurality of content data files.
  • an image file including a balloon-shaped figure described later is shown.
  • the image file can include image files of various data formats such as JPEG, GIFF, PNG, TIFF, BMP, PICT, and the like, and image files of its own format.
  • the menu screen and the playback screen for arranging the content data file are displayed on the user terminal in a format such as an HTML file or an XML file, or a file such as a slideshow including a plurality of image files. It can be stored as an image file to be displayed, or in a file format using a unique playback program, and can be used as an image file that is inserted and displayed in the file.
  • HTML files and XML files are that the number of parts restricted by the application program and the user terminal model is small, and the storage means connected to the Internet and accessed by the system of the present invention. That the user can access. Also X
  • playback control data is extracted using various tag information, or extracted data or data is extracted according to the type of computer or portable information terminal such as a mobile phone. Define files Can be
  • the image file may be a Macromedia (trademark) F1 ash (trademark) animation II, a Shockwave (trademark) movie, or other popular data files.
  • This is a method that uses a data format. The advantage of using these is that, although plug-in software is required, it is widely spread and readily available. Also, since multiple pages can be created, pages (frames) can be moved as if turning pages. In addition, it is possible to set automatic playback and perform heterogeneous control such as repeated playback.
  • the system of the present invention may be provided in the storage means connected to the Internet for access, so that the user can access the storage means.
  • Still another advantage is that a text field for entering text information can be provided in the image file, and the text information entered in the text field can receive link information to another file. it can. Also, objects such as image information can be inserted into the image file, and the object can receive link information to other files.
  • one or a plurality of balloon-like figures surrounded by a linear figure having an arbitrary shape and thickness are arranged at an arbitrary place in the image.
  • the balloon-shaped figure is indicated by reference numeral 19 in FIG.
  • a plurality of balloon-shaped figures are arranged in one image file.
  • the user terminal can select and display a desired page out of a plurality of pages, and in the lower right of FIG. 5, proceed to the page first.
  • the control button is image information or an object inserted in the image file, and is a predetermined other.
  • the link information to the page is embedded.
  • the data file stored in the storage means is a content such as a comic which has a story, and a user terminal has a plurality of pages.
  • 4 and 5 show an example of an image file displayed in such a form.
  • one or a plurality of character information display fields for displaying character information are arranged.
  • the character information fields are denoted by reference numerals 20a and 20b (hereinafter simply referred to as "20" as necessary) in FIG.
  • the character information field 20 can be set in advance so that predetermined character information is displayed, but the predetermined character information stored in the character information storage means is stored in accordance with the operation of the user.
  • the character information field 20 is a field for displaying image information in which an image information file is data including character information in the invention described in claim 3.
  • the data file stored in the character information storage means 17 is a data file in the form of an image, and the data that is the basis of the image information contains the character information.
  • characters are stored in an image format.
  • the balloon-shaped figure arranged in the image information includes image information including a balloon character on a predetermined coordinate in the image information indicated by the balloon-shaped figure.
  • a balloon character information field for displaying is displayed. That is, in this case, the image information displayed in the balloon character information field is a data file in an image format.
  • the image information including the balloon character is stored in the audio information storage unit.
  • the association with the predetermined audio information file can be set in advance. These may be obtained by embedding hyperlink information in the image information displayed in the balloon character information field 19.
  • the image information displayed in the balloon character information field 19 can take a form in which, for example, an image file of a balloon-shaped figure is overlaid on the image information of the entire page in a single layer format.
  • balloon character information is displayed on predetermined coordinates in the image information represented by the balloon-shaped figure.
  • a balloon character information field is arranged. That is, in this case, the balloon character information field is a field for displaying character information such as text arranged in the image information, and the character information displayed in the balloon character information field is a character information format data. File.
  • the balloon character information is associated with the predetermined voice information file stored in the voice information storage unit, and the predetermined character information stored in the character information storage unit. It is possible to set the association with the information file in advance.
  • hyperlink information may be embedded in the character information displayed in the balloon character information field 19.
  • the hyperlink to the speech information file stored in the speech information storage means 16 set from the speech character information field 19 and the character information storage means set from the speech character information field 19 17 Linking the hyperlink to the character information file stored in 7
  • the section is schematically shown. If the image file is a comic file such as a comic file, one page (image file) is provided with a balloon character information field indicating one or more dialogues, and audio information corresponding to each dialogue is provided. And hyperlinks to textual information.
  • the voice information stored in the voice information storage means 16 includes a WAV file, an MP3 file, an RM file, and various other audio files in data formats.
  • the character information stored in the character information storage means is a text format or another character information file.
  • FIG. 6 shows an example of the relationship between an image file, which is each page of content such as comics, stored in the image information storage means 15, and a balloon character information field arranged in each image file. This is shown using a data schematic diagram.
  • the information processing means 18 allows the user to operate the image information, audio information, text information, and the HTML file that constitutes the menu screen and the like described above using the input means of the user terminal.
  • This is an application program for performing display and output according to the operation.
  • Application programs include browser software, plug-in software for playing F1ash, etc., and programs for playing proprietary data files. Install these programs on storage means 10a such as a hard disk, or D— Provided in storage means 10b such as ROM or DVD, preferably provided with an autorun (Autorun) program in storage means 10b, and automatically stored when storage means 10b is loaded into the user terminal. It is possible to take the form of starting up.
  • FIG. 7 is a flowchart showing a first embodiment of the present invention.
  • the storage means 10 b is loaded in the user terminal 1.
  • the information processing means which is a program
  • the data files stored in the image information storage means 15, the voice information storage means 16, and the character information storage means 17 can be stored in the storage means 10a.
  • the information processing means 18 is started (S102).
  • the information processing means 18 is started by the user's operation, or automatically started by the automatic reproduction program (S103), and the information processing means 18 is started.
  • Teng Tsu data file such as a plurality of cartoon of the scan Tori one the stored data file (S 1 0 5), make a selection of content data Tafuairu (S 1 0 6) 0 Conte N'data If only one file is stored, go to the next step.
  • an image file such as the first page is displayed.
  • an opening screen such as a cover, title, and copyright notice may be displayed.
  • the image file of the first page is displayed.
  • the image to be displayed is an image file in which the balloon character information field 19 as shown in FIG. 4 is arranged as described above. Also, speaking of Fig. 4, the right side of the screen Is provided with a character information display field 20.
  • the user can select one of the balloon character information fields 19 from the balloon character information fields arranged in one or a plurality of displayed balloon-like figures (S108) ).
  • the selection of the balloon character information field is a user's action such as placing a cursor in the balloon character information field to be displayed or placing a cursor and clicking.
  • control means 12 detects the operation of the user, that is, the selection of the hyperlink information (S109), and transmits it to the information processing means 18 (S111). 0).
  • the information processing means detects the user's operation (S111), audio information and character information corresponding to the balloon character information field are extracted and reproduced or displayed and output.
  • the user can set the audio playback speed, number of playbacks, and other playback control information and store them as a setting file.In such a case, determine whether a playback control setting file exists. (S112), read the setting file (S113), extract voice information and character information, and move pages (extract and display image files) according to the data defined in the setting file. I do.
  • the setting is made so that only the audio is reproduced without displaying the character information, the display output of the character information is not performed.
  • the character information to be displayed is not always stored in the character information storage means in advance corresponding to all the balloon character information, or there is no character information at all.
  • the setting may be such that it is displayed in the character information display field included in the image file. In this case, it is determined whether there is character information associated with the balloon character information (S114).
  • the voice information indicating the location in the information is extracted (S115), and the character information indicating the location in the link information added to the selected speech character information field is extracted (S116).
  • the extracted voice information is output as a voice by the output means 14 and reproduced (S 1 17), and the extracted text information is arranged in the image file displayed by the display means 13. Displayed in display field 20 (S1 1 8) 0
  • the reproduction is terminated by the user's operation or selection, or by the automatic reproduction (S120). If not, you can return to the menu screen or navigate to another page.
  • the processing is terminated, the information processing means 18 which is a program is usually terminated.
  • a second embodiment of the present invention is a language translation information processing system using a balloon-shaped figure using the above system.
  • the translation languages that can be played and displayed are: English, French, German, Italian, Spanish, Dutch, Russian if the Japanese language is the pre-translation language.
  • Any language that can be translated from Japanese into a foreign language other than Japanese, such as Chinese, Chinese, Korean, and Swahili, may be used.
  • these foreign languages may be the pre-translation languages
  • the post-translation languages may be Japanese.
  • Japanese standard language and Kansai dialect, Nagoya dialect, Ainu language or Oki ref language or ancient, medieval, early modern, etc.
  • Language of the present It is used in virtual languages that do not actually exist, or in languages used by young people or the elderly, indulgent languages and official languages, upper-class languages, buzzwords, animations such as comics and TV programs, and drama. Languages that can replace various language sentences and words, such as distinctive phrases, heroes such as cartoon characters and dramas, and distinctive phrases of celebrities, in correspondence with other languages. It can also be used as a pre- or post-translation language.
  • the hardware configuration of the basic system and the data configuration of the data stored in the storage unit 10 are the same as in the first embodiment described above, and thus will not be described.
  • the speech information stored in the speech information storage means is post-translation language speech information corresponding to pre-translation language character information included in the balloon character information field.
  • the character information stored in the character information storage means is post-translation language character information corresponding to the pre-translation language character information included in the balloon character information field.
  • FIG. 8 is a diagram showing a storage area of the storage means.
  • the image information storage means 15 stores image information
  • the voice information storage means 16 stores voice information
  • character information is stored as necessary.
  • a character information storage means 17 for storing and an information processing means 18 for displaying character information and voice information on a user terminal are provided.
  • the image information, the image file inserted in the HTML file, the XML file, or the like stored in the image information storage means, a slide show including a plurality of image files, or the like is provided.
  • an image file displayed on a user terminal such as a file
  • character information or image information using character information as image data having an arbitrary shape and size is arranged at an arbitrary location in the image.
  • a plurality of character information display fields are arranged.
  • the character information display field includes the voice information storage unit. It is possible to set in advance the association with the predetermined character information file stored in the character information storage means, in addition to the association with the predetermined audio information file stored in the file. Yes, the character information field is not necessarily limited to the "balloon-shaped figure" as in the other embodiments, but may be variously arranged in a page and provided in a predetermined area set in advance. Including figures and character information. In addition, even if it is not necessarily a tangible figure, for example, a form in which a predetermined area in an image file is associated with a voice information file or a character information file is included.
  • the voice information stored in the voice information storage means is post-translation language voice information corresponding to the pre-translation language character information included in the character information field, and is stored in the character information storage means.
  • the character information to be translated is language character information after translation corresponding to the language character information before translation included in the character information field, and the cursor is placed in the character information field indicated by the language before translation.
  • Information processing means provided in the storage means for detecting the user's action in response to the user's action such as clicking on the link, and the location of the link information added to the character information field.
  • FIG. 20 Starting with the comic speech bubbles shown in Fig. 4, various shapes with various shapes and leader lines, circles and ellipses, cloud shapes, and irregular shapes These examples of FIG. 20 are shown, including species forms.
  • the balloon character information field provided in the balloon upper figure provided in the image file stored in the image information storage means is set so that character information consisting of the language before translation is displayed.
  • character information consisting of the language before translation
  • Fig. 4 and Fig. 5 the comics in Japanese as the pre-translation language are translated into English as the post-translation language, and the voice and characters in the selected speech character information field are automatically reproduced and displayed. An example is shown.
  • the basic processing flow is the same as in the first embodiment.
  • the user terminal 1 is loaded with the storage means 10b.
  • the information processing means which is a program
  • the data files stored in the image information storage means 15, the voice information storage means 16, and the character information storage means 17 can be stored in the storage means 10a.
  • the information processing means 18 is started (S102). '
  • the information processing means 18 is started by the user's operation, or automatically started by the automatic reproduction program (S103), and the information processing means 18 is started.
  • a menu screen such as which comic story to select is displayed (S104). For example, in FIG. 3, a menu screen is displayed, and a story such as “ ⁇ ⁇ ⁇ ” is selected from among a plurality of stories. If there are a plurality of content data files such as a data file storing a plurality of comic stories (S105), a content file is selected (S106). If only one content file is stored, proceed to the next step.
  • the image file of the first page is displayed, but there is an image to be displayed as described above. Is an image file in which is arranged.
  • a character information display field 20 is arranged on the right side of the screen.
  • An image file constituting the entire page as shown in FIG. 4 is an image file stored in the image information storage means in FIG. 8, and one or more image files are included in the image file (page).
  • a balloon character information field is set for the balloon-shaped figure.
  • there is a balloon character information field for each of the pre-translation languages Japanese in this example
  • Japanese in this example Japanese in this example
  • the voice information of the language is stored in the voice information storage means 16 in FIG. 8, and the corresponding text information of the translated language (English in this example) is stored in the voice information storage means 1 in FIG. 7 is stored.
  • the user can select one of the balloon character information fields 19 from the balloon character information fields arranged in one or a plurality of displayed balloon-shaped figures (S 1 0 8).
  • the user makes a selection, such as placing the cursor in the balloon character information field or placing the cursor and clicking, the user's action, that is, the selection of the hyperlink information, is controlled.
  • the means 12 detects (S109) and transmits it to the information processing means 18 (S110).
  • the information processing means detects the operation of the user (S111), the speech information and the character information of the translated language corresponding to the balloon character information field are extracted and reproduced or displayed and output. Will be If the user can set the audio playback speed, number of playbacks, and other playback control information in advance and store them as a setting file, determine whether there is a playback control setting file. (S112), read the setting file (S113), extract voice information and character information, and move pages (extract and display image files) according to the data defined in the setting file. ) I do. Also, if the setting is made so that only the voice is played without displaying the character information, the display and output of the character information are not performed. In particular, if the reproduction control is not set, the process proceeds to the next step.
  • the character information to be displayed is not always stored in the character information storage means in advance corresponding to all the balloon character information, or there is no character information at all.
  • the setting may be such that it is displayed in the character information display field included in the image file. In this case, it is determined whether there is character information associated with the balloon character information (S114).
  • the voice information indicating the location in the link information added to the selected balloon character information field is extracted (S115), and the audio information indicating the location is added to the link information added to the selected balloon character information field.
  • the character information indicated by is extracted (S116).
  • the balloon character information field 19 indicates that "Hatsutsu” ⁇ "Is it really true?" Is selected, and the extracted speech information, "Is it possibly”, in the translated language (English)
  • the sound “true thai: " is output and played back by the output means 14 (S117), and the extracted character information "Is it possibly true that " is displayed on the display means 13
  • the character information is displayed in the character information display field 20 arranged in the file (S118).
  • the reproduction is ended by a user operation or selection, or by automatic reproduction (S120). If not, you can return to the menu screen or navigate to another page.
  • the post-translation voice information stored in the voice information storage means includes a plurality of speech character information corresponding to pre-translation language character information included in the balloon character information field. Contains post-translation language audio information consisting of the post-translation language.
  • the post-translation character information stored in the character information storage means includes post-translation language characters composed of a plurality of post-translation languages corresponding to the pre-translation language character information included in the balloon character information field.
  • the pre-translation language Japanese
  • Japanese Japanese
  • the information and the character information displayed in the translated language are in a form that allows selection of, for example, English or French. Alternatively, it can be selected from English, French, Spanish, German, Chinese, and Korean.
  • Fig. 9 shows the storage means for storing speech information consisting of a plurality of translated language languages (here, English and French) corresponding to the pre-translation language (here, Japanese) and character information consisting of a plurality of translated language languages.
  • This shows a storage area of 0.
  • Fig. 10 shows the storage of speech information in a plurality of translated language languages (here, English and French) corresponding to the pre-translation language (here, Japanese) and character information consisting of a plurality of translated language languages.
  • FIG. 3 shows a schematic diagram of data stored in means 10.
  • the user performs a process of selecting which of a plurality of translated languages to translate the pre-translation language character information into. For example, if there are English and French translation languages, select English.
  • the information processing means provided in the storage means performs a process of detecting the user's action according to the action of the user.
  • the balloon-shaped character information arranged in the balloon-shaped figure The voice information in the selected translated language (selected English), which indicates the location in the link information added to the report field, is transmitted to the user terminal, and the voice reproduction means provided in the user terminal transmits the voice information. Output and play.
  • selected translated language selected English
  • the location is indicated in the character information display field in the link information added to the balloon character information field. Then, the character information in the translated language (selected English) is transmitted to the user terminal and displayed by the display means provided in the user terminal.
  • the balloon character information displayed in the balloon character information field which is indicated by the pre-translation language arranged in the displayed balloon-shaped figure, includes a plurality of pre-translation languages.
  • Balloon character information is prepared in advance, and an image file including a balloon-shaped figure is stored in the image information storage unit.
  • the comics in Japanese as the pre-translation language are translated into English as the post-translation language, and the voice and characters of the selected speech balloon character information field are automatically reproduced and displayed.
  • An example is shown.
  • an image file whose language before translation is English can be displayed in the balloon character information field.
  • Japanese is used as the post-translation language, and Japanese speech information and Japanese character information corresponding to English in the balloon character information field are stored.
  • FIG. 11 shows that there are multiple pre-translation languages, and that multiple pre-translation languages corresponding to pre-translation language 1 (for example, Japanese) and pre-translation language 2 (for example, English)
  • pre-translation language 1 for example, Japanese
  • pre-translation language 2 for example, English
  • it shows a storage area of the storage means 10 in which audio information composed of, for example, English and Japanese
  • character information composed of a plurality of translated language languages are stored.
  • Fig. 12 shows the speech information composed of multiple translated language languages (here, English and Japanese) corresponding to multiple pre-translation languages (here, Japanese and English) displayed in the balloon character information field.
  • FIG. 3 shows a schematic diagram of data stored in a storage area of a storage unit 10 in which character information composed of the translated language is stored.
  • Fig. 13 shows an example of translating a manga whose original language is English into English, which is the translated language, and automatically reproducing and displaying the voice and characters in the selected balloon character information field. It is shown.
  • FIG. 14 is a flowchart showing an example of a basic processing flow in the present embodiment.
  • the user performs a process of selecting from which of the plurality of pre-translation languages the pre-translation language is to be translated (S207). 0 8).
  • the post-translation language can be automatically set to Japanese, while English-Japanese translation, English-Japanese There may be multiple translated languages, such as Japanese-English translation, Japanese-German translation, German-Japanese translation, German-English translation.
  • the user performs a process of selecting a language to be translated from a translated language or a plurality of translated languages (S210).
  • a process of displaying an image file including a balloon character information field composed of the selected pre-translation language (S211), and a process of displaying the pre-translation language, which is arranged in the displayed balloon-shaped figure,
  • the information processing means provided in the storage means performs the process of detecting the user's operation (S213, S214).
  • the speech information which is the language after translation, whose location is indicated by the link information added to the balloon-shaped character information field, is transmitted to the user terminal, and is output and reproduced by the audio reproduction means provided in the user terminal.
  • the character information display field contains the link information added to the balloon character information field. Is transmitted to the user terminal, and is displayed on the display means provided in the user terminal (S222).
  • the storage means is a server system including a WEB server, an application server, a database server, and the like connected from a user terminal via a computer network, and is a computer represented by the Internet. In this mode, access is made from the user terminal 1 via a network.
  • the system according to the present embodiment is generally realized in a system having a Web server, an application server, a database server, and the like on a network to which a computer, a portable information terminal, and the like are connected.
  • Fig. 1 shows an example in which these server systems are installed in the same system, but if the application server is located in a separate location, Or, even if the database server exists in a separate location, these locations can be specified and specified by a URL or the like. Therefore, even in such a system configuration, the system of the present invention is used. Is feasible.
  • FIG. 15 shows a basic system configuration diagram of the present embodiment.
  • reference numeral 1 denotes a user terminal
  • reference numeral 25 denotes a server system
  • reference numeral 30 denotes a computer network represented by the Internet.
  • the server system 25 includes image information storage means 15, audio information storage means 16, and character information storage means 17.
  • user terminals for connecting to a network include computer terminals such as personal computers, wireless communication terminals such as mobile phones and PHS, portable information terminals incorporating these functions, and other various types of terminals.
  • computer terminals such as personal computers, wireless communication terminals such as mobile phones and PHS, portable information terminals incorporating these functions, and other various types of terminals.
  • kinds of computer terminals are included.
  • a so-called information home appliance such as an Internet TV may be used.
  • networks to which these are connected include wired and wireless communication lines.
  • image information storage means for storing image information
  • voice information storage means for storing voice information associated with the text information
  • text information storage means for storing text information
  • text information and voice information The configuration of the information processing means to be transmitted to the user terminal for display is common to the various modes described above.
  • the user terminal 1 includes a computer terminal such as a personal computer, a wireless communication terminal such as a mobile phone or a PHS, a portable information terminal incorporating these functions, and various other computer terminals. Also, for example, a so-called information home appliance such as the Internet TV may be used.
  • the storage means 10a includes an external storage device such as a CPU, a memory, and a hard disk.
  • the storage means 10 usually stores an operation system (OS), various application programs, various data files, and the like.
  • OS operation system
  • reference numeral 11 denotes input means such as a keyboard / mouse
  • 12 denotes data control, data transmission / reception, hardware control, software control, and the like using a CPU, a path, and other OS and application programs.
  • 2 shows control means for performing the above.
  • Reference numeral 14 denotes an output means for transmitting and receiving data via a network and outputting data such as voice.
  • the menu screen for browsing the content data file, the playback screen for arranging the content data file, and the like are in the form of an HTML file, an XML file, or the like.
  • Image file displayed on the user terminal such as a slide show file containing the same image file, or a file format using a unique playback program, or an image file inserted and displayed in the file You can also.
  • F1ash (trademark) and Shocwav (trademark) of Macromedia Corporation (trademark) have been described.
  • the information to be displayed is an image file such as a gif file
  • a link to the image file is described in a file such as an HTML file on a website.
  • HTML files In addition to HTML files, it is also possible to use XHTML files, XML files, SGML files, or C-HTML files for mobile terminals.
  • the user's computer terminal When the user accesses this web site, the user's computer terminal requests the transmission of the web page file (HTML file, etc.), and at the same time, the link is described in the file. It also requests transmission of the image file.
  • the web page file HTML file, etc.
  • the web page accessed by the user displays an HTML file or the like on the user's computer terminal screen via a browser software, and the image file is displayed on a part of the page.
  • the file is an audio file
  • the web page accessed by the user is displayed on the user's computer terminal screen as an HTML file via browser software, and the audio page is displayed on a part of the page.
  • the hyperlink to the file is described and displayed.
  • the file to be transmitted is displayed in a part of a plurality of divided frames, such as a frame for displaying a plurality of HTML files by dividing one screen.
  • customers who can access and browse the system of the present invention are not limited to an unspecified number of users, and only registered users can access and search and browse information. Is also good. For example, it is possible to access the web site, enter the ID and password issued for each customer, etc., and make the access possible. Next, a basic processing flow of the present embodiment will be described.
  • FIG. 16 and FIG. 17 are flowcharts showing an example of the basic processing of the present embodiment.
  • the user terminal 1 is connected to a computer network such as the Internet (S300), and accesses the server system 25 (S301).
  • the server system is provided with data files such as image information storage means, audio information storage means, and character information storage means, and programs such as information processing means. Is provided.
  • files such as HTM files and XML files provided on the WEB server that are displayed on the WEB are transmitted to the user terminal, and a menu screen is displayed.
  • a browsing menu is displayed (S305).
  • content data files here, translation of comics is taken as an example
  • S307 which one to browse
  • languages such as English-Japanese translation and Japanese-English translation
  • these choices are made (S308 to S311).
  • the information stored in the server system 20 is as follows, for example, using a system that can translate Japanese into English using Japanese manga as a material.
  • the image information storage means 15 includes character information such as dialogue of Japanese manga arranged in the balloon character information field of the pre-translation language for each frame of each manga page, each dialogue, etc. Image information is stored for each page of the comic.
  • the translated language character information storage means 17 stores, in correspondence with the above-mentioned dialogues, English translations of Japanese manga dialogues, etc., and textual information such as texts, etc. of each manga page, It is stored for each line or the like. It is also possible to store information such as points and notes for translation and other similar expressions.
  • the translated speech information database 16 stores audio files of English translations such as dialogues of Japanese comics, and text information such as text for each frame on each page of the comics, each speech, etc. You can also do that.
  • the image data storage means including the character information of the language before translation, the character information storage means of the language after translation, and the voice information storage means of the language after translation are tentatively stored.
  • the database structure can take various forms as long as it can extract data. These can be realized by adopting a hierarchical structure of folders or a relational database. Also, the translation of comics is an example here, and can take various forms described in the first embodiment and the second embodiment described above.
  • the information stored in each of the storage means 15, 16, and 17 is a claim.
  • the invention described in the range 17 it is possible to store by the following means, and it is preferable to use the present invention in order to store a lot of contents.
  • the storage unit including the image information storage unit, the voice information storage unit, the information processing unit, and the character information storage unit includes a data capturing unit that captures data such as a print having image information and balloon character information as image information. Be provided.
  • the data capturing means is, specifically, a scanner device or the like, and the read data is stored as an image file.
  • comics are used as the original material that becomes the content such as printed matter having image information and character information.
  • the writer who publishes the manga and the author who wrote the manga or Z obtain the rights such as copyrights for use in the system of the present invention.
  • the comics for which the right has been acquired are stored by scanning or the like in accordance with the database or the storage area having a hierarchical structure.
  • the first data processing means for storing the processed image information in the image information storage means sets a balloon character information field in a balloon-shaped graphic portion such as each speech included in the captured image information.
  • the character information to be arranged is input and stored as character information data to be arranged in the balloon character information field. Alternatively, it is stored as image information data including character information.
  • the character information (for example, Japanese speech in the pre-translation language) placed in the balloon character information field can be converted into character information by reading image information with OCR software.
  • the second data processing means inputs the character information and voice information associated with the character information included in the character information field, converts them to the translated language if necessary, converts the The information is stored in the information storage means.
  • the second data processing means includes a process of associating each balloon character information field included in the image information stored in the image information storage device, a process of inputting character information or voice information, and the above-described hierarchical structure or database. This is a program that performs processing for storing data files in a storage area such as a structure.
  • the process of inputting character information or voice information is performed by automatic translation software or the like based on the character information read by OCR or the input character information from the character part of the image information read by the data capture unit. It is possible to adopt a process of storing the translated information (for example, English) as character information (text data or the like) in the character information storage means and storing the information in the voice information storage means using a reading software or the like.
  • the files stored in the character information storage means, the image information storage means, and the audio information storage means are clicked with a mouse or the like on the user's website using a CGI program or another program.
  • the system can automatically generate files such as HTML files, XML files, Flash (trademark) movie files, etc., and create a system that obtains the desired language translation results.
  • FIG. 18 is a flowchart showing an example of the above processing.
  • the data created as described above is stored in a server system or the like, or is stored in an information storage medium such as a CD-ROM, and is loaded into a changer. It can be accessed and used from.
  • an information storage medium such as the CD-ROM described above can be obtained by purchase or the like, and the user can use it on a terminal.
  • the image file of the comic page is displayed.
  • This is the screen shown in Fig. 4, for example, with a manga displayed on the left side of the screen.
  • This speech balloon character information field of the comic that is, the Japanese part of the dialogue is clicked with the mouse (S313), and the dialogue part of the clicked comic is displayed on the right character information field 20a.
  • the control means of the user terminal detects the user's action by clicking the Japanese portion of the dialogue to be translated into English on the left side of the screen with a mouse (S31). 4), the information is transmitted through the computer network, and the application described later is started.
  • the application receives a file transmission request by a command such as a user's click (S315), judges the speech character information selected (clicked, etc.) by the user (S316), and With reference to each storage means 15, 16, 16 and 17, search and extract the information corresponding to the transmission request from the stored information, and include such information or hyperlink information to the information Combine HTML files etc.
  • a command such as a user's click (S315)
  • judges the speech character information selected (clicked, etc.) by the user S316
  • the application stored in the application server is used for the given condition, that is, the condition of the corresponding page, frame, dialogue, etc.
  • instruction information such as a request
  • access is made to step 10 in the memory s, data matching the conditions and the like are combined into, for example, an HTML format file, and transmitted to the user terminal.
  • sentences translated into English are played back as voices like narration via a browser plug-in software for playing back the voice information file of the hyperlink.
  • server software that generates the contents of html files is also being implemented.
  • Such software has a function to query the database and the server in advance, and if the content of the database query using SQL is embedded in an HTML file with its own extension, the server sends back the page. At this time, replace the contents of the HTML file with the contents of the result of the inquiry. Because the contents of the database query and the appearance of the displayed page can be described in a single file, service development is easier than with the CGI program.
  • a script environment operating on a server can be used.
  • Microsoft's ASP Active Server Age
  • ASP Active Server Age
  • VB Script Script
  • JS cript a server-side script
  • Active X control including JaVaplet
  • means does not necessarily mean physical means, but also includes a case where the function of each means is realized by software.
  • the function of one means or step may be realized by two or more physical means, and the functions of two or more means or steps may be realized by one physical means.
  • the system further includes an authentication unit for logging in from a user terminal, and an access number of the user.
  • a usage information storage unit capable of storing the number of uses of the translation system, other information, information on the user, and the like, and calculating a usage fee by referring to the information stored in the usage information storage unit. Means for calculating usage fees, and each of the above-mentioned number of accesses, etc. There is a system that can calculate usage charges and manage charges according to species usage information.
  • the information on the user may be a method in which the user inputs an e-mail address or the like, or may be information automatically acquired by the system of the present invention.
  • the information of the user may be obtained in advance through member registration on the Web site, and the system of the present invention may perform authentication by inputting an ID and a password.
  • Usage information of the access number or the like of the user also c are stored for each individual user, the unit price of the usage fee, the access execution of the translation, the voice acquisition, there have the use time unit and usage information amount unit It can be set for each and the like.
  • the usage fee calculating means calculates and stores the usage fee for each user.
  • the system further includes information on a right holder such as a copyright of text information and image information of a language before translation. And a license 'fee calculation means to be paid to the right holder, and a fee to be returned to the right holder according to the usage fee calculated by the usage fee calculation means.
  • a system that can calculate and manage data. .
  • the unit price of the fee to be returned to the copyright holder can be set for each unit of access, execution of translation, acquisition of voice, or unit of use time or amount of use information.
  • the license fee calculating means calculates and stores the license fee of each copyright and other right holder.
  • a computer-readable information storage medium can store data constructed by the system described above.
  • Something A CD-ROM is preferable.
  • DVD, FD (floppy disk), MO, hard disk, and any other storage media are included.
  • portable information terminals such as mobile phones, personal digital assistants, e-book players, and sound playback players can be loaded into portable information terminals that have been remarkably developed in recent years, and small information that can be loaded into computer devices such as personal computers.
  • Storage media (various memories, etc.) are included.
  • the information storage medium includes at least image information storage means for storing image information, voice information storage means for storing voice information, and information processing means for displaying character information and voice information at a user terminal. If necessary, character information storage means for storing character information is provided.
  • Image files displayed on the user terminal such as image files inserted into HTML files or XML files stored in the storage means, image files, and files such as slideshows including a plurality of image files.
  • one or more character information display fields for displaying character information are arranged.
  • image information including a balloon character at predetermined coordinates in the image information indicated by the balloon-shaped figure, or balloon character information is displayed.
  • a balloon character information field is provided for performing the processing, and the image information including the balloon character or the balloon character information is associated with a predetermined voice information file stored in the voice information storage unit.
  • the authentication permission information is set. If the information is stored in the authentication information storage means and made reproducible, it can be used only by the users who have downloaded it properly, or the trial version can be downloaded from a CD-ROM such as a magazine appendix. In order to distribute and obtain the official version, it is possible to take the form of registering the user online and obtaining the authentication permission information.
  • the information storage medium is loaded in the user terminal 1 which is a portable information terminal such as a mobile phone, a portable information terminal, an electronic book player, and a sound reproduction player.
  • a portable information terminal such as a mobile phone, a portable information terminal, an electronic book player, and a sound reproduction player.
  • a small information storage medium that is possible and that can be loaded into a computer device such as a personal computer is adopted.
  • the image information storage unit, the voice information storage unit, the image information stored in the character information storage unit, the audio information, or the character information included in the information storage medium can be output or reproduced by a portable information terminal. Files are included.
  • a portable information terminal file that can be output or reproduced by the portable information terminal is stored separately from the computer device file.
  • FIG. 19 shows an example of a basic process using the information storage medium of the present embodiment.
  • an information storage medium is loaded into a user terminal 1 such as a portable information terminal (S400).
  • the information processing means is activated (S401).
  • the user terminal is a computer device such as a personal computer
  • all the data formats of images, sounds, and characters can be displayed, so that the same processing as in the above-described embodiments is performed. That is, for example, the process proceeds to S104 in FIG.
  • the process proceeds to the process of determining whether the data file can be displayed and played back.However, the determination may be performed automatically, or may be performed by the user through a menu display operation. .
  • the image file may be a file for a computer device or an image file for a portable information terminal.
  • audio information is output (S407).
  • the reproduction of the audio information may be performed automatically, and the user operates and moves back and forth while reproducing the individual audio information corresponding to the balloon character information by an operation. May be.
  • the speech balloons are set to be associated with textual information and voice information.
  • the system of the present invention when a copyrighted work such as a comic is used, a consent of a copyright holder or the like is obtained, and a profit is also returned to the right holder.
  • a copyrighted work such as a comic
  • a consent of a copyright holder or the like is obtained, and a profit is also returned to the right holder.
  • secondary use of comics and the like is possible, and the content of this system can be enhanced and provided.
  • an information storage medium storing data and a program for realizing the above-described system
  • an information storage medium usable in both a computer device and a portable information terminal is provided. be able to.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Artificial Intelligence (AREA)
  • Computational Linguistics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

L'invention concerne un système de traitement d'informations, conçu pour afficher un index contenant des modèles de bulles, qui comprend un champ d'informations d'affichage de caractères de bulles pour l'affichage de caractères de bulles. A ces caractères de bulles sont corrélées des informations vocales et/ou des informations relatives aux caractères, dont une est affichée par la désignation du modèle de bulle à l'aide d'une souris ou similaire. Les caractères de bulles, les informations vocales et les informations relatives aux caractères peuvent être dans différentes langues ou peuvent être établies par la désignation d'un utilisateur. Les index sont de préférence des bandes dessinées. Le système de traitement de l'information peut être configuré selon un modèle client-serveur, peut se présenter sous la forme d'un dispositif mobile ou peut comporter un support de stockage. Il est possible d'ajouter un composant de comptabilité, si nécessaire.
PCT/JP2001/004743 2000-06-05 2001-06-05 Systeme de traitement d'informations au moyen de modeles de bulles, systeme de traitement d'informations par traduction dans lequel les modeles de bulles sont utilisees, systeme de traitement d'informations en ligne au moyen desdits modeles de bulles, et support de stockage d'informations lisible par ordinateur WO2001095079A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
AU2001262696A AU2001262696A1 (en) 2000-06-05 2001-06-05 Information processing system using balloon pattern, language translation information processing system using balloon pattern, on-line information processing system using balloon pattern, and computer-readable information storage medium
JP2002502565A JPWO2001095079A1 (ja) 2000-06-05 2001-06-05 吹き出し状図形を用いた情報処理システム、吹き出し状図形を用いた言語翻訳情報処理システム、吹き出し状図形を用いたオンライン情報処理システム、及びコンピュータ読み取り可能な情報記憶媒体

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2000207528 2000-06-05
JP2000-207528 2000-06-05

Publications (1)

Publication Number Publication Date
WO2001095079A1 true WO2001095079A1 (fr) 2001-12-13

Family

ID=18704278

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2001/004743 WO2001095079A1 (fr) 2000-06-05 2001-06-05 Systeme de traitement d'informations au moyen de modeles de bulles, systeme de traitement d'informations par traduction dans lequel les modeles de bulles sont utilisees, systeme de traitement d'informations en ligne au moyen desdits modeles de bulles, et support de stockage d'informations lisible par ordinateur

Country Status (3)

Country Link
JP (1) JPWO2001095079A1 (fr)
AU (1) AU2001262696A1 (fr)
WO (1) WO2001095079A1 (fr)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006085632A (ja) * 2004-09-17 2006-03-30 Just Syst Corp ファイル表示装置、ファイル表示方法、およびファイル表示プログラム
JP2006134140A (ja) * 2004-11-08 2006-05-25 Noritsu Koki Co Ltd 画像ファイル再生システム
JP2007226255A (ja) * 2007-03-30 2007-09-06 Celsys:Kk マンガの表示方法およびマンガを表示する電子機器
JP2009152889A (ja) * 2007-12-20 2009-07-09 Murphy Systems:Kk デジタル絵本システム
JP2010129068A (ja) * 2008-12-01 2010-06-10 Spicysoft Kk 画像群編集装置及び電子機器
JP2014007561A (ja) * 2012-06-25 2014-01-16 Toshiaki Ueno コンテンツ閲覧装置およびコンテンツ提供システム
US11409849B2 (en) 2017-01-31 2022-08-09 Lima Security Lab Co., Ltd. System, method and program for preventing unauthorized copies of webcomics and tracking replicated webcomics

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6640788B2 (ja) * 2017-06-07 2020-02-05 株式会社カプコン 言語変換プログラム及び言語変換装置

Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06319102A (ja) * 1993-05-10 1994-11-15 Sony Corp 再生表示装置、記録装置並に記録媒体
JPH0793368A (ja) * 1993-09-22 1995-04-07 Hudson Soft Co Ltd コミック出版物
JPH07249130A (ja) * 1994-03-08 1995-09-26 Matsushita Electric Ind Co Ltd 電子漫画装置
JPH10133852A (ja) * 1996-10-31 1998-05-22 Toshiba Corp パーソナルコンピュータおよび音声属性パラメータの管理方法
JPH10154185A (ja) * 1996-11-21 1998-06-09 Hitachi Maxell Ltd 著作物伝送システム
JPH10240953A (ja) * 1997-02-24 1998-09-11 Toshiba Corp 画像表示システム
JPH11175081A (ja) * 1997-12-11 1999-07-02 Toshiba Corp 発話装置及び発話方法
JPH11203008A (ja) * 1998-01-09 1999-07-30 Canon Inc 情報処理装置及び情報処理装置における言語切替制御方法
JPH11259971A (ja) * 1998-03-10 1999-09-24 Sony Corp ダビングシステム、ダビング方法
JPH11272399A (ja) * 1998-03-26 1999-10-08 Sharp Corp 表示用データを記録した記録媒体及び表示装置
JPH11275268A (ja) * 1998-03-20 1999-10-08 Matsushita Electric Ind Co Ltd カラオケ装置及びカラオケシステム
JPH11282867A (ja) * 1998-03-31 1999-10-15 Sharp Corp データ流通システム及び複製データ検出システム
JPH11282848A (ja) * 1998-03-31 1999-10-15 Yoshimori Kato Ｃｄ−ｒｏｍインターネット「翻訳の王様」（登録商標）
JP2000010876A (ja) * 1998-06-24 2000-01-14 Sony Corp ダウンロード装置、及び記録媒体
JP2000036781A (ja) * 1998-07-17 2000-02-02 Sony Corp 著作権管理装置、著作物配信装置および著作物配信受信システム
JP2000090350A (ja) * 1998-09-10 2000-03-31 Snk:Kk 情報伝達システム及び情報伝達方法
JP2001014406A (ja) * 1999-05-12 2001-01-19 Seecops Co Ltd マルチメディア情報及びマルチメディア情報再生プログラムを有する記録媒体ネットワークを基とするマルチメディア情報提供システム及びその方法
JP2001075581A (ja) * 1999-09-01 2001-03-23 Sharp Corp 電子漫画製造装置および電子漫画出力装置

Patent Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06319102A (ja) * 1993-05-10 1994-11-15 Sony Corp 再生表示装置、記録装置並に記録媒体
JPH0793368A (ja) * 1993-09-22 1995-04-07 Hudson Soft Co Ltd コミック出版物
JPH07249130A (ja) * 1994-03-08 1995-09-26 Matsushita Electric Ind Co Ltd 電子漫画装置
JPH10133852A (ja) * 1996-10-31 1998-05-22 Toshiba Corp パーソナルコンピュータおよび音声属性パラメータの管理方法
JPH10154185A (ja) * 1996-11-21 1998-06-09 Hitachi Maxell Ltd 著作物伝送システム
JPH10240953A (ja) * 1997-02-24 1998-09-11 Toshiba Corp 画像表示システム
JPH11175081A (ja) * 1997-12-11 1999-07-02 Toshiba Corp 発話装置及び発話方法
JPH11203008A (ja) * 1998-01-09 1999-07-30 Canon Inc 情報処理装置及び情報処理装置における言語切替制御方法
JPH11259971A (ja) * 1998-03-10 1999-09-24 Sony Corp ダビングシステム、ダビング方法
JPH11275268A (ja) * 1998-03-20 1999-10-08 Matsushita Electric Ind Co Ltd カラオケ装置及びカラオケシステム
JPH11272399A (ja) * 1998-03-26 1999-10-08 Sharp Corp 表示用データを記録した記録媒体及び表示装置
JPH11282867A (ja) * 1998-03-31 1999-10-15 Sharp Corp データ流通システム及び複製データ検出システム
JPH11282848A (ja) * 1998-03-31 1999-10-15 Yoshimori Kato Ｃｄ−ｒｏｍインターネット「翻訳の王様」（登録商標）
JP2000010876A (ja) * 1998-06-24 2000-01-14 Sony Corp ダウンロード装置、及び記録媒体
JP2000036781A (ja) * 1998-07-17 2000-02-02 Sony Corp 著作権管理装置、著作物配信装置および著作物配信受信システム
JP2000090350A (ja) * 1998-09-10 2000-03-31 Snk:Kk 情報伝達システム及び情報伝達方法
JP2001014406A (ja) * 1999-05-12 2001-01-19 Seecops Co Ltd マルチメディア情報及びマルチメディア情報再生プログラムを有する記録媒体ネットワークを基とするマルチメディア情報提供システム及びその方法
JP2001075581A (ja) * 1999-09-01 2001-03-23 Sharp Corp 電子漫画製造装置および電子漫画出力装置

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006085632A (ja) * 2004-09-17 2006-03-30 Just Syst Corp ファイル表示装置、ファイル表示方法、およびファイル表示プログラム
JP4713115B2 (ja) * 2004-09-17 2011-06-29 株式会社ジャストシステム ファイル表示装置、ファイル表示方法、およびファイル表示プログラム
JP2006134140A (ja) * 2004-11-08 2006-05-25 Noritsu Koki Co Ltd 画像ファイル再生システム
JP4591818B2 (ja) * 2004-11-08 2010-12-01 ノーリツ鋼機株式会社 画像ファイル再生システム
JP2007226255A (ja) * 2007-03-30 2007-09-06 Celsys:Kk マンガの表示方法およびマンガを表示する電子機器
JP2009152889A (ja) * 2007-12-20 2009-07-09 Murphy Systems:Kk デジタル絵本システム
JP4674356B2 (ja) * 2007-12-20 2011-04-20 株式会社 マーフィーシステムズ デジタル絵本システム
JP2010129068A (ja) * 2008-12-01 2010-06-10 Spicysoft Kk 画像群編集装置及び電子機器
JP2014007561A (ja) * 2012-06-25 2014-01-16 Toshiaki Ueno コンテンツ閲覧装置およびコンテンツ提供システム
US11409849B2 (en) 2017-01-31 2022-08-09 Lima Security Lab Co., Ltd. System, method and program for preventing unauthorized copies of webcomics and tracking replicated webcomics

Also Published As

Publication number Publication date
AU2001262696A1 (en) 2001-12-17
JPWO2001095079A1 (ja) 2004-01-08

Similar Documents

Publication Publication Date Title
US10503812B2 (en) Method and apparatus for materials in different screen sizes using an imaging sensor
TWI269245B (en) Video based language learning system
US8862473B2 (en) Comment recording apparatus, method, program, and storage medium that conduct a voice recognition process on voice data
US11657725B2 (en) E-reader interface system with audio and highlighting synchronization for digital books
US20060194181A1 (en) Method and apparatus for electronic books with enhanced educational features
US20080027726A1 (en) Text to audio mapping, and animation of the text
US20010041328A1 (en) Foreign language immersion simulation process and apparatus
US20130305153A1 (en) Interactive storybook system and method
US20080256066A1 (en) Book creation systems and methods
CA2639720A1 (fr) Formation linguistique communautaire sur l'internet fournissant un contenu a utilisation souple
WO2001001390A1 (fr) Trieuse-liseuse electronique
JP2008165175A (ja) モジュール方式のコンピュータ支援の言語学習方法及びシステム
US20190110110A1 (en) Recording medium recording content display program, content display method, and information processing apparatus
US20230237244A1 (en) Method and apparatus applicable for voice recognition with limited dictionary
JP2001014406A (ja) マルチメディア情報及びマルチメディア情報再生プログラムを有する記録媒体ネットワークを基とするマルチメディア情報提供システム及びその方法
KR20100005177A (ko) 맞춤형 학습 시스템, 맞춤형 학습 방법, 및 학습기
WO2001095079A1 (fr) Systeme de traitement d'informations au moyen de modeles de bulles, systeme de traitement d'informations par traduction dans lequel les modeles de bulles sont utilisees, systeme de traitement d'informations en ligne au moyen desdits modeles de bulles, et support de stockage d'informations lisible par ordinateur
US20060166172A1 (en) Speaking words language instruction system and methods
US7219164B2 (en) Multimedia re-editor
TW201816636A (zh) 書籍內容數位化互動系統及方法
KR20040065593A (ko) 음성인식을 이용한 온라인 외국어학습 방법 및 그 시스템
Gimeno The IN6ENIO online CALL authoring shell
KR100377107B1 (ko) 네트워크를 기반으로 하는 동영상 정보 제공 시스템 및 그방법
WO2023002300A1 (fr) Programme de lecture de diapositives, dispositif de lecture de diapositives et procédé de lecture de diapositives
KR100387102B1 (ko) 보이스 레코더를 이용한 학습 시스템

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase