WO2011086939A1 - Système de génération d'informations exécutant affichage de caractères et d'images entremêlés - Google Patents

Système de génération d'informations exécutant affichage de caractères et d'images entremêlés Download PDF

Info

Publication number
WO2011086939A1
WO2011086939A1 PCT/JP2011/000166 JP2011000166W WO2011086939A1 WO 2011086939 A1 WO2011086939 A1 WO 2011086939A1 JP 2011000166 W JP2011000166 W JP 2011000166W WO 2011086939 A1 WO2011086939 A1 WO 2011086939A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
picture
character information
sentence
pieces
Prior art date
Application number
PCT/JP2011/000166
Other languages
English (en)
Japanese (ja)
Inventor
西山純一
Original Assignee
株式会社アクロディア
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社アクロディア filed Critical 株式会社アクロディア
Priority to KR1020127019975A priority Critical patent/KR20120123381A/ko
Priority to CN201180006449.3A priority patent/CN102713872B/zh
Priority to JP2011549948A priority patent/JP5767590B2/ja
Publication of WO2011086939A1 publication Critical patent/WO2011086939A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/12—Use of codes for handling textual entities
    • G06F40/151—Transformation
    • G06F40/157—Transformation using dictionaries or tables
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/103—Formatting, i.e. changing of presentation of documents
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/166—Editing, e.g. inserting or deleting
    • G06F40/169—Annotation, e.g. comment data or footnotes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72427—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting games or graphical animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72436—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for text messaging, e.g. short messaging services [SMS] or e-mails

Definitions

  • the present invention relates to performing a display in which characters and pictures are mixed.
  • Japanese Patent Publication No. 2007-47855 describes a technique for enabling display images to be switched according to conditions when displaying pictograms and realizing various expressions in pictograms.
  • the content analysis unit analyzes the content acquired by the content acquisition unit and extracts pictographic codes.
  • the pictogram determination unit has a pictogram code conversion table in which a condition set for each pictogram code is associated with a display image, and determines a display image that matches the condition according to the various set conditions. For example, when the weather information of the received news content is clear, the pictograph determination unit determines a clear mark as a display image corresponding to the pictograph code, and determines that it is an umbrella mark when the weather information is rainy.
  • the determined display image is laid out at a predetermined position and displayed on the screen by the display unit.
  • a pictogram (Pictorial symbol, Picture writing, Pictograph) is typically a character that expresses a word in a simple picture, a thing that expresses a word in a simple picture, and substitutes the explanation in words, It is said that a picture can be put in between and play in place of characters.
  • a picture can be put in between and play in place of characters.
  • it is easier to grasp the meaning at a glance and to convey emotion more easily by using pictures or making information mixed with pictures.
  • it is more enjoyable to receive e-mails with mixed pictures than to receive e-mails with text only.
  • One aspect of the present invention is a system (apparatus) including a generating device (generator) that generates mixed information including textual text information including at least one sentence and picture information randomly selected for the text information. It is. Once the information to be expressed is produced as original text by character information by the system having this generating device, it is possible to obtain mixed information in which picture information decorating the character information is selected at random with respect to the text information of the original text. . Therefore, it is possible to reduce the work of selecting a pictogram each time a word is entered, and to generate a sentence with a picture in a short time. Furthermore, picture information that decorates the character information is selected at random, so that it is possible to enjoy making and seeing what kind of picture is included in the text. Furthermore, since the picture information that decorates the character information is selected at random, a sentence containing an unexpected picture that the user does not normally select can be created.
  • the generation device of this system includes a function of randomly selecting picture information for the text information of the original text each time a generation instruction is received. Since the picture information decorating the character information is selected at random, every time a generation instruction is given, there is a high possibility that a sentence containing a different picture will be generated. Therefore, the user can enjoy the generation of sentences containing different pictures for the same original sentence. Furthermore, the user can repeat the generation of the mixed information as many times as necessary only by issuing a generation instruction until a sentence including a favorite picture is generated for the same original sentence.
  • this generation device can select picture information randomly in units of sentences, phrases, and words. That is, a plurality of picture information pieces can be associated in advance with one character information piece corresponding to any of sentences, phrases, and words.
  • the generation device has a function of randomly selecting one of a plurality of picture information pieces corresponding to at least one character information piece included in the original text, and the character information piece to be decorated of the selected picture information piece is selected. And a function of generating hybrid information including information for displaying the decoration by the picture information piece.
  • the generation device includes a function of searching for the longest match character information piece included in the picture information dictionary from the original text and making it a character information piece to be decorated. This function makes it easy to automatically recognize characters that should be decorated with a single kanji character, items that should be decorated with multiple-character idioms, items that should be decorated with simple words, items that should be decorated with compound words, character names and names, etc. It is easy to randomly select picture information pieces suitable for.
  • This system preferably further includes a learning unit for adding a combination of character information pieces and picture information pieces included in the hybrid information to the picture information dictionary.
  • a combination of character information pieces and picture information pieces created or received by the user can be included as one of the random selections.
  • Typical picture information pieces include a picture added before or behind the character information piece to be decorated, a picture to be replaced with the character information piece to be decorated, and the upper or lower line of the character information piece to be decorated. And font information for changing the shape, color and / or size of the font of the character information piece to be decorated.
  • the generation device aggregates the judgment values of multiple types of emotions of multiple text information pieces contained in one sentence, and sets the emotion type of the sentence as a unit of sentences for each sentence of the original sentence, original sentence or paragraph of the original sentence.
  • a function for judging, a function for randomly selecting one of a plurality of pieces of picture information corresponding to the emotion type of a sentence, and generating mixed information including information for displaying a sentence by displaying the selected piece of picture information Functions to be included.
  • the system has a dictionary (dictionary file, dictionary library) including a plurality of character information pieces and a plurality of types of emotion judgment values associated with each of the plurality of character information pieces.
  • the dictionary may include a plurality of picture information pieces associated with respective types of emotions.
  • the generation device includes a function of performing a longest match search on character information pieces included in the picture information dictionary from the original text to obtain character information pieces to be counted. It is easy to distinguish between the case of giving emotional meaning with a single character and the case of giving emotional meaning with a plurality of characters, and it is possible to randomly select a piece of picture information that more closely matches the meaning of the sentence.
  • Typical examples of such picture information pieces include a picture expressing a predetermined emotion displayed at the end of the sentence, a decorative image added to the upper or lower line of the sentence, and the font shape, color and / or of the sentence. List font information that changes the size.
  • the generation device includes a function for limiting the information amount of randomly selected picture information.
  • the generation device may include a function of thinning out randomly selected picture information pieces when an area required for displaying the hybrid information does not fit in a preset display range.
  • the generation device further includes a function of selecting at least one overall decoration pattern from a plurality of types of overall decoration patterns and generating hybrid information including display by the selected overall decoration pattern.
  • the overall decoration pattern include a background display, a font, a fixed line displayed at the end of a sentence or a paragraph, and a user's own display.
  • the generation device includes a function for generating hybrid information as image information.
  • generating mixed information including picture information as image information such as GIF even when resources such as the font intended by the sender are not prepared at the recipient, Accordingly, display including picture information can be performed.
  • This system preferably further includes an output unit for switching and displaying character information and hybrid information on the display.
  • the system preferably further includes an input unit for inputting character information and a transmission unit for transmitting the hybrid information via a computer network. It is desirable that the transmission unit transmits the hybrid information according to a protocol for transmitting and receiving electronic mail.
  • One further aspect of the present invention is a method comprising the following steps. 1.
  • An information terminal including a CPU and a memory randomly selects picture information based on textual text information including at least one sentence. 2.
  • Generating hybrid information including character information and randomly selected picture information.
  • This method can generate mixed information including original text information including at least one sentence and picture information randomly selected for the text information, and can provide the generated information.
  • the above random selection includes randomly selecting picture information for the original text information each time a generation instruction is received.
  • a plurality of picture information pieces can be associated in advance with one character information piece corresponding to any of sentences, phrases and words.
  • the randomly selecting includes randomly selecting one of a plurality of picture information pieces corresponding to at least one character information piece included in the original text, and the generating is selecting It is desirable to include generating mixed information including information for displaying the character information piece to be decorated of the displayed picture information piece with the selected picture information piece.
  • the above random selection uses a picture information dictionary including a plurality of character information pieces and a plurality of picture information pieces associated with each of the plurality of character information pieces, and is included in the picture information dictionary from the original text. It is further preferable that the longest matching search is performed on the character information pieces to obtain character information pieces to be decorated.
  • This method preferably further comprises the following steps. 3.
  • the information terminal adds a combination of character information pieces and picture information pieces included in the hybrid information to the picture information dictionary.
  • a learning function can be provided.
  • a plurality of types of emotion judgment values are associated in advance with one character information piece corresponding to any of sentences, phrases, and words, and a plurality of picture information pieces are associated in advance with each type of the plurality of types of emotion. It is desirable to keep it.
  • the above random selection is based on the sentences for each original sentence, each sentence of the original sentence or each paragraph of the original sentence, and the judgment values of multiple types of emotions of a plurality of character information pieces included in one sentence are aggregated. Determining the emotional type of the sentence and randomly selecting one of a plurality of pieces of picture information corresponding to the emotional type of the sentence, wherein the generating includes selecting the sentence It is desirable to include generating hybrid information including information to be displayed in a decorative manner using the picture information pieces.
  • the above-mentioned random selection uses a dictionary including a plurality of character information pieces and a plurality of types of emotion judgment values associated with each of the plurality of character information pieces, from the original text to the picture information dictionary. It is desirable to include the longest match search for the included character information pieces to obtain character information pieces to be counted.
  • the method preferably further includes the following steps. 4). If the information terminal does not fit in the display range set in advance to display the mixed information, the picture information piece selected at random is thinned out. The data amount (information amount) of the hybrid information can be moderately suppressed.
  • the generation further includes selecting at least one overall decoration pattern from a plurality of types of overall decoration patterns and generating hybrid information including display by the selected overall decoration pattern.
  • the overall decoration pattern includes at least one of a background display, a font, a fixed line displayed at the end of a sentence or a paragraph, and a user's own display.
  • the above generation includes generating the hybrid information as image information.
  • Image information can be attached to an e-mail and transmitted.
  • the method preferably further includes the following steps. 5.
  • the information terminal shall switch and display the character information and the hybrid information on the display. 6). Enable to input text information. 7). Sending hybrid information according to a protocol for sending and receiving e-mail over a computer network.
  • the text information of the original text can be replaced to adjust the display by the hybrid information, and the completed hybrid information can be sent as an e-mail or attached to the e-mail.
  • One of the different aspects of the present invention is to randomly select picture information based on textual text information including at least one sentence, and to generate hybrid information including text information and randomly selected picture information.
  • a program program product having instructions to be executed by a computer.
  • This program or program product can be provided by being recorded on an appropriate recording medium such as a DVD.
  • the program or program product can be distributed or downloaded via a computer network such as the Internet.
  • This program preferably further has an instruction for the computer to add a combination of character information pieces and picture information pieces included in the hybrid information to the picture information dictionary.
  • the program further has an instruction for the computer to thin out randomly selected picture information pieces when the area required for displaying the hybrid information does not fall within a preset display range.
  • the program switches and displays the character information and the hybrid information on the display, enables the character information to be input, and transmits the hybrid information according to a protocol for sending and receiving electronic mail via the computer network. It is desirable to further have instructions for the computer to execute.
  • 3A is an example of an original text
  • FIG. 3B is an example of a pictographic document
  • FIG. 3C is a diagram illustrating a further different example of a pictographic document.
  • 4A shows an example of a character information library
  • FIG. 4C shows an example of an overall decoration library.
  • FIG. 1 shows a unit (pictogram document generator, pictogram document generator) that generates information (data to be displayed, hereinafter, hybrid information or pictogram document information) for displaying text in which characters and pictures are mixed or mixed.
  • FIG. 1 is a block diagram showing a schematic configuration of a system including
  • a character or character information is a representation of characters such as kanji, katakana, hiragana, and / or alphabet in Japanese, and representations represented by characters. This can be output to an output device such as a display.
  • the language is not limited to Japanese, and the character information includes information described by characters of each country for representing information in various languages as information that can be visually grasped.
  • the character information does not mean information based only on characters, and may include so-called pictograms in which characters and pictures are mixed.
  • a picture or picture information includes all information or variations that can be expressed on an output device such as a display, mainly an image output device, other than characters.
  • the picture or picture information can include graphics, photographs, colors, scaling, logos, fonts, movements, can be displayed with text, the text display itself can be decorated, and instead of text That can be displayed.
  • a sentence refers to a set of one or more sentences (sentences), and often includes letters, mails (including e-mails, and hereinafter, e-mails may be described as mails), documents, etc. Used interchangeably with document.
  • a sentence in which characters and pictures are mixed or mixed refers to a sentence in which at least a part of a plurality of characters included in the sentence is decorated (decorated) with picture information.
  • information for displaying a text in which characters and pictograms are mixed or mixed may be referred to as pictogram information.
  • the pictogram includes a word (sound form), and includes a thing or matter abstractly suggested using a picture.
  • pictograms include pictures, icons, and the like that are created using characters and symbols input by a computer.
  • a pictogram is a character that is colored, a character shape (font) is changed, a character size is changed, a still image or an animation image is displayed together with or instead of a character. Including things.
  • the system 1 shown in FIG. 1 is an information terminal including a CPU and a memory, and is typically a mobile phone.
  • the cellular phone 1 includes a display 2 serving as an output interface, a user interface 4 including a touch panel or keyboard 3 serving as an input interface, an operating system (OS) 5 that controls basic functions of the cellular phone 1, and an OS 5 Including the various functional units 6, 7, 8 and 10 operating above.
  • the keyboard 3 may include any of a numeric keypad, a jog dial, a multi selector, a cursor key, and the like.
  • FIG. 2 shows a typical hardware configuration of the system 1.
  • the system 1 includes a CPU 91 and a memory (storage) 92 that are computer resources, a communication unit 93 that is connected to a public telephone network or a computer network by wireless (wireless LAN), a touch panel 94 that also serves as a display 2, and a voice communication function ( An audio communication unit) 6, a camera function (camera unit) 7, and a position information acquisition function (position information acquisition unit, GPS) 8 are connected by an internal bus 99.
  • the touch panel 94 may cover all functions of the user interface 4, and may include a cursor key (keyboard) 3 in addition to the touch panel 94.
  • the function of the keyboard 3 may be provided by the touch panel 94.
  • the OS 5 and applications running on the OS 5 and various functions are provided as a program (program product) 95. Then, a program (program product) 95 stored in the storage 92 or a program module included in the program 95 is loaded into the CPU 91 at an appropriate timing, and the CPU 91 executes the program 95 to implement the function of the application.
  • the storage 92 can be composed of various recording media such as RAM, ROM, and flash memory, and provides recording areas such as the memory 18 and the library 70 described below.
  • Many mobile phones 1 include an e-mail client (e-mail client, e-mail software) 10 for sending and receiving e-mail (e-mail) as one of applications.
  • the mail client 10 includes a main body 11 and an add-on 12, and a pictographic document generator (generator) 50 is mounted on the mail client 10 as one of the add-ons 12.
  • the mail client main body 11 includes an editing unit 13 that allows the user of the mobile phone (mobile terminal) 1 to input and edit the mail text (original text) 19 using the display 2 and the keyboard 3, and a memory 18 that stores the original text 19 being edited.
  • the transmission / reception unit 15 also includes a function of receiving an electronic mail transmitted from the transmission source (receiving an incoming call).
  • the pictographic document generator 50 automatically converts the original text 19 in the memory 18 into information 59 (hereinafter referred to as a pictographic document including such information) for displaying a pictographic document in which character information and pictorial information are mixed. Is generated (converted) and stored in the memory 18.
  • a typical example of the pictographic document 59 is a document (data, information) in the MTML format.
  • the display unit 14 displays the pictographic document 59 on the display 2 instead of the original text 19.
  • the transmission / reception unit 15 transmits a mail including the pictographic document 59 to the destination. Therefore, the user can easily generate pictographic documents with various patterns.
  • 3 (a) to 3 (c) show how the original text is converted into a pictographic document.
  • a pictogram button 9d and an initial setting button 9e appear.
  • the pictogram button 9d is clicked, as shown in FIG. 3B, a pictorial information piece is randomly selected for the text information piece included in the original sentence 19, and a pictogram document 59a is generated and displayed.
  • picture information pieces are randomly selected for the character information pieces included in the original sentence 19, as shown in FIG.
  • a pictographic document 59b different from the pictographic document 59a of FIG. 3B is generated and displayed.
  • the confirm button 9b is clicked, the pictographic document 59b is confirmed and transmitted to the destination as mail or an attached file of mail.
  • the arrangement and function of the buttons 9a to 9c are merely examples, and are not limited.
  • the generator 50 includes functions (random selection function, random choice unit) 53 and 55 for selecting picture information at random.
  • the random selection functions 53 and 55 receive the generation instruction 51 for the generator 50 from the user interface 4, the random selection functions 53 and 55 randomly select the picture information for the text information of the original text 19.
  • the generation instruction 51 is output when the pictogram button 9d or the next candidate button 9f is operated, and the generator 50 randomly selects picture information and generates a new pictogram document (mixed information) 59 each time. .
  • the generation instruction 51 can be output by operating the next candidate button 9f or a pictogram button 9d described later. Therefore, the user operates the pictogram button 9d or the next candidate button 9f after completing the input of the entire mail text, so that the entire mail text is converted into the original text 19 into the pictogram document 59 in a batch, for example, with one click. It is possible to convert. Further, by operating the next candidate button 9f again, it is possible to convert the pictorial documents 59 to different pictographic documents 59 all at once. For this reason, it is possible to save the trouble of converting each word into a pictogram, and the user can generate a pictogram document very easily.
  • One of a plurality of functions for randomly selecting picture information refers to a dictionary (dictionary file, dictionary library) 70, and randomly selects one of a plurality of picture information pieces corresponding to character information pieces included in the original sentence 19.
  • a first functional unit to be selected (first random selection unit, random selection unit corresponding to characters) 53 is provided.
  • Each character information piece is a constituent element of a sentence included in the original sentence 19 and corresponds to one of a sentence, a phrase, and a word.
  • the generator 50 includes a random number generation unit 52, and the first random selection unit 53 receives random numbers from the random number generation unit 52 as needed.
  • the generator 50 includes a generation unit 60, and the generation unit 60 displays information for displaying the character information piece to be decorated of the picture information piece selected by the first random selection unit 53 with the selected picture information piece.
  • FIG. 4A shows an example of the character information library 71 included in the dictionary 70.
  • the character information library 71 includes various words (words, idioms, etc.), phrases, short sentences, etc. as the character information pieces 72.
  • a character information piece 72 one to be decorated with a single kanji character, one to be decorated with a idiom of multiple characters, one to be decorated with a simple word, one to be decorated with a compound word, last name, name, etc. You can register what should be decorated together.
  • the character information library 71 further includes at least one, and in many cases, a plurality of picture information pieces 73 for each character information piece 72.
  • the picture information piece 73 includes a picture (including a pictograph) added in front of or behind the character information piece 72 to be decorated, a picture (including a pictograph) to be replaced with the character information piece 72 to be decorated,
  • the decoration information added to the upper line or the lower line of the character information piece 72 and the font information for changing the font shape, color and / or size of the character information piece 72 to be decorated can be given.
  • the picture information piece 73 is not limited to these. Movement (temporal change) is applied to a picture (including pictograms) added in front of or behind the character information piece 72 to be decorated or a picture (including pictograms) to be replaced with the character information piece 72 to be decorated. Includes accompanying pictures and pictograms.
  • the first random selection unit 53 includes a function of searching the character information piece 72 and the original text 19 included in the character information library 71 for the longest match from the beginning of the original text 19 and selecting the character information piece 72 to be decorated. Further, the first random selection unit 53 randomly selects one of the plurality of picture information pieces 73 associated with the character information piece 72 to be decorated based on the random number obtained from the random number generation unit 52. Includes functionality. For example, one character information piece 72.1 includes a plurality of picture information pieces 73.1 to 73. n and the first random selection unit 53, when the longest match search is performed on the character information piece 72.1, the picture information pieces 73.1 to 73.n. Select one of n at random.
  • FIG. 5 shows an example of a pictographic document 59 using the influence of the longest match search.
  • the longest match search By performing the longest match search, one that should decorate a single Kanji character, one that should be decorated with multiple characters, one that should be decorated with simple words, one that should be decorated with compound words, one name, name, etc.
  • the power can be appropriately extracted from the original text 19.
  • the original text 19 of the last name 150 of the document is changed from “Kimura” to “Thu” and the space “Mura”.
  • the first random selection unit 53 performs the longest match search for “tree” and “village” instead of “kimura”.
  • a picture is added behind “Kimura”, but in the pictogram document 59 shown in FIG. 5, “tree” becomes the character information piece 72 to be decorated, A picture is added behind “tree”, “village” becomes a character information piece 72 to be decorated, and a picture is added after “village”. Furthermore, a picture that further interprets the sentence is added to the end of the sentence according to the type of emotion described below, which is interpreted as a sentence.
  • the character information piece 72 to be decorated included in the original text 19 is extracted from the character information piece 72 included in the dictionary 70 by the longest match search. Therefore, the words and phrases that the user has consciously input as a unit are identified as the unit character information piece 72. For this reason, without changing the meaning (contents and intentions) of the original sentence 19, the contents to be expressed by the original sentence 19 can be converted into the pictographic document 59. In addition, it is possible to control the decoration-target character information piece 72 by intentionally inserting a space into a word or phrase included in the original sentence 19, and it is possible to generate more variations of pictographic documents 59.
  • Another one of the plurality of functions for randomly selecting picture information is a third function for randomly selecting one of a plurality of picture information pieces corresponding to the sentence with the sentence included in the original text 19 as one unit.
  • the third functional unit 55 is a unit that randomly selects picture information pieces from emotions, and is hereinafter referred to as an emotion-corresponding random selection unit or a second random selection unit 55.
  • the generator 50 includes a function of defining emotion as a parameter for each sentence and determining the type of emotion corresponding to the sentence (sentence).
  • the function of determining the emotion type is provided by a functional unit (second functional unit, emotion selection unit) 54 that selects an emotion from a sentence.
  • the emotion selection unit 54 determines the emotion type for each sentence
  • the second random selection unit 55 randomly selects one of a plurality of picture information pieces prepared in advance corresponding to the determined emotion type. Including the function to perform.
  • emotion types are: Love (Type A), Joy (Type B), Surprised (Type C), Angry (Type D), Recessed (Depressed) (Type E), Sad (Type F) ), Lovable (type G), fun (type H), momentum (type I), troubled (type J), and funny (type K).
  • the character information library 71 of the dictionary 70 stores an appropriate value (emotion parameter) 74 for each emotion type with respect to the character information piece 72 such as a phrase or word constituting the sentence. Is set.
  • an emotion parameter 74.1 in which a value is set for each emotion type is set.
  • the emotion selection unit 54 includes a function of searching the character information piece 72 and the original sentence 19 included in the character information library 71 for the longest match from the head of the original sentence 19 and acquiring the emotion parameter 74 of the character information piece 72. Further, the emotion selection unit 54 aggregates the value of the emotion parameter 74 of the character information piece 72 included in the sentence for each sentence and assigns the type having the largest value among the emotion types A to K to the sentence. Includes the functions defined as
  • the emotion selection unit 54 can set a threshold value to be used for tabulation or set a magnification for each type of emotion, and can change specific settings by changing those settings in advance. Can be easily selected.
  • the emotion type may be determined randomly or the emotion type selected preferentially may be determined.
  • a plurality of picture information pieces 77 are set for one emotion type 76 in the emotion library 75 of the dictionary 70.
  • the picture information piece 77 for decorating the sentence a picture (including pictograms) expressing a predetermined emotion displayed at the end of the sentence, a decoration image added to the upper or lower line of the sentence, and the font shape of the sentence, Examples include font information that changes color and / or size.
  • the picture information piece 77 is not limited to the above.
  • the second random selection unit 55 randomly selects one of the plurality of picture information pieces 77 associated with the emotion type 76 determined by the emotion selection unit 54 based on the random number obtained from the random number generation unit 52. .
  • the generation unit 60 of the generator 50 has a function (mixed function, mixed unit) 61 for generating a pictographic document 59 including information for displaying each sentence with a picture information piece 77 selected by the second random selection unit 55. Including.
  • the generator 50 further includes an overall decoration unit 56 for selecting contents that decorate the entire original text 19 or the generated pictographic document 59.
  • an overall decoration unit 56 for selecting contents that decorate the entire original text 19 or the generated pictographic document 59.
  • one or a plurality of overall decoration patterns can be selected from a plurality of types of overall decoration patterns in the initial setting of the screen of FIG. Examples of the overall decoration pattern include a background display, a font, a definitive dialogue displayed at the end of a sentence or a paragraph, and a user's own display.
  • the overall decoration pattern is not limited to the above.
  • the overall decoration library 78 of the dictionary 70 includes an overall decoration item 79a and decoration contents (overall decoration pattern) 79b that can be selected for each item.
  • the user can select the entire decoration pattern 79b for each item with the initial setting button 9e.
  • a font that is one of the items 79 a to be entirely decorated indicates a font that is used uniformly throughout the pictographic document 59.
  • the font for overall decoration is one of the overall decoration patterns by registering the font purchased from the content provider by the user in the overall decoration library 78. You can choose as
  • “Background” which is another one of the items 79 a to be entirely decorated is an image, a picture, a photograph or the like displayed so as to overlap with the pictographic document 59, and includes a function of automatic editing so as not to overlap the pictographic document 59. Also good.
  • the user can also register photos taken by the user, user-created pictures, backgrounds purchased from content providers, etc. in the general decoration library 78, or refer to the user's picture file It can be selected as one of the overall decoration patterns.
  • FIG. 6 shows an output of the pictographic document 59 generated by selecting the background with New Year's theme and the font of the line book as the overall decoration pattern 79b.
  • the next candidate button 9f By pressing the next candidate button 9f, the use of the background and line font is not changed, but a pictographic document 59 with a different picture or the like displayed in the sentence and / or at the end of the sentence is generated and displayed on the display 2. .
  • the “decision line”, which is another one of the items 79a to be entirely decorated, is a sentence added to the end of the pictographic document 59 in many cases, and is a line used in movies, animations, games, and the like. For example, you can add words like "force together " or "I'm not very lucky " as a signature at the end of the email or separately from the signature.
  • the deciding dialogue is also created by registering the deciding dialogue or the like that the user makes by himself or purchased from the content provider in the entire ornament library 78. Can be selected as one.
  • the hybrid unit 61 of the generation unit 60 includes a function of generating a pictographic document 59 including a display with an overall decoration pattern selected by the overall decoration unit 56.
  • the generation unit 60 includes a function unit (restriction unit) 62 that reduces or restricts the information amount of the pictographic document 59 in addition to the hybrid unit 61 that generates the pictographic document 59 in this way.
  • a function unit restriction unit
  • the amount of information of the pictographic document 59 which is mixed information, exceeds the display range, for example, the display range of the display 2. If the display range of the display 2 is exceeded, it becomes difficult for the receiver to recognize the pictographic mail with a sense of unity as a whole. Furthermore, there is a possibility that the amount of data that can be transmitted by e-mail will be exceeded.
  • the restriction unit 62 obtains a random number from the random number generation unit 52, randomly selects the picture information pieces 73 and / or 77 included in the pictographic document 59, thins out (deletes) the selected picture information pieces, A function for limiting the information amount of the pictographic document 59 so as to be within the preset data amount is included. Therefore, the generation unit 60 can add randomly selected picture information and can limit the amount of information of the added picture information. Further, since the character information of the original text 19 is not reduced, the contents of the original text 19 are not affected. Further, whether or not to limit the information amount of the pictographic document 59 can be set using an initial setting menu.
  • the generation unit 60 further includes a functional unit (imaging unit) 63 that converts the pictographic document 59, which is mixed information, into an image file.
  • the imaging unit 63 includes a function of rendering a pictographic document 59 and generating a pictographic document 59 of image data (image file) according to a predetermined standard such as GIF or JPEG.
  • a functional unit such as GIF or JPEG.
  • the pictographic document 59 includes a motion (temporal change)
  • the pictographic document 59 of image data using a function such as GIF animation or motion JPEG is generated.
  • the generator 50 can generate a pictographic document 59 using decoration elements (whole decoration patterns) such as fonts and backgrounds purchased from a content provider or the like.
  • decoration elements whole decoration patterns
  • the font selected by the user is not necessarily included in the terminal that receives the mail, and it is difficult to transmit the purchased font together with the pictographic document 59.
  • the generator 50 further includes a learning unit 57 that adds a combination of the character information piece 72 and the picture information piece 73 included in the pictographic document 59 to the character information library 71 of the dictionary 70.
  • the learning unit 57 searches the character information piece included in the text information of the received or self-made pictographic document 59 based on the character information piece 72 registered in the character information library 71 and searches for the searched character.
  • a picture information piece 73 corresponding to the information piece 72 is added to the character information library 71.
  • the learning unit 57 further registers the background and the determined dialogue included in the received or self-made pictographic document 59 in the general decoration library 78 of the dictionary 70.
  • the learning unit 57 can also create a new user dictionary separately from the dictionary 70, and register the newly registered character information piece 72, picture information piece 73, and overall decoration pattern 79b in the user dictionary. Furthermore, it is possible to set the first random selection unit 53 so as to search the contents of the user dictionary in preference to the dictionary 70. Thereby, the probability of the picture information piece 73 selected at random with respect to the character information piece 72 can be set so that the user dictionary has priority.
  • the generator 50 each time the pictograph button 9d or the next candidate button 9f is operated and the generation instruction 51 is received, the character information of the original sentence 19 and the character information of the original sentence 19 are selected at random.
  • a pictographic document (mixed information) 59 including the generated picture information is generated.
  • the character information of the original text 19 and the pictographic document 59 can be switched and displayed on the display 2 by the display unit (output unit) 14.
  • the user can correct the text information of the original text 19 at any time by the editing unit (input unit) 13.
  • the confirmation button 9b is operated, the pictographic document 59 is transmitted via the transmission / reception unit (transmission unit) 15 in accordance with a protocol for transmitting / receiving electronic mail.
  • FIG. 7 shows the operation of the e-mail client 10 using a flowchart.
  • step 301 the original text 19 is input using the editing unit 13.
  • step 302 when the pictogram button 9d is selected from the menu button 9a in step 302, a generation instruction 51 is issued in step 303 to start the generator 50 and generate a pictographic document 59. If not converted to pictograms, the original text 19 is output as an e-mail via the transmission / reception unit 15 in step 306.
  • FIG. 8 shows the operation of the generator 50 using a flowchart.
  • generation instruction 51 is received in step 307
  • generation of the pictographic document 59 is started.
  • menu button 9a is selected in step 308
  • initialization is performed in step 309.
  • the overall decoration unit 56 is called in the initial setting menu
  • the overall decoration pattern is set.
  • the learning unit 57 is called in the initial setting menu, the contents of the dictionary 70 are updated.
  • step 311 the first random selection unit 53 searches the sentence of the original sentence 19 for the longest match based on the character information pieces 72 registered in the character information library 71 of the dictionary 70.
  • the first random selection unit 53 extracts the character information piece that has the longest match with the character information piece 72 registered in the character information library 71 as the character information piece 72 to be decorated.
  • step 312 the first random selection unit 53 randomly selects one of the plurality of picture information pieces 73 set in the character information piece 72 to be decorated.
  • the first random selection unit 53 repeats Steps 311 and 312 until the sentence of the original sentence 19 ends (Step 313).
  • Step 321 the emotion selection unit 54 searches for the sentence of the original sentence 19 based on the character information piece 72 registered in the character information library 71 of the dictionary 70.
  • the emotion parameter 74 is acquired.
  • the emotion selection unit 54 totals the emotion parameters 74 for each sentence and determines an emotion type 76 for each sentence.
  • the second random selection unit 55 randomly selects the picture information piece 77 of the emotion type determined for each sentence. Steps 321, 322 and 323 are repeated until the sentence of the original sentence 19 ends (step 324).
  • the generating unit 60 When the pictorial information pieces 73 and 77 are selected in this way, the generating unit 60 generates (mixes) the pictographic document 59 in step 330, and the generated pictographic document 59 is displayed on the display 2 in step 331. . In step 330, if the information amount of the generated pictographic document 59 is excessive, the picture information randomly selected by the restriction unit 62 is thinned out and the information amount is reduced.
  • FIG. 9 and FIG. 10 show how the decoration target character information piece 72 and the picture information piece 73 are extracted from the original sentence 19.
  • FIG. 9 shows a sentence of the original sentence 19.
  • the first sentence (sentence) 100 includes words 101 and 102 which are character information pieces 72.
  • the next sentence 110 includes words 111, 112 and 113.
  • the next sentence 120 includes words 121, 122 and 123.
  • the next sentence 130 includes words 131 and 132.
  • the next sentence 140 includes the word 141.
  • the last sentence 150 includes a word 151 indicating the name.
  • FIG. 10 shows a display of a pictographic document 59a which is an example of the generated pictographic document 59.
  • a plurality of picture information pieces 73 are set in the word 101, which is the character information piece 72 of the first sentence 100, and the back picture 201 is selected from among them, and the word 101 is used as a decoration target and behind it.
  • a picture 201 is additionally displayed. That is, the word 101 is displayed as a decoration by the picture 201.
  • the word 102 is to be decorated and displayed in a decorative manner by a picture 202 which is one of the picture information pieces 73 behind the word 102.
  • a picture 200 which is one of the picture information pieces 77 randomly selected via the emotion type 76, is additionally displayed at the end of the sentence and displayed in a decorative manner.
  • the word 111 is displayed as a decoration object, the picture information piece 73 for enlarging the font is selected, and the word 111 is enlarged and displayed 211, so that the word 111 is displayed as a decoration.
  • the word 112 becomes a decoration target, and a picture 212 which is one of the picture information pieces 73 is added behind the word 112 and displayed as a decoration.
  • the word 113 becomes a decoration target, and a picture 213 which is one of the picture information pieces 73 is added above (upper row) and displayed as a decoration.
  • the picture information piece 77 via the emotion type 76 is not selected, or an information piece that does not display a picture is selected, and the decoration based on the picture information piece for the whole is seen in the sentence 110. Absent. There is a possibility that the sentiment selection unit 54 interprets the sentence as being integrated with the next sentence 120 or 130.
  • the word 121 is not a decoration target. That is, the character information piece 72 corresponding to the word 121 is not registered in the character information library 71, and the word 121 is not decorated.
  • the word 122 is to be decorated, and a picture 222, which is one of the picture information pieces 73, is added behind the word 122 and displayed as a decoration.
  • the word 123 is not an object to be decorated, and a picture 220 which is one of the picture information pieces 77 selected via the emotion type 76 is added to the back of the sentence 120 and displayed in a decorative manner.
  • the word 131 is not a decoration object, or no picture information piece is selected, and no picture information piece is selected for the word 132. Thus, words 131 and 132 are not decorated.
  • a picture 230 which is one of the picture information pieces 77 selected through the emotion type 76 is displayed.
  • the sentence 140 has a word 141 as a decoration object, and a picture 241 is displayed thereafter. Further, a picture 240 that is one of the picture information pieces 77 selected through the emotion type 76 is displayed behind the picture.
  • the word 151 is a decoration object, and then a picture 251 as one of the picture information pieces 73 is added and displayed as a decoration.
  • the picture information for the entire sentence 150 is not selected.
  • the pictographic document 59a shown in FIG. 10 is an example of the pictographic document 59 mixed from the original text 19, and some other examples are shown in FIG. 3 (c) and FIG.
  • step 304 If the cancel button 9c is selected in step 304 after the pictogram document 59 is displayed in step 331, the process returns to the original text input in step 301.
  • the confirmation button 9b is selected in step 305, the displayed pictographic document 59 is determined as a transmission target.
  • step 305 when the next candidate button 9f is selected instead of the confirmation button 9b, the process returns to step 307, the generation instruction 51 is received by the generator 50, and the process of generating the new pictogram document 59 as described above is started. To do.
  • step 335 it is determined in step 335 whether or not imaging is necessary. If imaging is unnecessary, the pictographic document 59 is stored in the memory 18 as an HTML document in step 336. On the other hand, if imaging is necessary, image data such as GIF data is generated by the imaging unit 63 in step 337 and stored in the memory 18 as a pictographic document 59.
  • the program (program product, software) 95 can be provided by being recorded on an appropriate recording medium, or can be provided via a computer network such as the Internet or other communication.
  • the mail client 10 including the generator 50 can also be provided, It is also possible to provide document generation software including the generator 50 and a portable terminal including the generator 50. Therefore, the system in the claims may be a software package supplied as an add-on to a mail client, a mail client, document generation software, a portable terminal, and the like. Also good.
  • the above description is based on the mail client 10 mounted on a mobile terminal such as a mobile phone.
  • the description is not limited to the mobile terminal, and any information processing apparatus having a function capable of generating a document will be described above. With this function, anyone can easily create an emoji document.
  • the original text and pictographic document are not limited to those transmitted and received by e-mail, and the present invention can be applied to any software that generates a document with a word processor or the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Human Computer Interaction (AREA)
  • Information Transfer Between Computers (AREA)
  • Document Processing Apparatus (AREA)
  • Telephone Function (AREA)

Abstract

L'invention porte sur un téléphone mobile (1) qui comporte un générateur (50) afin de générer un texte en pictogrammes (59) dans lequel sont mélangées des informations de caractères d'un texte original (19) et des informations d'images sélectionnées aléatoirement par rapport aux informations de caractères. Le générateur (50), lors de la réception d'une instruction de génération (51), sélectionne chaque fois aléatoirement des informations d'images correspondant aux informations de caractères du texte original (19) et génère automatiquement un nouveau document en pictogrammes (59). Ainsi, un utilisateur peut générer facilement un document en pictogrammes (59) de différentes configurations.
PCT/JP2011/000166 2010-01-18 2011-01-14 Système de génération d'informations exécutant affichage de caractères et d'images entremêlés WO2011086939A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
KR1020127019975A KR20120123381A (ko) 2010-01-18 2011-01-14 문자 및 그림을 혼합하여 표시하는 정보를 생성하는 시스템
CN201180006449.3A CN102713872B (zh) 2010-01-18 2011-01-14 生成混合显示文字和图画的信息的系统
JP2011549948A JP5767590B2 (ja) 2010-01-18 2011-01-14 文字および絵が混ざり合った表示をする情報を生成するシステム

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2010008265 2010-01-18
JP2010-008265 2010-01-18

Publications (1)

Publication Number Publication Date
WO2011086939A1 true WO2011086939A1 (fr) 2011-07-21

Family

ID=44304214

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2011/000166 WO2011086939A1 (fr) 2010-01-18 2011-01-14 Système de génération d'informations exécutant affichage de caractères et d'images entremêlés

Country Status (4)

Country Link
JP (1) JP5767590B2 (fr)
KR (1) KR20120123381A (fr)
CN (1) CN102713872B (fr)
WO (1) WO2011086939A1 (fr)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101490009B1 (ko) * 2013-01-23 2015-02-04 박재현 디스플레이 장치에서 표시된 문자의 색상 변경 장치 및 방법
JP2015036886A (ja) * 2013-08-13 2015-02-23 ソニー株式会社 情報処理装置、記憶媒体、および方法
KR101628930B1 (ko) * 2014-07-30 2016-06-09 경북대학교 산학협력단 디스플레이 장치 및 그 제어 방법
WO2016079868A1 (fr) * 2014-11-21 2016-05-26 楽天株式会社 Dispositif, procédé, et programme de traitement d'informations
HK1201022A2 (en) 2014-12-10 2015-08-14 Concept Infinity Ltd Method and system for personalized text and illustration creation
CN106909547B (zh) * 2015-12-22 2020-09-04 北京奇虎科技有限公司 基于浏览器的图片加载方法及装置
CN115080172A (zh) * 2022-07-20 2022-09-20 灵智信息服务（深圳）有限公司 图文数据集的浏览方法、计算机设备、存储介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11259218A (ja) * 1998-03-13 1999-09-24 Akira Ito 文章の一部にイラストを挿入する文章作成方法、およびその文章作成装置、並びに文章の一部にイラストを挿入するプログラム記憶媒体
JP2002230011A (ja) * 2001-02-05 2002-08-16 Seiko Epson Corp 感情認識システム
JP2004096355A (ja) * 2002-08-30 2004-03-25 Sharp Corp メール送信サーバ、メール送信端末、メール送受信システム、およびメール送信方法
JP2006185426A (ja) * 2004-12-02 2006-07-13 Nec Corp Ｈｔｍｌメール生成システム、通信装置、ｈｔｍｌメール生成方法、及び記録媒体
JP2007148939A (ja) * 2005-11-29 2007-06-14 Kyocera Corp 通信機器及び通信方法
JP2007200159A (ja) * 2006-01-30 2007-08-09 Nec Corp メッセージ作成支援方法及び携帯端末
JP2008129687A (ja) * 2006-11-17 2008-06-05 Nec Saitama Ltd 特殊文字入力支援装置及びこれを備える電子機器

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0696056A (ja) * 1992-09-11 1994-04-08 Hitachi Ltd 文字入力装置
GB2383660A (en) * 2001-11-02 2003-07-02 Superscape Ltd System for graphic/text messaging
JP2003223181A (ja) * 2002-01-29 2003-08-08 Yamaha Corp 文字−音声変換装置およびそれを用いた携帯端末装置
JP2005222431A (ja) * 2004-02-09 2005-08-18 Fuji Xerox Co Ltd 共同作業システム
EP1667031A3 (fr) * 2004-12-02 2009-01-14 NEC Corporation Création de courrier électronique HTML

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11259218A (ja) * 1998-03-13 1999-09-24 Akira Ito 文章の一部にイラストを挿入する文章作成方法、およびその文章作成装置、並びに文章の一部にイラストを挿入するプログラム記憶媒体
JP2002230011A (ja) * 2001-02-05 2002-08-16 Seiko Epson Corp 感情認識システム
JP2004096355A (ja) * 2002-08-30 2004-03-25 Sharp Corp メール送信サーバ、メール送信端末、メール送受信システム、およびメール送信方法
JP2006185426A (ja) * 2004-12-02 2006-07-13 Nec Corp Ｈｔｍｌメール生成システム、通信装置、ｈｔｍｌメール生成方法、及び記録媒体
JP2007148939A (ja) * 2005-11-29 2007-06-14 Kyocera Corp 通信機器及び通信方法
JP2007200159A (ja) * 2006-01-30 2007-08-09 Nec Corp メッセージ作成支援方法及び携帯端末
JP2008129687A (ja) * 2006-11-17 2008-06-05 Nec Saitama Ltd 特殊文字入力支援装置及びこれを備える電子機器

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"Acrodea no 'Emoji Lite®' to 'VIVID Panorama ' ga NTT Docomo no 2009 Nendo Toshun Model 'docomo PRIME seriesTM SH-01B' (Sharp Sei) ni Tosai sare Hatsubai Kaishi", 20 November 2009 (2009-11-20), Retrieved from the Internet <URL:http://www.acrodea.co.jp/press/2009/20091120/index.html> [retrieved on 20110203] *

Also Published As

Publication number Publication date
JP5767590B2 (ja) 2015-08-19
KR20120123381A (ko) 2012-11-08
JPWO2011086939A1 (ja) 2013-05-20
CN102713872B (zh) 2016-03-23
CN102713872A (zh) 2012-10-03

Similar Documents

Publication Publication Date Title
JP5767590B2 (ja) 文字および絵が混ざり合った表示をする情報を生成するシステム
JP5097198B2 (ja) テキスト文書に画像アーティファクトを挿入する装置および方法
US10289654B2 (en) Smart variable expressive text or graphics for electronic communications
US7343561B1 (en) Method and apparatus for message display
JP2008527563A (ja) アイコニック通信
WO2006019639A2 (fr) Utilisation d&#39;emoticones pour dispositifs sans fil
EP1977312A2 (fr) Communication iconique
JP2005196780A (ja) 携帯端末機でアバターを用いたメッセージ処理装置及び方法
KR20120120189A (ko) 융통성 있는 폰트
WO2008071099A1 (fr) Procédé et système permettant d&#39;entrer un mot/diagramme artistique dans un programme d&#39;application
JP2004088335A (ja) メールサーバ、そのメールサーバを実現するためのプログラム及び携帯端末
JP4072900B2 (ja) 端末装置
JP2001209488A (ja) 情報入力装置及び情報入力プログラムを記録した記録媒体
JP4643054B2 (ja) 文字及び顔文字から成る文章を入力する装置
TW200913579A (en) Instant message system having personification object and method thereof
JP4586063B2 (ja) 端末装置
KR20190134080A (ko) 채팅 서비스 제공 장치
JP2019050049A (ja) 感情テキスト表示プログラム、方法およびシステム
KR20200073496A (ko) 채팅 서비스를 제공하기 위한 사용자 단말기
JP2007219940A (ja) メニュー制御装置、携帯電話、およびメニュー制御装置用プログラム
JP2011165046A (ja) 返信メール作成装置および返信メール作成方法
KR20190134082A (ko) 채팅 서비스 제공 방법
KR20030045223A (ko) 캐릭터 이미지 생성방법, 출력방법 및 출력시스템
JP4970164B2 (ja) 電子機器、電子メール作成時の変換候補表示方法、および変換候補表示プログラム
KR20190134049A (ko) 채팅 서비스를 제공하기 위한 사용자 단말기

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201180006449.3

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 2011549948

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 20127019975

Country of ref document: KR

Kind code of ref document: A

122 Ep: pct application non-entry in european phase

Ref document number: 11732811

Country of ref document: EP

Kind code of ref document: A1