JP5767590B2 - A system that generates information that displays a mixture of text and pictures - Google Patents

Description

  The present invention relates to performing a display in which characters and pictures are mixed.

  Japanese Patent Publication No. 2007-47855 describes a technique for enabling display images to be switched according to conditions when displaying pictograms and realizing various expressions in pictograms. . In the technique according to Patent Literature 1, the content analysis unit analyzes the content acquired by the content acquisition unit and extracts pictographic codes. The pictogram determination unit has a pictogram code conversion table in which a condition set for each pictogram code is associated with a display image, and determines a display image that matches the condition according to the various set conditions. For example, when the weather information of the received news content is clear, the pictograph determination unit determines a clear mark as a display image corresponding to the pictograph code, and determines that it is an umbrella mark when the weather information is rainy. The determined display image is laid out at a predetermined position and displayed on the screen by the display unit.

  A pictorial symbol (Pictorial symbol, Picture writing, Pictograph) is typically a character that expresses a word in a simple picture, a thing that expresses a word in a simple picture, and is used as a substitute for an explanation in words. It is said that a picture can be put in between and play in place of characters. Compared to text-only information, there is an advantage that it is easier to grasp the meaning at a glance and to convey emotion more easily by using pictures or making information mixed with pictures. In addition, there is an advantage that it is more enjoyable to receive e-mails with mixed pictures than to receive e-mails with text only. In addition, I enjoy the creation of emails with mixed pictures.

  On the other hand, it may be burdensome for the user to select a picture suitable for the information to be conveyed from a large number of pictures. Therefore, it is desired that many users can easily create pictographs or sentences containing pictographs.

  One aspect of the present invention is a system (apparatus) including a generating device (generator) that generates mixed information including textual text information including at least one sentence and picture information randomly selected for the text information. It is. Once the information to be expressed is produced as original text by character information by the system having this generating device, it is possible to obtain mixed information in which picture information decorating the character information is selected at random with respect to the text information of the original text. . Therefore, it is possible to reduce the work of selecting a pictogram each time a word is entered, and to generate a sentence with a picture in a short time. Furthermore, picture information that decorates the character information is selected at random, so that it is possible to enjoy making and seeing what kind of picture is included in the text. Furthermore, since the picture information that decorates the character information is selected at random, a sentence containing an unexpected picture that the user does not normally select can be created.

Generator of this system receives the generation instruction, each time, including the ability to select a picture information for the character information of the original random. Since the picture information decorating the character information is selected at random, every time a generation instruction is given, there is a high possibility that a sentence containing a different picture will be generated. Therefore, the user can enjoy the generation of sentences containing different pictures for the same original sentence. Furthermore, the user can repeat the generation of the mixed information as many times as necessary only by issuing a generation instruction until a sentence including a favorite picture is generated for the same original sentence.

Furthermore, this generation apparatus can select picture information at random in units of sentences, phrases, and words. That is, a plurality of picture information pieces can be associated in advance with one character information piece corresponding to any of sentences, phrases, and words. The generation device has a function of randomly selecting one of a plurality of picture information pieces corresponding to at least one character information piece included in the original text, and the character information piece to be decorated of the selected picture information piece is selected. including a function of generating a hybrid information by picture information pieces including information for decorative display was.

Further have a picture information dictionary containing a plurality of character information piece, and a plurality of picture information pieces associated with each of a plurality of character information pieces. Generator from original, then the longest match search character information pieces included in the picture information dictionary, including the function of the character information piece decorative object. This function makes it easy to automatically recognize characters that should be decorated with a single kanji character, items that should be decorated with multiple-character idioms, items that should be decorated with simple words, items that should be decorated with compound words, character names and names, etc. It is easy to randomly select picture information pieces suitable for.

  The system preferably further includes a learning unit that adds a combination of character information pieces and picture information pieces included in the hybrid information to the picture information dictionary. A combination of character information pieces and picture information pieces created or received by the user can be included as one of the random selections.

  Typical picture information pieces include a picture added before or behind the character information piece to be decorated, a picture to be replaced with the character information piece to be decorated, and the upper or lower line of the character information piece to be decorated. And font information for changing the shape, color and / or size of the font of the character information piece to be decorated.

  The entire original text, the sentence of the original text, or the paragraph of the original text can be set as one unit (sentence), and picture information can be selected at random in that unit. That is, a plurality of types of emotion determination values are associated in advance with one character information piece corresponding to one of sentences, phrases, and words, and a plurality of picture information pieces are previously associated with each type of the plurality of types of emotion. Can be associated. The generation device aggregates the judgment values of multiple types of emotions of multiple text information pieces contained in one sentence, and sets the emotion type of the sentence as a unit of sentences for each sentence of the original sentence, original sentence or paragraph of the original sentence. A function for judging, a function for randomly selecting one of a plurality of pieces of picture information corresponding to the emotion type of a sentence, and generating mixed information including information for displaying a sentence by displaying the selected piece of picture information Functions to be included.

  The system preferably includes a dictionary (dictionary file, dictionary library) including a plurality of character information pieces and a plurality of types of emotion judgment values associated with each of the plurality of character information pieces. The dictionary may include a plurality of picture information pieces associated with respective types of emotions. It is desirable that the generation device includes a function of performing a longest match search on character information pieces included in the picture information dictionary from the original text to obtain character information pieces to be counted. It is easy to distinguish between the case of giving emotional meaning with a single character and the case of giving emotional meaning with a plurality of characters, and it is possible to randomly select a piece of picture information that more closely matches the meaning of the sentence.

  Typical examples of such picture information pieces include a picture expressing a predetermined emotion displayed at the end of the sentence, a decorative image added to the upper or lower line of the sentence, and the font shape, color and / or of the sentence. List font information that changes the size.

  If picture information is randomly added to the character information, there is a risk that the amount of the mixed information exceeds the display range. Therefore, it is desirable that the generation device includes a function for limiting the information amount of randomly selected picture information. The generation device may include a function of thinning out randomly selected picture information pieces when an area required for displaying the hybrid information does not fit in a preset display range.

  The generation device preferably further includes a function of selecting at least one overall decoration pattern from a plurality of types of overall decoration patterns and generating hybrid information including display by the selected overall decoration pattern. Typical examples of the overall decoration pattern include a background display, a font, a fixed line displayed at the end of a sentence or a paragraph, and a user's own display.

  Furthermore, it is desirable that the generation device includes a function for generating the hybrid information as image information. By generating mixed information including picture information as image information such as GIF, even when resources such as the font intended by the sender are not prepared at the recipient, Accordingly, display including picture information can be performed.

  It is desirable that the system further includes an output unit that switches and displays the character information and the hybrid information on the display. The system preferably further includes an input unit for inputting character information and a transmission unit for transmitting the hybrid information via a computer network. It is desirable that the transmission unit transmits the hybrid information according to a protocol for transmitting and receiving electronic mail.

One further aspect of the present invention is a method comprising the following steps.
1. An information terminal including a CPU and a memory randomly selects picture information based on textual text information including at least one sentence.
2. Generating hybrid information including character information and randomly selected picture information.

  By this method, it is possible to generate hybrid information including text information of the original text including at least one sentence and picture information randomly selected for the text information, and the generated information can be provided.

Selecting the above random receives the generation instruction, each time, including the selection of picture information for the character information of the original random.

It is possible to associate a plurality of picture information pieces in advance with one character information piece corresponding to any of sentences, phrases and words. In this case, the randomly selecting includes randomly selecting one of a plurality of picture information pieces corresponding to at least one character information piece included in the original text, and the generating is selecting including generating a hybrid information including information for decoration displayed by picture information piece selected character information pieces decoration object by painting information pieces.

The above random selection uses a picture information dictionary including a plurality of character information pieces and a plurality of picture information pieces associated with each of the plurality of character information pieces, and is included in the picture information dictionary from the original text. including the fact that the character information piece longest match search, and character information piece of decorative object.

This method preferably further comprises the following steps.
3. The information terminal adds a combination of character information pieces and picture information pieces included in the hybrid information to the picture information dictionary. A learning function can be provided.

  In addition, a plurality of types of emotion judgment values are associated in advance with one character information piece corresponding to any of sentences, phrases, and words, and a plurality of picture information pieces are associated in advance with each type of the plurality of types of emotion. It is desirable to keep it. In this case, the above random selection is based on the sentences for each original sentence, each sentence of the original sentence or each paragraph of the original sentence, and the judgment values of multiple types of emotions of a plurality of character information pieces included in one sentence are aggregated. Determining the emotional type of the sentence and randomly selecting one of a plurality of pieces of picture information corresponding to the emotional type of the sentence, wherein the generating includes selecting the sentence It is desirable to include generating hybrid information including information to be displayed in a decorative manner using the picture information pieces.

  Furthermore, the above-mentioned random selection uses a dictionary including a plurality of character information pieces and a plurality of types of emotion judgment values associated with each of the plurality of character information pieces, from the original text to the picture information dictionary. It is desirable to include the longest match search for the included character information pieces to obtain character information pieces to be counted.

The method preferably further includes the following steps.
4). If the information terminal does not fit in the display range set in advance to display the mixed information, the picture information piece selected at random is thinned out. The data amount (information amount) of the hybrid information can be moderately suppressed.

  In addition, it is desirable that the generation further includes selecting at least one overall decoration pattern from a plurality of types of overall decoration patterns and generating hybrid information including display by the selected overall decoration pattern. The overall decoration pattern includes at least one of a background display, a font, a fixed line displayed at the end of a sentence or a paragraph, and a user's own display.

  In addition, it is desirable that the generation includes generation of hybrid information as image information. Image information can be attached to an e-mail and transmitted.

The method preferably further includes the following steps.
5. The information terminal shall switch and display the character information and the hybrid information on the display.
6). Enable to input text information.
7). Sending hybrid information according to a protocol for sending and receiving e-mail over a computer network.

  The text information of the original text is replaced to adjust the display by the hybrid information, and the completed hybrid information can be transmitted as an e-mail or attached to the e-mail.

  One of the different aspects of the present invention is to randomly select picture information based on textual text information including at least one sentence, and to generate hybrid information including text information and randomly selected picture information. A program (program product) having instructions to be executed by a computer. This program or program product can be provided by being recorded on an appropriate recording medium such as a DVD. The program or program product can be distributed or downloaded via a computer network such as the Internet.

  It is desirable that the program further has an instruction for the computer to add a combination of the character information piece and the picture information piece included in the hybrid information to the picture information dictionary. In addition, it is preferable that the program further has an instruction for the computer to thin out randomly selected picture information pieces when the area required for displaying the hybrid information does not fall within a preset display range. Further, the program switches and displays the character information and the hybrid information on the display, enables the character information to be input, and transmits the hybrid information according to a protocol for sending and receiving electronic mail via the computer network. It is desirable to further have instructions for the computer to execute.

The block diagram which shows the outline | summary of the system (terminal device) including the function which produces | generates the text which a character and a picture mix. The block diagram which shows the hardware constitutions of a system. 3A is an example of an original text, FIG. 3B is an example of a pictographic document, and FIG. 3C is a diagram illustrating a further different example of a pictographic document. 4A shows an example of a character information library, FIG. 4B shows an example of an emotion library, and FIG. 4C shows an example of an overall decoration library. A different example of an emoji document. A different example of an emoji document. The flowchart which shows the outline | summary of operation | movement of an e-mail client. The flowchart which shows the outline | summary of operation | movement of a generator. The figure which shows the character information piece of the decoration object contained in the original text. The figure which shows the picture information piece contained in a pictogram document.

BEST MODE FOR CARRYING OUT THE INVENTION

  FIG. 1 shows a unit (pictogram document generator, pictogram document generator) that generates information (data to be displayed, hereinafter, hybrid information or pictogram document information) for displaying text in which characters and pictures are mixed or mixed. FIG. 1 is a block diagram showing a schematic configuration of a system including In this specification, a character or character information is a representation of characters such as kanji, katakana, hiragana, and / or alphabet in Japanese, and representations represented by characters. This can be output to an output device such as a display. The language is not limited to Japanese, and the character information includes information described by characters of each country for representing information in various languages as information that can be visually grasped. In the present specification, the character information does not mean information based only on characters, and may include so-called pictograms in which characters and pictures are mixed.

  In this specification, a picture or picture information includes all information or variations that can be expressed on an output device such as a display, mainly an image output device, other than characters. In addition to the picture, the picture or picture information can include graphics, photographs, colors, scaling, logos, fonts, movements, can be displayed with text, the text display itself can be decorated, and instead of text That can be displayed. In this specification, a sentence refers to a set of one or more sentences (sentences), and often includes letters, mails (including e-mails, and in the following, e-mails may be described as mails), documents, etc. Used interchangeably with document.

  In this specification, a text in which characters and pictures are mixed or mixed refers to a text in which at least a part of a plurality of characters included in the text is decorated (decorated) with picture information. In this specification, information for displaying a text in which characters and pictograms are mixed or mixed may be referred to as pictogram information. In this specification, the pictogram includes a word (sound form), and includes a thing or matter abstractly suggested using a picture. In addition, in this specification, pictograms include pictures, icons, and the like that are created using characters and symbols input by a computer. In addition, in this specification, a pictogram is a character that is colored, a character shape (font) is changed, a character size is changed, a still image or an animation image is displayed together with or instead of a character. Including things.

  A system 1 shown in FIG. 1 is an information terminal including a CPU and a memory, and is typically a mobile phone. The cellular phone 1 includes a display 2 serving as an output interface, a user interface 4 including a touch panel or keyboard 3 serving as an input interface, an operating system (OS) 5 that controls basic functions of the cellular phone 1, and an OS 5 Including the various functional units 6, 7, 8 and 10 operating above. The keyboard 3 may include any of a numeric keypad, a jog dial, a multi selector, a cursor key, and the like.

  FIG. 2 shows a typical hardware configuration of the system 1. The system 1 includes a CPU 91 and a memory (storage) 92 that are computer resources, a communication unit 93 that is connected to a public telephone network or a computer network by wireless (wireless LAN), a touch panel 94 that also serves as a display 2, and a voice communication function ( An audio communication unit) 6, a camera function (camera unit) 7, and a position information acquisition function (position information acquisition unit, GPS) 8 are connected by an internal bus 99. The touch panel 94 may cover all functions of the user interface 4, and may include a cursor key (keyboard) 3 in addition to the touch panel 94. The function of the keyboard 3 may be provided by the touch panel 94. It is also possible to input characters or sentences using the voice communication function 6. The OS 5 and applications running on the OS 5 and various functions are provided as a program (program product) 95. Then, a program (program product) 95 stored in the storage 92 or a program module included in the program 95 is loaded into the CPU 91 at an appropriate timing, and the CPU 91 executes the program 95 to implement the function of the application. The storage 92 can be composed of various recording media such as RAM, ROM, and flash memory, and provides recording areas such as the memory 18 and the library 70 described below.

  Many mobile phones 1 include an e-mail client (e-mail client, e-mail software) 10 for sending and receiving e-mail (e-mail) as one of applications. The mail client 10 includes a main body 11 and an add-on 12, and a pictographic document generator (generator) 50 is mounted on the mail client 10 as one of the add-ons 12. The mail client main body 11 includes an editing unit 13 that allows the user of the mobile phone (mobile terminal) 1 to input and edit the mail text (original text) 19 using the display 2 and the keyboard 3, and a memory 18 that stores the original text 19 being edited. A display unit 14 for displaying the mail document stored in the memory 18 and an image of an attached file on the display 2, and a transmission / reception unit 15 for transmitting a mail (e-mail) including the original text 19 stored in the memory 18 to the destination. Including. The transmission / reception unit 15 also includes a function of receiving an electronic mail transmitted from the transmission source (receiving an incoming call).

  The pictographic document generator 50 automatically converts the original text 19 in the memory 18 into information 59 (hereinafter referred to as a pictographic document including such information) for displaying a pictographic document in which character information and pictorial information are mixed. Is generated (converted) and stored in the memory 18. A typical example of the pictographic document 59 is a document (data, information) in the MTML format. The display unit 14 displays the pictographic document 59 on the display 2 instead of the original text 19. When the pictographic document 59 is confirmed by the user, the transmission / reception unit 15 transmits a mail including the pictographic document 59 to the destination. Therefore, the user can easily generate pictographic documents with various patterns.

  FIGS. 3A to 3C show how the original text is converted into a pictographic document. After inputting the original text 19 as shown in FIG. 3A, when the menu button 9a shown on the lower side of the display 2 is clicked, a pictogram button 9d and an initial setting button 9e appear. When the pictogram button 9d is clicked, as shown in FIG. 3B, a pictorial information piece is randomly selected for the text information piece included in the original sentence 19, and a pictogram document 59a is generated and displayed. Furthermore, when the next candidate button 9f shown on the lower side of the display 2 is clicked, picture information pieces are randomly selected for the character information pieces included in the original sentence 19, as shown in FIG. A pictographic document 59b different from the pictographic document 59a of FIG. 3B is generated and displayed. When the confirm button 9b is clicked, the pictographic document 59b is confirmed and transmitted to the destination as mail or an attached file of mail. In addition, arrangement | positioning and a function of button 9a-9c are examples, and are not limited.

  Returning to FIG. 1, the generator 50 includes functions (random selection function, random choice unit) 53 and 55 for randomly selecting picture information. Each time the random selection functions 53 and 55 receive the generation instruction 51 for the generator 50 from the user interface 4, the random selection functions 53 and 55 randomly select the picture information for the text information of the original text 19. The generation instruction 51 is output when the pictogram button 9d or the next candidate button 9f is operated, and the generator 50 randomly selects picture information and generates a new pictogram document (mixed information) 59 each time. .

  The generation instruction 51 can be output by operating the next candidate button 9f or a pictogram button 9d described later. Therefore, the user operates the pictogram button 9d or the next candidate button 9f after completing the input of the entire mail text, so that the entire mail text is converted into the original text 19 into the pictogram document 59 in a batch, for example, with one click. It is possible to convert. Further, by operating the next candidate button 9f again, it is possible to convert the pictorial documents 59 to different pictographic documents 59 all at once. For this reason, it is possible to save the trouble of converting each word into a pictogram, and the user can generate a pictogram document very easily.

  Further, each time the original text 19 or the pictographic document 59 is converted at once (every time the next candidate button 9f is operated), a different result, that is, a different pictographic document 59 is obtained. Since picture information is selected at random, individual picture information appears repeatedly at random. However, the possibility that the same pictographic document 59 is obtained as the whole pictographic document 59 is not zero but very small. It is also possible to convert to a pictographic document by operating the pictogram button 9d or the next candidate button 9f in the middle of inputting the mail text. It is also possible to convert the title into a pictographic document by operating the pictogram button 9d or the next candidate button 9f when a mail title is input.

  One of a plurality of functions for randomly selecting picture information refers to a dictionary (dictionary file, dictionary library) 70, and randomly selects one of a plurality of picture information pieces corresponding to character information pieces included in the original sentence 19. A first functional unit to be selected (first random selection unit, random selection unit corresponding to characters) 53 is provided. Each character information piece is a constituent element of a sentence included in the original sentence 19 and corresponds to one of a sentence, a phrase, and a word. The generator 50 includes a random number generation unit 52, and the first random selection unit 53 receives random numbers from the random number generation unit 52 as needed. Further, the generator 50 includes a generation unit 60, and the generation unit 60 displays information for displaying the character information piece to be decorated of the picture information piece selected by the first random selection unit 53 with the selected picture information piece. A function (mixed function) 61 for generating hybrid information (pictogram document) 59 including

  FIG. 4A shows an example of the character information library 71 included in the dictionary 70. The character information library 71 includes various words (words, idioms, etc.), phrases, short sentences, etc. as the character information pieces 72. In the character information library 71, as a character information piece 72, one to be decorated with a single kanji character, one to be decorated with a idiom of multiple characters, one to be decorated with a simple word, one to be decorated with a compound word, last name, name, etc. You can register what should be decorated together. The character information library 71 further includes at least one, and in many cases, a plurality of picture information pieces 73 for each character information piece 72.

  The picture information piece 73 includes a picture (including a pictograph) added in front of or behind the character information piece 72 to be decorated, a picture (including a pictograph) to be replaced with the character information piece 72 to be decorated, The decoration information added to the upper line or the lower line of the character information piece 72 and the font information for changing the font shape, color and / or size of the character information piece 72 to be decorated can be given. The picture information piece 73 is not limited to these. Movement (temporal change) is applied to a picture (including pictograms) added in front of or behind the character information piece 72 to be decorated or a picture (including pictograms) to be replaced with the character information piece 72 to be decorated. Includes accompanying pictures and pictograms.

  The first random selection unit 53 includes a function of searching the character information piece 72 and the original sentence 19 included in the character information library 71 for the longest match from the head of the original sentence 19 and selecting the character information piece 72 to be decorated. Further, the first random selection unit 53 randomly selects one of the plurality of picture information pieces 73 associated with the character information piece 72 to be decorated based on the random number obtained from the random number generation unit 52. Includes functionality. For example, one character information piece 72.1 includes a plurality of picture information pieces 73.1 to 73. n are associated with each other, and the first random selection unit 53, when the character information piece 72.1 is searched for the longest match, the picture information pieces 73.1 to 73.n. Select one of n at random.

  FIG. 5 shows an example of a pictographic document 59 using the influence of the longest match search. By performing the longest match search, one that should decorate a single Kanji character, one that should be decorated with multiple characters, one that should be decorated with simple words, one that should be decorated with compound words, one name, name, etc. The power can be appropriately extracted from the original text 19. In this example, the original text 19 of the last name 150 of the document is changed from “Kimura” to “Thu” and the space “Mura”. For this reason, the first random selection unit 53 performs the longest match search for “tree” and “village” instead of “kimura”. As a result, in the pictogram document 59 shown in FIG. 3, a picture is added behind “Kimura”, but in the pictogram document 59 shown in FIG. 5, “tree” becomes the character information piece 72 to be decorated, A picture is added behind “tree”, “village” becomes a character information piece 72 to be decorated, and a picture is added after “village”. Furthermore, a picture that further interprets the sentence is added to the end of the sentence according to the type of emotion described below, which is interpreted as a sentence.

  As described above, the first random selection unit 53 extracts the character information piece 72 to be decorated included in the original sentence 19 from the character information piece 72 included in the dictionary 70 by the longest match search. Therefore, the words and phrases that the user has consciously input as a unit are identified as the unit character information piece 72. For this reason, without changing the meaning (contents and intentions) of the original sentence 19, the contents to be expressed by the original sentence 19 can be converted into the pictographic document 59. In addition, it is possible to control the decoration-target character information piece 72 by intentionally inserting a space into a word or phrase included in the original sentence 19, and it is possible to generate more variations of pictographic documents 59.

  Another one of the plurality of functions for randomly selecting picture information is a third function for randomly selecting one of a plurality of picture information pieces corresponding to the sentence with the sentence included in the original text 19 as one unit. Provided by functional unit 55. As will be described below, the third functional unit 55 is a unit that randomly selects picture information pieces from emotions, and is hereinafter referred to as an emotion-corresponding random selection unit or a second random selection unit 55.

  Compared to phrases or words, the sentence variations included in the original sentence 19 generated by the user are enormous, and it is almost impossible to prepare picture information corresponding to them in advance. For this reason, the generator 50 includes a function of defining emotion as a parameter for each sentence and determining the type of emotion corresponding to the sentence (sentence). The function of determining the emotion type is provided by a functional unit (second functional unit, emotion selection unit) 54 that selects an emotion from a sentence. When the emotion selection unit 54 determines the emotion type for each sentence, the second random selection unit 55 randomly selects one of a plurality of picture information pieces prepared in advance corresponding to the determined emotion type. Including the function to perform. Examples of emotion types are: Love (Type A), Joy (Type B), Surprised (Type C), Angry (Type D), Recessed (Depressed) (Type E), Sad (Type F) ), Lovable (type G), fun (type H), momentum (type I), troubled (type J), and funny (type K).

  Even if it is difficult to automatically determine emotions in terms of words (words, phrases), if the sentence contains multiple words, the sentence unit depends on the frequency of words that depend on emotion. It is possible to automatically judge (select) emotions with relatively high accuracy. In addition, by obtaining emotions based on comprehensive judgment in units of sentences and then selecting picture information pieces, the possibility of adding pieces of picture information pieces that do not match the emotions to be expressed in the sentence is reduced. it can. Therefore, even if a picture information piece is selected at random, it is possible to add a picture information piece that is relatively in line with the content that the user wants to convey by e-mail. The probability of being done can be improved.

  As shown in FIG. 4A, the character information library 71 of the dictionary 70 stores an appropriate value (emotion parameter) 74 for each emotion type with respect to the character information piece 72 such as a phrase or word constituting the sentence. Is set. For example, for the character information piece 72.1, an emotion parameter 74.1 in which a value is set for each emotion type is set. The emotion selection unit 54 includes a function of searching the character information piece 72 and the original sentence 19 included in the character information library 71 for the longest match from the head of the original sentence 19 and acquiring the emotion parameter 74 of the character information piece 72. Further, the emotion selection unit 54 aggregates the value of the emotion parameter 74 of the character information piece 72 included in the sentence for each sentence, and assigns the type having the largest value among the emotion types A to K to the sentence. Includes the functions defined as

  The emotion selection unit 54 can set a threshold value to be used for tabulation or set a magnification for each type of emotion, and can change specific settings by changing those settings in advance. Can be easily selected. In addition, for a certain sentence, when the values aggregated for a plurality of emotion types are the same, the emotion type may be determined randomly or the emotion type selected preferentially may be determined.

  As shown in FIG. 4B, a plurality of picture information pieces 77 are set for one emotion type 76 in the emotion library 75 of the dictionary 70. As the picture information piece 77 for decorating the sentence, a picture (including pictograms) expressing a predetermined emotion displayed at the end of the sentence, a decoration image added to the upper or lower line of the sentence, and the font shape of the sentence, Examples include font information that changes color and / or size. The picture information piece 77 is not limited to the above.

  The second random selection unit 55 randomly selects one of the plurality of picture information pieces 77 associated with the emotion type 76 determined by the emotion selection unit 54 based on the random number obtained from the random number generation unit 52. .

  The generation unit 60 of the generator 50 has a function (mixed function, mixed unit) 61 for generating a pictographic document 59 including information for displaying each sentence with a picture information piece 77 selected by the second random selection unit 55. Including.

  The generator 50 further includes an overall decoration unit 56 for selecting contents that decorate the entire original text 19 or the generated pictographic document 59. In the overall decoration unit 56, one or a plurality of overall decoration patterns can be selected from a plurality of types of overall decoration patterns in the initial setting of the screen of FIG. Examples of the overall decoration pattern include a background display, a font, a definitive dialogue displayed at the end of a sentence or a paragraph, and a user's own display. The overall decoration pattern is not limited to the above.

  As shown in FIG. 4C, the overall decoration library 78 of the dictionary 70 includes an overall decoration item 79a and decoration contents (overall decoration pattern) 79b that can be selected for each item. The user can select the entire decoration pattern 79b for each item with the initial setting button 9e. A font that is one of the items 79 a to be entirely decorated indicates a font that is used uniformly throughout the pictographic document 59. In addition to the font provided by default to the mail client 10 or the generator 50, the font for overall decoration is one of the overall decoration patterns by registering the font purchased from the content provider by the user in the overall decoration library 78. You can choose as

  “Background” which is another one of the items 79 a to be entirely decorated is an image, a picture, a photograph or the like displayed so as to overlap with the pictographic document 59, and includes a function of automatic editing so as not to overlap the pictographic document 59. Also good. In addition to the images provided by default to the generator 50, the user can also register photos taken by the user, user-created pictures, backgrounds purchased from content providers, etc. in the general decoration library 78, or refer to the user's picture file It can be selected as one of the overall decoration patterns.

  FIG. 6 shows an output of a pictographic document 59 generated by selecting the background with New Year's theme and the font of the line book as the overall decoration pattern 79b. By pressing the next candidate button 9f, the use of the background and line font is not changed, but a pictographic document 59 with a different picture or the like displayed in the sentence and / or at the end of the sentence is generated and displayed on the display 2. .

  The “decision line”, which is another item 79a to be entirely decorated, is a sentence added at the end of the pictographic document 59 in many cases, and is a line used in movies, animations, games, and the like. For example, you can add words like "force together ..." or "I'm not very lucky ..." as a signature at the end of the email or separately from the signature. In addition to the sentences or titles provided by default to the generator 50, the deciding dialogue is also created by registering the deciding dialogue or the like that the user makes by himself or purchased from the content provider in the entire ornament library 78. Can be selected as one.

  The hybrid unit 61 of the generation unit 60 includes a function of generating a pictographic document 59 including a display with the overall decoration pattern selected by the overall decoration unit 56.

  The generation unit 60 includes a function unit (restriction unit) 62 that reduces or restricts the information amount of the pictographic document 59 in addition to the hybrid unit 61 that generates the pictographic document 59 in this way. If picture information is randomly added to the text information of the original text 19, there is a possibility that the amount of information of the pictographic document 59, which is mixed information, exceeds the display range, for example, the display range of the display 2. If the display range of the display 2 is exceeded, it becomes difficult for the receiver to recognize the pictographic mail with a sense of unity as a whole. Furthermore, there is a possibility that the amount of data that can be transmitted by electronic mail will be exceeded.

  The restriction unit 62 obtains a random number from the random number generation unit 52, randomly selects the picture information pieces 73 and / or 77 included in the pictographic document 59, thins out (deletes) the selected picture information pieces, A function for limiting the information amount of the pictographic document 59 so as to be within the preset data amount is included. Therefore, the generation unit 60 can add randomly selected picture information and can limit the amount of information of the added picture information. Further, since the character information of the original text 19 is not reduced, the contents of the original text 19 are not affected. Further, whether or not to limit the information amount of the pictographic document 59 can be set using an initial setting menu.

  The generation unit 60 further includes a functional unit (imaging unit) 63 that converts the pictographic document 59, which is mixed information, into an image file. The imaging unit 63 includes a function of rendering a pictographic document 59 and generating a pictographic document 59 of image data (image file) according to a predetermined standard such as GIF or JPEG. When the pictographic document 59 includes a motion (temporal change), the pictographic document 59 of image data using a function such as GIF animation or motion JPEG is generated.

  The generator 50 can generate a pictographic document 59 using a decoration element (overall decoration pattern) such as a font or background purchased from a content provider or the like. However, the font selected by the user is not necessarily included in the terminal that receives the mail, and it is difficult to transmit the purchased font together with the pictographic document 59. By transmitting the generated pictographic document 59 as image data, if the mail receiving terminal has a function of displaying the image data, the pictographic document 59 as intended by the user of the transmitting source is sent to the receiving terminal. Can be displayed.

  The generator 50 further includes a learning unit 57 that adds a combination of the character information piece 72 and the picture information piece 73 included in the pictographic document 59 to the character information library 71 of the dictionary 70. The learning unit 57 searches the character information piece included in the text information of the received or self-made pictographic document 59 based on the character information piece 72 registered in the character information library 71 and searches for the searched character. A picture information piece 73 corresponding to the information piece 72 is added to the character information library 71. The learning unit 57 further registers the background and the determined dialogue included in the received or self-made pictographic document 59 in the general decoration library 78 of the dictionary 70.

  The learning unit 57 can also create a new user dictionary separately from the dictionary 70 and register the newly registered character information piece 72, picture information piece 73, and overall decoration pattern 79b in the user dictionary. Furthermore, it is possible to set the first random selection unit 53 so as to search the contents of the user dictionary in preference to the dictionary 70. Thereby, the probability of the picture information piece 73 selected at random with respect to the character information piece 72 can be set so that the user dictionary has priority.

  In this way, in the generator 50, each time the pictograph button 9d or the next candidate button 9f is operated and the generation instruction 51 is received, the character information of the original sentence 19 and the character information of the original sentence 19 are selected at random. A pictographic document (mixed information) 59 including the generated picture information is generated. In the system (cellular phone) 1, the character information of the original text 19 and the pictographic document 59 can be switched and displayed on the display 2 by the display unit (output unit) 14. The user can correct the text information of the original text 19 at any time by the editing unit (input unit) 13. When the confirmation button 9b is operated, the pictographic document 59 is transmitted via the transmission / reception unit (transmission unit) 15 in accordance with a protocol for transmitting / receiving electronic mail.

  FIG. 7 shows the operation of the email client 10 using a flowchart. In step 301, the original text 19 is input using the editing unit 13. Next, when the pictogram button 9d is selected from the menu button 9a in step 302, a generation instruction 51 is issued in step 303 to start the generator 50 and generate a pictographic document 59. If not converted to pictograms, the original text 19 is output as an e-mail via the transmission / reception unit 15 in step 306.

  FIG. 8 shows the operation of the generator 50 using a flowchart. When the generation instruction 51 is received in step 307, generation of the pictographic document 59 is started. First, when the menu button 9a is selected in step 308, initialization is performed in step 309. For example, when the overall decoration unit 56 is called in the initial setting menu, the overall decoration pattern is set. When the learning unit 57 is called in the initial setting menu, the contents of the dictionary 70 are updated.

  Next, in step 311, the first random selection unit 53 searches the sentence 19 of the original sentence 19 for the longest match based on the character information pieces 72 registered in the character information library 71 of the dictionary 70. The first random selection unit 53 extracts the character information piece that has the longest match with the character information piece 72 registered in the character information library 71 as the character information piece 72 to be decorated. Further, in step 312, the first random selection unit 53 randomly selects one of the plurality of picture information pieces 73 set in the character information piece 72 to be decorated. The first random selection unit 53 repeats Steps 311 and 312 until the sentence of the original sentence 19 ends (Step 313).

  In parallel with or before and after Steps 311 and 312, in Step 321, the emotion selection unit 54 searches for the sentence of the original sentence 19 based on the character information piece 72 registered in the character information library 71 of the dictionary 70. The emotion parameter 74 is acquired. In step 322, the emotion selection unit 54 totals the emotion parameters 74 for each sentence and determines an emotion type 76 for each sentence. In step 323, the second random selection unit 55 randomly selects the picture information piece 77 of the emotion type determined for each sentence. Steps 321, 322 and 323 are repeated until the sentence of the original sentence 19 ends (step 324).

  When the pictorial information pieces 73 and 77 are selected in this way, the generating unit 60 generates (mixes) the pictographic document 59 in step 330, and the generated pictographic document 59 is displayed on the display 2 in step 331. . In step 330, if the information amount of the generated pictographic document 59 is excessive, the picture information randomly selected by the restriction unit 62 is thinned out and the information amount is reduced.

  FIGS. 9 and 10 show how the character information piece 72 and the picture information piece 73 to be decorated are extracted from the sentence of the original sentence 19. FIG. 9 shows a sentence of the original sentence 19. The first sentence (sentence) 100 includes words 101 and 102 which are character information pieces 72. The next sentence 110 includes words 111, 112 and 113. The next sentence 120 includes words 121, 122 and 123. The next sentence 130 includes words 131 and 132. The next sentence 140 includes the word 141. The last sentence 150 includes a word 151 indicating the name.

  FIG. 10 shows a display of a pictographic document 59a which is an example of the generated pictographic document 59. A plurality of picture information pieces 73 are set in the word 101, which is the character information piece 72 of the first sentence 100, and the back picture 201 is selected from among them, and the word 101 is used as a decoration target and behind it. A picture 201 is additionally displayed. That is, the word 101 is displayed as a decoration by the picture 201. Similarly, the word 102 is to be decorated and displayed in a decorative manner by a picture 202 which is one of the picture information pieces 73 behind the word 102. Furthermore, for the sentence 100 including the words 101 and 102, a picture 200, which is one of the picture information pieces 77 randomly selected via the emotion type 76, is additionally displayed at the end of the sentence and displayed in a decorative manner.

  With respect to the sentence 110, the word 111 is displayed as a decoration object, the picture information piece 73 for enlarging the font is selected, and the word 111 is enlarged and displayed 211, whereby the word 111 is displayed as a decoration. In addition, the word 112 becomes a decoration target, and a picture 212 which is one of the picture information pieces 73 is added behind the word 112 and displayed as a decoration. The word 113 becomes a decoration target, and a picture 213 which is one of the picture information pieces 73 is added above (upper row) and displayed as a decoration. For this sentence 110, the picture information piece 77 via the emotion type 76 is not selected, or an information piece that does not display a picture is selected, and the decoration based on the picture information piece for the whole is seen in the sentence 110. Absent. There is a possibility that the sentiment selection unit 54 interprets the sentence as being integrated with the next sentence 120 or 130.

  For the sentence 120, the word 121 is not a decoration target. That is, the character information piece 72 corresponding to the word 121 is not registered in the character information library 71, and the word 121 is not decorated. The word 122 is to be decorated, and a picture 222, which is one of the picture information pieces 73, is added behind the word 122 and displayed as a decoration. The word 123 is not an object to be decorated, and a picture 220 which is one of the picture information pieces 77 selected via the emotion type 76 is added to the back of the sentence 120 and displayed in a decorative manner.

  For the sentence 130, the word 131 is not a decoration target, or no picture information piece is selected, and no picture information piece is selected for the word 132. Thus, words 131 and 132 are not decorated. Behind the sentence 130, a picture 230 which is one of the picture information pieces 77 selected through the emotion type 76 is displayed.

  For the sentence 140, the word 141 is used as a decoration object, and a picture 241 is displayed thereafter. Further, a picture 240 that is one of the picture information pieces 77 selected through the emotion type 76 is displayed behind the picture.

  With respect to the sentence 150, the word 151 is a decoration target, and then a picture 251 that is one of the picture information pieces 73 is added and displayed as a decoration. The picture information for the entire sentence 150 is not selected.

  The pictographic document 59a shown in FIG. 10 is an example of the pictographic document 59 mixed from the original text 19, and some of other examples are shown in FIG. 3C and FIG.

  If the cancel button 9c is selected in step 304 after the pictographic document 59 is displayed in step 331, the process returns to the original text input in step 301. When the confirmation button 9b is selected in step 305, the displayed pictographic document 59 is determined as a transmission target. In step 305, when the next candidate button 9f is selected instead of the confirmation button 9b, the process returns to step 307, the generation instruction 51 is received by the generator 50, and the process of generating the new pictogram document 59 as described above is started. To do.

  When the pictographic document 59 is confirmed in step 305, it is determined in step 335 whether or not imaging is necessary. If imaging is unnecessary, the pictographic document 59 is stored in the memory 18 as an HTML document in step 336. On the other hand, if imaging is necessary, image data such as GIF data is generated by the imaging unit 63 in step 337 and stored in the memory 18 as a pictographic document 59.

  The process for generating the pictographic document 59 shown in FIG. 7 and FIG. 8 is executed by a processor such as the CPU 91 of the mobile phone 1 shown in FIG. Therefore, the functions shown in FIG. 1 and the processes shown in FIGS. 7 and 8 operate the processor according to instructions included in the program (program product, software) 95 installed in the storage 92 of the mobile phone 1. It is executed by. The program (program product) 95 can be provided by being recorded on an appropriate recording medium, or can be provided via a computer network such as the Internet or other communication.

  In addition, although the example which provides the function (generator) 50 which produces | generates the pictogram document 59 as an add-on of the mail client 10 is shown above, the mail client 10 including the generator 50 can also be provided, It is also possible to provide document generation software including the generator 50 and a portable terminal including the generator 50. Therefore, the system in the claims may be a software package supplied as an add-on to a mail client, a mail client, document generation software, a portable terminal, and the like. Also good.

  Further, the above description is based on the mail client 10 mounted on a mobile terminal such as a mobile phone. With this function, anyone can easily create an emoji document. In addition, the original text and pictographic document are not limited to those transmitted and received by e-mail, and the present invention can be applied to any software that generates a document by a word processor or the like.

Claims (29)

A system having a generation device that generates text information of text including at least one sentence and mixed information including picture information randomly selected for the text information ,
Multiple pieces of character information corresponding to any of sentences, phrases, and words, which are modified with a single character, modified with a multi-character phrase, modified with a simple word, modified with a compound word, and A plurality of character information pieces including a surname or a character that is qualified by a name; and a plurality of picture information pieces associated with each of the plurality of character information pieces. It further has a picture information dictionary associated in advance,
The generation device, from the original text, the longest match search for character information pieces included in the picture information dictionary, and a character information piece to be decorated,
When receiving a generation instruction for the generation device, a function of randomly selecting picture information pieces corresponding to all the character information pieces to be decorated included in the original text each time;
And a function of generating the composite information in which the character information piece to be decorated of the selected picture information piece is displayed by being decorated with the selected picture information piece . In claim 1 ,
The system further comprising a learning unit for adding a combination of character information pieces and picture information pieces included in the hybrid information to the picture information dictionary. In claim 1 or 2 ,
The picture information piece is added to a picture added to the front or back of the character information piece to be decorated, a picture to be replaced with the character information piece to be decorated, or an upper line or a lower line of the character information piece to be decorated. A decoration image and at least one of font information that changes a font shape, color, and / or size of the character information piece to be decorated. In any of claims 1 to 3 ,
A plurality of types of emotion determination values are associated in advance with one character information piece corresponding to one of sentences, phrases, and words, and a plurality of picture information pieces are associated in advance with each type of the plurality of types of emotion. And
The generation device, based on the original sentence, sentences for each sentence of the original sentence or for each paragraph of the original sentence, totals the judgment values of the plurality of types of emotions of a plurality of character information pieces included in one sentence, The ability to determine the type of emotion in a sentence,
A function of randomly selecting one of a plurality of pieces of picture information corresponding to the emotion type of the sentence;
And a function of generating the hybrid information including information for displaying the sentence with a selected piece of picture information. In claim 4 ,
A dictionary including a plurality of character information pieces and determination values of the plurality of types of emotions associated with each of the plurality of character information pieces;
The generation apparatus includes a function of performing a longest match search on character information pieces included in the picture information dictionary from the original text to obtain character information pieces to be counted. According to claim 4 or 5,
The picture information piece includes a picture expressing a predetermined emotion displayed at the end of a sentence, a decoration image added to the upper or lower line of the sentence, and font information for changing the font shape, color and / or size of the sentence. A system including at least one of them. In any one of Claims 1 thru | or 6 .
The generation apparatus includes a function of limiting an information amount of the randomly selected picture information. In any one of Claims 1 thru | or 7 ,
The generation apparatus includes a function of thinning out the randomly selected picture information pieces when an area required for displaying the composite information does not fit in a preset display range. In any of claims 1 to 8 ,
The generation device further includes a function of selecting at least one overall decoration pattern from a plurality of types of overall decoration patterns, and generating the hybrid information including a display by the selected overall decoration pattern,
The overall decoration pattern includes at least one of a background display, a font, a fixed line displayed at the end of a sentence or a paragraph, and a user's own display. In any one of claims 1 to 9, wherein the generator includes a function for generating said composite information as image information, system. In any one of claims 1 to 10, further comprising an output unit for displaying by switching the character information and the hybrid information on the display, the system. The input unit for inputting the character information according to claim 11 ,
A system further comprising: a transmission unit that transmits the hybrid information via a computer network. 13. The system according to claim 12 , wherein the transmission unit transmits the hybrid information according to a protocol for transmitting and receiving an electronic mail. An information terminal including a CPU and a memory randomly selects picture information based on textual text information including at least one sentence;
Generating mixed information including the character information and randomly selected picture information ,
The random selection is a plurality of character information pieces corresponding to any of sentences, phrases and words, which are modified by one character, those modified by a plural character idiom, those modified by a simple word, One character information piece including a plurality of character information pieces including those qualified with a compound word and a last name or a name qualified with a name, and a plurality of picture information pieces associated with each of the plurality of character information pieces. A character information piece included in a picture information dictionary in which a plurality of picture information pieces are associated in advance is searched from the original text for the longest match, and is used as a character information piece to be decorated.
Each time receiving a generation instruction, including randomly selecting picture information pieces corresponding to all the character information pieces to be decorated included in the original text,
Generating the hybrid information includes generating the hybrid information in which the decoration-target character information piece of the selected picture information piece is displayed by decoration using the selected picture information piece . In claim 14 ,
The method further comprising the information terminal adding a combination of a character information piece and a picture information piece included in the hybrid information to the picture information dictionary. In claim 14 or 15 ,
A plurality of types of emotion determination values are associated in advance with one character information piece corresponding to one of sentences, phrases, and words, and a plurality of picture information pieces are associated in advance with each type of the plurality of types of emotion. And
The random selection includes counting sentences of the plurality of types of emotions of a plurality of character information pieces included in one sentence in units of sentences in each of the original sentence, each sentence of the original sentence or each paragraph of the original sentence. Determining the type of emotion in the sentence;
Randomly selecting one of a plurality of pieces of picture information corresponding to the emotion type of the sentence,
The generating includes generating the hybrid information including information for displaying the text with a selected piece of picture information. In claim 16 ,
The random selection uses a dictionary including a plurality of character information pieces and determination values of the plurality of types of emotions associated with each of the plurality of character information pieces, and from the original text, the picture information dictionary A longest matching search for character information pieces included in the character information pieces to obtain character information pieces to be counted. In any of claims 14 to 17 ,
The method further comprising: thinning out the randomly selected picture information pieces when the area required for displaying the hybrid information does not fit within a preset display range. In any of claims 14 to 18 ,
The generating further includes selecting one overall decoration pattern from a plurality of types of overall decoration patterns, and generating the hybrid information including display by the selected overall decoration pattern,
The overall decoration pattern includes a background display, a font, a fixed line displayed at the end of a sentence or a paragraph, and at least one of a user's own display. In any one of claims 14 to 19 ,
The generating includes generating the hybrid information as image information. In any of claims 14 to 20 ,
The information terminal switches and displays the character information and the hybrid information on a display;
Enabling the input of the character information;
Transmitting the hybrid information according to a protocol for sending and receiving electronic mail over a computer network. Randomly selecting picture information based on textual text information including at least one sentence;
A program having an instruction for a computer to generate hybrid information including the character information and randomly selected picture information,
The random selection is a plurality of character information pieces corresponding to any of sentences, phrases and words, which are modified by one character, those modified by a plural character idiom, those modified by a simple word, One character information piece including a plurality of character information pieces including those qualified with a compound word and a last name or a name qualified with a name, and a plurality of picture information pieces associated with each of the plurality of character information pieces. A character information piece included in a picture information dictionary in which a plurality of picture information pieces are associated in advance is searched from the original text for the longest match, and is used as a character information piece to be decorated.
Each time receiving a generation instruction, including randomly selecting picture information pieces corresponding to all the character information pieces to be decorated included in the original text,
Generating the hybrid information includes generating the hybrid information in which the decoration-target character information piece of the selected picture information piece is displayed as a decoration using the selected picture information piece . In claim 22 ,
A program further comprising an instruction for a computer to add a combination of character information pieces and picture information pieces included in the hybrid information to the picture information dictionary. In claim 22 or 23 ,
A plurality of types of emotion determination values are associated in advance with one character information piece corresponding to one of sentences, phrases, and words, and a plurality of picture information pieces are associated in advance with each type of the plurality of types of emotion. And
The random selection includes counting sentences of the plurality of types of emotions of a plurality of character information pieces included in one sentence in units of sentences in each of the original sentence, each sentence of the original sentence or each paragraph of the original sentence. Determining the type of emotion in the sentence;
Randomly selecting one of a plurality of pieces of picture information corresponding to the emotion type of the sentence,
The generating includes generating the hybrid information including information for displaying the text with a selected piece of picture information. In claim 24 ,
The randomly selecting uses a dictionary file including a plurality of character information pieces and determination values of the plurality of types of emotions associated with each of the plurality of character information pieces,
Further, the program includes: searching for the longest match character information pieces included in the picture information dictionary from the original text to obtain character information pieces to be counted. In any of claims 22 to 25 ,
A program further comprising an instruction for a computer to thin out the randomly selected picture information pieces when an area required for displaying the hybrid information does not fall within a preset display range. In any of claims 22 to 26 ,
The generating further includes selecting at least one overall decoration pattern from a plurality of types of overall decoration patterns, and generating the hybrid information including display by the selected overall decoration pattern,
The overall decoration pattern is a program that includes at least one of a background display, a font, a fixed line displayed at the end of a sentence or a paragraph, and a user's own display. In any of claims 22 to 27 ,
The generating includes generating the hybrid information as image information. A device according to any one of claims 22 to 28 .
Switching and displaying the character information and the hybrid information on a display;
Allowing the character information to be entered;
A program further comprising: an instruction for a computer to transmit the hybrid information according to a protocol for transmitting and receiving electronic mail via a computer network.

Images