EP2290924A1 - Converting text messages into graphical image strings - Google Patents

Converting text messages into graphical image strings Download PDF

Info

Publication number
EP2290924A1
EP2290924A1 EP10173805A EP10173805A EP2290924A1 EP 2290924 A1 EP2290924 A1 EP 2290924A1 EP 10173805 A EP10173805 A EP 10173805A EP 10173805 A EP10173805 A EP 10173805A EP 2290924 A1 EP2290924 A1 EP 2290924A1
Authority
EP
European Patent Office
Prior art keywords
subject
sentence
graphical representation
graphical
verb
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP10173805A
Other languages
German (de)
French (fr)
Inventor
Francisco Rubio Andres
Miguel Angel Touset Rios
Daniel Almodovar Herraiz
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vodafone Espana SA
Vodafone Group PLC
Original Assignee
Vodafone Espana SA
Vodafone Group PLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vodafone Espana SA, Vodafone Group PLC filed Critical Vodafone Espana SA
Publication of EP2290924A1 publication Critical patent/EP2290924A1/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72427—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting games or graphical animations
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/205—Parsing
    • G06F40/211—Syntactic parsing, e.g. based on context-free grammar [CFG] or unification grammars

Definitions

  • the present invention is comprised within the field of methods for converting text information into graphical format.
  • the invention is more specifically aimed to convert the status information of a user in an Internet social network, such as Facebook, into a graphical image string, so that other contacts can easily, and graphically, obtain the status of said user.
  • the current scenario about the status of contacts in Internet social networks is a collection of separate sources with different formats.
  • the status can be user-generated, when Internet users write their own messages, or automatically-generated, when the servers or the devices automatically generate registers of presence or activity.
  • the user-generated status dominant in the Internet social networks (e.g. Facebook, Twitter), consists generally in text messages. It's a phrase with a verb and a noun but in some cases is a more elaborated phrase. These textual phrases are shown in a text like a book and usually using time as the only parameter to put them in order. Only the more innovative webs like ZYB have a friend player with these messages and you can forward or rewind the time where the messages appeared.
  • the automatic registers generated by servers, fixed/mobile network nodes or devices have very different and disparate formats, and are not collected or available.
  • the status is then a feature common in all the social networks.
  • the status generally is just an answer to the question "what are you doing now?".
  • Most of the social networks, aggregators and software used to follow the friend's updates provide special relevance to this information.
  • Web and mobile services (such as Facebook, ZYB, Twitter) send you continuously a lot of information about different people.
  • the mobile telephony networks have registers of IMS presence, made calls, missed calls, voice mails, lack of coverage, etc.
  • US Patent application US2007239631 discloses a method for generating a graphical image string to convey an intended message.
  • the method enables a user to select one or more graphics from a graphic language database, wherein the annotations (or descriptions) associated with each graphic selected can be combined to convey the intended message.
  • a common sense augmented translation of the combined graphics can also be performed in order to convert the graphical image string into a text message.
  • US2007239631 discloses (in figure 4 ) a method for translating a text message into a graphic message. However, said method performs a primitive and poor translation, since it only translates nouns and verbs and normally the result is a graphic string combined with text message to convey an understandable message.
  • the method is carried out by extracting the context of the text message, leaving only nouns and verbs, accessing a graphic language database and an annotation database in order to locate the graphical images having annotations that correspond with the extracted context. Once the graphical images have been located, the images are combined into a graphic message, which normally includes words or phrases interspersed throughout the string of graphical images in order to interconnect the graphical images, to obtain an understandable message.
  • the present invention seeks to address the shortcomings in the known methods for converting text messages into graphical image strings.
  • the invention relates to a method for converting text messages into graphical image strings according to claim 1, to a system according to claim 11 and to an electronic device according to claim 10.
  • Preferred embodiments of the system and of the method are defined in the dependent claims.
  • the object of the method of the present invention is to generate graphical image strings that graphically represent the content of text messages.
  • the method comprises:
  • the method can further comprise:
  • the method preferably comprises:
  • the text message is preferably the status information of a user in an Internet social network, the subject of each sentence is preferably said user and the graphical representation of the subject is preferably an avatar of said user in said Internet social network.
  • the method can also comprise, for each substantive referring to a person included in each sentence, checking if said substantive corresponds to a user of the Internet social network, and in that case obtaining the avatar of said user in said Internet social network as the graphical representation of the subject.
  • the method further comprises, if a graphical representation of a substantive cannot be obtained in the first graphic database, obtaining a graphical representation of said substantive by generating an image showing the text of the substantive.
  • the modified graphical representation of the subject showing the subject performing the action indicated by the at least one associated verb can be obtained by at least on of the following ways:
  • an electronic device for converting text messages into graphical image strings, said graphical image strings graphically representing the content of the text messages.
  • the electronic device comprises data processing means configured to:
  • the system comprises:
  • the system preferably also comprises a second graphic database storing, for each subject, a plurality of images showing the subject performing different actions, each action associated to a verb; the electronic device being further configured to retrieve, from the second graphic database, the modified graphical representation of the subject showing the subject performing the corresponding action.
  • the system can further comprise a third graphic database storing a plurality of predefined images, each one associated to a different verb; the electronic device being further configured to retrieve, from the third graphic database, an image associated with the corresponding verb, and to combine said retrieved image with the graphical representation of the subject to obtain the modified graphical representation of the subject.
  • the method proposed by the present invention performs a more sophisticated translation to obtain full-meaning phrases and a full text-to-graphic translation.
  • Said translation can include not only nouns and verbs, but also adjectives, adverbs, personalized subjects (which can be the avatars of the Internet social network users) and a graphical relationship between the different parts of the sentence (noun, verbs, adjectives, subjects,).
  • the present invention can convert the text message "Paul is thinking of a red car" into a graphical string comprising a graphical image of Paul's avatar in the Internet social network, a speech balloon next to the head of Paul's avatar, a graphical image of a car inside the speech balloon, and more specifically a car painted in red. Therefore, all the parts of the sentence are intimately linked in a meaningful graphic string and the user can obtain a complete translation of the text message.
  • the present invention allows the user an easy way to understand continuous changes in the status of each contact in a graphical view. This brings a number of advantages:
  • the present invention provides a system, method and electronic device for converting text messages into graphical image strings.
  • Figure 1 shows a system suitable for implementing the invention.
  • a preferred embodiment of the method has the following steps:
  • the proposed invention takes this text per contact and detects verbs, nouns and adjectives. Once these have been identified, it takes the contact's avatar (the avatar can be obtained automatically per contact from any of the sources or can be previously personalized by the user), chooses the main verb of the phrase and modifies the avatar to show that action, using the others nouns and adjectives to modify the image. For example, as shown in Figure 2 , if my status is "thinking of my birthday" the algorithm detects 'thinking' and goes to a database where the avatar 2 is modified to look like thinking; then, the noun associated to the action of thinking, in this case 'birthday', is associated in the database with a cake with candles and this appears in a balloon over the head of the avatar.
  • the next update in your status can be "Driving home", as shown un Figure 3 , in the same way we take the animation of your avatar and show him in a picture driving, and show the home concept (i.e. arriving to a house).
  • the same can be done with the following updates; in this way what we finally have is a comic with all the status changes in a page or in a row if you are reading the updates of this person in a mobile.
  • the invention provides the analysis of the text in order to identify the different verbs, nouns, adverbs, adjectives, etc.
  • the invention gets the avatar 2 and modifies it with the main verb, this image is later modified with the additional information found in the text.
  • first graphic database 10 In case a substantive noun does not exist or is not found in the graphic database corresponding to substantives, first graphic database 10, it can appear in the image string in text format or as an image showing the text, as shown in Figure 5 .
  • the system as shown in Figure 1 , is formed of:
  • the text message to be converted into graphical format is usually manually input by the user of an Internet social network.
  • the corresponding Internet social network server (5,5'5,) receives the text message showing the status of the user.
  • This text message contains a sentence which can include substantives, verbs, adjectives, adverbs, etc., expressing a thought or state or mind of the user.
  • This text message can be retrieved from the Internet social servers (5,5',5") by using APIs or other specific applications.
  • the electronic device 1 receives the text message, it performs the following actions:
  • Substantives not referring to a person can be retrieved from a first graphic database 10 which links substantives with images. Adjectives associated to substantives will be used to modify the substantive.
  • the user can previously select a style or template which should be used for select the images in the database. For instance, the user can select images with "comic” style, "manga” style, "pop art” style, etc. This way if in a database there are different images associated with a substantive (for instance, a car), the database would provide the image associated also with the selected style (e.g., a car in "comic” style, if the user selects "comic” style, as shown in Figure 8 ) The user could also select the special treatment of the images: sepia, black and white, etc.
  • the different image strips are showed, sorted according to time, as shown in Figure 6 .
  • the image string can be finally adapted to be sent to a computer, a mobile phone, a smartphone, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Library & Information Science (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

To generate graphical image strings that graphically represent the full meaning of the content of text messages, a text message containing at least one sentence to be converted into graphical format is first analyzed to identify, for each sentence: the subject; the at least one verb associated with the subject, if any; and the substantives not referring to a person, if any. A graphical representation of the subject is then obtained for each sentence. Likewise a first graphic database is accessed to obtain a graphical representation of the substantives not referring to a person included in each sentence. A modified graphical representation of the subject is then obtained showing the subject performing the action indicated by the at least one associated verb. Finally, these graphical representations are combined into a graphical image string.

Description

    Field of the Invention
  • The present invention is comprised within the field of methods for converting text information into graphical format. The invention is more specifically aimed to convert the status information of a user in an Internet social network, such as Facebook, into a graphical image string, so that other contacts can easily, and graphically, obtain the status of said user.
    • Background of the Invention
  • The current scenario about the status of contacts in Internet social networks is a collection of separate sources with different formats. The status can be user-generated, when Internet users write their own messages, or automatically-generated, when the servers or the devices automatically generate registers of presence or activity.
  • The user-generated status, dominant in the Internet social networks (e.g. Facebook, Twitter), consists generally in text messages. It's a phrase with a verb and a noun but in some cases is a more elaborated phrase. These textual phrases are shown in a text like a book and usually using time as the only parameter to put them in order. Only the more innovative webs like ZYB have a friend player with these messages and you can forward or rewind the time where the messages appeared.
  • The automatic registers generated by servers, fixed/mobile network nodes or devices have very different and disparate formats, and are not collected or available.
  • The status is then a feature common in all the social networks. The status generally is just an answer to the question "what are you doing now?". Most of the social networks, aggregators and software used to follow the friend's updates provide special relevance to this information. In addition, it is possible to get status also from communication networks, such as the IMS presence features in the fixed and mobile telecommunication systems.
  • Web and mobile services (such as Facebook, ZYB, Twitter) send you continuously a lot of information about different people. Also the mobile telephony networks have registers of IMS presence, made calls, missed calls, voice mails, lack of coverage, etc. The problem arises because there is so much information to process and read from all those different sources (e.g. social networks, telecommunications networks) and contacts (e.g. friends, workmates, family members).
  • US Patent application US2007239631 discloses a method for generating a graphical image string to convey an intended message. The method enables a user to select one or more graphics from a graphic language database, wherein the annotations (or descriptions) associated with each graphic selected can be combined to convey the intended message. A common sense augmented translation of the combined graphics can also be performed in order to convert the graphical image string into a text message. In addition, US2007239631 discloses (in figure 4) a method for translating a text message into a graphic message. However, said method performs a primitive and poor translation, since it only translates nouns and verbs and normally the result is a graphic string combined with text message to convey an understandable message. The method is carried out by extracting the context of the text message, leaving only nouns and verbs, accessing a graphic language database and an annotation database in order to locate the graphical images having annotations that correspond with the extracted context. Once the graphical images have been located, the images are combined into a graphic message, which normally includes words or phrases interspersed throughout the string of graphical images in order to interconnect the graphical images, to obtain an understandable message.
  • The present invention seeks to address the shortcomings in the known methods for converting text messages into graphical image strings.
    • Description of the Invention
  • The invention relates to a method for converting text messages into graphical image strings according to claim 1, to a system according to claim 11 and to an electronic device according to claim 10. Preferred embodiments of the system and of the method are defined in the dependent claims.
  • The object of the method of the present invention is to generate graphical image strings that graphically represent the content of text messages. The method comprises:
    • obtaining a text message containing at least one sentence to be converted into graphical format;
    • analyzing the at least one sentence to identify, for each sentence:
      • the subject;
      • the at least one verb associated with the subject, if any;
      • the substantives not referring to a person, if any;
    • obtaining, for each sentence, a graphical representation of the subject;
    • accessing a first graphic database to obtain a graphical representation of the substantives not referring to a person included in each sentence;
    • obtaining a modified graphical representation of the subject showing the subject performing the action indicated by the at least one associated verb;
    • combining graphical representations previously obtained into a graphical image string.
  • The method can further comprise:
    • identifying, for each sentence, the substantives referring to a person included in the sentence, if any;
    • obtaining, for each sentence, a graphical representation of the substantives referring to a person included in the sentence.
  • In a preferred embodiment the method also comprises:
    • identifying, for each sentence, the at least one verb associated to each substantive referring to a person, if any;
    • obtaining a modified graphical representation of each substantive referring to a person showing each substantive performing the action indicated by the at least one associated verb.
  • The method preferably comprises:
    • identifying, for each sentence, the adjectives included in the sentence associated with substantives not referring to a person, if any;
    • obtaining a modified graphical representation of the substantives not referring to a person showing the substantive modified by the quality of the corresponding adjective.
  • In yet another preferred embodiment the method also can comprise:
    • identifying, for each sentence, the adverbs included in the sentence, if any, and the verb or adjective associated to each adverb;
    • for each adverb associated to an adjective, obtaining a modified graphical representation of the corresponding substantive not referring to a person showing the substantive modified by the quality of the corresponding adjective modified with the adverb;
    • for each adverb associated to a verb, obtaining a modified graphical representation of the corresponding subject showing the subject performing the action indicated by the associated verb modified by the adverb.
  • The text message is preferably the status information of a user in an Internet social network, the subject of each sentence is preferably said user and the graphical representation of the subject is preferably an avatar of said user in said Internet social network.
  • The method can also comprise, for each substantive referring to a person included in each sentence, checking if said substantive corresponds to a user of the Internet social network, and in that case obtaining the avatar of said user in said Internet social network as the graphical representation of the subject.
  • In a preferred embodiment the method further comprises, if a graphical representation of a substantive cannot be obtained in the first graphic database, obtaining a graphical representation of said substantive by generating an image showing the text of the substantive.
  • The modified graphical representation of the subject showing the subject performing the action indicated by the at least one associated verb can be obtained by at least on of the following ways:
    • retrieving said modified graphical representation from a second graphic database storing, for each subject, a plurality of images showing the subject performing different actions, each action associated to a verb;
    • retrieving an image associated with the corresponding verb from a third graphic database storing a plurality of predefined images, each one associated to a different verb, and combining said retrieved image with the graphical representation of the subject to obtain the modified graphical representation of the subject.
  • In accordance with a further aspect of the present invention there is provided an electronic device for converting text messages into graphical image strings, said graphical image strings graphically representing the content of the text messages. The electronic device comprises data processing means configured to:
    • obtain a text message containing at least one sentence to be converted into graphical format;
    • analyze the at least one sentence to identify, for each sentence:
      • the subject;
      • the at least one verb associated with the subject, if any;
      • the substantives not referring to a person, if any;
    • obtain, for each sentence, a graphical representation of the subject;
    • access a first graphic database to obtain a graphical representation of the substantives not referring to a person included in each sentence;
    • obtain a modified graphical representation of the subject showing the subject performing the action indicated by the at least one associated verb;
    • combine graphical representations previously obtained into a graphical image string.
  • In accordance with yet a further aspect of the present invention there is provided a system for converting text messages into graphical image strings, said graphical image strings graphically representing the content of the text messages. The system comprises:
    • a first graphic database storing graphical representations of substantives not referring to a person;
    • an electronic device configured to:
      • obtain a text message containing at least one sentence to be converted into graphical format;
      • analyze the at least one sentence to identify, for each sentence:
        • o the subject;
        • o the at least one verb associated with the subject, if any;
        • o the substantives not referring to a person, if any;
      • obtain, for each sentence, a graphical representation of the subject;
      • access the first graphic database to obtain a graphical representation of the substantives not referring to a person included in each sentence;
      • obtain a modified graphical representation of the subject showing the subject performing the action indicated by the at least one associated verb;
      • combine graphical representations previously obtained into a graphical image string.
  • The system preferably also comprises a second graphic database storing, for each subject, a plurality of images showing the subject performing different actions, each action associated to a verb; the electronic device being further configured to retrieve, from the second graphic database, the modified graphical representation of the subject showing the subject performing the corresponding action.
  • The system can further comprise a third graphic database storing a plurality of predefined images, each one associated to a different verb; the electronic device being further configured to retrieve, from the third graphic database, an image associated with the corresponding verb, and to combine said retrieved image with the graphical representation of the subject to obtain the modified graphical representation of the subject.
  • Thus when compared to known solutions, the method proposed by the present invention performs a more sophisticated translation to obtain full-meaning phrases and a full text-to-graphic translation. Said translation can include not only nouns and verbs, but also adjectives, adverbs, personalized subjects (which can be the avatars of the Internet social network users) and a graphical relationship between the different parts of the sentence (noun, verbs, adjectives, subjects,...). For instance, the present invention can convert the text message "Paul is thinking of a red car" into a graphical string comprising a graphical image of Paul's avatar in the Internet social network, a speech balloon next to the head of Paul's avatar, a graphical image of a car inside the speech balloon, and more specifically a car painted in red. Therefore, all the parts of the sentence are intimately linked in a meaningful graphic string and the user can obtain a complete translation of the text message.
  • The present invention allows the user an easy way to understand continuous changes in the status of each contact in a graphical view. This brings a number of advantages:
    • Saves times of the user, since seeing pictures is much more immediate than reading text or listening to audio. This is especially important nowadays with the increasing overflow of information that human beings have to process.
    • Helps illiterate people and in general people finding difficulties in reading a lot of text in different formats (e.g. depending on the source)
    • Makes interaction with the new services more fun, so helping to introduce people, such as older people, in the "information society".
    Brief Description of the Drawings
  • A series of drawings which aid in better understanding the invention and which are expressly related with an embodiment of said invention, presented as a non-limiting example thereof, are very briefly described below.
    • Figure 1 shows the system object of the present invention.
    • Figures 2 to 8 show different examples of the operation of aspects of the invention.
    Description of a Preferred Embodiment of the Invention
  • The present invention provides a system, method and electronic device for converting text messages into graphical image strings. Figure 1 shows a system suitable for implementing the invention. A preferred embodiment of the method has the following steps:
    1. 1. Collection of status information of a contact from different sources, normally different servers (5,5',5"):
      • As a minimum, it would collect info from at least one user-generated source (e.g. Twitter server 5).
      • If available, it would collect info from several user-generated sources (e.g. Twitter server 5, Facebook server 5', ZYB server 5"). The aggregation could be done via APIs (Application Programming Interface) provided by those sources for developers. This would require identity management in order to map the different aliases or accounts of the contacts in the different sources.
      • If available, it would collect info from several automatically-generated sources (e.g. IMS presence from mobile operator, call registers uploaded from the device). The aggregation could be done via APIs provided by the operators or via active uploads from client applications at the device. This would require again identity management, and also privacy management in order to authorise access to those network information of registers.
    2. 2. Conversion of the contact status collected along time into a graphical story or "comic". This comic will inform about the activity of the contact in an immediate, attractive visual way.
  • For this purposes, the proposed invention takes this text per contact and detects verbs, nouns and adjectives. Once these have been identified, it takes the contact's avatar (the avatar can be obtained automatically per contact from any of the sources or can be previously personalized by the user), chooses the main verb of the phrase and modifies the avatar to show that action, using the others nouns and adjectives to modify the image. For example, as shown in Figure 2 , if my status is "thinking of my birthday" the algorithm detects 'thinking' and goes to a database where the avatar 2 is modified to look like thinking; then, the noun associated to the action of thinking, in this case 'birthday', is associated in the database with a cake with candles and this appears in a balloon over the head of the avatar. Afterwards, the next update in your status can be "Driving home", as shown un Figure 3, in the same way we take the animation of your avatar and show him in a picture driving, and show the home concept (i.e. arriving to a house). The same can be done with the following updates; in this way what we finally have is a comic with all the status changes in a page or in a row if you are reading the updates of this person in a mobile.
  • There are multiple possible options for this "comic story", since the picture can be enriched with several nouns and verbs and avatars of other users can also be used. For example if I write "thinking of Penelope's birthday", as shown in Figure 4 , the image will show a man (or my avatar) thinking and in the air Penelope avatar 3 close to (or blowing out) the candles of a cake. Adjectives and adverbs can also be shown in the picture if they are available in the database.
  • The invention provides the analysis of the text in order to identify the different verbs, nouns, adverbs, adjectives, etc.
  • Therefore, the invention gets the avatar 2 and modifies it with the main verb, this image is later modified with the additional information found in the text.
  • In case a substantive noun does not exist or is not found in the graphic database corresponding to substantives, first graphic database 10, it can appear in the image string in text format or as an image showing the text, as shown in Figure 5 .
  • Finally, the images of the same user are joined in a temporary succession in order to obtain a comic with the changes, such as shown in Figure 6 .
  • In a preferred embodiment the system, as shown in Figure 1 , is formed of:
    • An electronic device 1, configured for obtaining the text message (in a preferred embodiment the status of the user in an Internet social network; for instance, by accessing the corresponding server 5,5',5"). Different APIs can be used to obtain the status of the user. The status of the user is preferably in text format, although it can be first obtained in audio format and then converted into text by an application.
    • The different databases (10,11,12) used by the electronic device 1.
  • The text message to be converted into graphical format is usually manually input by the user of an Internet social network. The corresponding Internet social network server (5,5'5,") receives the text message showing the status of the user. This text message contains a sentence which can include substantives, verbs, adjectives, adverbs, etc., expressing a thought or state or mind of the user. This text message can be retrieved from the Internet social servers (5,5',5") by using APIs or other specific applications.
  • Once the electronic device 1 receives the text message, it performs the following actions:
    • Analysis of the substantives. All the substantives included in the text message are obtained. The subjects of the different sentences included in the text message are identified. The substantives referring to a person receive a special treatment. The subject and the substantives referring to a person would be normally represented by a avatar or image. The electronic device 1 can ask the different Internet social networks information about the subject, to obtain an image or avatar from them. Optionally, the avatar (or photo) can be requested and retrieved directly from the user.
  • Substantives not referring to a person can be retrieved from a first graphic database 10 which links substantives with images. Adjectives associated to substantives will be used to modify the substantive.
  • In this step the flow of information will be the following:
    • Input: Text message (substantives, verbs, adjectives, adverbs)
    • Output: avatar or images of subjects and substantives referring to people + images of substantives + rest of the text message.
    • Avatar modification. In this step the subjects and substantives referring to a person are modified to show the action of the verbs. This is achieved by using a graphic database (11,12) which links a verb with an image. In case the verb is not found in this database, an image showing the text of the verb can be used. The avatar modification can be carried out in different ways, for example:
      1. a) Storing in a second graphic database 11 for each user a plurality of images or photographs showing the user performing different actions (e.g., driving, sleeping, resting, thinking, etc.)
      2. b) Storing in a third graphic database 12 a plurality of predefined images showing a person performing different actions (drinking, running, etc.), and combining the image previously obtained of the avatar with the corresponding predefined image describing the action. The combination would normally consist in replacing the head of the predefined image showing the action with the head of the avatar.
      3. c) Using symbolic elements (e.g., arrows or speech balloons) for representing the action of the verb. This is specially useful for verbs such as "think", "say", "tell", "imagine", "listens", etc. The object of this verb would be inside the speech balloon.
      4. d) A combination of the previous ways.
    In this step the flow of information will be the following:
    • Input: avatar or images of subjects and substantives referring to people + images of substantives + rest of the text message.
    • Output: modified avatar + modified image of substantives referring to people + images related to the verbs + images of substantives + rest of the text message.
    • Substantives modification: For the adjectives included in the sentence and referring to a person, the substantive image should be modified. For instance, if the sentence says "Thinking in a red car", there are two ways ob obtaining the substantive image modified by the adjective. The first database the 10 can store cars of different colours (blue car, red car, black car), so the association "red car" with an image is directly performed. Other way of obtaining the substantive image modified by the adjective is retrieving an image of a car from the first graphic database 10, for instance a blue car with white background, and replacing the blue colour with red, obtaining a red car, such as shown in Figure 7.
    • Creation of the image string. In this step the image string is composed 100 by using the images previously obtained.
  • The user can previously select a style or template which should be used for select the images in the database. For instance, the user can select images with "comic" style, "manga" style, "pop art" style, etc. This way if in a database there are different images associated with a substantive (for instance, a car), the database would provide the image associated also with the selected style (e.g., a car in "comic" style, if the user selects "comic" style, as shown in Figure 8 ) The user could also select the special treatment of the images: sepia, black and white, etc.
  • The different image strips are showed, sorted according to time, as shown in Figure 6.
  • The image string can be finally adapted to be sent to a computer, a mobile phone, a smartphone, etc.

Claims (13)

  1. Method for converting text messages into graphical image strings, said graphical image strings graphically representing the content of the text messages, characterized in that the method comprises:
    - obtaining a text message containing at least one sentence to be converted into graphical format;
    - analyzing the at least one sentence to identify, for each sentence:
    • the subject;
    • the at least one verb associated with the subject, if any;
    • the substantives not referring to a person, if any;
    - obtaining, for each sentence, a graphical representation of the subject;
    - accessing a first graphic database (10) to obtain a graphical representation of the substantives not referring to a person included in each sentence;
    - obtaining a modified graphical representation of the subject showing the subject performing the action indicated by the at least one associated verb;
    - combining graphical representations previously obtained into a graphical image string.
  2. Method according to claim 1, the method further comprising:
    - identifying, for each sentence, the substantives referring to a person included in the sentence, if any;
    - obtaining, for each sentence, a graphical representation of the substantives referring to a person included in the sentence.
  3. Method according to claim 2, the method further comprising:
    - identifying, for each sentence, the at least one verb associated to each substantive referring to a person, if any;
    - obtaining a modified graphical representation of each substantive referring to a person showing each substantive performing the action indicated by the at least one associated verb.
  4. Method according to any of claims 1 to 3, the method further comprising:
    - identifying, for each sentence, the adjectives included in the sentence associated with substantives not referring to a person, if any;
    - obtaining a modified graphical representation of the substantives not referring to a person showing the substantive modified by the quality of the corresponding adjective.
  5. Method according to claim 4, the method further comprising:
    - identifying, for each sentence, the adverbs included in the sentence, if any, and the verb or adjective associated to each adverb;
    - for each adverb associated to an adjective, obtaining a modified graphical representation of the corresponding substantive not referring to a person showing the substantive modified by the quality of the corresponding adjective modified with the adverb;
    - for each adverb associated to a verb, obtaining a modified graphical representation of the corresponding subject showing the subject performing the action indicated by the associated verb modified by the adverb.
  6. Method according to any of claims 1-5, wherein the text message is the status information of a user in an Internet social network, the subject of each sentence is said user and the graphical representation of the subject is an avatar of said user in said Internet social network.
  7. Method according to claims 2 and 6, the method further comprising:
    - for each substantive referring to a person included in each sentence, checking if said substantive corresponds to a user of the Internet social network, and in that case obtaining the avatar of said user in said Internet social network as the graphical representation of the subject.
  8. Method according to any of claims 1 to 7, the method further comprising:
    - if a graphical representation of a substantive cannot be obtained in the first graphic database (10), obtaining a graphical representation of said substantive by generating an image showing the text of the substantive.
  9. Method according to any of claims 1 to 8, wherein the modified graphical representation of the subject showing the subject performing the action indicated by the at least one associated verb is obtained by at least on of the following ways:
    - retrieving said modified graphical representation from a second graphic database (11) storing, for each subject, a plurality of images showing the subject performing different actions, each action associated to a verb;
    - retrieving an image associated with the corresponding verb from a third graphic database (12) storing a plurality of predefined images, each one associated to a different verb, and combining said retrieved image with the graphical representation of the subject to obtain the modified graphical representation of the subject.
  10. Electronic device for converting text messages into graphical image strings, said graphical image strings graphically representing the content of the text messages, characterized in that the electronic device comprises data processing means configured to:
    - obtain a text message containing at least one sentence to be converted into graphical format;
    - analyze the at least one sentence to identify, for each sentence:
    • the subject;
    • the at least one verb associated with the subject, if any;
    • the substantives not referring to a person, if any;
    - obtain, for each sentence, a graphical representation of the subject;
    - access a first graphic database (10) to obtain a graphical representation of the substantives not referring to a person included in each sentence;
    - obtain a modified graphical representation of the subject showing the subject performing the action indicated by the at least one associated verb;
    - combine graphical representations previously obtained into a graphical image string.
  11. System for converting text messages into graphical image strings, said graphical image strings graphically representing the content of the text messages, characterized in that the system comprises:
    - a first graphic database (10) storing graphical representations of substantives not referring to a person;
    - an electronic device configured to:
    • obtain a text message containing at least one sentence to be converted into graphical format;
    • analyze the at least one sentence to identify, for each sentence:
    o the subject;
    o the at least one verb associated with the subject, if any;
    o the substantives not referring to a person, if any;
    • obtain, for each sentence, a graphical representation of the subject;
    • access the first graphic database (10) to obtain a graphical representation of the substantives not referring to a person included in each sentence;
    • obtain a modified graphical representation of the subject showing the subject performing the action indicated by the at least one associated verb;
    • combine graphical representations previously obtained into a graphical image string.
  12. System according to claim 11, the system further comprising a second graphic database (11) storing, for each subject, a plurality of images showing the subject performing different actions, each action associated to a verb;
    the electronic device being further configured to retrieve, from the second graphic database (11), the modified graphical representation of the subject showing the subject performing the corresponding action.
  13. System according to any of claims 11 to 12, the system further comprising a third graphic database (12) storing a plurality of predefined images, each one associated to a different verb;
    the electronic device being further configured to retrieve, from the third graphic database (12), an image associated with the corresponding verb, and to combine said retrieved image with the graphical representation of the subject to obtain the modified graphical representation of the subject.
EP10173805A 2009-08-24 2010-08-24 Converting text messages into graphical image strings Withdrawn EP2290924A1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
ES200930619 2009-08-24

Publications (1)

Publication Number Publication Date
EP2290924A1 true EP2290924A1 (en) 2011-03-02

Family

ID=43242879

Family Applications (1)

Application Number Title Priority Date Filing Date
EP10173805A Withdrawn EP2290924A1 (en) 2009-08-24 2010-08-24 Converting text messages into graphical image strings

Country Status (2)

Country Link
US (1) US20110078564A1 (en)
EP (1) EP2290924A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2519312A (en) * 2013-10-16 2015-04-22 Nokia Technologies Oy An apparatus for associating images with electronic text and associated methods

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110269435A1 (en) * 2010-04-30 2011-11-03 Tim Dieckman Automatic iconic display of calendar events on computing devices by inspecting events text
CN103109521B (en) * 2010-09-21 2015-05-06 索尼爱立信移动通讯有限公司 Systems and methods for enhancing messages
US20140082494A1 (en) * 2012-09-19 2014-03-20 Perion Network Ltd. Method for displaying e-mail messages to a user
US9596206B2 (en) 2012-10-09 2017-03-14 Facebook, Inc. In-line images in messages
US9331970B2 (en) * 2012-12-05 2016-05-03 Facebook, Inc. Replacing typed emoticon with user photo
US20150347363A1 (en) * 2014-05-30 2015-12-03 Paul Manganaro System for Communicating with a Reader
US11410755B2 (en) * 2014-11-06 2022-08-09 Ieso Digital Health Limited Computer-based system for providing psychological therapy
US10951562B2 (en) 2017-01-18 2021-03-16 Snap. Inc. Customized contextual media content item generation
US10802683B1 (en) * 2017-02-16 2020-10-13 Cisco Technology, Inc. Method, system and computer program product for changing avatars in a communication application display
US10719545B2 (en) * 2017-09-22 2020-07-21 Swarna Ananthan Methods and systems for facilitating storytelling using visual media
CN108304540B (en) * 2018-01-29 2022-08-02 腾讯科技（深圳）有限公司 Text data identification method and device and related equipment
US10885176B2 (en) 2018-06-11 2021-01-05 International Business Machines Corporation Image based passphrase for authentication
US11210968B2 (en) * 2018-09-18 2021-12-28 International Business Machines Corporation Behavior-based interactive educational sessions
US11010562B2 (en) 2019-02-08 2021-05-18 International Business Machines Corporation Visual storyline generation from text story
US10904174B1 (en) * 2019-07-03 2021-01-26 International Business Machines Corporation Screen size-based pictorial message translation
US11675828B2 (en) 2019-11-05 2023-06-13 International Business Machines Corporation Visual representation coherence preservation
CN111009041B (en) * 2019-11-15 2023-09-26 广东智媒云图科技股份有限公司 Drawing creation method, device, terminal equipment and readable storage medium
US12282755B2 (en) * 2022-09-10 2025-04-22 Nikolas Louis Ciminelli Generation of user interfaces from free text
CN115567474B (en) * 2022-12-06 2023-04-18 广州钛动科技股份有限公司 Message pushing method and system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20040028038A (en) * 2002-09-28 2004-04-03 주식회사 케이티 System and method of automatically converting text to image using by language processing technology
KR20040100700A (en) * 2003-05-23 2004-12-02 에스케이 텔레콤주식회사 Method and System for Converting Text Message into Styled Text for Transmission
WO2007110717A2 (en) * 2006-03-28 2007-10-04 Nokia Corporation Method, apparatus and computer program product for generating a graphical image string to convey an intended message
US20090119308A1 (en) * 2007-11-01 2009-05-07 Clark David K Method and system for translating text into visual imagery content

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7945653B2 (en) * 2006-10-11 2011-05-17 Facebook, Inc. Tagging digital media
US20080039163A1 (en) * 2006-06-29 2008-02-14 Nokia Corporation System for providing a personalized comic strip
US20100081461A1 (en) * 2008-10-01 2010-04-01 Microsoft Corporation SMS Based Social Networking

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20040028038A (en) * 2002-09-28 2004-04-03 주식회사 케이티 System and method of automatically converting text to image using by language processing technology
KR20040100700A (en) * 2003-05-23 2004-12-02 에스케이 텔레콤주식회사 Method and System for Converting Text Message into Styled Text for Transmission
WO2007110717A2 (en) * 2006-03-28 2007-10-04 Nokia Corporation Method, apparatus and computer program product for generating a graphical image string to convey an intended message
US20070239631A1 (en) 2006-03-28 2007-10-11 Nokia Corporation Method, apparatus and computer program product for generating a graphical image string to convey an intended message
US20090119308A1 (en) * 2007-11-01 2009-05-07 Clark David K Method and system for translating text into visual imagery content

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2519312A (en) * 2013-10-16 2015-04-22 Nokia Technologies Oy An apparatus for associating images with electronic text and associated methods

Also Published As

Publication number Publication date
US20110078564A1 (en) 2011-03-31

Similar Documents

Publication Publication Date Title
EP2290924A1 (en) Converting text messages into graphical image strings
US11036469B2 (en) Parsing electronic conversations for presentation in an alternative interface
Stäheli et al. Digital detox tourism: Practices of analogization
CN102017585B (en) Method and system for notification and telecommunications management
Schmid et al. Frames and framing in documentary comics
Szabo et al. Using mobile technology with individuals with aphasia: native iPad features and everyday apps
Faimau et al. Facebooking religion and the technologization of the religious discourse: A case study of a Botswana-based Prophetic Church
Cesare et al. Mourning and memory in the twittersphere
US20180052654A1 (en) Story capture system
US20220114210A1 (en) Social media video sharing and cyberpersonality building system
Brennan Gay porn’s bareback momentum
König Transmodal messenger interaction–Analysing the sequentiality of text and audio postings in WhatsApp chats
De Bruijn Citizen journalism at crossroads: Mediated political agency and duress in Central Africa
Dietz et al. A scoping review of PhotoVoice for people with post-stroke aphasia
US20250323883A1 (en) Techniques for an artificial intelligence assistant for family history and storytelling
Mendonça Situating single mothers through values-based cartooning
JP2015146550A (en) Information processing apparatus, information processing method, and program
JP2023147286A (en) Program, information processing device, information processing system, and information processing method
Shiau The use of celebrity scandals and sensational news for identity negotiations: Analyzing gossip among the queers within Taiwanese families
Leon-Boys No Spanish in Cinderella’s kingdom: A situated ethnography of Disney World’s engagement with Elena of Avalor
Montgomery Mediation, technological change, and discourse: The case of television talk
Adams et al. Recollections of September 11 in three English villages: Identifications and self-narrations
Francis The semantics of emojis and memes: understanding meaning-making among social media users
CN116192786B (en) Message processing methods, apparatus, computer equipment, storage media and program products
Curtis Alternative Instagram Memes: Intersectional Community and Collaborative Storytelling in the Digital Age

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME RS

17P Request for examination filed

Effective date: 20110902

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20110903