TW201617947A - Device and method of managing user information based on image - Google Patents

Abstract

A device and a method of managing user information are provided. The device includes a display and a controller. The controller controls the display to display an avatar-based image according to user schedule information, change the avatar-based image according to a user input indicating a request to change the avatar-based image, and update the user schedule information according to the changed avatar-based image. The method includes displaying, on a display of a device, an avatar-based image according to user schedule information, changing the avatar-based image according to a user input indicating a request to change the avatar-based image, and updating the user schedule information according to the changed avatar-based image.

Description

Device and method for managing user information based on image

SUMMARY OF THE INVENTION The present invention is directed to an apparatus and method for managing user information and, more particularly, to an apparatus and method for managing user information based on images indicative of user information.

As communication technologies are evolving and smart devices are more widely used, various types of user information can be collected. User information is information about the user, such as user profile information and/or vital record information. The user's life record information may include user schedule information or user health information, but is not limited thereto.

User information can be collected using user input, device sensing functions, device detection functions, and/or data analysis functions, but the method of collecting user information is not limited thereto.

Techniques are needed for effectively managing the user information so collected.

The information disclosed in this prior art section is known to the inventors prior to the concept of the invention or is the technical information obtained in the course of achieving the inventive concept. Thus, the information may contain information that does not form prior art known to the public in the country.

One aspect of the present invention is to provide an apparatus and method for efficiently managing user information by easily changing, adding, and/or checking user information based on images indicative of user information.

Another aspect of the present invention is to provide an apparatus and method for efficiently managing user information by easily inspecting and using available services based on images indicating user information.

Additional aspects of the invention will be set forth in part in the description which follows,

In accordance with an aspect of an exemplary embodiment of the present invention, an apparatus for managing user information is provided, the apparatus comprising: a display configured to display an avatar-based image; and a controller Controlling the display such that the display displays the avatar-based image based on user schedule information, changing the avatar-based image according to a user input indicating a request to change the avatar-based image, and Updating the user schedule information according to the changed avatar-based image.

The device can include a user input module configured to receive user input requesting user information for a particular time period, wherein in response to the user input, the controller controls the display to be based on the particular The user information of the time period displays a plurality of avatar-based images, and the plurality of avatar-based images are determined for a plurality of different time periods including the specific time period and respectively correspond to the plurality of different time periods.

The controller can control the display to display a plurality of avatar-based images, the device can further include a user input module configured to receive user input requesting user information for a particular time period, in response to the The user input, the controller may control the display to display the plurality of avatar-based images according to the user information of the specific time period, and the plurality of avatar-based images may be included in the Determined by the subject item in the user information for a specific period of time.

The apparatus can further include a user input module configured to receive a user input requesting display of changeable information regarding the avatar-based image, wherein the controller controls in response to the user input The display displays the changeable area and the unchangeable area in the avatar-based image in a distinguishable manner.

The controller may check a supply period set for the avatar-based image and control the display not to display the avatar-based image when the supply period has expired.

The controller can control the display to display the avatar-based image based on a user's health information, the device can further include a user input module configured to receive user input indicative of a medical information request, And the controller can control the display to display medical information related to the health information in response to the user input, and receive information about the displayed medical information based on the user input module After the user of the selected medical information is input, the user schedule information is updated according to the selected medical information.

The apparatus can further include a user input module configured to receive user input indicating information to be added to the avatar-based image, wherein the controller controls the display to display for receiving a to-be-added An input input window of the information, and the controller adds an image corresponding to the information received via the input window to the avatar-based image, and according to the inclusion of the added image The user schedule information is updated based on the avatar image.

The controller can control the display to display the avatar-based image based on future hope information of the user, the device can further include a user configured to receive information requesting information about the future desired information Input user input module, and the controller may control the display to display the information related to the future hope information according to the user input, and according to the selected future information related to the future The information of the information updates the user schedule information.

The controller can control the display to display a plurality of avatar-based images based on usage history information of the device, the device can further include usage history information configured to receive each usage period requesting the device The user inputs a user input module, and in response to the user input, the controller can control the display to display the plurality of avatar-based images.

The controller can control the display to display the avatar-based image based on user information registered in the social media, the device can further include receiving a user input requesting to change the avatar-based image a user input module, and the controller may change the avatar-based image in response to the user input, and update the registered in the social media according to the changed avatar-based image User information.

In accordance with another aspect of an exemplary embodiment of the present invention, a method of managing user information is provided, wherein the method is performed by a device, the method comprising: based on user schedule information on a display of the device Displaying an avatar-based image; changing the avatar-based image according to a user input indicating a request to change the avatar-based image; and updating the user schedule information according to the changed avatar-based image.

The displaying may include displaying a plurality of avatar-based images according to user information of a specific time period, wherein the plurality of avatar-based images are determined for a plurality of different time periods including the specific time period and respectively correspond to the plurality of Different time periods.

The displaying may include displaying a plurality of avatar-based images according to user information for a specific time period, wherein the plurality of avatar-based images are determined according to a theme item included in the user information of the specific time period.

The method can further include displaying the changeable area and the unchangeable area in the avatar-based image in a distinguishable manner in response to requesting display of user input of changeable information.

The method may further include: checking a supply period set for the avatar-based image; and controlling the display to not display the avatar-based image when the supply period has expired.

The method may further include: displaying the avatar-based image on the display according to the user's health information; providing medical information about the health information according to a user input indicating the medical information request; The medical information selected by the medical information has been provided to update the user schedule information.

The method may further include, after receiving a user input indicating information to be added to the avatar-based image, displaying an input window for receiving the information to be added on the display; Adding an image of the information received by the input window to the avatar-based image; and updating the user schedule information according to the avatar-based image including the added image.

The method may further include: displaying the avatar-based image according to a future hope information of the user; and providing information related to the future hope information according to a user input requesting the information related to the future hope information; And updating the user schedule information according to information selected from the information related to the future hope information.

The method can further include displaying a plurality of avatar-based images according to a usage history of each usage period of the device in accordance with user input requesting the usage history information.

The method may further include: displaying the avatar-based image according to user information registered in the social media; changing the avatar-based image by changing user input of the avatar-based image according to the request; The altered avatar-based image updates the user information registered in the social media.

According to another aspect of an exemplary embodiment of the present invention, a method for visually managing and displaying user information is provided, the method comprising: displaying an avatar-based image modified according to user information on a display of the device Receiving, by the user input requesting the change of the avatar-based image, the device; receiving the changed input of the avatar-based image; displaying the changed avatar-based image; The changed avatar-based image updates the user information.

The user information may be user scheduling information.

The avatar-based image displayed may include a plurality of images, each image depicting different types of user schedule information.

The displaying the avatar-based image may include displaying a plurality of avatar-based images, and each avatar-based image is modified according to user schedule information corresponding to different time periods.

The different time periods may include weekends and workdays.

The different time periods may include different days of the work week.

The user information may include user health information.

The user health information can be received from an external device.

The user information may include usage information of the device.

Reference will now be made in detail to the exemplary embodiments embodiments In this regard, the exemplary embodiments of the present invention may have various forms and should not be construed as being limited to the descriptions set forth herein. Therefore, the illustrative embodiments are merely described below by referring to the figures. In the description of the present invention, a specific detailed explanation of the related art is omitted when it is considered that such explanation may unnecessarily obscure the essence of the inventive concept.

Although such terms as "first," "second," etc. may be used to describe various components, such components are not limited to the above terms. The above terms are only used to distinguish one component from another.

All terms including descriptive or technical terms used herein are to be interpreted as having a significant meaning to those skilled in the art. However, the terms may have different meanings depending on the intention of the person skilled in the art, the precedent situation or the appearance of new technology. Also, some terms may be arbitrarily selected by the applicant, and in this case, the meaning of the selected terms will be described in detail in the detailed description of the present invention. Therefore, the terms used herein must be defined based on the meaning of the terms along with the description throughout the specification.

Expressions used in the singular encompasses the plural forms of expression unless they have a clearly different meaning in the context. In the present specification, it is to be understood that the terms such as "including" or "having" are intended to indicate the presence of the features, the figures, the steps, the acts, the Or the possibility of adding one or more other features, numbers, steps, actions, components, components or combinations thereof.

The term "and/or" as used herein includes any and all combinations of one or more of the associated listed items. An expression such as "at least one of" is used to modify the entire list of elements before the list of elements.

According to an exemplary embodiment, the user information may include user profile information.

User profile information can include information about the user's gender. The user profile information can contain information about the user's name. User profile information can include information about the user's age. User profile information can include information about the user's nationality.

Moreover, the user profile information may include information about the area in which the user currently lives. The user profile information can contain information about the company name in which the user is working. User profile information can include information about the location of the company in which the user works. User profile information can include information about the user's preferences.

Also, the user profile information may include information about where the user was born. The user profile information can contain information about the user's occupation. The user profile information may include information about the user's family, such as information about whether the user has parents and children. The user profile information may include information about the user's pet, such as information about whether the user has a pet and the type of pet. User profile information can include information about the user's interests (such as classical guitar, sports, football, economy, travel, games, and books). However, the user profile information according to an exemplary embodiment is not limited thereto.

Also, the user profile information may be referred to as user profile information (hereinafter, also referred to as social media profile information) registered in social media (such as Facebook, Twitter, Blog, YouTube, or LinkedIn).

The social media profile information may include keywords, photos, places, times, and/or events (eg, photo shows, art shows, baseball games, football matches, concerts, or plays), each of which is published by the user via analysis The context, vocabulary, images, and/or tags are detected, but are not limited thereto.

The user information according to an exemplary embodiment may include user information registered in a website (eg, Naver, Yahoo, or Google) (eg, membership information in the game, game level information, product information, usage information, and/or Or explore information).

User information according to an exemplary embodiment may include user information registered in each application installed in the device. The applications installed in the device can be, for example, scheduled applications, game applications, service center applications, membership applications, customer centre applications, market applications, life log management applications, map applications or In the future, I hope that the information management application (for example, the wish list management application or the wish list management application) is not limited to this.

According to an exemplary embodiment, the user information may include information obtained by the device based on the interaction or input/output according to the interaction between the device and the user.

The information obtained by the device may include search history information. The information obtained by the device may include mail history information. The information obtained by the device may include message history information, wherein the message may be a short message, a multi-message or a voice message. The information obtained by the device may include browsing history information.

Moreover, the information obtained by the device may include social media usage history information (social network service (SNS) history information). The information obtained by the device may include telephone call history information. The information obtained by the device may include album history information. The information obtained by the device may include network history information. The information obtained by the device may include content history information. However, the information obtained by the device is not limited to this.

The search history information may include at least one piece of information obtained when executing a search application installed in the device, for example, a list of search words (or query languages), the number of times each search word was searched, the search date, and/or Or the number of search results.

The mail history information may include at least one piece of information obtained when executing a mail application installed in the device, for example, a list of transmitted and received mails, the number of transmitted and received mails, and deleted mail. The number, the list of senders, the number of messages transmitted by each sender, the list of recipients, the number of messages received by each recipient, and/or the date of the transmitted and received mail.

The message history information may include at least one piece of information obtained when executing a message application installed in the device, for example, a list of transmitted and received messages, the number of transmitted and received messages, and deleted messages. The number, the list of senders, the number of messages transmitted by each sender, the list of receivers, the number of messages received by each receiver, and/or the date of the transmitted and received messages.

The browsing history information may include at least one piece of information obtained when executing a browsing application installed in the device, such as a list of uniform resource locators (URLs), the number of times each URL is accessed, or a URL. Link information.

The social media usage history information may include at least one piece of information obtained when executing a social media service application installed in the device, such as the number of announcements and/or the number of comments. For example, the social media usage history information may include historical information based on at least one of the following (eg, a list of keywords, a number of times each keyword is generated, a list of locations, and each visited location) The number of times, the user's activity based on the time of the SNS and/or the number of times each event was viewed): keywords, photos, places, times, and/or events (eg, photo exhibitions, art exhibitions, baseball games, football matches, Concert or drama), each of which is detected by analyzing context, vocabulary, images, and/or tags posted by the user.

The phone call history information may include at least one piece of information obtained when executing a phone call application installed in the device, such as the number of video calls performed, the duration of the video call, the target of the video call, for each The number of video calls made by the target, the duration of the video call for each target, the number of voice calls made, the duration of the voice call, the target of the voice call, the number of voice calls made to each target, and/or The duration of the voice call for each target.

The album history information may include at least one piece of information about a still image and/or a moving image obtained when executing a camera application installed in the device, such as a place where the photo or video was taken, photographed or recorded. Target information (eg, person, object or animal) and/or date/time such as the location of the photo or video.

The web history information may include at least one segment of the device's network connection information. Internet connection information can include, for example, information about whether a Wi-Fi network is connected, the number of times Wi-Fi is accessed, the name of the Wi-Fi device being accessed, information about the Wi-Fi network, and Bluetooth Information about whether the network is connected, the number of Bluetooth accesses, the name of the Bluetooth device being accessed, information about whether to contact near field communication (NFC), the number of times of contact with NFC, details of using NFC, The details of the beacon or/and the details of accessing the Zigbee are accessed, but the network connection information according to an exemplary embodiment is not limited thereto.

The content history information may include content generated by using the device and information about the content. The content history information may include content shared with another device and information about the content. The content history information may include content transmitted to another device and information about the content.

Also, the content history information may include content received from another device and information about the content. The content history information according to an exemplary embodiment is not limited thereto. For example, the information about the content included in the content history information may include a date when the content is generated, a data amount of the content, a search keyword of the content, a name of a device that generates the content, a name of a device that transmits the content, or The name of the device that receives the content.

According to an exemplary embodiment, the user information may include device configuration information set in the device. The device configuration information may include, for example, a name of the device, account information, a backup account, and/or a name of an external device (or peripheral device), but the device configuration information according to an exemplary embodiment is not limited thereto.

According to an exemplary embodiment, user information may be stored in the device. According to an exemplary embodiment, user information may be received from at least one external device connected to the device. The at least one external device may comprise a wearable device such as a smart watch or smart glasses. The at least one external device can include an application accessory. The at least one external device can include a medical device. The at least one external device can include a vehicle. The at least one external device may include a server, such as a question and answer (QA) server or a game server. The at least one external device may include an Internet of Things (IoT) network-based device (hereinafter referred to as an IoT device). The at least one external device may include an IoT network based sensor (hereinafter referred to as an IoT sensor). The at least one external device may comprise a device such as a game console.

User information received from the at least one external device may include a value sensed (or measured) by the at least one external device. User information received from the at least one external device may include information collected by the at least one external device. The information collected by the at least one external device may include information detected or analyzed by the at least one external device. However, the user information received from the at least one external device is not limited thereto.

The value sensed by the at least one external device may include health information of the user. The activity information of the user may be included by the value of the at least one external device. The value sensed by the at least one external device is not limited thereto.

The user's health information can include information about the number of hours of exercise. The user's health information can include information about the heart rate during the duration of the exercise. The user's health information can include information about the pulsating oxygen measurement method during the duration of the exercise. The user's health information can include information about calorie consumption during the duration of the exercise. The user's health information may include information about the user's distance traveled during the duration of the exercise.

Also, the user's health information may include information about the skin temperature of the user during the duration of the exercise. The user's health information may include information about the number of steps the user took during a time period, such as a day. The user's health information may include information about the user's skin electrical response during the duration of the exercise. The user's health information can include information about the user's sleep duration. The user's health information can include information about the user's sleep patterns. The user's health information can include information about the user's blood glucose level.

Also, the user's health information may include information sensed or measured by the medical device, such as information about body composition, blood vessel age, blood pressure, meridian system, and/or pulse.

The user's activity information may include information indicating walking. The user's activity information may include information indicating the running. The user's activity information may include information indicating that they are staying at one location. The user's activity information may include information indicating sleep.

Also, the user's activity information may include information indicating transportation, such as a car, bus, train, airplane, or boat. The user's activity information can include information about when the user stayed at a location. User activity information can include information about places that users often visit.

Moreover, the user's activity information may include information about people frequently seen by the user. The user's activity information can include information about the meeting the user is participating in. User activity information can include information about the party the user is participating in. However, the activity information of the user according to an exemplary embodiment is not limited thereto. The user's activity information may include portions of the health information (such as the number of hours of exercise) described above.

The information collected by the at least one external device may include information collected by the server, but is not limited thereto. The information collected by the server may include information in which the user's questions and search results are mapped to each other. The information collected by the server may include information obtained by the device described above, such as a game level or a level of exercise. The information collected by the server is not limited to this.

According to an exemplary embodiment, the user information may include physiological information of the user. Moreover, the user information may include the user's psychological information. User information can include the user's social information. User information can include user schedule information. User information can include future hopes of the user, such as a wish list or wish list information. User information may include information about usage history information for each usage period of the device.

The user's physiological information may include information about the face, such as facial shape, eye color, nose shape, mouth shape, eye shape, and/or eyebrow shape. The user's physiological information can include information about the user's height. The user's physiological information may include information about the user's hair style, such as short hair, long hair, curly hair, straight hair or wavy hair. The user's physiological information may include the user's facial information. The user's physiological information may include the user's weight information. According to an exemplary embodiment, the physiological information of the user is not limited thereto. The user's physiological information may include, for example, information about the user's gender and/or age.

The user's psychological information may contain information about the taste of the user, such as food taste. The user's psychological information may include information about the user's tendency, such as user preference information based on bookmark information, frequently executed application information, application execution time information, book purchase record information, video rental record information (or Video on demand (VOD) download information), magazine subscription information, music download information and / or product purchase list information.

Moreover, the user's psychological information may include information about the user's preferences, such as preference information based on website search list information and/or hobby information. The user's psychological information may contain information about the user's emotions, such as information indicating happiness, sadness, fear, anger, surprise, greeting, or disgust. The user's psychological information is not limited to this. For example, the user's psychological information may include information about the interests described above.

The user's social information can contain information about the user's academic background. The user's social information can contain information about the user's work. The user's social information may contain information about the user's job description. The user's social information can include information about the user's party. According to an exemplary embodiment, the social information of the user is not limited thereto.

The user's schedule information may include information input by the user by using the schedule application, but is not limited thereto. The user's schedule information can contain information about the user's past, present, and future. The user's schedule information may include user information based on at least one of time, day, month, year, and season.

The user's schedule information can be categorized based on the subject item. Examples of subject matter items include at least one of: travel, company, study, bicycle, meeting, appointment, movie, sports, shopping, hospital, beauty, diet, game, party, hiking, night life, birthday party , performance or / and business travel. According to an exemplary embodiment, the subject matter is not limited thereto.

User information may include all or part of user information managed by personal information management software (PIMS). The user information may include at least one of all or part of the information included in the user's life log information.

User information may be expressed in the form of user modeled information or user personal information such that the use of the device, external device or service provider (eg, providing a customized service for the user) is effectively performed.

User information can be based on an avatar's image representation in a two-dimensional (2-dimensional; 2D) or 3D model. User information can be represented by a virtual image or a virtual self graphic icon.

Hereinafter, one or more exemplary embodiments will be described in detail with reference to the accompanying drawings.

1 illustrates an example of an apparatus 100 for displaying an avatar-based image and displaying information indicative of a changeable image from the avatar-based image based on the travel schedule information of the user, in accordance with an illustrative embodiment.

Referring to Figure 1, device 100 can display an avatar-based image based on the user's travel schedule information. The avatar-based image shown in FIG. 1 includes duration information 101 about the date of travel, an avatar 102 indicating the user, a photo 103 of the trip, an image 104 of the package, information 105 indicating that the photo 103 is a changeable image, The image 104 of the indication packet is information 106 that can change the image and the information 107 indicating that the duration information 101 is a changeable image. That is, as shown in FIG. 1, the information 105 to 107 indicating the changeable image may be a circle at various positions on the display screen of the device 100, the circle having a texture located therein. However, this situation is only an example.

The avatar-based image based on the travel schedule information is not limited to the image shown in FIG. For example, an avatar-based image may contain graphics, photos, or text about multiple travel preparations. The duration information 101 can be omitted based on the avatar-based image. The avatar-based image may further include information indicating that the avatar 102 is a changeable image.

Device 100 may indicate information 105 through 107 of FIG. 1 via another method. For example, device 100 can change the brightness of a changeable image in a uniform or variable period of time. Alternatively, device 100 may be eye-catching to change the image.

The device 100 can display information in different ways to change the image according to the image indication. For example, device 100 may change the brightness of photo 103 in a uniform or variable time period, highlight the image 104 of the packet, and periodically flash duration information 101.

2 is a flow diagram of a method of managing user information, wherein device 100 displays an avatar-based image based on user schedule information and updates user schedule information by changing avatar-based images, in accordance with an exemplary embodiment.

In operation S201, the device 100 displays an avatar-based image based on the user schedule information. The user schedule information may be information stored in a schedule application installed in the device 100, but is not limited thereto. For example, user schedule information can be received from an external device connected to device 100.

The device 100 can generate an avatar-based image based on the ontology-based user modeling information. Ontologies can describe the relationship between words, between words and concepts, or between concepts in formal language.

The formal language may include, for example, a language such as hasHobby, hasSize, A (isA), or Cause, but the formal language according to an exemplary embodiment is not limited thereto. A formal language with a hobby as a relationship between the indicators. A formal language with a size that is the size of the relationship between the indicators. A is a formal language that indicates the inclusion relationship between words. Make a formal language that is the cause and effect relationship between the words. For example, "requires rest due to overwork" can be expressed by (overwork, rest) by reason of use.

User modelling information may be generated by an external device connectable to device 100.

FIG. 3 illustrates an example of user modeling information regarding user schedule information generated by device 100, in accordance with an illustrative embodiment.

The user modeling information of FIG. 3 is generated by using a resource description framework (RDF) data model. The device 100 may generate user model information according to an ontology web language (OWL) or a semantic web rule language (SWRL).

Referring to Figure 3, the user modeled information includes a subject field, a predicate field, and an object field. The subject field is the field of the subject related to the user's information. In FIG. 3, the subject of the user information is the first user User_1. Here, the first user User_1 is shown as an individual by using categories and resources. The execution entity of the resource definition category.

The predicate field of Figure 3 is a formal language field indicating the relationship between words contained in the subject field and the object field. Referring to Figure 3, the formal language included in the predicate field contains a formal language about gender, a formal language about travel scheduling, and a formal language about travel preparation. However, the formal language included in the predicate field according to an exemplary embodiment is not limited thereto. For example, a formal language about travel scheduling can be referred to as a formal language for scheduling. The formal language for travel preparation can be referred to as the formal language for preparation or travel inspection projects.

The device 100 may express the female in the object field as the gender of the first user User_1 according to the formal language of the gender. The device 100 may express the first to fifth travel locations in the object field as the travel location (or destination) of the first user User_1 according to the formal language of the travel schedule. The device 100 may express the first to fourth preparations in the object field as the travel preparation of the first user User_1 according to the formal language regarding the travel preparation.

The device 100 can generate an avatar-based image by using object information (female, first to fifth travel locations, and first to fourth preparations) of the object field included in the user model information. The object information of the object field can be used as identification (ID) information for generating an avatar-based image.

In order to produce an avatar-based image. The device 100 can store a plurality of object images. The plurality of object images can be stored in an external device connectable to the device 100.

The plurality of object images may include a number of images corresponding to the number of segments of the article information included in the object field of FIG. The plurality of object images may include an avatar, a photo, a moving image, a graphic, and/or a character, but is not limited thereto according to an exemplary embodiment.

4 is a table for describing a relationship between a plurality of segments of article information stored in device 100 and a plurality of object images, in accordance with an exemplary embodiment.

Referring to Figure 4, each segment of the object information contained in the object field has a corresponding object image. The device 100 can read the object image from the memory of the device 100 by using the object information as the ID information. When a plurality of segments of the article information of FIG. 4 and object images are stored in an external device connected to the device 100, the device 100 can receive the object image from the external device by using the object information.

The device 100 can generate and display an avatar-based image of the image as shown in FIG. 1 by combining the generated object images. Referring to FIG. 4, the avatar-based image shown in FIG. 1 may be an image generated by combining a female avatar corresponding to a female, an object image corresponding to the first travel location, and an image corresponding to the first prepared object.

Returning to FIG. 2, in operation S202, the device 100 may receive a user input indicating that the avatar-based image as shown in FIG. 1 is changed. Examples of user input may include touch-based user input, voice-based user input, and gesture-based user input, although user input in accordance with an exemplary embodiment is not limited thereto.

5A-5E are diagrams for describing an example in which device 100 changes an avatar-based image, in accordance with an illustrative embodiment. In FIGS. 5A to 5E, the preparation for traveling changes.

Referring to FIG. 5A, when the image 104 receiving the selection indication packet is a user input of the information 106 that can change the image, the device 100 displays the images 501 to 504 for the first to fourth preparations respectively as shown in FIG. 5B. An avatar-based image. If the first preparation is a bag, the device 100 may display the images 502 to 504 regarding the second to fourth preparation, respectively. If the first preparation is a package and the device 100 displays the images 501 to 504 for the first to fourth preparations, respectively, the device 100 may display the same image as the image 104 of the package as the image 501 regarding the first preparation. The device 100 can display an image 501 regarding the first preparation having a display size that is smaller than the display size of the image 104 of the package. Also, device 100 may display change button 505, add button 506, and/or completion button 507.

In FIG. 5B, upon receiving the user input of the selection change button 505, the device 100 changes the display states of the first to fourth prepared images 501 to 504 as shown in FIG. 5C, respectively. Therefore, the user recognizes that the first to fourth preparations can be changed.

Upon receiving a user input selecting the first prepared image 501 in FIG. 5C, the device 100 displays detailed information about the first preparation, as shown in FIG. 5D.

Referring to FIG. 5D, detailed information about the first preparation may be provided by displaying the highlight window 508 near the first prepared image 501, but the illustrative embodiments are not limited thereto. Since the detailed information provided via the quick display window 508 is detailed information about the first preparation, the user can delete or change the first preparation while viewing the detailed information via the quick display window 508. Device 100 can display detailed information in different display areas rather than in quick display window 508. For example, the detailed information can be displayed via the area in which the duration information 101 is displayed.

When the user selects the pop-up window 508 displaying the detailed information as shown in FIG. 5E, the device 100 can display further detailed information about the first preparation. Device 100 can provide more detailed information by using another page. When more detailed information is provided by using another page, the device 100 can change the picture of FIG. 5E to a page that provides more detailed information.

6A-6E are diagrams for describing another example of device 100 changing an avatar-based image, in accordance with an illustrative embodiment. In FIGS. 6A to 6E, the route of travel changes.

Referring to FIG. 6A, upon receiving a user input of the selection information 105, the device 100 displays images 601 to 605 indicating the first to fifth travel locations and information indicating the order of visiting the first to fifth travel locations (eg, an arrow) ) along with images based on avatars. Images 601 through 605 can contain textual information. Text information can include the name of the travel location. Images 601 through 605 may contain symbols, indicia, icons, or thumbnails of representative images of the travel location.

Referring to FIG. 6B, the device 100 displays the image 601 indicating the first travel location in a manner of distinguishing between the image 601 and the images 602 to 605 indicating the second to fifth travel locations, so that the user can easily recognize that it is included in the avatar-based image. A photo 103 of the travel location in the image corresponds to the first travel location. For example, in FIG. 6B, device 100 may highlight the image 601 indicating the first travel location.

Device 100 may display change button 606, add button 607, and/or completion button 608 along with an avatar-based image. The completion button 608 is a button for receiving user input to complete a change operation and/or an addition operation of the avatar-based image displayed on the device 100.

When the user input of the selection change button 606 is received in FIG. 6B, the device 100 changes the display state of the images 601 to 605 as shown in FIG. 6C. Therefore, the user easily recognizes that the images 601 to 605 can be changed.

In FIG. 6D, when receiving a user input of the moving image 601 to the image 602, the device 100 changes the configuration of the images 601 to 605 as shown in FIG. 6E while changing the photo 103 based on the first travel location. A photo 609 based on the second travel location shown in FIG. 6D. Thus, the user recognizes that the route has been changed to cause the second travel location to first tour.

Referring again to FIG. 2, when the user selects the completion button 608 after checking the changed route as shown in FIG. 6E, the device 100 updates the travel schedule information based on the avatar-based image to make the travel schedule in operation S203. The information becomes the order of the original second travel place, the original first travel place, the third travel place, the fourth travel place, and the fifth travel place as shown in FIG. 6E.

7 is a flow diagram of a method of managing user information, wherein device 100 displays an avatar-based image based on user schedule information, and by adding information based on the displayed avatar-based image, in accordance with an illustrative embodiment. Update user schedule information.

Referring to FIG. 7, in operation S701, the device 100 displays an avatar-based image based on user schedule information. As described above with reference to operation S201, the device 100 can display an avatar-based image based on the user schedule information.

In operation S702, upon receiving a user input indicating addition, the device 100 displays an input window. Device 100 can display the input window as a separate window.

In operation S703, when receiving information via the input window, the device 100 adds an image corresponding to the received information to the avatar-based image. For example, when the received information is a passport, the device 100 may add an image corresponding to the passport to the avatar-based image. That is, in the case of a passport, the user can type in the word "passport" via the input window, and can then be prompted to add an image of the passport. For example, the passport image can be received by the user scanning the passport into the device 100, or can be received by the user using the device 100 to take an image of the passport. Additionally or alternatively, device 100 may pre-store images that may correspond to received information. Images that may correspond to the received information may be stored in an external device connectable to device 100. Search keywords or search ID information can be assigned to each image corresponding to the received information. The device 100 can search for an image corresponding to the received information by using a search keyword or search ID information. For example, in the case of a passport, the passport image can be stored on an external device and the passport image can be searched by the device 100.

As long as a letter (or an alphabet) is received, the device 100 can search for and provide at least one candidate image (or multiple candidate images) corresponding to the received information. For example, at least one candidate image corresponding to the received information when receiving the letter "p" may be different or identical to at least one candidate image corresponding to the received information when the letter "pa" is received. Upon receiving a signal to select a candidate image, device 100 may add the selected candidate to the avatar-based image.

In operation S704, the device 100 updates the user schedule information according to the avatar-based image to which the image is added.

8A-8C are diagrams for describing another example of device 100 changing an avatar-based image, in accordance with an illustrative embodiment. In FIGS. 8A to 8C, the device 100 is added for preparation.

When a user input indicating the addition of information based on the add button 506 is received in FIG. 8A, the device 100 displays the input window 801 as shown in FIG. 8B. When the information about the fifth preparation is input via the input window 801 and the user input of the selection input button 802 is received, the device 100 adds the image 803 indicating the fifth preparation to the avatar-based image as shown in FIG. 8C.

The device 100 can display an image 803 that can be distinguished from the images 501 through 504. Therefore, the user easily recognizes that the image 803 corresponding to the fifth preparation is added.

When the user input of the selection completion button 507 is received in FIG. 8C, the device 100 updates the user schedule information based on the avatar-based image to which the image 803 is added. Therefore, the images 501 to 504 corresponding to the first to fourth preparations included in the user schedule information become the images 501 to 504 and 803 corresponding to the first to fifth preparations. Thus, the user can then be prompted to enter an image corresponding to the fifth preparation for display with the avatar.

9 is a flowchart of a method of managing user information, wherein the device 100 displays a plurality of avatar-based images according to user schedule information for a specific time period, and according to the plurality of avatar-based images, according to an exemplary embodiment A change in at least one of the images updates the user schedule information.

In operation S901, the device 100 receives a user input indicating a request for user schedule information for a specific time period. The specific time period can be set based on the date information. The specific time period can be set based on the number of days. The specific time period can be set based on the weekly unit. The specific time period can be set based on time. However, the specific time period according to an exemplary embodiment is not limited thereto.

In operation S902, the device 100 displays a plurality of avatar-based images according to the weekday and weekend user schedule information. Here, weekdays and weekends are weekdays and weekends that are included in a specific time period. For example, when the specific time period is from February 2, 2015 to February 15, 2015, the device 100 may display an avatar-based image according to the work schedule information of the working day from February 2 to February 6 An avatar-based image of user schedule information based on weekends from February 7 to February 8, an avatar-based image based on user schedule information for weekends from February 9 to February 13, and according to February 14 An avatar-based image of user schedule information for the weekend to February 15.

The device 100 changes at least one of the plurality of avatar-based images when a plurality of avatar-based images are displayed while receiving a user input indicating a change in operation S903.

In operation S904, the device 100 may update the user schedule information according to at least one of the plurality of avatar-based images that have changed.

10 illustrates an example of an avatar-based image 1001 based on weekday user schedule information and an avatar-based image 1002 based on weekend user schedule information, in accordance with an illustrative embodiment.

11 is a flowchart of a method of managing user information, wherein the device 100 displays a plurality of user schedule information according to each topic item based on a request for user schedule information for a specific time period, according to an exemplary embodiment. An avatar-based image, and updating user schedule information by changing at least one of the plurality of avatar-based images.

Referring to FIG. 11, after receiving a user input indicating a request for user schedule information for a specific time period in operation S1101, the device 100 displays a plurality of based on the user schedule information according to each theme item in operation S1102. An image of an avatar. Here, the topic item is included in the user schedule information for a specific time period.

In operation S1103, the device 100 changes at least one of the plurality of avatar-based images according to a user input indicating the change. In operation S1104, the device 100 updates the user schedule information according to at least one of the plurality of avatar-based images that have changed.

12A through 12C are diagrams for describing a plurality of avatar-based images for displaying each of the subject items included in the user schedule information of the specific time period of FIG. 11 and changing the plurality of based based on an exemplary embodiment A diagram of an instance of at least one of the images of the avatar.

Referring to Figure 12A, device 100 displays a plurality of avatar-based images 1201 through 1204 for each of the subject items from February 1 to February 8, 2015.

When the user input selecting the avatar-based image 1201 is received from the plurality of avatar-based images 1201 to 1204 of FIG. 12A as shown in FIG. 12B, the device 100 may enlarge the avatar-based image 1201 and as shown in FIG. 12C. The image is displayed on the entire screen of the device 100.

Referring to FIG. 12C, the avatar-based image 1201 can include a change button 1205, an add button 1206, and/or a finish button 1206. In FIG. 12C, changing the range may include changing the bicycle ride to another subject item (or another user activity) or canceling the bicycle ride, but the scope of the change according to an exemplary embodiment is not limited thereto. For example, when the bicycle ride becomes unscheduled, the device 100 can change the avatar-based image 1201 to the avatar-based image 1204 of FIG. 12A.

The range of options for adding in Figure 12C may include adding a date theme item with B to the bicycle ride. In this case, the device 100 can add an image related to B to the avatar-based image 1201. The range of options for addition according to an exemplary embodiment is not limited thereto.

13 is a flow diagram of a method of managing user information, wherein device 100 manages life of an avatar-based image, in accordance with an illustrative embodiment.

In operation S1301, when the supply period is set with respect to the avatar-based image, the device 100 checks the supply period. The supply period can be counted based on the date. The supply period can be counted based on time. The supply period may be counted based on the number of times provided. According to an exemplary embodiment, the basis of counting the supply period is not limited thereto.

It is then determined in operation S1302 that the supply period has expired. When it is determined that the supply period has expired (S1302, YES), the device 100 removes the avatar-based image in operation S1303. The avatar-based image can be removed by deleting the avatar-based image stored in device 100. The avatar-based image can be stored in an external device connected to the device 100. At that time, the avatar-based image is stored in an external device, and the device 100 can transmit a command to delete the avatar-based image to the external device.

14 is a flow diagram of a method of managing user information, wherein the device 100 displays an avatar-based image based on the user's health information and updates the user schedule information based on the selected medical information, in accordance with an exemplary embodiment.

In operation S1401, the device 100 displays an avatar-based image based on the user's health information. The health information may be received from an external device, but the illustrative embodiments are not limited thereto. Health information can be obtained by executing a health application installed in the device 100.

In operation S1402, the device 100 provides medical information related to the health information according to a user input indicating the medical information request. For example, when the health information indicates that the user has caught a cold, the device 100 can provide medical information related to the cold.

In operation S1403, the device 100 updates the user schedule information based on the medical information selected based on the provided medical information.

15A-15E are diagrams for describing an example in which the device 100 displays an avatar-based image based on a user's health information, provides medical information based on health information, and updates user schedule information according to the selected medical information, according to an exemplary embodiment. Figure.

In FIG. 15A, the device 100 displays an avatar-based image of a nose with fever and runny nose based on the health information of the user received from the smart bracelet 1500.

When a user input indicating a medical information request is input, the device 100 provides a function table item including a hospital item 1511, a pharmacy item 1512, a drug item 1513, and a self-therapy item 1514 as shown in FIG. 15B. For example, upon receiving a user input that touches the avatar-based image of FIG. 15A for a threshold period of time, device 100 may provide the menu item of FIG. 15B. The function table items provided according to an exemplary embodiment are not limited thereto.

When the user input selecting the hospital item 1511 is received in FIG. 15B, the device 100 provides sub-items of the hospital item 1511 as shown in FIG. 15C, such as the B hospital 1521, the C hospital 1522, and the D hospital 1523. For example, when a user input that touches the hospital item 1511 for a threshold period of time is received in FIG. 15B, the device 100 may provide a sub-item of the hospital item 1511 as shown in FIG. 15C, that is, the B hospital 1521. C hospital 1522 and D hospital 1523.

When the user input of the selection C hospital 1522 is received as shown in FIG. 15D, the device 100 provides the reservation information about the C hospital 1522 as shown in FIG. 15E. For example, when a user input to touch C hospital 1522 for a threshold period of time is received in FIG. 15D, device 100 may provide the appointment information for C hospital 1522 in FIG. 15E.

When the user input 1531 indicating the reservation is received after the user checks the reservation information in FIG. 15E, the device 100 executes a program for making a reservation in the C hospital 1522. For example, when a user input of the touch reservation button 1532 for a threshold period of time is received after the user checks the reservation information in FIG. 15E, the device 100 may execute a program for generating a reservation. The program is executed by making a reservation at the C hospital 1522 based on the reservation information and the user information. Therefore, the server of the C hospital 1522 can store reservation information about the user.

When the process is completed, the device 100 updates the user schedule information based on the subscription information about the user in the C hospital 1522. Therefore, the reservation information in the C hospital 1522 can be included in (or registered in) the user schedule information stored in the device 100.

16 is a flowchart of a method of managing user information according to an exemplary embodiment of a user, wherein the device 100 displays an avatar-based image according to a user's future hope information and updates the information according to information selected from information related to future hope information. Schedule information.

In operation S1601, the device 100 displays an avatar-based image based on the user's future hope information. The future hope information may indicate the user's future work information, but is not limited to according to an exemplary embodiment. For example, future hope information may include a user's bucket list or wish list.

In operation S1602, the device 100 provides information related to future hope information according to a user input requesting information related to the future desired information. For example, when receiving a user input that touches an avatar-based image with a finger for a threshold period of time and then drags a finger in one direction, the device 100 can provide information related to future hope information.

In operation S1603, the device 100 updates the user schedule information based on the information selected from the information related to the future desired information. For example, when receiving a user's input of touching a piece of information related to future hope information with a finger and then dragging the finger in one direction, the device 100 may update the touched piece according to the information related to the future desired information. User scheduling information.

17A-17D are diagrams for describing an apparatus 100 displaying an avatar-based image according to a user's future hope information, providing information related to future hope information according to a request, and based on information selected by a user, according to an exemplary embodiment. A diagram of the program to update user schedule information.

Referring to Figure 17A, the device 100 displays an avatar-based image indicative of the art therapist based on the user's future hope information.

Upon receiving the user input 1701 requesting information related to future desired information, as shown in FIG. 17A, the device 100 provides the qualification check schedule item 1711, the certification center item 1712, and/or related as shown in FIG. 17B. Event item 1713 serves as information related to future hopes. For example, when the user input 1701 is received by touching the image displayed in FIG. 17A with a finger for a threshold period and dragging the finger in one direction, the device 100 provides information related to future hope information, such as The quality check schedule item 1711, the certification center item 1712, and/or the related event item 1713 are as shown in FIG. 17B.

When the user input selecting the related event item 1713 is received in FIG. 17B, the device 100 provides the first event item 1721, the second event item 1722, and the third event item 1723. For example, when the user input of the touch related event item 1713 for the threshold period is received in FIG. 17B, the device 100 may provide the first event item 1721, the second event item 1722, and the third event item 1723, The event item is registered in the sub-layer of the related event item 1713.

In FIG. 17C, upon receiving a user input selecting the second event item 1722, the device 100 provides detailed information regarding the second event item 1722. For example, when a user input that touches the second event item 1722 for a threshold period of time is received in FIG. 17C, the device 100 can provide detailed information regarding the second event item 1722.

The device 100 can provide detailed information about the second event item 1722 by opening a separate window 1724 proximate to the second event item 1722. The separate window 1724 can be displayed as a pop-up window having the shape of a speech bubble, but is not limited thereto.

In FIG. 17D, upon receiving a user input selecting the OK button 1725 included in the separate window 1724, the device 100 updates the user schedule information by using the information associated with the second event item 1722. For example, in FIG. 17D, when receiving a user input that participates in the OK button 1725 in a separate window 1724 for a threshold period of time, the device 100 can use information related to the second event item 1722. To update user schedule information. Therefore, the information related to the second event item 1722 is included in the user schedule information.

18 is a flowchart of a method of managing user information based on a plurality of avatar-based images based on usage history information of device 100, in accordance with an exemplary embodiment.

When the user input requesting the usage history information of the device 100 is received in operation S1801, the device 100 displays a plurality of avatar-based images according to the usage history information of each usage period of the device 100 in operation S1802. For example, when a user input indicating selection of a usage history information request for the device 100 included in the function table item provided by the device 100 is received in operation S1801, the device 100 may display according to operation S1802 Multiple avatar-based images of usage history for each usage period. In operation S1801, information of the usage period of the designating device 100 may be received. Information specifying the time period of use can be entered based on date, time, and/or day of the week.

19A and 19B are diagrams for describing each of the plurality of avatar-based images provided by the device 100 after receiving user input of the usage history information request of the pointing device 100, according to an exemplary embodiment. A diagram of an instance of historical information.

Referring to FIG. 19A, the device 100 displays a plurality of avatar-based images according to usage history information of the device 100 regarding weekdays 1910 and weekends 1920.

Referring to weekday 1910 of Figure 19A, device 100 uses the most phone call applications and the second most use of internet applications on weekdays 1910. Referring to the weekend 1920 of FIG. 19A, the device 100 uses the digital television (DTV) application at the weekend and the second most uses the Band application.

In FIG. 19A, upon receiving the user input 1911 of the next usage history information of the requesting device 100 on the weekday 1910, the device 100 may change based on the next usage history information of the device 100 on the weekday 1910 as shown in FIG. 19B. An avatar-based image of the working day 1910 shown. Referring to weekday 1910 of Figure 19B, device 100 uses the Kakao Talk application third and uses the camera application fourth on weekdays 1910.

In FIGS. 19A and 19B, according to an exemplary embodiment, the usage history information of the device 100 is provided based on an application installed in the device 100, but is not limited thereto.

20 is a flowchart of a method of managing user information according to an exemplary embodiment, wherein the device 100 displays an avatar-based image based on user information registered in the social media, and changes the displayed avatar-based based on user input. And updating the user information registered in the social media according to the changed avatar-based image.

In operation S2001, the device 100 displays an avatar-based image based on user information registered in the social media. User information registered in social media may be received from a social media server connected to device 100. For example, user information registered in Facebook may be received from a Facebook server connected to device 100.

User information registered in the social media may be provided from the social media server upon request by the device 100, or alternatively may be provided automatically from the social media server when the device 100 is connected to the social media server. According to an exemplary embodiment, a method of receiving user information registered in social media by the device 100 is not limited thereto.

In operation S2002, the device 100 changes the avatar-based image by changing the user input of the avatar-based image according to the request. The avatar-based image may be changed in operation S2002 in the same manner as described above with reference to operation S202 of FIG. 2.

In operation S2003, the device 100 may update the user information registered in the social media according to the changed avatar-based image. The device 100 can convert the changed avatar-based image into text information, and request the social media server to update the user information registered in the social media while transmitting the text information to the social media server. Therefore, the social media server can update the user information. After the user information is updated, the social media server can transmit an update completion message to the device 100. According to an exemplary embodiment, a method of updating user information registered in social media is not limited thereto.

21 is a block diagram of a system 2100 for managing user information that includes device 100, in accordance with an illustrative embodiment.

Referring to Figure 21, system 2100 includes device 100, network 2110, and external device 2120.

The device 100 may include, for example, a portable device, a wearable device, a home internet appliance, or a mobile device, but the device 100 according to an exemplary embodiment is not limited thereto.

The portable device can be a smart phone, a notebook computer, a smart console, a tablet PC, a handheld device, a handheld computer, a media player, an e-book device or a personal digital assistant (PDA), but according to The portable device of an exemplary embodiment is not limited thereto.

The wearable device may include devices such as smart glasses, smart watches, smart tapes (eg, smart belts or smart straps), smart clips, smart accessories (eg, smart rings) , smart bracelet, smart foot ring, smart hair clip or smart necklace), smart body protection (for example, smart knee guard or smart elbow guard), smart shoes, smart gloves , smart clothing, smart hats, smart artificial legs for people with disabilities, or smart artificial arms for people with disabilities, but not limited to this.

Home Internet appliances can include home appliances that form a machine to machine (M2M) or Internet of Things (IoT), such as smart TV, PC, desktop PC, smart refrigerator, smart Washing machine, smart light, smart duster, smart health device, smart oven, smart dishwasher, multimedia console, game console or smart water purifier, but home internet according to an exemplary embodiment Network appliances are not limited to this.

The mobile device may include a device (such as a car) that forms an M2M or IoT, but the mobile device according to an exemplary embodiment is not limited thereto.

The network 2110 may include, for example, an intranet, an Internetwork, an Internet, or a personal area network (PAN) (eg, a near field wireless communication network such as Bluetooth). Or home radio frequency (HomeRF), campus area network (CAN), local area network (LAN), wide area network (WAN), gaming network, Wi- Fi communication or Wi-Fi Direct communication, but the network 2110 according to an exemplary embodiment is not limited thereto.

The network 2110 can use at least one of the transmission media from the wired transmission medium and the wireless transmission medium. The wired transmission medium may include, for example, at least one of a coaxial cable, a twisted pair cable, and/or an optical fiber, but the wired transmission medium according to an exemplary embodiment is not limited thereto. The wireless transmission medium may include, for example, at least one of radio frequency waves, terrestrial microwaves, satellite microwaves, and/or infrared waves, but the wireless transmission medium according to an exemplary embodiment is not limited thereto.

The connection type of the network 2110 may be a star type, a mesh type, a tree type, a bus type, or a ring type, but is not limited thereto.

The network 2110 may use at least one of network connection devices such as a LAN card, a hub, a switch, a bridge, a gateway, a repeater, and/or a router, but the network connection device is not limited thereto.

The external device 2120 is a device that is disposed outside of the device 100 and that can be connected to the device 100. The external device 2120 can include a user's cloud server, a user information management server, a question and answer (QA) server, a service providing server (eg, a game server or an application server), or a social media server. However, the external device 2120 according to an exemplary embodiment is not limited thereto.

The external device 2120 can include a server, a medical device, a computing device, an application accessory, a wearable device, an IoT sensor, or an IoT device. The external device 2120 can be the same device as the device 100. The user of the external device 2120 can be the same as the user of the device 100. The user of the external device 2120 can be different from the user of the device 100.

The medical device can have a communication function and a function of sensing (or measuring) the user's health information. The medical device may include a home medical device (eg, a thermometer, a sphygmomanometer, a cholesterol meter, a blood glucose meter, a uric acid meter, or a massager), a hospital medical device (eg, an ultrasonic device, a body fat measuring device, a stethoscope, or an electrocardiogram (electrocardiogram; ECG) measuring device) or rehabilitation medical device (for example, a step belt, a moving belt, a knee board or a paraffin bath), but the medical device is not limited thereto.

The application accessory is a device that is controlled by using an application installed in the device 100. For example, application accessories include smart spheres, smart printers, smart wireless sphygmomanometers, smart recorders, smart positioning devices, smart microphones, smart thermostats, smart alarms or Smart toys.

In accordance with one or more exemplary embodiments, apparatus 100 may perform a method of managing user information. The device 100 can manage user information stored in the device 100 and/or user information stored in the external device 2120 connected via the network 2110. User information stored in device 100 can be received from external device 2120 and stored in device 100. User information stored in the external device 2120 can be received from the device 100 and stored in the external device 2120. The user information stored in the device 100 can be the same as the user information stored in the external device 2120. The user information stored in the device 100 may be different from the user information stored in the external device 2120. The portion of the user information stored in the device 100 can be the same as the user information stored in the external device 2120.

According to one or more exemplary embodiments, the device 100 may update user information stored in the device 100 and/or the external device 2120 by using user information changed by a method of managing user information. The device 100 can transmit the user information stored in the device 100 to the external device 2120 and request the external device 2120 to manage the user information.

22 is a flow diagram of a method of managing user information by device 100, in accordance with an illustrative embodiment. 23A-23F are diagrams for describing an avatar-based image displayed by device 100 based on user information, in accordance with an illustrative embodiment.

Referring to FIG. 22, in operation S2201, the device 100 displays an avatar-based image based on user information. For example, device 100 can generate and display avatar-based image 2310 based on user information 2300 of FIG. 23A. The avatar-based image 2310 is an image of the user of the symbolizing device 100. The avatar-based image 2310 can be represented by a 2D or 3D model avatar, a computer character, a user's virtual character, a user's virtual self-graphic representation, or a user graphical representation. According to an exemplary embodiment, the method of representing the avatar-based image 2310 is not limited thereto.

In operation S2201, the device 100 may display a plurality of avatar-based images based on user information, as shown in FIGS. 23B to 23F. (Operations S2202 and S2203 will be described later in detail later in the description of Figs. 31A to 31D.)

Referring to FIG. 23B, the device 100 displays an avatar-based image 2340 based on current user information (hereinafter referred to as the current image 2340), and an avatar-based image 2341 based on future user information (hereinafter referred to as a future image 2341). ).

Image 2340 and future image 2341 now have different hairstyles. These different hairstyles indicate that the hair style information contained in the current user information (for example, the user's hair style is a wavy hair) and the hair style information contained in the future user information (for example, the user's hair style is a short hair) are different. .

The hairstyle information included in the current user information may be based on photo information, but the illustrative embodiments are not limited thereto. For example, the hairstyle information included in the current user information can be input by the user. The hairstyle information included in the future user information may be based on the user's beauty salon appointment information, but the illustrative embodiments are not limited thereto. For example, the hairstyle information included in future user information can be input by the user.

The device 100 can display the current image 2340 and the future image 2341 by dividing the user information into a daily unit, a plurality of day units, a weekly unit, a monthly unit, or a yearly unit.

For example, when the user information is divided by the daily unit, the device 100 can generate and display the current image 2340 based on today's user information (for example, the user's schedule information today), and based on the user information of tomorrow ( For example, the user's schedule information for tomorrow generates and displays a future image 2341.

For example, when the user information is divided into weekly units, the device 100 may generate and display the current image 2340 based on the user information of the past week including the day, and generate the user information based on the next week including the next day. And display the future image 2341.

The current image 2340 and the future image 2341 displayed on the device 100 may be the same. In this situation, the current user information and future user information are the same.

The device 100 can generate the current image 2340 and the future image 2341 in other ways than those described above. For example, the device 100 may generate a current image of the school uniform 2340 and a future image of the police uniform based on information about the current job (eg, student) included in the user information and information about the ideal job (eg, police). 2341.

Alternatively, device 100 may generate and display future image 2341 based on a wish list or wish list included in the user information. For example, when ten items are included in the wish list, the device can generate and display ten avatar-based images based on the ten items as ten future images. For example, when ten futures are generated and displayed based on ten items, the device 100 may divide the area where the future image 2341 is displayed to simultaneously display ten future images, or may display ten future images in ten pages. However, the illustrative embodiments are not limited thereto.

In FIG. 23C, the device 100 according to an exemplary embodiment simultaneously displays an avatar-based image 2342 (hereinafter referred to as a past image 2342), a current image 2340, and a future image 2341 based on past user information.

Referring to Fig. 23C, the device 100 simultaneously displays past images 2342, now images 2340, and future images 2341 having different hairstyles. These different hair style instructions differ from each other in the past user information, current user information, and future user information.

As described above with reference to FIG. 23B, the device 100 can simultaneously generate and display the past image 2342, the current image 2340, and the future image 2341 based on the user information on a daily, several day, week, month, or year basis. For example, the device 100 may generate a current image 2340 based on the user information of the past week based on the user information of the current time based on the current time, and generate a future image 2341 based on the user information of the week after the current time, and based on The past image 2342 based on the user information of the past week is generated by the user information of the current image 2340.

In FIG. 23D, the device 100 according to an exemplary embodiment simultaneously displays an avatar-based image based on morning user information (hereinafter referred to as morning image 2343) and an avatar-based image based on afternoon user information (hereinafter Known as the afternoon image 2344). The device 100 may generate the morning image 2343 and the afternoon image 2344 based on the unit of day, day, week, month or year, but the unit for generating the morning image 2343 and the afternoon image 2344 is not limited thereto.

Referring to Fig. 23D, the morning image 2343 indicates that the user information contains the information "Working in the morning". Afternoon image 2344 indicates that the user information contains information "Violin lessons after work".

In FIG. 23E, the device 100 according to an exemplary embodiment simultaneously displays an avatar-based image 2345 based on weekday user information (hereinafter referred to as a workday image 2345) and an avatar-based image based on weekend user information. 2346 (hereinafter referred to as weekend image 2346).

Referring to Figure 23E, device 100 generates a weekday image 2345 based on user information from Monday to Friday. Moreover, device 100 can generate weekend image 2346 based on user information on Saturday and Sunday. The device 100 may generate a workday image 2345 and a weekend image 2346 based on weeks, weeks, months, years, or years of the unit, but the unit is not limited thereto.

Workday image 2345 indicates that the user information contains information "Going to work from Monday to Friday." Weekend image 2346 indicates that the user information contains information "ride to ride on weekends". According to an exemplary embodiment, the weekday image 2345 and the weekend image 2346 displayed on the device 100 are not limited to the image shown in FIG. 23E.

In FIG. 23F, the device 100 according to an exemplary embodiment simultaneously displays an avatar-based image 2347 (hereinafter referred to as spring image 2347) based on spring user information, and an avatar-based image based on summer user information. 2348 (hereinafter referred to as summer image 2348), avatar-based image 2349 based on autumn user information (hereinafter referred to as autumn image 2349) and avatar-based image 2350 based on winter user information (hereinafter Known as the winter image 2350).

Device 100 may generate spring image 2347 based on, for example, user information from March to May. Device 100 may generate summer image 2348 based on user information, for example, from June to August. The device 100 can generate an autumn image 2349 based on, for example, user information from September to November. The device 100 can generate a winter image 2350 based on, for example, user information from December to February.

The Spring Image 2347 and the Fall Image 2349 indicate that the user information contains information "Biking to Work". The summer image 2348 and the winter image 2350 indicate that the user information contains information "driving to work". The device 100 can generate and display a spring image 2347, a summer image 2349, an autumn image 2349, and a winter image 2350, which are different from each other according to user information.

The device 100 can generate and display a spring image 2347, a summer image 2348, an autumn image 2349, and a winter image 2350 as a monthly image or an image in units of several months.

The device 100 can generate and display the avatar-based image 2310, the current image 2340, the future image 2341, the past image 2342, the morning image 2343, the afternoon image 2344, and the working day of FIG. 23A to FIG. 23F according to the user information including various objects. Image 2345, weekend image 2346, spring image 2347, summer image 2348, autumn image 2349, and/or winter image 2350.

In one or more of the exemplary embodiments described above, the device 100 generates and displays an avatar-based image meaning that the device 100 provides an avatar-based image.

In the following, for convenience of description, it is assumed that the avatar-based image displayed on the device 100 is the avatar-based image 2310 of FIG. 23A. However, the avatar-based image according to an exemplary embodiment is not limited thereto. For example, the avatar-based image 2310 displayed on the device 100 can be the current image 2340, the future image 2341, the past image 2342, the morning image 2343, the afternoon image 2344, and the working day of FIG. 23A to FIG. 23F according to user information. Any of image 2345, weekend image 2346, spring image 2347, summer image 2348, autumn image 2349, and/or winter image 2350. Moreover, the avatar-based image 2310 displayed on the device 100 may be an image obtained by adding at least one object to one of the following: the current image 2340 of FIG. 23A to FIG. 23F according to user information, Future image 2341, past image 2342, morning image 2343, afternoon image 2344, weekday image 2345, weekend image 2346, spring image 2347, summer image 2348, autumn image 2349, and winter image 2350.

The device 100 may represent the avatar-based image 2310 in at least one of a still image and a moving image. For example, the device 100 may represent the avatar-based image 2310 in a moving image and may represent the avatar-based image 2310 as a still image after the first time. Alternatively, the device 100 may represent the avatar-based image 2310 as a still image and may display the avatar-based image 2310 as a dynamic image after the second time. The first or second time can be preset. The first time and the second time may be the same or different from each other.

Referring to FIG. 23A, the user information 2300 includes the user's hobby information 2301, the user's name 2302, and the user's gender information 2303. According to an exemplary embodiment, user information 2300 is not limited to the information shown in FIG. 23A.

For example, user information 2300 can further include at least one segment of the user information described above. User information 2300 may contain less information than the information shown in Figure 23A. For example, the user information 2300 can include the user's preference information 2301 and the user's name 2302.

To generate an avatar-based image 2310, device 100 can generate user modeled information about user information 2300. The user model information may be referred to as a user model information table.

The device 100 can generate an ontology-based user modelling information about the user information 2300. The method of generating user modeled information about user information 2300 is not limited to the ontology.

24A illustrates an example of user modeling information 2400 regarding user information 2300, based on an ontology, in accordance with an illustrative embodiment. The body has been described above with reference to FIG.

Referring to FIG. 24A, the user modeling information 2400 includes a subject field 2401, a predicate field 2402, and an object field 2403.

The subject field 2401 of FIG. 24A is a field related to the subject of the user information 2300. Referring to FIG. 24A, the subject of the user information 2300 is the first user User_1. In FIG. 24A, the category 2402 and the resource 2405 are used to indicate that the first user User_1 is an individual. Resource 2405 defines the execution individual of category 2404.

The predicate field 2402 of FIG. 24A is a field of the formal language indicating the relationship between the words included in the subject field 2401 and the object field 2403. Therefore, the predicate field 2402 of FIG. 24A contains a formal language (name) about the name, a formal language (gender) about the gender, and a formal language (with hobbies) about the hobby.

According to the formal language of the name, "A" included in the object field 2403 can be represented as the name of the first user User_1. According to the formal language of gender, the "female" included in the object field 2403 can be expressed as the gender of the first user User_1. According to the formal language of the hobby, the "violin" included in the object field 2403 can be expressed as the hobby of the first user User_1. The information included in the object field 2403 of FIG. 24A is user information corresponding to the first user User_1 of the formal language included in the predicate field 2402.

The user modeling information 2400 of Figure 24A is generated in the RDF language. However, device 100 may generate ontology-based user modeling information about user information 2300 by using a language such as OWL or SWRL.

24B illustrates an example of a display size of an object included in an avatar-based image 2310 displayed on device 100, in accordance with an illustrative embodiment. The example of Figure 24B is for a violin included in the user modeling information 2400 of Figure 24A.

Referring to Figure 24B, device 100 can determine the display size of the object based on the possible weighting values assigned to the object. As shown in FIG. 24B, the device 100 can determine the display size of the violin to be included in the avatar-based image 2310 based on the possible weighting values assigned to the violin included in the object field 2403. Possible weighting values can be determined based on user information. The display size according to the possible weighting value can be set in advance.

Referring to Figure 24B, the possible weighting values range from 0 to 1. The user's level of interest in the violin is low when the possible weighting value is 0.3, compared to a possible weighting value of one. For example, when it is determined that the user's preference is to play the violin and the user plays the violin every other hour based on the user information of the device 100, the device 100 may set the possible weighting value of the violin to 0.5. Alternatively, the device 100 may set the possible weighting value of the violin to one when it is determined that the user's preference is to play the violin and the user plays the violin for one hour per day based on the user information of the device 100.

When the possible weighting value of the violin is 0.5, the device 100 determines that the display size of the violin is 50 x 50 pixels. Thus, device 100 can generate an avatar-based image 2310 that includes an image of a 50 x 50 pixel violin.

Alternatively, when the possible weighting value of the violin is 1, the device 100 determines that the display size of the violin is 100 x 100 pixels. Thus, device 100 can generate an avatar-based image 2310 that includes an image of a violin of 100 x 100 pixels.

24C is a diagram for describing a display size of an object included in an avatar-based image 2310, according to an exemplary embodiment. The example of Figure 24C is for a woman included in the user modeling information 2400 of Figure 24A.

Referring to Fig. 24C, the device 100 can determine the display size of the female avatar 2311 of Fig. 23A to be included in the avatar-based image 2310 based on body weight and height. The weight and height are the weight and height of the female included in the object field 2403 of the user model information 2400. Weight and height are included in the user information. The device 100 can select one of a plurality of display sizes set in advance.

Referring to Fig. 24C, the device 100 sets the baseline of the body weight to 50 kg and sets the baseline of the height to 170 cm. However, the baseline according to an exemplary embodiment is not limited thereto. When the weight of the user included in the user information satisfies the condition of "(height-100) x 0.9 + 5 > weight", the device 100 can display the female avatar 2311 included in the avatar-based image 2310 in a fat image.

Alternatively, when the user's weight satisfies the "(height-100) x 0.9 <weight" condition, the device 100 may display the female avatar 2311 included in the avatar-based image 2310 in a thin image. When the user's weight satisfies the "other" condition, the device 100 can display the female avatar 2311 included in the avatar-based image 2310 as normal.

25 illustrates an example of mapping information 2500 between object images and object ID information, in accordance with an illustrative embodiment. Referring to Figure 25, device 100 can generate avatar-based image 2310 by using mapping information 2500 and user modeling information 2400 of Figure 24A. The display size of the object image of FIG. 25 can be adjusted or changed based on the information contained in the user information as described above with reference to FIGS. 24B and 24C.

The mapping information 2500 can be configured by considering all or some of the user information described above. The mapping information 2500 can be referred to as a mapping information table.

According to an exemplary embodiment, the mapping information 2500 can be set differently than the information shown in FIG. For example, mapping information 2500 can be configured to provide an image of the object as a still image as shown in FIG. 25, or to provide an image of the object as a moving image. The mapping information 2500 can be stored in the device 100 or in the external device 2120.

Images corresponding to a violin or guitar can include standard images of playing a violin or guitar. Standard images can also be provided as still images or moving images. Standard images can include avatar images of instruments and instruments.

When the standard image is stored in the mapping information 2500, the device 100 can change the avatar of the playing instrument into the avatar of the user. The device 100 can change the avatar of the musical instrument into the avatar of the user by mapping the position information of the feature point for displaying the avatar of the playing instrument and the position information of the feature point for displaying the avatar of the user. When the avatar is a 2D image, the position information of the feature point can be represented by the (x, y) coordinate value. When the avatar is a 3D image, the position information of the feature point can be represented by a (x, y, z) coordinate value.

26 is a diagram for describing a procedure for generating an avatar-based image 2310 by using user modeling information 2400 and mapping information 2500, in accordance with an illustrative embodiment.

Referring to Figure 26, device 100 detects information (A, female, and violin) contained in object field 2403 of user modeled information 2400. The device 100 detects object images 2610 and 2620 from the mapping information 2500 by using object ID information assigned to the detected information (eg, "0000 0010" for women and "0000 0011" for violin). Device 100 combines object images 2610 and 2620.

When the object images 2610 and 2620 are combined, the device 100 can use the coordinate values (2D coordinate values or 3D coordinate values) for reproducing the object images 2610 and 2620 and preset the combined condition information.

The coordinate values of the object images can be configured in the coordinate value table such that the coordinate values can be detected by using the object ID information contained in the mapping information 2500. For example, the device 100 can detect the coordinate value used to reproduce the object image 2610 from the coordinate value table by using "0000 0010". The coordinate value table may contain location information for displaying feature points of each object image. The coordinate value table can be stored in device 100 and/or external device 2120.

The coordinate value table can be a skeleton data table of the object image. For example, when the object image is an avatar such as object image 2610, the skeleton data table displays the outline of the avatar. For example, the skeletal data sheet of the avatar may include information about the face, head, neck, shoulders, chest, waist, hips, length of the arms, thickness of the arms, length of the legs, thickness of the legs, right hand and/or Left hand information, but not limited to this.

For example, when the object image is a violin such as object image 2620, the skeleton data sheet shows the outline of the violin. For example, the skeleton data sheet of the violin may include the head, the peg, the peg box, the string pillow, the neck, the fingerboard, the strings, the sound board, the trim, the side panels, the waist, the bridge, the f-hole , tail piece, chin rest and/or button, but not limited to this.

The combined condition information may include location information of the image of the object to be combined. The combined condition information can be configured in the combined condition information table such that the combined condition information is detected by using the object ID information of the object image to be combined. For example, when the object images 2610 and 2620 are combined as shown in FIG. 26, the device 100 can use the object ID information (ie, "0000 0010" and "0000 0011") of the object images 2610 and 2620. The combined condition information table detects combined condition information between the object images 2610 and 2620.

When the combined condition information includes, for example, position information indicating that the object image 2610 holds the bow with the right hand and the left hand holds the neck of the violin, the device 100 can provide the image 2630 by combining the object image 2610 and the object image 2620. The location information indicates location information for displaying feature points of each object. The combined condition information table may be stored in the device 100 and/or the external device 2120 in advance.

In order to generate the avatar-based image 2310, the combined condition information may include information indicating the position of "holding the lower jaw with the lower jaw on the chin rest and holding the neck of the violin with the left hand". When the object image 2620 of the violin is a standard image for playing the violin, the device 100 can change the coordinate value (or the position information of the feature point) used to reproduce the violinist playing the violin to the coordinate value of the object image 2610.

Referring back to FIG. 22, in operation S2002, the device 100 changes the avatar-based image 2310 according to user input. The user input may be a user input indicating a change request based on the avatar-based image 2310, a user input indicating an object selection, or a user input indicating that the change is completed, but is not limited thereto. The user input indicating the change request may be a user input indicating the edit request. The user input indicating that the change is complete may be a user input indicating that the edit is complete.

User input can be based on at least one of touch, touch and drag, gesture, multi-mode, and voice. User input can be received from external device 2120.

When a user input indicating a change request is received while displaying the avatar-based image 2310, the device 100 may display the changeable item.

27A-27F illustrate an example of device 100 displaying a changeable item, in accordance with an illustrative embodiment.

Referring to FIG. 27A, upon receiving a user input selecting the change request button 2701, the device 100 promptly presents the user's name 2702 and the violin 2703. Therefore, the user recognizes that the name 2702 and the violin 2703 are changeable items.

In FIG. 27B, upon receiving a user input selecting the change request button 2705, the device 100 may overlap and display the message 2706 indicating the name in a partial area of the user's name 2702. Further, the device 100 superimposes and displays a message 2707 indicating a hobby in a partial region of the violin 2703. The indication hobby message 2707 may contain information related to the violin 2703, for example, playing a violin. Thus, the user recognizes that the name 2702 and the violin 2703 are changeable items, or the message 2706 indicating the name and the message 2707 indicating the hobby are changeable items.

Referring to Figure 27C, device 100 can display system 匣 2712 containing illustrations 2710 and 2711 of changeable objects along with avatar-based image 2310.

In FIG. 27C, upon receiving a user input selecting the change request button 2709, the device 100 provides a system 匣 2712 containing a graphical representation 2710 of hobbies and a graphical representation 2711 of the name. The illustration 2710 can include information related to the violin 2703. Therefore, the user can recognize that the name 2702 and the violin 2703 or the name 2702 and the hobby item are changeable items. The system 匣 2712 may further include ID information (hobbies and names) of the illustrations 2710 and 2711.

Referring to Figure 27C, device 100 displays system 匣 2712 at the bottom of the screen. Alternatively, system 匣 2712 can be displayed at at least one of the left, right, top, or bottom of the screen. When the number of illustrations of changeable items is greater than the number of illustrations of items that may be simultaneously displayed on system 匣 2712, device 100 may display an illustration of the selectable items while allowing the graphical representation displayed via system 匣 2712 to be based on The scroll input input of system 匣 2712 moves. The scrolling input based on system 匣 2712 may include a scrolling input based on the area of system 匣 2712.

When the number of icons of the changeable items is greater than the number of icons of the items that can be simultaneously displayed on the system 匣 2712, the device 100 can provide a plurality of system 分类 sorted according to the preset categories.

When the device 100 provides a plurality of system ports, the device 100 may configure a plurality of system ports at at least one of a left side, a right side, a top, or a bottom of the screen, or configure a plurality of systems in a hierarchical structure on the screen. At least one of the left, right, top or bottom. The category can be set according to the type of the changeable object, but is not limited thereto.

In Figure 27C, when an illustration of an item contained in system 匣 2712 is selected, device 100 can highlight the selected object of the illustration.

In FIG. 27D, an apparatus 100 according to an exemplary embodiment provides information about a changeable object via a speech bubble according to a touch-based input.

In FIG. 27D, upon receiving a user input selecting a change request button 2714, device 100 can initiate a changeable image from the displayed image.

Upon receiving a touch-based input 2715 indicating a selection of a changeable object (eg, violin 2703) from the displayed image, device 100 displays changeable information (eg, hobby) containing information about the changeable object (violin 2703). Speech Bubble 2716. The device 100 can display a speech bubble 2716 near the violin 2703 to indicate that the speech bubble 2716 is associated with the violin 2703. Therefore, the user can recognize that the violin 2703 is an object that can be changed and the user information about the hobby can be changed.

Referring to Figure 27E, device 100 provides a changeable object in the form of a quick display window 2721. In FIG. 27E, upon receiving a user input indicating a selection of the change request button 2718, the device 100 displays a pop-up window 2721 containing information 2719 and 2720 regarding the changeable object. The quick display window 2721 can contain information about at least one object.

Therefore, the user identifies information 2719 and 2720 regarding the changeable items. When the information about an object included in the pop-up window 2721 is selected, the device 100 can highlight the object corresponding to the selected information.

Referring to Figure 27F, device 100 can display the changeable object by using a separate page. In FIG. 27F, upon receiving a user input to select change request button 2723, device 100 opens page 2726 containing information 2724 and 2725 about the changeable object. Therefore, the user identification can change the object. Device 100 can display information regarding at least one changeable item via page 2726.

When the changeable item is selected in FIG. 27E or FIG. 27F, the device 100 can be bold to indicate that the changeable item is selected.

In FIGS. 27A through 27F, user input indicating selection of a change request button 2701, 2705, 2709, 2714, 2718, or 2723 is received, but the user input indicating the change request is not limited thereto, according to an exemplary embodiment. . For example, device 100 can receive user input by using another button or based on a user gesture.

28 is a flow diagram of a method of changing an avatar-based image 2310 based on user input by device 100, in accordance with an exemplary embodiment.

Referring to FIG. 28, in operation S2801, the device 100 receives a first selection signal regarding an object from the changeable object. In operation S2802, the device 100 displays a candidate object of the selected object.

29A-29F illustrate an example of changing an item based on a candidate item provided by device 100, in accordance with an illustrative embodiment.

When the device 100 receives the touch-based input 2715 as a first selection signal indicating the selection of the violin 2703 as shown in the screen 2920 while highlighting the changeable object as shown in the screen 2910 of FIG. 29A, the device 100 Candidate objects related to the violin 2703 are displayed.

Referring to the screen 2920 of FIG. 29A, the device 100 provides the guitar item 2912, the baseball item 2913, and the badminton item 2914 as candidate objects related to the violin 2703, but the candidate object according to an exemplary embodiment is not limited thereto.

Referring to the screen 2920 of FIG. 29A, the device 100 displays information about the candidate object in the form of a quick display window 2921. Referring to screen 2920 of Figure 29A, device 100 provides information about the candidate object in text.

However, the method of providing information on candidate objects according to an exemplary embodiment is not limited thereto. For example, as shown in screen 2930 of FIG. 29B, device 100 may provide information about candidate objects in the form of a rectangular pop-up window 2931. The rectangular quick display window 2931 horizontally configures images corresponding to the candidate objects, respectively. The rectangular quick display window 2931 may provide information about the candidate object in a symbol, a graphic or a representative image, but the information about the candidate object is not limited thereto.

As shown in screen 2940 of Figure 29B, device 100 can provide information about candidate objects in the form of ring-type pop-up window 2941. The ring type quick display window 2941 can contain information about the candidate object in symbols or text.

When the number of candidate objects is greater than the number of objects simultaneously displayed on the pop-up window 2921, 2931 or 2941, the device 100 may be displayed on the pop-up window 2921 according to the scrolling input based on the pop-up window 291, 2931 or 2941. Information about the candidate object at 2931 or 2941 provides information about the candidate object. The device 100 can move information about the candidate object according to a preset configuration order.

When the number of candidate objects is greater than the number of objects simultaneously displayed on the pop-up window 2921, 2931 or 2941, the device 100 can be expanded by input (eg, touch and drag) based on the quick display window 2921, 2931 or 2941. The formal area of the display window 2921, 2931 or 2941 provides information about the candidate object.

For example, when the user performs a touch and drag input on the screen 2930 shown in FIG. 29B, the screen 2950 is in the form of FIG. 29C. That is, when the user performs touch and drag input on the screen 2930, the device 100 can provide information about the candidate object by expanding the rectangular quick display window 2931 according to the touch and drag input 2951. Alternatively, as shown in screen 2960 of FIG. 29D, device 100 may further provide a fast display window 2961 that is separate from rectangular display window 2931 based on touch and drag input 2951.

Returning to FIG. 28, in operation S2803 of FIG. 28, the device 100 receives a second selection signal based on information about the candidate object. In operation S2804, the device 100 changes the selected object to the candidate object selected according to the second selection signal.

When the second selection signal of the selected baseball item 2913 is received in the screen 2970 of FIG. 29E, the device 100 changes the avatar-based image of the playing violin 2703 to the left-handed baseball glove and the right-handed ball as shown in the screen 2980. An avatar-based image.

The avatar-based image of the baseball shown in the screen 2980 according to an exemplary embodiment is not limited thereto. For example, when receiving a user input selecting a baseball item 2913 while holding the avatar-based image of the violin 2703 with the left hand as shown in the screen 2990 of FIG. 29F, the device may display holding the baseball with the left hand. An avatar-based image of the stick 2996. Alternatively, when a user input selecting a movie item 2915 is received via the pop-up window 2911', the device 100 may display an avatar-based image of the movie CD or video tape with the left hand.

When a user input selecting the change completion button 2704 is received in the screen 2980 of FIG. 29E or the screen 2995 of FIG. 29F, the device 100 can generate and display a changed image 2320 similar to the image shown in FIG. 23A. The changed image 2320 of Figure 23A is an avatar-based image of baseball.

30 is a flow diagram of a method by which device 100 provides service information that may be provided based on objects contained in avatar-based image 2310, in accordance with an exemplary embodiment.

Referring to FIG. 30, in operation S3001, the device 100 receives a first selection signal indicating selection of an object. In operation S3002, the device 100 provides at least one segment based on service information of the selected object.

31A to 31D illustrate an example of a screen for describing the method of FIG. When the user input of the selection change request button 2701 is received while the avatar-based image is displayed as shown in the screen 3110 of FIG. 31A, the device 100 promptly indicates that the object can be changed as shown in the screen 3120 of FIG. 31A.

When the first selection signal regarding the violin 2703 is received in the screen 3120 of FIG. 31A, the device 100 provides the serviceable information based on the violin 2703 via the pop-up window 3131 as shown in the screen 3130 of FIG. 31B. Referring to the pop-up window 3131, the service information that can be provided may include a concert reservation item, a group access item, and/or a specific shopping website item, but the serviceable information according to an exemplary embodiment is not limited thereto.

Referring to FIGS. 30 and 31A to 31D, when a second selection signal 3132 indicating selection of a selected object (violin 2703 of the screen 3130 of FIG. 13B) is received in operation S3003, the device 100 provides relevant information in operation S3004. Information about at least one candidate object of the selected object (violin 2703). Information about at least one candidate object may be provided in the form of a pop-up window 3141 as shown in picture 3140 of Figure 31B.

Accordingly, the apparatus 100 determines that the first selection signal received in operation S3001 is a preliminary selection regarding an item that the user desires to change, and determines that the second selection signal received in operation S3003 is an item regarding the user's desire to change. Complete the selection. The preliminary selection indicates the selection standby state with respect to the object, and the completion selection indicates the selection completion state with respect to the object.

In operation S3005, the device 100 receives a third selection signal based on information about the at least one candidate object. Accordingly, in operation S3006, the apparatus 100 provides at least one segment of service information regarding the selected candidate object.

Referring to FIG. 31C, when a baseball item is selected from information about at least one candidate object displayed on the pop-up window 3141 of the screen 3150, the device 100 provides a baseball-based offering available via the speech bubble 3151 as shown in the screen 3160. Service information.

In operation S3007, the device 100 receives a fourth selection signal regarding the selected candidate object (baseball item). For example, a double touch 3152 of picture 3160 of Figure 31C can be received as a fourth selection signal.

The device 100 may determine the third selection signal regarding the selected candidate object received in operation S3005 as an initial selection with respect to the selected candidate object, and determine the fourth selection signal regarding the selected candidate object received in operation S3007 as Regarding the completion selection of the selected candidate object. The initial selection indicates that the inactive state is selected and the selection is completed to indicate the completion state.

In operation S3008, the device 100 changes the selected object to a selected candidate. Accordingly, the device 100 can display an avatar-based image based on a baseball item as shown in the screen 3170 of FIG. 31D. When the user input of the selection change completion button 2704 is received in the screen 3170 of FIG. 31D, the device 100 completes the image change.

According to the method of FIG. 30, the user of the device 100 can check the serviceable information based on the candidate object before changing the avatar-based image.

Returning again to FIG. 22, when the avatar-based image 2310 is changed according to the user input in operation S2202 of FIG. 22, the device 100 updates the user information 2300 to the user information based on the changed image 2320 of FIG. 23A in operation S2203. 2330. The user information 2330 includes the user's hobby information 2331 (playing the guitar), the user's name 2332, and the user's gender information 2333 (female).

By updating the user information 2300 to the user information 2330, the user modeling information of FIG. 24A can be updated to the user modeling information 3200 of FIG. FIG. 32 illustrates an example of user modeling information 3200 updated by device 100, in accordance with an illustrative embodiment.

When the display size of the female avatar 2311 included in the avatar-based image 2310 is changed, the device 100 can change the user information according to the changed display size. For example, when the display size of the female avatar 2311 included in the avatar-based image 2310 changes from normal to thin according to the user input, the device 100 can update the weight and height of the user included in the user information to Indicates a thin value.

Although the avatar-based image 2310 is displayed by the device 100 in operation S2201 of FIG. 22, the device 100 may also provide sound based on the user information 2300. Sound can be provided as the background music of the avatar-based image 2310 or the voice of the female avatar 2311. The voice of the female avatar 2311 can provide, for example, guidance information related to user information 2300 (eg, "I am A, female, hobby to play the violin".)

The device 100 can provide the voice of the female avatar 2311 in any of a variety of modes based on female voice. Examples of various modes may include a voice mode, a music mode, and/or a play mode, but are not limited thereto. This mode can be set to a preset in device 100 or can be set or changed by the user.

When sound is provided as background music, the device 100 may provide violin music based on the hobby information 2301 (playing the violin) included in the user information 2300. The violin music can be determined by the device 100 or the external device 2120 based on user information other than the user information 2300 of FIG. 23A.

Together with the avatar-based image 2310, the device 100 can further provide a background image of the female avatar 2311 based on the user information 2300. The background image may be a stage image of a violin based on the hobby information 2301 or a monochrome image (eg, pink) based on the gender information 2303, but is not limited thereto. For example, when it is determined based on user information that the user often plays the violin 2312 at night, the device 100 can display the night image as a background image. The device 100 can determine that the user often plays the violin 2312 at night based on the violin playing time included in the user information.

As described above, when at least one of the background image and the sound is further provided along with the avatar-based image 2310, the device 100 can provide the background image and sound as the changeable object.

When the background image and sound are provided by user information other than the user information 2300, and the background image and/or sound is changed, the device 100 may update the user information based on the changed background image and/or the changed sound.

33 is a flow diagram of a method for managing user information by device 100 by changing an avatar-based image, in accordance with an illustrative embodiment. In Figure 33, the user information is updated based on user input accepting the changed avatar-based image.

In operation S3301 of FIG. 33, as in the above-described operation S2201, the device 100 displays the avatar-based image 2310 based on the user information. In operation S3302, as in the above-described operation S2202, the device 100 changes the avatar-based image 2310 according to the user input.

In operation S3303, the device 100 displays the changed image 2320. It is then determined in operation S3304 whether the changed image is acceptable. When the user input accepting the changed image 2320 is received (S3304, YES), operation S3305 is performed. User input accepting the changed image 2320 can be input via the device 100 or by using an external device 2120. In order to receive user input accepting the changed image 2320, the device 100 may display a message inquiring the user to accept the changed image 2320.

When the user input accepting the changed image 2320 is not received (S3304, NO), operation S3301 is performed and the device 100 can display the avatar-based image 2310.

Alternatively, when the user input accepting the changed image 2320 is not received (S3304, NO), operation S3303 is performed and the device 100 can display the changed image 2320 while maintaining the user input requesting to additionally change the changed image 2320. Standby status.

When the user input duration is not received in operation S3304, the device 100 may determine that the user input accepting the changed image 2320 has not been received.

Upon receiving the user input accepting the changed image 2320 (S3304, YES), the device 100 updates the user information based on the changed image 2320 in operation S3305.

FIG. 34 is a flowchart of a method for managing user information by device 100 by changing an avatar-based image, in accordance with another exemplary embodiment.

Referring to FIG. 34, the device 100 receives user information from the external device 2120 in operation S3401. The device 100 can receive user information from the external device 2120 according to a user input requesting user information. For example, the device 100 may request the user information from the external device 2120 according to the input of the user information requested to be registered in the social media server, and thus, receive the user information from the external device 2120.

Alternatively, device 100 may request user information from external device 2120 without any request. For example, when the device 100 is in the sleep mode or executes the application A, the user's health information can be received from the external device 2120. The user information received in operation S3401 may include at least one segment of the user information described above. The received user information can be stored in the device 100.

In operation S3402, the device 100 may generate and display an avatar-based image based on the user information. The avatar-based image may be generated based on user information as described above with reference to operation S2201 of FIG.

In operation S3403, the device 100 changes the avatar-based image according to the user input indicating the change request. The avatar-based image may be changed according to user input, as described above with reference to operation S2202 of FIG.

In operation S3404, the device 100 updates the user information based on the changed avatar-based image. The device 100 changes the user information received in operation S3401 according to the changed avatar-based image, and transmits the changed user information to the external device 2120 while requesting the external device 2120 to update the user information. Therefore, the external device 2120 can update the user information. After requesting the external device 2120 to update the user information, the device 100 can automatically delete the user information stored thereon.

35 is a flow diagram of a method of managing user information, wherein device 100 changes and/or adds information by using an avatar-based image, in accordance with an illustrative embodiment.

In operation S3501, the device 100 displays the avatar-based image 2310 based on the user information. Operation S3501 can be performed in a manner similar to operation S2201 of FIG. 22 described above.

In operation S3502, the device 100 may change the avatar-based image 2301 according to user input. The avatar-based image 2310 can be changed in operation S3502 in a manner similar to operation S2202 of FIG.

Also, in operation S3502, the device 100 may add new information (or a new object) to the avatar-based image 2310 according to user input. The new information may be added based on image information corresponding to the information that can be added by the device 100. The image information may include at least one of an image, a symbol, and a graphic that symbolizes the information that can be added.

When image information corresponding to the information that can be added is selected, the device 100 can provide the changed image 2320 to which the selected image information is added. However, the procedure for adding new information is not limited to this.

For example, when image information corresponding to addable information (eg, an application accessory) is selected, device 100 can provide an input window for receiving information related to selected image information (eg, earrings). Upon receiving information related to the selected image information via the input window, device 100 can generate an image (eg, earrings) that receives the information and provide a changed image 2320 containing the generated image.

In operation S3503, the device 100 updates the user information based on the changed image 2320. For example, when the fifth preparation is added as described above with reference to FIGS. 8A through 8C, the device 100 may update the user information such that the information about the fifth preparation is included in the user information.

36 is a flow diagram of a method of managing user information to enable device 100 to provide services based on an item selected from an avatar-based image, in accordance with an illustrative embodiment. In FIG. 36, the object is an image and/or text corresponding to the changeable user information contained in the avatar-based image.

In operation S3601, the device 100 displays an image based on the avatar based on the user information. The device 100 can display an avatar-based image in the same manner as in the operation S2201 of FIG. 22 described above. For example, device 100 can display the avatar-based image of FIG. 31A. At this time, the device 100 can display an avatar-based image that does not include the change request button 2701 and the change completion button 2704 of FIG. 31A.

In operation S3602, the device 100 provides service information based on the object (eg, the violin 2703) upon receiving user input from the screen 3110 selecting the violin 2703. For example, upon receiving a user input selecting the violin 2703, as in the screen 3120 of FIG. 31A, the device 100 opens a pop-up window 3131 containing at least one segment based on the service information of the violin 2703, as shown in the screen of FIG. 31B. Shown in 3130.

Referring to FIG. 31B, the service information included in the pop-up window 3131 includes a concert reservation item, a group access item, and a specific shopping website item. However, the service information included in the pop-up window 3131 is not limited to this. Also, the service information based on the violin 2703 according to an exemplary embodiment may be provided in the form of the system 匣 2712 of FIG. 27C. The service information based on the violin 2703 may be referred to as service information based on the object selected by the user input.

Next, it is determined in operation S3603 whether or not the service information is selected. When receiving a user input selecting a piece of service information (S3603, YES), the device 100 provides the selected service information in operation S3604. For example, upon receiving a user input selecting a concert reservation item included in the pop-up window 3131, the device 100 may execute an application that provides a violin concert reservation service.

37 is a flow diagram of a method of managing user information, wherein device 100 provides a question and answer (QA) service based on the displayed avatar-based image, in accordance with an illustrative embodiment.

In operation S3701 of FIG. 37, the device 100 displays an image based on the avatar based on the user information. For example, device 100 can display avatar-based image 2310 of FIG. 23A based on user information.

Next, it is determined in operation S3702 whether or not the problem information is received. When the problem information is received (S3702, YES), the device 100 provides the answer information about the problem information in operation S3703.

The problem information received in operation S3702 is problem information related to the avatar-based image. For example, the problem information can be "Tell me about the violin concert I booked", "Tell me if there is a violin class tomorrow", "When is the violin class yesterday?" or "My violin class tomorrow" Previous schedule".

The user's voice signal can be used by operating the problem information received in S3702. If the device 100 is unable to process (or recognize) the problem information generated in operation S3702, the device 100 may display an error message indicating an error message or output a voice signal.

Moreover, if the device 100 fails to recognize the problem information, the device 100 can provide guidance information about the information that can be input. The device 100 can provide guidance information about the information that can be input into the form of a list. Guidance information provides information about the formation of information that can be entered into a problem.

When identifying problem information, device 100 may consider user information. For example, when the problem information is "Give me information about Lincoln," the device 100 can determine whether Lincoln is a person or a car based on user information. If the device 100 determines that the user is very interested in the car based on the user information, the device 100 can identify "Lincoln" included in the problem information as the car "Lincoln".

Meanwhile, if the problem information received in operation S3702 is "tell me information about the violin concert I have booked", the device 100 may provide the screen 3810 or 3820 of FIG. 38 in operation S3703. For example, if the problem information received in operation S3702 is "tell me information about the most recently based concert", the device 100 may provide the screen 3810 before the update and the screen 3820 after the update of FIG. 38. Therefore, the user can easily check information about the concert before and after the update.

Figure 38 illustrates an example of device 100 providing answer information based on received problem information, in accordance with an illustrative embodiment. Referring to FIG. 38, the response information based on the user information before the update and the response information based on the user information after the update are simultaneously displayed.

Device 100 may partially overlap and display screens 3810 and 3820. Device 100 can provide screens 3810 and 3820 in a manner similar to opening an e-book. When the screens 3810 and 3820 are provided in this manner and a user input of a corner or side of the touch and dragging screen 3810 or 3820 is received, the device 100 can close the screens 3810 and 3820 in the drag direction. For example, upon receiving the rightmost user input that touches and drags the screen 3820 in the left direction, the device 100 can flip the screen 3820 to close the screens 3810 and 3820 in a manner that covers the screen 3810.

FIG. 39 is a flowchart of a method of managing user information based on device 100 and external device 2120, in accordance with an exemplary embodiment. In FIG. 39, the external device 2120 generates an image based on the avatar.

In operation S3901, the external device 2120 generates an avatar-based image based on the user information. The external device 2120 can generate an avatar-based image based on the user information in the same manner as in the operation S2201 of FIG. 22 described above. For example, when the external device 2120 is a social media server, the external device 2120 can generate an avatar-based image based on the user profile information registered in the social media server.

In operation S3902, the external device 2120 transmits the avatar-based image to the device 100. Operation S3902 can be performed in response to a request by the device 100 for user information.

In operation S3903, the device 100 displays an image based on the avatar. In operation S3904, the device 100 changes the image based on the avatar. Operation S3904 can be performed by receiving a user input indicating a request to change the avatar-based image. The avatar-based image may be changed in the same manner as the operation S2202 of FIG. 22 described above.

When the avatar-based image has changed, the device 100 transmits the changed avatar-based image to the external device 2120 in operation S3905. In operation S3906, the external device 2120 updates the user information based on the changed avatar-based image. Operation S3906 can be performed in the same manner as operation S2203 of FIG.

FIG. 40 is a flowchart of a method of managing user information based on device 100 and external device 2120, according to another exemplary embodiment. In Figure 40, device 100 produces an avatar-based image.

When the user information is transmitted from the external device 2120 to the device 100 in operation S4001, the device 100 generates an avatar-based image based on the user information in operation S4002.

In operation S4003, the device 100 displays an image based on the avatar. In operation S4004, the device 100 changes the image based on the avatar according to the user input.

In operation S4005, the device 100 updates the user information based on the changed avatar-based image. In operation S4006, the device 100 transmits the updated user information to the external device 2120. In operation S4007, the external device 2120 may update the user information stored in the external device 2120 based on the received updated user information.

41 is a flow diagram of a method of managing user information based on device 100 and wearable device 4110, in accordance with an illustrative embodiment. In FIG. 41, information about the object in the avatar-based image is included via the wearable device 4110.

The device 100 displays the avatar-based image based on the user information in operation S4101, and transmits information about the changeable object included in the avatar-based image to the wearable device 4110 in operation S4102.

In operation S4103, the wearable device 4100 displays information about the changeable object. According to an exemplary embodiment, the information about the changeable object may be displayed in the form of an image, but is not limited thereto. For example, the wearable device 4110 can display information about the changeable object in the form of text. When a signal based on the information about the changeable object is selected in operation S4104, the wearable device 4110 transmits information about the selected object to the device 100 in operation S4105.

In operation S4106, the device 100 searches for stored information for information about candidate objects of the selected object. Information about candidate objects can be searched from an external storage device of device 100. The information about the candidate object can be searched from the external device 2120 connected to the device 100. The device 100 can search for information about the candidate object by using the ID information of the selected object as a key.

In operation S4107, the device 100 transmits information about the candidate object to the wearable device 4110. In operation S4108, the wearable device 4110 displays information about the candidate object.

For example, when the object selected in operation S4104 is the violin 2703 of FIG. 29A, the information about the candidate object that can be displayed in operation S4108 can include the item included in the pop-up window 2921 of the screen 2920 of FIG. 29A. .

For example, when the object selected in operation S4104 is the illustration 2710 of the hobby of FIG. 27C, the information about the candidate object that can be displayed in operation S4108 may include items related to the hobby (eg, swimming, bicycle) Cycling and photography).

The information about the candidate object can be displayed in the form of images and/or text, but is not limited thereto.

When the signal of the selection candidate object is received in operation S4109, the wearable device 4110 transmits information about the selected candidate object to the device 100 in operation S4110.

In operation S4111, the device 100 changes the avatar-based image by using the selected candidate object. In operation S4112, the device 100 updates the user information based on the changed avatar-based image. The user information can be updated in operation S4112 in the same manner as in the operation S2203 of FIG. 22 described above.

FIG. 42 is a flowchart of a method of managing user information based on device 100 and wearable device 4210, in accordance with another exemplary embodiment. In FIG. 42, the avatar-based image is changed based on the user information obtained by the wearable device 4210.

In operation S4201, the device 100 displays an image based on the avatar based on the user information. In operation S4201, the device 100 may display an avatar-based image in the same manner as in the operation S2201 of FIG. 22 described above.

In operation S4202, the wearable device 4210 obtains user information. The user information obtained by the wearable device 4210 may include, for example, the user's health information or the location information of the wearable device 4210, but the user information obtained by the wearable device 4210 is not limited thereto.

Operations S4201 and S4202 can be performed simultaneously. Alternatively, operation S4202 may be performed prior to operation S4201, or operation S4201 may be performed prior to operation S4202.

In operation S4203, the wearable device 4210 transmits user information to the device 100. In operation S4204, the device 100 changes the avatar-based image displayed in operation S4201 based on the received user information.

For example, when the received user information is information about the temperature of the user and the temperature is determined to be higher than the reference temperature, the device 100 may change the face of the avatar-based image displayed in operation S4201 to a partial red color. Thus, the user can check that the user has had a fever via the altered avatar-based image displayed via device 100.

For example, when the received user information is information about the user's feeling of pleasure, the device 100 may change the face of the avatar-based image displayed in operation S4201 to a smiling face. Thus, the user can check that the user is in good mood via the altered avatar-based image displayed via device 100.

As described above, the device 100 can change the avatar-based image displayed in operation S4201 differently according to the user information obtained and transmitted by the wearable device 4210. When changing an avatar-based image, not only the face of the avatar-based image is changed, but also at least one changeable object from the object contained in the avatar-based image is changed. The changeable object may further include at least one of a background image and a sound, but is not limited thereto. In operation S4205, the device 100 may update the user information based on the changed avatar-based image.

FIG. 43 is a functional block diagram of an apparatus 100, in accordance with an exemplary embodiment. Referring to FIG. 43, the device 100 can include a user input module 4310, a controller 4320, a display 4330, and a memory 4340.

The user input module 4310 can receive user input requesting user information, user input requesting change of user information, user input requesting addition of user information, user input to complete change of user information, and selection of objects. User input, user input requesting service information, user input selecting service information, user input accepting changed avatar-based image or user input of control device 100, but according to an exemplary embodiment User input is not limited to this.

The user input module 4310 can be mounted on the device 100. The user input module 4310 mounted on the device 100 can include, for example, at least one of the following: a keypad, a hemispherical switch, a touchpad (contact capacitance type, pressure resistance film type, infrared detection type). The surface acoustic conduction type, the integrated pull force measurement type or the piezoelectric effect type), the jog wheel and/or the jog switch, but the user input module 4310 according to an exemplary embodiment is not limited thereto.

User input received via user input module 4310 may be touch-based user input, motion-based user input, visual-based user input, and/or voice-based user input, but user input is not Limited to this.

Examples of touch-based user input can include light touch (or touch), long touch (or long touch), touch and hold, touch and drag, double tap, drag, horizontal move, tap, drag, and drag and drop. , swept or slip, but touch-based user input is not limited to this.

Examples of mobile-based user input may include user input based on movement-based user gestures of device 100 (eg, shaking device 100, rotating device 100, or lifting device 100), but mobile-based user input is not Limited to this.

Examples of visual-based user input may include user input identified by input image obtained by a camera included in device 100 without contact between device 100 and the user, but based on visual use The input is not limited to this.

Controller 4320 is one or more processors that control the operation of device 100. The controller 4320 can load and operate a program for executing a method of managing user information in accordance with one or more illustrative embodiments, the program being stored in the memory 4340. The controller 4320 can store the program for executing the method in the memory 4340. The controller 4320 can update the program stored in the memory 4340.

The controller 4320 can generate an avatar-based image based on the user information according to the method, and display the avatar-based image on the display 4330. After receiving a user input requesting to change the avatar-based image from the user input module 4310, the controller 4320 changes the avatar-based image based on the user input. The controller 4320 can update the user information based on the changed avatar-based image.

The controller 4320 can be based on FIGS. 2, 7, 9, 11, 13, 14, 16, 18, 20, 22, 28, 30, 33, 37, 39, The operation of the apparatus 100 is controlled by the method of any of FIGS. 40 to 42.

Moreover, when receiving a user input requesting user information of a specific time period via the user input module 4310, in response to the user input, the controller 4320 controls the display 4330 to view the user information according to the specific time period. Display multiple avatar-based images. The plurality of avatar-based images displayed on the display 4330 can be determined based on criteria for segmenting the particular time period.

Moreover, when receiving a user input requesting user information of a specific time period via the user input module 4310, in response to the user input, the controller 4320 controls the display 4330 to view the user information according to the specific time period. Display multiple avatar-based images. The plurality of avatar-based images displayed on the display 4330 can be determined based on the subject items included in the user information for the specific time period.

Moreover, when receiving a user input requesting display of changeable information via the user input module 4310, the controller 4320 can display the changeable area and the unchangeable area of the avatar-based image displayed on the display 4330 in a distinguishable manner.

Also, when the supply period is set with respect to the avatar-based image, the controller 4320 checks the supply period. When the supply period expires, the controller 4320 can remove the avatar-based image. Information about the supply period and the avatar-based image may be stored in the memory 4340, but the illustrative embodiments are not limited thereto. For example, information about the supply period and the avatar-based image may be stored in the external device 2120.

Moreover, when the avatar-based image is displayed on the display 4330 based on the user's health information, and the user input indicating the medical information request is received via the user input module 4310, the controller responds to the user input, and the controller 4320 displays medical information related to health information on display 4330.

When receiving a user input selecting medical information from the medical information provided via the display 4330 via the user input module 4310, the controller 4320 may update the user schedule information according to the selected medical information.

Moreover, when receiving user input to add information to the avatar-based image via the user input module 4310, the controller 4320 can display an input window for adding information on the display 4330. When receiving information via the input window, the controller 4320 adds an image corresponding to the received information to the avatar-based image displayed on the display 4330. The controller 4320 can update the user schedule information according to the avatar-based image to which the image is added. User schedule information can be stored in memory 4340 and/or external device 2120.

Further, the controller 4320 controls the display 4330 to display the avatar-based image based on the future hope information of the user. When the avatar-based image according to the future hope information is displayed on the display 4330, and the user input module 4310 receives the user input requesting the information related to the future desired information, the user input is controlled in response to the user input. The device 4320 provides information related to future hope information via the display 4330. When receiving a user input selecting at least one segment of information related to future hope information provided via the display 4330 via the user input module 4310, the controller 4320 may update the user schedule based on the selected information related to future hope information. News.

Moreover, when receiving a user input requesting usage history information of each usage period of the device 100 via the user input module 4310, in response to the user input, the controller 4320 may be based on the usage history on the display 4330. The information shows multiple avatar-based images.

Also, the controller 4320 can control the display 4330 to display an avatar-based image based on user information registered in the social media. Here, when receiving the user input requesting the change via the user input module 4310, the controller 4320 may change the avatar-based image displayed on the display 4330 in response to the user input, and according to the changed avatar based on the avatar The image updates the user information registered on social media. The user information registered in the social media may include user profile information registered in the social media server as described above. User information registered in social media according to an exemplary embodiment is not limited thereto.

Display 4330 can display information processed by device 100. Display 4330 can display a graphical user interface (GUI) screen as described above. For example, the display 4330 can display as described above with reference to FIG. 1, FIG. 5A to FIG. 5E, FIG. 6A to FIG. 6E, FIG. 8A to FIG. 8C, FIG. 10, FIG. 12A to FIG. 12C, FIG. 15A to FIG. 15E, and FIG. The GUI screens described in FIGS. 17D, 19A and 19B, 23A to 23F, 27A to 27F, 29A to 29F, 31A to 31D, or 38.

When the display 4330 and the touchpad form a layered structure configured as a touch screen, the display 4330 can be used as an input device and an output device. The display 4330 may include at least one of a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT-LCD), and an organic light-emitting diode (organic) Light-emitting diode (OLED), flexible display, 3D display, and electrophoretic display (EPD). However, the display 4330 is not particularly limited.

According to an exemplary embodiment of device 100, device 100 can include at least two displays. Here, at least two displays may be disposed to face each other by using a hinge. The display can be a transparent display unit.

The memory 4340 can store programs for the program and control of the controller 4320. The program stored in the memory 4340 may include an operating system (OS) program and various applications. The various applications may include an application for executing at least one of a method of managing user information according to one or more exemplary embodiments and a method of providing a service based on an avatar-based image, but the application is not limited this.

The memory 4340 stores information managed by the application. For example, the memory 4340 can store user information according to one or more exemplary embodiments, user model information based on user information, coordinate values of each object, and/or combined condition information of each object. However, the information stored in the memory 4340 is not limited to this.

The memory 4340 may include at least one storage medium from: a flash memory, a hard disk, a multimedia card micro memory, a card type memory (for example, a secure digital (SD) card or an extreme digit ( Extreme digital; XD) card, random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electricity It can erase electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, disk or optical disk. However, the memory 4340 is not particularly limited.

The device 100 can be configured to use a web page storage or cloud server (not shown) that performs the storage function of the memory 4340 over the Internet. At this time, the information about the GUI displayed on the display 4330 can be provided from the webpage storage or the cloud server.

Not all of the components of device 100 illustrated in Figure 43 are essential. Device 100 may include more or fewer components than those shown in FIG. For example, device 100 can be configured as shown in FIG.

Referring to FIG. 44, the device 100 can include a user interface module 4410, a controller 4420, a sensor module 4430, a memory 4440, an image processor 4450, an audio output unit 4460, an audio input unit 4470, a camera 4480, and a communication module. Group 4490.

Device 100 can further include a battery (not shown). The battery can be embedded in the device 100 or detachably contained in the device 100. The battery can supply power to all of the components included in device 100. Device 100 can receive power from an external power supply. The external power supply device may be a battery embedded in the external device 2120.

The user input module 4411 and the display 4412, the controller 4420, and the memory 4440 included in the user interface module 4410 of FIG. 44 are similar or identical to the user input module 4310, the controller 4320, and the display of FIG. 4330 and memory 4340.

The sensor module 4430 can include a proximity sensor 4431 that detects the proximity of the user to the device 100, an illumination sensor 4432 (or an optical sensor) that detects illumination around the device 100, and the detection device 100. Moodscope sensor 4433 of the user's emotion, position sensor 4434 (for example, GPS receiver) for detecting the position of the device 100, and gyroscope sensor 4435 of the azimuth of the measuring device 100 The measuring device 100 is based on the acceleration sensor 4436 (accelerometer) of the inclination and acceleration of the ground surface, the geomagnetic sensor 4437 that detects the azimuth orientation based on the device 100, and the infrared light reflected by the hand. A gesture sensor 4438 that recognizes the hand gesture and/or a temperature/humidity sensor 4439 that identifies the ambient temperature and humidity. When the position sensor 4434 is configured as a GPS receiver, the position sensor 4434 can be included in the communication module 4490. The gesture sensor 4438 can be a motion detection sensor that detects activity.

The sensor module 4430 is not limited to the sensor module shown in FIG. For example, the sensor module 4430 can further include a gravity sensor, an altitude sensor, a chemical sensor (eg, an odorant sensor), an atmospheric pressure sensor, and a fine dust measurement sensor. , infrared light sensor, ozone content sensor, carbon dioxide (CO2) sensor and/or network sensor (eg Wi-Fi, Wi-Fi Direct, Bluetooth, 3G, Long Term Evolution (long Term evolution; LTE) or near field communication (NFC) based network sensor).

The sensor module 4430 can include a pressure sensor (eg, a touch sensor, a piezoelectric sensor, or a physical button), a state sensor (eg, a headphone terminal, digital multimedia broadcasting) ;DMB) an antenna or standard terminal (for example, a terminal for identifying a charging level, a terminal for identifying a personal computer (PC) connection or a terminal for identifying a docking connection), a time sensor and/or Or a health sensor (eg, a biosensor, heart rate sensor, blood flow rate sensor, diabetes sensor, blood pressure sensor, or pressure sensor), but included in accordance with an exemplary embodiment The sensor in the sensor module 4430 is not limited thereto.

The result (a sensed value or sensed signal) detected by the sensor module 4430 is transmitted to the controller 4420.

The controller 4420 can generate an avatar-based image based on the sensed values received from the sensor module 4430 and display an avatar-based image on the display 4412. The controller 4420 can change the avatar-based image displayed on the display 4412 based on a user input that changes the avatar-based image via a request received via the user input module 4411. The controller 4420 can update the user information stored in the memory 4440 based on the changed avatar-based image. The controller 4420 can update the user information stored in the external device 2120 connected via the communication module 4490 according to the changed avatar-based image. Thus, controller 4420 can operate in the same manner as controller 4320 of FIG. 43, in accordance with an exemplary embodiment.

Controller 4420 controls the overall operation of device 100. For example, the controller 4420 can execute a program stored in the memory 4440 to control the user interface module 4410, the sensor module 4430, the memory 4440, the image processor 4450, the audio output unit 4460, and the audio input unit. 4470, camera 4480 and/or communication module 4490.

Controller 4420 can control the operation of device 100 based on the methods described above. For example, the controller 4420 can be based on FIGS. 2, 7, 9, 11, 13, 14, 16, 16, 18, 22, 28, 30, 33, 34 The operation of apparatus 100 is controlled by the method described in any of FIG. 37, and FIG. 39 to FIG. 42, such as controller 4320 of FIG.

The device 100 can include a plurality of controllers 4420 depending on the operating environment. For example, controller 4420 can include a processor operating in a low power mode and a processor operating in a normal mode of device 100. Controller 4420 can include multiple processors in accordance with the components included in device 100.

The programs stored in the memory 4440 can be classified into a plurality of modules according to functions. For example, the programs stored in the memory 4440 can be classified into a UI module 4441, a notification module 4442, and/or an application module 4443, but the programs stored in the memory 4440 according to an exemplary embodiment do not. Limited to this. For example, when the display 4412 is combined with the touch panel, the plurality of modules may include a touch screen module.

The UI module 4441 may provide GUI information for changing the user information described above according to an exemplary embodiment to the controller 4420. The UI module 4441 may provide a UI or GUI specific to each application installed in the device 100 to the controller 4200.

The notification module 4442 may generate a signal to notify the request change, request addition, change completion, object selection, request service information, or service selection of the device 100, but the notification generated by the notification module 4442 is not limited thereto.

The notification module 4442 may output the notification signal in the form of a video signal or in the form of an audio signal via the audio output unit 4460 via the display 4412, but is not limited thereto.

The application module 4443 may include at least one of a user information management application set in the device 100 and a service providing application based on the avatar-based image.

The user information management application according to an exemplary embodiment can be operated by connecting to another application set in the device 100. For example, when the problem information is received in operation S3702 of FIG. 37, the user information management application can be connected to the QA application set in the device 100 to provide answer information based on the problem information (for example, in operation S3703). ,search results).

The image processor 4450 processes the image data received from the communication module 4490 or stored in the memory 4440 for display on the display 4412. For example, the image processor 4450 can perform signal processing on the image material such that the above refers to FIGS. 1, 5A to 5E, 6A to 6E, 8A to 8C, 10, 12A to 12A. 12C, FIGS. 15A to 15E, 17A to 17D, 19A and 19B, 23A to 23F, 27A to 27F, 29A to 29F, 31A to 31D, and 38 The GUI screen is displayed on the display 4412.

According to an exemplary embodiment, the audio output unit 4460 may output a sound according to user information. The audio output unit 4460 can output audio data received from the communication module 4490 or stored in the memory 4440. The audio output unit 4460 can output a sound signal (eg, a notification sound) related to a function performed by the device 100. The audio output unit 4460 may include a speaker or a buzzer, but is not limited thereto.

The audio input unit 4470 can be configured as a microphone. The audio input unit 4470 can receive an audio signal input from an external device of the device 100, convert the audio signal into an electrical audio signal, and transmit the electrical audio signal to the controller 4420. The audio input unit 4470 can be configured to perform operations based on any of various noise removal algorithms for removing noise generated when an external sound signal is received.

When the device 100 is in the video call mode or the photographing mode, the camera 4480 can obtain a still image or an image frame of the moving image via the image sensor. The camera 4480 can obtain a finger motion image of the user of the device 100 and transmit it to the controller 4420. The controller 4420 can determine whether to receive a user input requesting to change the avatar-based image, requesting to add information to the user input based on the avatar image, and complete the use of the avatar-based image change based on the user's finger indicating the motion image. The user inputs, requests user input from the avatar-based image selection object, requests user input based on service information of the avatar-based image, or user input requesting execution of the avatar-based image service. According to an exemplary embodiment, the finger gesture motion image is not limited to determine whether a user input is received. Images captured by the image sensor can be processed via controller 4420 or a separate image processor (not shown).

The image frames processed by the camera 4480 can be stored in the memory 4440 or transmitted externally via the communication module 4490. According to an exemplary embodiment, device 100 may include at least two cameras 4480.

Communication module 4490 can include at least one component for communication between device 100 and at least one external device 2120. For example, the communication module 4490 can include at least one of a short range wireless communicator 4491, a mobile communicator 4492, and a broadcast receiver 4493. According to an exemplary embodiment, the components included in the communication module 4490 are not limited thereto. For example, communication module 4490 can include components for performing at least one communication described above with respect to network 2110 of FIG.

The short-range wireless communicator 4491 may include a module capable of performing communication from at least one of: Bluetooth communication, Bluetooth low energy (BLE) communication, near field communication (radio frequency identification (RFID)) ), wireless local area network (WLAN) communication (Wi-Fi), Zigbee communication, Ant+ communication, Wi-Fi direction (WFD) communication, and ultra wideband (UWB) Communication. The communication module included in the short-range wireless communicator 4491 according to an exemplary embodiment is not limited thereto. For example, the short range wireless communicator 4491 can include an infrared data association (IrDA) communication module. The short range wireless communicator 4491 can use lower power Bluetooth communication when receiving beacon signals.

The mobile communicator 4492 transmits the wireless signal to at least one of the base station, the external device, and/or the server over the mobile communication network and receives the wireless signal from at least one of the base station, the external device, and/or the server. Here, the wireless signal may include any of various types of data transmitted and received according to a voice call signal, an image call signal, or a text/multimedia message.

The broadcast receiver 4493 receives broadcast signals and/or broadcast associated information from an external source via a broadcast channel. The broadcast channel may include at least one of a satellite channel, a terrestrial wave channel, and a radio channel, but is not limited thereto.

The communication module 4490 can transmit the avatar-based image generated and/or changed by the device 100 according to an exemplary embodiment to the external device 2120. According to an exemplary embodiment, the communication module 4490 can receive at least the user information, the user model information, the avatar-based image, the service information, the coordinate information of each object, and the combined condition information of the object from the external device 2120. One. The information, materials, and signals transmitted via the communication module 4490 are not limited thereto.

FIG. 45 is a detailed functional block diagram of controller 4320 or 4420, in accordance with an exemplary embodiment. For convenience of description, FIG. 45 is described based on the controller 4420 of FIG. 44, and the description of the controller is also applicable to the controller 4320 of FIG.

Referring to FIG. 45, the controller 4420 includes an information collection processor 4501, a user model information generation processor 4502, an image generation processor 4503, an image display processor 4504, an image change processor 4505, and a user model information change processor. 4506.

The information collection processor 4501 can collect user information. The information collection processor 4501 can collect user information based on information received via the user input module 4411, the sensor module 4430, or the communication module 4490. User information has been described above. The user input received via the user input module 4411 can be based on selecting an item in the form of an image provided by the information collection processor 4501, but user input in accordance with an exemplary embodiment is not limited thereto. The information collection processor 4501 can store the collected user information in the memory 4440 or transmit the collected user information to the external device 2120 via the communication module 4490.

The user model information generation processor 4502 generates user model information by using user information collected by the information collection processor 4501. User modelling information can be configured as described above with reference to FIG. 3 or FIG. 24A. The user modeling information according to an exemplary embodiment is not limited thereto. The user model information generation processor 4502 can store the generated user model information in the memory 4440 or transmit the generated user model information to the external device 2120 via the communication module 4490.

The image generation processor 4503 generates an avatar-based image according to an exemplary embodiment based on the user modeling information generated by the user modeling information generation processor 4502. An avatar-based image is an image that symbolizes the user. The image generation processor 4503 can store the generated avatar-based image in the memory 4440 or transmit the generated avatar-based image to the external device 2120 via the communication module 4490. Images stored in the memory 4440 or the external device 2120 can be temporarily stored therein.

The image display processor 4504 displays the avatar-based image generated by the image generation processor 4503 via the display 4412.

According to an exemplary embodiment, image change processor 4505 changes the avatar-based image displayed via display 4412. After the avatar-based image change, the image change processor 4505 can update the avatar-based image stored in the memory 4440 or the external device 2120.

The user model information change processor 4506 updates the user information stored in the memory 4440 or the external device 2120 based on the avatar-based image changed by the image change processor 4505.

Controllers 4320 and 4420 of Figures 43 and 44 may include more or fewer components than those shown in Figure 45. For example, when receiving user information from the external device 2120, the controller 4320 or 4420 may not include the information collection processor 4501.

When receiving the user modeling information from the external device 2120, the controller 4320 or 4420 may include a user model information receiving processor instead of the information collecting processor 4501 and the user modeling information generating processor 4502, and the user model. The information transfer processor, rather than the user, models the information change processor 4506. For example, when receiving an avatar-based image based on user information from the external device 2120, the controller 4320 or 4420 may include an image receiving processor instead of the information collecting processor 4501, the user modeling information generating processor 4502, and The image generation processor 4503.

As described above, the detailed functional block diagram of the controller 4320 or 4420 of FIG. 43 or FIG. 44 is not limited to the detailed functional block diagram of FIG. Also, the function of the external device 2120 is determined based on the detailed functional block diagram of the controller 4320 or 4420.

The method according to one or more of the exemplary embodiments can be implemented via a computer program. For example, the method can be executed by an application for easily changing, adding, and/or checking user information based on an image indicating user information, the application being installed in the device 100. The computer program can operate in the operating system environment provided in device 100. The device 100 can write a computer program on the storage medium and read the computer program from the storage medium to use the computer program.

At least one program including a command for executing a method according to an exemplary embodiment by a computer can be written as a computer readable program code on a non-transitory computer readable recording medium. The non-transitory computer readable recording medium is any data storage device that can store data that can be thereafter read by a computer system. Examples of the computer readable recording medium include read-only memory (ROM), random-access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like. The computer readable recording medium can also be distributed over a network coupled computer system to store and execute computer readable code in a distributed manner.

It should be understood that the illustrative embodiments described herein are to be considered as illustrative only and not limiting. Descriptions of features or aspects within each exemplary embodiment should generally be considered as other similar features or aspects that may be used in other exemplary embodiments. Although one or more exemplary embodiments have been described with reference to the drawings, it will be understood by those skilled in the art that the form and details may be made therein without departing from the spirit and scope defined by the scope of the following claims. Various changes.

100‧‧‧ device
101‧‧‧Duration information
102‧‧‧Incarnation
103‧‧‧ Photos
104‧‧‧ Images
105~107‧‧‧Information
501‧‧‧About the first prepared image
502~504‧‧‧ images
505‧‧‧Change button
506‧‧‧Add button
507‧‧‧Complete button
508‧‧‧快显示窗
601~605‧‧‧ images
606‧‧‧Change button
607‧‧‧Add button
608‧‧‧Complete button
609‧‧‧ photo
801‧‧‧ input window
802‧‧‧Select input button
803‧‧‧ images
1001, 1002‧‧‧Image based on avatar
1201~1204‧‧‧Image based on avatar
1205‧‧‧Change button
1206‧‧‧Add button
1207‧‧‧Complete button
1500‧‧‧Smart bracelet
1511‧‧‧Hospital Project
1512‧‧‧ Pharmacy Project
1513‧‧‧Drug Project
1514‧‧‧ Self-treatment project
1521‧‧B hospital
1522‧‧C hospital
1523‧‧D hospital
1531‧‧‧User input
1532‧‧‧Reservation button
1701‧‧‧User input
1711‧‧‧Qualification inspection schedule
1712‧‧‧ Certification Center Project
1713‧‧‧ related event items
1721‧‧‧First Event Project
1722‧‧‧second event project
1723‧‧‧ Third Event Project
1724‧‧‧ separate window
1725‧‧‧Participate in the OK button
1910‧‧‧ working days
1911‧‧‧User input
1920‧‧ Weekend
2100‧‧‧ system
2110‧‧‧Network
2120‧‧‧External devices
2300‧‧‧ User Information
2301‧‧‧ User's hobby information
2302‧‧‧ User's name
2303‧‧‧User's gender information
2310‧‧‧Image based on avatar
2311‧‧‧Female avatars
2312‧‧ violin
2320‧‧‧Changed image
2330‧‧‧ User Information
2331‧‧‧ User's hobby information
2332‧‧‧ User's name
2333‧‧‧User's gender information
2340‧‧‧Image based on avatar/present image
2341‧‧‧Image based on avatars/future images
2342‧‧‧Image based on avatar/past image
2343‧‧ Morning imagery
2344‧‧ pm image
2345‧‧‧Image based on avatar/working day image
2346‧‧‧Image based on avatars/weekend images
2347‧‧‧Image based on avatar/spring image
2348‧‧‧Image based on avatars/summer images
2349‧‧‧Image based on avatars/autumn imagery
2350‧‧‧Image based on avatars/winter images
2400‧‧‧User Modeling Information
2401‧‧‧ Subject field
2402‧‧‧predicate field
2403‧‧‧ Object field
2404‧‧‧Categories
2405‧‧ Resources
2500‧‧‧ Mapping Information
2610, 2620‧‧‧ Object image
2630‧‧ images
2701‧‧‧Change request button
2702‧‧‧ User's name
2703‧‧‧ violin
2704‧‧‧Change completion button
2705‧‧‧Change request button
2706‧‧‧Information indicating the name
2707‧‧‧Information indicating hobbies
2708‧‧‧Change completion button
2709‧‧‧Change request button
2710, 2711‧‧
2712‧‧‧System匣
2714‧‧‧Change request button
2715‧‧‧Touch-based input
2716‧‧‧ speech bubble
2717‧‧‧Change completion button
2718‧‧‧Change request button
2719, 2720‧‧ Information
2721‧‧‧快显示窗
2722‧‧‧Change completion button
2723‧‧‧Change request button
2724, 2725‧‧ Information
2726‧‧‧ page
2727‧‧‧Change completion button
2910‧‧‧ screen
2911, 2911 '‧‧‧ Quick display window
2912‧‧‧ Guitar Project
2913‧‧‧Baseball Project
2914‧‧‧Badminton Project
2915‧‧‧Movie Project
2920‧‧‧ screen
2921‧‧‧快显示窗
2930‧‧‧ screen
2931‧‧‧Rectangle Quick View Window
2940‧‧‧ screen
2941‧‧‧ Ring Express Window
2950‧‧‧ screen
2951‧‧‧Touch and drag input
2960‧‧‧ screen
2961‧‧‧Express window
2970, 2980, 2990, 2995‧‧‧ screen
2996‧‧‧ baseball bat
3110, 3120, 3130‧‧‧ screen
3131‧‧‧Fast window
3132‧‧‧Second selection signal
3140‧‧‧ screen
3141‧‧‧快显示窗
3150‧‧‧ screen
3151‧‧‧ speech bubble
3152‧‧‧Double touch
3160, 3170‧‧‧ screen
3200‧‧‧ User Modeling Information
3810, 3820‧‧‧ screen
4110, 4210‧‧‧ wearable devices
4310‧‧‧User input module
4320‧‧‧ Controller
4330‧‧‧ display
4340‧‧‧ memory
4410‧‧‧User Interface Module
4411‧‧‧User input module
4412‧‧‧ display
4420‧‧‧ Controller
4430‧‧‧Sensor module
4431‧‧‧ proximity sensor
4432‧‧‧Lighting sensor
4433‧‧‧Emotional Instrument Sensor
4434‧‧‧ position sensor
4435‧‧‧Gyroscope sensor
4436‧‧‧Acceleration sensor
4437‧‧‧Geomagnetic sensor
4438‧‧‧Signal motion sensor
4439‧‧‧ Temperature/Humidity Sensor
4440‧‧‧ memory
4441‧‧‧User interface module
4442‧‧‧Notification module
4443‧‧‧Application Module
4450‧‧‧Image Processor
4460‧‧‧ audio output unit
4470‧‧‧Optical input unit
4480‧‧‧ camera
4490‧‧‧Communication Module
4491‧‧‧Short-range wireless communicator
4492‧‧‧Mobile Communicator
4493‧‧‧Broadcast receiver
4501‧‧‧Information Collection Processor
4502‧‧‧User modeled information generation processor
4503‧‧‧Image Generation Processor
4504‧‧‧Image display processor
4505‧‧‧Image Change Processor
4506‧‧‧User Modeling Information Change Processor
S201~S203‧‧‧ operation
S701~S704‧‧‧ operation
S901~S904‧‧‧ operation
S1101~S1104‧‧‧ operation
S1301~S1303‧‧‧ operation
S1401~S1403‧‧‧ operation
S1601~S1603‧‧‧ operation
S1801, S1802‧‧‧ operation
S2001~S2003‧‧‧ operation
S2201~S2203‧‧‧ operation
S2801~S2804‧‧‧ operation
S3001~S3008‧‧‧ operation
S3301~S3305‧‧‧ operation
S3401~S3404‧‧‧ operation
S3501~S3503‧‧‧ operation
S3601~S3604‧‧‧ operation
S3701~S3703‧‧‧ operation
S3901~S3906‧‧‧ operation
S4001~S4007‧‧‧ operation
S4101~S4112‧‧‧ operation
S4201~S4205‧‧‧ operation

BRIEF DESCRIPTION OF THE DRAWINGS The following description of the exemplary embodiments, which are illustrated in the accompanying drawings Schedule information displays instances of avatar-based images. 2 is a flow diagram of a method of managing user information, wherein the device changes user information by using an avatar-based image based on user schedule information, in accordance with an illustrative embodiment. 3 illustrates an example of user modelling information regarding user schedule information generated by a device, in accordance with an illustrative embodiment. 4 is a table for describing a relationship between a plurality of segments of article information stored in a device and a plurality of object images, in accordance with an exemplary embodiment. 5A-5E are diagrams for describing an example of a device changing an avatar-based image, in accordance with an exemplary embodiment. 6A-6E are diagrams for describing another example of a device changing an avatar-based image, in accordance with an exemplary embodiment. 7 is a flow diagram of a method of managing user information, wherein the device adds user information by using an avatar-based image based on user schedule information, in accordance with an illustrative embodiment. 8A-8C are diagrams for describing another example of a device changing an avatar-based image, in accordance with an exemplary embodiment. 9 is a flowchart of a method for managing user information of a plurality of avatar-based images based on user schedule information according to a specific time period by a device, according to an exemplary embodiment. 10 illustrates an example of a plurality of avatar-based images displayed by a device based on weekday user schedule information and weekend user schedule information, in accordance with an illustrative embodiment. 11 is a flow diagram of a method of managing user information, wherein the device uses a plurality of avatar-based images based on user schedule information for each topic item, in accordance with an illustrative embodiment. 12A through 12C are diagrams for describing an example of changing a plurality of avatar-based images of each subject item, according to an exemplary embodiment. 13 is a flow diagram of a method of managing user information, wherein the device manages life of an avatar-based image, in accordance with an illustrative embodiment. 14 is a flow diagram of a method of managing user information, wherein the device uses an avatar-based image based on the user's health information, in accordance with an illustrative embodiment. 15A-15E are diagrams for describing an example of updating user schedule information by means of an avatar-based image according to a user's health information, according to an exemplary embodiment. 16 is a flow diagram of a method for managing user information based on avatar-based images based on future hopes of a user, by a device, in accordance with an illustrative embodiment. 17A-17D are diagrams for describing a procedure for updating user schedule information based on an avatar-based image based on a user's future desired information, according to an exemplary embodiment. 18 is a flowchart of a method of managing user information based on a plurality of avatar-based images based on usage history information of the device, in accordance with an exemplary embodiment. 19A and 19B are diagrams for describing an example of providing a plurality of avatar-based images by a device according to a usage history information request of a device, according to an exemplary embodiment. 20 is a flow diagram of a method of managing user information, wherein the device uses an avatar-based image based on user information registered in the social media, in accordance with an illustrative embodiment. 21 is a block diagram of a system for managing user information that includes devices, in accordance with an illustrative embodiment. 22 is a flow diagram of a method of managing user information by a device, in accordance with an illustrative embodiment. 23A-23F are diagrams for describing an avatar-based image displayed by a device based on user information, in accordance with an exemplary embodiment. 24A illustrates an example of user modeling information regarding user information, in accordance with an illustrative embodiment. 24B illustrates an example of a display size of an object included in an avatar-based image displayed on a device, in accordance with an illustrative embodiment. 24C is a diagram for describing a display size of an object included in an avatar-based image, in accordance with an exemplary embodiment. 25 illustrates an example of mapping information between an object image and object identification (ID) information, in accordance with an illustrative embodiment. 26 is a diagram for describing a procedure for generating an avatar-based image by using user modelling information and mapping information, in accordance with an illustrative embodiment. 27A-27F illustrate an example of a device displaying a changeable item, in accordance with an illustrative embodiment. 28 is a flow diagram of a method of changing an avatar-based image based on user input by a device, in accordance with an illustrative embodiment. 29A-29F illustrate an example of changing an item based on a candidate item provided by the device, in accordance with an illustrative embodiment. 30 is a flow diagram of a method of providing service information that may be provided based on objects contained in an avatar-based image by a device, in accordance with an illustrative embodiment. 31A to 31D illustrate an example of a screen for describing the method of FIG. 32 illustrates an example of user modeling information updated by a device, in accordance with an illustrative embodiment. 33 is a flow diagram of a method for managing user information by a device by changing an avatar-based image, in accordance with an illustrative embodiment. FIG. 34 is a flowchart of a method for managing user information by a device by changing an avatar-based image, according to another exemplary embodiment. 35 is a flow diagram of a method of managing user information, wherein the device changes and/or adds information by using an avatar-based image, in accordance with an illustrative embodiment. 36 is a flow diagram of a method of managing user information to enable a device to provide services based on an item selected from an avatar-based image, in accordance with an illustrative embodiment. 37 is a flow diagram of a method of managing user information, wherein the device provides a question and answer (QA) service based on the displayed avatar-based image, in accordance with an illustrative embodiment. Figure 38 illustrates an example of a device providing answer information based on received problem information, in accordance with an illustrative embodiment. 39 is a flow diagram of a method of managing user information based on a device and an external device, in accordance with an illustrative embodiment. FIG. 40 is a flowchart of a method of managing user information based on a device and an external device, according to another exemplary embodiment. 41 is a flow diagram of a method of managing user information based on a device and a wearable device, in accordance with an illustrative embodiment. 42 is a flowchart of a method of managing user information based on a device and a wearable device, in accordance with another exemplary embodiment. 43 and 44 are functional block diagrams of devices in accordance with an exemplary embodiment. 45 is a detailed functional block diagram of a controller, in accordance with an illustrative embodiment.

S201~S203‧‧‧ operation

Claims (15)

An apparatus for managing user information, the apparatus comprising: a display configured to display an avatar-based image; and a controller configured to control the display such that the display is based on a user The schedule information displays the avatar-based image, the avatar-based image is changed according to a user input indicating a request to change the avatar-based image, and the user is updated according to the changed avatar-based image Schedule information. The device for managing user information, as described in claim 1, further comprising: a user input module configured to receive user input requesting user information for a specific time period; wherein User input, the controller controlling the display to display a plurality of avatar-based images according to the user information of the specific time period, and the plurality of avatar-based images are for including the specific time period The different time periods are determined and correspond to the plurality of different time periods, respectively. The device for managing user information according to claim 1, wherein the controller controls the display to display a plurality of avatar-based images; the device further comprises: a user input module, Configuring to receive user information requesting a specific time period; in response to the user input, the controller controls the display to display the plurality of avatar-based images according to the user information of the specific time period, And the plurality of avatar-based images are determined according to a theme item included in the user information of the specific time period. The apparatus for managing user information, as described in claim 1, further comprising: a user input module configured to receive user input requesting display of changeable information about the avatar-based image And in response to the user input, the controller controls the display to display the changeable area and the unchangeable area in the avatar-based image in a distinguishable manner. The apparatus for managing user information according to claim 1, wherein the controller checks a supply period set for the avatar-based image, and controls the display when the supply period has expired The avatar-based image is not displayed. The device for managing user information, as described in claim 1, wherein the controller controls the display to display the avatar-based image according to a user's health information; the device further includes: using Input module configured to receive user input indicative of a medical information request; and the controller controls the display to display medical information related to the health information in response to the user input, and After receiving the user input related to the medical information selected based on the displayed medical information, the user input module updates the user schedule information according to the selected medical information. The device for managing user information, as described in claim 1, further comprising: a user input module configured to receive user input indicating information to be added to the avatar-based image; Wherein the controller controls the display to display an input window for receiving an input of the information to be added; and the controller adds an image corresponding to the information received via the input window to the An avatar-based image, and updating the user schedule information according to the avatar-based image including the added image. The apparatus for managing user information according to claim 1, wherein the controller controls the display to display the avatar-based image according to future hope information of the user; Including: a user input module configured to receive user input requesting information regarding the future desired information; and the controller controlling the display to display relevant to the future based on the user input The information of the information is desired, and the user schedule information is updated according to information selected from the information related to the future hope information. The device for managing user information according to claim 1, wherein the controller controls the display to display a plurality of avatar-based images according to usage history information of the device; User input module configured to receive user input requesting usage history information for each usage period of the device; and in response to the user input, the controller controls the display to display Describe multiple avatar-based images. The apparatus for managing user information according to claim 1, wherein the controller controls the display to display the avatar-based image according to user information registered in social media; The method further includes: a user input module, configured to receive a user input requesting to change the avatar-based image; and the controller changes the avatar-based image in response to the user input, and according to the The altered avatar-based image updates the user information registered in the social media. A method of managing user information, wherein the method is performed by a device, the method comprising: displaying an avatar-based image based on user schedule information on a display of the device; and changing the avatar-based image according to the indication The requested user input changes the avatar-based image; and updates the user schedule information according to the changed avatar-based image. The method for managing user information according to claim 11, wherein the displaying comprises displaying a plurality of avatar-based images according to user information of a specific time period, wherein the plurality of avatar-based images are for Determining a plurality of different time periods of a specific time period and respectively corresponding to the plurality of different time periods. The method for managing user information according to claim 11, wherein the displaying comprises displaying a plurality of avatar-based images according to user information of a specific time period, wherein the plurality of avatar-based images are included in Determining the subject item in the user information for the specific time period. The method for managing user information, as described in claim 11, further comprising: displaying the changeable area in the avatar-based image in a distinguishable manner in response to requesting display of user input that can change information; Change the area. The method for managing user information according to claim 11, further comprising: checking a supply period set for the avatar-based image; and controlling the display not to display when the supply period has expired An image based on an avatar.