KR20160051536A - Device for managing user information based on image and method thereof - Google Patents

Abstract

The present invention provides a device for managing user information based on an image and a method thereof, effectively managing user information by easily revising, adding, or/and checking the user information based on an image representing the user information. According to one embodiment of the present invention, the device includes: a display which displays an avatar-based image; and a control unit which revises the avatar-based image being displayed on the display in accordance with a user input, and updating the user information based on the revised avatar-based image.

Description

[0001] DEVICE FOR MANAGING USER INFORMATION BASED ON IMAGE AND METHOD THEREOF [0002]

The present disclosure relates to a device and method for managing user information, and more particularly, to a device and method for managing user information based on an image representing user information.

With the development of communication technology and the smartization of devices, it is becoming possible to collect various user information. The user information refers to user-related information such as user profile information and / or user's life log information. The user's life log information may include, but is not limited to, user schedule information, or user health information.

User information may be collected using a user input or / and a sensing function of the device, a detection function of the device, or / and a data analysis function of the device, but the method of collecting the user information is not limited thereto.

There is a need for a technique for effectively managing user information collected in various ways.

The above-described background information is information that the inventor holds for the purpose of deriving the present disclosure or obtained in the process of deriving the present disclosure and is not necessarily a known technology disclosed to the general public prior to the filing of the present disclosure.

Embodiments of the present disclosure are for effectively managing user information by easily modifying, adding, and / or verifying user information on an image basis that represents user information.

In addition, embodiments of the present disclosure are for effectively managing user information by easily identifying and using services that can be provided on an image basis representing user information.

As a technical means to accomplish the above-mentioned technical objects, a first aspect of the present disclosure provides a device for managing user information, comprising: a display for displaying an avatar-based image; Based image in accordance with a user input indicating a modification request for the avatar-based image, and for modifying the avatar-based image according to a user input indicating a modification request for the avatar-based image, And a controller for updating the user schedule information according to the user schedule information.

The display may further include a user input unit for displaying a plurality of avatar-based images and receiving a user input for requesting user information of a specific period by being controlled by the control unit, In response, the device is controlled to display a plurality of avatar-based images according to the user information of the specific period, and the plurality of avatar-based images can be determined according to a criterion dividing the specific period.

The display may further include a user input unit for displaying a plurality of avatar-based images and receiving a user input for requesting user information of a specific period by being controlled by the control unit, Based image in response to the user information of the specific period, and the plurality of avatar-based images may be determined according to a theme item included in the user information of the specific period.

The device may further include a user input for receiving a user input requesting a modifiable information display, wherein the display, by being controlled by the control unit, is operable, in response to the user input, The part can be marked differently from the non-modifiable part.

Also, the control unit may check the provision period if the provision period for the avatar-based image is set, and may extinguish the avatar-based image when the provision period expires.

The display may further include a user input unit for displaying an avatar-based image according to health information of a user, the device receiving a user input indicating a request for medical information, The method according to claim 1, further comprising: providing health information related to health information of a user through the display; and receiving, when the user input relating to the selected medical information is received through the user input unit based on the provided medical information, Information can be updated.

The device may further include a user input unit for receiving a user input indicating addition of information on the avatar-based image, wherein the display controls an input window for adding the information by being controlled by the control unit, The control unit may add an image corresponding to the information received through the input window to the avatar-based image, and update the user's schedule information according to the avatar-based image including the added image.

The display may further include a user input unit for receiving a user input for requesting information related to the future desired information by controlling the display unit to display an avatar based image according to user's future desired information by controlling the control unit The control unit may provide information relating to future desired information according to the user input through the display and update the schedule information of the user according to information selected from information related to the future desired information.

In addition, the display may display a plurality of avatar-based images according to usage history information of the device by being controlled by the control unit, and the device may receive user input for requesting usage history information for each device for the usage period And the control unit may control the display such that the plurality of avatar-based images are displayed on the display in response to the user input.

The display may further include a user input unit for displaying an avatar-based image according to user information registered in the social media by being controlled by the control unit, the device including a user input for requesting modification, Based image in response to the user input and update the user information registered in the social media according to the modified avatar based image.

According to a second aspect of the present disclosure, there is provided a method of managing user information executed by a computing device, the method comprising: displaying an avatar-based image according to user schedule information on a display of the computing device step; Modifying the avatar-based image according to user input indicating a modification request for the avatar-based image; And updating the user schedule information according to the modified avatar-based image.

In addition, the step of displaying the avatar-based image may include displaying a plurality of avatar-based images according to user information of a specific period of time, and the plurality of avatar-based images may be determined according to a criterion for dividing the specific period of time .

The displaying of the avatar-based image may include displaying a plurality of avatar-based images according to user information of a specific period, and the plurality of avatar-based images may include a theme Can be determined according to the item.

The method may further include displaying the modifiable portion of the avatar-based image distinct from the non-modifiable portion in response to a user input requesting a modifiable information display.

The method may further include: checking the providing period if the providing period for the avatar-based image is set; And exposing the avatar-based image when the providing period expires.

The method may further include displaying an avatar-based image according to the user's health information on the display; Providing health information related to the health information of the user according to a user input indicating a medical information request; And updating the schedule information of the user according to the medical information selected based on the provided medical information.

The method may further include displaying an input window for adding the information on the display as a user input indicating the addition of information about the avatar-based image is received; Adding an image corresponding to information received through the input window to the avatar-based image; And updating the schedule information of the user according to the avatar-based image including the added image.

The method may further include displaying an avatar-based image according to future user's desired information; And providing information related to future desired information according to a user input requesting information related to the future desired information; And updating the schedule information of the user according to information selected from the information related to the future desired information.

The method may further include displaying a plurality of avatar-based images corresponding to the usage history information according to a user input requesting usage history information for each usage period of the computing device.

The method may further include displaying an avatar-based image according to user information registered in a social media; Modifying the avatar-based image according to a user input requesting modification; And updating the user information registered in the social media according to the modified avatar-based image.

The third aspect of the present disclosure can provide a computer-readable recording medium on which a program for causing a computer to execute the method of the second aspect is recorded.

1 is an example in which a device according to some embodiments displays an avatar-based image according to the travel schedule information of a user.
2 is a flowchart of a method of managing user information in which a device according to some embodiments modifies user information using an avatar-based image according to user schedule information.
3 is an example of user modeling information for user schedule information generated by a device according to some embodiments.
4 is a diagram for explaining a relationship between a plurality of object information and a plurality of object images stored in a device according to some embodiments.
5A-5E illustrate an example in which a device according to some embodiments modifies an avatar-based image.
6A-6E are another example of a device according to some embodiments modifying an avatar-based image.
7 is a flowchart of a method of managing user information in which a device according to some embodiments adds user information using an avatar-based image according to user schedule information.
8A-8C are another example of a device according to some embodiments modifying an avatar-based image.
9 is a flowchart of a method for managing user information based on a plurality of avatar-based images according to user schedule information of a specific period according to some embodiments.
10 is an example of displaying a plurality of avatar-based images based on weekday user schedule information and weekend user schedule information by a device according to some embodiments.
11 is a flowchart of a method of managing user information in which a device according to some embodiments uses a plurality of avatar-based images based on theme item-based user schedule information.
12A to 12C are examples of modifying a plurality of avatar-based images for each theme item.
13 is a flowchart of a method of managing user information in which a device according to some embodiments manages the lifetime of an avatar-based image.
14 is a flowchart of a method of managing user information in which a device according to some embodiments uses an avatar-based image according to health information of a user.
15A to 15E are views illustrating an example in which a device according to some embodiments updates user information using an avatar-based image according to a user's health information.
16 is a flowchart of a method of managing user information based on an avatar-based image according to a user's future desired information according to some embodiments.
17A to 17D are diagrams for explaining a process in which a device according to some embodiments updates user schedule information based on an avatar-based image according to a user's future desired information.
18 is a flowchart of a method for managing user information based on a plurality of avatar-based images according to usage history information of a device according to some embodiments.
Figs. 19A and 19B are an example in which a device according to some embodiments provides a plurality of avatar-based images according to usage history information request of the device.
20 is a flowchart of a user information management method in which a device according to some embodiments uses an avatar-based image according to user information registered in social media.
21 is a block diagram of a user information management system including a device according to some embodiments.
22 is a flowchart illustrating a method for managing user information performed by a device according to some embodiments.
23A-23F are diagrams illustrating avatar-based images that a device according to some embodiments displays based on user information.
24A is an example of user modeling information for user information, in accordance with some embodiments.
24B is an example of a display size of an object included in an avatar-based image that can be displayed on a device according to some embodiments.
24C is a view for explaining a display size of an object included in an avatar-based image according to some embodiments.
25 shows an example of mapping information between an object image and object identification information according to some embodiments.
26 is a view for explaining a process of generating an avatar-based image using user modeling information and mapping information according to some embodiments.
Figures 27A-27F are examples of devices in accordance with some embodiments displaying modifiable objects.
Figure 28 is a flow diagram of a process in which a device according to some embodiments modifies an avatar-based image in accordance with user input.
29A-29E illustrate an example in which an object is modified based on a candidate object provided by a device according to some embodiments.
FIG. 30 is a flowchart illustrating a process in which a device according to some embodiments provides service information that can be provided for each object included in an avatar-based image.
Figs. 31A to 31D are examples of screens for explaining the user information management method shown in Fig. 30. Fig.
32 is an example of user modeling information updated by a device according to some embodiments.
33 is a flow diagram of a method in which a device according to some embodiments modifies an avatar-based image to manage user information.
34 is a flow diagram of a method in which a device according to some embodiments modifies an avatar-based image to manage user information.
35 is an operational flowchart of a method for managing user information in which a device according to some embodiments modifies and / or adds information using an avatar-based image.
36 is a flowchart of a method for managing user information so that a device according to some embodiments may provide a service based on an object selected in an avatar-based image.
37 is a flowchart of a user information management method for providing a QA (Question & Answer) service based on an avatar-based image on which a device according to some embodiments is being displayed.
FIG. 38 is an example in which a device according to some embodiments provides answer information according to question information to be received.
39 is a flowchart of a method of managing user information based on a device and an external device according to some embodiments.
40 is a flowchart of a method of managing user information based on a device and an external device according to some embodiments.
41 is a flowchart of a method of managing user information based on a device and a wearable device according to some embodiments.
42 is a flowchart of a method of managing user information based on a device and a wearable device according to some embodiments.
Figures 43 and 44 are functional block diagrams of a device according to some embodiments.
45 is a detailed functional block diagram of a control unit according to some embodiments.

BRIEF DESCRIPTION OF THE DRAWINGS The specific embodiments are illustrated and described in detail in the drawings below. It should be understood, however, that the invention is not limited to the specific embodiments described below, but includes all changes, equivalents, and alternatives falling within the spirit and scope of the invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the embodiments of the present general inventive concept, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout.

The terms first, second, etc. may be used to describe various elements, but the elements should not be limited by terms. Terms are used only for the purpose of distinguishing one component from another.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. While the terms used throughout the specification have taken into account their function, they have chosen the general terms which are currently widely used, but may vary depending on the intentions, precedents, or emergence of new techniques employed by those skilled in the art. In addition, in certain cases, there may be a term arbitrarily selected by the applicant, in which case the meaning of the selected term will be described in detail. Therefore, terms used throughout the specification should be defined not based on the name of a simple term but on the meaning and meaning of the term throughout the specification.

The singular expressions include plural expressions unless the context clearly dictates otherwise. It is to be understood that the terms "comprises", "having", and the like in the specification are intended to specify the presence of stated features, integers, steps, operations, elements, parts or combinations thereof, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, parts, or combinations thereof.

In the present disclosure, user information may include user profile information.

The user profile information may include information about the sex of the user. The user profile information may include information about the user's name. The user profile information may include information about the age of the user. The user profile information may include information about the nationality of the user.

In addition, the user profile information may include information about the area in which the user currently resides. The user profile information may include information about the company name in which the user is working. The user profile information may include information about the location of the company where the user is working. The user profile information may include information about a user's hobby.

In addition, the user profile information may include information about where the user was born. The user profile information may include information about the user's job. The user profile information may include information about the user's family (e.g., information about the presence or absence of a parent, presence of a parent, etc.). The user profile information may include information about the user's pet (e.g., presence of pets, pet type, etc.). The user profile information may include information about the user's interests (e.g., classical guitar, soccer, economy, travel, games, books, etc.). The user profile information in the present disclosure is not limited to the above-mentioned ones.

In addition, the user profile information may be referred to as user profile information (hereinafter, abbreviated as social media profile information) registered in social media (e.g., Facebook, Twitter, blog, YouTube, LinkedIn, etc.).

The social media profile information may be generated by analyzing the context, vocabulary, images, and / or tags posted by the user and storing the detected keywords, photos, places, time and / or events (e.g., photo exhibits, art exhibitions, A play, a concert, or a play, etc.).

In the present disclosure, user information may include user information (e.g., membership information, game level information, article information, usage history information, and / or game information) registered in a web site (e.g., Naver, (quest information), and the like.

In the present disclosure, the user information may include user information registered respectively with an application installed in the device. An application installed in a device may be, for example, a schedule management application, a game application, a service center application, a membership application, a customer center application, a market application, a life log management application, a map application, A bucket list management application or a wish list management application), but the application installed in the device in this disclosure is not limited thereto.

In the present disclosure, the user information may include information obtained by the device based on data generated or input / output by the interaction between the device and the user.

The information obtained by the device may include search history information. The information obtained by the device may include mail history information. The information obtained by the device may include information about the message history (e.g., short message, multi-message, or voice message). The information obtained by the device may include browsing history information.

In addition, the information obtained by the device may include social media usage history information (or social network service history information). The information obtained by the device may include call history information. The information obtained by the device may include album history information. The information obtained by the device may include network history information. The information obtained by the device may include content history information. The information obtained by the device is not limited to the above-mentioned ones.

The search history information may include at least one piece of information (e.g., a list of search terms (or query terms), the number of searches per search term, the date of search, or the number of search results) have.

The mail history information includes at least one piece of information acquired while executing the mail application installed in the device (for example, transmission / reception mail list, number of transmission / reception mails, number of erased mails, sender list, Number of received emails, date of sending / receiving mail, etc.).

The message history information includes at least one piece of information acquired while executing a message application installed in the device (e.g., a list of transmission / reception messages, a number of transmission / reception messages, a number of deleted messages, a list of senders, Number of message recipients per recipient, date of sending and receiving messages, etc.).

The browsing history information may include at least one piece of information (e.g., a URL (Uniform Resource Locator) list, a number of accesses per URL, URL link information, etc.) obtained while executing a browsing application installed in the device.

The social media usage history information may include at least one piece of information (e.g., number of postings, number of comments, etc.) obtained while running the social media service application installed on the device. For example, the social media usage history information may include a keyword, a photo, a location, a time and / or an event (e.g., a photo exhibition) detected by analysis of at least one of the context, vocabulary, image, and / (E.g., a keyword list, a number of occurrences per keyword, a list of places, a number of visits per place, a time-based social network service based on at least one of a time, a baseball game, an art exhibition, a baseball game, a soccer game, a concert, The activity contents of the user, or the number of visits per event, etc.).

The call history information includes at least one piece of information acquired while executing the call application installed in the device (for example, the number of video calls, the video call time, the video call destination, the number of calls per video call destination, A voice call time, a voice call destination, a number of calls per voice call destination, or a call time per voice call destination, and the like).

The album history information includes information about a still image and / or a moving image obtained while executing a camera application installed in the device (for example, a photographing place, photographing object information (e.g., a person, an object, Date, etc.).

The network history information may include at least one network connection information of the device. The network connection information includes, for example, whether Wi-Fi is enabled, the number of Wi-Fi connections, the name of a connected Wi-Fi device, information about the Wi-Fi network, whether or not Bluetooth is enabled, the number of Bluetooth connections, the name of the connected Bluetooth device, The NFC usage count, the NFC usage history, the beacon connection history, or the ZigBee connection history, but the network connection information in the present disclosure is not limited thereto.

The content history information may include content generated using the device and information about the content. The content history information may include content that is shared with other devices and information about the content. The content history information may include content transmitted to another device and information about the content.

In addition, the content history information may include content received from another device and information related thereto. The content history information in the present disclosure is not limited to the above-described ones. The information on the content included in the content history information includes, for example, a content creation date, a data amount of the content, a search keyword for the content, a name of the device that generated the content, a name of the device that transmitted the content, And may include the name of the received device.

In the present disclosure, the user information may include environmental information of the device set in the device. The environmental information of the device may include, for example, the name of the device, the account information, the backup account, or the name of the external device (or peripheral), but the environmental information of the device is not limited in this disclosure.

In the present disclosure, user information may be stored in a device. In the present disclosure, user information may be received from at least one external device connected to the device. The external device may include a wearable device (e.g., smart watch, smart glass, etc.). The external device may include an appscessory. The external device may comprise a medical device. The external device may include a vehicle. The external device may include a server (e.g., a Question & Answer server, or a game server). The external device may include an Internet-of-Thing (IoT) network-based device (hereinafter referred to as IoT device). The external device may include an IoT network-based sensor (hereinafter, referred to as IoT sensor). The external device may include a device (e.g., a game console, etc.).

User information provided from an external device may include a value (or a measured value) sensed by an external device. The user information provided from the external device may include information collected by the external device. The information collected by the external device may include information detected or analyzed by the external device. The user information provided from the external device is not limited to the above-mentioned ones.

The value sensed by the external device may include the health information of the user. The value sensed by the external device may include the activity information of the user. The values sensed by the external device are not limited to those described above.

The user's health information may include information about exercise time. The user's health information may include information about the heart rate during the exercise period. The user's health information may include information about pulse oximetry during the exercise period. The user's health information may include information about calorie consumption during the exercise period. The health information of the user may include information on the movement distance of the user during the exercise period.

In addition, the user's health information may include information about the temperature of the user's skin during the exercise period. The health information of the user may include information on the number of steps of the user of the day. The user's health information may include information about the user's galvanic skin response during the exercise period. The user's health information may include information about a duration of sleep of the user. The user's health information may include information about sleep patterns of the user. The user's health information may include information on the blood sugar level of the user.

The user's health information may also include information sensed by the medical device or measured information (e.g., body composition, blood vessel age, blood pressure, or information about the meridian vein, etc.).

The user's activity information may include information indicating walking. The user's activity information may include information indicating running. The activity information of the user may include information indicating stay. The activity information of the user may include information indicating sleep.

In addition, the activity information of the user may include information indicating a moving means (for example, a passenger car, a bus, a train, an airplane, or a ship). The activity information of the user may include information indicating the user's staying time in one place. The user's activity information may include information about a place that the user frequently visits.

In addition, the activity information of the user may include information about the person that the user frequently meets. The user's activity information may include information about the meeting in which the user participates. The activity information of the user may include information about the meeting in which the user participates. In the present disclosure, the activity information of the user is not limited to the above-mentioned ones. The activity information of the user may include a part of the above-described user's health information (for example, exercise time).

The information collected by the external device may include, but is not limited to, information collected by the server. The information collected by the server may include information that maps the user's Question and search results. The information collected by the server may include information (e.g., game level, motion level, etc.) obtained by the device described above. The information collected by the server is not limited to the one just described.

In the present disclosure, user information may include the user's physical information. In addition, the user information may include the mental information of the user. The user information may include the user's social information. The user information may include schedule information of the user. The user information may include the user's future desired information (bucket list, or desired information). The user information may include usage history information for the device for the usage period.

The user's physical information may include information about the face (e.g., face type, pupil color, nose shape, mouth shape, eye shape, and / or eyebrow shape, etc.). The user's physical information may include information about the user's key. The user's physical information may include information about the user's hair style (e.g., short hair, long hair, curly hair, straight hair, or wave, etc.). The user's physical information may include the user's race information. The user's physical information may include the user's weight information. In the present disclosure, the user's physical information is not limited to the above-mentioned ones. The user's physical information may include, for example, information about the user's gender, and / or information about the age of the user.

The mental information of the user may include information on the taste of the user (for example, food symbol information). The user's mental information may include information about the user's propensity (e.g., bookmark information, frequently running application information, application run time information, book purchase history information, video rental history information, magazine subscription information, And / or item purchase history information) based on the user's preference information.

In addition, the mental information of the user may include information on the user's preference (for example, preference information based on information such as website search history information and / or hobby information). The user's mental information may include information about the user's feelings (e.g., information indicating joy, sadness, fear, anger, surprise, greeting, or aversion). The formal information of the user is not limited to the above. For example, the user ' s formal information may include information regarding the above - mentioned concerns.

The user's social information may include information about the education of the user. The user's social information may include information about the user's workplace. The user's social information may include information about the business contents of the user. The user's social information may include information about the user's meeting. In the present disclosure, the user's social information is not limited to the above-mentioned one.

The user's schedule information may include, but is not limited to, information entered by a user using a schedule management application. The user's schedule information may include information about the user's past, present, and future. The user's schedule information may include user information based on at least one of time, day of week, month, year, and season.

The schedule information of the user can be classified based on the theme item. Theme items can be, for example, travel, company, study, bike, meeting, dating, movie viewing, athletics, shopping, hospital, beauty care, meals, games, meetings, climbing, night activities, birthdays, performances, And may include at least one. Theme items in the present disclosure are not limited thereto.

The user information may include all or some of the user information managed by the user's Personal Information Management Software (PIMS). The user information may include at least one or all of the information included in the user's life log information.

The user information may be provided in the form of user modeling information or user personal information to more effectively perform a purpose of the device, the device of the device, or the service provider (for example, providing a customized service) Can be expressed.

The user information can be represented as an avatar-based image expressed as a two-dimensional model or a three-dimensional model. The user information may be represented by a virtual image, a virtual self-graphic icon, or the like.

The present disclosure will be described in detail below with reference to the accompanying drawings.

1 illustrates an example in which a device 100 according to some embodiments displays an avatar-based image according to a user's travel schedule information, and displays information indicating an adjustable image in an avatar-based image.

Referring to FIG. 1, the device 100 may display an avatar-based image according to travel schedule information of a user. The avatar-based image shown in Fig. 1 includes travel period information 101, an avatar 102 representing a user, a photograph 103 for a travel destination, a picture 104 for a bag, and a picture 103 for a travel destination Information 106 indicating that the picture 104 for the bag is a modifiable image and information 107 indicating that the travel period information 101 is a modifiable image do.

The avatar-based image according to the travel schedule information of the user is not limited to the one shown in Fig. For example, the avatar-based image according to the user's travel schedule information may include pictures, photographs, or text regarding a plurality of travel arrangements. The avatar-based image according to the travel schedule information of the user may not include the travel period information 101. [ The avatar-based image according to the travel schedule information of the user may further include information indicating that the avatar 102 is an editable image.

The device 100 may display the information 105, 106, 107 representing the modifiable image shown in Fig. 1 in different forms. For example, the device 100 may change the brightness of the modifiable image to a constant or variable period. In addition, the device 100 may highlight the modifiable image.

The device 100 may display information for indicating a correctable image differently depending on the image. For example, the device 100 may change the brightness of the picture 103 for the travel location at a fixed or variable period, highlight the picture 104 for the bag, periodically flicker the travel period information 101, Lt; / RTI >

2 is a flow diagram of a user information management method in which a device 100 according to some embodiments displays an avatar-based image in accordance with user schedule information and updates the user-schedule information by modifying the displayed avatar-based image.

In step S201, the device 100 displays the avatar-based image according to the user schedule information. The user schedule information may be information stored in the schedule management application installed in the device 100, but is not limited thereto. For example, the user schedule information may be received from an external device connected to the device 100.

The device 100 may generate an avatar-based image according to ontology-based user modeling information. Ontologies can describe a word (or concept) and a relationship (or a relationship between concepts) to a word in a formal language.

Ordinary vocabularies may include vocabularies such as, for example, hasHobby, hasSize, isA, cause, etc., but the formal vocabulary is not limited in this disclosure. hasHobby is a formal vocabulary that indicates that the relationship between words is a hobby. hasSize is a formal vocabulary that indicates the relationship between words is a size. isA is a formal vocabulary that indicates the inclusion relation between words. Cause is a formal vocabulary that shows the causal relationship between words. For example, "breaks due to overwork" can be expressed using Cause (overwork, rest).

The user modeling information described above may be generated by an external device that may be coupled to the device 100. [

FIG. 3 is an example of user modeling information for user schedule information generated by the device 100 according to some embodiments.

Referring to FIG. 3, the user modeling information is generated in a Resource Description Framework (RDF) language. The device 100 may generate user modeling information by OWL (Ontology Web Language) or SWRL (Semantic Web Rule Language).

Referring to FIG. 3, the user modeling information includes a subject field, a predicate field, and an object field. The subject field is a field related to the subject of user information. Referring to FIG. 3, the object of user information is user 1 (user_1). Using the class and resource, user 1 is a person. A resource is an instance of a class.

The field card field shown in FIG. 3 is a formal lexical field indicating the relationship between the words included in the subject field and the object field. Referring to FIG. 3, the formal vocabulary included in the field includes a formal vocabulary (sex) about a sex, a formal vocabulary (travel) about a schedule, and a formal vocabulary (preparation) about a preparation. The orthopedic vocabulary included in the field in the present disclosure is not limited to the above-described one.

The device 100 can express the woman in the object field by the sex of the user 1 by the formal vocabulary concerning the sex. The device 100 can express the travel location 1 to the travel location 5 in the object field as the travel location of the user 1 by the fixed vocabulary relating to the schedule. The device 100 can express the preparations 1 to 4 in the object field as the travel preparations of the user 1 by the fixed vocabulary relating to the suitcase.

The device 100 may generate an avatar-based image using the object information of the object field included in the user modeling information (female, travel location 1 to travel location 5, and preparations 1 to 4 shown in FIG. 2). The information of the object field may be used as identification information for generating an avatar-based image.

In order to create an avatar based image, the device 100 may store a plurality of object images. A plurality of object images may be stored in an external device connectable with the device 100.

The plurality of object images may include an image corresponding to the number of object information included in the object field shown in FIG. The plurality of object images may include avatars, pictures, movies, pictures, and / or characters, but the plurality of object images in the present disclosure are not limited thereto.

4 is a diagram for explaining a relationship between a plurality of object information and a plurality of object images stored in the device 100 according to some embodiments.

Referring to FIG. 4, each object information included in the object field has a corresponding object image. The device 100 can read the object image from the memory of the device 100 using the object information as identification information. When a plurality of pieces of object information shown in FIG. 4 and an object image corresponding thereto are stored in an external device connected to the device 100, the device 100 can receive the object image from the external device using the object information.

The device 100 may combine the generated object images to create and display one avatar-based image as shown in FIG.

Meanwhile, in step S202, the device 100 may receive a user input indicating a modification request for the avatar-based image being displayed as shown in Fig. The user input may include a touch-based user input, a user's voice-based user input, or a user's gesture-based user input, but the user input is not limited in this disclosure.

5A-5E illustrate an example in which a device 100 according to some embodiments modifies an avatar-based image. Figures 5A-5E are examples of modifications to travel arrangements.

5A, when a user input is received indicating a selection for the information 106 indicating that the picture 104 for the bag is a modifiable image, the device 100 may be placed in a bag as shown in FIG. The images of the preparations 1 to 4 (501 to 504) are displayed together with the avatar-based image. In addition, the device 100 may display a modify button 505, an add button 506, and / or a done button 507.

5B, when the user input indicating the selection of the modification button 505 is received, the device 100 changes the display states of the preparations 1 to 4 (501 to 504) as shown in FIG. 5C. Accordingly, the user can know that preparations 1 to 4 (501 to 504) are in an editable state.

5C, when the user input indicating the selection of the first item 501 is received, the device 100 displays detailed information about the first item 501 as shown in FIG. 5D.

Referring to FIG. 5D, detailed information on the provision item 1 501 may be displayed by providing a pop-up window 508 at a position adjacent to the provision item 1 501, but the present disclosure is not limited thereto. Since the detailed information provided through the pop-up window 508 is detailed information on the first item 501, the user can delete or modify the first item 501 while watching the detailed information provided through the pop-up window 508 . The device 100 may display the detailed information in a display area other than the form of the pop-up window 508. [ For example, detailed information can be displayed using the area in which the travel period information 101 is displayed.

By clicking on the pop-up window 508 displaying the detailed information, the device can display more detailed information. The device 100 can provide more detailed information using another page. In the case of providing more detailed information using another page, the device 100 can switch the screen shown in FIG. 5E to a page providing more detailed information.

6A-6E are further examples of device 100 according to some embodiments modifying an avatar-based image. Figs. 6A to 6E show an example of correcting the travel route.

6A, when a user input indicating a selection for the above-described information 105 is received, the device 100 displays images 601 through 605 representing travel locations 1 through 5, as shown in FIG. 6B, (Arrow) indicating the order is displayed together with the avatar-based image. Images 601 through 605 may include textual information. The text information may include the name of the travel destination. Images 601-605 may include thumbnails of travel symbols, marks, icons, or representative images.

Referring to FIG. 6B, the device 100 displays an image 601 representing travel location 1 so that the user can easily recognize that the photo 103 related to the travel location included in the avatar- ) From the images 602 to 605 indicating the travel locations 2 to 5, respectively. For example, in FIG. 6B, the device 100 may highlight the image 601 representing the travel location 1.

The device 100 may display the modify button 606, the add button 607, and / or the done button 608 along with the avatar based image. The completion button 608 is a button that can receive user input indicating completion of the modification and / or additional operation for the avatar-based image being displayed on the device 100. [

6B, when the user input indicating the selection of the modification button 606 is received, the device 100 displays the display states of the images 601 to 605 indicating the travel location 1 to the travel location 5 as shown in FIG. 6C Change it. Accordingly, the user can easily recognize that the images 601 to 605 indicating the travel locations 1 to 5 can be modified.

6D, when the user input indicating the movement of the image 601 representing the travel location 1 to the image 602 representing the travel location 2 is received, the device 100 displays the travel based on the travel location 1 The arrangement of the images 601 to 605 indicating the travel destinations 1 to 5 is changed as shown in Fig. 6E while the photograph 103 about the place is changed to the photograph 609 for the travel place corresponding to the travel place 2. [ do. Accordingly, the user first visits the travel location 2 and can confirm that the travel route has been changed.

After confirming the changed travel route shown in FIG. 6E, the user selects the completion button 608, and at step S203, the device 100 transmits the travel location 2 -> travel location 1 -> travel The travel schedule information is updated according to the avatar-based image so that the travel schedule information is changed in the order of location 3 -> travel place 4 -> travel place 5.

7 illustrates an example of a user information management method for updating the user schedule information as the device 100 according to some embodiments displays an avatar based image according to user schedule information and adds information based on the displayed avatar based image FIG.

Referring to FIG. 7, in step S701, the device 100 displays an avatar-based image according to user schedule information. The device 100 can display the avatar-based image according to the user schedule information as in the above-described step S201.

In step S702, when a user input indicating addition is received, the device 100 displays an input window. The device 100 may display the input window as an independent window.

In step S703, when the information is received through the input window, the device 100 adds the image corresponding to the received information to the avatar-based image. For example, if the received information is a passport, the device 100 may add an image corresponding to the passport to the avatar based image. To this end, the device 100 may pre-store an image that may correspond to the received information. An image, which may correspond to the information received, may be stored in an external device connectable to the device 100. Images corresponding to the received information may be assigned search keywords or search identification information, respectively. The device 100 can search for an image corresponding to the received information using the search keyword or the search identification information described above.

The device 100 may search for and provide at least one candidate image (or a plurality of candidate images) that can be corresponded to a single character (or one alphabet) unit with respect to the received information. When a selection signal for the candidate image is received, the device 100 may add the selected candidate image to the avatar-based image.

In step S704, the device 100 updates the user schedule information according to the avatar-based image including the added image.

8A-8C are further examples of device 100 according to some embodiments modifying an avatar-based image. 8A to 8C show an example of adding a preparation.

When a user input indicating addition of information based on the add button 506 is received in Fig. 8A, the device 100 displays the input window 801 as shown in Fig. 8B. When the user inputs information on the preparation item 5 through the input window 801 and selects a button 802 indicating the input, the device 100 displays the image corresponding to the preparation item 5 as shown in FIG. 8C, (803) to the avatar-based image.

The device 100 may display the added image 803 so that it can be distinguished from other images 501 to 504. [ Accordingly, the user can easily recognize that the image 803 corresponding to the preparation item 5 is added.

8C, the device 100 updates the user schedule information according to the avatar-based image to which the image 803 corresponding to the provision item 5 is added. Accordingly, preparations 1 to 4 (501 to 504) included in the user schedule information are changed to preparations 1 to 5 (501 to 504 and 803).

9 is a flowchart of a method of managing user information in which a device 100 according to some embodiments displays a plurality of avatar-based images according to user schedule information for a specific period of time and updates user schedule information according to the avatar-based image modification.

In step S901, the device 100 receives a user input indicating a user schedule information request for a specific period. The specific period may be set based on the date information. The specific period may be set on a day-of-week basis. The specific period can be set on a weekly basis. A specific period can be set to be a time period. The specific period in this disclosure is not limited to the above-mentioned one.

In step S902, a plurality of avatar-based images corresponding to the weekday and weekend user schedule information are displayed. Weekdays and weekends are weekdays and weekends included in the above-mentioned specific period. For example, if the specific period is from Feb. 2, 2015 to Feb. 15, 2015, the device 100 will display an avatar-based image according to weekday user schedule information from February 2 to February 6, Avatar based image according to weekday user schedule information from 7th to 8th of February, avatar based image according to weekday user schedule information from Feb. 9 to Feb. 13, weekend user from Feb. 14 to Feb. 15 Based images according to the schedule information.

When a plurality of avatar-based images are being displayed, the device 100 modifies the avatar-based image when a user input indicating modification is received in step S903.

In step S904, the device 100 may update the user schedule information according to the avatar-based image including the modified image.

Figure 10 is an example of displaying an avatar based image 1001 based on weekday user schedule information and an avatar based image 1002 based on weekend user schedule information together by the device 100 according to some embodiments.

FIG. 11 is a flowchart illustrating a method of displaying a plurality of avatar-based images according to theme item-based user schedule information according to a user schedule information request of a specific period, And a user information management method for updating information.

Referring to FIG. 11, in step S1101, the device 100 displays a plurality of avatar-based images corresponding to the theme schedule-specific user schedule information in step S1102 upon receiving a user input indicating a user schedule information request for a specific period. The theme item refers to a theme item included in the user schedule information of a specific period.

In step S1103, the device 100 modifies the avatar-based image according to the user input indicating the modification. In step S1104, the device 100 updates the user schedule information according to the avatar-based image including the modified image.

FIGS. 12A to 12C show an example of displaying a plurality of avatar-based images for each theme item included in the user schedule information for the specific period mentioned in FIG. 11 and modifying the avatar-based image being displayed.

Referring to FIG. 12A, the device 100 displays a plurality of avatar-based images 1201, 1202, 1203, and 1204 for each theme item from February 1, 2015 to February 8, 2015.

12A, when a user input for selecting one avatar-based image 1201 is received from among a plurality of avatar-based images 1201, 1202, 1203, and 1204 as shown in FIG. 12B, The avatar-based image 1201 may be enlarged and displayed on the entire screen as shown in FIG. 12C.

Referring to FIG. 12C, the avatar-based image 1201 may include an edit button 1202, an add button 1203, and / or a finish button 1204. The scope of modification in Figure 12c may include changing the bike ride to another theme item (or other user activity) or canceling the bike ride, but the scope of the modifications in this disclosure is not limited to the one just described. When changing the bike ride to sleep, the device 100 may change the avatar-based image 1201 to the avatar-based image 1204 shown in Fig. 12A.

The additional range in FIG. 12C may include adding a theme theme item with B to the bike ride. In such a case, the device 100 may add an image related to B to the avatar-based image 1201. [ The scope of the present disclosure is not limited to the above-described ones.

13 is a flowchart of a method for managing user information in which device 100 according to some embodiments manages the lifetime of an avatar-based image.

In step S1301, if the provision period for the avatar-based image is set, the device 100 checks the provision period for the avatar-based image. The offer period can be counted on a date basis. The offering period can be counted on a time basis. The providing period may be counted as the providing period. The counting criterion for the provision period in this disclosure is not limited to the one just described.

In step S1302, if the device 100 determines that the providing period has expired, the device 100 cancels the corresponding avatar-based image. Destroying the avatar based image refers to deleting the avatar based image stored in the device 100. The avatar-based image may be stored in an external device connected to the device 100. When the avatar-based image is stored in the external device, the device 100 can transmit the delete command for the avatar-based image to the external device.

FIG. 14 is a flowchart of a user information management method in which a device 100 according to some embodiments displays an avatar-based image according to user's health information and updates user schedule information according to the selected medical information.

In step S1401. The device 100 displays an avatar-based image according to user health information. The user's health information may be received from an external device, but the present disclosure is not limited thereto. The user's health information can be obtained by executing the health application set in the device 100. [

In step S1402, the device 100 provides medical information related to the user's health information according to a user input indicating a medical information request. For example, when the user's health information indicates that the user has a cold, the device 100 may provide medical information related to the cold.

In step S1403, the device 100 updates the schedule information of the user according to the selected medical information based on the provided medical information.

15A to 15E illustrate an example in which the device 100 according to some embodiments displays an avatar-based image according to the user's health information, provides medical information according to the user's health information, As shown in Fig.

In FIG. 15A, the device 100 displays a row and a snarling avatar-based image according to the user's health information received from the smart merchandise 1500.

The device 100 includes a hospital item 1511, a pharmacy item 1512, a medicinal item 1513, and a self-treatment item 1514, as shown in Figure 15B. Menu items. For example, as shown in FIG. 15A, when a user input for touching an avatar-based image according to health information of a user being displayed for a predetermined time is received, the device 100 provides menu items as shown in FIG. 15B can do. The menu items provided in the present disclosure are not limited to those described above.

15B, when the user input to select the hospital item 1511 is received, the device 100 receives the sub-items (hospital B 1521, hospital C 1522) of the hospital item 1511 as shown in Fig. , D hospital 1523). For example, in FIG. 15B, when a user input for touching the hospital item 1511 for a certain time is received, the device 100 displays the sub items of the hospital item 1511 (B hospital 1521 ), C hospital 1522, D hospital 1523).

15D, when the user input for selecting the C hospital 1522 is received, the device 100 provides the reservation information for the C hospital 1522 in FIG. 15E. For example, if a user input touching the C hospital 1522 for a certain time is received in FIG. 15D, the device 100 may provide the reservation information for the C hospital 1522 in FIG. 15E.

After confirming the reservation information provided in FIG. 15E, when the user input indicating the reservation is received, the device 100 performs a reservation procedure for the C hospital 1522. FIG. For example, after confirming the reservation information provided in FIG. 15E, when a user input for touching the reservation button 1532 for a predetermined time is received, the device 100 can perform the reservation procedure. The reservation procedure is to register the reservation information in the C hospital based on the provided reservation information and the user information.

When this procedure is completed, the device 100 updates the user schedule information based on the reserved information. Accordingly, the reservation information for the C hospital can be registered in the user schedule information stored in the device 100. [

16 is a flowchart of a user information management method in which a device 100 according to some embodiments displays an avatar-based image according to a user's future desired information and updates user schedule information according to information selected from among information related to a desired future .

In step S1601, the device 100 displays the avatar-based image according to the user's future desired information. The future desired information may represent the future job information of the user, but the desired information in the present disclosure is not limited to this. For example, the future desired information may include a bucket list of the user or a wish list of the user.

In step S1602, the device 100 provides information related to future desired information according to a user input for requesting information related to the user's future desired information. For example, when an avita-based image corresponding to future desired information of a user being displayed is touched for a predetermined time and a user input for dragging in one direction is received, the device 100 can provide information related to future desired information .

In step S1603, the device 100 updates the schedule information of the user according to the information selected from the information related to the future desired information. For example, when one of the information related to the provided future desired information is touched for a predetermined time and a user input for dragging in one direction is received, the device 100 can update the user's schedule information according to the received information have.

17A to 17D are diagrams for explaining an example in which the device 100 according to some embodiments displays related information in accordance with the user's future desired information and requests information related to the future desired information, And updating the user schedule information according to the selected information.

Referring to FIG. 17A, the device 100 displays an avatar-based image representing an art therapist according to the user's future desired information.

17A, when the user input 1701 requesting the provision of information related to the future desired information is received, the device 100 transmits the qualification test schedule item 1711, the authentication center item 1712, And / or related event items 1713 as information related to the future desired information. For example, when a user touches the image being displayed in FIG. 17A for a predetermined time and receives a user input 1701 to drag in one direction, the device 100 displays a message related to future desired information Information (qualification test schedule item 1711, certification center item 1712, and / or related event item 1713).

17B, the device 100 provides an Event 1 item 1721, an Event 2 item 1722, and an Event 3 item 1723. Upon receiving a user input that selects a related event item 1713 in FIG. For example, when a user input touching the related event item 1713 for a certain time is received in FIG. 17B, the device 100 displays the event 1 item 1721 registered in the sub-layer of the related event item 1713, An event 2 item 1722, and an event 3 item 1723. [

In FIG. 17C, when a user input for selecting an event 2 item 1722 is received, the device 100 provides detailed information about the event 2 item 1722. For example, if a user input that touches the Event 2 item 1722 for a certain amount of time is received in FIG. 17C, the device 100 may provide detailed information about the Event 2 item 1722.

The device 100 may provide detailed information about the event 2 item 1722 by opening a separate window 1724 at a location adjacent to the event 2 item 1722. [ A separate window 1724 may be displayed as a pop-up window with a horsepair shape, but the disclosure is not limited thereto.

17D, when a user input for selecting the participation OK button 1725 included in the separate window 1723 is received, the device 100 uses the information related to the event 2 item 1722 to display the schedule information of the user Lt; / RTI > For example, when a user input for touching the participation OK button 1725 included in the separate window 1723 for a predetermined time is received in FIG. 17D, the device 100 transmits information related to the event 2 item 1722 The schedule information of the user can be updated. Accordingly, information related to the event 2 item 1722 is registered in the schedule information of the user.

18 is a flowchart of a method of displaying user avatar information by displaying a plurality of avatar based images according to usage history information of the device 100 according to some embodiments.

18, when the device 100 receives the user input requesting the usage history information for the device 100, the device 100 searches for a plurality of avatar based on the usage history information for the usage period for the device 100 in step S1802 Display the image. For example, in step S1801, when a user input indicating selection of a usage history information request item of the device 100 included in the menu item provided by the device 100 is received, in step S1802, the device 100 A plurality of avatar-based images corresponding to usage history information can be displayed. Information specifying the use period of the device 100 may be received in step S1801. Information specifying the period of use may be entered based on date, time, or day of the week.

FIGS. 19A and 19B are examples in which the device 100 according to some embodiments provides usage history information per use period as a plurality of avatar-based images when a user input is received in response to a usage history information request of the device 100. FIG.

Referring to FIG. 19A, the device 100 displays a plurality of avatar-based images according to usage history information of the device 100 regarding the weekday 1910 and the weekend 1920. FIG.

Referring to the weekday 1910 in FIG. 19A, it can be seen that the device 100 is used as the first application on the weekday 1910, and the second application is the Internet application. Referring to the weekend 1920 of FIG. 19A, it can be seen that on the weekend 1920, the device 100 uses the DTV app in the first place and uses the band in the second place.

19A, when the user input 1911 requesting the next usage history information for the device 100 is received on the weekday 1910, the device 100 stores the usage history information for the device 100 on the weekday 1910 Based image for the weekday 1910 as shown in Figure 19B. Referring to the weekday 1910 of FIG. 19B, it is easy to know that the device 100 uses the KakaoTalk app in the third rank on the weekday 1910 and uses the camera app in the fourth rank.

19A and 19B provide usage history information of the device 100 based on the application set in the device 100, but the usage history information of the device 100 in the present disclosure is not limited to the above-described one.

FIG. 20 illustrates an example in which a device 100 according to some embodiments displays an avatar-based image according to user information registered in a social media, and when an avatar-based image being displayed according to user input is modified, FIG. 2 is a flowchart of a user information management method for updating user information registered in a social media. FIG.

In step S2001, the device 100 displays an avatar-based image according to the user information registered in the social media. User information registered with the social media may be received from the social media server connected to the device 100. [ For example, user information registered on Facebook may be received from a Facebook server connected to device 100.

The user information registered in the social media may be provided from the social media server at the request of the device 100, but may be automatically provided from the social media server when the device 100 is connected to the social media server. The method by which the device 100 receives user information registered in the social media in the present disclosure is not limited to the above-described one.

In step S2002, the device 100 modifies the avatar-based image according to a user input requesting an image modification. The method of modifying the avatar-based image in step S2002 may be performed in the manner described above in step S202 of FIG.

In step S2003, the device 100 can update the user information registered in the social media according to the modified avatar-based image. The device 100 may convert the modified avatar-based image into textual information and send the textual information to the social media server, requesting an update to the user information registered in the social media. Accordingly, the social media server can update the registered user information. Once the update to the user information is complete, the social media server may send an update complete message to the device 100. [ The manner of updating the user information registered in the social media in the present disclosure is not limited to the above-described one.

21 is a block diagram of a user information management system 2100 that includes a device 100 in accordance with some embodiments.

21, a system 2100 includes a device 100, a network 2110, and an external device 2120.

The device 100 may include, for example, a Portable Device, a Wearable Device, a Home Internet Appliance, or a Mobile Device, (100) is not limited to the above-mentioned ones.

The portable device may be a smart phone, a notebook, a smart board, a tablet PC, a handheld device, a handheld computer, a media player, an electronic book device , Or a PDA (Personal Digital Assistant), but the portable device in this disclosure is not limited to the above-mentioned ones.

Wearable devices include smart glasses, smart watches, smart bands (e.g., smart waistbands and smart hair bands), smart clips, various smart ornaments (e.g., smart rings, smart wristbands, And smart necklaces, etc.), various smart body protectors (e.g., smart knee protectors, and smart elbow protectors). But are not limited to, devices such as smart shoes, smart gloves, smart clothing, smart hats, smart for the disabled, smart for the disabled, and the like.

Home Internet Appliance is a smart home appliance that can be used in various applications such as smart TV, personal computer, desktop personal computer, smart refrigerator, smart washing machine, smart lighting, smart cleaner, smart health appliance, smart oven, smart dishwasher, ), A game console, or a smart water purifier. However, the home Internet appliance in the present disclosure is not limited to the above-described one.

A mobile device may include a device such as an automobile that forms an M2M (achine to machine) or an Internet of Things (IoT), but the mobile device in this disclosure is not limited to the one just described.

The network 2110 may be, for example, an intranet, an internetwork, an Internet, a Personal Area Network (PAN) (e.g., short range wireless communication such as Bluetooth, HomeRF), a CAN (Campus Area Network) Local Area Network (WAN), Wide Area Network (WAN), or gaming network, but the network 2110 in this disclosure is not limited to the one just described.

The network 2110 may use at least one of a wired transmission medium and a wireless transmission medium. The wired transmission medium may include at least one of, for example, coaxial, twisted pair cable, and / or fiber-optic, but in the present disclosure, It is not limited. The wireless transmission medium may include, for example, at least one of a Radio Frequency Wave, a Terrestrial Microwave, a Satellite Microwave, and / or Infrared, The wireless transmission medium is not limited to the above-mentioned ones.

The connection form of the network 2110 may be in the form of a molding, a net, a tree, a bus, or a ring, but the connection form of the network 2110 is not limited to the above.

The network 2110 includes at least one of network connection devices such as a LAN (Local Area Network) card, a hub, a switch, a bridge, a gateway, a repeater, One can be used, but in this disclosure the network connection device is not limited to the one just described.

The external device 2120 refers to a device that can be connected to the device 100 from the outside of the device 100. The external device 2120 may include a user's cloud server, a user's information management server, a QA (question and answer) server, a service providing server (e.g., a game server or an application server) However, in this disclosure, the external device 2120 is not limited to the above-described ones.

The external device 2120 may include a server, a medical device, a computing device, an app store, a wearable device, an IoT sensor, or an IoT device. The external device 2110 may be the same device as the device 100. [ The user of the external device 2110 may be the same as the user of the device 100. The user of the external device 2110 may be different from the user of the device 100.

The medical device may include a function of sensing (or measuring) the health information of the user and a communication function. The medical device may be a home medical device (e.g., at least one device such as a body temperature meter, a blood pressure meter, a cholesterol meter, a blood glucose meter, a uric acid meter, and a massager), a hospital medical device (e.g., (E.g., at least one device such as a stethoscope, an electrocardiograph, etc.), or a medical device such as a recycled medical device (e.g., at least one device such as a walking belt, a moving belt, a knee guard, a paraffin bath, etc.) The apparatus is not limited to the above-mentioned ones.

The appset is a device controlled using an application installed in the device 100. [ The appset includes at least one device such as, for example, a smart light bulb, a smart printer, a smart wireless blood pressure monitor, a smart tape recorder, a smart location tracker, a smart microphone, a smart thermostat, a smart alarm device, .

The device 100 may perform a method of managing user information according to some embodiments. The device 100 may manage user information stored in the device 100 and / or user information stored in the external device 2120 connected via the network 2110. [ User information stored in the device 100 may be received from the external device 2120 and stored. User information stored in the external device 2120 may be received from the device 100 and stored. The user information stored in the device 100 may be the same as the user information stored in the external device 2120. The user information stored in the device 100 may be different from the user information stored in the external device 2120. Some of the user information stored in the device 100 may be the same as the user information stored in the external device 2120.

The device 100 may update the user information stored in the device 100 or the external device 2120 using the modified user information using the user information management method according to some embodiments. The device 100 may transmit the stored user information to the external device 2120 and request the external device 2120 to manage the user information.

22 is a flowchart illustrating a method for managing user information performed by the device 100 according to some embodiments. 23A-23F illustrate avatar-based images displayed by the device 100 according to some embodiments on the basis of user information.

Referring to FIG. 22, in step S2201, the device 100 displays an avatar-based image based on user information. For example, the device 100 may generate and display an avatar based image 2310 based on the user information 2300 of FIG. 23A. The avatar-based image 2310 may be referred to as an image that represents the user of the device 100. The avatar-based image 2310 may be represented by an avatar, a cyber character, a virtual image of a user, a virtual self-graphic icon of a user, or a user's icon represented by a two-dimensional model or a three-dimensional model. The manner of expressing the avatar-based image 2310 in this disclosure is not limited to the one just described.

In step S2201, the device 100 can display a plurality of avatars based on the user information as shown in Figs. 23B to 23F.

Referring to Figure 23B, the device 100 combines an avatar-based image 2340 (hereinafter referred to as the current image) and an avatar-based image 2341 (hereinafter referred to as a future image) based on the current user information Display.

The current image 2340 has a different hairstyle from the future image 2341. This means that the hair style information included in the current user information (e.g., the user's hair style is cut) and the hair style information included in future user information (e.g., the user's hair style is wave) .

The hair style information included in the current user information may be based on the photograph information, but the present disclosure is not limited to the above-described one. For example, the hair style information contained in the current user information can be input by the user. The hair style information included in the future user information may be based on the user's hair shop reservation information, but the present disclosure is not limited to the above-described one. For example, hair style information included in future user information can be input by the user.

The device 100 may display the current image 2340 and the future image 2341 by dividing the user information by day, day, week, month, or year.

For example, in the case of a day, the device 100 may generate and display the current image 2340 based on today's user information (e.g., the user's current schedule information) , Schedule information of the user tomorrow), and display the future image 2341. [

For example, in the case of a weekly unit, the device 100 generates and displays the current image 2340 based on the user information for the past week based on the current time point, A future image 2341 can be generated and displayed based on the information.

The current image 2340 and the future image 2341 displayed on the device 100 may be the same. This indicates that the current user information and the future user information are the same.

The device 100 may not generate the current image 2340 and the future image 2341 in the units described above. For example, the device 100 may determine the current image 2340 (e.g., a student) based on information about the current job (e.g., a student) included in the user information and information about the future wishes An avatar-based image of a student uniform) and a future image (e.g., an avatar-based image of a police uniform 2341).

In addition, the device 100 may generate and display a future image 2341 based on the bucket list or wish list of the user included in the user information. For example, if the bucket list includes 10 items, the future image 2341 may generate and display an avatar-based image according to 10 different items. For example, in the case of generating and displaying an avatar-based image according to the above-mentioned 10 different items, the device 2341 divides the area in which the future image 2341 is displayed and displays it at the same time, But the present disclosure is not limited thereto.

23C is an example of a device 100 according to some embodiments simultaneously displaying an avatar based image 2342 (hereinafter referred to as a past image), a current image 2340, and a future image 2341 according to past user information .

Referring to FIG. 23C, device 100 simultaneously displays past image 2342, current image 2340, and future image 2341 with different hair styles. This means that the user's hair style information included in past user information, current user information, and future user information are different.

The device 100 can display the past image 2341, the current image 2340, and the future image 2341 based on user information in units of days, days, weeks, months, or years as shown in FIG. 23B Can be generated and displayed at the same time. For example, the device 100 may generate a current image 2340 based on user information for the current time and a week prior to the current time, and generate a future image 2341 based on user information for a week after the current time, And generate a past image 2342 based on the user information for the previous week based on the user information used to provide the current image 2340. [

Figure 23d illustrates a device 100 according to some embodiments having an avatar based image 2343 based on morning user information and an avatar based image 2344 based on afternoon user information, Are simultaneously displayed. The device 100 may generate the morning image 2343 and the afternoon image 2344 based on one of daily, day, week, month, or year units, And the generation unit of the afternoon image 2344 are not limited thereto.

Referring to FIG. 23D, the morning image 2343 indicates that the user information includes information indicating " morning to work. &Quot; The afternoon image 2344 indicates that the user information includes information that " receives a violin lesson after work. &Quot;

Figure 23E illustrates a device 100 according to some embodiments that includes an avatar-based image 2345 based on user information on weekdays and an avatar-based image 2346 based on user information on weekends, Are simultaneously displayed.

Referring to Figure 23E, the device 100 creates a weekday image 2345 based on user information from Monday through Friday. In addition, the device 100 may generate a weekend image 2346 based on user information on Saturday and Sunday. The device 100 may generate a weekday image 2345 and a weekend image 2346 based on one of weekly, weekly, monthly, yearly, or even yearly units, (2345) and the weekend image (2346) are not limited to the above-mentioned ones.

The weekday image 2345 indicates that the user information includes information " to go to work from Monday to Friday ". The weekend image 2346 indicates that the user information includes " jogging on weekends ". The weekday image 2345 and the weekend image 2346 displayed in the device 100 in this disclosure are not limited to those shown in Fig. 23D.

Figure 23f illustrates an embodiment in which the device 100 according to some embodiments includes an avatar based image 2347 (hereinafter abbreviated as spring image) based on user information, an avatar based image 2348 (hereinafter abbreviated as summer image based on user information) Based image 2349 (hereinafter referred to as fall image) based on user information in autumn, and an avatar-based image 2350 based on user information in winter.

The device 100 may generate a spring image 2347 based on user information, for example, from March to May. The device 100 may generate a summer image 2348 based on the user information, for example, from June to August. Device 100 may generate a fall image 2349 based on user information, for example, from September to November. Device 100 may generate a winter image 2350 based on user information from December through February.

The spring image 2347 and the autumn image 2349 indicate that the user information includes information of " coming to work by bicycle ". The summer image 2348 and the winter image 2350 indicate that the user information includes information indicating " automatically go to work ". Device 100 may generate and display different spring images 2347, summer images 2348, autumn images 2349, and winter images 2350 according to user information.

The device 100 may generate and display a spring image 2347, a summer image 2348, an autumn image 2349, and a winter image 2350 as a monthly image or a month-by-month image.

The device 100 can generate and display more various objects in the images 2310, 2340, 2341, 2342, 2343, 2344, 2345, and 2346 shown in Figs. 23A to 23F according to the user information .

The device 100, which is mentioned in some of the embodiments described above, generates and displays an avatar-based image, which means that the device 100 provides an avatar-based image.

For convenience of the following description, the avatar-based image displayed on the device 100 is referred to as the image 2310 shown in FIG. 23A. However, the avatar-based image in this disclosure is not limited to this. For example, the avatar-based image 2310 being displayed on the device 100 may include the avatar-based images 2340, 2341, 2342, 2343, 2344, 2345, and 2346 shown in Figures 23B- ≪ / RTI > Further, the avatar-based image 2310 displayed on the device 100 may be displayed in accordance with the user information such that one of the avatar-based images 2340, 2341, 2342, 2343, 2344, 2345, 2346 shown in Figs. 23A to 23F The image may be an image in which at least one object is added.

The device 100 may represent the avatar-based image 2310 with at least one of a static image and a dynamic image. For example, the device 100 may represent the avatar-based image 2310 as a dynamic image, and then render the avatar-based image 2310 as a static image after a first time period. The device 100 may render the avatar-based image 2310 as a static image, and then render the avatar-based image 2310 as a dynamic image after a second time period. The first time and the second time may be set in advance. The first time and the second time may be the same time, but may be different times.

Referring to FIG. 23A, the user information 2300 includes information 2301 about a user's hobby, a name 2302 of a user, and information 2303 about a user's sex. The user information 2300 in this disclosure is not limited to the one shown in Fig. 23A.

For example, the user information 2300 may further include at least one of the user information mentioned in the introduction of the specification. User information 2300 may contain less information than that shown in FIG. 23A. For example, the user information 2300 may comprise information 2301 about the user's hobby and a name 2302 of the user.

In order to create an avatar based image 2310, the device 100 may generate user modeling information 2400 on the user information 2300. The user modeling information 2400 can be referred to as a user modeling information table.

The device 100 may generate user modeling information 2400 for the user information 2300 based on an ontology. The manner of generating user modeling information 2400 for user information 2300 is not limited to ontology based.

24A is on-topology-based as an example of user modeling information 2400 for user information 2300. FIG. The ontology is as described in Fig.

Referring to FIG. 24A, user modeling information 2400 includes a subject field 2401, a predicate field 2402, and an object field 2403.

The subject field 2401 shown in FIG. 24A is a field related to the target of the user information 2300. Referring to FIG. 24A, the object of the user information 2300 is user 1 (user_1). 24A shows that the user 1 (user_1) is a person by using a class 2404 and a resource 2405. FIG. Resource 2405 is an instance of class 2404.

24A is a field showing a formal vocabulary indicating the relationship between words included in the subject field 2401 and the object field 2403. [ 24A includes a fixed vocabulary (Name) about a name, a fixed vocabulary (Gender) about sex, and a fixed vocabulary (hasHobby) about hobbies.

Quot; A " included in the object field 2403 can be expressed by the name of " user 1 " The "woman" in the object field 2403 can be expressed by the sex of "user 1" by the fixed form vocabulary (Gender) regarding the sex. The "bilingual" in the object field 2403 can be represented by the habit of "user 1" by the fixed habit of hashobby (hasHobby). The information included in the object field 2403 shown in FIG. 24A is the user information of the user 1 corresponding to the fixed vocabulary included in the predicate field 2402.

The user modeling information 2400 shown in FIG. 24A is an example generated in the RDF (Resource Description Framework) language. However, device 100 may generate ontology-based user modeling information for user information 2300 in languages such as OWL (Ontogy Web Language) and SWRL (Semantic Web Rule Language).

24B is an example of a display size of an object included in an avatar-based image 2310 that can be displayed on the device 100 according to some embodiments. FIG. 24B is an example of a violin included in the user modeling information 2400 shown in FIG. 24A.

Referring to FIG. 24B, the device 100 may determine a display size of an object according to a possible weight value of the object. As shown in FIG. 24B, the device 100 may determine the display size of the violin to be included in the avatar-based image 2310 according to the weight given to the violin included in the object field 2403. FIG. The weights may be determined according to the user information. The display size according to the weight can be set in advance.

Referring to FIG. 24B, the weight range is 0 to 1. A weight of 0.3 indicates that the user's interest in the violin is lower than in the case of a weight of 1. For example, if the user's hobby based on the user information of the device 100 is a violin and it is determined that the violin is played every hour for one hour, the device 100 may assign a weight for the violin to 0.5 . In addition, if the user's hobby based on the user information of the device 100 is a violin and it is determined that the user plays one hour each day, the device 100 can assign a weight for the violin to one.

If the weight for the violin is 0.5, the device 100 determines the display size of the violin to be (50 x 50) pixels. Accordingly, the device 100 may generate an avatar-based image 2310 that includes a violin image of (50 x 50) pixels.

Further, when the weight for the violin is 1, the device 100 determines the display size of the violin to be (100 x 100) pixels. Accordingly, the device 100 may generate an avatar based image 2310 that includes a violin image of (100 x 100) pixels.

24C is a view for explaining a display size of an object included in the avatar-based image 2310 according to some embodiments. FIG. 24C is an example of the excitation included in the user modeling information 2400 shown in FIG. 24A.

Referring to FIG. 24C, the device 100 may determine the display size of the avatar 2311 to be included in the avatar-based image 2310 according to the weight and the height. The weight and the key are the weight and the height of the woman included in the object field 2403 of the user modeling information 2400. The weight and key of the woman are the information included in the user information. The device 100 may select one of a plurality of preset display sizes.

Referring to FIG. 24C, the device 100 has a reference value for body weight of 50 kg and a reference value for a key of 170 cm. However, the reference values in the present disclosure are not limited to those just described. If the user's weight included in the user information satisfies the condition "(key -100) × 0.9 + 5> weight", the device 100 sets the female avatar 2311 included in the avatar-based image 2310 as an obese image Can be displayed.

In addition, if the user's weight satisfies the condition "(key-100) x 0.9 <weight", the device 100 can display the woman avatar 2311 included in the avatar-based image 2310 as a skinny image. If the user's weight satisfies the &quot; other &quot; condition, the device 100 may display the female avatar 2311 included in the avatar-based image 2310 as a normal image.

25 shows an example of mapping information 2500 between an object image and object identification information according to some embodiments. Referring to FIG. 25, the device 100 may generate the avatar-based image 2310 using the mapping information 2500 and the user modeling information 2400 shown in FIG. The object image shown in Fig. 25 can be adjusted or changed in display size based on the information included in the user information, as mentioned in Figs. 24B and 24C.

The mapping information 2500 may be configured in view of all or some of the user information referred to at the beginning of this disclosure. The mapping information 2500 may be referred to as a mapping information table.

In this disclosure, the mapping information 2500 may be set differently from that shown in Fig. For example, the mapping information 2500 may be configured to provide an object image of a still image as shown in FIG. 25, but may be configured to provide an object image of the moving image. The mapping information may be stored in the device 100 but may be stored in the external device 2120.

An image corresponding to a violin or guitar may include a standard image playing the violin or a standard image playing the guitar. Standard images may also be provided in still image format or video format. The standard image may include a musical instrument and an avatar image that plays the musical instrument.

When the standard image is stored in the mapping information 2500, the device 100 can change the avatar playing the musical instrument to the user's avatar. The device 100 may change the avatar playing the musical instrument to the avatar of the user by mapping the positional information about the minutiae necessary for displaying the avatar playing the musical instrument and the positional information about the minutiae necessary for displaying the avatar of the user. The positional information about the minutiae can be expressed by the (x, y) coordinate value when the avatar is a two-dimensional image. The positional information on the minutiae can be expressed by (x, y, z) coordinate values when the avatar is a three-dimensional image.

26 is a view for explaining a process of generating an avatar-based image 2310 using user modeling information 2400 and mapping information 2500 according to some embodiments.

26, the device 100 detects information (A, Woman, Violin) included in the object field 2303 of the user information 2300. The device 100 detects the information 2620 from the mapping information 2500 using the object identification information (e.g., &quot; 0000 0010 &quot; in the case of the violin and 0000 0011 in the case of the violin) Device 100. The device 100 combines the detected object images 2610 and 2620.

When combining the object images 2610 and 2620, the device 100 sets the coordinate values (two-dimensional coordinate values or three-dimensional coordinate values) used to render the respective object images 2610 and 2620, Binding condition information can be used.

The coordinate value of each object image may be configured as a table that can be detected using the object identification information included in the mapping information 2500. [ For example, the device 100 may detect the coordinate value used when rendering the object image 2610 from the coordinate value table using &quot; 0000 0010 &quot;. The coordinate value table may include position information of feature points required to display each object image. The coordinate value table may be stored in the device 100 and / or the external device 2120.

The coordinate value table may be a skeleton data table of the object image. For example, if the object image is an avatar such as image 2610, the skeleton data table represents the outline of the avatar. For example, the skeleton data of the avatar includes information on the face, head, neck, shoulder, chest, waist, hip, arm length, arm thickness, leg length, leg thickness, right hand, and / But this disclosure is not limited thereto.

For example, if the object image is a violin, such as image 2620, the skeleton data table represents the outline of the violin. For example, the skeleton data of a biorolin may include a scroll, a lanyard, a lanyard, a nut, a neck, a fingerboard, a string, a loudspeaker, a purple ring, a side plate, a waist, But is not limited to, information about a hanger plate, a chin rest, and / or buttons, and the like.

The combining condition information may include position information to be combined between the object images. The combining condition information may be composed of a table that can be detected using the identification information of object images to be combined. For example, when the object images 2610 and 2620 are combined as shown in FIG. 26, the device 100 acquires the identification information of the object images 2610 and 2620 as &quot; 0000 0010 &quot;, &quot; 0000, 0011 &quot; The combining condition information between the images 2610 and 2620 can be detected from the combining condition information table.

The device 100 includes an object image 2610 (for example, if the binding condition information includes position information indicating, for example, a violin bow in the right hand of the object image 2610 and a neck of the violin in the left hand) And an object image 2620 in combination with an image 2630 as shown in FIG. The position information indicates position information of the feature points necessary to display each object. The binding condition information table may be previously stored in the device 100 and / or the external device 2120.

To create the avatar-based image 2310, the combining condition information may include positional information indicating &quot; holding the violin bow in the right hand, putting the jaw of the violin in the jaw, and holding the neck of the violin in the left hand &quot;. In the case where the violin image 2620 is a standard image for playing the violin, the device 100 stores the coordinate value (or position information of the minutiae point) used to render the player who plays the violin as the coordinate value of the object image 2610 Can be changed.

In step S2202, the device 100 modifies the avatar-based image 2310 according to user input. The user input may include a user input indicating a modification request for the avatar based image 2310, a user input indicating an object selection, or a user input indicating completion of modification, but the user input is not limited to this in this disclosure. The user input representing the modification request may represent a user input representing an editing request. A user input indicating completion of modification may indicate a user input indicating completion of editing.

The user input may be based on at least one of a touch, a touch & drag, a gesture, a multimodal, and a voice. The user input may be received from the external device 2120.

The device 100 may display the modifiable object when the user input indicating the modification request is received when the avatar based image 2310 is being displayed.

Figures 27A-27F are examples of devices 100 according to some embodiments displaying modifiable objects.

Referring to FIG. 27A, when a user input indicating a selection for the modification request button 2701 is received, the device 100 highlights the name 2702 of the user and the violin 2703. [ Accordingly, the user can know that the name 2702 of the user and the violin 2703 are modifiable objects.

27B, when a user input indicating a selection for the modification request button 2705 is received, the device 100 overlaps and displays a message 2706 indicating a name in a partial area of the user's name 2702. [ In addition, the device 100 overlays and displays a message 2707 indicating a hobby in a part of the area on the violin 2703. The message 2707 indicating the hobby may include information (e.g., playing a violin) related to the violin 2703. [ Accordingly, the user can know that the user's name 2702 and the violin 2703 are objects that can be modified, such as the object 2702 or the user's hobby 2707.

Referring to Figure 27C, the device 100 may display a tray 2712 with icons 2710,2711 for the modifiable object along with the avatar based image 2310. [

27C, when a user input representing a selection for the modification request button 2709 is received, the device 100 provides a tray 2712 containing an icon 2710 about the hobby and an icon 2711 about the name do. The hobby icon 2710 may include information related to the violin 2703. Accordingly, the user can know that the user's name 2702, the violin 2703, the user's name 2702, and the hobby item are editable objects. The tray 2712 may further include identification information (hobby, name) relating to the icons 2710 and 2711.

Referring to FIG. 27C, the device 100 displays a tray 2712 at the bottom of the screen. However, the tray 2712 may be displayed on at least one of the left side, the right side, the upper side, or the lower side of the screen. If the number of icons of the modifiable object is greater than the number of icons of the object that can be simultaneously displayed in the tray 2712, the device 100 displays the object being displayed through the tray 2712 in accordance with the scroll input based on the tray 2712 The icon of the selectable object can be displayed while moving the icon of the object. The scroll input based on the tray 2712 may include a scroll input based on the tray 2712 area.

If the number of editable object icons is greater than the number of icons of objects that can be simultaneously displayed in the tray 2712, the device 100 may provide a plurality of trays divided into predetermined categories.

In the case where the device 100 provides a plurality of trays, the device 100 may arrange a plurality of trays on at least one of the left, right, upper, or lower sides of the screen, Structure. The category may be set according to the type of object that can be modified, but is not limited thereto.

27C, when the icon of one object included in the tray 2712 is selected, the device 100 can highlight the object corresponding to the icon of the selected object.

Figure 27D is an example in which device 100 according to some embodiments provides information about a modifiable object through a mouthpocket in accordance with a touch-based input to an object.

27D, when a user input indicating a selection for the modify request button 2714 is received, the device 100 may activate a modifiable one of the images being displayed.

Based input 2715 indicating a selection of an editable object (e.g., a violin 2703) from among the images being displayed is received, the device 100 determines that the edited possible information for the object (violin 2703) (E. G., Hobby). &Lt; / RTI &gt; The device 100 may display the horse pocket 2716 at a position adjacent to the object 2703 so that the horse pocket 2716 may indicate that it is related to the object 2703. [ Thus, the user can know that the violin 2703 is a modifiable object and can modify the user information about the hobby.

27E, the device 100 provides a modifiable object to the pop-up window 2721. [ 27E, when a user input indicating a selection for the modify request button 2718 is received, the device 100 displays a popup window 2721 containing information 2719,2720 on the modifiable object. The pop-up window 2721 may contain information about one object.

Accordingly, the user can know information 2719 and 2720 regarding the object that can be modified. When the information on one object included in the pop-up window 2721 is selected, the device 100 can highlight the object corresponding to the information on the selected object.

Referring to FIG. 27F, the device 100 may display an object that can be modified using an independent page. In Figure 27f, when a user input indicating a selection for the modify request button 2723 is received, the device 100 opens a page 2726 containing information 2724, 2725 on the modifiable object. As a result, the user can know the object that can be modified. Device 100 may display information about at least one modifiable object through page 2726. [

27E or 27F, the device 100 can highlight the object corresponding to the selected modifiable object.

27A-27F receive user input indicating a selection for the Modify Request buttons 2701, 2705, 2709, 2714, 2718, and 2723, but the user input representing the Modify request in this disclosure is not limited to the one just described. For example, another button on the device 100 may be used or a user input indicating a modification request input may be received based on the user's gesture.

28 is a flow diagram of a process in which a device 100 according to some embodiments modifies an avatar-based image 2310 according to user input.

Referring to Fig. 28, in step S2801, the device 100 receives a first selection signal for one object of the modifiable objects. In step S2802, the device 100 displays a candidate object for the selected object.

29A-29E illustrate an example in which an object is modified based on a candidate object provided by the device 100 according to some embodiments.

When the device 100 highlights a modifiable object as shown in the screen 2910 of FIG. 29A, a first selection signal 2715 indicating selection for the violin 2703, such as the screen 2920, The device 100 displays the candidate object associated with the selected violin 2703. [

29A, the device 100 provides other items 2912, baseball items 2913, and badminton items 2914 as candidate objects related to the violin 2703, but in this disclosure, The object is not limited to this.

Referring to the screen 2920 of FIG. 29A, the device 100 displays information about the candidate object in the form of a pop-up window 2921. Referring to the screen 2920 of FIG. 29A, the device 100 provides information about candidate objects in text form.

However, the method of providing information regarding candidate objects in the present disclosure is not limited to the above-mentioned ones. For example, the device 100 may provide information about the candidate object in the form of a square pop-up window 2931, as shown in the screen 2930 shown in FIG. 29B. A rectangular pop-up window 2931 arranges images horizontally corresponding to each candidate object. The information on the candidate objects included in the square pop-up window 2931 may be provided as symbols, icons, representative images, etc., but the information on the candidate objects in the present disclosure is not limited to the above.

The device 100 may provide information about the candidate object in the form of a ring-shaped pop-up window 2941, as shown in screen 2940 of FIG. 29B. The ring-shaped pop-up window 2941 may include information about a candidate object in symbol form or text form.

If the number of candidate objects is greater than the number that can be simultaneously displayed in the pop-up windows 2921, 2931 and 2941, the device 100 displays pop-up windows 2921, 2931 and 2941 in accordance with the scroll input based on the pop- , 2931, and 2941 while providing information about the candidate object. The device 100 can move the information on the candidate object according to a predetermined arrangement order.

If the number of candidate objects is greater than the number that can be simultaneously displayed in the pop-up windows 2921, 2931, and 2941, the device 100 can display the input based on the pop-up windows 2921, 2931, 2941 The display area of the pop-up windows 2921, 2931, and 2941 may be expanded to provide information about the candidate object.

For example, the device 100 may expand the pop-up window 2931 according to the touch & drag input 2951 to provide information about the candidate object, as shown in the screen 2950 shown in FIG. 29C have. The device 100 may further provide a popup window 2961 independent of the popup window 2931 in accordance with the touch and drag input 2951 as shown in the screen 2960 shown in FIG.

In step S2803 of Fig. 28, the device 100 receives the second selection signal based on the information about the candidate object being displayed. In step S2804, the device 100 modifies the object selected as the selected candidate object according to the second selection signal.

29E, when the second selection signal for selecting the baseball item 2913 is received, the device 100 displays the avatar-based image that played the violin on the left hand The baseball glove is replaced with an avatar-based image with a baseball ball in the right hand.

The baseball-based avatar-based image in this disclosure is not limited to the one shown in the screen 2980. [ For example, when the device 100 displays an avatar-based image holding a violin 2703 in the left hand, as shown in screen 2990 of FIG. 29F, the selection of the baseball item 2913 When a user input is received, the device 100 may display an avatar based image holding a baseball bat 2996 in the left hand. In addition, when a user input indicating a selection of a movie item is received through the pop-up window 2911, the device 100 may display an avatar-based e-book having a movie CD or movie tape in the left hand.

When the user input indicating the selection of the modification completed button 2704 is received in the screen 2980 of FIG. 29E or the screen 2995 of FIG. 29F, the device 100 displays the modified image 2320 shown in FIG. And display it. The modified image 2320 shown in FIG. 23A is an avatar-based image for playing a guitar.

FIG. 30 is a flowchart of a process in which the device 100 according to some embodiments provides service information that can be provided for each object included in the avatar-based image 2310. FIG.

Referring to FIG. 30, in step S3001, the device 100 receives a first selection signal indicating selection for an object. In step S3002, the device 100 provides at least one service information based on the selected object.

Figs. 31A to 31D are examples of screens for explaining the user information management method shown in Fig. 30. Fig. 31A, when the avatar-based image is being displayed, when the user input indicating the selection of the modification request button 2701 is received, the device 100 displays the modified image 3120 shown in FIG. Highlight the possible objects.

When the first selection signal for the violin 2703 is received on the screen 3120 of FIG. 31A, the device 100 receives the service information Through a pop-up window 3131. [ Referring to the popup window 3131, the service information that can be provided may include a concert reservation item, a community access item, and / or a specialty shopping mall item, but is not limited to the above-described service information that can be provided in this disclosure.

When the second selection signal 3132 indicating selection for the selected object (the violin 2703 in Fig. 31B) is received in step S3003, the device 100 in step S3004 determines whether the selected object (violin 2703) And provides information about at least one candidate object. Information about the candidate object may be provided in the form of a pop-up window 3141 as shown in screen 3140 of FIG. 31B.

Accordingly, the device 100 recognizes the first selection signal in step S3001 as a preliminary selection for the object to be modified, and recognizes the second selection signal in step S3003 as a completion selection for the object to be modified . A preliminary selection indicates a selection waiting state for an object. The completion selection indicates the selection completion status for the object.

In step S3005, the device 100 receives the third selection signal based on the information on the candidate object. Thus, in step S3006, the device 100 provides at least one service information for the selected candidate object.

Referring to FIG. 31C, when a baseball item is selected from among information on a candidate object included in the pop-up window 3141 provided on the screen 3150, the device 100 displays the baseball 3160, And provides service information that can be provided on the basis of the item through the end bag 3151. [

In step S3007, the device 100 receives a fourth selection signal for the selected candidate (baseball). For example, the double touch 3152 shown in the screen 3160 of FIG. 31C can be received as the fourth selection signal.

The device 100 recognizes the third selection signal for the candidate object in step S3005 as a preliminary selection for the candidate object and selects the fourth selection signal for the selected candidate object in step S3007 as a completion selection for the selected candidate object Can be recognized. The preliminary selection indicates the selection waiting state, and the completion selection indicates the selection completion state.

In step 3008, the device 100 modifies the selected object with the selected candidate object. Accordingly, the device 100 may display an avatar-based image based on the baseball item as shown on screen 3170 of FIG. 31D. When the user input indicating the selection of the modification completed button 2704 is received on the screen 3170 of FIG. 31D, the device 100 completes the image modification.

30, the user of the device 100 can confirm the available service information based on the candidate object before modifying the avatar-based image.

If the avatar-based image 2310 is modified in accordance with the user's input in step S2202 of FIG. 22, the device 100 in step S2203 updates the user information 2300 based on the modified avatar- 2330). The user information 2330 includes information (guitar performance) 2331 about a user's hobby, a user name 2332, and information (female) 2333 about user gender.

As the user information 2300 is updated to the user information 2330, the user modeling information 2400 shown in FIG. 24A may be updated to the user modeling information 3200 shown in FIG. 32 is an example of user modeling information 3200 updated by device 100 according to some embodiments.

When the display size of the avatar 2311 included in the avatar-based image 2310 is changed, the device 100 can change the user information according to the changed display size. For example, when the display size of the avatar 2311 included in the avatar-based image 2310 is normal and the display size of the avatar 2311 is changed to be black according to user input, The weight and the key of the included user can be updated to a value that can be expressed in a state of being dried.

In step S2201 of FIG. 22, when the avatar-based image 2210 is being displayed by the device 100, the device 100 may provide a sound based on the user information 2300. FIG. The sound may be provided as background music of the avatar-based image 2310 or may be provided as the voice of the avatar 2311. [ The voice of the avatar 2311 may provide guidance information (e.g., "My name is A, female, my hobby is a violin performance") related to the user information 2300, for example.

The device 100 may provide the voice of the avatar 2311 in various modes based on female voice. The various modes may include modes such as, for example, a speech mode, a musical mode, or a play mode, but are not limited to the above described various modes based on speech in the present disclosure. The voice mode may be set to the default on the device 100, but may be set or changed by the user.

In the case where the sound is provided as background music, the device 100 can provide the violin playing music based on the information (2301, a violin performance) about the hobby of the user included in the user information 2300. [ The violin music piece can be determined by the device 100 or the server 2120 based on user information other than the user information 2300 shown in Fig. 23A.

The device 100 may further provide a background image of the avatar 2311 in the avatar based image 2310 based on the user information 2300. [ The background image may be represented by a monochromatic image (e.g., pink) based on the violin playing stage image or information on the sex of the user 2303 (female) based on information (2301, a violin performance) about the user's hobby The background image in the present disclosure is not limited to the above-described one. For example, the device 100 may display a night image as a background image if the user is perceived as playing a violin 2312 in the evening, mainly on the basis of user information. The device 100 may determine that the user is playing the violin 2312 mainly in the evening based on, for example, the violin performance time zone included in the user information.

In the case where at least one of the background image and the sound is provided in the avatar-based image 2310 as described above, the device 100 may provide the background image and sound as a modifiable object.

If the background image and the sound are provided by other user information than the information contained in the user information 2300 and the background image and / or sound are modified, the device 100 may modify the modified background image and / The user information can be updated based on the user information.

33 is a flowchart of a method in which a device 100 according to some embodiments modifies an avatar-based image to manage user information. Figure 33 is an example of updating user information according to user input accepting a modified avatar based image.

In step S3301 of Fig. 33, the device 100 displays the avatar-based image 2310 based on the user information as in the above-described step S2201. In step S3302, the device 100 modifies the avatar-based image according to the user input as in step S2202 described above.

In step S3303, the device 100 displays the modified avatar-based image 2320. [ In step S3304, when the device 100 receives a user input indicating acceptance for the modified avatar-based image 2320, the process proceeds to step S3305. The user input indicating acceptance for the modified avatar based image 2320 may be input via the device 100 but may be input using the external device 2120. [ Based on the modified avatar-based image 2320, the device 100 may display a message inquiring acceptance of the modified avatar-based image 2320 to receive user input indicating acceptance.

If in step S3304 no user input is received indicating to accept the modified avatar based image 2320, then the device 100 proceeds to step S3301 to display the avatar based image 2310 prior to being modified.

If the user input indicating that the modified avatar based image 2320 is to be received is not received in step S3304, the device 100 proceeds to step S3303 to display the modified avatar based image 2320, It is possible to maintain the standby state with respect to the user input.

In step S3304, if no user input is received for a predetermined time, the device 100 may determine that no user input has been received indicating that the modified avatar-based image 2320 is to be received.

Based on the modified avatar-based image 2320, the device 100 updates the user information in step S3305 when the user input is received, in step S3304, indicating that the modified avatar-based image 2320 is to be received.

34 is a flowchart of a method in which a device 100 according to some embodiments modifies an avatar-based image to manage user information.

Referring to FIG. 34, in step S3401, the device 100 receives user information from the external device 2120. FIG. The device 100 may receive user information from the external device 2120 according to a user input requesting the user information. For example, the device 100 may request user information from the external device 2120 in response to a user input requesting user information registered in the social media server, and may thereby receive user information from the external device 2120 have.

Also, the user information can be received from the external device 2120 without request of the device 100. [ For example, the user's health information may be received from the external device 2120 when the device 100 is in the sleep mode or running the A application. The user information received in step S3401 may include at least one of the user information mentioned at the beginning of this disclosure. The received user information may be stored in the device 100.

In step S3402, the device 100 generates and displays an avatar-based image based on the received user information. The generation of the avatar-based image based on the received user information may be performed as in step S2201 of Fig. 22 described above.

In step S3403, the device 100 modifies the avatar-based image being displayed in response to a user input indicating a modification request. Modification of the avatar-based image according to user input may be performed as in step S2202 of FIG. 22 described above.

In step S3404, the device 100 updates the user information according to the modified avatar-based image. The device 100 may request the update of the user information while changing the user information received in step S3401 according to the modified avatar based image and transmitting the changed user information to the external device 2120. [ Accordingly, the external device 2120 can update the user information. After requesting the update of the user information, the device 100 may automatically delete the information stored in the device 100 upon receiving the user information in step S3401.

35 is an operational flow diagram of a user information management method in which a device 100 according to some embodiments modifies and / or adds information using an avatar-based image.

In step S3501, the device 100 displays the avatar-based image 2310 according to the user information. Step S3501 may be performed similarly to step S2201 of Fig. 22 described above.

In step S3502, the device 100 may modify the avatar-based image 2310 being displayed in accordance with the user input. The modification to the avatar-based image 2310 performed in step S3502 may be performed similarly to step S2202 of Fig. 22 described above.

Also, in step S3502, the device 100 may add new information (or new objects) to the avatar-based image 2310 being displayed according to user input. Adding new information may be performed based on the image information corresponding to the additional information provided by the device 100. [ The image information may include at least one of an image, a symbol, or an icon symbolizing additional information.

The device 100 may provide the modified image 2320 with the selected image added, if the image corresponding to the addable information is selected. The process of adding new information in this disclosure is not limited to the one just described.

For example, the device 100 may provide an input window in which, when an image for addable information (e.g., an accessory) is selected, information related to the selected image (e.g., an earring) may be entered. When information related to the selected image is received through the provided input window, the device 100 generates an image (e. G., An earring) of the selected information based on the received information and transmits the modified image 2320 ). &Lt; / RTI &gt;

In step S3503, the device 100 updates the user information according to the avatar-based image to which the correction and / or the image has been added. For example, when a travel provision is added as shown in Figs. 8A to 8C, the device 100 updates the user information so that information about the added provision is included in the user information.

36 is a flowchart of a method of managing user information so that the device 100 according to some embodiments may provide a service based on an object selected in an avatar-based image. In Fig. 36, an object refers to an image corresponding to the modifiable user information included in the avatar-based image, and / or text.

In step S3601, the device 100 displays the avatar-based image according to the user information. The device 100 may display the avatar-based image as in step S2201 of Fig. 22 described above. For example, the device 100 may display the avatar-based image shown in FIG. 31A. At this time, the device 100 can display an avatar-based image that does not include the modification request button 2701 and the modification completion button 2704 shown in FIG. 31A.

In step S3602, when a user input indicating selection for one object 2703 in the avatar-based image 3110 being displayed on the device 100 is received, the device 100 displays service information based on the selected object 2703 Lt; / RTI &gt; For example, when a user input indicating selection for an object 2703 is received, such as the screen 3120 of FIG. 31A described above, the device 100 displays the selected object And opens a pop-up window 3131 containing at least one service information based on the service information.

Referring to FIG. 31B, the service information included in the pop-up window 3131 includes a recurring reservation item, a community access item, and a specialty shopping mall item. The service information included in the pop-up window 3131 in the present disclosure is not limited to the above-described one. In addition, service information based on the object 2703 selected in the present disclosure may be provided in the form included in the tray 2712 in Fig. 27C.

In step S3603, when a user input indicating selection of one service information is received, the device 100 provides the selected service. For example, when a user input indicating a selection for a concert reservation item included in the pop-up window 3131 is received, the device 100 may execute an application that provides a violin concert reservation service.

37 is a flowchart of a user information management method for providing a QA (Question & Answer) service based on an avatar-based image on which the device 100 according to some embodiments is displayed.

In step S3701 of FIG. 37, the device 100 displays an avatar-based image according to the user information. For example, the device 100 may display the avatar-based image 2310 shown in FIG. 23A according to user information.

In step S3702, when the question information is received, in step S3703, the device 100 provides answer information on the received question information.

The question information in step S3702 refers to question information related to the avatar-based image being displayed. For example, the question information could be "Tell me about the violin concert I booked", "Let me know if there is a violin lesson tomorrow", "What time was the violin lesson yesterday?", Or " What schedule is there for? "

The question information received in step S3702 may utilize the user's voice signal. If the device 100 can not process (or recognize) the question information received in step S3702, the device 100 may display an error message or output a voice signal indicating an error message.

In addition, when the device 100 fails to recognize the received question information, the device 100 may provide guidance information on the possible question information. The guide information on the question information can provide inputable question information in the form of a list. The guidance information on the question information can provide information on the types of questions that can be input.

When the device 100 recognizes the received question information, it may consider the user information. For example, if the received question is "Give information about Lincoln," device 100 may determine whether "Lincoln" is a person "Lincoln" or a car "Lincoln" based on the user information. In the case where the user of the device 100 is determined to be a person who is interested in the automobile based on the user information, the device 100 can recognize "Lincoln" included in the question information as a car "Lincoln".

On the other hand, if the question information received in step S3702 is &quot; Tell me the violin concert information I reserved &quot;, the device 100 in step S3703 sets the screen 3810 or the screen 3820 shown in FIG. . For example, if the question information received in step S3702 is &quot; Tell me about the recently updated concert information &quot;, then in step S3703, the device 100 receives the pre-update concert information 3810 shown in FIG. After the update, the concert information 3820 can be provided together. Accordingly, the user can easily confirm the pre-update concert information and the updated concert information.

FIG. 38 is an example in which the device 100 according to some embodiments provides answer information according to question information received. Referring to FIG. 38, answer information based on user information before being updated and response information based on user information after updated are simultaneously provided.

The device 100 may provide the screen 3810 and the screen 3820 partially overlapping. The device 100 may provide the screen 3810 and the screen 3820 in an expanded form of the electronic book. When the user inputs touching and dragging based on the edge or side of the screen 3810 or the screen 3820 when the screens 3810 and 3820 are provided in an expanded form of the electronic book, May close screens 3810 and 3820 in the direction in which they are dragged. For example, when a user input that touches the uppermost side of the screen 3820 and drags in the left side direction is received, the device 100 may close the screen such that the screen 3820 covers the screen 3810.

39 is a flow diagram of a method for managing user information based on device 100 and external device 2120 in accordance with some embodiments. FIG. 39 shows a case where an avatar-based image is generated in the external device 2120. FIG.

In step S3901, the external device 2120 generates an avatar-based image based on the user information. The external device 2120 may generate an avatar-based image based on the user information as in step S2201 of FIG. 22 described above. For example, if the external device 2120 is a social media server, the external device 2120 may generate an avatar-based image based on the user profile information registered in the social media server.

In step S3902, the external device 2120 transmits the generated avatar-based image to the device 100. [ Step S3902 may be performed in accordance with the user information request of the device 100. [

In step S3903, the device 100 displays the avatar-based image. In step S3904, the device 100 modifies the avatar-based image being displayed. Step S3904 may be performed upon receipt of a user input indicating a modification request based on the avatar-based image being displayed. The method of modifying the avatar-based image may be performed as in step S2202 of FIG. 22 described above.

When the avatar-based image is modified, the device 100 transmits the modified avatar-based image to the external device 2120 in step S3905. In step S3906, the external device 2120 updates the user information based on the received modified avatar-based image. Step S3906 may be performed as in step S2203 of Fig.

40 is a flow diagram of a method for managing user information based on device 100 and external device 2120 in accordance with some embodiments. FIG. 40 shows a case where an avatar-based image is generated in the device 100. FIG.

In step S4001, when the user information is transmitted from the external device 2120 to the device 100, the device 100 generates an avatar-based image based on the received user information in step S4002.

In step S4003, the device 100 displays the generated avatar-based image. In step S4004, the device 100 modifies the avatar-based image being displayed according to the received user input.

In step S4005, the device 100 updates the user information based on the modified avatar-based image. In step S4006, the device 100 transmits the updated user information to the external device 2120. [ The external device 2120 updates the user information stored in the external device 2120 based on the received updated user information.

41 is a flow diagram of a method of managing user information based on device 100 and wearable device 4110 in accordance with some embodiments. 41 is an example of displaying information about an object included in the avatar-based image through the wearable device 4110. [

In step S4101, the device 100 displays the avatar-based image in accordance with the user information, and in step S4102, the device 100 transmits information on the modifiable object included in the avatar-based image to the wearable device 4110 do.

In step S4103, the wearable device 4110 displays information about the received object. In this disclosure, information about an object can be displayed in an image form, but is not limited thereto. For example, the wearable device 4110 may display information about objects in text form. When a selection signal based on the information about the object being displayed is received in step S4104, the wearable device 4110 transmits information about the selected object to the device 100 in step S4105.

In step S4106, the device 100 retrieves information about the candidate object related to the selected object from the stored information. Information about the candidate object may be retrieved from an external storage device of the device 100. Information about the candidate object may be retrieved from the external device 2120 connected to the device 100. The device 100 can retrieve information about the candidate object using the identification information of the selected object as a keyword.

In step S4107, the device 100 transmits information about the searched candidate object to the wearable device 4110. [ In step S4108, the wearable device 4110 displays information about the received candidate object.

For example, if the object selected in step S4104 is the violin 2703 shown in FIG. 29A, the candidate object that can be displayed in step S4108 is the item included in the pop-up window 2921 shown in the screen 2920 of FIG. 29A .

For example, if the selected object in step S4104 is an icon (2710, or a hobby item) of the hobby in Figure 27c, then the candidate object that may be displayed in step S4108 is an item related to the hobby Photographs, etc.).

The information about the candidate object may be displayed in the form of an image or / and text, but the display form of the information about the candidate object in this disclosure is not limited to the one just described.

When the selection signal for the candidate object is received in step S4109, the wearable device 4110 transmits information about the selected candidate object to the device 100 in step S4110.

In step S4111, the device 100 modifies the avatar-based image using the selected candidate object. In step S4112, the device 100 updates the user information based on the modified avatar-based image. Updating the user information in step S4112 may be performed as in step S2203 of Fig. 22 described above.

42 is a flow diagram of a method of managing user information based on device 100 and wearable device 4210 in accordance with some embodiments. 42 is an example of modifying the avatar-based image based on the user information acquired by the wearable device 4210. FIG.

In step S4201, the device 100 displays the avatar-based image according to the user information. In step S4201, the device 100 may display the avatar-based image as in step S2201 of Fig. 22 described above.

In step S4202, the wearable device 4210 acquires user information. User information obtained by the wearable device 4210 may include, for example, user health information, or location information of the wearable device 4210, but in this disclosure information obtainable by the wearable device 4210 Is not limited to this.

The above-described steps S4201 and S4202 may be performed simultaneously. Step S4202 may be performed before step S4201.

In step S4203, the wearable device 4210 transmits the obtained user information to the device 100. [ The device 100 modifies the avatar-based image being displayed in step S4201 based on the received user information.

For example, if the received user information is information indicating the user's body temperature and the measured body temperature is determined to be higher than the reference, the device 100 may partially color the face of the avatar-based image being displayed in step S4201 It can be reddish. Accordingly, the user can confirm that the user is heating up through the avatar-based image being displayed through the device 100. [

For example, if the received user information is information indicating the user's pleasant feeling, the device 100 may modify the face of the avatar-based image being displayed in step S4201 to a smiling face. Accordingly, the user can confirm that the user is in a comfortable mood through the avatar-based image displayed through the device 100. [

As described above, the device 100 can variously modify the avatar-based image being displayed in step S4201 according to information measured and transmitted in the wearable device 4210. [ Image modification can modify at least one object that is modifiable among the objects included in the image as well as the face of the image. Modifiable objects may include at least one of a background image and a sound, but objects that can be modified in this disclosure are not limited to the above-described ones.

Figure 43 is a functional block diagram of a device 100 in accordance with some embodiments. 43, the device 100 may include a user input portion 4310, a control portion 4320, a display 4330, and a memory 4340.

The user input unit 4310 includes a user input indicating a user information request, a user input indicating a modification request for user information, a user input indicating a user information addition request, a user input indicating completion of modification of user information, Based input, a user input indicating a request for service information, a user input indicating selection of service information, a user input indicating acceptance for a modified avatar-based image, or a user input for controlling the device 100, The user input is not limited to the above-mentioned one.

The user input unit 4310 may be mounted in the device 100. [ A user input 4310 that may be mounted to the device 100 may include a keypad, a dome switch, a touchpad (contact capacitive, pressure resistive, infrared A jog wheel, and / or a jog switch, but the user input 4310 in this disclosure is not limited to the one described above, Do not.

User inputs that may be received via user input 4310 may include touch-based user input, movement-based user input, vision-based user input, and / Input, but the user input in this disclosure is not limited to the one just described.

The touch-based user input may be, for example, a tap or touch, a long tap or touch, a touch and hold, a touch and drag, a double tap-based user input in this disclosure may include one or more of the following limitations, such as, but not limited to, tapping, dragging, panning, flicking, dragging and dropping, It does not.

The movement-based user input may include user input based on, for example, a motion-based user gesture of the device 100 (e.g., device waving, device rotation, or device lifting, etc.) But the motion-based user input in this disclosure is not limited to the one just described.

Vision-based user input may include recognized user input by analyzing an input image obtained by a camera (not shown) included in device 100 without contact between device 100 and a user, Vision-based user input is not limited to the one just described.

The control unit 4320 refers to a processor that controls the operation of the device 100. [ The control unit 4320 can operate by loading a program that can execute the user information management method according to some embodiments stored in the memory 4340. [ The control unit 4320 may store in the memory 4340 a program capable of executing the user information management method according to some embodiments. The control unit 4320 can update the program that can execute the user information management method according to some embodiments stored in the memory 4340. [

The control unit 4320 may generate an avatar based image based on the user information and display it on the display 4330 according to the user information management method according to some embodiments. When a user input requesting modification of the avatar-based image is received from the user input unit 4310, the controller 4320 modifies the avatar-based image according to the received user input. The control unit 4320 can update the user information based on the modified avatar-based image.

The control unit 4320 controls the operation of the control unit 4320 in accordance with the above-described Figures 2, 7, 9, 11, 13, 14, 16, 18, 20, 22, 28, 30, 33, 35, Fig. 36, Fig. 37, Fig. 39, Fig. 40, Fig. 41 or Fig.

In addition, when a user input for requesting user information of a specific period is received through the user input unit 4310, the controller 4320 displays a plurality of avatar-based images in response to the user input, 4330 so that the display 4330 is displayed. The plurality of avatar-based images displayed on the display 4330 may be determined according to a criterion that divides a specific period of time.

In addition, when a user input for requesting user information of a specific period is received through the user input unit 4310, the controller 4320 displays a plurality of avatar-based images on the display 4330 The display 4330 is displayed. The plurality of avatar-based images displayed on the display 4330 may be determined according to the theme items included in the user information of the specific period.

In addition, when a user input requesting the display of the modifiable information is received through the user input unit 4310, the control unit 4320 modifies the modifiable portion of the avatar-based image displayed on the display 4330 in response to the user input It can be distinguished from the unlikely part.

If the providing period for the avatar-based image is set, the control unit 4320 checks the providing period. When the providing period expires, the control unit 4320 may extinguish the avatar-based image. The information regarding the providing period and the avatar-based image described above may be stored in the memory 4340, but the present disclosure is not limited thereto. For example, the information on the providing period and the avatar-based image described above may be stored in the external device 2120. [

Further, when a user input indicating a medical information request is received via the user input unit 4310 when the avatar-based image based on the user's health information is displayed on the display 4330, the control unit 4320 responds to the user input On the display 4330, medical information related to the health information of the user.

If a user input relating to the selected medical information is received via the user input unit 4310 based on the medical information provided through the display 4330, the control unit 4320 may update the user's schedule information according to the selected medical information .

Also, when a user input indicating the addition of information on the avatar-based image is received through the user input unit 4310, the control unit 4320 displays an input window for adding information on the display 4330. When information is received through the input window, the controller 4320 adds the image corresponding to the received information to the avatar-based image being displayed on the display 4330. The control unit 4320 may update the user's schedule information according to the avatar-based image including the added image being displayed on the display 4330. [ The schedule information of the user may be stored in the memory 4340 and / or the external device 2120.

Also, the avatar-based image according to the user's future desired information can be displayed on the display 4330 under the control of the controller 4320. [ When a user input for requesting information related to future desired information is received via the user input unit 4310 while the avatar based image according to the user's future desired information is displayed on the display 4330, And provides information related to the future desired information through the display 4330. [ When a user input for selecting at least one of the information related to the future desired information provided through the display 4330 through the user input unit 4310 is received, the controller 4320 updates the user's schedule information according to the selected information .

In response to the user input for requesting usage history information for the use period of the device 100 through the user input unit 4310, the control unit 4320 receives the user history information of the device 100, Based images on the display 4330. The avatar-

Further, the avatar-based image according to the user information registered in the social media on the display 4330 can be displayed under the control of the controller 4320. [ In this case, when a user input requesting modification is received through the user input unit 4310, the controller 4320 modifies the avatar-based image displayed on the display 4330 in response to the received user input, The user information registered in the social media can be updated according to the avatar-based image. The user information registered in the social media may include user profile information registered in the above-mentioned social media server. The user information registered in the social media in the present disclosure is not limited to the above-described ones.

Display 4330 may display information processed by device 100. [ The display 4330 may include any of the above-described Figures 1, 5A to 5E, 6A to 6E, 8A to 8C, 10, 12A to 12C, 15A to 15E, 17A to 17D, (Graphic User Interface) screen shown in Figs. 19a, 19b, 23a to 23f, 27a to 27f, 29a to 29f, 31a to 31d, or 38 can be displayed.

The display 4330 can be used as an output device and an input device when the touch pad has a layer structure and is configured as a touch screen. The display 4330 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display display, and / or an electrophoretic display (EPD).

Depending on the implementation of the device 100, the device 100 may include two or more displays 4330. At this time, the two or more displays 4330 may be arranged to face each other using a hinge. Display 4330 may be comprised of a transparent display.

The memory 4340 may store a program for processing and controlling the control unit 4320. The program stored in the memory 4340 may include an OS (Operating System) program and various application programs. The various application programs may include an application capable of executing at least one of a user information management method according to some embodiments or a service providing method according to an avatar based image, but the application is not limited thereto.

The memory 4340 stores information managed by the application program. For example, user information according to some embodiments, user modeling information based on user information, coordinate values for each object, and / or coupling condition information for each object may be stored, but may be stored in memory 4340 The information is not limited to those described above.

The memory 4340 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory) SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory) , Or an optical disc.

The device 100 may be configured to use a web storage or a cloud server (not shown) that performs the storage function of the memory 4340 on the Internet. In this case, the information about the GUI displayed on the display 4330 may be provided from the web storage or cloud server described above.

The device 100 is not necessarily all of the components shown in Fig. The device 100 may include more components than the components shown in FIG. 43 or may include fewer components than those shown in FIG. For example, the device 100 may be configured as shown in FIG.

44, the device 100 includes a user interface unit 4410, a control unit 4420, a sensor unit 4430, a memory 4440, an image processing unit 4450, an audio output unit 4460, an audio input unit 4470, a camera 4480, and a communication unit 4490.

The device 100 may further include a battery (not shown). The battery may be embedded in the device 100 in a form that is embedded in the device 100 or removable. The battery can supply power to all components contained in the device 100. The device 100 may be powered from an external power supply. The external power supply may be a battery built in the external device 2120.

The user input unit 4411, the display 4412, the control unit 4420 and the memory 4440 included in the user interface unit 4410 shown in FIG. 44 correspond to the user input unit 4310, the control unit 4320 ), Display 4330, and memory 4340 may be referred to as similar or identical components.

The sensor unit 4430 includes a proximity sensor 4431 for sensing whether the user is approaching the device 100, an illuminance sensor 4432 (or optical sensor) for sensing the illumination around the device 100, A mood sensor 4433 for sensing the mood of the user, a position sensor (e.g., GPS (Global Positioning System) receiver 4434) for detecting the position of the device 100, a device An accelerometer sensor 4436 for measuring the tilt and acceleration of the device 100 about the ground surface, a gyroscope sensor 4435 for measuring the azimuth angle of the device 100, A gesture sensor 4438 that senses infrared rays reflected on the palm of the hand and recognizes a hand gesture, and / or a temperature / humidity sensor 4439 that recognizes ambient temperature and humidity, and the like. In the case where the position sensor 4434 is configured as a GPS receiver, the position sensor 4434 may be referred to as being included in the communication unit 4490. [ The gesture sensor 4438 may be referred to as a motion detection sensor for sensing activity.

The sensor portion 4430 is not limited to the one shown in Fig. For example, the sensor unit 4430 may be a sensor such as a gravity sensor, an altitude sensor, a chemical sensor (e.g., Odorant sensor), an air pressure sensor, a fine dust measuring sensor, an ultraviolet sensor, (CO 2) sensors, and / or network sensors (e.g., network sensors based on WiFi, Bluetooth, 3G, Long Term Evolution (LTE), or Near Field Communication).

The sensor unit 4430 may include a pressure sensor (e.g., a touch sensor, a piezoelectric sensor, a physical button, etc.), a status sensor (e.g., an earphone terminal, a Digital Multimedia Broadcasting (DMB) A terminal for recognizing whether or not the charging progress is recognized, a terminal for recognizing whether or not a PC (Personal Computer) is connected, a terminal for recognizing whether a dock is connected), a time sensor, and / A blood pressure sensor, a blood pressure sensor, a stress sensor, etc.), but the sensors that may be included in the sensor portion 4430 in the present disclosure are not limited to those described above.

The result (or sensing value or sensing signal) sensed by the sensor unit 4430 is transmitted to the controller 4420.

The control unit 4420 may generate an avatar-based image based on the sensing value received from the sensor unit 4430 and display the avatar-based image on the display 4412. The control unit 4420 may modify the avatar-based image being displayed on the display 4412 according to a user input indicating a modification request received via the user input unit 4411. The control unit 4420 can update the user information stored in the memory 4440 based on the modified avatar based image. The control unit 4410 can update the user information stored in the external device 2120 connected through the communication unit 4490 based on the modified avatar-based image. As such, the controller 4420 may operate according to some embodiments, such as the controller 4320 of FIG.

The control unit 4420 controls the overall operation of the device 100. [ For example, the control unit 4420 includes a user interface unit 4410, a sensor unit 4430, a memory 4440, an image processing unit 4450, an audio output unit 4460, The audio input unit 4470, the camera 4480, and / or the communication unit 4490. [

The control unit 4420 may control the operation of the control unit 4320 in the same manner as the control unit 4320 of FIG. 30, 33, 34, 35, 36, 37, 39, 40, 41, or 42. FIG.

The control unit 4420 may include a plurality of devices according to the operating environment of the device 100. [ For example, the controller 4420 may include a processor operating in the low power mode of the device 100 and a processor operating in the normal mode. The controller 4420 may include a plurality of processors separated according to the components included in the device 100. [

Programs stored in the memory 4440 can be classified into a plurality of modules according to their functions. For example, programs stored in memory 4440 may be classified as UI module 4441, notification module 4442, and / or application module 4443, Are not limited to those described above. For example, where the display 4412 is associated with a touch panel layer, the plurality of modules may include a touch screen module.

The UI module 4441 may provide GUI information to the control unit 4420 for modifying the user information referred to in the preferred embodiment. The UI module 4441 can provide a UI, a GUI, and the like, which are specialized for each application installed in the device 100, to the control unit 4420.

The notification module 4442 may generate a signal informing the device 100 of a modification request, an addition request, a modification completion, an object selection, a service information request, or a service selection. However, the notification generated by the notification module 4442 may be, One is not immediately limited.

The notification module 4442 can output the notification signal in the form of a video signal through the display 4412 and output the notification signal in the form of an audio signal through the audio output portion 4460. However,

The application module 4443 may include at least one of a user information management application set on the device 100, and / or a service providing application based on an avatar based image.

The user information management application according to some embodiments may be operated in connection with other applications set in the device 100. [ For example, if the question information is received in step S3702 of FIG. 37, the user information management application may be set to the device 100 to provide answer information (e.g., search result) based on the question information received in step S3703 QA (Question & Answer) application.

The image processing unit 4450 processes the image data received from the communication unit 4490 or stored in the memory 4440 so as to be displayed on the display 4412. For example, the above-described Figures 1, 5A to 5E, 6A to 6E, 8A to 8C, 10, 12A to 12C, 15A to 15E, 17A to 17D, (Graphic User Interface) screen shown in Fig. 19B, Figs. 23A to 23F, Figs. 27A to 27F, Figs. 29A to 29F, Figs. 31A to 31D or Fig. 38 can be displayed on the display 4412 The image processing unit 4450 can perform signal processing on the image data.

The audio output unit 4460 may output sound according to user information according to some embodiments. The audio output unit 4460 can output audio data received from the communication unit 4490 or stored in the memory 4440. The audio output unit 4460 may output a sound signal (e.g., a notification sound) related to the function performed by the device 100. [ The audio output unit 4460 may include, but is not limited to, a speaker, a buzzer, and the like.

The audio input unit 4470 may be constituted by a microphone. The audio input unit 4470 receives an audio signal input from the outside of the device 100, converts the received audio signal into an electrical audio signal, and transmits the electrical audio signal to the controller 4420. The audio input unit 4470 may be configured to perform operations based on various noise reduction algorithms for eliminating noise generated in receiving an external sound signal. The audio input unit 4470 can recognize the user's voice.

The camera 4480 can obtain an image frame such as a still image or a moving image through the image sensor in a video communication mode or a photographing mode. The camera 4480 may obtain and transmit a finger gesture image of the user of the device 100 to the control unit 4480. Based on the user's finger gesture image, the control unit 4420 displays a user input indicating a modification request for the avatar-based image, a user input indicating an addition request for the avatar-based image, a user input indicating completion of modification to the avatar- Based on the avatar-based image, a user input indicating a service information providing request based on the avatar-based image, and a user input indicating a service execution request based on the avatar-based image. In this disclosure, the user's finger gesture image is not limited to being used to determine whether or not to receive the above-described user input. The image captured through the image sensor can be processed through the control unit 4420 or a separate image processing unit (not shown).

The image frame processed by the camera 4480 may be stored in the memory 4440 or may be transmitted to the outside via the communication unit 4490. [ The camera 4480 may be provided in two or more according to the configuration of the device 100.

The communication unit 4490 may include one or more components for communicating between the device 100 and the at least one external device 2120. For example, the communication unit 4490 may include at least one of a local communicator 4491, a mobile communication device 4492, and / or a broadcast receiver 4493. The components included in the communication unit 4490 in the present disclosure are not limited to those described above. For example, the communication unit 4490 may include components capable of performing at least one of the communications described in the network 2110 of Fig.

The short-range wireless communicator 4491 may be a Bluetooth communication device, a Bluetooth low energy (BLE) communication device, a near field communication unit (RFID) device, a WLAN communication device, a Zigbee communication device, Communication, WFD (Wi-Fi Direct) communication, or UWB (ultra wideband) communication. The communication modules included in the local communicator 4491 in the present disclosure are not limited to the above-described ones. For example, the local communicator 4491 may include an infrared (IRDA) communication module. When the local communicator 4491 receives the beacon signal, it can use low power Bluetooth communication.

The mobile communication device 4492 transmits and receives radio signals with at least one of a base station, an external device, and / or a server on a mobile communication network. Here, the wireless signal may include various types of data depending on a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The broadcast receiver 4493 receives broadcast signals and / or broadcast-related information from outside via a broadcast channel. The broadcast channel may include, but is not limited to, at least one of a satellite channel, a terrestrial channel, and a radio channel.

The communication unit 4490 may transmit the avatar-based image and / or the modified avatar-based image generated in the device 100 to the external device 2120 according to some embodiments. The communication unit 4490 receives at least one of user information, user modeling information, avatar-based image, service information, coordinate information of each object, and / or coupling condition information between objects from the external device 2120 according to some embodiments . The information, data, and signals transmitted and received via the communication unit 4490 are not limited to those described above.

45 is a detailed functional block diagram of the control units 4320 and 4420 according to some embodiments. The following description will be made on the basis of the control unit 4420 of Fig. 44 for the sake of convenience, but the following description can be applied to the control unit 4320 of Fig.

45, the control unit 4420 includes an information collection processor 4501, a user modeling information generation processor 4502, an image generation processor 4503, an image display processor 4504, an image modification processor 4505, And a modeling information modification processor 4506.

The information collection processor 4501 may collect user information. The information collection processor 4501 may collect user information based on information received through the user input unit 4411, the sensor unit 4430, or the communication unit 4490. [ The user information is as mentioned at the beginning of this disclosure. The user input received via the user input 4411 may be based on selection for an image type object provided by the information collection processor 4501, but the user input in this disclosure is not limited to the one just described. The information collection processor 4501 may store the collected user information in the memory 4440 or transmit it to the external device 2120 through the communication unit 4490. [

The user modeling information generation processor 4502 generates user modeling information using the user information collected by the information collection processor 4501. The user modeling information may be configured as shown in FIG. 3 or FIG. 24A. User modeling information in this disclosure is not limited to the one just described. The user modeling information generation processor 4502 may store the generated user modeling information in the memory 4440 or may transmit the generated user modeling information to the external device 2120 through the communication unit 4490. [

The image generation processor 4503 generates an avatar based image referred to in this disclosure based on the user modeling information generated by the user modeling information generation processor 4502. [ An avatar-based image can be said to be an image symbolizing a user. The image generation processor 4503 may store the generated avatar-based image in the memory 4440 or transmit it to the external device 2120 through the communication unit 4490. [ The image stored in the memory 4440 or the external device 2120 can be temporarily stored.

The image display processor 4504 displays the avatar based image generated by the image generating processor 4503 through the display 4412. [

The image modification processor 4505 modifies the avatar-based image based on the avatar-based image being displayed through the display 4412 in accordance with some embodiments described above. When the modification to the avatar-based image is completed, the image modification processor 4505 can update the image stored in the memory 4440 or the image stored in the external device 2120.

The user modeling information modification processor 4506 updates the user information stored in the memory 4440 or the external device 2120 based on the image modified by the image modification processor 4505. [

The control units 4320 and 4420 shown in Figs. 43 and 44 may include fewer or more components than those shown in Fig. For example, when the user information is received from the external device 2120, the control units 4320 and 4420 may not include the information collection processor 4501.

The control units 4320 and 4420 include a user modeling information receiving processor in place of the information collecting processor 4501 and the user modeling information generating processor 4502, And may include a user modeling information transmission processor instead of the information modification processor 4506. For example, when receiving an avatar update image based on the user information from the external device 2120, the control units 4320 and 4420 include an information collection processor 4501, a user modeling information generation processor 4502, An image receiving processor may be included instead of the image receiving processor 4503.

As described above, detailed functional block diagrams of the control units 4320 and 4420 shown in Figs. 43 and 44 are not limited to those shown in Fig. 45. In addition, the functions of the external device 2120 can be determined based on the functional block diagrams of the control units 4320 and 4420.

One or more programs, including instructions for causing a computer-implemented method of implementing the method according to the embodiments of the present disclosure, to be recorded on a computer readable recording medium with computer readable code. A computer-readable recording medium includes all kinds of storage devices in which data that can be read by a computer system is stored. Examples of the computer-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like. The computer readable recording medium may also be distributed over a networked computer system and stored and executed as computer readable code in a distributed manner.

The present disclosure has been described with reference to preferred embodiments thereof. It will be understood by those skilled in the art that the present disclosure may be embodied in various forms without departing from the essential characteristics of the present disclosure. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present disclosure is set forth in the appended claims rather than the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present disclosure.

Claims (20)

A device for managing user information,
A display for displaying an avatar-based image;
Controlling the display such that the avatar-based image according to user schedule information is displayed on the display,
Based image in accordance with a user input indicating a modification request for the avatar-based image,
And a controller for updating the user schedule information according to the modified avatar-based image. The apparatus of claim 1, wherein the display is controlled by the control unit to display a plurality of avatar-based images,
Further comprising a user input for receiving user input requesting user information of a specific period,
Wherein the control unit controls the device in response to the user input so that a plurality of avatar-based images are displayed according to the user information of the specific period,
Wherein the plurality of avatar based images are determined according to a criterion that divides the specific time period. The apparatus of claim 1, wherein the display is controlled by the control unit to display a plurality of avatar-based images,
Further comprising a user input for receiving user input requesting user information of a specific period,
Wherein the controller controls the device to display a plurality of avatar-based images according to the user information of the specific period in response to the user input,
Wherein the plurality of avatar-based images are determined according to a theme item included in the user information of the specific period. 2. The apparatus of claim 1,
Further comprising a user input for receiving a user input requesting a modifiable information display,
Wherein the display is controlled by the controller to display the modifiable portion of the avatar-based image distinct from the non-modifiable portion in response to the user input. The apparatus of claim 1,
If the providing period for the avatar-based image is set, checking the providing period,
And expires the avatar-based image when the providing period expires. The display according to claim 1,
An avatar-based image according to the health information of the user is displayed,
Wherein the device further comprises a user input for receiving a user input indicative of a medical information request,
Wherein,
Providing health information related to the health information of the user through the display in response to the user input,
When the user input relating to the selected medical information based on the provided medical information is received through the user input unit,
And updates the schedule information of the user according to the selected medical information. 2. The apparatus of claim 1,
Further comprising a user input for receiving a user input indicating the addition of information to the avatar-based image,
Wherein the display is controlled by the control unit to display an input window for adding the information,
Wherein,
Based image, adding an image corresponding to the information received through the input window to the avatar-
And updates the schedule information of the user according to the avatar-based image including the added image. The apparatus of claim 1, wherein the display is configured to display an avatar-based image according to a user's future desired information by being controlled by the controller,
The device comprising:
Further comprising a user input section for receiving a user input requesting information related to the future desired information,
Wherein,
Providing information related to future desired information through the display according to the user input,
And updates the schedule information of the user according to the selected information among the information related to the future desired information. The display device according to claim 1, wherein the display controls a plurality of avatar-based images according to usage history information of the device,
The device comprising:
Further comprising a user input unit for receiving a user input for requesting usage history information for the device for each use period,
Wherein the control unit is responsive to the user input to control the display such that the plurality of avatar based images are displayed on the display. The display device according to claim 1, wherein the display is controlled by the control unit to display an avatar-based image according to user information registered in a social media,
The device further comprising a user input for receiving a user input requesting modification,
Wherein the controller modifies the avatar-based image in response to the user input,
And updates the user information registered in the social media according to the modified avatar-based image. A method for managing user information executed by a computing device,
Displaying an avatar-based image according to user schedule information on a display of the computing device;
Modifying the avatar-based image according to user input indicating a modification request for the avatar-based image; And
And updating the user schedule information according to the modified avatar-based image. 12. The method of claim 11, wherein displaying the avatar-
Displaying a plurality of avatar-based images according to user information of a specific period,
Wherein the plurality of avatar-based images are determined according to a criterion dividing the specific period. 12. The method of claim 11, wherein displaying the avatar-
Displaying a plurality of avatar-based images according to user information of a specific period,
Wherein the plurality of avatar-based images are determined according to a theme item included in the user information of the specific period. 12. The method of claim 11,
And displaying the modifiable portion of the avatar-based image in a manner distinct from the non-modifiable portion in response to a user input requesting an editable information display. 12. The method of claim 11,
If the providing period for the avatar-based image is set, checking the providing period;
Expiration of the avatar-based image when the providing period expires,
Further comprising: 12. The method of claim 11,
Displaying an avatar-based image according to the user's health information on the display;
Providing health information related to the health information of the user according to a user input indicating a medical information request; And
And updating the user's schedule information according to the medical information selected based on the provided medical information. 12. The method of claim 11,
Displaying an input window for adding the information on the display as a user input indicating the addition of information about the avatar-based image is received;
Adding an image corresponding to information received through the input window to the avatar-based image; And
And updating the user's schedule information according to an avatar-based image including the added image. 12. The method of claim 11,
Displaying an avatar-based image according to user's future desired information; And
Providing information related to future desired information according to a user input requesting information related to the future desired information; And
And updating the schedule information of the user according to information selected from information related to the future desired information. 12. The method of claim 11,
Depending on the user input requesting usage history information for the usage period for the computing device
And displaying the plurality of avatar-based images according to the usage history information. 12. The method of claim 11,
Displaying an avatar-based image according to user information registered in the social media;
Modifying the avatar-based image according to a user input requesting modification; And
And updating the user information registered in the social media according to the modified avatar-based image.

Images