KR20240020818A - Method and system for displaying emotional state of users - Google Patents

Abstract

The present disclosure provides a method for displaying an emotional state for a conversation partner, which is performed by at least one processor. The method includes obtaining at least one conversational message conducted between a first user and a second user, determining, based on the obtained conversational message, an emotional state of the second user with respect to the first user, and determining the determined emotion. It may include displaying first visualization information related to the status in the chat room.

Description

{METHOD AND SYSTEM FOR DISPLAYING EMOTIONAL STATE OF USERS}

The present disclosure relates to a method for displaying a user's emotional state toward a conversation partner, and more specifically, to a method and system for displaying a user's emotional state toward a conversation partner in a chat room based on conversation messages sent and received between users.

Due to the proliferation of mobile devices such as smartphones and the development of the Internet, instant messaging applications using mobile devices are widely used. Users who use instant messaging applications through mobile devices can exchange various conversation messages with other users through chat rooms.

These instant messaging applications provide the ability to set a user's profile, and users can register nicknames, photos, etc. through the profile. In addition, instant messaging applications provide the ability to set statuses, allowing users to set various statuses such as out of office, unanswered, on vacation, driving, sad, happy, angry, etc. Based on the user's status, other users can determine the user's status.

However, this status setting function requires the user's input information because the user directly changes his or her status through the profile, and there is a problem in that it is difficult to reflect the user's status in real time. Additionally, if status information is not recorded in the user's profile, it is difficult for other users to determine the user's status.

The present disclosure provides a method for displaying an emotional state for a conversation partner, a computer program stored in a recording medium, and a device (system) to solve the above problems.

The present disclosure may be implemented in various ways, including a method, a device (system), and/or a computer program stored in a computer-readable storage medium, and a computer-readable storage medium storing the computer program.

According to an embodiment of the present disclosure, a method for displaying an emotional state performed by at least one processor includes obtaining at least one conversation message performed between a first user and a second user, based on the obtained conversation message. , may include determining the emotional state of the second user with respect to the first user and displaying first visualization information associated with the determined emotional state in the chat room.

According to an embodiment of the present disclosure, a method for displaying an emotional state includes determining an emotional state of a first user with respect to a second user based on an obtained conversation message, and providing second visualization information associated with the determined emotional state to a chat room. A display step may be further included.

According to an embodiment of the present disclosure, the step of determining the emotional state of the second user with respect to the first user includes: determining the emotional state of the second user with respect to the first user based on the conversation message written by the second user among the obtained conversation messages; Determining the emotional state of the user, wherein determining the emotional state of the first user with respect to the second user comprises: determining the emotional state of the first user with respect to the second user; It may include determining the emotional state of the first user.

According to an embodiment of the present disclosure, a method for displaying an emotional state includes detecting a conversation message written by a first user intended for a third user in a chat room, and in response to the detected conversation message, It may further include displaying third visualization information related to the emotional state in the chat room.

According to an embodiment of the present disclosure, displaying the second visualization information in the chat room includes displaying the second visualization information in a predetermined area where the emotional state of the first user is expressed, and displaying the second visualization information in the chat room. The step of displaying information in a chat room may include changing the second visualization information displayed in a predetermined area into third visualization information.

According to an embodiment of the present disclosure, the step of displaying the third visualization information in the chat room is based on a conversation message between the third user and the first user included in at least one of the chat room or another chat room, It may include determining the emotional state of the first user.

According to an embodiment of the present disclosure, the step of detecting a conversation message of a first user written for a third user includes detecting a mention message in which the first user points to a third user in a chat room, or When detecting the first user's response message to the user's conversation message, it may include determining that the first user's conversation message written for the third user has been detected.

According to one embodiment of the present disclosure, the chat room is a group chat room, and the step of obtaining at least one chat message includes the first set of chat messages written by the second user from the group chat room including the first user and the second user. Obtaining conversation messages and obtaining a second set of conversation messages included in a personal chat room including a first user and a second user, wherein the emotional state of the second user with respect to the first user is the first set of conversation messages. It may be determined based on the set of conversation messages and the second set of conversation messages.

According to an embodiment of the present disclosure, determining the emotional state of the second user with respect to the first user includes determining the first emotional state based on a first set of conversational messages, a second set of conversational messages, and Based on the message, determining a second emotional state and determining an emotional state of the second user with respect to the first user based on the first emotional state and the second emotional state.

According to one embodiment of the present disclosure, determining the emotional state of the second user with respect to the first user includes determining whether the first emotional state and the second emotional state are the same, and the first emotional state and the second emotional state. In response to determining that the two emotional states are different, the method may include determining an emotional state with a higher priority among the first emotional state and the second emotional state as the emotional state of the second user with respect to the first user.

According to an embodiment of the present disclosure, the emotional state of the second user with respect to the first user may be determined by applying a first weight to the first emotional state and a second weight to the second emotional state.

According to one embodiment of the present disclosure, the second weight may be greater than the first weight.

According to an embodiment of the present disclosure, the first set of conversation messages may be messages written by a second user for a first user in a group chat room.

According to an embodiment of the present disclosure, a method for displaying an emotional state includes obtaining a third set of conversation messages between a first user and a third user included in a group chat room, and a personal chat room including the first user and the third user. obtaining a fourth set of conversation messages included in, determining, based on the third set of conversation messages and the fourth set of conversation messages, an emotional state of the third user with respect to the first user, and determining the first user's emotional state with respect to the first user. The method may further include displaying fourth visualization information related to the emotional state of the third user with respect to the user in the group chat room.

According to an embodiment of the present disclosure, the method for displaying emotional states further includes the step of displaying emotional relationship information between all users included in the group chat room, and the emotional relationship information includes each of the other users with respect to the first user. It may include the emotional state of the first user and the emotional state of each of the other users.

According to an embodiment of the present disclosure, the method for displaying an emotional state may further include receiving an output request for emotional relationship information from a first user and obtaining at least a portion of the emotional relationship information from an external device.

According to one embodiment of the present disclosure, determining the emotional state of the second user with respect to the first user includes extracting at least one keyword or emoticon associated with the emotion from the obtained conversation message and at least one extracted It may include determining the emotional state of the second user with respect to the first user based on the keyword or emoticon.

According to an embodiment of the present disclosure, displaying the first visualization information in the chat room may include displaying the first visualization information in association with the profile of the second user in the chat room.

In order to execute the above-described emotional state display method on a computer, a computer program stored in a computer-readable recording medium may be provided.

A user terminal according to an embodiment of the present disclosure includes a memory and at least one processor connected to the memory and configured to execute at least one computer-readable program included in the memory, and the at least one program is operated by the first user. Obtain at least one conversation message performed between the user and the second user, determine the emotional state of the second user with respect to the first user based on the obtained conversation message, and display first visualization information associated with the determined emotional state in the chat room. It may contain commands for displaying.

According to some embodiments of the present disclosure, the emotional state of each conversation partner may be analyzed based on the conversation message, and the emotional state of each conversation partner may be automatically displayed in the chat room based on the analysis result. Accordingly, the emotional state of the conversation partner can be reflected and displayed in real time without manual manipulation by the user.

According to some embodiments of the present disclosure, the emotional state of each conversation partner can be more accurately determined based on the conversation messages included in the group chat room and the conversation messages included in the personal chat room.

According to some embodiments of the present disclosure, visualization information related to the emotional state is output to the chat room, so that the user can intuitively determine the emotional state of the conversation partner.

According to some embodiments of the present disclosure, various functions such as emotional relationship information between a user and a plurality of conversation partners, expression of emotional states within a chat room, etc. are provided, thereby improving user satisfaction with the instant messaging service.

The effects of the present disclosure are not limited to the effects mentioned above, and other effects not mentioned are clear to a person skilled in the art (referred to as a ‘person skilled in the art’) in the technical field to which this disclosure pertains from the description of the claims. It will be understandable.

Embodiments of the present disclosure will be described with reference to the accompanying drawings described below, in which like reference numerals represent like elements, but are not limited thereto.
1 is a diagram illustrating an example of a group chat room screen displaying an emotional state, according to an embodiment of the present disclosure.
Figure 2 is a schematic diagram showing a configuration in which an information processing system according to an embodiment of the present disclosure is connected to communicate with a plurality of user terminals.
Figure 3 is a block diagram showing the internal configuration of a user terminal and an information processing system according to an embodiment of the present disclosure.
Figure 4 is a block diagram showing the internal configuration of a processor of a user terminal according to an embodiment of the present disclosure.
Figure 5 is a diagram illustrating an example of a personal chat room screen including an emotional state.
Figure 6 is a diagram showing another example of a personal chat room in which emotional states are displayed.
Figure 7 is a diagram illustrating an example of a group chat room screen where emotional states are displayed.
Figure 8 is a diagram illustrating emotional relationship information according to an embodiment of the present disclosure.
Figure 9 is a flowchart for explaining a method of displaying an emotional state for a conversation partner, according to an embodiment of the present disclosure.

Hereinafter, specific details for implementing the present disclosure will be described in detail with reference to the attached drawings. However, in the following description, detailed descriptions of well-known functions or configurations will be omitted if there is a risk of unnecessarily obscuring the gist of the present disclosure.

In the accompanying drawings, identical or corresponding components are given the same reference numerals. Additionally, in the description of the following embodiments, overlapping descriptions of identical or corresponding components may be omitted. However, even if descriptions of components are omitted, it is not intended that such components are not included in any embodiment.

Advantages and features of the disclosed embodiments and methods for achieving them will become clear by referring to the embodiments described below in conjunction with the accompanying drawings. However, the present disclosure is not limited to the embodiments disclosed below and may be implemented in various different forms. The present embodiments are merely provided to ensure that the present disclosure is complete and that the present disclosure does not convey the scope of the invention to those skilled in the art. It is provided only for complete information.

Terms used in this specification will be briefly described, and the disclosed embodiments will be described in detail. The terms used in this specification are general terms that are currently widely used as much as possible while considering the function in the present disclosure, but this may vary depending on the intention or precedent of a technician working in the related field, the emergence of new technology, etc. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the relevant invention. Accordingly, the terms used in this disclosure should be defined based on the meaning of the term and the overall content of the present disclosure, rather than simply the name of the term.

In this specification, singular expressions include plural expressions, unless the context clearly specifies the singular. Additionally, plural expressions include singular expressions, unless the context clearly specifies plural expressions. When it is said that a certain part includes a certain element throughout the specification, this does not mean excluding other elements, but may further include other elements, unless specifically stated to the contrary.

Additionally, the term 'module' or 'unit' used in the specification refers to a software or hardware component, and the 'module' or 'unit' performs certain roles. However, 'module' or 'unit' is not limited to software or hardware. A 'module' or 'unit' may be configured to reside on an addressable storage medium and may be configured to run on one or more processors. Thus, as an example, a 'module' or 'part' refers to components such as software components, object-oriented software components, class components and task components, processes, functions and properties. , procedures, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, or variables. Components and 'modules' or 'parts' may be combined into smaller components and 'modules' or 'parts' or further components and 'modules' or 'parts'. Could be further separated.

According to an embodiment of the present disclosure, a 'module' or 'unit' may be implemented with a processor and memory. 'Processor' should be interpreted broadly to include general-purpose processors, central processing units (CPUs), microprocessors, digital signal processors (DSPs), controllers, microcontrollers, state machines, etc. In some contexts, 'processor' may refer to an application-specific integrated circuit (ASIC), programmable logic device (PLD), field programmable gate array (FPGA), etc. 'Processor' refers to a combination of processing devices, for example, a combination of a DSP and a microprocessor, a combination of a plurality of microprocessors, a combination of one or more microprocessors in combination with a DSP core, or any other such combination of configurations. You may. Additionally, 'memory' should be interpreted broadly to include any electronic component capable of storing electronic information. 'Memory' refers to random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), programmable read-only memory (PROM), erasable-programmable read-only memory (EPROM), May also refer to various types of processor-readable media, such as electrically erasable PROM (EEPROM), flash memory, magnetic or optical data storage, registers, etc. A memory is said to be in electronic communication with a processor if the processor can read information from and/or write information to the memory. The memory integrated into the processor is in electronic communication with the processor.

In the present disclosure, 'system' may include at least one of a server device and a cloud device, but is not limited thereto. For example, a system may consist of one or more server devices. As another example, a system may consist of one or more cloud devices. As another example, the system may be operated with a server device and a cloud device configured together.

In addition, terms such as first, second, A, B, (a), (b) used in the following embodiments are only used to distinguish one component from another component, and the terms The nature, sequence, or order of the relevant components are not limited.

Additionally, in the following embodiments, when a component is described as being 'connected', 'coupled' or 'connected' to another component, the component may be directly connected or connected to the other component. , it should be understood that another component may be 'connected', 'combined', or 'connected' between each component.

In the present disclosure, 'each of the plurality of A' may refer to each of all components included in the plurality of A, or may refer to each of some components included in the plurality of A.

In addition, as used in the following embodiments, 'comprises' and/or 'comprising' means that the mentioned component, step, operation, and/or element includes one or more other components, steps, or operations. and/or the presence or addition of elements.

Before describing various embodiments of the present disclosure, the terms used will be explained.

In embodiments of the present disclosure, 'emotional state' is state information related to the user's emotions and may include, for example, joy, joy, depression, happiness, anger, sadness, etc. Additionally, each emotional state may be associated with different visualization information. For example, a first emotional state may be associated with first visualization information, and a second emotional state may be associated with second visualization information.

In embodiments of the present disclosure, 'visualization information' may be information displayed on the screen including graphic elements. For example, visualization information may include graphic elements with a specific color, graphic objects such as emoticons, graphic objects output in animation form, etc. Visualization information may be displayed in a predetermined area within the chat room. Here, the predetermined area is an area where visualization information is displayed and may be preset as a pixel range. For example, a predetermined area may be associated with an area where a profile is output.

In embodiments of the present disclosure, a 'mention message' may be a conversation message that points to another user belonging to the same chat room. For example, a mention message may be a conversation message that points to a user registered in an instant messaging application by combining a tag (eg, @) with the user's name.

In embodiments of the present disclosure, a 'response message' may be a response message to a specific conversation message. For example, when a first conversation message is included in a chat room and a second conversation message is entered into the chat room in response to the first conversation message, the second conversation message may act as a response message to the first conversation message. You can.

In embodiments of the present disclosure, the 'private chat room' may be a 1:1 chat room in which two users participate.

In embodiments of the present disclosure, a 'group chat room' may be a chat room in which three or more users participate.

Hereinafter, various embodiments of the present disclosure will be described in detail with reference to the attached drawings.

FIG. 1 is a diagram illustrating an example of a group chat room screen 120 on which an emotional state is displayed, according to an embodiment of the present disclosure. According to one embodiment, while exchanging conversation messages through an instant messaging application, the user terminal 110 displays visualization information 132 associated with the emotional states of the conversation partners (Brown, Sally, and Cony) about the user (James). , 142, 152) can be displayed in the chat room.

The emotional state of each conversation partner can be determined based on the conversation messages 130, 140, and 150 included in group chat room A. As illustrated in the group chat room screen 120 of FIG. 1, based on the conversation messages 130, 140, and 150 for each conversation partner (Brown, Sally, and Cony), each conversation partner (Brown, Sally and Cony's emotional states can be determined. For example, based on the keyword 'feel good' included in the conversation message 130 of user Brown, the emotional state of user Brown is determined to be 'pleasure', and the first visualization information 132 associated with 'pleasure' is displayed in the chat room. It can be displayed in . As another example, based on the keyword 'happy' included in the Sally user's conversation message 140, the emotional state of the Sally user is determined to be 'happy', and the second visualization information 142 associated with 'happiness' is displayed. It can be displayed in chat rooms. As another example, based on the keyword 'depressed' included in the conversation message 150 of the Cony user, the emotional state of the Cony user is determined to be 'depressed', and third visualization information 152 associated with 'depression' may be displayed in the chat room. Here, '@James' may indicate that the conversation message 150 written by user Cony is a mention message that points to user James.

Each visualization information 132, 142, and 152 may be displayed in association with the corresponding user's profile. For example, each visualization information 132, 142, and 152 may be displayed in the lower right corner of the profile photo thumbnail of the corresponding user. Alternatively, each visualization information 132, 142, 152 may be displayed in an area other than the profile.

Additionally or alternatively, the emotional state of each of the conversation partners may be determined based on conversation messages included in the personal chat room. Here, the personal chat room may be a chat room in which the user and one conversation partner participate. According to one embodiment, when a specific conversation partner participates in both a personal chat room and a group chat room, the user terminal 110 creates a specific conversation for the user based on the conversation message included in the personal chat room and the conversation message included in the group chat room. You can determine the emotional state of the other person. Additionally, the user terminal 110 may determine the user's emotional state toward a specific conversation partner based on the conversation message included in the personal chat room and the conversation message included in the group chat room.

With this configuration, the emotional state of the conversation partner can be determined without separate manipulation by the user, and visualization information related to the emotional state can be displayed in the chat room. Accordingly, the user can intuitively determine the emotional state of the conversation partner toward the user.

Figure 2 is a schematic diagram showing a configuration in which the information processing system 230 according to an embodiment of the present disclosure is connected to communicate with a plurality of user terminals 210_1, 210_2, and 210_3. As shown, a plurality of user terminals 210_1, 210_2, and 210_3 may be connected to an information processing system 230 that can provide an instant messaging service through a network 220. Here, the plurality of user terminals 210_1, 210_2, and 210_3 may include terminals of users receiving an instant messaging service.

In one embodiment, information processing system 230 may include one or more server devices and/or databases capable of storing, providing, and executing computer-executable programs (e.g., downloadable applications) and data associated with providing instant messaging services, etc. Alternatively, it may include one or more distributed computing devices and/or distributed databases based on cloud computing services.

The instant messaging service provided by the information processing system 230 may be provided to users through an instant messaging application installed on each of a plurality of user terminals 210_1, 210_2, and 210_3. For example, the information processing system 230 may transmit information received from the user terminals 210_1, 210_2, and 210_3 to a designated purpose (i.e., the conversation partner's terminal) through an instant messaging application or the like. Additionally, the information processing system 230 may store and manage emotional relationship information (see FIG. 8) including emotional states for each user and conversation partner.

A plurality of user terminals 210_1, 210_2, and 210_3 may communicate with the information processing system 230 through the network 220. The network 220 may be configured to enable communication between a plurality of user terminals 210_1, 210_2, and 210_3 and the information processing system 230. Depending on the installation environment, the network 220 may be, for example, a wired network such as Ethernet, a wired home network (Power Line Communication), a telephone line communication device, and RS-serial communication, a mobile communication network, a wireless LAN (WLAN), It may consist of wireless networks such as Wi-Fi, Bluetooth, and ZigBee, or a combination thereof. The communication method is not limited, and may include communication methods utilizing communication networks that the network 220 may include (e.g., mobile communication networks, wired Internet, wireless Internet, broadcasting networks, satellite networks, etc.) as well as user terminals (210_1, 210_2, 210_3). ) may also include short-range wireless communication between

In Figure 2, the mobile phone terminal (210_1), tablet terminal (210_2), and PC terminal (210_3) are shown as examples of user terminals, but they are not limited thereto, and the user terminals (210_1, 210_2, 210_3) use wired and/or wireless communication. This can be any computing device capable of installing and executing an instant messaging application or a web browser. For example, user terminals include AI speakers, smartphones, mobile phones, navigation, computers, laptops, digital broadcasting terminals, PDAs (Personal Digital Assistants), PMPs (Portable Multimedia Players), tablet PCs, game consoles, It may include wearable devices, IoT (internet of things) devices, VR (virtual reality) devices, AR (augmented reality) devices, set-top boxes, etc. In addition, in Figure 2, three user terminals (210_1, 210_2, 210_3) are shown as communicating with the information processing system 230 through the network 220, but this is not limited to this, and a different number of user terminals are connected to the network ( It may be configured to communicate with the information processing system 230 through 220).

In one embodiment, the information processing system 230 may store and manage emotional relationship information including the emotional state of each conversation partner. The information processing system 230 may receive the user's emotional relationship information from the user terminals 210_1, 210_2, and 210_3. Here, the emotional relationship information may include bidirectional emotional states between various users. The two-way emotional state may include a first-direction emotional state that the user feels toward the conversation partner and a second-direction emotional state that the conversation partner feels toward the user.

The information processing system 230 may generate or update emotional state information including bidirectional emotional states between each user based on the emotional states between a specific user and a plurality of conversation partners. The information processing system 230 may provide emotional state information to the user terminals 210_1, 210_2, and 210_3.

Figure 3 is a block diagram showing the internal configuration of the user terminal 210 and the information processing system 230 according to an embodiment of the present disclosure. The user terminal 210 may refer to any computing device capable of executing an instant messaging application, etc. and capable of wired/wireless communication, for example, the mobile phone terminal 210_1, tablet terminal 210_2, and PC in FIG. 2. It may include a terminal 210_3, etc. As shown, the user terminal 210 may include a memory 312, a processor 314, a communication module 316, and an input/output interface 318. Similarly, information processing system 230 may include memory 332, processor 334, communication module 336, and input/output interface 338. As shown in FIG. 3, the user terminal 210 and the information processing system 230 are configured to communicate information and/or data through the network 220 using respective communication modules 316 and 336. It can be. Additionally, the input/output device 320 may be configured to input information and/or data to the user terminal 210 through the input/output interface 318 or to output information and/or data generated from the user terminal 210.

Memories 312 and 332 may include any non-transitory computer-readable recording medium. According to one embodiment, the memories 312 and 332 are non-permanent mass storage devices such as read only memory (ROM), disk drive, solid state drive (SSD), flash memory, etc. It can be included. As another example, non-perishable mass storage devices such as ROM, SSD, flash memory, disk drive, etc. may be included in the user terminal 210 or the information processing system 230 as a separate persistent storage device that is distinct from memory. Additionally, the memories 312 and 332 may store an operating system and at least one program code (for example, code for an instant messaging application installed and running on the user terminal 210).

These software components may be loaded from a computer-readable recording medium separate from the memories 312 and 332. This separate computer-readable recording medium may include a recording medium directly connectable to the user terminal 210 and the information processing system 230, for example, a floppy drive, disk, tape, DVD/CD- It may include computer-readable recording media such as ROM drives and memory cards. As another example, software components may be loaded into the memories 312 and 332 through a communication module rather than a computer-readable recording medium. For example, at least one program is loaded into memory 312, 332 based on a computer program installed by files provided over the network 220 by developers or a file distribution system that distributes installation files for applications. It can be.

The processors 314 and 334 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input/output operations. Instructions may be provided to the processors 314 and 334 by memories 312 and 332 or communication modules 316 and 336. For example, the processors 314 and 334 may be configured to execute instructions received according to program codes stored in a recording device such as the memory 312 and 332.

The communication modules 316 and 336 may provide a configuration or function for the user terminal 210 and the information processing system 230 to communicate with each other through the network 220, and may provide a configuration or function for the user terminal 210 and/or information processing. The system 230 may provide a configuration or function for communicating with other user terminals or other systems (for example, a separate cloud system, etc.). For example, a request or data (e.g., emotional relationship information, conversation message, etc.) generated by the processor 314 of the user terminal 210 according to a program code stored in a recording device such as the memory 312 is transmitted to the communication module ( It may be transmitted to the information processing system 230 through the network 220 under the control of 316). Conversely, a control signal or command provided under the control of the processor 334 of the information processing system 230 is transmitted through the communication module 316 of the user terminal 210 through the communication module 336 and the network 220. It may be received by the user terminal 210. For example, the user terminal 210 may receive conversation messages, emotional relationship information, etc. from the information processing system 230.

The input/output interface 318 may be a means for interfacing with the input/output device 320. As an example, input devices may include devices such as cameras, keyboards, microphones, mice, etc., including audio sensors and/or image sensors, and output devices may include devices such as displays, speakers, haptic feedback devices, etc. You can. As another example, the input/output interface 318 may be a means for interfacing with a device that has components or functions for performing input and output, such as a touch screen, integrated into one. For example, the processor 314 of the user terminal 210 uses information and/or data provided by the information processing system 230 or another user terminal when processing instructions of a computer program loaded in the memory 312. A service screen, etc. constructed by doing so may be displayed on the display through the input/output interface 318. In FIG. 3 , the input/output device 320 is shown not to be included in the user terminal 210, but the present invention is not limited to this and may be configured as a single device with the user terminal 210. Additionally, the input/output interface 338 of the information processing system 230 may be connected to the information processing system 230 or means for interfacing with a device (not shown) for input or output that the information processing system 230 may include. It can be. In FIG. 3, the input/output interfaces 318 and 338 are shown as elements configured separately from the processors 314 and 334, but the present invention is not limited thereto, and the input/output interfaces 318 and 338 may be configured to be included in the processors 314 and 334. there is.

The user terminal 210 and information processing system 230 may include more components than those in FIG. 3 . However, there is no need to clearly show most prior art components. According to one embodiment, the user terminal 210 may be implemented to include at least some of the input/output devices 320 described above. Additionally, the user terminal 210 may further include other components such as a transceiver, a global positioning system (GPS) module, a camera, various sensors, and a database. For example, if the user terminal 210 is a smartphone, it may include components generally included in a smartphone, such as an acceleration sensor, a gyro sensor, an image sensor, a proximity sensor, a touch sensor, Various components such as an illuminance sensor, a camera module, various physical buttons, buttons using a touch panel, input/output ports, and a vibrator for vibration may be implemented to be further included in the user terminal 210.

While a program for an instant messaging application or the like that provides the function of displaying the emotional state of a conversation partner is running, the processor 314 includes a touch screen, keyboard, audio sensor, and/or image sensor connected to the input/output interface 318. Text, images, videos, voices, and/or actions input or selected can be received through input devices such as cameras and microphones, and the received text, images, videos, voices, and/or actions, etc., can be stored in the memory 312. It can be stored or provided to the information processing system 230 through the communication module 316 and network 220. For example, the processor 314 receives an input from a user requesting to transmit a conversation message while a chat room containing an emotional state is output, and sends the information processing system ( 230).

The processor 314 of the user terminal 210 manages, processes, and/or stores information and/or data received from the input/output device 320, other user terminals, the information processing system 230, and/or a plurality of external systems. It can be configured to do so. Information and/or data processed by processor 314 may be provided to information processing system 230 via communication module 316 and network 220. The processor 314 of the user terminal 210 may transmit information and/or data to the input/output device 320 through the input/output interface 318 and output the information. For example, the processor 314 may display the received information and/or data on the screen of the user terminal 210.

The processor 334 of the information processing system 230 may be configured to manage, process, and/or store information and/or data received from a plurality of user terminals 210 and/or a plurality of external systems. Information and/or data processed by the processor 334 may be provided to the user terminal 210 through the communication module 336 and the network 220.

Figure 4 is a block diagram showing the internal configuration of the processor 314 of the user terminal according to an embodiment of the present disclosure. As shown, the processor 314 may include a message extraction unit 410, an emotion analysis unit 420, and an emotional state output unit 430.

The message extractor 410 may extract conversation messages included in at least one chat room. According to one embodiment, the message extractor 410 may extract a conversation message of a conversation partner included in at least one of a personal chat room or a group chat room. For example, the message extraction unit 410 extracts a conversation message between a user included in at least one chat room among a personal chat room in which the first conversation partner is participating or a group chat room in which the first conversation partner is participating and the first conversation partner. You can.

According to one embodiment, the message extractor 410 may extract conversation messages that occurred from a predetermined time n hours ago to the current time. Accordingly, the message extractor 410 can extract a plurality of conversation messages depending on the situation. According to some embodiments, the message extractor 410 may extract m (where m is a natural number) recently entered conversation messages from the chat room. The conversation message extracted by the message extractor 410 can be used to determine the emotional state of the user or the conversation partner.

The emotion analysis unit 420 may analyze at least one conversation message to determine the user's emotional state toward the conversation partner and/or the conversation partner's emotional state toward the user. According to one embodiment, the emotion analysis unit 420 may use an emotion reference table in which emotion keywords are recorded to analyze emotions.

[Table 1] below is a diagram showing an example of an emotion reference table.

keyword Emoticon ID joy keyword1, keyword2, keyword3, … emoticon1, emoticon2, emoticon3, … happiness keyword11, keyword12, keyword13, … emoticon11, emoticon12, emoticon13, … sadness keyword21, keyword22, keyword23, … emoticon21, emoticon22, emoticon23, … fury keyword31, keyword32, keyword33, … emoticon31, emoticon32, emoticon33, … …

As illustrated in Table 1, keywords associated with each emotion may be recorded in the emotion reference table, and identification information of emoticons associated with each emotion may be recorded in the emotion table.

According to one embodiment, the emotion analysis unit 420 may calculate the number of keywords for each emotion included in the conversation message by comparing text included in the conversation message with keywords included in the emotion reference table. Additionally, the emotion analysis unit 420 may calculate the number of emoticons for each emotion included in the conversation message by comparing the emoticon included in the conversation message with the emoticon included in the emotion reference table. The emotion analysis unit 420 may determine the emotional state based on the number of keywords and emoticons for each emotion. The emotion analysis unit 420 applies different or the same weights to each of the keyword count and the emoticon count, adds up the weighted counts, and selects the emotion with the largest number among the summed counts as the emotion of the user or the conversation partner. It can be determined that it is in a state. Alternatively, the emotion analysis unit 420 may determine the emotional state based on the conversation message using a machine learning model without using an emotion reference table.

According to one embodiment, the emotion analysis unit 420 sets at least one conversation message written by the user as a first conversation message group among conversation messages extracted from a personal chat room/group chat room in which the user and the conversation partner participate, At least one conversation message written by the conversation partner can be set as the second conversation message group. In this case, the emotion analysis unit 420 compares the text/emoticon included in the first conversation message group with the keyword/emoticon included in the emotion reference table to calculate the number of keywords/emoticons for each emotion for the first group. , the user's emotional state toward the conversation partner can be determined based on the calculated number of keywords/emoticons. In addition, the emotion analysis unit 420 compares the text/emoticon included in the second conversation message group with the keyword/emoticon included in the emotion reference table to calculate the number of keywords/emoticons for each emotion for the second group, Based on the calculated number of keyword/emoticon extractions, the emotional state of the conversation partner toward the user can be determined.

Meanwhile, the conversation partner may be participating in a group chat room or a personal chat room. In this case, the message extractor 410 may extract the first set of conversation messages performed between the conversation partner and the user in the group chat room. Additionally, the message extractor 410 may extract a second set of conversation messages performed between the user and the conversation partner included in the personal chat room.

According to one embodiment, the message extractor 410 may extract conversation messages written by a user and conversation messages written by a conversation partner from among conversation messages included in a group chat room. In addition, the message extractor 410 may extract conversation messages performed between the user and the conversation partner as the first set of conversation messages from among the extracted conversation messages. At this time, the message extraction unit 410 selects a message in which the name of the user or the conversation partner is recorded, a mention message for the user/the conversation partner, and a response message for the user/the conversation partner among the extracted conversation messages as the first set of conversation messages. It can be extracted as.

In one embodiment, the emotion analysis unit 420 may determine the user's emotional state toward the other party and/or the emotional state of the conversation partner toward the user, based on the first set of conversation messages extracted from the group chat room. Additionally, the emotion analysis unit 420 may determine the user's emotional state toward the other party and/or the emotional state of the conversation partner toward the user, based on the second set of conversation messages extracted from the personal chat room.

In one embodiment, the emotion analysis unit 420 may determine whether the first emotional state determined based on the first set of conversation messages and the second emotional state determined based on the second set of conversation messages do not match, If the two emotional states match, the matched emotional state can be determined to be the emotional state of the user and/or the conversation partner. On the other hand, when the first emotional state and the second emotional state do not match, the emotion analysis unit 420 may determine the high priority emotional state as the emotional state of the user or the conversation partner. The user can set which of the emotional states in a personal chat room or the emotional state in a group chat room to give priority. Alternatively, the emotion analysis unit 420 may determine the final emotional state by applying a first weight to the first emotional state and a second weight to the second emotional state. Here, the second weight is greater than the first weight, so a higher weight can be applied to the emotions in the personal chat room.

In some embodiments, the emotion analysis unit 420 applies different weights to each of the number of emotions calculated based on the first set of conversation messages and the number of emotions calculated based on the second set of conversation messages, Among the number of times each emotion is added by applying each weight, the emotion with the highest number of times can be determined as the emotional state of the user or the conversation partner. For example, a first weight may be applied to the number of emotions for each emotion calculated based on the first set of conversation messages, and a second weight may be applied to the number of emotions for each emotion calculated based on the second set of conversation messages. At this time, the second weight is greater than the first weight, so a higher weight can be applied to the emotions in the personal chat room.

According to one embodiment, the emotion analysis unit 420 may determine the emotional state of the user and/or the conversation partner at regular intervals or in real time. Here, determining the emotional state in real time may mean that the emotional state of the user or the conversation partner is re-analyzed by triggering the creation of a new conversation message by the user or the conversation partner. If the previous emotional state is different from the current emotional state, the emotional state of the user or the conversation partner may be updated to the current emotional state. The updated emotional state may be output to the chat room by the emotional state output unit 430. In some embodiments, the emotion analysis unit 420 may transmit the bidirectional emotional state between the user and the conversation partner to an external device (eg, an information processing system).

If the emotional state is set to be determined at regular periodic intervals instead of being determined in real time, the determination cycle of the emotional state may be determined based on time or the number of occurrences of a new conversation message. For example, the emotion analysis unit 420 determines the user's emotional state and/or It is possible to determine the emotional state of the conversation partner toward the user. As another example, when a predetermined number of new conversation messages created by the user and/or the conversation partner are accumulated, the user's emotional state toward the conversation partner and/or the conversation partner's feelings toward the user based on the accumulated new conversation messages. status can be determined. That is, at the point when more than a predetermined number of conversation messages occur between the user and the conversation partner, a process for determining the emotional state may be performed.

The user's emotional state toward the conversation partner (or the conversation partner's emotional state toward the user), which is determined by being performed at regular intervals or in real time, may be different from the previous emotional state. In this case, the emotional state is updated, and the updated emotional state can be output to the chat room by the emotional state output unit 430. The updated emotional state may be output in association with the user's profile (or the conversation partner's profile) output in the corresponding cycle.

For example, when the emotional state of the conversation partner with respect to the user is determined to be a first emotional state based on at least one conversation message extracted during the first period, based on the at least one conversation message extracted during the second period It can be assumed that the emotional state of the conversation partner with respect to the user changes to the second emotional state. In this case, the emotional state output unit 430 outputs visualization information representing the first emotional state in association with the profile of the conversation partner output during the first cycle, and displays visualization information representing the first emotional state in association with the profile of the conversation partner output during the second cycle. 2 Visualization information representing emotional states can be output. As illustrated in FIGS. 1 and 5 to 7, the user profile may be output to the chat room along with the chat message, and the emotional state output unit 430 displays the emotional state of the conversation partner (or user) determined in a specific period. The displayed visualization information can be output in association with the conversation partner's profile (or user profile) output at a specific cycle. When the emotional state is output in association with the profile of each cycle in this way, the change trend in the emotional state of the user and/or the conversation partner can be confirmed.

The emotional state output unit 430 may output the emotional state of the user and/or the conversation partner to the chat room. According to one embodiment, the emotional state output unit 430 may obtain first visualization information related to the user's emotional state and output the first visualization information to the chat room. At this time, the emotional state output unit 430 may display first visualization information in association with the user's profile. Here, displaying the first visualization information in relation to the profile may mean that the first visualization information is displayed at least one of inside the profile (or profile photo thumbnail) or around the profile. Additionally, the emotional state output unit 430 may obtain second visualization information related to the emotional state of the conversation partner and output the second visualization information to the chat room. At this time, the emotional state output unit 430 may display second visualization information in association with the profile of the conversation partner.

According to one embodiment, the emotional state output unit 430 receives a request input for emotional relationship information and, in response, provides emotional relationship information (see FIG. 8) including bidirectional emotional states between the user and the conversation partners. Can be printed. A specific example of how emotional relationship information is output will be described later with reference to FIG. 8 .

FIG. 5 is a diagram illustrating an example of a personal chat room screen 500 including emotional states 512 and 522. Figure 5 illustrates a personal chat room screen 500 in which a user and a chat partner with the name Brown participate. As illustrated in Figure 5, as the conversation message 510 written by Brown, the conversation partner, includes 'angry', a keyword related to anger, Brown's emotional state toward the user is 'angry'. ', and visualization information 512 related to 'anger' may be displayed in connection with Brown's profile.

In addition, as the conversation message 520 written by the user includes 'angry', a keyword related to anger, the user's emotional state toward Brown, the conversation partner, is determined to be 'angry', and ' Visualization information 522 related to 'anger' may be displayed in association with the user's profile.

In Figure 5, the emotional states of the user and the conversation partner are each determined based on one message, but the present invention is not limited to this. For example, the emotional state of a conversation partner (Brown) toward a user can be determined by multiple conversation messages entered by the conversation partner (Brown) in a private chat room that includes the user and the conversation partner (Brown), and/or the user and the conversation partner (Brown). ) may be determined based on a plurality of conversation messages written for the user by the conversation partner (Brown) in at least one group chat room included. Similarly, the user's emotional state toward the conversation partner (Brown) can be determined by multiple conversation messages entered by the user in a private chat room that includes the user and the conversation partner (Brown), and/or the user's emotional state toward the conversation partner (Brown). It may be determined based on a plurality of conversation messages written by the user to the conversation partner (Brown) in at least one group chat room.

FIG. 6 is a diagram illustrating another example of a personal chat room screen 600 on which an emotional state is displayed. Figure 6 illustrates a personal chat room screen 600 in which a user and a conversation partner named Sally participate. As illustrated in Figure 6, as the conversation message 610 written by Sally, the conversation partner, includes 'happy', a keyword related to happiness, Sally's emotional state toward the user is determined to be 'happy', and 'happy' ' and the associated visualization information 612 may be displayed in association with Sally's profile.

In addition, as the conversation message 620 written by the user includes 'happy', a keyword related to happiness, the user's emotional state toward Sally, the conversation partner, is determined to be 'happy', and visualization information associated with 'happiness' ( 622) may be displayed in association with the user's profile.

FIG. 7 is a diagram illustrating an example of a group chat room screen 700 on which an emotional state is displayed. As illustrated in Figure 7, multiple conversation partners and users are participating in group chat room B. The group chat room screen 700 may display the emotional states 710, 720, 730, 740, 770 of each conversation partner and the emotional states 750, 760 of the user.

As illustrated in FIG. 7 , keywords related to emotions may not be extracted from the conversation message “Hello” written by Brown, the first conversation partner, in group chat room B. In this case, Brown's emotional state (e.g., angry) toward the user is determined based on the conversation message included in the personal chat room (e.g., the chat room in FIG. 5) in which Brown and the user participated, and Brown's emotional state toward the user (e.g., angry) For example, visualization information 710 associated with Tuesday may be displayed in association with Brown's profile. Brown's emotional state toward the user is determined by chat messages entered by Brown in a private chat room containing the user and Brown, and/or by Brown interacting with the user in at least one group chat room containing the user and Brown together (including group chat room B). It may be determined based on the conversation message written for the target. For example, the number of emotion-related keywords/emoticons calculated from the personal chat room and/or group chat room in which the user and Brown participate may be used to determine Brown's emotional state toward the user. Here, the number of keywords/emoticons can be calculated based on at least one conversation message written by Brown for the user.

In addition, 'happy' is extracted as a keyword related to the happiness emotion in the conversation message written by Sally, the second conversation partner, in group chat room B, and accordingly, Sally's emotional state toward the user can be determined to be 'happy'. Additionally, visualization information 720 related to Sally's emotional state (i.e., happiness) toward the user may be displayed in association with Sally's profile. Sally's emotional state toward the user is determined by conversation messages entered by Sally in a private chat room that includes the user and Sally, and/or by Sally interacting with the user in at least one group chat room that includes the user and Sally (including group chat room B). It may be determined based on the conversation message written for the target. For example, the number of emotion-related keywords/emoticons calculated from the personal chat room and/or group chat room in which the user and Sally participate may be used to determine Sally's emotional state toward the user. Here, the number of keywords/emoticons can be calculated based on at least one conversation message written by Sally for the user.

In the conversation message written by Cony, the third conversation partner, in group chat room B, 'depressed' is extracted as a keyword related to emotion, and Cony's emotional state toward the user can be determined to be 'depression'. Additionally, visualization information 730 related to Cony's emotional state (i.e., depression) toward the user may be displayed in association with Cony's profile. Cony's emotional state toward the user is determined by a conversation message entered by Cony in a personal chat room containing the user and Cony and/or by Cony interacting with the user in at least one group chat room containing the user and Cony (including group chat room B). It may be determined based on the conversation message written for the target. For example, the number of emotion-related keywords/emoticons calculated from the personal chat room and/or group chat room in which the user and Cony participate can be used to determine Cony's emotional state toward the user. Here, the number of keywords/emoticons can be calculated based on at least one conversation message written by Cony for the user.

Keywords related to emotions may not be extracted from the conversation message (“Hello”) written by Choco, the fourth conversation partner, in group chat room B. Additionally, a personal chat room in which Choco and the user participate may not be opened, or a personal chat room in which Choco and the user participate may be opened, but keywords and emoticons related to emotions may not be extracted from this private chat room. In this case, Choco's emotional state is determined to be 'no emotion', and visualization information 740 related to 'no emotion' may be displayed in association with Choco's profile. Here, the visualization information 740 related to ‘no emotion’ may include graphic elements related to expressionless expression. Alternatively, in the case of Choco, the visualization information 740 may not be displayed.

Users can also enter a chat message (“Hello”) in group chat room B. As illustrated in Figure 7, the user's conversation message ("Hello") entered into group chat room B did not specify the conversation partner, and in addition, the conversation message ("Hello") did not contain keywords and emoticons related to emotions. Therefore, the user's emotional state at the time of entering the "hello" conversation message may be determined as 'no emotion'. Accordingly, at the point when the “hello” conversation message is input, visualization information 750 related to ‘no emotions’ may be displayed in association with the user profile. Alternatively, visualization information 750 may not be displayed.

As illustrated in Figure 7, the user can write a response message 762 to the conversation message written by Sally. Since the response message indicates that the user has specified Sally as the conversation partner, the user's emotional state toward Sally may be determined based on the user's emotional state in the personal chat room in which Sally and the user participated (eg, the chat room in FIG. 6). At this time, when emotion-related keywords/emoticons are extracted from the response message, the user's emotional state toward Sally can be determined by using the emotion-related keywords/emoticons and the user's emotional state extracted from the personal chat room.

In Figure 7, the user's emotional state toward Sally is determined to be 'happiness', and visualization information 760 related to 'happiness' is displayed in association with the user's profile. Comparing reference numerals 750 and 760, it can be seen that the visualization information related to the user's emotional state changes. That is, when the conversation partner being pointed out or responded to in a group chat room changes, the emotional state associated with the user profile may also change based on the emotional state associated with this conversation partner.

Meanwhile, the conversation partner can input an additional conversation message. As illustrated in FIG. 7, Choco, the fourth conversation partner, can write a mention message 772 naming James. Here, James may be a user name. The corresponding mention message 772 includes the emotion-related keyword 'angry', and accordingly, Choco's emotional state toward the user may be determined to be 'angry'. Accordingly, at the time the mention message 772 is written, visualization information 770 related to 'anger' may be displayed in association with the Choco profile.

According to one embodiment, even if a tag (e.g., @) related to the mention message is not included in the conversation message, if the conversation message includes a specific user name, the user terminal determines that the conversation message is a mention message pointing to a specific user. It can be determined that For example, if Choco enters a chat message like "What's wrong James? You're so mad," this chat message contains the username 'James' even though it does not contain any tags (e.g. @) associated with the mention message. , the user terminal may determine that the conversation message is a mention message pointing to James. In addition, the conversation message includes the emotion-related keyword 'angry', and accordingly, Choco's emotional state toward the user may be determined to be 'angry'.

As illustrated in reference numerals 740 and 770, it can be intuitively recognized that Choco's emotional state is changing from 'no emotion' to 'anger'. When new conversation messages are transmitted and received between conversation partners and the user, the emotional state of the user may change, and the emotional states of each conversation partner may also change. When the emotional state changes, visualization information related to this may be output in association with the profile.

In some embodiments, a representative chat room may be established. Here, the representative chat room can be understood as a chat room representing an emotional state. The representative chat room can be set by the user. When a representative chat room is set up, the user's emotional state is determined based on the conversation message included in the representative chat room, and the determined user's emotional state can be propagated to other chat rooms. In other words, if the user's emotional state in the representative chat room is 'happy', the user's emotional state is determined to be 'happy' in other chat rooms, and visualization information related to happiness can be displayed in both the representative chat room and other chat rooms. .

Meanwhile, the group chat room may include a menu/icon 780 related to emotional relationship information. When a user touches or clicks the corresponding menu/icon 780, emotional relationship information including bidirectional emotional states between all users included in the group chat room may be output. This will be described later in Figure 8.

FIG. 8 is a diagram illustrating emotional relationship information 800 according to an embodiment of the present disclosure. When a menu/icon related to emotional relationship information included in a group chat room is touched or selected, emotional relationship information 800 as shown in FIG. 8 may be output. As illustrated in FIG. 8 , emotional relationship information 800 may include visualization information 812 to 828 associated with emotional states so that users can intuitively check them.

As illustrated in FIG. 8 , the two-way emotional state between conversation partners participating in a group chat room based on the user (me) may be included in the emotional relationship information 800. Looking at the two-way emotional state between the user and Brown, the emotional state that the user feels toward Brown is 'angry' (812), and the emotional state that Brown also feels toward the user is 'angry' (822). In addition, looking at the two-way emotional state between the user and Sally, the emotional state that the user feels toward Sally is 'happiness' (814), and the emotional state that Sally also feels toward the user is 'happiness' (824).

Looking at the two-way emotional state between the user and Cony, the emotional state that the user feels toward Cony is 'no emotion' (816), and the emotional state that Cony feels toward the user is 'depressed' (826). Looking at the two-way emotional state between the user and Choco, the emotional state that the user feels toward Choco is 'happiness' (818), and the emotional state that Choco feels toward the user is 'no emotion' (828).

This emotional relationship information may be stored in the user terminal. In some embodiments, at least some of the emotional relationship information may be received from an external device (eg, an information processing system). For example, when the user terminal receives an output request for emotional relationship information from the user, it may request emotional relationship information from an external device and receive at least part of the emotional relationship information from the external device in response.

In some embodiments, bidirectional emotional states between conversation partners may be included and output as emotional relationship information. That is, as shown in Figure 8, not only the emotional states between the user and the conversation partners, but also Brown's emotional states for each of Sally, Cony, and Choco, Sally's emotional states for each of Brown, Cony, and Choco, Brown, Sally, and Choco Cony's emotional state for each and Choco's emotional state for each of Brown, Sally, and Cony may be further included in the emotional relationship information. Bidirectional emotional states between conversation partners can be received from an external device.

FIG. 9 is a flowchart illustrating a method 900 for displaying an emotional state for a conversation partner, according to an embodiment of the present disclosure. The method shown in FIG. 9 is only an example to achieve the purpose of the present disclosure, and of course, some steps may be added or deleted as needed. Additionally, the method shown in FIG. 9 may be performed by at least one processor included in the user terminal shown in FIG. 2. For convenience of explanation, it will be described that each step shown in FIG. 9 is performed by a processor included in the user terminal shown in FIG. 2.

The processor may obtain at least one conversation message performed between the first user and the second user (S910). According to one embodiment, the processor may obtain conversation messages that occurred during a predetermined time from a group chat room and/or a private chat room in which the first user and the second user participated.

Thereafter, the processor may determine the emotional state of the second user with respect to the first user based on the obtained conversation message (S920). According to one embodiment, the processor may determine the emotional state of the second user with respect to the first user based on a conversation message written by the second user among the obtained conversation messages. In one embodiment, the processor extracts at least one keyword and/or emoticon associated with an emotion from the obtained conversation message and determines the second user's emotion with respect to the first user based on the extracted at least one keyword and/or emoticon. status can be determined.

Subsequently, the processor may obtain first visualization information associated with the determined emotional state and display the obtained first visualization information in the chat room (S930).

Additionally or alternatively, the processor may determine, based on the obtained conversation message, the emotional state of the first user with respect to the second user and display second visualization information associated with the determined emotional state in the chat room. At this time, the processor may display the second visualization information in a predetermined area where the emotional state of the first user is expressed. According to one embodiment, the processor may determine the emotional state of the first user with respect to the second user based on a conversation message written by the first user among the obtained conversation messages.

The processor may detect a chat message written by the first user targeting a third user in a chat room in which the first user, the second user, and the third user are participating. When the processor detects a mention message in a chat room in which the first user points to a third user or detects the first user's response message to the third user's conversation message, the processor sends a message written for the third user. 1 It can be determined that the user's conversation message has been detected. In this case, the processor may display third visualization information associated with the emotional state of the first user with respect to the third user in the chat room in response to the detected conversation message. According to one embodiment, the processor may change existing visualization information (eg, second visualization information) into third visualization information in a predetermined area (eg, profile-related area) where the emotional state of the first user is expressed. According to one embodiment, the processor may determine the emotional state of the first user with respect to the third user based on a conversation message between the first user and the third user included in at least one of the chat room or another chat room.

Meanwhile, the chat room in which the first user and the second user are participating may be a group chat room. In this case, the processor obtains a first set of conversation messages written by the second user from a group chat room that includes both the first user and the second user, and the first set of conversation messages included in the personal chat room that includes the first user and the second user. A second set of conversation messages may be obtained. Here, the emotional state of the second user with respect to the first user may be determined based on the first set of conversation messages and the second set of conversation messages. Here, the first set of messages may include messages written by the second user to the first user in a group chat room.

In one embodiment, the processor determines a first emotional state based on the first set of conversation messages, determines a second emotional state based on the second set of conversation messages, and then determines the first emotional state and the second emotion. Based on the state, the emotional state of the second user with respect to the first user may be determined. In this case, the processor determines whether the first emotional state and the second emotional state are the same, and in response to determining that the first emotional state and the second emotional state are different, the processor determines which of the first emotional state and the second emotional state is preferred. The highly ranked emotional state may be determined as the emotional state of the second user with respect to the first user.

In some embodiments, the emotional state of the second user with respect to the first user may be determined by applying a first weight to the first emotional state and a second weight to the second emotional state.

In one embodiment, the processor obtains a third set of conversation messages between a first user and a third user included in a group chat room, and a fourth set of conversation messages included in a personal chat room including the first user and a third user. You can get the message. In addition, the processor determines, based on the third set of conversation messages and the fourth set of conversation messages, the emotional state of the third user with respect to the first user, and the determined emotional state of the third user with respect to the first user is associated with the emotional state of the third user with respect to the first user. Fourth visualization information can be displayed in a group chat room.

Meanwhile, the processor may display emotional relationship information between all users included in the group chat room. Here, the emotional relationship information may include the emotional state of each of the other users with respect to the first user and the emotional state of the first user with respect to each of the other users. According to one embodiment, when receiving an output request for emotional relationship information from a user, the processor may obtain at least part of the emotional relationship information from an external device.

The above flowchart and above description are only examples and may be implemented differently in some embodiments. For example, in some embodiments, the order of each step may be changed, some steps may be performed repeatedly, some steps may be omitted, or some steps may be added.

The above-described method may be provided as a computer program stored on a computer-readable recording medium for execution on a computer. Media may be used to continuously store executable programs on a computer, or to temporarily store them for execution or download. In addition, the medium may be a variety of recording or storage means in the form of a single or several pieces of hardware combined. It is not limited to a medium directly connected to a computer system and may be distributed over a network. Examples of media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and There may be something configured to store program instructions, including ROM, RAM, flash memory, etc. Additionally, examples of other media include recording or storage media managed by app stores that distribute applications, sites that supply or distribute various other software, or servers.

The methods, operations or techniques of this disclosure may be implemented by various means. For example, these techniques may be implemented in hardware, firmware, software, or a combination thereof. Those skilled in the art will understand that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented in electronic hardware, computer software, or combinations of both. To clearly illustrate this interchange of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the specific application and design requirements imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementations should not be interpreted as causing a departure from the scope of the present disclosure.

In a hardware implementation, the processing units used to perform the techniques may include one or more ASICs, DSPs, digital signal processing devices (DSPDs), programmable logic devices (PLDs). ), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, electronic devices, and other electronic units designed to perform the functions described in this disclosure. , a computer, or a combination thereof.

Accordingly, the various illustrative logical blocks, modules, and circuits described in connection with this disclosure may be general-purpose processors, DSPs, ASICs, FPGAs or other programmable logic devices, discrete gate or transistor logic, discrete hardware components, or It may be implemented or performed as any combination of those designed to perform the functions described in. A general-purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, such as a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other configuration.

For firmware and/or software implementations, techniques include random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), and PROM ( on computer-readable media such as programmable read-only memory (EPROM), electrically erasable PROM (EEPROM), flash memory, compact disc (CD), magnetic or optical data storage devices, etc. It may also be implemented as stored instructions. Instructions may be executable by one or more processors and may cause the processor(s) to perform certain aspects of the functionality described in this disclosure.

When implemented in software, the techniques described above may be stored on or transmitted through a computer-readable medium as one or more instructions or code. Computer-readable media includes both computer storage media and communication media, including any medium that facilitates transfer of a computer program from one place to another. Storage media may be any available media that can be accessed by a computer. By way of non-limiting example, such computer readable media may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or the desired program code in the form of instructions or data structures. It can be used to transfer or store data and can include any other media that can be accessed by a computer. Any connection is also properly termed a computer-readable medium.

For example, if the Software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair cable, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave, , fiber optic cable, twisted pair, digital subscriber line, or wireless technologies such as infrared, radio, and microwave are included within the definition of medium. As used herein, disk and disk include CD, laser disk, optical disk, digital versatile disc (DVD), floppy disk, and Blu-ray disk, where disks are usually magnetic. It reproduces data optically, while discs reproduce data optically using lasers. Combinations of the above should also be included within the scope of computer-readable media.

A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known. An exemplary storage medium may be coupled to the processor such that the processor may read information from or write information to the storage medium. Alternatively, the storage medium may be integrated into the processor. The processor and storage media may reside within an ASIC. ASIC may exist within the user terminal. Alternatively, the processor and storage medium may exist as separate components in the user terminal.

Although the above-described embodiments have been described as utilizing aspects of the presently disclosed subject matter in one or more standalone computer systems, the disclosure is not limited thereto and may also be implemented in conjunction with any computing environment, such as a network or distributed computing environment. . Furthermore, aspects of the subject matter of this disclosure may be implemented in multiple processing chips or devices, and storage may be similarly effected across the multiple devices. These devices may include PCs, network servers, and portable devices.

Although the present disclosure has been described in relation to some embodiments in this specification, various modifications and changes may be made without departing from the scope of the present disclosure as can be understood by a person skilled in the art to which the invention pertains. Additionally, such modifications and changes should be considered to fall within the scope of the claims appended hereto.

110: user terminal
120: Group chat room screen
130, 140, 150: Chat message
132, 142, 152: Visualization information

Claims (20)

A method for displaying an emotional state for a conversation partner, performed by at least one processor, comprising:
Obtaining at least one conversation message conducted between a first user and a second user;
based on the obtained conversation message, determining an emotional state of the second user with respect to the first user; and
Displaying first visualization information associated with the determined emotional state in a chat room
Including, a method for displaying an emotional state.
According to paragraph 1,
based on the obtained conversation message, determining an emotional state of the first user with respect to the second user; and
Displaying second visualization information associated with the determined emotional state in the chat room
A method for displaying an emotional state, further comprising:
According to paragraph 2,
Determining the emotional state of the second user with respect to the first user includes:
Among the obtained conversation messages, determining the emotional state of the second user with respect to the first user based on the conversation message written by the second user.
Including,
Determining the emotional state of the first user with respect to the second user includes:
Among the obtained conversation messages, determining the emotional state of the first user with respect to the second user based on the conversation message written by the first user.
Including, a method for displaying an emotional state.
According to paragraph 2,
detecting a conversation message written by the first user for a third user in the chat room; and
In response to the detected conversation message, displaying third visualization information associated with the emotional state of the first user with respect to the third user in the chat room.
A method for displaying an emotional state, further comprising:
According to clause 4,
The step of displaying the second visualization information in the chat room includes:
Displaying the second visualization information in a predetermined area where the emotional state of the first user is expressed.
Including,
The step of displaying the third visualization information in the chat room includes:
Changing the second visualization information displayed in the predetermined area into the third visualization information
Including, a method for displaying an emotional state.
According to clause 4,
The step of displaying the third visualization information in the chat room includes:
Determining the emotional state of the first user with respect to the third user based on a conversation message between the third user and the first user included in at least one of the chat room or another chat room.
Including, a method for displaying an emotional state.
According to clause 4,
The step of detecting the first user's conversation message written for the third user,
In the chat room, when the first user detects a mention message pointing to the third user or detects the first user's response message to the third user's conversation message, the third user Determining that the conversation message of the first user written as a target is detected
Including, a method for displaying an emotional state.
According to paragraph 1,
The chat room is a group chat room,
The step of obtaining the at least one conversation message includes:
Obtaining a first set of conversation messages written by the second user from the group chat room including the first user and the second user; and
Obtaining a second set of conversation messages included in a personal chat room including the first user and the second user.
Including,
The emotional state of the second user with respect to the first user is determined based on the first set of conversation messages and the second set of conversation messages.
According to clause 8,
Determining the emotional state of the second user with respect to the first user includes:
Based on the first set of conversational messages, determining a first emotional state;
based on the second set of conversational messages, determining a second emotional state; and
Based on the first emotional state and the second emotional state, determining the emotional state of the second user with respect to the first user.
Including, a method for displaying an emotional state.
According to clause 9,
Determining the emotional state of the second user with respect to the first user includes:
determining whether the first emotional state and the second emotional state are the same; and
In response to determining that the first emotional state and the second emotional state are different, an emotional state with a higher priority among the first emotional state and the second emotional state is selected as the emotional state of the second user with respect to the first user. Steps to decide on status
Including, a method for displaying an emotional state.
According to clause 9,
The emotional state of the second user with respect to the first user is determined by applying a first weight to the first emotional state and a second weight to the second emotional state.
According to clause 11,
A method for displaying an emotional state, wherein the second weight is greater than the first weight.
According to clause 8,
The first set of conversation messages is a message written by the second user for the first user in the group chat room.
According to clause 8,
Obtaining a third set of conversation messages between the first user and a third user included in the group chat room;
Obtaining a fourth set of conversation messages included in a personal chat room including the first user and the third user;
based on the third set of conversation messages and the fourth set of conversation messages, determining an emotional state of the third user with respect to the first user; and
Displaying fourth visualization information associated with the determined emotional state of the third user with respect to the first user in the group chat room.
A method for displaying an emotional state, further comprising:
According to clause 14,
Displaying emotional relationship information between all users included in the group chat room
It further includes,
The emotional relationship information includes the emotional state of each of the other users with respect to the first user and the emotional state of the first user with respect to each of the other users.
According to clause 15,
Receiving an output request for the emotional relationship information from the first user; and
Obtaining at least some of the emotional relationship information from an external device
A method for displaying an emotional state, further comprising:
According to paragraph 1,
Determining the emotional state of the second user with respect to the first user includes:
extracting at least one keyword or emoticon associated with an emotion from the obtained conversation message; and
Based on the extracted at least one keyword or emoticon, determining the emotional state of the second user with respect to the first user.
Including, a method for displaying an emotional state.
According to paragraph 1,
The step of displaying the first visualization information in the chat room includes:
Displaying the first visualization information in association with the profile of the second user in the chat room
Including, a method for displaying an emotional state.
A computer program stored in a computer-readable recording medium for executing the method according to any one of claims 1 to 18 on a computer.
As a user terminal,
Memory; and
At least one processor connected to the memory and configured to execute at least one computer-readable program included in the memory
Including,
The at least one program is,
Obtain at least one conversation message conducted between the first user and the second user,
Based on the obtained conversation message, determine the emotional state of the second user with respect to the first user,
A user terminal comprising instructions for displaying first visualization information associated with the determined emotional state in a chat room.

Images