JP2023166973A - Method and device for displaying expression of emotion of user in picture content - Google Patents

Abstract

To provide a method for displaying expression of an emotion of a user in a picture content which is performed by at least one processor of a user terminal.SOLUTION: A method for displaying expression of an emotion of a user in a picture content includes the steps of: outputting a picture content in a first region of a display of a user terminal (step S910); outputting a chat content related to the picture content in a second region of the display (S920); receiving user input related to expression of the emotion of the user in a third region of the display (step S930); and outputting a first visual effect related to expression of the emotion in the second region in response to the reception of the user input (step S940).SELECTED DRAWING: Figure 9

Description

There is an application for exception to loss of novelty.

The present disclosure relates to a method and apparatus for displaying a user's emotional expression in video content, and specifically relates to a method and apparatus for outputting a visual effect associated with a user's emotional expression when playing video content.

2. Description of the Related Art Recently, with the development of social network services (SNS) and video providing platforms, consumption of video content such as live Internet broadcasting has become very active. 2. Description of the Related Art In live Internet broadcasting and the like, functions that allow viewers to express their emotions and effects associated therewith are provided for communication between broadcasters and viewers. For example, if you click the "Like" button, the associated effects will appear on your screen.

Such effects have the problem that the effects associated with each viewer's "likes" are the same or similar, making it difficult for the service user to distinguish between the effects of the user himself and other viewers. . Furthermore, because simple 2D motion has become commonplace, there is a lack of differentiation among video providing platforms. This has limited the bond that can be formed between broadcasters and viewers.

Korean Patent Application Publication No. 2012-0108485

The present disclosure provides a method for displaying a user's emotional expression in video content, a computer program, and an apparatus (system) for solving the above problems.

According to an embodiment of the present disclosure, a method for displaying emotional expressions of a user in video content performed by at least one processor of a user terminal includes outputting the video content in a first area on a display of the user terminal. outputting chat content associated with the video content in a second area on the display; and receiving user input associated with an emotional expression of the user in a third area on the display. , outputting a first visual effect associated with the emotional expression in the second region in response to receiving the user input.

A computer-readable computer program for executing on a computer a method for displaying a user's emotional expression according to an embodiment of the present disclosure is provided.

A user terminal according to an embodiment of the present disclosure includes a communication module, a memory, a display, and at least one computer-readable program coupled to the memory and configured to execute at least one computer-readable program contained in the memory. including two processors. The at least one program outputs video content in a first area on the display, outputs chat content associated with the video content in a second area on the display, and outputs chat content associated with the video content in a second area on the display. , including instruction words for receiving a user input associated with an emotional expression of the user and outputting a first visual effect associated with the emotional expression in the second region in response to receiving the user input. .

According to some embodiments of the present disclosure, by having the user actively click the "Like" button, it is possible to induce the user to actively participate in content in addition to chat participation.

According to some embodiments of the present disclosure, users can easily distinguish their emotional expressions from those of other users.

According to some embodiments of the present disclosure, a live broadcast host, viewer user, etc. can visually confirm an increase in the number of cumulative emotional expressions, and can confirm that the number of cumulative emotional expressions has reached a target value. Can be easily confirmed.

The effects of the present disclosure are not limited to this, and other effects not mentioned will be clearly understood by a person with ordinary knowledge in the technical field to which the present disclosure pertains (hereinafter referred to as "a person skilled in the art") from the description of the claims. It should be understood.

Embodiments of the present disclosure will be described based on the accompanying drawings below. Here, similar reference numerals indicate similar elements, but are not limited thereto.
FIG. 2 is a diagram illustrating an example of displaying a user's emotional expression according to an embodiment of the present disclosure. FIG. 1 is a schematic diagram showing a configuration in which an information processing system according to an embodiment of the present disclosure is connected so as to be able to communicate with a plurality of user terminals. FIG. 1 is a block diagram showing the internal configuration of a user terminal and an information processing system according to an embodiment of the present disclosure. FIG. 3 is a diagram illustrating detailed areas of a user interface according to an embodiment of the present disclosure. FIG. 6 is a diagram illustrating an example in which effects associated with a user's emotional expression are displayed according to an embodiment of the present disclosure. FIG. 7 is a diagram illustrating an example of outputting a visual effect due to an increase in the number of cumulative emotional expressions according to an embodiment of the present disclosure. FIG. 7 is a diagram illustrating an example of setting values for visual effects displayed in an area where chat content is output according to an embodiment of the present disclosure. FIG. 6 is a diagram illustrating an example of a setting value of a visual effect associated with the number of cumulative emotional expressions of video content according to an embodiment of the present disclosure. 3 is a flowchart illustrating a method for displaying a user's emotional expression in video content according to an embodiment of the present disclosure.

Hereinafter, specific contents for implementing the present disclosure will be described in detail based on the accompanying drawings. However, in the following description, specific descriptions of known functions and configurations will be omitted if there is a risk of unnecessarily obscuring the gist of the present disclosure.

In the accompanying drawings, identical or corresponding components are provided with the same reference symbols. Further, in the following description of the embodiments, duplicate descriptions of the same or corresponding components may be omitted. However, the omission of a description of a component should not be intended to mean that such a component is not included in a given embodiment.

The advantages and features of the disclosed embodiments, and the manner in which they are achieved, will become clearer with reference to the following embodiments, taken in conjunction with the accompanying drawings. However, the present disclosure is not limited to the embodiments disclosed below, and may be embodied in various forms different from each other. However, these embodiments are provided only so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.

Terms used in the present disclosure will be briefly explained, and examples of the disclosure will be specifically explained. The terminology used in this specification has been chosen to be as common as possible and currently widely used, taking into account its function in this disclosure; This may change depending on legal precedents, the emergence of new technology, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, but their meanings will be described in detail in the description of the invention. Therefore, the terms used in this disclosure should be defined based on the meaning of the term and the overall content of this disclosure, rather than the simple name of the term.

In this disclosure, singular expressions may include plural expressions, and plural expressions may include singular expressions, unless the context clearly dictates otherwise. Throughout the specification, if a certain part is said to "include" a certain component, this does not mean that it excludes other components, and unless there is a specific statement to the contrary, this does not mean that it further includes other components. It also means that you can.

Further, the term "module" or "unit" used in the specification refers to a software or hardware component, and the "module" or "unit" performs a certain role. However, the term "module" or "unit" is not limited to software or hardware. A "module" or "unit" may be configured to reside on an addressable storage medium and may be configured to execute on one or more processors. Thus, by way of example, a "module" or "unit" refers to components such as software components, object-oriented software components, class components, task components, as well as processes, functions, attributes, procedures, subroutines, and program components. It can include at least one of a segment of code, a driver, firmware, microcode, circuitry, data, a database, a data structure, a table, an array, or a variable. Components and "modules" or "sections" may be defined as functions provided internally that may be combined with fewer components and "modules" or "sections" or with additional components and "modules" or "sections." It can be further separated into ``.

According to one embodiment of the present disclosure, a "module" or "unit" may be embodied in a processor and memory. "Processor" should be construed broadly to include general purpose processors, central processing units (CPUs), microprocessors, digital signal processors (DSPs), controllers, microcontrollers, state machines, and the like. In some environments, a "processor" can also refer to an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), and the like. "Processor" means a processing processor, such as a combination of a DSP and a microprocessor, a combination of multiple microprocessors, a combination of one or more microprocessors combined with a DSP core, or any other such configuration. It can also refer to a combination of devices. Additionally, "memory" should be construed broadly to include any electronic component capable of storing electronic information. "Memory" refers to RAM (Random Access Memory), ROM (Read Only Memory), NVRAM (Non-Volatile Random Access Memory), PROM (Programmable Read-Only Memory), EPROM (Erasable Programmable Read-Only Memory), EEPROM ( It can also refer to various types of processor-readable media, such as electrically erasable programmable reda-only memory, flash memory, magnetic or optical data storage devices, registers, and the like. A memory is said to be in electronic communication with a processor when the processor can read/read information from, and record information to, the memory. Memory integrated into the processor is in electronic communication with the processor.

In the present disclosure, a "user" can refer to a user who is viewing a live video, and "another user" can refer to another user who is viewing the same live video.

FIG. 1 is a diagram illustrating an example of displaying a user's emotional expression according to an embodiment of the present disclosure. As shown in the figure, the user terminal 110 can display a screen on which video content is played back on the display 120. In one embodiment, the video content may be a live video, a recorded video of a live video, a pre-stored video, or the like.

In one example, user 100 may click a button associated with an emotional expression as the video content is played. For example, when the video content is played, a "like" button 130 is displayed on the display 120 of the user terminal 110 along with the video content, allowing the user to input positive feedback. User 100 may input positive feedback by touching or clicking "like" button 130 on display 120. Additionally, the user 100 may communicate with the live broadcast host, other viewers, etc. by entering text via a chat input window on the display 120.

In one embodiment, the user terminal 110 may output a visual effect 140 associated with the emotional expression when the user 100 selects the "like" button 130. For example, user terminal 110 may output visual effects 140 to an area on the display where chat content is output. At this time, the visual effect 140 can be output to a layer below the layer in which the chat content is output. Visual effects 140 can have any size, any color, or any transparency, and can be output anywhere within the area on the display where the chat content is output. Visual effects 140 can be output for a predetermined time or any time on display 120, and can use blurred images. Additionally, the user 100 may select the "like" button 130 several times, at which time a number of visual effects may be output on the display 120.

When the user 100 selects the "Like" button 130, the visual effect 140 is displayed not only on the user terminal 110 of the user 100, but also on the user terminals of other users who are viewing the same video content, and on the live broadcast host. It can be displayed in the same or similar manner on other user terminals. Furthermore, even if another user who is viewing the same video content clicks the "Like" button, the user 100 can confirm that the other user has clicked the "Like" button. Visual effects may be output to display 120 of user terminal 110.

With this configuration, users who are viewing video content can actively click the "Like" button 130, thereby encouraging users to actively express their emotions in addition to participating in a chat. can be induced. Furthermore, users can check the emotional expressions of viewers without interfering with viewing video content and chat content. In live video content, such a visual effect 140 can have an effect similar to a flashlight of a spectator or the like in an offline concert.

In one embodiment, the user terminal 110 may output the visual effect 150 associated with the cumulative number of emotional expressions related to the video content. For example, the user terminal 110 can output the visual effect 150 associated with the cumulative number of "likes" clicked by users viewing the same video content. The visual effects 150 can be output to a layer below the layer in which chat content is output. Further, the visual effect 150 can be output to the same layer as the visual effect 140 or a layer below it.

In one example, visual effects 150 may vary in visual attributes based on the number of cumulative emotional expressions associated with the video content. For example, visual effect 150 may increase in size as the number of cumulative emotional expressions increases. With this configuration, the user 100 can intuitively confirm the number of cumulative emotional expressions associated with video content.

FIG. 2 is a schematic diagram showing a configuration in which an information processing system 230 according to an embodiment of the present disclosure is communicably connected to a plurality of user terminals 210_1, 210_2, and 210_3. As shown in the figure, a plurality of user terminals 210_1, 210_2, and 210_3 are connected via a network 220 to an information processing system 230 that can provide video content services. Here, the plurality of user terminals 210_1, 210_2, and 210_3 may include terminals of users to whom video content services are provided. In one embodiment, information processing system 230 includes one or more server devices and/or servers capable of storing, providing, and executing computer-executable programs (e.g., downloadable applications) and data associated with video content services and the like. The database may include one or more distributed computing devices and/or distributed databases based on cloud computing services.

The video content service provided by the information processing system 230 can be provided to the user via a video content playback application or a web browser installed on each of the plurality of user terminals 210_1, 210_2, and 210_3. For example, the information processing system 230 receives video content playback requests from user terminals 210_1, 210_2, and 210_3 via a video content playback application, a request for information associated with video content, or a request for information associated with a user's emotional expression. It can provide information corresponding to user input, etc., and perform corresponding processing.

The plurality of user terminals 210_1, 210_2, and 210_3 can communicate with the information processing system 230 via the network 220. The network 220 can be configured to allow communication between the plurality of user terminals 210_1, 210_2, 210_3 and the information processing system 230. Depending on the installation environment, the network 220 may include, for example, a wired network such as Ethernet (registered trademark), PLC (Power Line Communication), telephone line communication equipment, and RS-serial communication, a mobile communication network, and a WLAN (WLAN). Wireless LAN), Wi-Fi, Bluetooth, ZigBee, etc., or a combination thereof. The communication method is not limited to a communication method that utilizes a communication network that can include the network 220 (for example, a mobile communication network, wired Internet, wireless Internet, broadcasting network, satellite network, etc.), as well as a communication method that utilizes the user terminal 210_1, Near field wireless communication between 210_2 and 210_3 is also included.

In FIG. 2, a mobile phone terminal 210_1, a tablet terminal 210_2, and a PC terminal 210_3 are shown as examples of user terminals, but the user terminals 210_1, 210_2, and 210_3 are capable of wired and/or wireless communication. It can be any computing device on which a video content playback application, a web browser, or the like can be installed and run. For example, user terminals include smartphones, mobile phones, navigation systems, computers, notebooks, digital broadcast terminals, PDAs (Personal Digital Assistants), PMPs (Portable Multimedia Players), tablet PCs, game consoles, wearable devices ( wearable devices), IoT (internet of things) devices, VR (virtual reality) and AR (augmented reality) devices, set-top boxes, etc. Further, although FIG. 2 shows three user terminals 210_1, 210_2, and 210_3 communicating with the information processing system 230 via the network 220, the present invention is not limited to this, and different numbers of user terminals may communicate with the information processing system 230 via the network 220. The information handling system 230 may also be configured to communicate with the information handling system 230 via the computer.

According to one embodiment, the information processing system 230 can receive user input associated with the user's emotional expression from the plurality of user terminals 210_1, 210_2, and 210_3. Thereafter, the information processing system 230 may provide data or settings associated with each user input, the number of cumulative emotional expressions associated with the video content, or the visual effect to the plurality of user terminals 210_1, 210_2, and 210_3.

FIG. 3 is a block diagram showing the internal configuration of the user terminal 210 and the information processing system 230 according to an embodiment of the present disclosure. The user terminal 210 can be any computing device that can execute a video content playback application or a web browser, and can perform wired/wireless communication, such as the mobile phone terminal 210_1 and the tablet terminal 210_2 in FIG. and a PC terminal 210_3. As shown, user terminal 210 may include memory 312, processor 314, communication module 316, and input/output interface 318. Similarly, information handling system 230 may include memory 332, processor 334, communication module 336, and input/output interface 338. As shown in FIG. 3, user terminal 210 and information handling system 230 can be configured to communicate information and/or data over network 220 using respective communication modules 316, 336. The input/output device 320 is also configured to input information and/or data to the user terminal 210 and output information and/or data generated from the user terminal 210 via the input/output interface 318. can.

Memory 312, 332 may include any non-transitory computer readable storage medium. According to one embodiment, the memories 312, 332 include permanent mass storage devices such as read only memory (ROM), disk drives, solid state drives (SSD), flash memory, and the like. mass storage device). As another example, permanent mass storage devices such as ROM, SSD, flash memory, disk drives, etc. may be included in user terminal 210 or information handling system 230 as a separate permanent storage device separate from memory. obtain. The memories 312 and 332 may also store an operating system and at least one program code (eg, code for a video content playback application installed and run on the user terminal 210).

Such software components may be loaded from a computer readable storage medium separate from memory 312, 332. Such separate computer-readable storage media can include storage media directly coupled to such user terminals 210 and information handling systems 230, such as floppy drives, disks, tapes, etc. It can include computer readable storage media such as DVD/CD-ROM drives, memory cards, and the like. As another example, software components or the like may be loaded into memory 312, 332 via a communication module rather than a computer-readable storage medium. For example, at least one program can be loaded into memory 312, 332 based on a computer program being installed by a file provided over network 220 by a developer or a file distribution system that distributes application installation files.

Processors 314, 334 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input/output operations. Instructions may be provided to the processor 314, 334 by a memory 312, 332 or a communication module 316, 336. For example, processors 314, 334 may be configured to execute instructions received by program code stored in a storage device, such as memory 312, 332.

The communication modules 316 and 336 can provide configurations and functions for the user terminal 210 and the information processing system 230 to communicate with each other via the network 220, and allow the user terminal 210 and/or the information processing system 230 to communicate with other users. It can provide configuration and functionality for communicating with a terminal or other systems (eg, a separate cloud system, etc.). By way of example, a request or data (e.g., a request to play video content, a user input associated with a user's emotional expression, or data associated therewith) may be communicated to information handling system 230 via network 220 under control of communication module 316 . Conversely, control signals and instructions provided by control of processor 334 of information handling system 230 may be received by user terminal 210 via communication module 316 of user terminal 210 via communication module 336 and network 220 . For example, the user terminal 210 receives data associated with other users' emotional expressions, data associated with the cumulative number of emotional expressions related to video content, etc. from the information processing system 230 via the communication module 316. can.

Input/output interface 318 may be a means for interfacing with input/output device 320. By way of example, input devices include devices such as cameras, keyboards, microphones, mice, etc., including audio and/or image sensors, and output devices include devices such as displays, speakers, haptic feedback devices, etc. equipment. As another example, input/output interface 318 may be a means for interfacing with a device that has an integrated structure or function for performing input and output, such as a touch screen. For example, when the processor 314 of the user terminal 210 processes instructions of a computer program loaded into the memory 312, a service screen is configured using information and/or data provided by the information processing system 230 and other user terminals. etc. may be displayed on the display via the input/output interface 318. Although the input/output device 320 is shown not to be included in the user terminal 210 in FIG. 3, the input/output device 320 is not limited to this, and may be configured integrally with the user terminal 210. The input/output interface 338 of the information processing system 230 is a means for interfacing with an input or output device (not shown) that is connected to the information processing system 230 or that the information processing system 230 can include. could be. Although the input/output interfaces 318, 338 are shown in FIG. 3 as elements configured separately from the processors 314, 334, the input/output interfaces 318, 338 may be configured to be included in the processors 314, 334. You can also.

User terminal 210 and information processing system 230 may include more components than those shown in FIG. However, most prior art components need not be explicitly shown. According to one embodiment, the user terminal 210 may be implemented to include at least a portion of the input/output device 320 described above. In addition, the user terminal 210 may further include other components such as a transceiver, a global positioning system (GPS) module, a camera, various sensors, and a database. For example, when the user terminal 210 is a smartphone, it can generally include components that a smartphone has, such as an acceleration sensor, a gyro sensor, a camera module, various physical buttons, buttons using a touch panel, and input/output ports. , a vibrator for vibration, etc., may be further included in the user terminal 210.

FIG. 4 is a diagram illustrating detailed areas of a user interface 400 according to one embodiment of the present disclosure. As shown, the user interface 400 can include a first area 410, a second area 420, and a third area 430. The regions 410, 420, and 430 are not limited to this, and the positions and sizes of the regions 410, 420, and 430 may be different from those shown in FIG. 4.

Video content can be output to the first area 410. Chat content associated with the video content can be output to the second area 420. Chat content can include real-time chats of users viewing video content, public notices, major notifications, and the like. The second area 420 may include a first layer where chat content is output and a second layer where visual effects are output. Here, the first layer may be a higher layer than the second layer.

The visual effects output to the second layer include visual effects associated with emotional expressions that are output when a user viewing the video content selects the "Like" button, and the video content. may include a visual effect associated with the cumulative number of emotional expressions. As described above, the visual attributes of the visual effects associated with the cumulative number of emotional expressions related to video content may change based on the cumulative number of emotional expressions. The second layer has a background color/background image and can have a default transparency. In one example, the transparency of the second layer increases from the bottom to the top.

In one embodiment, a first area 410 where video content is output and a second area 420 where chat content is output may partially overlap. At this time, the second area 420 may further include a third layer to which a portion of the video content is output. The second layer may be a higher layer than the third layer. With this configuration, the first area 410 in which video content is displayed can be maximized, and at the same time, the user can view both chat content and visual effects through the second area 420.

The third area 430 may display various buttons/icons including a "like" button. If the user clicks on the "like" button in the third area 430, a visual effect associated with the emotional expression may be output in the second area 420. Additionally or alternatively, if the user clicks on the "Like" button in the third area 430, an effect associated with the emotional expression can be output in the third area 430, as described in FIG. This will be explained later. In one embodiment, the first area 410 and the third area 430 where video content is output may partially overlap. At this time, various buttons/icons included in the third area 430 may be output on the video content.

FIG. 5 is a diagram illustrating an example in which effects associated with a user's emotional expression are displayed according to an embodiment of the present disclosure. The first operation 510 is that when another user viewing the video content selects the "Like" button, a first visual effect 512 associated with the other user's emotional expression is displayed as the first visual effect 512 on the display. An example of output to area 514 of No. 2 is shown. A plurality of visual effects associated with emotional expressions of other users, etc. can be output to the second area 514. With such a configuration, the user can visually grasp the degree of response to the video content of other users. As shown, if another user selects the "Like" button, no visual effect is output to the third area 516.

In one embodiment, if the number of "like" buttons clicked by a user or the like during a certain period of time while viewing video content exceeds a predetermined threshold, the magnitude of the first visual effect 512 may be increased. It can become smaller and last less long. Such a configuration can prevent the problem of the first visual effect 512 being excessively output to the second area or occupying an excessively large area, and the user's visual fatigue.

A second operation 520 is such that when the user selects the "Like" button 524, a second visual effect 526 associated with the user's emotional expression is output to the second region 514 of the display, and the user's emotional expression An example is shown in which a third visual effect 528 associated with the representation is output to the third area 516 of the display. For example, the third visual effect 528 output to the third area 516 of the display may include at least one visual effect (e.g., a heart-shaped visual effect) rising from the bottom to the top of the third area. It can be an animation that includes motion. Such a configuration allows the user to easily distinguish his or her emotional expression from that of other users, and such a configuration may encourage the user to actively click the "Like" button 524. In addition to chat participation, users can be encouraged to actively express their emotions.

In one example, the third visual effect 528 output to the third area 516 of the display is the first visual effect 512 and the second visual effect output to the second area 514 of the display. 526 and different attributes. For example, the third visual effect 528 can have a different shape, hue, transparency, degree of blurring, size, animation effect, etc. than the first and second visual effects 512, 526. Additionally or alternatively, the third visual effect 528 may be output for a longer duration than the first and second visual effects 512, 526.

In one example, the third visual effect 528 can be output to the top layer of the third region 516. Therefore, the third visual effect 528 is not obstructed by the various buttons/icons displayed in the third region 516, and the user can easily see the feedback associated with the "like" button he or she clicks. can.

As mentioned above, the visual effect when a user selects the "Like" button is different from when another user selects the "Like" button, so that the visual effect for the user is particularly emphasized. This allows the user to recognize that his or her emotional expression is differentiated from the emotional expressions of other users. That is, the user can immediately confirm his or her emotional expression through the visual effects displayed in the third area 516 of the display, and can view and listen to the video content through the visual effects displayed in the second area 514 of the display. You can immediately check the emotional expressions of all users.

FIG. 6 is a diagram illustrating output examples of visual effects 612, 622, 634, and 636 due to an increase in the number of cumulative emotional expressions according to an embodiment of the present disclosure. As shown in the first operation 610 and the second operation 620, as the number of cumulative emotional expressions of the video content increases, the magnitude of the visual effects 612 and 622 also increases. Further, as shown in a third operation 630, if the number of cumulative emotional expressions of the video content reaches a predetermined target value, visual effects 634 and 636 associated therewith may be output. With such a configuration, the live broadcast host, user, etc. can intuitively confirm that the number of cumulative emotional expressions in the video content increases and reaches the target value.

A first operation 610 illustrates an example in which, at the beginning of the video content, a visual effect 612 associated with the number of cumulative emotional expressions of the video content is output to a second region 614 of the display. Here, the number of cumulative emotional expressions of the video content is 0, and as the number of cumulative emotional expressions increases, the size of the visual effect 612 also increases. The visual effect 612 can be output anywhere within the second area 614, preferably in the center of the second area 614.

The second operation 620 is such that as the video content progresses, the number of cumulative emotional expressions of the video content increases, and a visual effect 622 that is larger than the initial visual effect 612 is displayed in a second area 614 of the display. An example of the output is shown below. In one embodiment, the magnitude of the visual effect 622 may be determined based on the ratio between the current cumulative number of emotional expressions and a target value. For example, if the target value is 1,000 and the current number of cumulative emotional expressions is 500, the size of visual effect 622 may be half of the maximum size. Although the size of the visual effect 622 is shown to be larger than the size of the visual effect 612 in FIG. 6, the size of the visual effect 622 is not limited to this. Visual attributes such as hue, transparency or degree of blurring may change. For example, as the number of cumulative emotional expressions increases, the transparency of the visual effect may gradually decrease, and the visual effect may be output more clearly.

The third operation 630 provides an example in which the number of cumulative emotional expressions reaches a predetermined target value (e.g., 1,000) and visual effects 634, 636 are output in the first region 632 of the display. show. In one example, visual effects 634 have a predetermined shape, size, hue, and have predetermined animation effects applied. Additionally, the visual effect 634 can be output at any position within the first area 632 where the video content is output, preferably at the center of the first area 632.

In one example, a visual effect 636 (eg, text, image, etc.) indicating a predetermined target value may be displayed along with visual effect 634. For example, the visual effects 636 may display numbers in the form of "1,000", "1K", "1M", etc., or may include symbols or graphics that the user should recognize as indicating a specific number. (eg, a plurality of star-shaped figures each indicating 100 pieces) may be displayed.

In one example, the first region 632 can include a first layer in which video content is output and a second layer in which visual effects 634, 636 are output. Here, the second layer may be a higher layer than the first layer. With this configuration, the user can clearly recognize that the number of cumulative emotional expressions has reached the predetermined target value.

In one example, before outputting the visual effect 634 in the first area 632 and after outputting the visual effect in the second area 614, a visual effect is output in the second area 614; A connected visual effect can be output to seamlessly connect the visual effect 634 output in the first region 632. For example, visual effect 634 may be output after the visual effect output to second area 614 rises to first area 632. With this configuration, connectivity can be provided between the visual effects output in the second area 614 and the first area 632 when the number of cumulative emotional expressions reaches the target value.

FIG. 7 is a diagram illustrating an example of visual effect setting values 700 displayed in an area where chat content is output according to an embodiment of the present disclosure. As shown, the settings 700 may include at least one of a visual effect type, a size range, a transparency range, a blurring range, or a duration range. The administrator of the video content service or the video content manager can modify or delete a part of the setting values 700 or add new data to the setting values 700. For example, in the case of video content that is expected to attract a large number of viewers, the administrator can set the duration period of the visual effect to be shorter than the basic value.

When video content is played through the user terminal, a visual effect based on the data in the settings 700 can be output on the display of the user terminal. The user terminal receives all or part of the setting value 700 from the information processing system, or receives video or visual effect data reflecting all or part of the setting value 700, and changes the setting value 700 to within the setting value 700. Visual effects based on data can be output together with video content.

The data and the like in the setting values 700 shown in FIG. 7 are merely examples, and the present invention is not limited thereto. For example, the types of visual effects are not limited to heart shapes and star shapes, but can include various shapes such as circular shapes and the like. Similar to settings 700, various settings associated with visual effects output to the third area of the display may be saved by a video content service administrator or video content administrator.

FIG. 8 is a diagram illustrating an example of visual effect setting values 800 associated with the cumulative number of emotional expressions of video content according to an embodiment of the present disclosure. As shown in the figure, the settings 800 include the type of visual effect, initial position, subsequent position, maximum size, hue, transparency, blurring, target number of user inputs, size transformation interval, etc. be able to. Based on the setting value 800 and the number of cumulative emotional expressions, visual attributes of the visual effect associated with the number of cumulative emotional expressions of the video content may change. The administrator of the video content service or the administrator of the video content can modify or delete a part of the setting values 800 or add new data to the setting values 800. For example, if an influx of a large number of viewers is expected, the administrator can set the target value for the number of cumulative emotional expressions higher than the basic value.

When the video content is played through the user terminal, a visual effect based on the data in the settings 800 can be output on the display of the user terminal. The user terminal receives all or part of the setting value 800 from the information processing system, or receives video or visual effect data reflecting all or part of the setting value 800, and changes the setting value 800 to within the setting value 800. Visual effects based on data can be output together with video content.

In one embodiment, the setting value 800 may include information associated with the position of the visual effect before and after the number of cumulative emotional expressions reaches a predetermined target value. For example, the setting value 800 may include information regarding a position of a visual effect associated with the number of cumulative emotional expressions and a position of a visual effect associated with reaching a goal of the number of cumulative emotional expressions. The information regarding the location may include coordinate values (eg, X: 150, Y: 30), but is not limited thereto, and may include any type of information that can specify the location. In addition, various position information including not only the initial position and subsequent positions but also various movements may be included.

In one embodiment, the setting value 800 may include information regarding a target value for the number of cumulative emotional expressions and a detailed section in which visual attributes of the visual effect change. For example, the target value can be set to 2,000, the first interval value to 500, the second interval value to 1,000, and the third interval value to 1,500. At this time, each time the cumulative number of emotional expressions reaches 500, 1,000, and 1,500, the size of the visual effect increases, and when it reaches 2,000, the goal is reached. Visual effects associated with achievements can be output. The number of detailed sections can be set by the administrator, and the visual attributes can be set to change for each number in proportion to the number of cumulative emotional expressions without dividing the detailed sections. Further, it can be set so that the visual attribute does not change until the target value is reached, and a visual effect associated with reaching the target value is output at the same time as the target value is reached. As described above, the detailed interval value can be expressed as the number of cumulative emotional expressions (for example, 500) or as a percentage value with the target value as the maximum value. For example, if the target value is 2,000 and the interval value is 30%, the visual attributes of the visual effect may change when the cumulative number of emotional expressions reaches 600.

The data in the setting values 800 shown in FIG. 8 are merely examples, and the present invention is not limited thereto. For example, the types of visual effects are not limited to heart shapes and star shapes, but can include various shapes such as circular shapes and the like.

FIG. 9 is a flowchart illustrating a method 900 for displaying a user's emotional expression in video content according to an embodiment of the present disclosure. Method 900 can be performed by at least one processor of a user terminal. Method 900 may begin with the processor outputting video content in a first area on a display of a user terminal (S910). Thereafter, the processor may output chat content associated with the video content in a second area on the display (S920).

Subsequently, the processor can receive user input associated with the user's emotional expression in a third area on the display (S930). The processor can output a first visual effect associated with the emotional expression in the second region in response to receiving the user input (S940). Here, the first visual effect has at least one of an arbitrary size, an arbitrary hue, and an arbitrary transparency, and can be output at an arbitrary position within the second area. Alternatively, in response to receiving the user input, the processor outputs a first visual effect in the second region while outputting a second visual effect associated with the user's emotional expression in the third region. visual effects are output.

In one example, the second region can include a first layer in which chat content is output and a second layer in which a first visual effect is output. At this time, the first layer may be a higher layer than the second layer. Further, the first area where the video content is output and the second area where the chat content is output partially overlap, and the second area has a third layer where a part of the video content is output. It can further include: At this time, the second layer may be a higher layer than the third layer.

In one example, the processor can output a third visual effect associated with the other user's emotional expression in the second region. When the processor outputs a third visual effect associated with the emotional expression of the other user in the second region, the visual effect associated with the emotional expression of the other user in the third region is No output.

In one embodiment, the processor can output a fourth visual effect whose visual attributes change based on the number of cumulative emotional expressions associated with the video content in the second region. Here, the fourth visual effect increases in size as the number of cumulative emotional expressions associated with the video content increases. At this time, the second area may include a first layer where chat content is output and a second layer where a fourth visual effect is output. The first layer may be a higher layer than the second layer.

In one embodiment, in response to determining that the number of cumulative emotional expressions associated with the video content has reached a predetermined target value, the processor outputs the fifth visual effect in the first region. can. At this time, the first region may include a fourth layer in which video content is output and a fifth layer in which a fifth visual effect is output. The fifth layer may be a higher layer than the fourth layer. Also, before outputting the fifth visual effect and after outputting the fourth visual effect, the processor outputs a fourth visual effect output in the second area and a fourth visual effect output in the first area. A sixth visual effect can be outputted to seamlessly connect the outputted fifth visual effect. Additionally, the processor can output a seventh visual effect indicating a predetermined target value together with the fifth visual effect in the first region.

The flowchart shown in FIG. 9 and the above description are merely exemplary and may be implemented differently in some embodiments. For example, one or more steps may be omitted, the order of each step may be changed, one or more steps may be performed overlapping each other, or one or more steps may be performed repeatedly several times.

The method described above may be provided as a computer program stored on a computer-readable storage medium for execution on a computer. The medium may store the computer executable program continuously or may temporarily store it for execution or download. Furthermore, the medium may be a variety of recording means or storage means in the form of a single piece of hardware or a combination of multiple pieces of hardware, but is not limited to a medium that is directly connected to a certain computer system, and is distributed over a network. It can be something that exists. Examples of media include hard disks, magnetic media such as floppy disks and magnetic tape, optical recording media such as CD-ROMs and DVDs, and magnetic-optical media such as floptical disks. (magneto-optical medium), ROM, RAM, flash memory, etc., and is configured to store program command words. Further, examples of other media include app stores that distribute applications, other sites that supply or distribute various software, and recording or storage media managed by servers or the like.

The methods, acts, or techniques of this disclosure may be implemented through a variety of means. For example, such techniques may be implemented in hardware, firmware, software, or a combination thereof. Those skilled in the art will appreciate that the various example logical blocks, modules, circuits, and algorithmic steps described by this disclosure can be implemented in electronic hardware, computer software, or a combination of both. It should be. To clearly explain such mutual substitutions of hardware and software, various exemplary components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software will vary depending on the particular application and design requirements imposed on the overall system. Those skilled in the art may also implement the described functionality in various ways for each particular application, but such implementation should not be construed as departing from the scope of this disclosure.

In a hardware implementation, the processing unit utilized to perform the techniques may include one or more ASICs, DSPs, digital signal processing devices (DSPD), programmable logic devices (PLD), field field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, electronic devices, other electronic units designed to perform the functions described in this disclosure, computers, or the like; It can also be implemented in combination.

Accordingly, the various exemplary logic blocks, modules, and circuits described by this disclosure include general purpose processors, DSPs, ASICs, FPGAs and other programmable logic devices, discrete gate and transistor logic, and discrete hardware. It may also be implemented or performed in any combination of components or components designed to perform the functions described herein. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be embodied in a combination of computing devices, such as a DSP and a microprocessor, multiple microprocessors, one or more microprocessors associated with a DSP core, or any other configuration combination. You can also do it.

In a firmware and/or software implementation, techniques may include RAM (random access memory), ROM (read-only memory), NVRAM (non-volatile random access memory), PROM (programmable read-only memory), EPROM (erasable The instructions may be embodied in instructions stored on a computer readable medium, such as a programmable read-only memory, an electrically erasable PROM (EEPROM), a flash memory, a compact disc (CD), a magnetic or optical data storage device, and the like. The instructions can be executed by one or more processors to cause the processors, etc. to perform particular aspects of the functionality described in this disclosure.

Although the foregoing embodiments have been described as utilizing aspects of the presently disclosed subject matter in one or more standalone computer systems, the present disclosure is not limited to, and may be applied to, network or distributed computing environments. can be implemented by any computing environment such as Furthermore, aspects of the subject matter in this disclosure may be implemented in multiple processing chips or devices, and storage may be similarly effected across multiple devices. Such devices may also include PCs, network servers, and portable devices.

Although the present disclosure has been described herein with reference to some embodiments, various modifications and changes may be made without departing from the present disclosure as can be understood by those skilled in the art to which the disclosed invention pertains. It is possible. It is also to be understood that such modifications and changes are within the scope of the claims appended hereto.

100 User 110 User terminal 120 Display 130 "Like" button 140 Visual effect associated with the user's emotional expression 150 Visual effect associated with the cumulative number of emotional expressions

Claims (16)

A method for displaying a user's emotional expression in video content performed by at least one processor of a user terminal, comprising:
outputting the video content in a first area on a display of the user terminal;
outputting chat content associated with the video content in a second area on the display;
receiving user input associated with an emotional expression of a user in a third area on the display;
outputting a first visual effect associated with the emotional expression in the second region in response to receiving the user input. In response to receiving the user input, in the second region, the first visual effect is output, while in the third region, a second visual effect associated with the emotional expression of the user is output. The method for displaying a user's emotional expression in video content according to claim 1, further comprising the step of outputting a target effect. The first visual effect has at least one of an arbitrary size, an arbitrary hue, and an arbitrary transparency, and is output at an arbitrary position within the second area. A method for displaying a user's emotional expression in video content. The second area includes a first layer where the chat content is output and a second layer where the first visual effect is output,
2. The method for displaying a user's emotional expression in video content according to claim 1, wherein the first layer is a layer higher than the second layer. The first area where the video content is output and the second area where the chat content is output partially overlap,
The second area further includes a third layer to which a part of the video content is output,
5. The method for displaying a user's emotional expression in video content according to claim 4, wherein the second layer is a layer higher than the third layer. The method of displaying a user's emotional expression in video content according to claim 1, further comprising the step of outputting a third visual effect associated with another user's emotional expression in the second area. When outputting a third visual effect associated with the emotional expression of the other user in the second area, the visual effect associated with the emotional expression of the other user in the third area; 7. The method for displaying a user's emotional expression in video content according to claim 6, wherein: is not output. The video according to claim 1, further comprising outputting, in the second region, a fourth visual effect whose visual attributes change based on the number of cumulative emotional expressions associated with the video content. How to display user emotional expressions in content. 9. The method of claim 8, wherein the fourth visual effect increases in size according to an increase in the number of cumulative emotional expressions associated with the video content. The second area includes a first layer where the chat content is output and a second layer where the fourth visual effect is output,
9. The method for displaying a user's emotional expression in video content according to claim 8, wherein the first layer is a layer higher than the second layer. Further comprising outputting a fifth visual effect in the first area in response to determining that the number of cumulative emotional expressions associated with the video content has reached a predetermined target value. The method for displaying a user's emotional expression in video content according to claim 8. The first area includes a fourth layer to which the video content is output, and a fifth layer to which the fifth visual effect is output,
12. The method for displaying a user's emotional expression in video content according to claim 11, wherein the fifth layer is a layer higher than the fourth layer. Before outputting the fifth visual effect and after outputting the fourth visual effect, the fourth visual effect is output in the second area, and the fourth visual effect is output in the first area. 12. The method for displaying a user's emotional expression in video content according to claim 11, further comprising the step of outputting a sixth visual effect for seamlessly connecting the outputted fifth visual effect. The user in the video content according to claim 11, further comprising outputting a seventh visual effect indicating the predetermined target value together with the fifth visual effect in the first area. How to display emotional expression. A computer-readable computer program for executing, on a computer, the method for displaying a user's emotional expression in video content according to any one of claims 1 to 14. A user terminal,
a communication module;
memory and
display and
at least one processor coupled to the memory and configured to execute at least one computer readable program contained in the memory;
The at least one program includes:
outputting video content in a first area on the display;
outputting chat content associated with the video content in a second area on the display;
receiving user input associated with an emotional expression of a user in a third area on the display;
A user terminal comprising instructions for outputting a first visual effect associated with the emotional expression in the second region in response to receiving the user input.

Images