KR20190099714A - Method for providing content collection and sharing services based on user’s emotions - Google Patents

Abstract

According to an embodiment of the present invention, a method of providing a content collecting and sharing service based on emotions of a user includes the following steps of: (a) receiving monitoring data from a user terminal generating the monitoring data by receiving biometric information of a user in real time from a biometric information collector; and (b) generating image content combined with a plurality of pre-received monitoring data in accordance with a request for sharing from the user terminal, and uploading the generated image content into a platform server which a plurality of other user terminals can access. The monitoring data include data made by capturing content comprising at least one among a text, an image and a video, or data related with an image taken through a camera connected with the user terminal.

Description

How to provide content collection and sharing service based on user's emotion {METHOD FOR PROVIDING CONTENT COLLECTION AND SHARING SERVICES BASED ON USER ’S EMOTIONS}

The present invention collects the content of a user's enjoyment or excitement due to biometric information that changes according to the user's emotion, provides the user with a gallery of the corresponding content, and enables the user to share it with other users through the platform. It's about the service.

Recently, with the development of scanning technology, devices that can scan various biological signals are increasing, and the size and shape thereof are also diversified depending on the purpose. BACKGROUND In general, biomedical scanners are used for medical and health supplements, and there is a scanning device that collects a wearable biosignal that can be easily used by the general public.

However, the conventional biosignal scanning apparatus unconditionally receives and stores a biosignal from a user, and since the data can only know a change in the biosignal, a separate input and storage is required for a specific situation affecting the biosignal. .

If there is no device to store the factors affecting the bio-signal as described above, the factors that changed the bio-signal are collected by data because there is a limit point in which the specific factors affecting the bio-signal exist. There has been a demand for various methods and functions that can be used.

In order to solve the above-mentioned problems, the present invention collects content on factors affecting the user's biometric information by automatically transmitting environmental data and biometric data to a preset device in response to changes in the user's real-time biosignal. In this way, the gallery of the data allows users to enjoy the contents on / offline.

Secondly, the present invention transmits the contents viewed on the user's selection to the platform server and publishes them online to other users so that they can share and sympathize with the other users.

According to an aspect of the present invention, there is provided a method for providing a content collection and sharing service based on a user's emotion as a technical means for achieving the above technical problem, the method comprising: (a) real-time biometric information of a user from a biometric information collector; Receiving monitoring data from a user terminal that receives and generates monitoring data; And (b) generating, according to a sharing request of the user terminal, video content combining the plurality of received monitoring data and uploading the generated video content to a platform server that can be accessed by a plurality of other user terminals. The monitoring data may be a method including data capturing content composed of at least one type of text, an image, and a video displayed on a user terminal, or data regarding an image captured by a camera connected to the user terminal. .

In addition, according to another embodiment of the present invention, a memory in which at least one program is recorded; And a processor for executing the program, the program comprising the steps of: (a) receiving monitoring data from a user terminal which generates monitoring data by receiving biometric information of a user in real time from a biometric information collector; And (b) generating video content combining the plurality of received monitoring data according to a sharing request of the user terminal and uploading the generated video content to a platform server that can be accessed by a plurality of other user terminals. It may be a server, which includes the instructions.

According to an embodiment of the present invention described above, the effective environment data can be collected and used by automatically transmitting the environment data and the biometric data to the device in advance by changing the real-time biosignal of the user using the content of the device where the program is installed in advance. have.

In addition, by collecting data in conjunction with the change of the user's bio-signals generated by using the content on / offline and the content and the surrounding environment information, it is possible to determine the user psychology, behavior patterns, such as games in the online / offline, It can be used for healthcare, education, sales and development of contents for SNS, and users can use it for community and other purposes.

1 is an exemplary diagram illustrating a configuration of a content collection and sharing service based on a user's emotion according to an embodiment of the present invention.
2 is a block diagram showing the configuration of a server according to an embodiment of the present invention.
3 is a flowchart illustrating a method of providing a content collection and sharing service based on a user's emotion performed by a server according to an embodiment of the present invention.
4 is a flowchart illustrating a process of generating monitoring data by the user terminal 200 in detail according to an exemplary embodiment of the present invention.
FIG. 5 is a flowchart illustrating a process of statistic of user preferred content using a content collection method based on user emotion according to an exemplary embodiment of the present invention.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a part is "connected" to another part, this includes not only "directly connected" but also "electrically connected" with another element in between. . In addition, when a part is said to "include" a certain component, which means that it may further include other components, except to exclude other components, unless specifically stated otherwise, one or more other features It is to be understood that the present disclosure does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, parts, or combinations thereof.

In the entire specification, the server 100 may refer to a device that provides a content collection and sharing service based on the emotion of the user.

The following examples are detailed description to aid in understanding the present invention, and do not limit the scope of the present invention. Therefore, the same range of inventions that perform the same functions as the present invention will also fall within the scope of the present invention.

1 is an exemplary diagram illustrating a configuration of a content collection and sharing service based on a user's emotion according to an embodiment of the present invention.

Referring to FIG. 1, the content collection and sharing service based on the emotion of the user may include the server 100, the user terminal 200, and the biometric information collector 300.

According to an embodiment of the present invention, the server 100 may generate generated monitoring data generated by a terminal application mounted on the user terminal 200 in response to the user's biometric information collected by the biometric information collector 300 in real time. Can receive and generate secondary video content.

In addition, the monitoring data and the image content may be uploaded to the platform server to be shared with a plurality of other user terminals 200 according to a sharing request by the user terminal 200 of the user.

The monitoring data refers to data that captures content (text, image, video, etc.) currently displayed by the user terminal 200. Alternatively, as an optional embodiment, it may mean image data (image or video) of photographing the user or an external object through a camera or an external photographing apparatus.

Also, the secondary video content is secondary content generated by using monitoring data. The secondary video content may be an image, video, or additional content generated through editing, such as combining or combining a plurality of texts, images, or videos. have.

The terminal 200 of the user receives the biometric information of the user in real time from the biometric information collector 300, and generates and stores monitoring data in response to the change of the biometric information. The stored monitoring data is categorized and provided to the user, and the user can view the monitoring data arranged in a galler manner. Among them, monitoring data checked as a user wants to share with other users may be provided to the server 100.

In this case, the user terminal 200 may measure the change in the biometric information of the user in real time from the biometric information collector 300, and generate monitoring data based on the content being used by the user when determining that the biometric information of the user has changed.

In detail, the monitoring data generated by the user terminal 200 is generated in real time based on the content of the user or the appearance of the user in real time, but since the data cannot be increased indefinitely, it is generated and deleted after setting a predetermined time unit. Will be repeated.

At this time, the monitoring data that has been scheduled to be deleted after a certain time from the time of detecting the change of the biometric information is continued until the user's biometric information returns to the preset value, and if the biometric information returns to the preset value, the generation is stopped. The monitoring data will be saved. More details of generating the monitoring data will be described together with a method of preventing monitoring data loss in FIG. 4 to be described later.

In addition, when the user terminal 200 detects a change in the biometric information, an additional application capable of collecting the biometric information may be executed to increase accuracy in the change of the user biometric information, and the additionally executed application may be executed first. The same biosignal may be collected as the biometric information collector 300 in use, or a completely different biosignal may be measured.

The application used to implement the present invention described above may be an application embedded in the user terminal 200 or an application downloaded from a server distributing the application and installed in the user terminal 200.

In addition, the user terminal 200 refers to a communication terminal that can use the terminal application in a wired or wireless communication environment. In particular, in the present invention, the user terminal 200 may mean a device such as a portable terminal of a user, for example, a smart phone, but the spirit of the present invention is not limited thereto, and as described above, the terminal application may be mounted. The terminal can be borrowed without limitation.

In more detail, the user terminal 200 may include a handheld computing device (eg, PDA, email client, etc.), any form of cellular phone, or any form of other kind of computing or communication platform. However, the present invention is not limited thereto.

The biometric information collector 300 measures the biometric information of the user in real time and transmits the biometric information to the user terminal 200, and various devices may be used according to the type of biosignal measured by the user. For example, a variety of biometric information such as a heart rate monitor for measuring a heart rate, a camera for photographing a human face, a speaker for measuring a volume, and a sweat or an iris can be applied to the present invention.

Meanwhile, although omitted in the drawing, the communication network serves to connect the server 100 and the user terminal 200. That is, the communication network refers to a communication network that provides a connection path for transmitting and receiving data after the user terminals 200 access the server 100. The communication network may be a wired network such as local area networks (LANs), wide area networks (WANs), metropolitan area networks (MANs), integrated service digital networks (ISDNs), or wireless networks such as wireless LANs, CDMA, Bluetooth, and satellite communications. It may encompass, but the scope of the present invention is not limited thereto.

2 is a block diagram showing the configuration of the server 100 according to an embodiment of the present invention.

Referring to FIG. 2, the server 100 may include a processor 110, a memory 120, a communication unit 130, and a database 140.

First, the processor 110 is a kind of central processing unit that controls the entire process of providing a content collection and sharing service based on a user's emotion. Each step performed by the processor 110 will be described later with reference to FIG. 3.

Here, the processor 110 may include all kinds of devices capable of processing data, such as a processor. Here, the 'processor' may refer to a data processing apparatus embedded in hardware having, for example, a circuit physically structured to perform a function represented by code or instructions included in a program. As an example of a data processing device embedded in hardware, a microprocessor, a central processing unit (CPU), a processor core, a multiprocessor, and an application-specific integrated device (ASIC) It may include a processing device such as a circuit, a field programmable gate array (FPGA), etc., but the scope of the present invention is not limited thereto.

The memory 120 records a program for performing a method of providing a content collection and sharing service based on a user's emotion. In addition, the processor 110 performs a function of temporarily or permanently storing data processed by the processor 110. Here, the memory 120 may include a magnetic storage media or a flash storage media, but the scope of the present invention is not limited thereto.

The communication unit 130 provides a communication interface necessary to provide a transmission / reception signal between the server 100 and the user terminal 200 in the form of packet data in association with a communication network. In addition, the communication unit 130 may receive a data request from the user terminal 200 and transmit a data as a response thereto.

Here, the communication unit 130 may be a device including hardware and software necessary for transmitting and receiving a signal such as a control signal or a data signal through a wired or wireless connection with another network device.

The database 140 may store at least one or more of the user's biometric information, the monitoring data received from the user terminal 300 and the secondary image content generated by processing the same.

In addition, the monitoring data stored in the database 140 may be stored after being classified according to a preset category setting such as a type and a date, and the data stored in the database 140 may be inquired through an application provided by the user terminal 200. Or share.

3 is a flowchart illustrating a method of providing a content collection and sharing service based on a user's emotion performed by a server according to an embodiment of the present invention.

Referring to FIG. 3, first, the server 100 receives data selected by a user from among monitoring data generated by the user terminal 200 (S310).

At this time, the user terminal 200 generates the monitoring data according to the change of the user's biometric information, and selects the desired data to be edited or shared among them and transmits the data to the server 100.

The user terminal 200 scans the biometric information of the user who is using the specific content in real time through the biometric information collector 300, selects the monitoring data that is being generated in real time when detecting the change of the biometric information, and the biometric information is preset. Generation will continue until you return to the level below.

A plurality of monitoring data generated in step S310 is stored for the user to conveniently search and select, the detailed description will be carried out through FIG. 4 to be described later.

Next, the server 100 generates a second video content by using the previously received monitoring data according to the user's request for generating the second video content, uploads it to the platform server, and shares it (S330).

In this case, the server 100 may receive a video content generation command from the user terminal 200, but in step S310, the server 100 requests the user terminal 200 whether the video content is generated or shared, You can also perform that step based on the response.

The image content may be generated as content such as text, image, image by editing a plurality of monitoring data, and the user may directly select an editing method performed by the server 100. For example, if the monitoring data composed of images are connected to each other to create a single video material, or another method is added to an existing generated image or video, the server 100 automatically displays it. It can be a way of implementation.

In addition, in another optional embodiment, a user having an excellent editing technique for an image or a video may directly perform editing by providing an editing interface through an application of the user terminal 200, and on the contrary, for a user who is not excellent in the corresponding technique. The user terminal 200 may provide a template for generating secondary image content through a simple task, or the server 100 may perform synthesis by itself.

In addition, depending on whether the content generated based on the monitoring data is shared, the server 100 may upload the content to the platform server, and, optionally, may be directly uploaded to the user's terminal or the user's SNS. With sharing of content, the user terminal 200 may receive monitoring data from the server 100. For each monitoring data (for example, a captured image), only the data that the user wants to share are checked separately. Can be. The check mark may be regarded as meaning that sharing may be performed. After the signal for the check mark is transmitted to the server 100, only the monitoring data marked with the check mark may be used to generate secondary content in the server 100. It can be used as basic data.

4 is a flowchart illustrating a process of generating monitoring data by the user terminal 200 in detail according to an exemplary embodiment of the present invention.

Referring to FIG. 4, first, the user terminal 200 has a step of receiving a bio signal from the biometric information collector 300 in real time (S410).

As mentioned above, the user terminal 200 receives one or more of various body signals that can change in response to the user's emotion such as heart rate, facial expression, breathing, volume, and sweating of the user through the biometric information collector 300 in real time. Done.

If the user's emotion is changed by the specific situation of the content currently being used and the biometric information is changed according to the usual situation and exceeds the preset value (S420), the generation of the received time point is being performed based on the time point. Select the monitoring data (S430).

In this case, the user terminal 200 needs to go through the operations from step S410 to step S430 until acquiring the monitoring data. Thus, the method of starting the capture operation after recognizing the emotion change of the user is performed by the user terminal 200. Depending on the speed of processing, there is a possibility of missing a scene at the moment of detecting a change in the user's biometric information.

Therefore, in the present invention, a data loss prevention method for compensating the above-described problem can be applied. The user terminal 200 generates a plurality of monitoring data in real time, repeats generation and deletion based on a predetermined section, and generates a plurality of monitoring data by shifting the generation section from each other.

For example, the user terminal 200 simultaneously generates two monitoring data through the first data generator and the second data generator, and each data generator has a method of deleting and monitoring the monitoring data for two minutes at the time of generation. Here, the first data generator and the second data generator simultaneously generate data in real time. However, the first data generator starts generating data at intervals of 0 to 2 minutes based on 0 minutes, and the second data generator generates 1 to 3 minutes. It is created at intervals to deviate each other's monitoring data.

Thereafter, if the biometric information exceeds a preset value, the user terminal 200 may select the generated monitoring data for more than half of the preset generation time from among the monitoring data being generated based on the excess time.

For example, if the user terminal 200 assumes that the biometric information exceeds a preset value in 2 minutes and 20 seconds based on 0 minutes, the first data generator exemplified above is 2-4 minutes. After generating the second monitoring data having a length of 20 seconds has passed, the second data generator generates the first monitoring data having a length of 1 to 3 minutes and has passed 1 minute 20 seconds, the user terminal 200 ) Selects the first monitoring data generated by the second data generator.

This in turn includes monitoring data information that may be missed through the process from step S410 to step S430 by selecting the monitoring data including the extra data from the time point when the user terminal 200 receives the change in the biometric information. You can do it.

Next, the user terminal 200 generates monitoring data from the biometric information collector 300 to a point in time at which biometric information falls below a preset value (S440).

The monitoring data being generated in step S430 is generated until a time when the user's biometric information falls below a preset value.

For example, if the user's biosignal starts to change at 2 minutes and 20 seconds and returns to its original state after 3 minutes with the extension line of the example described above, the second data generator starts generating monitoring data at 1 minute and then generates 5 minutes and 20 seconds. After generating the user's biometric information to return to its original state, the generation is terminated, and a total of 4 minutes and 20 seconds of monitoring data is generated.

Finally, the generated monitoring data is categorized and stored by the user terminal 200 (S450).

A plurality of monitoring data generated through the step (S410) (S440) is categorized according to the type or date and stored in the user terminal 200 so that the user can conveniently search and select. In an alternative embodiment, the application of the present invention has a function such as an album, so that monitoring data can be stored and managed in the user terminal 200.

In this case, the stored monitoring data may be viewed or shared by an external application installed in the user terminal 200 in an optional embodiment, and may be stored or shared by another external device as necessary.

For example, the user may play the monitoring data through the basic video playing application installed in the user terminal 200 or transmit the monitoring data to a smart TV or another person's smartphone to store or play the data.

In addition, the user may select the desired monitoring data and deliver it to the server 100 and share it with the platform server, or may generate secondary image content.

FIG. 5 is a flowchart illustrating a process of statistic of user preferred content using a content collection method based on user emotion according to an exemplary embodiment of the present invention.

Referring to FIG. 5, in the method of statistic content preferred by users according to the present invention, first, a plurality of user terminals 200 have a step of collecting and storing biometric information and monitoring data mapped thereto ( S610).

In particular, in this step, it is necessary to collect monitoring data that maps and changes in biometric information from users using the same content.

The monitoring data stored in step S610 are classified into time zones, and the part of the content that affects the biometric information is statistically compared between users based on the classification (S620).

In more detail, it is possible to identify which time periods (or scenes, etc.) of a plurality of users who use the same content change their emotions, or which part of various content causes the most emotional change. Can be statistics.

Through this, content creators can use it as a material for producing or supplementing content in the future.

The foregoing description of the present invention is intended for illustration, and it will be understood by those skilled in the art that the present invention may be easily modified in other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is shown by the following claims rather than the above description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. do.

100: server
110: server's processor 120: server's memory
130: communication unit of the server 140: database of the server
200: user terminal 300: biometric information collector

Claims (14)

In the method of providing a content collection and sharing service based on the emotion of the user performed by the server,
(a) receiving the monitoring data from a user terminal which generates the monitoring data by receiving the biometric information of the user in real time from the biometric information collector; And
(b) generating, according to a sharing request of the user terminal, video content combining the plurality of previously received monitoring data and uploading the generated video content to a platform server accessible by a plurality of other user terminals;
Including,
The monitoring data may include data capturing content composed of at least one type of text, image, and video displayed on the user terminal, or data about an image captured by a camera connected to the user terminal.
How to provide content collection and sharing service based on user's emotion. The method of claim 1,
Before step (a)
When the biometric information being received in real time exceeds a preset value, the user terminal collects and shares monitoring data corresponding to a point in time when the biometric information exceeds a preset value. How to Provide Services. The method of claim 2,
The biometric information includes at least one of biometric signals in response to a user's emotion,
When the user terminal detects a change in the biometric information, and further executes an external biometric information collection program to increase the accuracy of the biometric information, the content collection and sharing service providing method based on the emotion of the user. The method of claim 1,
In step (a),
(a-1) further comprising preventing data loss of the monitoring data,
Step (a-1),
And collecting monitoring data before and after the time point at which the biometric information exceeds a predetermined value, providing the content collection and sharing service based on the emotion of the user. The method of claim 6,
Step (a-1),
Collect and store the monitoring data in real time,
When the time point at which the biometric information exceeds a predetermined value is recognized, and when the time point at which the biometric information falls below the preset value is recognized after a predetermined time, the time point is dropped from the time point earlier than the exceeding time point by a predetermined time. And storing the collected monitoring data up to a point in time, and deleting the remaining collected monitoring data. The method of claim 7, wherein
Step (a-1),
Collecting and storing the monitoring data displayed in the user terminal in real time, dividing the monitoring data into a plurality of data based on a plurality of time zones, and collecting the divided data through each of a plurality of applications;
When the time point at which the biometric information exceeds the predetermined value is recognized, the monitoring data collected by the application which has already been executed at the time point and the time point exceeding the biometric information until the biometric information falls below the predetermined value Combining collected monitoring data, the method of providing a content collection and sharing service based on the emotion of the user. The method of claim 10,
Step (a-1),
Each application repeatedly operates to collect data currently being displayed on the user terminal for n minutes at intervals of m minutes, and after the biometric information exceeds the predetermined value, the application collects the data. The method of providing content collection and sharing service based on the emotion of the user, wherein the time limit of n minutes is released (m and n are integers or decimals greater than 0). The method of claim 1,
After step (a)
The plurality of monitoring data previously generated by the user terminal is categorized by a preset classification method,
And selectively storing the monitoring data requested by the user terminal in the server. The method of claim 8,
The user terminal further includes a function of executing the categorized monitoring data through an application or delivering the data to an external storage. The method of providing content collection and sharing service based on the emotion of the user. The method of claim 1,
Step (b) is
Delivering the video content generation request to the user terminal;
Generating the video content based on the video content generating command received from the user terminal;
And editing information of the video content is further added to the video content generating command. The method of claim 10,
And the editing information includes one or more of information of the monitoring data necessary for generating the image content and information for editing the monitoring data. A memory in which at least one program is recorded; And
A processor for executing the program;
The program,
(a) receiving the monitoring data from a user terminal which generates the monitoring data by receiving the biometric information of the user in real time from the biometric information collector; And
(b) generating, according to a sharing request of the user terminal, video content combining the plurality of previously received monitoring data and uploading the generated video content to a platform server accessible by a plurality of other user terminals;
And instructions for performing the. A computer-readable recording medium having recorded thereon a program for performing a method for providing a content collection and sharing service based on a user's emotion. In the method of providing a content collection and sharing service based on the emotion of the user performed by the user terminal,
(a) receiving the biometric information of the user from the biometric information collector in real time to generate monitoring data, and transmitting the monitoring data to a server; And
(b) sending a sharing request for a plurality of said monitoring data to said server; And
(c) accessing a platform server and receiving image content combining the plurality of monitoring data generated by the server to be shared;
The video content can be provided to a plurality of other user terminal,
The monitoring data may include data capturing content composed of at least one type of text, image, and video displayed on the user terminal, or data about an image captured by a camera connected to the user terminal. How to provide content collection and sharing service based on user's emotion.

Images