KR102342866B1 - A method streaming and displaying custom content - Google Patents

Abstract

The present invention relates to a method for streaming and displaying content customized to a user by acquiring surrounding environment information and preference information of the user. According to one embodiment of the present invention, a customized control providing method executed by a first user terminal including a display, a camera, and a control unit comprises the following steps: acquiring first object information from an external server; acquiring surrounding image information; acquiring a plurality of pieces of user preference information from a second user terminal; determining customized content on the basis of the surrounding image information and the first object information or the preference information; and displaying the customized content on the display. The surrounding image information includes front image information of the first user terminal acquired through the camera or photographed image information of an area, in which the first user terminal is to be disposed, acquired from the second user terminal.

Description

{A method streaming and displaying custom content}

The present invention relates to a method of providing customized content to a customer according to the environment and preference around the customer, and displaying the customized content on a display.

The user's latest tendency is generated based on the properties of events that the user recently participated in, and the properties of new events are predicted by comparing the properties of past events. Research on providing a customized event in consideration of the properties of the new event, user preference, and user's situation is being actively conducted, and a method of displaying it on a display is also being actively researched.

The video recommendation system that is currently commonly used consists of two data classification systems and can be divided into content-based filtering and collaborative filtering. As online platform-led content production is revitalized due to the coronavirus pandemic, the field of virtual influencers using artificial intelligence is emerging. The virtual influencer is produced with GAN artificial intelligence, and a comparative learning algorithm that repeats learning in a way that two systems with different personalities compete with each other is used. is proceeding.
Seoul Industry Promotion Agency (Finalist of the 4th Seoul Innovation Challenge in 2021) (IC210014) This is a technology developed through 'Visual content AI emotion classification system and curation technology development using machine learning image analysis technology'.

According to the present invention, it is possible to provide customized content suitable for the user by acquiring the user's surrounding environment information and preference information.

In accordance with an embodiment, a method for providing customized content performed by a first user terminal including a display, a camera, and a control unit, the method comprising: obtaining first object information from an external server; acquiring surrounding image information; obtaining a plurality of user preference information from a second user terminal; determining customized content based on the surrounding image information and the first object information or the preference information; and displaying the customized content on the display, wherein the surrounding image information is arranged by the first user terminal obtained from the front image information of the first user terminal acquired through the camera or the second user terminal It may include information about the photographed image of the to-be-prepared area.

The customized content includes user-customized video information and theme information for the customized content, and the displaying of the customized content on the display includes displaying a customized image, which is an image corresponding to the customized video information, on a left area of the display screen. and displaying, on the basis of the theme information, the theme content, which is the content of the theme corresponding to the customized image, in the second area, which is the right area of the first area.

The determining of the customized content based on the surrounding image information and the first object information or the preference information may include: a first sentiment category based on surrounding image information, the first object information, and the preference information among a plurality of emotion categories. Including; and, the displaying of the customized content on the display includes adding additional content to the customized content corresponding to the first emotional category based on the first emotional category to the second may include; displaying them together in the area.

obtaining location information where the first user terminal is located from a first external server; The determining of the customized content based on the surrounding image information and the first object information or the preference information may include: Based on at least one of the location information, the surrounding image information, the first object information, and the preference information determining a recommended place where the first user terminal is to be placed; It may include; determining the first emotion category based on the recommended place.

The additional contents include atmosphere contents corresponding to the customized contents, time contents for reproducing the customized contents, and description contents of recommended places suitable for the customized contents, and based on the first emotion category, the first The step of displaying additional content for the customized content content corresponding to the emotional category together in the second area includes displaying the description of the recommended place at the top of the area corresponding to the customized image in the second area. displaying on the third area; displaying the theme content in a fourth area that is a lower end of the third area among the inside of the second area; and displaying the content of the time to turn on the customized content on a fifth area that is a lower end of the fourth area among the inside of the second area.

The present invention can provide satisfaction to customers by providing customized content by reflecting user preferences.

According to the present invention, the user's satisfaction can be improved by providing content based on the user's age group and the user's location information.

BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are included as part of the detailed description to aid understanding of the various embodiments, provide various embodiments and, together with the detailed description, explain technical features of the various embodiments.
1 is a diagram illustrating an operation of a processor according to an embodiment.
2 is a diagram illustrating an operation of displaying customized content on a display according to an embodiment.
3 is a diagram illustrating an operation of acquiring customized content according to an embodiment.
4 is a diagram illustrating an operation of displaying customized content including a moving picture on a display according to an exemplary embodiment.
5 is a diagram illustrating an operation of displaying a reproduction setting of a customized content according to an exemplary embodiment.

Since the present invention can have various changes and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and it should be understood to include all modifications, equivalents and substitutes included in the spirit and scope of the present invention. In describing each figure, like reference numerals have been used for like elements.

Terms such as first, second, A, and B may be used to describe various elements, but the elements should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component. The term “and/or” includes any combination of a plurality of related listed items or any of a plurality of related listed items.

When an element is referred to as being “connected” or “connected” to another element, it is understood that it may be directly connected or connected to the other element, but other elements may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that the other element does not exist in the middle.

The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as “comprise” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the accompanying drawings. In explaining the present invention, in order to facilitate the overall understanding, the same reference numerals are used for the same components in the drawings, and duplicate descriptions of the same components are omitted.

1 is a diagram illustrating an operation of a processor belonging to a control unit according to an embodiment. Referring specifically to FIG. 1 , the at least one processor 110 may be a central processing unit (CPU), a graphics processing unit (GPU), or a dedicated unit in which methods according to embodiments of the present invention are performed. of the processor. Each of the memory 120 and the storage device 160 may be configured of at least one of a volatile storage medium and a non-volatile storage medium. For example, the memory 120 may be one of a read only memory (ROM) and a random access memory (RAM), and the storage device 160 is a flash-memory. , a hard disk drive (HDD), a solid state drive (SSD), or various memory cards (eg, micro SD card).

In addition, the control unit 100 may be included in the control unit, and may include a transceiver 130 for performing communication through a wireless network. Also, the controller 100 may further include an input interface device 140 , an output interface device 150 , a storage device 160 , and the like. Each of the components included in the control unit 100 may be connected by a bus 170 to communicate with each other.

2 is a diagram illustrating an operation of displaying customized content on a display according to an embodiment. 3 is a diagram illustrating an operation of acquiring customized content according to an embodiment.

2 and 3 , the first user terminal 1 includes a display and a camera, the control unit may obtain at least one piece of first object information from an external server, and the first user through the camera It is possible to obtain peripheral image information of the terminal 1 . The first object information may mean information about a thing. This can include information about trees, flowers, clouds, wind, people, cars, as well as items that currently exist. The external server may mean a control unit including the first object information.

In this case, the surrounding image information may include front image information of the first user terminal 1 and, in addition, side and rear image information. That is, a plurality of cameras may be built-in or installed instead of one.

The controller may acquire customized content information based on surrounding image information and the at least one first object information. In this case, the operation of acquiring the customized content information will be described later.

The first user terminal may obtain content, keyword, QR code scan, user pattern change, user emotion change information, and may obtain user experience data. Thereafter, a personalized recommendation service can be provided to users through behavioral patterns, keywords and user input, color analysis, object analysis, correlation analysis, and the like.

Determining the emotion of the image includes composition information included in the content content, size information of objects included in the content content, arrangement information of objects in the content content, behavioral information of objects included in the content content, and objects included in the content content. The emotion may be determined based on the texture information. After determining the emotion of the content, it can be provided as customized content according to the situation and emotion. Depending on the size of the object, the importance can be measured high according to how much space the object occupies in the video, and the main emotion can be determined according to the arrangement method. this can be heard Also, the sensibility may vary depending on the texture.

The controller may display customized content information on the display.

The controller may acquire a surrounding image through the camera, and may recognize flowers, trees, sky, etc. included in the surrounding image. Thereafter, the second object may be derived by matching the recognized flower tree, sky, etc. with the first object information. The second object may mean an object corresponding to an object included in the surrounding image information among the first objects. After recognizing the second object, the color of the second object is derived, the emotion is determined through the color, and user-customized content suitable for the color can be provided.

In this case, the customized content may include user-customized music information and user-customized photo information, in addition to user-customized video information, and in addition to information that is commonly used by users, may be included. In this case, for each user-customized music information, customized music that is music corresponding to the customized music information may be displayed in the first area, and for user-customized photo information, a customized photo may be displayed, and the theme information also corresponds to each music photograph content may be displayed.

In addition, content such as music or video matching the second object may be provided. In an embodiment, if the second object has many objects related to nature,

As an embodiment, if many objects related to nature are included among the second objects, after determining the category of nature, an image or music related to nature may be determined. In this case, images or music related to nature may be determined as in Equation 1, as described later, or may be determined by comprehensively considering the music range, popularity ranking, and the like. In this case, the abundance of nature-related objects may mean a case in which the threshold value is higher than the threshold value set by the user.

In an embodiment, in the case of a natural environment in which there are many trees, if peaceful music is set, it may be set to recommend peaceful music or peaceful images.

In this case, after recognizing the second object, content such as music or video corresponding to the second object may be determined. In this case, the controller may obtain, as an output value, second object information, which is information about a second object corresponding to the first object information, through a machine learning method learned in advance by using the surrounding image information as an input value. The second object may mean objects included in the surrounding information image acquired by the first user terminal 1 as described above. The pre-trained machine learning method may use a deep learning model or the like.

The control unit may obtain a plurality of user preference information from the second user terminal. The first user terminal 1 may mean a device that provides customized content, and the second user terminal may mean a device including the user's preference information, such as a user's smart phone. As will be described later, the user preference information may include the user's age information, the user's gender information, and the user's personality information. In addition, the user's usual content information, the user's usual music information, and the user's second It may include user terminal usage information, user's preferred food information, user's preferred season information, user's preferred weather information, and frequently used application information by the user. The controller may acquire a plurality of preset preference categories from the second user terminal.

A plurality of preset preference categories may mean a category for a preference set by a user, and according to an embodiment, the category may be preset as an active category, a pleasant category, an emotional category, etc., and also an exercise category, a travel category , food categories, etc.

The controller may determine a first preference category from among the plurality of preference categories based on a user input or the plurality of user preference information. The user's input may mean a category preset by the user from among a plurality of preset preference categories. That is, if the user has previously determined a specific preference category, the controller may determine the corresponding category as the first preference category. If there is no category input by the user, the controller may determine the first preference category based on a plurality of user preference information from among a plurality of preset preference categories, which will be described in detail later.

The controller may determine the customized content based on the first preference category. The customized content may include video content, music content, or screen content.

As an embodiment, if the first preference category is determined as the exercise category, an image, music, photo, etc. related to exercise may be determined.

In an embodiment, if the first preference category is determined to be an active category, an active video, music, photo, etc. may be determined. At this time, if an active image, music, or photo is a photo as an embodiment, a photo of an active standard can be determined based on the brightness or color of the color included in the photo. It can be determined, and in the case of an image, the sound range, the frame rate of the image, or the overall atmosphere in the image can be considered. In this case, determining the corresponding music, photo, or video can be done by universal technology.

The controller may output a signal for displaying the customized content on a display included in the first user terminal.

The plurality of user preference information may include age information of the user, gender information of the user, and personality information of the user. The user's age information may be classified into 20's if the user is 21 years old, or may be classified as early 20's, which may be determined by the user's setting. The user's gender information may refer to information that can distinguish whether the user is a man or a woman, and the user's personality information may refer to MBTI information obtained from the sixth external server, and may be preset by the user. have. In addition to the MBTI, commonly used personality type information can be utilized.

The controller may determine the first preference category based on the user's age information, the user's gender information, and the user's personality information among the plurality of preference categories.

The determining of the first preference category based on the user's input or the plurality of user preference information among the plurality of preference categories may include determining that the user determines the first preference category determined before a predetermined number of times as the first preference category. may include

The first preference category determined before the predetermined number of times may mean that the user has set the previously determined first preference category to be determined as the first preference category afterward.

In an embodiment, if the exercise category is determined as the first preference category immediately before, the exercise category may be determined even when the next first preference category is determined. The predetermined number of times may mean the number of times the first preference category is determined in advance by the user before the first preference category at the current time point. The predetermined number of times may mean one determination of the first preference category determined just before the current use, may be used every other time according to a user's setting, or may be set periodically. In an embodiment, an exercise category may be determined on Monday, a food category may be determined on Tuesday, and a different category may be designated for each anniversary based on schedule information obtained from the second user terminal.

In one embodiment, the predetermined number of times is once, and if the first preference category is determined on July 21, 2021, the exercise category is determined, and then the moment when the first preference category is determined on July 22, 2020, before the first The exercise category determined as the preference category may be determined again as the first preference category.

In the method for providing customized content, the control unit may obtain, from a first external server, information on the area in which the first user terminal is located, and date information of the area in which the first user terminal is located. The first external server may mean a control unit including GPS information. Region information in which the user terminal is located may be acquired based on GPS information and may be previously stored. The first external server is also a server including weather information and may mean the Korea Meteorological Administration.

The step of the controller determining the customized content based on the first preference category may further include determining the customized content based on the region information and the date information.

In an embodiment, if the first preference category is a food category, the place where the first user terminal is located is near the beach, and the weather is humid and hot, fish dishes or seafood dishes in consideration of the beach and hot and humid weather among the food categories It is possible to provide content related to, etc.

The control unit may obtain age preference information, which is information about preference of an age group corresponding to the user's age information, from the third external server. The third external information may refer to a control unit including various information preferred by age group.

The controller may determine the customized content based on age preference information. The first user terminal may display information related to customized content based on age group preference information on the screen.

In one embodiment, information such as calm, blue, mysterious, emotional, beach, etc. may be displayed as the preference of the age group in their twenties, and various keywords may be derived. This may mean displaying information on age preference information, which is a basis for determining customized content.

In an embodiment, customized content may be determined based on keywords such as calm blue, mysterious, emotional, and the like.

As an embodiment, contents included in the age preference information may be classified into age preference categories preset by the user.

As an embodiment, each age group may be divided into a color category, a food category, a weather category, an emotion category, a place category, and the like, and numerical values may be differently tabulated for content included in each category.

That is, it is possible to quantify the contents included in the age group preference information to determine a preference value for each category, and to determine customized content corresponding to the preference value for each category. A method of determining the preferred numerical value may be based on Equation 1 below.

[Equation 1]

S may mean a preference value for each category. b may mean the number of preference variables included in the category. As an embodiment, there may be health golf tennis in the exercise category. Ha may mean the number of derived variables corresponding to the a-th variable. As an example, looking at FIG. 5 , it can be seen that the word “stylish” is displayed in plural, and it can be recognized that stylish things are highly preferred by the age group in their twenties. In this case, the displayed number may mean a derived number. In this case, the displayed number may depend on the frequency of words mentioned for each age group from a specific external server or a pre-designated control unit, and may also depend on the weight derived by a universal method. Fa may mean a weight corresponding to the a-th variable.

A category corresponding to a numerical value corresponding to the highest value may be determined by obtaining a preferred numerical value for each category through the corresponding Equation (1). In an embodiment, if the preference value of the exercise category is 12, the preference value of the food category is 20, and the preference value of the emotion category is 15, the food category may be determined as the highest preference value, and customized content for the food category is provided can do. In this case, the determination of the customized content for the food category may be as described above.

In this case, a deep learning model can be used when using a machine learning day, and it can be performed using a machine learning model. In this case, the learning data set may include various voice information and word information obtained from various external control units as the learning data set, and a supervised learning method may be used. In this case, the deep learning model module may use a deep neural network (DNN) algorithm. Without being limited to the description, convolutional neural network (CNN), recurrent neural network (RNN), Restricted Boltzmann Machine (RBM), 　 Deep Belief Network (DBN) algorithms are may be used, and since each algorithm is a well-known technique, a description thereof will be omitted.

The controller may recognize the second object included in the surrounding image information. In this case, recognizing the second object is the same as described above. The controller may acquire color information of the recognized second object. In this case, the color information of the second object may use machine learning. A method for this is the same as described above. The customized content information may be acquired based on the color information.

In this case, providing customized content information based on color information is an embodiment. Assuming that blue and green are mixed in a 7:3 ratio in surrounding image information according to color information, blue and green are mixed in a 7:3 ratio and in advance. Videos with similar proportions within a set difference may be recommended, or photos may be recommended.

The controller may acquire the customized content information based on color information, and may determine a first color from among a plurality of color categories based on the color information by a predetermined method. A first emotion category derived based on the first color among a plurality of emotion categories may be determined. The customized content information may be acquired based on the first emotion category. The first emotion category may be determined based on the determined color value.

In this case, for classifying by a predetermined method, data values for each color previously tabulated for each color may be determined. In this case, the table standard may be set by the user or may be obtained from the second external server. That is, it is possible to determine the color value of the classified colors, and in addition, the color value of the object may be determined.

In an embodiment, if the colors included in an object are green, dark green, and brown, pre-tabled x, y, and z values may be set for each value, and an average value thereof may be determined as a color value. . Thereafter, when a color value is determined, a color corresponding to the corresponding color value may be determined as the first color corresponding to the color information. In this case, the first color corresponding to the color value of the object may be determined as the color corresponding to the object.

At this time, if there is no color whose weight is greater than a certain ratio set by the user in relation to the area area of the object among the values of the colors included in relation to the area area of an object, a preset color matching the determined first color The second color may be determined, and the first emotion category may be determined based on the second color. When the first emotion category is determined, customized content corresponding to the first emotion category may be considered. In this case, the first emotion category corresponding to the color may be tabulated in advance.

In this case, if there are a plurality of objects, there may be a plurality of first emotion categories. In this case, customized content may be determined based on the plurality of first emotion categories. In addition, if there is no color whose weight is greater than a certain ratio set by the user in relation to the area width of the object, among the values of the colors included in relation to the area width of an object, it is representative among all images included in the surrounding image. After determining the color value, a first emotion category matching the representative color value may be determined.

At this time, after determining the representative color value among all images included in the surrounding image, determining the first emotional category matching the representative color value is each value of the included colors in relation to the area width of one object when there are a plurality of objects. In the case of an object having a color whose weight is greater than a certain ratio set by the user in relation to the area width of the object, the first emotion category corresponding to the first color value of the object is determined, and the For each value of the included colors for comparison, in the case where only objects without a color whose weight exceeds a certain ratio set by the user in relation to the area width of the object, the first emotional category may be determined by the representative color value. .

As an embodiment, if there are three objects recognized from one surrounding image information, the first emotion category may be determined for two, but the first emotion category may not be determined for one object. That is, in this case, the first emotion category corresponding to the two objects may be determined, and one representative color value may be determined to determine the first emotion category corresponding to the representative color value. That is, three first emotion categories may be derived as a whole.

In this case, determining the first color may also determine a color value based on values of respective pixels included in the surrounding image information. The values of the pixels may be determined according to the RGB difference, and in addition, a general method may be used.

That is, color recognition may be performed by a commonly used method.

After the first color is determined, the first emotion category corresponding to the color may be determined. In this case, determining the first emotion category may be set by the user.

A first emotion category corresponding to the classified color may be determined, and the customized content information may be acquired based on the determined first emotion category.

An overall color value and an overall emotion may be determined based on the color information and the first emotion category. At this time, if the determined emotion is determined to be warm, peaceful, bright, etc., the corresponding content may be displayed on the display, and the corresponding warm, peaceful, or bright music may be determined as the recommended music. In this case, the music corresponding to the emotion may be set by the user or may be obtained from the fourth external server. In addition, the date, time, and place of the day may be displayed on the display, and information on the date, time, and place may be previously stored or obtained from the first external server. In the case of place information, GPS information may be used.

At this time, receiving warm, peaceful, or bright music as recommended music may be preset by the user, or may be determined as preset and classified music in the fourth external server, music chart ranking of music, specific site of music may be determined in consideration of the popularity ranking of , pre-tabled emotions corresponding to the range of the highlighted part of the music, and emotions corresponding to the average range of the pre-tabled music.

At this time, the sensibility corresponding to the music range may be preset by the user or may be acquired from another external server.

Based on the color information, three most representative plurality of colors and emotions corresponding to the corresponding colors may be derived.

In an embodiment, green, yellow, and sky blue are derived as the first colors, which are the most representative colors, based on the surrounding image information, and emotions corresponding to each may be determined as peaceful, bright, and active emotions. Thereafter, the image may be determined based on the peaceful, bright, and lively emotion. In this case, obtaining the corresponding image may be preset by the user or may be obtained from the fifth external server. Also, at this time, preference information frequently viewed by the user may be included.

In one embodiment, image information frequently viewed by a user among images that are peaceful, bright, active, or all possessed is obtained from a fifth external server, and among images included in the fifth external server, active, bright, or , and peaceful images can be obtained. In this case, an image corresponding to each emotion preset in the fifth external server may be acquired, and an image corresponding to the emotion may be acquired by a user's setting.

In addition, according to an embodiment, obtaining image information corresponding to emotion may be based on Equation 2 below.

[Equation 2]

V may mean an image value obtained based on emotion and incidental information on the image. b may mean the number of variables required to obtain an image value. S _a may mean a weight corresponding to the a-th variable. T _a may mean each numerical value corresponding to the corresponding variable.

In an embodiment, the number of views of the video corresponding to the emotion, the number of likes of the video, the number of dislikes of the video, the number of comments of the video, the number of words included in the comment of the video, corresponding to the first emotion category as a variable necessary to obtain the image value It may include the number of words of emotion, the number of words of emotion corresponding to the first emotion category among the words included in the hashtag of the image, and in addition, the emotion category in which the video is classified in the fifth external server will be included as a numerical value. may be

As an embodiment, in the drawing of FIG. 2 , in consideration of customized content, an emotional image related to an image of a fish falling from a waterfall swimming may be displayed on the display.

In this case, the first user terminal may include a humidity sensor, a temperature sensor, and a sound sensor, and may recommend customized content based on the humidity sensor, the temperature sensor, and the sound sensor.

In an embodiment, if the temperature is higher than or equal to a predetermined temperature based on the temperature sensor, an arrow indicating an emergency exit may be displayed along with a safety phrase through the display.

In an embodiment, when a noise of more than a certain decibel is generated based on the sound sensor, it is possible to control to display a text asking to be quiet on the display.

According to an embodiment, based on the sound sensor, the user's mood may be inferred according to the user's voice or trembling, and content capable of giving a positive effect may be provided.

In an embodiment, when it is determined that there is no person around the first user terminal based on a temperature sensor or a camera, the display may be controlled to be turned off, and if a person is detected, the display may be changed to be turned on again.

The control unit may obtain 301 first object information from an external server, obtain 302 surrounding image information and a plurality of user preference information, determine 303 customized content information, and customize content The information may be displayed 304 on a display.

4 is a diagram illustrating an operation of displaying customized content including a moving picture on a display according to an exemplary embodiment.

Referring specifically to FIG. 4 , the customized content in the first user terminal 1 may include user-customized video information and theme information for the customized content. The theme information may mean general introduction information about the customized image. According to an embodiment, the production of a dreamlike atmosphere, which is an atmosphere corresponding to the customized image, may belong to the theme information.

The controller may display a custom image, which is an image corresponding to the customized video information, on the first area 10 that is a left area of the display screen. In this case, the first region may be specifically disposed in the lower left region in the left region. Specifically, the content indicating the current location of the first user terminal may be displayed on the upper portion, and may be displayed on the first area 10 that is the lower left area. As described above, customized music or customized photos may be displayed in the first region 10 . Based on the theme information, the controller may display theme content, which is content for a theme corresponding to the customized image, in the second area 11 , which is a right area of the first area 10 . The control unit may determine a first emotion category based on the surrounding image information, the first object information, and the preference information among the plurality of emotion categories, and add additional content to the customized content corresponding to the first emotion category to the second It can be displayed together in the area 11 .

The control unit may acquire location information where the first user terminal is located from an external server, and the first user terminal is disposed based on at least one of location information, the surrounding image information, the first object information, and the preference information A recommended place, which is a space to be used, may be determined, and the first emotion category may be determined based on the recommended place.

The additional content may mean additional content corresponding to the customized content. The content of the atmosphere, the content of the time when the customized content is to be turned on, and the description of a recommended place suitable for the customized content may be included. The control unit may display the description of the recommended place in a third area that is an upper end of the area corresponding to the customized image among the inside of the second area 11 , and display the atmosphere content corresponding to the customized content in the second area It can be displayed in the fourth area 13 that is the lower end of the third area 12 of the inside, and the content of the time to turn on the customized content is displayed in the fourth area 13 of the inside of the second area 11. It may be displayed in the fifth area 14, which is the lower part. In this case, the display may be outputting a displayed signal. In this case, the contents displayed in the first area 10 , the second area 11 , the third area 12 , the fourth area 13 , and the fifth area 14 may be displayed interchangeably according to the user's setting. have.

At this time, a plurality of customized images, customized photos, or customized music may be recommended and presented as shown in FIG. 4 , and in this case, the corresponding customized image, customized photo, or customized music is the customized content most preferred by the user in the first area 10 . You can set it to be displayed from the top to the bottom. In this case, the customized content preferred by the user may be determined according to the numerical value of [Equation 1] described above, or may be set by the user. In addition, according to the user's setting, it can be set to be displayed sequentially from the most preferred customized content according to a preset display time, rather than being simultaneously viewed in a line from top to bottom in the first area 10, and images or music corresponding to the customized content , You can also set it to display one or two pictures instead of three, or more depending on the user's settings.

5 is a diagram illustrating an operation of displaying a reproduction setting of a customized content according to an exemplary embodiment.

Referring specifically to FIG. 5 , the user may set a playback setting for playing the customized content in the first user terminal 1 . You can set the date to play the customized content, the start time and the end time of the play, and you can set whether to repeat every day, whether to exclude holidays, whether to play shuffle or whether to repeat play. An indication of receiving may be displayed.

The methods according to the present invention may be implemented in the form of program instructions that can be executed by various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the computer-readable medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the art of computer software.

Examples of computer-readable media may include hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions may include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as at least one software module to perform the operations of the present invention, and vice versa.

In addition, the above-described method or apparatus may be implemented by combining all or part of its configuration or function, or may be implemented separately.

Although the above has been described with reference to preferred embodiments of the present invention, those skilled in the art can variously modify and change the present invention within the scope without departing from the spirit and scope of the present invention as set forth in the claims below. You will understand that it can be done.

1: first user terminal

Claims (5)

A method for providing customized content performed by a first user terminal including a control unit, the method comprising:
acquiring surrounding image information;
obtaining first object information from an external server;
obtaining a plurality of user preference information from a second user terminal;
determining customized content based on the surrounding image information and the first object information or based on the preference information; and
Displaying the customized content on a display of the first user terminal,
The surrounding image information includes front image information of the first user terminal obtained through a camera included in the first user terminal or photographed image information of an area in which the first user terminal is to be arranged obtained from the second user terminal do,
The plurality of user preference information includes the user's age information, the user's gender information, and the user's personality information,
The customized content includes user-customized video information and theme information for the customized content,
Displaying the customized content on the display comprises:
A customized image that is an image corresponding to the customized video information is displayed in a first region that is a left region of the display screen, and a theme content that is a theme corresponding to the customized image is displayed in the first region based on the theme information. Including; displaying on the second area that is the right area of
The step of determining the customized content based on the surrounding image information and the first object information or based on the preference information,
Determining a first emotion category based on surrounding image information, the first object information, and the preference information among a plurality of emotion categories;
The step of displaying the customized content on the display comprises:
Based on the first emotion category, displaying additional content for the customized content corresponding to the first emotion category together in the second area;
Further comprising; obtaining location information on which the first user terminal is located from the first external server;
The step of determining the customized content based on the surrounding image information and the first object information or based on the preference information,
determining a recommended place, which is a space in which the first user terminal is to be disposed, based on at least one of the location information, the surrounding image information, the first object information, and the preference information; and
and determining the first emotional category based on the recommended place. According to claim 1,
The additional content is
It includes a description of a time to play the customized content and a recommended place for the customized content to match,
Based on the first emotion category, displaying additional content for the customized content corresponding to the first emotion category together in the second area includes:
displaying the description of the recommended place in a third area that is an upper end of an area corresponding to the customized image among the inside of the second area;
displaying the theme content in a fourth area that is a lower end of the third area among the inside of the second area; and
and displaying the content of the time when the customized content is to be turned on in a fifth area that is a lower end of the fourth area among the inside of the second area. delete delete delete

Images