KR102619388B1 - Method, device and system for providing interface that implement visual effect depending on access related to metaverse memorial hall service based on constellation - Google Patents

Abstract

According to one embodiment, in a method of providing an interface for implementing a visual effect according to a connection related to a constellation-based metaverse memorial service performed by a device, when it is confirmed that the first user is wearing an output device, the display is displayed in the sky or outer space. Controlling the initial screen of the memorial service with constellations displayed on the output device to be displayed; When the first user is wearing an operating device and the first constellation or first star is selected on the initial screen through the operating device, the first constellation or first star is set for whose memory. Confirmation steps; If it is confirmed that the first constellation or the first star is set to commemorate the first deceased or the first companion animal, a memorial space for the memorial of the first deceased or the first companion animal is implemented in the metaverse environment. controlling a screen of the first virtual space to be displayed on the output device so that the first user is connected to the first virtual space; And when movement within the first virtual space is requested through the operating device, the point at which the first user is located in the first virtual space is changed, and the screen of the first virtual space is displayed centered on the changed point. A method of providing an interface for implementing visual effects according to access related to a constellation-based metaverse memorial service is provided, including the step of controlling the display to be displayed on the output device.

Description

Method, device and system for providing an interface for implementing visual effects according to access to constellation-based Metaverse Memorial Hall service {METHOD, DEVICE AND SYSTEM FOR PROVIDING INTERFACE THAT IMPLEMENT VISUAL EFFECT DEPENDING ON ACCESS RELATED TO METAVERSE MEMORIAL HALL SERVICE BASED ON CONSTELLATION}

The following embodiments relate to technology for providing an interface that implements visual effects according to access related to the metaverse memorial service based on constellations.

Usually, when a person or a pet dies, the body is cremated or a cemetery is created, and along with this, the deceased or dead pet, that is, the items the deceased had before death, are organized, so there are not many people left who miss the deceased. The only way to appease the longing for the dead is by reminiscing about them through old photos or mementos of the dead.

However, this is only possible when old photos or mementos of the deceased remain intact. As time passes, old photos or mementos of the deceased are bound to be damaged, and these old photos or mementos of the deceased alone are not enough to preserve the memories spent with the deceased. It's reality.

Recently, metaverse has been in the spotlight as a representative service that provides virtual worlds to users. Metaverse is a compound word of meta, meaning processing and abstraction, and universe, meaning the real world, and refers to a three-dimensional virtual world. The core technologies of this metaverse are virtual reality (VR), It is an extended reality (XR) technology that encompasses augmented reality (AR) and mixed reality (MR).

In order to relieve the sense of loss and sadness of people who live with the emotional wounds of bereavement of the deceased, there is an urgent need for the development of content that can interact with the deceased or dead pets using the metaverse environment described above.

Therefore, as the demand to provide a memorial space to commemorate the deceased or dead companion animal in the metaverse environment is increasing, research on related technologies is required.

Korean Patent No. 10-2410670 Korean Patent Publication No. 10-2021-0151713 Korean Patent Publication No. 10-2020-0125054 Korean Patent Publication No. 10-2019-0134912

According to one embodiment, when it is confirmed that the first user is wearing the output device, the initial screen of the memorial service showing constellations in the sky or outer space is controlled to be displayed on the output device, and the first user controls the operation device If you are wearing it, when the first constellation or first star is selected on the initial screen through the control device, check whose memorial the first constellation or first star is set for, and select the first constellation or first star. If it is confirmed that the memorial space for the first deceased or the first companion animal is set up to commemorate the first deceased or the first companion animal, the first user is in the first virtual space where the memorial space for the first deceased or the first companion animal is implemented in the metaverse environment. Controls the screen of the first virtual space to be displayed on the output device so that it is connected, and when movement within the first virtual space is requested through the operation device, the point where the first user is located in the first virtual space is changed. The purpose is to provide a method, device, and system for providing an interface for implementing visual effects according to access to the constellation-based metaverse memorial service, which controls the screen of the first virtual space to be displayed on the output device centered on the changed point.

The object of the present invention is not limited to the object mentioned above, and other objects not mentioned can be clearly understood from the description below.

According to one embodiment, in a method of providing an interface for implementing a visual effect according to a connection related to a constellation-based metaverse memorial service performed by a device, when it is confirmed that the first user is wearing an output device, the display is displayed in the sky or outer space. Controlling the initial screen of the memorial service with constellations displayed on the output device to be displayed; When the first user is wearing an operating device and the first constellation or first star is selected on the initial screen through the operating device, the first constellation or first star is set for whose memory. Confirmation steps; If it is confirmed that the first constellation or the first star is set to commemorate the first deceased or the first companion animal, a memorial space for the memorial of the first deceased or the first companion animal is implemented in the metaverse environment. controlling a screen of the first virtual space to be displayed on the output device so that the first user is connected to the first virtual space; And when movement within the first virtual space is requested through the operating device, the point at which the first user is located in the first virtual space is changed, and the screen of the first virtual space is displayed centered on the changed point. A method of providing an interface for implementing visual effects according to access related to a constellation-based metaverse memorial service is provided, including the step of controlling the display to be displayed on the output device.

The step of controlling the screen of the first virtual space to be displayed on the output device includes, when it is confirmed that the first constellation or the first star is selected, the first zone where the first constellation or the first star is located on the initial screen. enlarging and controlling the screen of the first zone to be displayed on the output device; If it is confirmed that the memorial space for commemorating the first deceased or the first companion animal is the first virtual space, the screen of the access video accessing the first virtual space following the screen of the first zone is displayed on the output device. controlling to be displayed; and controlling the screen of the first virtual space to be displayed on the output device following the screen of the connected video.

The step of controlling the screen of the access video accessing the first virtual space to be displayed on the output device following the screen of the first zone includes the first deceased or the first companion animal being implemented as a character of the first age group. Controlling the image of the first avatar to be displayed on both walls of the first section; And controlling the image of the second avatar, in which the first deceased or the first companion animal is embodied as a character of a second age group older than the first age group, to be displayed on the walls on both sides of the second section following the first section. May include steps.

The step of controlling the screen of the first virtual space to be displayed on the output device following the screen of the access video includes the step of controlling the first deceased or the first companion animal as a character of a third age group older than the second age group. setting the implemented third avatar to be displayed in the first virtual space; And controlling the third avatar to be displayed in the first virtual space so that the first user can feel the experience of encountering the first deceased or the first companion animal through the third avatar. there is.

The step of controlling the screen of the first virtual space to be displayed on the output device following the screen of the connected video includes the experience of the first user encountering the first deceased or the first companion animal through the third avatar. After the step of controlling the screen of the first virtual space to be displayed on the output device so that one can feel, if the memorial place is selected as the first place and the encounter year is selected as the first year through the operation device, the first setting a virtual space to be implemented as the first location in the first year; Confirming the age group of the first deceased or the first companion animal as a fourth age group based on the first year; Setting a fourth avatar implemented as a character of the fourth age group to be displayed on the first virtual space implemented as the first location in the first year; and controlling the fourth avatar to be displayed in the first virtual space so that the first user can feel the experience of encountering the first deceased or the first companion animal in the first place and in the first year. It may further include.

According to one embodiment, by providing a memorial space to commemorate the deceased or dead pet in the metaverse environment, the user can interact with the deceased or dead pet in the metaverse environment, so that the user can interact with the deceased or dead pet with a higher level of immersion. It has the effect of allowing you to communicate with dead pets.

Meanwhile, the effects according to the embodiments are not limited to those mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description below.

1 is a diagram schematically showing the configuration of a system according to an embodiment.
Figure 2 is a flow chart to explain the process of providing an interface for the metaverse memorial service based on constellations according to an embodiment.
Figure 3 is a flowchart for explaining a process for providing visual effects when accessing a virtual space according to an embodiment.
Figure 4 is a diagram for explaining a connection video for accessing a virtual space according to an embodiment.
Figure 5 is a flowchart for explaining the process of providing visual effects according to the memorial location and encounter year according to an embodiment.
Figure 6 is a flowchart for explaining the process of recommending a joint condolence statement according to an embodiment.
Figure 7 is a flow chart for explaining the process of recommending product development for users using the memorial service according to an embodiment and matching influencers who will advertise the product.
FIG. 8 is a diagram illustrating a process of selecting an influencer to advertise a product based on information on a candidate influencer according to an embodiment.
Figure 9 is an exemplary diagram of the configuration of a device according to an embodiment.

Hereinafter, embodiments will be described in detail with reference to the attached drawings. However, various changes can be made to the embodiments, so the scope of the patent application is not limited or limited by these embodiments. It should be understood that all changes, equivalents, or substitutes for the embodiments are included in the scope of rights.

Specific structural or functional descriptions of the embodiments are disclosed for illustrative purposes only and may be modified and implemented in various forms. Accordingly, the embodiments are not limited to the specific disclosed form, and the scope of the present specification includes changes, equivalents, or substitutes included in the technical spirit.

Terms such as first or second may be used to describe various components, but these terms should be interpreted only for the purpose of distinguishing one component from another component. For example, a first component may be named a second component, and similarly, the second component may also be named a first component.

When a component is referred to as being “connected” to another component, it should be understood that it may be directly connected or connected to the other component, but that other components may exist in between.

The terms used in the examples are for descriptive purposes only and should not be construed as limiting. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, terms such as “comprise” or “have” are intended to designate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, but are not intended to indicate the presence of one or more other features. It should be understood that this does not exclude in advance the possibility of the existence or addition of elements, numbers, steps, operations, components, parts, or combinations thereof.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as generally understood by a person of ordinary skill in the technical field to which the embodiments belong. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and unless explicitly defined in the present application, should not be interpreted in an ideal or excessively formal sense. No.

In addition, when describing with reference to the accompanying drawings, identical components will be assigned the same reference numerals regardless of the reference numerals, and overlapping descriptions thereof will be omitted. In describing the embodiments, if it is determined that detailed descriptions of related known technologies may unnecessarily obscure the gist of the embodiments, the detailed descriptions are omitted.

Embodiments may be implemented in various types of products such as personal computers, laptop computers, tablet computers, smart phones, televisions, smart home appliances, intelligent vehicles, kiosks, and wearable devices.

An artificial intelligence (AI) system is a computer system that implements human-level intelligence, and unlike existing rule-based smart systems, it is a system in which machines learn and make decisions on their own. As artificial intelligence systems are used, their recognition rates improve and they can more accurately understand user preferences, and existing rule-based smart systems are gradually being replaced by deep learning-based artificial intelligence systems.

Artificial intelligence technology consists of machine learning and element technologies using machine learning. Machine learning is an algorithmic technology that classifies/learns the characteristics of input data on its own, and elemental technology is a technology that mimics the functions of the human brain such as cognition and judgment by utilizing machine learning algorithms such as deep learning, including linguistic understanding and visual It consists of technical areas such as understanding, reasoning/prediction, knowledge expression, and motion control.

The various fields where artificial intelligence technology is applied are as follows. Linguistic understanding is a technology that recognizes and applies/processes human language/characters and includes natural language processing, machine translation, conversation systems, question and answer, and voice recognition/synthesis. Visual understanding is a technology that recognizes and processes objects like human vision, and includes object recognition, object tracking, image search, person recognition, scene understanding, spatial understanding, and image improvement. Inferential prediction is a technology that judges information to make logical inferences and predictions, and includes knowledge/probability-based reasoning, optimization prediction, preference-based planning, and recommendations. Knowledge expression is a technology that automatically processes human experience information into knowledge data, and includes knowledge construction (data creation/classification) and knowledge management (data utilization). Motion control is a technology that controls the autonomous driving of vehicles and the movement of robots, and includes motion control (navigation, collision, driving), operation control (behavior control), etc.

Generally, in order to apply machine learning algorithms to real life, learning is performed using a trial and error method due to the nature of the basic methodology of machine learning. In particular, deep learning requires hundreds of thousands of iterations. It is impossible to execute this in an actual physical external environment, so instead, the actual physical external environment is virtually implemented on a computer and learning is performed through simulation.

1 is a diagram schematically showing the configuration of a system according to an embodiment.

Referring to FIG. 1 , a system according to one embodiment may include an output device 100, an operating device 200, and a device 300.

First, the output device 100 is a device that outputs a screen implemented in a metaverse environment and can be electrically connected to the device 300.

Here, metaverse is a compound word of meta, meaning processing and abstraction, and universe, meaning the real world. In an online three-dimensional virtual world, individuals embodied as characters or avatars communicate with each other, It refers to a platform that allows you to carry out activities in the real world. This metaverse environment may include extended reality (XR), which encompasses virtual reality (VR), augmented reality (AR), and mixed reality (MR).

Virtual reality refers to a technology that uses a computer to build a virtual space that does not exist in the real world and then makes the virtual space feel like reality, while augmented reality or mixed reality is a technology that adds computer-generated information to the real world. Technology, that is, technology that allows real-time interaction with users by combining the real world and the virtual world. The metaverse environment in the present invention can be implemented through any one of virtual reality, augmented reality, and mixed reality. You can.

The output device 100 is worn by the user to output images on the screen implemented in the metaverse environment. For example, it is mounted on the user's head or eyes to output VR/AR images directly in front of the user's eyes. It may be provided as a display device, such as a head mounted display (HMD). A head-mounted display is a type of wearable video output terminal that allows users to experience realistic images. The display is mainly mounted on the front of the helmet and can output images such as VR/AR.

The output device 100 can track the user's gaze through the head movement of the user wearing the output device 100, and can process the image to be changed and displayed according to the user's gaze movement through head tracking. That is, the output device 100 can quantify the rotation angle and speed of the user's head and process the image so that it changes in the same direction as the movement of the user's head. For example, if the user's head turns to the right, the image on the screen implemented in the metaverse environment will move to the right, and if the user's head rotates to the left, the image on the screen implemented in the metaverse environment will also move to the left. You can.

The manipulation device 200 is a device worn by the user and generates a manipulation signal for a command according to the user's manipulation, and may be electrically connected to the device 300.

The manipulation device 200 is worn on the user's hand to interact on a screen implemented in a metaverse environment, for example, tracking the user's motion, providing physical feedback, and providing tactile feedback. It can be provided with VR/AR gloves.

These VR/AR gloves track the motion of the user's fingers, hands, and wrists and implement them in VR/AR, and apply a preset amount of tension to each finger to improve the hardness of objects in VR/AR. The texture is expressed through the vibration sensor installed on each finger. In the present invention, when the user generates a manipulation signal using a VR/AR glove to interact in the metaverse environment, the manipulation signal is used to control the metaverse-based Experience services may be provided.

The device 300 may be its own server owned by a person or organization that provides services using the device 300, a cloud server, or a p2p (peer-to-peer) set of distributed nodes. It may be possible. The device 300 may be configured to perform all or part of the calculation function, storage/reference function, input/output function, and control function of a typical computer.

The device 300 may be configured to communicate wired or wirelessly with the output device 100, can control which information to display on the screen of the output device 100, and controls the overall operation of the output device 100. can do.

The device 300 may be configured to communicate wired or wirelessly with the manipulation device 200, can obtain a manipulation signal from the manipulation device 200, recognize user manipulation, and control the overall operation of the manipulation device 200. You can.

Meanwhile, the device 300 may include a plurality of pre-trained artificial neural networks to perform machine learning algorithms.

In the present invention, artificial intelligence (AI) refers to technology that imitates human learning ability, reasoning ability, perception ability, etc. and implements this with a computer, and includes concepts such as machine learning and symbolic logic. may include. Machine Learning (ML) is an algorithmic technology that classifies or learns the characteristics of input data on its own. Artificial intelligence technology is a machine learning algorithm that analyzes input data, learns the results of the analysis, and makes judgments or predictions based on the results of the learning. Additionally, technologies that mimic the functions of the human brain, such as cognition and judgment, using machine learning algorithms can also be understood as the category of artificial intelligence. For example, technical fields such as verbal understanding, visual understanding, reasoning/prediction, knowledge representation, and motion control may be included.

Machine learning can refer to the process of training a neural network model using experience processing data. Machine learning can mean that computer software improves its own data processing capabilities. A neural network model is built by modeling the correlation between data, and the correlation can be expressed by a plurality of parameters. A neural network model extracts and analyzes features from given data to derive correlations between data. Repeating this process to optimize the parameters of the neural network model can be called machine learning. For example, a neural network model can learn the mapping (correlation) between input and output for data given as input-output pairs. Alternatively, a neural network model may learn the relationships by deriving regularities between given data even when only input data is given.

An artificial intelligence learning model or neural network model may be designed to implement the human brain structure on a computer, and may include a plurality of network nodes with weights that simulate neurons of a human neural network. A plurality of network nodes may have a connection relationship with each other by simulating the synaptic activity of neurons in which neurons exchange signals through synapses. In an artificial intelligence learning model, multiple network nodes are located in layers of different depths and can exchange data according to convolutional connection relationships. The artificial intelligence learning model may be, for example, an artificial neural network model (Artificial Neural Network), a convolution neural network (CNN) model, etc. As an example, an artificial intelligence learning model may be machine-learned according to methods such as supervised learning, unsupervised learning, and reinforcement learning. Machine learning algorithms for performing machine learning include Decision Tree, Bayesian Network, Support Vector Machine, Artificial Neural Network, and Ada-boost. , Perceptron, Genetic Programming, Clustering, etc. can be used.

Among them, CNN is a type of multilayer perceptrons designed to use minimal preprocessing. CNN consists of one or several convolution layers and general artificial neural network layers on top of them, and additionally utilizes weights and pooling layers. Thanks to this structure, CNN can fully utilize input data with a two-dimensional structure. Compared to other deep learning structures, CNN shows good performance in both video and audio fields. CNNs can also be trained via standard back propagation. CNNs have the advantage of being easier to train and using fewer parameters than other feedforward artificial neural network techniques.

Convolutional networks are neural networks that contain sets of nodes with bound parameters. The increasing size of available training data and the availability of computational power, combined with algorithmic advances such as piecewise linear unit and dropout training, have led to significant improvements in many computer vision tasks. For extremely large data sets, such as those available for many tasks today, overfitting is not critical, and increasing the size of the network improves test accuracy. Optimal use of computing resources becomes a limiting factor. For this purpose, distributed, scalable implementations of deep neural networks can be used.

According to one embodiment, the device 300 may provide a memorial service in a metaverse environment based on constellations. Here, the memorial service is a service that allows you to purchase stars or constellations to commemorate the deceased or a pet and bury them in the sky or outer space. It is a service that allows you to commemorate the deceased or a pet by embodying them in a metaverse environment. am.

The device 300 may display a constellation and provide a user interface to access a memorial space matched to a specific star or constellation. At this time, the device 300 can provide the initial screen of the service by displaying constellations in the sky or outer space, and can process the constellations to be displayed in harmony with each menu required to use the service. A detailed description regarding this will be provided later with reference to FIG. 2 .

The device 300 may provide an interface for implementing various visual effects when providing memorial services in a metaverse environment. For example, when a specific star or a specific constellation is selected, the device 300 applies a time loop-like sucking effect when accessing a memorial site through the selected star or constellation, creating a visual effect to transform it into a memorial site. can be provided. At this time, in the process of accessing the memorial location, the life story of the deceased or companion animal that is the subject of memorialization may be displayed as a video. A detailed description related to this will be described later with reference to FIGS. 3 and 4.

The device 300 can provide a user-customized metaverse environment in providing memorial service in a metaverse environment. For example, when the user selects a memorial location and encounter year, the device 300 customizes the metaverse environment so that the user can feel the experience of encountering the deceased or a companion animal at the selected memorial location and encounter year. can do. A detailed description regarding this will be provided later with reference to FIG. 5 .

In the video implemented in the metaverse environment, various menus used in the memorial service may be provided as icons, for example, conversation enablement, link sharing, sound on/off, screen rotation, search, confirmation of users entering the memorial space, Menus such as Favorites, Home, and Back can be displayed as button-type icons. When a button-type icon is selected, commands for the corresponding menu can be processed through the selected icon.

Figure 2 is a flow chart to explain the process of providing an interface for the metaverse memorial service based on constellations according to an embodiment.

Referring to FIG. 2 , first, in step S201, the device 300 may confirm that the first user is wearing the output device 100. At this time, when the device 300 obtains a detection signal from a sensor attached to the output device 100, it can confirm that the first user is wearing the output device 100.

In step S202, if it is confirmed that the first user is wearing the output device 100, the device 300 may control the initial screen of the memorial service to be displayed on the output device 100. At this time, the initial screen is a screen in which constellations are displayed in the sky or outer space, and the constellations displayed on the initial screen may include stars or constellations traded in memory of the deceased or a companion animal.

The initial screen may be provided as a 3D image of the sky or outer space, and the displayed area may change depending on the user's gaze movement. A detailed description regarding this will be provided later with reference to FIG. 3 .

When the first user information is confirmed, the device 300 can control the output device 100 to display an initial screen customized for the first user. A detailed description regarding this will be provided later with reference to FIG. 4 .

If the first user information is not confirmed, the device 300 may control the output device 100 to display a randomly provided initial screen. At this time, the device 300 can control the constellations to be displayed larger in the sorted order by sorting the constellations in the order in which they are most searched for or accessed during a certain period of time.

In step S203, when the first user is wearing the manipulation device 200 and the first constellation or first star is selected on the initial screen through the manipulation device 200, the device 300 operates the manipulation device 200. A selection signal for the first constellation or first star can be obtained from.

For example, the first user can select a first constellation, which is one of the constellations displayed in the sky or outer space, through the manipulation device 200, and the device 300 selects the first constellation from the manipulation device 200. 1 You can obtain the selection signal for the constellation.

In addition, the first user can select a first star, which is one of the stars displayed in the sky or outer space, through the manipulation device 200, and the device 300 selects the first star from the manipulation device 200. A selection signal can be obtained.

In step S204, the device 300 may confirm that the first constellation or the first star is set to commemorate the first deceased or the first companion animal.

That is, when the first constellation or the first star is selected on the initial screen through the operation device 200, the device 300 checks for whose memorial the first constellation or the first star is set, and selects the first constellation for whose memory the first constellation or the first star is selected. Alternatively, it can be confirmed that the first star is set to commemorate the first deceased or the first companion animal. For this purpose, constellation information and star information are stored in the database of the device 300, and the constellation information and star information may include information about memorial objects, transaction details, access details, etc.

For example, when the device 300 obtains a selection signal for the first constellation from the manipulation device 200, the device 300 searches the database to obtain first constellation information, and based on the first constellation information, selects the first constellation You can check whose memorial is set for.

In addition, when the device 300 obtains a selection signal for the first star from the operating device 200, the device 300 searches the database to obtain first star information, and determines who the first star is based on the first star information. You can check if it is set up to commemorate .

In step S205, if it is confirmed that the first constellation or the first star is set to commemorate the first deceased or the first companion animal, the device 300 creates a memorial space for the memorial of the first deceased or the first companion animal. The screen of the first virtual space corresponding to can be controlled to be displayed on the output device 100.

For this purpose, a virtual space corresponding to each memorial space accessible through a constellation or star is implemented in a metaverse environment, and the first virtual space corresponds to a memorial space accessible through the first constellation or star. It can refer to a virtual space implemented in a metaverse environment.

The device 300 can control the screen of the first virtual space to be displayed on the output device 100 worn by the first user, so that the first user is connected to the first virtual space, and the first user Through the screen of the first virtual space displayed on the output device 100, you can feel the same experience as accessing the first virtual space. At this time, a character created based on the first deceased or the first companion animal is displayed on the screen of the first virtual space, providing a memorial service that allows communication with the first deceased or the first companion animal in a metaverse environment. there is.

In step S206, when movement within the first virtual space is requested through the manipulation device 200, the device 300 may obtain a movement request signal from the manipulation device 200.

In step S207, when it is confirmed that movement within the first virtual space is requested through the movement request signal, the device 300 changes the point where the first user is located in the first virtual space, and places the changed point as the center. It is possible to control the screen of the first virtual space to be displayed on the output device 100.

For example, when a first user accesses a first virtual space, the first user may be located at a first point within the first virtual space, and the device 300 may be located in the first virtual space centered on the first point. The screen can be controlled to be displayed on the output device 100.

Thereafter, when the first user moves to a second point within the first virtual space due to a movement request within the first virtual space, the device 300 outputs the screen of the first virtual space centered on the second point. It can be controlled to be displayed on the device 100.

Figure 3 is a flowchart for explaining a process for providing visual effects when accessing a virtual space according to an embodiment.

Referring to FIG. 3, first, in step S301, the device 300 can confirm that the first constellation or the first star is selected on the initial screen.

For example, when the device 300 obtains a selection signal for the first constellation from the manipulation device 200, the device 300 may confirm that the first constellation is selected and receive a selection signal for the first star from the manipulation device 200. Once acquired, it can be confirmed that the first star has been selected.

In step S302, the device 300 may control the initial screen to enlarge the first zone where the first constellation or the first star is located and display the screen of the first zone on the output device 100.

For example, when it is confirmed that the first constellation is selected on the initial screen, the device 300 enlarges the first zone where the first constellation is located on the initial screen so that the screen of the first zone is displayed on the output device 100. You can control it.

In addition, when it is confirmed that the first star is selected on the initial screen, the device 300 enlarges the first zone where the first star is located on the initial screen and controls the display so that the screen of the first zone is displayed on the output device 100. You can.

In step S303, if it is confirmed that the first constellation or the first star is set to commemorate the first deceased or the first companion animal, the device 300 creates a memorial space for the memorial of the first deceased or the first companion animal. It can be confirmed that this is the first virtual space.

For example, if the first constellation is selected on the initial screen and the first constellation is confirmed as a constellation set for the memorial of the first deceased, the device 300 creates a memorial space for the first deceased through the first constellation. It can be confirmed that this is the first virtual space, and if the first constellation is confirmed to be a constellation set for the memorial of the first companion animal, the memorial space for the first companion animal through the first constellation is the first virtual space. This can be confirmed.

In addition, when the first star is selected on the initial screen, the device 300 confirms that the first star is a star set to commemorate the first deceased, and the memorial space for the first deceased is created through the first star. It can be confirmed that it is a virtual space, and if the first star is confirmed to be a star set for the memorial of the first companion animal, it can be confirmed that the memorial space for the first companion animal is the first virtual space through the first star. .

In step S304, the device 300 may control the output device 100 to display a screen of a connection video connecting to the first virtual space following the screen of the first zone. At this time, the device 300 can control the connection image connecting to the first virtual space to be output by applying the effect of being sucked into the first virtual space. A detailed description regarding this will be provided later with reference to FIG. 4 .

In step S305, the device 300 may control the output device 100 to display the screen of the first virtual space following the screen of the connection video connecting to the first virtual space. At this time, the device 300 processes the screen of the first virtual space to be displayed after being sucked into the first virtual space, so that the user can feel the same experience as accessing the first virtual space, implemented in a metaverse environment. Video can be provided.

Figure 4 is a diagram for explaining a connection video for accessing a virtual space according to an embodiment.

First, when creating a memorial space, the device 300 may receive deceased information or companion animal information from the terminal of a user who wishes to create a memorial space and store it in a database. Here, the deceased information may include information about the deceased's photo, video, age, gender, appearance, height, weight, personality, habits, facial expression, voice intensity, voice pitch, timbre, pronunciation, tone, etc. by age group. , Pet information may include information about the pet's photos, videos, age, gender, appearance, height, weight, personality, habits, facial expressions, voice intensity, voice pitch, and timbre, etc., by age group.

If the device 300 determines that the memorial space for commemorating the first deceased or the first companion animal is the first virtual space, the device 300 displays the n-th avatar in which the first deceased or the first companion animal is implemented as a character of the n-th age. can be created.

The device 300 can create an avatar for the deceased by age group based on the deceased's information, and 3D scans the front, back, left, right, flat, bottom, and oblique sides of the deceased shown in the photo or video to identify the deceased. After building a basic appearance, you can create an avatar for the deceased by reflecting detailed information such as age, gender, appearance, height, weight, personality, habits, and facial expressions, and implementing 3D animation of the character. You can.

In addition, the device 300 can create avatars for pets by age group based on pet information, and can display the front, back, left, right, flat, bottom, and oblique sides of a dead pet shown in a photo or video. After building the basic appearance of the dead pet through 3D scanning, detailed information such as age, gender, appearance, height, weight, personality, habits, and facial expressions are reflected to create the dead pet's character and create 3D animation of the character. By implementing this, you can create an avatar for your pet.

For example, the device 300 may generate a first avatar in which the first deceased or the first companion animal is implemented as a character of a first age group, and the first deceased or the first companion animal may be implemented as a character of a second age group. A second avatar may be created, and a third avatar may be created in which the first deceased or the first companion animal is embodied as a character of a third age group. Here, the first age group may be set using the lowest age group information among the age-specific information included in the deceased information or companion animal information, and the second age group may be set as an age group older than the first age group. The 3 age group may be set as an age group older than the second age group.

In the present invention, for convenience of explanation, the third age group is set as the highest age group, but it is not limited thereto, and the fourth age group, fifth age group, etc. may be set as the highest age group depending on the deceased or the companion animal. .

Specifically, if it is confirmed that the memorial space for commemorating the first deceased is the first virtual space, the device 300 may query the database to obtain information on the first deceased. At this time, the first deceased information may include 1-1 deceased information, 1-2 deceased information, 1-3 deceased information, etc. classified by age group, and the 1-1 deceased information may include 10 deceased persons. It may include information about photos, videos, etc. when the first deceased was in his or her 20s, and information about the 1st-2nd deceased may include information about photos, videos, etc. when the first deceased was in his 20s, and information about the 1st-3rd deceased may include information about the first deceased when he was in his 20s. 1 May include information about photos, videos, etc. from when the deceased was in his 30s.

Thereafter, the device 300 may generate a first avatar in which the first deceased is embodied as a character in his teens based on the information on the 1-1 deceased, and the first deceased may create a first avatar based on the information on the 1-2 deceased. A second avatar embodied as a character in their 20s can be created, and a third avatar embodied in the first deceased as a character in their 30s can be created based on information on the first to third deceased.

Meanwhile, if it is confirmed that the memorial space for commemorating the first companion animal is the first virtual space, the device 300 may query the database to obtain information on the first companion animal. At this time, the first companion animal information may include 1-1 companion animal information, 1-2 companion animal information, and 1-3 companion animal information divided by age group, and the 1-1 companion animal information It may include information about photos, videos, etc. when the first companion animal was 1 to 2 years old, and the first and second companion animal information includes information about photos, videos, etc. when the first companion animal was 3 to 4 years old. The first to third companion animal information may include information about photos, videos, etc. from when the first companion animal was 5 to 6 years old.

Thereafter, the device 300 may generate a first avatar in which the first companion animal is implemented as a character of 1 to 2 years of age based on the 1-1 companion animal information, and based on the 1-2 companion animal information This allows you to create a second avatar where the first pet is embodied as a character aged 3 to 4 years, and based on the information on the first and third pets, the first pet is implemented as a character aged 5 to 6 years old. A third avatar can be created.

When avatars embodied as characters for each age group are created, the device 300 can control each avatar to be displayed for each section when controlling the screen of the access video accessing the first virtual space to be displayed on the output device 100. there is.

For example, when a first avatar, a second avatar, and a third avatar are created, the device 300 displays the image of the first avatar on the walls on both sides of the first section, as shown in (a) of FIG. 4. It can be controlled to be displayed, and the image of the second avatar can be controlled to be displayed on the walls on both sides of the second section following the first section.

That is, the device 300 can control the image of an avatar embodied as a character of a younger age to be displayed on the screen of the access video connecting to the first virtual space, the closer it is to the first user's field of view.

Afterwards, the device 300 applies the effect of being sucked into the first virtual space, so that the user can feel the same experience as accessing the first virtual space, so that the images displayed on both walls can pass behind, and the first section When this passes, as shown in (b) of FIG. 4, the first section disappears and only the second section remains, and only the image of the second avatar can be displayed on the screen of the connection video connecting to the first virtual space. .

Thereafter, the device 300 can control the output device 100 to output the screen of the first virtual space following the screen of the connected video. At this time, the device 300 sets the third avatar to be displayed in the first virtual space and then displays the third avatar so that the first user can feel the experience of encountering the first deceased or the first companion animal through the third avatar. The avatar can be controlled to be displayed in the first virtual space.

That is, when the device 300 applies the effect of being sucked into the first virtual space on the screen of the access video connecting to the first virtual space, the device 300 controls the images of the avatars that gradually become older to be displayed sequentially. , When accessing the first virtual space, the third avatar, which is the oldest and most similar to its most recent appearance when alive, can be controlled to be displayed in the first virtual space.

Figure 5 is a flowchart for explaining the process of providing visual effects according to the memorial location and encounter year according to an embodiment.

Referring to FIG. 5, first, in step S501, the device 300 is selected from the manipulation device 200 when the memorial site is selected as the first location and the encounter year is selected as the first year. 1 A selection signal for location and first year can be obtained.

For example, when the memorial place selection menu is selected in the first virtual space, the device 300 can control the interface for selecting a memorial place to be displayed in the first virtual space, and display the memorial place through the operation device 200. When the first location is selected in the selection interface, a selection signal for the first location can be obtained.

In addition, when the encounter year selection menu is selected in the first virtual space, the device 300 can control the interface for selecting the encounter year to be displayed in the first virtual space, and the interface for selecting the encounter year can be displayed through the operating device 200. When the first year is selected, a selection signal for the first year can be obtained.

In step S502, when the memorial location is selected as the first location and the encounter year is selected as the first year through the manipulation device 200, the device 300 configures the first virtual space to be implemented as the first location in the first year. You can set it. To this end, the database of the device 300 stores image information generated by performing 3D modeling for each of a plurality of places, divided by year, and the device 300 searches the database to determine the first image of the first year. After obtaining image information generated by performing 3D modeling on a place, the first virtual space can be set to be implemented as the first place in the first year based on the obtained image information.

For example, if the memorial location is selected as a park and the encounter year is selected as 2020, the device 300 may set the first virtual space to be implemented as a park in 2020.

In step S503, the device 300 may confirm the age group of the first deceased or the first companion animal as the fourth age group based on the first year. Here, the fourth age group may be any one of the age groups from the first age group to the third age group, may be an age group between the first age group and the second age group, or may be an age group between the second age group and the third age group.

For example, when the first year is 2020, the device 300 may identify people in their 30s as the fourth age group if the first deceased was confirmed to be 35 years old when he was alive as of 2020.

Additionally, when the first year is 2020, the device 300 can identify the 5-6 year old age group as the fourth age group if the first companion animal is confirmed to be 5 years old when it was alive as of 2020.

If the age group of the first deceased or the first companion animal is confirmed to be the fourth age group based on the first year, the device 300 may generate a fourth avatar embodied as a character of the fourth age group.

For example, if the age group of the first deceased is confirmed to be the fourth age group based on the first year, the device 300 creates a character implemented as a character when the first deceased person was in the fourth age group based on the information on the first deceased person. 4 You can create an avatar.

In addition, when the age group of the first companion animal is confirmed to be the fourth age group based on the first year, the device 300 displays a character implemented as a character when the first companion animal was in the fourth age group based on the first companion animal information. A fourth avatar can be created.

In step S504, the device 300 may set the fourth avatar to be displayed in the first virtual space implemented as the first location in the first year.

In step S505, the device 300 controls the fourth avatar to be displayed in the first virtual space so that the first user can feel the experience of encountering the first deceased or the first companion animal in the first year at the first place. can do.

Figure 6 is a flowchart for explaining the process of recommending a joint condolence statement according to an embodiment.

Referring to FIG. 6, first, in step S601, the device 300 may confirm that a second user is additionally connected to the first virtual space while the first user is connected to the first virtual space.

That is, the device 300 detects that a first user wearing the output device 100 is connected to the first virtual space and a second user wearing another output device 100 is connected to the first virtual space. You can check it.

When the first user and the second user access the first virtual space at the same time, the device 300 displays the avatar of the first deceased or the first companion animal on the output device 100 worn by the first user. The avatar can be controlled to be displayed, and the output device 100 worn by the second user can be controlled to display the first user's avatar along with the avatar of the first deceased or the first companion animal.

In step S602, if it is confirmed that the first user and the second user are simultaneously connected to the first virtual space, the device 300 may control the conversation window between the first user and the second user to be displayed on the first virtual space. .

The device 300 controls the output device 100 worn by the first user to display a conversation window between the first user and the second user next to the avatar of the second user, and displays the output device 100 worn by the second user. ), a conversation window between the first user and the second user can be controlled to be displayed next to the avatar of the first user.

Keyword information input through the operating device 200 worn by the first user may be displayed in the conversation window between the first user and the second user, and keyword information input through the operating device 200 worn by the second user. may be displayed.

In addition, in the conversation window between the first user and the second user, when the first user's voice is input through the speaker provided in the output device 100 worn by the first user, keyword information extracted through voice recognition of the first user is displayed. When the second user's voice is input through a speaker provided in the output device 100 worn by the second user, keyword information extracted through voice recognition of the second user may be displayed.

In step S603, if the device 300 determines that the first user and the second user are simultaneously accessing the first virtual space, the first user accesses the memorial service based on the first user's memorial access history. You can check the first list, which is a list of constellations or stars, and check the second list, which is a list of constellations or stars that the second user accessed for memorial purposes, based on the second user's memorial access history.

Specifically, when it is confirmed that the first user terminal and the output device 100 are connected through short-distance wireless communication, the device 300 may check the first user account logged in to the first user terminal, and confirm the first user account logged in to the first user terminal. First user information can be obtained from the database using the user account. For this purpose, user information classified by user account is stored in the database of the device 300. Here, the user information may include information about the user identification number, contact information, the user's memorial object, constellations or stars purchased by the user, memorial access history, etc.

Thereafter, the device 300 may check the memorial access history of the first user based on the first user information. Here, the first user's memorial access history is accumulated information about the first user's access to the memorial space through a constellation or star, and includes information such as access constellation, access star, access date, access time, and end time. It may consist of a list.

Thereafter, the device 300 may check the first list, which is a list of constellations or stars that the first user accessed for memorial purposes, based on the first user's memorial access history.

Meanwhile, when the device 300 confirms that the second user terminal and the output device 100 are connected through short-distance wireless communication, the device 300 can check the second user account logged in to the second user terminal, and identify the confirmed second user. Second user information can be obtained from the database using the account.

Thereafter, the device 300 may check the memorial access history of the second user based on the second user information. Here, the second user's memorial access history is accumulated information about the second user's access to the memorial space through constellations or stars, and includes information such as access constellation, access star, access date, access time, and end time. It may consist of a list.

Thereafter, the device 300 may check the second list, which is a list of constellations or stars that the second user accessed for memorial purposes, based on the second user's memorial access history.

In step S604, the device 300 may compare the first list and the second list.

That is, the device 300 can compare the constellations included in the first list and the constellations included in the second list to check whether there are overlapping constellations, and determine whether there are constellations included in the first list. By comparing the stars with the stars included in the second list, it is possible to check whether any stars are included in duplicate.

In step S605, the device 300 compares the first list and the second list, and may confirm that the second constellation or the second star is included in duplicate among the remainder excluding the first constellation or the first star.

For example, when the device 300 is connected to the first virtual space through the first constellation, as a result of comparing the first list and the second list, the device 300 selects a constellation that is included in duplicate among the rest excluding the first constellation. Or, by checking whether there is a star, it can be confirmed that the second constellation or the second star is included in duplicate.

In addition, when access to the first virtual space is made through the first star, the device 300 compares the first list and the second list, and as a result, the constellations or stars that are duplicated among the rest excluding the first star are selected. By checking whether there is a second constellation or a second star, it can be confirmed that it is included in duplicate.

In step S606, the device 300 may confirm that the second constellation or the second star is set to commemorate the second deceased or the second companion animal.

For example, if the device 300 determines that the second constellation is included in duplicate as a result of comparing the first list and the second list, the device 300 checks whose memorial the second constellation is set for, and determines whose memorial the second constellation is set for. 2 You can see that the constellation is set to commemorate the second deceased or the second pet.

In addition, when the device 300 compares the first list and the second list and determines that the second star is included in duplicate, the device 300 checks for whose memorial the second star is set, and determines whose memorial the second star is. You can see that this is set up to commemorate the second deceased or the second pet.

In step S607, if it is confirmed that the second constellation or the second star is set for the memorial of the second deceased or the second companion animal, the device 300 creates a memorial space for the memorial of the second deceased or the second companion animal. Through access to the second virtual space implemented in this metaverse environment, a notification message recommending joint condolences for the second deceased or the second companion animal can be controlled to be displayed in the chat window between the first user and the second user. You can. At this time, if the notification message is selected, the user can be connected to the second virtual space.

In other words, if the device 300 determines that the second constellation or the second star is set to commemorate the second deceased or the second companion animal, the memorial space for the second deceased or the second companion animal is set to meta. It is recommended to check the second virtual space implemented in a bus environment and allow the first and second users to move to the second virtual space and perform joint condolences for the second deceased or the second companion animal. A notification message can be controlled to be displayed in a conversation window between the first user and the second user.

When a notification message recommending joint condolences is selected in a conversation window between the first user and the second user through the operation device 200 worn by the first user, the device 300 displays a second virtual space on the screen of the first virtual space. The screen can be controlled to be displayed in the second virtual space on the output device 100 worn by the first user. Through this, the first user can move from the first virtual space to the second virtual space, and the first user can be connected to the second virtual space.

In addition, when a notification message recommending joint condolences is selected in a conversation window between the first user and the second user through the operating device 200 worn by the second user, the device 300 displays a second message on the screen of the first virtual space. The screen is converted to a virtual space, and the screen of the second virtual space can be controlled to be displayed on the output device 100 worn by the second user. Through this, the second user can move from the first virtual space to the second virtual space, and the second user can be connected to the second virtual space.

Figure 7 is a flow chart for explaining the process of recommending product development for users using a memorial service according to an embodiment and matching influencers who will advertise the product.

Referring to FIG. 7, first, in step S701, the device 300 may confirm that users using the memorial service are interested in products of the first category. Here, the first category may be any one of product categories such as clothing, cosmetics, furniture, and home appliances.

For example, if it is confirmed that the first user and the second user used the memorial service, the device 300 may collect the first user's activity information and the second user's activity information. Here, the activity information may include posted data uploaded to the SNS account, content usage history, post view history, etc.

Thereafter, the device 300 may predict which category of product the first user is most interested in, based on the activity information of the first user, and which category the second user will be selected based on the activity information of the second user. You can predict whether there is a lot of interest in the product.

Afterwards, when it is predicted which category of product each user is most interested in, the device 300 can use the predicted result to check which category of product the users are most interested in.

In step S702, the device 300 may transmit a notification message recommending development of a product in the first category to a plurality of stakeholder terminals. To this end, the device 300 may be configured to communicate wired or wirelessly with a plurality of stakeholder terminals.

Multiple stakeholder terminals are terminals used by stakeholders involved in product production and sales. Various entities such as product planners, producers, and sellers can participate in product planning and production as stakeholders. The first stakeholder terminal is used by the first stakeholder, It may include a second stakeholder terminal used by the second stakeholder, etc.

In step S703, the device 300 may obtain information on the first product, which is the product to be developed, and a plan for the first product from a first stakeholder terminal, which is one of a plurality of stakeholder terminals. At this time, the information on the first product may include the name of the first product, the category of the first product, and ingredient information of the first product. The plan for the first product may include a strategy for how to plan, produce, and release the first product, the production quantity of the first product, the expected production cost of the first product, and the expected production date of the first product. It may include etc.

In step S704, when the plan for the first product is adopted and manufacturing of the first product is determined, the device 300 may obtain advertising content performed by the influencer from at least one database. Here, at least one database can be a blog or YouTube.

Specifically, the device 300 may obtain advertising content performed by an influencer through at least one database including a blog or YouTube.

In step S705, based on the advertising content performed by the influencer, the device 300 acquires advertising information of a candidate influencer whose ratio of advertising content related to products of the first category among all advertising content is greater than or equal to the reference ratio. can do. Here, the reference ratio is a preset ratio and may vary depending on the embodiment. In addition, the advertising information of the candidate influencer may include information on the candidate influencer, including the name of the candidate influencer, the candidate influencer's followers, and information on the candidate influencer's followers. It may include information on the advertising content performed by the candidate influencer, including the number of advertising content of the candidate influencer, the category of advertising content of the candidate influencer, and the number of views, comments, and shares of the candidate influencer's advertising content. there is.

Specifically, based on the advertising content performed by the influencer, the device 300 classifies the advertising content in response to the influencer, analyzes the products of the advertising content, and determines whether the advertising content is related to the product of the first category. It can be analyzed whether it is content or advertising content that is not related to products in the first category. That is, the device 300 can check the ratio of advertising content related to the product of the first category among the total advertising content based on the advertising content performed by the influencer, and select a candidate whose ratio is greater than or equal to a preset standard ratio. You can obtain advertising information from influencers.

For example, through at least one database, the YouTube database, 'A' advertising content, 'B' advertising content, 'C' advertising content, 'D' advertising content, 'E' advertising content, 'F' advertising content, ' ‘G’ advertising content, ‘H’ advertising content, ‘I’ advertising content, and ‘J’ advertising content are acquired, and ‘A’ advertising where the advertising content corresponding to the ‘A’ influencer is the advertising content of the first category product Content, 'D' advertising content, which is the advertising content of the first category product, and 'B' advertising content corresponding to the influencer is the advertising content of the second category product, 'B' advertising content, the advertising content of the first category product 'F' advertising content, 'I' advertising content that is advertising content of the first category product, and 'C' advertising content corresponding to the influencer is advertising content of the first category product, 'C' advertising content, first category product. 'E' advertising content, which is advertising content for category products, 'G' advertising content, which is advertising content for third category products, 'H' advertising content, which is advertising content for first category products, and 'J' advertising content which is advertising content for first category products. ' If it is advertising content and the standard ratio is 75%, the device 300 selects 'A' where the advertising content related to the product of the first category accounts for 75% or more of the total advertising content through at least one database, the YouTube database. Influencers and 'C' influencers can be selected as candidate influencers, and advertising information of 'A' influencer and advertising information of 'C' influencer can be obtained.

In step S706, the device 300 may obtain information about advertising content performed by the candidate influencer based on the advertising information of the candidate influencer.

Specifically, based on the advertising information of the candidate influencer, the device 300 includes the number of advertising contents of the candidate influencer, the category of advertising content of the candidate influencer, the number of views and comments of the advertising content of the candidate influencer. Information on advertising content performed by the candidate influencer, including the number and number of shares, can be obtained.

In step S707, the device 300 performs advertising of the first product among the candidate influencers based on the candidate influencer's advertising information, information on the advertising content performed by the candidate influencer, and information on the first product. You can select an influencer to do this.

Specifically, the device 300 acquires target information of the candidate influencer based on the advertising information of the candidate influencer, and determines the candidate influencer's target information based on information on advertising content performed by the candidate influencer. Obtain content interest information, and apply the target information of the candidate influencer, the content interest information of the candidate influencer, and the information of the first product to the first artificial neural network to select the influencer who will advertise the first product. can do. For a detailed explanation regarding this, please refer to FIG. 7.

In step S708, when an influencer to advertise the first product is selected and an advertisement for the first product is produced, the device 300 displays the advertisement when the initial screen of the memorial service is displayed on the output device 100. The area can be controlled to display an advertisement for the first product. For this purpose, some areas of the initial screen are set as advertisement display areas.

FIG. 8 is a diagram illustrating a process of selecting an influencer to advertise a product based on information on a candidate influencer according to an embodiment.

Referring to FIG. 8, first, in step S801, the device 300 generates target information of the candidate influencer including target age information and target gender information of the candidate influencer based on the advertisement information of the candidate influencer. can be obtained.

Specifically, the device 300 may obtain follower information of the candidate influencer based on the advertisement information of the candidate influencer, and analyze the follower information of the candidate influencer to determine the target age group of the candidate influencer. Is the person in their teens, 20s, 30s, 40s, 50s, 60s, 70s, or is the target age group of the candidate influencer teenagers, young adults, middle-aged, elderly, etc. can be identified, and the target age information of the candidate influencer can be obtained based on the identification results. The device 300 may acquire follower information of the candidate influencer based on the candidate influencer's advertisement information, and analyze the follower information of the candidate influencer to determine whether the target gender of the candidate influencer is female. , it is possible to determine whether a person is male, and based on the identification results, target gender information of the candidate influencer can be obtained. Additionally, the device 300 may obtain target information on the candidate influencer, including target age information and target gender information on the candidate influencer.

In step S802, the device 300 determines the number of advertisement contents, the average number of views of the advertisement content, and the average sharing of the advertisement content, based on the advertisement content information of the candidate influencer. It is possible to obtain content interest information of candidate influencers, including the number of comments and the average number of comments on advertising content.

In step S803, the device 300 may generate a first input signal based on the candidate influencer's target information, the candidate influencer's content interest information, and the first product information.

Specifically, the device 300 may perform a process of preprocessing the target information of the candidate influencer, the content interest information of the candidate influencer, and the information of the first product. The target information of the preprocessed candidate influencer, the content interest information of the candidate influencer, and the information of the first product can be used as input to the first artificial neural network, or can be used as input through normal processing to remove unnecessary information. can be created.

In step S804, the device 300 may generate a first output signal by applying the first input signal to the first artificial neural network.

Here, the device 300 acquires the training influencer's target information, the training influencer's content interest information, training first category product information, first output signals, and training influencer matching information, , Based on this, the first artificial neural network can be trained in advance. The device 300 may generate a first output signal by applying a first input signal to a pre-trained first artificial neural network. At this time, the training influencer matching information may be influencer matching information corresponding to the training influencer's target information, the training influencer's content interest information, and information on the first training category product. The first output signals are first training input signals generated based on the training influencer's target information, the training influencer's content interest information, and the information on the training first category product and are applied to the first artificial neural network. The generated output signals may be

According to one embodiment, the device 300 obtains training outputs by applying the training influencer's target information, the training influencer's content interest information, and the information of the training first category product to the first artificial neural network. You can. The device 300 may learn the first artificial neural network based on the training outputs, first output signals, and training influencer matching information. The device 300 may generate a first output signal by applying a first input signal to a pre-trained first artificial neural network.

The device 300 may learn the first artificial neural network based on the training outputs, first output signals, and training influencer matching information. The device 300 may learn the first artificial neural network by calculating training errors corresponding to the training outputs and optimizing the connection relationships of nodes in the first artificial neural network to minimize the training errors. The device 300 may extract influencer matching information from the influencer's target information, the influencer's content interest information, and the first product information using the first artificial neural network on which learning has been completed.

The device 300 may train a first artificial neural network to extract influencer matching information.

The first artificial neural network includes a first input layer into which training samples are input and a first output layer including training outputs, and may be learned based on the difference between the training outputs and labels. Here, the labels may be defined based on the influencer's target information, the influencer's content interest information, and the first product information. The first artificial neural network is connected to a group of a plurality of nodes, and is defined by weights between connected nodes and an activation function that activates the nodes.

The device 300 may learn the first artificial neural network using a gradient descent (GD) technique or a stochastic gradient descent (SGD) technique. The device 300 may use a loss function designed by the outputs and labels of the first artificial neural network.

The device 300 may calculate the training error using a predefined loss function. The loss function may be predefined with a label, output, and parameter as input variables, where the parameter may be set by weights in the first artificial neural network. For example, the loss function may be designed in the form of MSE (Mean Square Error), entropy, etc., and various techniques or methods may be employed in embodiments in which the loss function is designed.

The device 300 can find weights that affect the training error using a backpropagation technique. Here, the weights are relationships between nodes in the first artificial neural network. Device 300 may use the SGD technique using labels and outputs to optimize the weights found through the backpropagation technique. For example, the device 300 may update the weights of the loss function defined based on the labels, outputs, and weights using the SGD technique.

According to one embodiment, the device 300 may generate first training input signals based on the training influencer's target information, the training influencer's content interest information, and training product information. Device 300 may generate first output signals from first training input signals.

According to one embodiment, the first artificial neural network is based on the training influencer's target information, the training influencer's content interest information, training product information, first output signals, and training influencer matching information. So it can be learned in advance. The first artificial neural network may be learned by minimizing training errors generated based on differences between the first output signals and training influencer matching information.

In step S805, the device 300 may generate matching information corresponding to the first product and the candidate influencer based on the first output signal. Here, the influencer matching information is the degree of matching between the candidate influencer and the first product and may be a real number between 0 and 1.

For example, the device 300 uses the first artificial neural network to generate 0.8 as influencer matching information corresponding to influencer 'A', 0.3 as influencer matching information corresponding to influencer 'C', and ' 0.5 can be generated from the influencer matching information corresponding to the 'D' influencer, and 0.6 can be generated from the influencer matching information corresponding to the 'E' influencer.

In step S806, the device 300 may check the history of advertising products produced by the manufacturer of the first product among the candidate influencers and apply a weight proportional to the number of advertisements to the matching information.

For example, the candidate influencers are 'A' influencer, 'C' influencer, 'D' influencer, and 'E' influencer, and the manufacturer of the first product is manufacturer 'A', The number of times products produced by 'A' manufacturer were advertised was 2 times for 'A' influencer, 3 times for 'C' influencer, 3 times for 'D' influencer, and 'E' influencer. In the case of influencer number 1, the device 300 may apply 0.2 as a weight proportional to the number of advertisements to influencer 'A' and 0.3 as a weight proportional to the number of advertisements to influencer 'C'. 0.3 can be applied to the 'D' influencer as a weight proportional to the number of advertisements, and 0.1 can be applied to the 'E' influencer as a weight proportional to the number of advertisements.

In step S807, the device 300 may select an influencer to advertise the first product using weighted matching information.

For example, the influencer matching information corresponding to 'A' influencer is 0.8, the weight proportional to the number of advertisements is 0.2, and the influencer matching information corresponding to 'C' influencer is 0.3, the number of advertisements is 0.2. The weight proportional to is 0.3, the influencer matching information corresponding to the 'D' influencer is 0.5, the weight proportional to the number of advertisements is 0.3, and the influencer matching information corresponding to the 'E' influencer is 0.5. 0.6, when the weight proportional to the number of advertisements is 0.1, the device 300 generates matching information with a weight applied to the 'A' influencer as 1, and the weighted matching information corresponding to the 'C' influencer is applied as 1. Matching information was created as 0.6, weighted matching information corresponding to the 'D' influencer was created as 0.8, and weighted matching information corresponding to the 'E' influencer was created as 0.7 to create the first product. 'A' influencer can be selected as the influencer to carry out the advertisement.

Figure 9 is an exemplary diagram of the configuration of a device according to an embodiment.

Device 300 according to one embodiment includes a processor 310 and memory 320. The processor 310 may include at least one device described above with reference to FIGS. 1 to 8 or may perform at least one method described above with reference to FIGS. 1 to 8 . A person or organization using the device 300 may provide services related to some or all of the methods described above with reference to FIGS. 1 to 8 .

The memory 320 may store information related to the methods described above or store a program in which methods described later are implemented. Memory 320 may be volatile memory or non-volatile memory.

The processor 310 can execute programs and control the device 300. The code of the program executed by the processor 310 may be stored in the memory 320. The device 300 is connected to an external device (eg, a personal computer or a network) through an input/output device (not shown) and can exchange data through wired or wireless communication.

Device 300 may be used to train an artificial neural network or use a trained artificial neural network. Memory 320 may include an artificial neural network that is being trained or has been trained. The processor 310 may learn or execute the artificial neural network algorithm stored in the memory 320. The learning device that trains the artificial neural network and the device 300 that uses the learned artificial neural network may be the same or may be separate.

The embodiments described above may be implemented with hardware components, software components, and/or a combination of hardware components and software components. For example, the devices, methods, and components described in the embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, and a field programmable gate (FPGA). It may be implemented using one or more general-purpose or special-purpose computers, such as an array, programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. A processing device may execute an operating system (OS) and one or more software applications that run on the operating system. Additionally, a processing device may access, store, manipulate, process, and generate data in response to the execution of software. For ease of understanding, a single processing device may be described as being used; however, those skilled in the art will understand that a processing device includes multiple processing elements and/or multiple types of processing elements. It can be seen that it may include. For example, a processing device may include a plurality of processors or one processor and one controller. Additionally, other processing configurations, such as parallel processors, are possible.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., singly or in combination. Program instructions recorded on the medium may be specially designed and configured for the embodiment or may be known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -Includes optical media (magneto-optical media) and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, etc. Examples of program instructions include machine language code, such as that produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing unit to operate as desired, or may be processed independently or collectively. You can command the device. Software and/or data may be used on any type of machine, component, physical device, virtual equipment, computer storage medium or device to be interpreted by or to provide instructions or data to a processing device. , or may be permanently or temporarily embodied in a transmitted signal wave. Software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

Although the embodiments have been described with limited drawings as described above, those skilled in the art can apply various technical modifications and variations based on the above. For example, the described techniques are performed in a different order than the described method, and/or components of the described system, structure, device, circuit, etc. are combined or combined in a different form than the described method, or other components are used. Alternatively, appropriate results may be achieved even if substituted or substituted by an equivalent.

Therefore, other implementations, other embodiments, and equivalents of the claims also fall within the scope of the following claims.

Claims (3)

In a method of providing an interface for implementing visual effects according to access to a constellation-based metaverse memorial service performed by a device,
When it is confirmed that the first user is wearing the output device, controlling the output device to display the initial screen of the memorial service, which displays constellations in the sky or outer space;
When the first user is wearing an operating device and the first constellation or first star is selected on the initial screen through the operating device, the first constellation or first star is set for whose memory. Confirmation steps;
If it is confirmed that the first constellation or the first star is set to commemorate the first deceased or the first companion animal, a memorial space for the memorial of the first deceased or the first companion animal is implemented in the metaverse environment. controlling a screen of the first virtual space to be displayed on the output device so that the first user is connected to the first virtual space; and
When movement within the first virtual space is requested through the operating device, the point where the first user is located in the first virtual space is changed, and the screen of the first virtual space is displayed around the changed point. Including controlling the display to be displayed on the output device,
The step of controlling the screen of the first virtual space to be displayed on the output device includes:
While the first user is connected to the first virtual space, if it is confirmed that a second user is additionally connected to the first virtual space, a chat window between the first user and the second user is displayed in the first virtual space. Controlling to be displayed in space;
Based on the memorial access history of the first user, check the first list, which is a list of constellations or stars that the first user accessed for memorial purposes, and based on the memorial access history of the second user, the second user Checking a second list, which is a list of constellations or stars accessed for memorial purposes;
As a result of comparing the first list and the second list, if it is confirmed that the second constellation or second star is included in duplicate among the remainder excluding the first constellation or first star, the second constellation or second star Steps to determine in whose memory the star is set; and
If it is confirmed that the second constellation or second star is set to commemorate the second deceased or the second companion animal, a memorial space for the memorial of the second deceased or the second companion animal is implemented in the metaverse environment. Through access to a second virtual space, controlling a notification message recommending joint condolences for the second deceased or the second companion animal to be displayed in the chat window,
When it is confirmed that users using the memorial service are interested in products of the first category, transmitting a notification message recommending development of the product of the first category to a plurality of stakeholder terminals;
Obtaining information on a first product, which is a product to be developed, and a plan for the first product from a first stakeholder terminal, which is one of the plurality of stakeholder terminals;
When manufacturing of the first product is determined, obtaining advertising content performed by an influencer from at least one database;
Based on the advertising content performed by the influencer, obtaining advertising information of a candidate influencer whose ratio of advertising content related to products of a first category among all advertising content is greater than or equal to a preset standard ratio;
Obtaining information on advertising content performed by the candidate influencer based on the advertising information of the candidate influencer;
An influencer who will perform advertising of the first product among the candidate influencers based on the advertising information of the candidate influencer, the information of advertising content performed by the candidate influencer, and the information of the first product. Step of selecting; and
When the advertisement for the first product is produced, when the initial screen is displayed on the output device, controlling the advertisement for the first product to be displayed in a preset advertisement display area,
The step of selecting an influencer to advertise the first product from among the candidate influencers,
Based on the information on the candidate influencer, obtaining target information on the candidate influencer including target age information and target gender information on the candidate influencer;
Based on the advertising content information of the candidate influencer, the candidate influencer includes the number of advertising content, the average number of views of the advertising content, the average number of sharing of the advertising content, and the average number of comments on the advertising content. Obtaining content interest information;
generating a first input signal based on target information of the candidate influencer, content interest information of the candidate influencer, and information of the first product;
applying the first input signal to a first artificial neural network to generate a first output signal;
generating matching information corresponding to the first product and the candidate influencer based on the first output signal;
Checking the candidate influencer's history of advertising products produced by the manufacturer of the first product and applying a weight proportional to the number of advertisements to the matching information; and
Comprising the step of selecting an influencer to advertise the first product using the weighted matching information,
A method of providing an interface that implements visual effects according to access to the constellation-based metaverse memorial service. According to paragraph 1,
The step of controlling the screen of the first virtual space to be displayed on the output device includes:
When it is confirmed that the first constellation or the first star is selected, the first zone where the first constellation or the first star is located is enlarged on the initial screen, and the screen of the first zone is controlled to be displayed on the output device. step;
If it is confirmed that the memorial space for commemorating the first deceased or the first companion animal is the first virtual space, the screen of the access video accessing the first virtual space following the screen of the first zone is displayed on the output device. controlling to be displayed; and
A step of controlling the screen of the first virtual space to be displayed on the output device following the screen of the connected video,
The step of controlling the screen of the connection video accessing the first virtual space to be displayed on the output device following the screen of the first zone,
Controlling the image of a first avatar in which the first deceased or the first companion animal is embodied as a character of a first age group to be displayed on both walls of the first section; and
Controlling the image of a second avatar in which the first deceased or the first companion animal is embodied as a character of a second age group older than the first age group to be displayed on both walls of the second section following the first section. Including,
The step of controlling the screen of the first virtual space to be displayed on the output device following the screen of the connected video,
setting a third avatar embodied as a character of a third age group in which the first deceased or the first companion animal is older than the second age group to be displayed in the first virtual space; and
Comprising the step of controlling the third avatar to be displayed in the first virtual space so that the first user can feel the experience of encountering the first deceased or the first companion animal through the third avatar,
A method of providing an interface that implements visual effects according to access to the constellation-based metaverse memorial service. According to paragraph 2,
The step of controlling the screen of the first virtual space to be displayed on the output device following the screen of the connected video,
After controlling the screen of the first virtual space to be displayed on the output device so that the first user can feel the experience of encountering the first deceased or the first companion animal through the third avatar,
When a memorial site is selected as a first location and an encounter year is selected as a first year through the operation device, setting the first virtual space to be implemented as the first location in the first year;
Confirming the age group of the first deceased or the first companion animal as a fourth age group based on the first year;
Setting a fourth avatar implemented as a character of the fourth age group to be displayed on the first virtual space implemented as the first location in the first year; and
Controlling the fourth avatar to be displayed in the first virtual space so that the first user can feel the experience of encountering the first deceased or the first companion animal in the first place and the first year. Including more,
A method of providing an interface that implements visual effects according to access to the constellation-based metaverse memorial service.