KR102625748B1 - System for providing ontact interaction service using augmented reality and method for providing ontact interaction service using thereof - Google Patents

Abstract

The present invention relates to a content provision system and method using Augmented Reality (AR). According to the present invention, each user uses a user terminal and augmented reality (AR) technology to request and receive services. Including a server that performs processing to provide the service requested from the user terminal, the user logs in to the server through his/her user terminal, selects the desired activity, creates a room, and when other users enter, each user's user terminal Through AR recognition, predetermined objects are created for each content for the activity, and at the same time, a chat function is implemented so that the user and the other party can converse with each other by voice or text, following predetermined rules for each activity. The process of participating in the selected activity through interaction is structured to be shared in real time, allowing people to freely communicate with each other face-to-face and engage in various activities through the concept of augmented reality (AR) and metaverse. An on-tact interaction service provision system using augmented reality, which is configured to provide the same pleasure as being together, and a method for providing on-tact interaction services using the same are provided.

Description

System for providing ontact interaction service using augmented reality and method for providing ontact interaction service using the same {System for providing ontact interaction service using augmented reality and method for providing ontact interaction service using the same}

The present invention relates to a content provision system and method using Augmented Reality (AR), and more specifically, to a mixture of conventional Augmented Reality (AR), Virtual Reality (VR), or a combination thereof. Services that provide various contents such as learning or games using Mixed Reality (MR) technology have been proposed, but using AR, VR, or MR technology, users can interact with each other with the desired party. In order to solve the limitations of conventional content provision services that did not provide content that could provide experiences, augmented reality (AR) technology was used to allow users to create rooms online and invite people they want to chat together. Ontact interaction using augmented reality is structured so that users can share the process of interaction while doing so, so that users can feel the pleasure of engaging in various activities with the person they want without having to gather in a specific place or meet in person. This relates to a service provision system and a method of providing on-tact interaction services using the same.

In addition, the present invention has recently been developed to allow meeting with people or free outdoor activities in accordance with the trend of requiring social distancing, non-face-to-face, and untact due to the global pandemic of COVID-19. It prevents not only the inconvenience of daily life, but also mental and emotional problems such as anxiety about the spread of infectious diseases, such as corona blue, or depression and lethargy due to disconnection from social activities. In order to prevent the spread of infectious diseases due to indiscriminate private gatherings, augmented reality (AR) technology allows users to create a room online, invite the people they want, talk together, and share the interaction process. About the on-tact interaction service provision system using augmented reality, which is structured so that users can feel the pleasure of enjoying various activities with the person they want without having to gather in a specific place or meet in person, and a method of providing on-tact interaction service using the same. will be.

In addition, as described above, the present invention includes a user terminal for each user to request and receive services, and augmented reality (AR) in order to allow users to experience the pleasure of engaging in various activities with their desired partner without having to meet them in person. It is configured to include a server that performs processing to provide services requested from the user terminal using technology, and allows the user to log in to the server through his/her user terminal, select the desired activity, create a room, and invite the desired person. When the other party or other users who accepted the invitation by revealing it to an unspecified number of people enter the room, predetermined objects are created for each content for the activity through AR recognition on each user's user terminal, and at the same time, they can chat with each other by voice or text. A chat function is implemented so that the user and the other party can talk to each other and interact according to predetermined rules for each activity. The process of doing the selected activity together is shared in real time through the server, and when the activity ends, It is configured to carry out a series of processing processes that allow sharing of the resulting photos and videos, so even in the recent era of social distancing and untact, you can meet the person you want face-to-face through the concept of augmented reality (AR) and metaverse. An on-tact interaction service provision system using augmented reality that allows free interaction while communicating and thereby provides the same pleasure as participating in various activities in an on-tact manner, and provision of on-tact interaction services using the same. It's about method.

In general, Augmented Reality (AR) technology is a field of Virtual Reality (VR), which is computer graphics that synthesizes virtual objects or information in the real environment to make them look like objects that exist in the original environment. It's a technique.

In addition, while existing virtual reality technology targets only virtual spaces and objects, augmented reality (AR) technology synthesizes virtual objects on the basis of the real world to reinforce and provide information that is difficult to obtain in the real world alone. , Unlike virtual reality, which is premised on a complete virtual world, it has the advantage of being able to further increase the effect of reality by combining virtual objects with the environment of the real world.

In addition, augmented reality (AR) technology changes the nature of physical space itself when physical space is filled with information artefacts with computing power, and due to these characteristics, it is limited to fields such as games. Unlike existing virtual reality, which can be applied in various real-world environments, it has the advantage of being applicable to various real environments, so it has recently been widely used in services that provide various contents in various digital media fields.

Here, examples of prior art for systems and methods for providing various contents using augmented reality as described above include, for example, "augmentation and There is a “method of providing experiential learning content based on virtual reality.”

More specifically, the above-mentioned Korean Patent Publication No. 10-2272255 states that a user group inputs team information and management code information through a user terminal, and the next step proceeds when the team information and management code information are determined to be normal. entry process steps; An opening step in which the central server provides one or more opening images and one or more opening missions to the user terminal, and proceeds to the next step when one or more opening missions are successful; And the central server provides one or more story missions to the user terminal, and when one or more story missions are successful, rewards and ending images for at least some of the one or more story missions are provided, including a story stage that proceeds to the next stage, By applying augmented/virtual reality using a user terminal to experiential learning content, the learning effect can be increased, and unlike existing experiential learning content, roles are divided into user groups and a role-playing gamification technique is introduced to provide experience to the experiencer. This is about a method of providing experiential learning content based on augmented and virtual reality that is designed to improve the interest and participation of the experiencer by giving them the experience of going back to the past and directly exploring historical sites and performing various missions.

In addition, other examples of prior art for systems and methods for providing various contents using augmented reality as described above include, for example, "augmented reality" as presented in Korean Patent Publication No. 10-2020-0076626. There is a “reality-based learning content provision method and system.”

More specifically, the above-described Korean Patent Publication No. 10-2020-0076626 is an augmented reality-based learning content providing method performed on a server, comprising the steps of generating a block problem and transmitting it to a user terminal; An operation of receiving an image of a block assembled by a user from a user terminal; An operation of determining whether a block problem is correct using an image of a received assembly block; And when it is determined to be correct, an operation of generating augmented reality content for the block problem and transmitting it to the user terminal, wherein the augmented reality content includes at least one of an augmented reality character and augmented reality learning content, and the user can directly This relates to a method of providing learning content that is designed to stimulate users' interest in learning by using assembleable blocks as learning tools and providing augmented reality learning content on the assembled blocks.

As mentioned above, various content provision services using augmented reality have been proposed in the past, but most of the conventional services using augmented reality have limitations in that they are mostly limited to specific fields such as learning, games, or information provision systems.

In other words, conventional technology services using augmented reality generally synthesize and provide various information about objects existing in the real environment, and most of them provide tangible content such as games, educational content such as experiential learning, or route guidance, etc. It had its limitations in that it was mainly applied to information provision services.

More specifically, the augmented reality services of the prior art are mainly provided for special cases such as education, games, route guidance, etc. and assuming a single user, for example, for special purposes such as drinking tea with friends. There has been no service presented that can provide enjoyment to users by applying augmented reality to everyday life rather than special occasions.

In addition, recently, due to the global pandemic of COVID-19, continuous social distancing and non-face-to-face, that is, untact, have been emphasized, resulting in, for example, Corona Blue ( Like corona blue, problems such as anxiety about the spread of infectious diseases or depression and lethargy due to restrictions on social activities are occurring.

Therefore, in order to solve the limitations of the augmented reality (AR) technology of the prior art as described above and effectively prevent the occurrence of mental problems caused by the pandemic of infectious diseases, for example, users can use augmented reality (AR) technology. An on-tact interaction service using a new type of augmented reality that allows you to invite people you want online without meeting them in person, chat with them, and provide the pleasure of interacting through various activities. Although it is desirable to present a method, a device or method that satisfies all such requirements has not yet been presented.

Korean Patent Publication No. 10-2272255 (2021.06.28.) Korean Patent Publication No. 10-2020-0076626 (2020.06.29.)

The present invention seeks to solve the problems of the prior art as described above. Therefore, the purpose of the present invention is to use augmented reality (AR), virtual reality (VR), or mixed reality (MR) technology in the form of a combination thereof. Services that provide a variety of content, such as learning or games, have been proposed, but content that allows users to interact with each other with desired parties has not been provided, solving the limitations of content provision services in the prior art. In order to do this, augmented reality (AR) technology is used to allow users to create a room online, invite people they want, talk together, and share the process of interacting with each other, allowing users to gather in a specific place or directly The purpose is to present an on-tact interaction service provision system using augmented reality that allows users to experience the pleasure of engaging in various activities with their desired partner without meeting them, and a method for providing on-tact interaction services using the same.

In addition, another object of the present invention is to meet people or freely interact with people in accordance with the recent trend of requiring social distancing, non-face-to-face, and untact due to the global pandemic of COVID-19. Restricted outdoor activities not only cause inconveniences in daily life, but also cause mental and emotional problems such as anxiety about the spread of infectious diseases, such as corona blue, or depression and lethargy due to disconnection from social activities. In order to prevent the spread of infectious diseases due to indiscriminate private gatherings, augmented reality (AR) technology is used to create a room online and invite people of their choice to chat and interact with each other. An on-tact interaction service provision system using augmented reality that is configured to be shared so that users can feel the pleasure of enjoying various activities with the person they want without having to gather in a specific place or meet in person, and provide an on-tact interaction service using the same. The purpose is to suggest a method.

In addition, another purpose of the present invention is to enable users to feel the pleasure of engaging in various activities with their desired partner without having to meet them in person, as described above, by providing a user terminal for each user to request and receive services, and an augmented device. It is configured to include a server that performs processing to provide services requested from the user terminal using reality (AR) technology, and allows the user to log in to the server through his or her user terminal, select the desired activity, create a room, and When the other user or another user who has accepted the invitation by inviting another person or revealing it to an unspecified number of people enters the room, a predetermined object is created for each content for the activity through AR recognition on each user's user terminal, and at the same time, they can communicate with each other by voice or text. A chat function is implemented to enable conversation, and the process of engaging in the selected activity is shared in real time through the server through which the user and the other party communicate with each other and interact according to predetermined rules for each activity. When the activity is over, a series of processing processes are performed to enable sharing of the resulting photos and videos, allowing anyone who wants to share them through the concept of augmented reality (AR) and metaverse even in the recent era of social distancing and untact. An on-tact interaction service provision system using augmented reality that allows free interaction while communicating with each other face-to-face, thereby providing the same pleasure as participating in various activities in an on-tact manner, and an on-tact interaction service using the same. The purpose is to present a method of providing tact interaction services.

In order to achieve the above-mentioned object, according to the present invention, in an on-tact interaction service provision system using Augmented Reality (AR), activity content desired by each user A user terminal for requesting and receiving services; and a server that performs processing to provide services for activity content requested through the user terminal, including a plurality of activity content produced and stored in advance, wherein the system is configured to allow a specific user to use his or her user terminal. If you log in to the server and create a room for the desired activity and invite the desired party or set it to allow unspecified users to enter, the server sends an invitation message to the other party's user terminal to invite the other party or anyone can enter. An invitation step in which a process is performed to create a public room and allow other users to enter the room created by the user; When the invited counterpart or other user's entry is completed, the service main screen is displayed, and the corresponding activity is displayed on the screen through augmented reality (AR) using the camera provided on the user terminal of the user and the other user or the other user. An augmented reality creation step in which a preset object is created and a chat function is executed to enable conversation with each other through at least one of text or voice. Through the chat function, the user and the other person or the other user communicate with each other and perform the selected activity through interaction with each other according to predetermined rules for the activity, and the process of performing the activity is performed on the server. An activity service provision step in which processing is performed to allow real-time sharing through; And when the activity is completed, photos and videos of the performance of the activity can be saved to the user terminal and uploaded to the server, and shared through a separate SNS (Social Network Service) or sharing service. Processing, including the end stage, is performed selectively according to the user's choice, allowing users to freely interact while communicating with each other through the concepts of augmented reality (AR) and metaverse. An on-tact interaction service provision system using augmented reality, characterized in that it provides interactive game functions and at the same time allows users to enjoy the pleasure of enjoying various activities face-to-face without having to meet the person they want in person. This is provided.

Here, the user terminal is configured by installing a dedicated program on an information processing device including dedicated hardware or a PC, which is configured to transmit and receive various data with the server through at least one communication method of wired or wireless communication. It is characterized by

Alternatively, the user terminal may be configured by installing a dedicated application program on a personally portable information and communication terminal device, including the user's smartphone, tablet PC, or laptop.

In addition, the chat function is configured to selectively turn on/off the text chat function and the voice chat function, respectively, and is configured to selectively mute the voice during voice chat. do.

In addition, the system is characterized in that one user can create multiple rooms at the same time, or two or more people can gather in the same room and enjoy the selected activity while talking together.

Moreover, the activity content is characterized in that it is configured to provide activities for the on-tact teahouse service.

At this time, in the invitation step, when the user executes the service through his or her user terminal, an initial screen is displayed including a start menu button for logging in and a gallery menu button for checking previously saved videos or records. When the user touches the start menu button and logs in to the server, the menu button that issues an invitation code to invite others to have tea together is displayed in the form of a water drop, and when the user touches the menu button, water fills up and invites the user. A code is generated and the screen is switched to an invitation code issuance screen, and the server transmits the issued invitation code and invitation message to the user terminal of the other party, who received the invitation code and invitation message. A screen for entering an invitation code is displayed, and a standby screen is displayed on each user terminal until the other party who has received the invitation code inputs the invitation code and the entry process is completed. Once the entry process is completed, the screen for entering the invitation code is displayed. It is characterized in that it is configured to perform the process of switching to the intro screen.

In addition, the invitation code issuance screen displays a water droplet filled with water and a generated invitation code, along with a share button and previous and next movement buttons at the bottom, and each time the water droplet is touched, the invitation code is reissued and the next time the water droplet is touched. When you press the button, the water droplets shake to encourage touch, and when you press the share button on the invitation code issuance screen, a shortcut menu to the chat window of sharing services including SNS (Social Network Service) or messenger is displayed. , Characterized in that the processing is performed to display a pop-up screen including an execution menu for each SNS or messenger app, and a file copy, print, save menu, and exit menu so that the user can perform the desired task. do.

In addition, the standby screen is configured to include an image symbolizing tea leaves, and a pop-up screen is displayed at the bottom to confirm whether to leave the room by displaying a previous button when touched, and the user touches the tea leaves while waiting. When you do so, the image and sound of tea leaves being picked are output, and when you touch the background (empty space), a predetermined separate sound is output. If the entry process is not completed within a predetermined period of time, a failure message is output and you are invited again or returned to the main screen. It is characterized in that it is configured to display a screen inquiring about return.

Moreover, the intro screen is characterized by being configured to display an image of the teacup repeating its size and size or rotating when the admission process is completed.

In addition, in the augmented reality creation step, the service main screen includes a menu button for selecting various tools for making tea, including a tea cup, bowl, strainer, and plate. The included toolbar menu is displayed at the top of the screen to scroll left and right, an exit button that displays an exit pop-up window is displayed on one side of the top of the screen, and an AR menu button for running augmented reality (AR) is displayed in the middle of the screen. is displayed, and on the left and right sides are displayed multiple water selection menus and tea selection menus that allow you to adjust the amount of water and the type and amount of tea. At the bottom of the screen, there is a camera-shaped menu button to save the image of the current screen, and the user It is characterized in that it is configured to display a voice chat menu button to activate voice chat so that the other party can talk to each other, and a play menu button to exchange turns between the host (user) and the guest (opponent).

Here, in the augmented reality creation step, when the other party's entrance is completed, the creation of a table using augmented reality (AR) is performed automatically or manually by touching the AR menu button, so that each user terminal Put down and reset menu buttons are displayed along with the table on the screen, and each user can move the table by dragging it to a desired location and then touch the put down button to determine the location or press the reset button to set the table. It is configured so that the position can be reset, and all functions and menu buttons except the camera and voice chat are displayed as inactive until the creation of the table is completed. When the table is created, all menu buttons are activated, and the table When the position of is determined, a start button is created, and when the start button is pressed, processing to proceed to the tea making service provision step is performed.

In addition, the activity service provision step includes a tea making service provision step and a tea drinking service provision step, and the tea making service provision step includes the total number of turns predetermined for each user, the time per turn, and the water menu. Depending on the number of uses and the number of uses of the tea menu, you can take turns selecting each tool to make tea. When it is the other person's turn, you can watch the other person play, and freely turn on or off voice chat during play. It is configured to be OFF, and when each user selects the desired tool during his or her turn, the selected tool is displayed as an AR image in the center of the screen, and the AR image displayed on the screen is dragged to set the position to place it on the table. , At this time, the AR image must be held for more than 1 second to fix and release the position, and the position of the tool can be fixed with the pin button in the tool menu, and the tool in use (placed on the table) can be selected in the tool selection menu. It is displayed in the form of an empty shadow, and each user can only select tools currently in the tool selection menu. If the tool currently in use is to be used, processing is performed to make it usable by returning it to the tool menu. It is characterized by being

Moreover, in the step of providing the tea making service, the tea ingredients of the tea menu include leaves, fruits, stems, and flowers, and each of the tea ingredients can be used only once, so that the difference between unused ingredients and used ingredients is divided. It is configured to display different colors, and the water menu displays a plurality of icons as many times as can be used. The icon is configured to disappear when touched (used) to easily determine the number of uses, and the action of pouring water. In order to perform this, each tool can be rotated (tilted), and the gyro function of the user terminal is used to display the speed or amount of the water stream differently depending on the tilt of each tool, and each time each user uses the turn. The display (icon or UI) indicating the number of turns is changed and processing is performed so that the display (icon or UI) disappears when all of the turns are used.

In addition, the tea drinking service provision step allows each user to perform the action of blowing into the microphone of their user terminal, thereby providing the experience of drinking the tea made in the tea making service provision step while cooling it. It is characterized in that it is configured so that.

Here, the system displays an exit pop-up window on all user terminals when the exit menu is selected at any one of the tea making service provision stage or the tea drinking service provision stage, and if even one person selects quit, the play ends. and is characterized in that it is configured to perform processing to move to the end step.

In addition, in the end step, the end shooting screen has a live action shooting menu button for shooting an AR image with a real background and a virtual shooting menu button for shooting an AR image with a virtual background so that the current play content can be recorded as a photo or video. Menu buttons are displayed at the top of the screen, a camera button is displayed at the bottom of the screen to move to a preview screen where you can check the shooting results, and voice chat is displayed at the top of the screen along with the live-action shooting menu button and the virtual shooting menu button. It is characterized in that it further includes a menu button.

Moreover, the ending step includes the content captured on the ending shooting screen along with the amount of water used, the type and amount of tea used, and the time the user and the other party drank tea together and history information including the distance between them. It is characterized in that it is configured to perform processing that displays.

Here, in the preview screen, the game end menu button, share menu button, and gallery menu button are displayed at the bottom of the screen along with the captured content, and when the game end menu button is selected, each user makes and drinks tea. After the recorded video is automatically played, a menu inquiring whether to end the play is displayed. If you select End, processing is performed to inquire whether to save and upload the captured content. When you select the gallery menu button above, a menu is displayed asking whether to end the play. A menu asking if you want to move to the gallery is displayed, and when you select move, a warning message is displayed indicating that the currently captured content will not be saved. When you select the share menu button, you are taken to your account screen and uploaded the desired post. It is characterized in that it is configured to allow upload or deletion processing.

In addition, the activity content includes activities related to game content including online games, tangible games, and board games using augmented reality (AR), virtual reality (VR), or mixed reality (MR) technology. It is characterized in that it is configured to provide.

In addition, according to the present invention, in the on-tact interaction service providing method using the on-tact interaction service providing system using augmented reality described above, using the user terminal of the service providing system, the user accesses the server of the service providing system. An invitation step in which processing is performed to log in, create a room for the desired activity, invite desired parties, or allow an unspecified number of other users to enter; When the invited party or another user enters, preset objects for the activity are created using augmented reality (AR) on each user terminal, and text and voice chat functions are executed so that they can communicate with each other. An augmented reality creation step in which processing is performed; An activity service in which processing is performed to allow the user and the counterpart or other users to perform a selected activity according to predetermined rules while conversing with each other through each user terminal, and to share the process of performing the activity through the server. provision stage; When the activity is terminated, the process of allowing the user and the other party or the other user to store and share photos or videos of the process of performing the activity through each user terminal is selectively performed according to the user's selection. By including the end stage, it provides an interactive game function that allows users to freely interact while communicating with each other through the concept of augmented reality (AR) and metaverse, while providing the user with the desired game function. A method of providing an on-tact interaction service is provided, which is configured to provide the pleasure of enjoying various activities together face-to-face without having to meet people in person.

As described above, according to the present invention, a user terminal for each user to request and receive a service, and a server to perform the process of providing the service requested from the user terminal using augmented reality (AR) technology. It is configured to include, where the user logs in to the server through his or her user terminal, selects the desired activity, creates a room, and invites the desired person, or opens it to an unspecified number of people, and when the person who accepted the invitation or another user enters the room, each user Through AR recognition on the user's terminal, a predetermined object is created for each content for the activity, and at the same time, a chat function is executed so that the user and the other party can communicate with each other by voice or text. Augmentation is configured to perform a series of processing processes that allow the process of participating in a selected activity through interaction according to rules to be shared in real time through a server, and to share the resulting photos and videos when the activity is completed. By providing an on-tact interaction service provision system using reality and an on-tact interaction service provision method using the same, you can meet the person you want through the concept of augmented reality (AR) and metaverse even in the recent social distancing and untact era. As a result, it is possible to freely interact while communicating with each other, which can provide the same pleasure as doing various activities together in an on-tact manner.

In addition, according to the present invention, as described above, using augmented reality (AR) technology, users create a room online, invite people they want, or share the process of interacting with each other by talking with an unspecified number of other users. An on-tact interaction service provision system using augmented reality that allows users to feel the pleasure of engaging in various activities with the person they want without having to gather in a specific place or meet in person, and an on-tact interaction service using the same. As a method of providing tact interaction services is provided, services that provide various contents such as learning or games using augmented reality (AR), virtual reality (VR), or mixed reality (MR) technology that combines them have been proposed. , Content that can provide users with the experience of interacting with the desired party can solve the problems of content provision services in the prior art that were never provided.

In addition, according to the present invention, using augmented reality (AR) technology, users can create a room online, invite people they want, or chat with an unspecified number of other users and share the process of interacting with each other. An on-tact interaction service provision system using augmented reality that allows users to feel the pleasure of engaging in various activities with the person they want without having to gather in a specific place or meet in person, and provide an on-tact interaction service using the same. By providing a method, meeting with people or free outdoor activities are limited due to the recent trend of requiring social distancing, non-face-to-face, and untact due to the global pandemic of COVID-19. Effectively prevents not only the inconveniences of daily life, but also mental and emotional problems such as anxiety about the spread of infectious diseases, such as corona blue, or depression and lethargy due to disconnection from social activities. At the same time, it can contribute to preventing the spread of infectious diseases caused by indiscriminate private gatherings.

Figure 1 is a block diagram schematically showing the overall configuration of an on-tact interaction service providing system using augmented reality according to an embodiment of the present invention.
Figure 2 is a flow chart schematically showing the overall processing process of the interaction service provision method performed in the on-tact interaction service provision system using augmented reality according to an embodiment of the present invention.
Figure 3 is a flow chart schematically showing the overall processing process of the on-tact teahouse activity as an example of activity content provided in the on-tact interaction service provision system using augmented reality according to an embodiment of the present invention.
Figure 4 is a diagram schematically showing an example of the configuration of the initial screen of the on-tact teahouse activity provided in the on-tact interaction service provision system using augmented reality according to an embodiment of the present invention.
Figure 5 is a diagram schematically showing a configuration example of an invitation screen for an on-tact teahouse activity according to an embodiment of the present invention.
Figure 6 is a diagram schematically showing a configuration example of a sharing pop-up screen.
Figure 7 is a diagram schematically showing an example of the configuration of a standby screen displayed on each user terminal until the other party who has received the invitation code enters the code.
Figure 8 is a diagram schematically showing an example of the configuration of the service main screen displayed after the invitation and admission processing is completed.
Figure 9 is a diagram schematically showing a configuration example of a tea making play screen in which a user and an opponent each take turns making tea.
Figure 10 is a diagram schematically showing an example of the configuration of the end shooting screen displayed after the tea making play ends.
Figure 11 is a diagram schematically showing a configuration example of a preview screen.
Figure 12 is a diagram showing the initial screen of the on-tact teahouse activity executed by actually implementing the on-tact activity service provision system using augmented reality and the on-tact activity service provision method using the same according to an embodiment of the present invention.
Figure 13 is a diagram showing an invitation screen for an on-tact teahouse activity according to an embodiment of the present invention.
Figure 14 is a diagram showing an invitation code input screen displayed on the user terminal of the other person who received the invitation code in the on-tact teahouse activity according to an embodiment of the present invention.
Figure 15 is a diagram showing a screen displayed in the process of creating a table and determining its location using AR to proceed with the tea making process of the on-tact tea shop activity according to an embodiment of the present invention.
Figure 16 is a diagram showing a screen displayed while users of the on-tact tea shop activity take turns making tea according to an embodiment of the present invention.
Figure 17 is a diagram showing a screen displayed while users of the on-tact tea shop activity take turns making tea according to an embodiment of the present invention.
Figure 18 is a diagram showing a screen displayed while users of the on-tact tea shop activity take turns making tea according to an embodiment of the present invention.
Figure 19 is a diagram illustrating a screen displayed while users of an on-tact tea shop activity drink finished tea according to an embodiment of the present invention.
Figure 20 is a diagram showing a screen displayed during the termination process of an on-tact teahouse activity according to an embodiment of the present invention.
Figure 21 is a diagram showing a screen for uploading a post during the termination process of an on-tact teahouse activity according to an embodiment of the present invention.

Hereinafter, with reference to the attached drawings, a specific embodiment of an on-tact interaction service providing system using augmented reality and a method for providing on-tact interaction service using the same according to the present invention will be described.

Here, it should be noted that the content described below is only one embodiment for carrying out the present invention, and the present invention is not limited to the content of the embodiment described below.

In addition, in the description of the embodiments of the present invention below, parts that are the same or similar to the contents of the prior art or that are judged to be easily understood and implemented at the level of those skilled in the art will be described in detail to simplify the explanation. It should be noted that was omitted.

In other words, as described later, the present invention presents services that provide various contents such as learning or games using augmented reality (AR), virtual reality (VR), or mixed reality (MR) technology in the form of a combination thereof. However, in order to solve the limitations of the content provision services of the prior art, which did not provide content that could provide the user with an experience of interacting with the desired party, augmented reality (AR) technology was used to provide the user with the experience. It is structured so that users can create a room online and invite the people they want to talk to and share the process of interacting with each other, giving users the pleasure of engaging in various activities with the people they want without having to gather in a specific place or meet in person. It relates to an on-tact interaction service provision system using augmented reality that is configured to allow users to feel and a method of providing on-tact interaction services using the same.

In addition, as will be described later, the present invention is a method of meeting people in accordance with the recent trend of requiring social distancing, non-face-to-face, and untact due to the global pandemic of COVID-19. In addition to the inconvenience of daily life due to restrictions on free outdoor activities, mental and emotional problems such as anxiety about the spread of infectious diseases, such as corona blue, or depression and lethargy due to interruption of social activities. In order to prevent the spread of infectious diseases due to indiscriminate private gatherings, augmented reality (AR) technology is used to create a room online and invite people of their choice to chat and interact together. An on-tact interaction service provision system using augmented reality that is configured to share the process so that users can feel the pleasure of enjoying various activities with the person they want without having to gather in a specific place or meet in person, and on-tact interaction using the same. It is about how to provide services.

Moreover, as will be described later, the present invention includes a user terminal for each user to request and receive services, and augmented reality (AR) so that users can feel the pleasure of engaging in various activities with desired partners without having to meet in person. ) It is configured to include a server that performs processing to provide services requested from the user terminal using technology, and the user logs into the server through his/her user terminal, selects the desired activity, creates a room, and invites the desired person. Or, when the other person or other user who accepted the invitation by revealing it to an unspecified number of people enters the room, a predetermined object is created for each content for the activity through AR recognition on each user's user terminal, and at the same time, they can chat with each other by voice or text. A chat function is implemented so that the user and the other party can talk to each other and interact according to predetermined rules for each activity. The process of doing the selected activity together is shared in real time through the server, and the activity is terminated. It is configured to perform a series of processing processes that allow sharing of the resulting photos and videos, so even in the recent era of social distancing and untact, you can face the person you want through the concept of augmented reality (AR) and metaverse. An on-tact interaction service provision system using augmented reality that allows free interaction while communicating with each other and thereby provides the same pleasure as participating in various activities in an on-tact manner, and an on-tact interaction service using the same. It's about how to provide it.

Continuing, with reference to the drawings, specific details of the on-tact interaction service providing system using augmented reality and the on-tact interaction service providing method using the same according to the present invention will be described.

More specifically, first, referring to FIG. 1, FIG. 1 is a block diagram schematically showing the overall configuration of an on-tact interaction service providing system 10 using augmented reality according to an embodiment of the present invention.

As shown in Figure 1, the on-tact interaction service provision system 10 using augmented reality according to an embodiment of the present invention is roughly divided into four functions: requesting and receiving services for activity content desired by each user; It may be configured to include a user terminal 11 and a server 12 that performs processing to provide a service for the activity content requested through the user terminal 11 among various activity content produced and stored in advance. , At this time, the service for the above-described activity content may be configured to provide on-tact interaction content using augmented reality (AR) technology, as described later.

In addition, the user terminal 11 may be composed of dedicated hardware configured to transmit and receive various data with the server 12 through at least one communication method among wired and wireless communication and perform a series of processes as described later. Alternatively, it can be configured by installing a dedicated program on an information processing device such as a PC.

Here, the user terminal 11 is preferably a dedicated device configured to perform processing as described later on a personally portable information and communication terminal device, such as a smartphone, tablet PC, or laptop. It can be configured by installing an application program, which makes it possible to implement the service at a simpler configuration and lower cost without the need to implement separate hardware.

In addition, the server 12 may be configured to receive a service request for a selected activity from each user terminal 11 and provide the corresponding activity content, as described later.

More specifically, referring to FIG. 2, FIG. 2 is a flowchart schematically showing the overall processing process of the interaction service provision method performed in the on-tact interaction service provision system 10 using augmented reality according to an embodiment of the present invention. am.

As shown in Figure 2, the interaction service providing method performed in the on-tact interaction service providing system 10 using augmented reality according to an embodiment of the present invention is, first, a specific user uses his or her user terminal 11. If you log in to the server 12 and create a room for the desired activity and invite the desired party or open it to an unspecified number of people, the server 12 sends an invitation message to the other party's user terminal or creates a public room that anyone can enter (S10) .

Subsequently, when the invited other party enters the room created by the user through his or her user terminal 11, or when an unspecified number of other users enter, the user terminal 11 of the user and the other party recognizes the activity in advance through AR recognition. As soon as the set object is created, the chat function is executed so that you can communicate with each other through at least one of text or voice. At this time, the chat function selectively turns on/off the text chat function and the voice chat function, respectively. (off), and can be configured to selectively mute the voice during voice chat (S20).

Subsequently, the user and the other party communicate with each other through the chat function and perform the selected activity through interaction with each other according to predetermined rules for the activity, and this activity process is shared in real time through the server 12. It can be configured to do so (S30).

Next, when the activity is terminated, photos and videos of the performance of the activity are stored in the user terminal 11 and uploaded to the server 12 through the user terminal 11, and at the same time, a separate SNS (Social Network Service) ) or a sharing service, etc., the process of enabling sharing is performed (S40).

Therefore, the series of processing processes described above are configured to be performed using a personal portable information and communication terminal such as a smartphone, so that the user and the other party can freely communicate with each other through the concepts of augmented reality (AR) and metaverse. It provides a type of interactive game function that works, and at the same time, it can provide users with the same enjoyment as enjoying various activities together face-to-face without having to meet the person they want in person.

Here, in the above-described embodiment, the present invention has been described by taking as an example a case where a user and another party enter the same room and perform an activity together. However, the present invention is not necessarily limited to the above-described embodiment, that is, the present invention It may be configured so that one user can create multiple rooms at the same time, or provide games and tangible content where two or more people can gather in the same room and enjoy various activities while talking together. It should be noted that various modifications and changes can be made by those skilled in the art as needed without departing from the spirit and essence of the present invention.

In addition, in the embodiments of the present invention configured as described above, for example, the specific process of generating a specific object through AR recognition, etc., can be easily understood and implemented by those skilled in the art by referring to prior art literature. It should be noted that detailed explanations of what can be done have been omitted to simplify the explanation.

Therefore, from the configuration described above, content for various activities is created in advance and stored in the server 12, and when a specific activity content is requested through the user terminal 11, the corresponding activity content is provided, so that the user It is possible to easily implement an on-tact interaction service provision system 10 using augmented reality that provides various activities customized according to the needs of.

Continuing, as an example of activity content and on-tact interaction services that can be provided through the on-tact interaction service provision system 10 using augmented reality according to an embodiment of the present invention configured as described above, on-tact teahouse activity service Using as an example, the specific details of the activity content and on-tact interaction service according to the present invention will be described.

Here, in the embodiments of the present invention described below, the present invention is explained by taking the case of an on-tact teahouse activity service as an example, but the content of the embodiments shown below is only an embodiment of the activity services that can be provided by the present invention. However, the present invention is not necessarily limited to the content of the embodiments presented below, that is, the present invention can provide other types of services in addition to the configuration of the embodiments described below, and the purpose and essence of the present invention is It should be noted that various modifications and changes can be made and applied by those skilled in the art as necessary within the scope without deviation.

In other words, activity content that can be provided through the on-tact interaction service provision system 10 using augmented reality according to an embodiment of the present invention includes, for example, augmented reality (AR) or virtual reality in addition to the on-tact teahouse service described above. It may be configured to provide activities for game content including online games, immersive games, and board games using (Virtual Reality; VR) or Mixed Reality (MR) technology. Therefore, the above activity content is, It should be noted that there are no particular restrictions on the type or content of content as long as users can interact with each other and share the content through augmented reality.

More specifically, referring to FIG. 3, FIG. 3 is an example of an activity provided by the on-tact teahouse service provision system 10 using augmented reality according to an embodiment of the present invention, and shows the overall processing process of the on-tact teahouse activity. This is a flow chart that schematically represents.

As shown in Figure 3, in the on-tact teahouse activity using augmented reality according to an embodiment of the present invention, first, a specific user logs in to the server 12 through his/her user terminal 11, creates a room, and selects a desired partner. When the invitation code is sent to the other party, the server 12 transmits the invitation code and message to the other party's user terminal (S11).

Subsequently, when the invited other party receives an invitation message through his or her user terminal 11 and enters the room created by the user by entering the invitation code, the user and the other party's user terminal 11 recognize the user's name through AR ground recognition. A table object based on the location is created, and tools such as kettles, tea cups, and tea ingredients are created around the table. At the same time, text chat and voice chat functions are executed to enable conversation with each other. At this time, the voice chat function is activated. can be configured to be selectively turned off or muted (S21).

Continuing, the user and the other party talk to each other through the chat function and take turns selecting each tool and material to make tea within a predetermined time and number of times. The process of making tea is performed on the server ( It can be configured to be shared in real time through 12) (S31).

Next, when the tea making is finished, the user and the other party drink the made tea together through their user terminal 11. Afterwards, the resulting photos and videos are stored in the user terminal 11 and stored on the server 12. ), and at the same time, a process of allowing it to be shared through a separate SNS (Social Network Service) or sharing service is performed (S41).

Therefore, the series of processing processes described above are configured to be performed using a personal portable information and communication terminal such as a smartphone, so that the user and the other party can communicate freely with each other through the concepts of augmented reality (AR) and metaverse. At the same time as providing a game function to create, it can provide users with the same pleasure as drinking tea face-to-face without having to meet the person they want in person.

Here, in the above-described embodiment, the present invention has been described by taking the case where a user and the other party drink tea together as an example, but the present invention is not necessarily limited to the above-described embodiment. That is, the present invention is provided by one user. The present invention may be configured to create multiple rooms at the same time, or to provide games and tangible content that two or more people can enjoy while talking together in the same room and making and drinking tea. It should be noted that it can be modified and changed in various ways by those skilled in the art as needed without departing from the purpose and essence of.

In addition, in the embodiment of the present invention configured as described above, for example, a specific process of creating a table and various materials and tools through AR ground recognition, etc., those skilled in the art can refer to prior art literature, etc. It should be noted that detailed explanations of content that can be easily understood and implemented have been omitted to simplify the explanation.

Continuing, the specific details of the on-tact teahouse activity performed in the on-tact interaction service providing system 10 using augmented reality according to an embodiment of the present invention configured as described above will be described.

First, referring to FIG. 4, FIG. 4 shows an example of the configuration of the initial screen of the on-tact teahouse activity service performed in the on-tact teahouse service provision system 10 using augmented reality according to the embodiment of the present invention shown in FIG. 3. This is a schematic drawing.

Here, in the embodiments of the present invention described below, the present invention has been explained by taking as an example the case where the user terminal 11 is configured by installing a dedicated application on the user's smartphone. However, the present invention does not necessarily apply to the embodiments shown below. It should be noted that this is not limited to examples.

As shown in FIG. 4, the on-tact teahouse activity service provided by the on-tact teahouse service providing system 10 according to an embodiment of the present invention is shown in FIG. 4 when a dedicated application installed on the user terminal 11 is executed. The initial screen may be configured to be displayed as shown.

That is, as shown in FIG. 4, the initial screen can be configured to display a start menu button for logging in to the service and a gallery menu button for checking previously saved videos or records.

At this time, each menu button may be displayed as an image only, as shown in FIG. 3, or may be displayed as text or a combination of text and images, and may be configured in various ways depending on need.

Additionally, referring to FIG. 5, FIG. 5 is a diagram schematically showing an example of the configuration of an invitation screen for inviting a counterpart in an on-tact teahouse activity service according to an embodiment of the present invention.

As shown in Figure 5, when the user touches the start button on the initial screen and logs in to the service, that is, the server 12, the menu button for issuing an invitation code to invite someone to have tea together is displayed in the form of a water drop. , When you touch the menu button, the water fills, an invitation code is generated, and the screen switches to the right.

In addition, the water droplet filled with water and the generated invitation code are displayed, along with the share button and previous and next movement buttons at the bottom. Each time the water droplet is touched, the invitation code is reissued, and when the share button is pressed, the sharing screen pops up. Then, when the button is pressed, the water droplet can be configured to slowly shake up and down to induce touch.

More specifically, referring to FIG. 6, FIG. 6 is a diagram schematically showing a configuration example of a sharing pop-up screen.

As shown in Figure 6, when the user presses the share button on the invitation code issuance screen, a shortcut menu for the chat window of a sharing service such as SNS or messenger, an execution menu for each SNS or messenger app, and a file A pop-up screen including copy, print, save menu, and exit menu may be displayed so that the user can perform the desired task.

Subsequently, the server 12 transmits the issued invitation code and invitation message to the corresponding other party's user terminal (11), and a screen for entering the invitation code is displayed on the other party's user terminal (11) for which the invitation code has been received. displayed.

That is, referring to FIG. 7, FIG. 7 is a diagram schematically showing an example of the configuration of a standby screen displayed on the user terminal until the other party who has received the invitation code enters the code and enters the user terminal.

As shown in Figure 7, a standby screen in the shape of a tea leaf is displayed on each user terminal 11 until the other party who has received the invitation code enters the code and entry is completed, and when the entry process is completed, the tea cup becomes larger. It can be configured to change to an intro screen that repeats becoming smaller or rotates.

At this time, the previous button is displayed at the bottom, and when touched, an exit pop-up screen is displayed. If the user touches the tea leaves while waiting, an image and sound similar to picking tea leaves are output, or if the user touches the background (empty space), a forest-like natural environment is displayed. The sound can be output so that the user does not feel bored while waiting.

Additionally, if the entry process is not completed within a predetermined period of time, a failure message may be output and a screen may be displayed to invite the user again or to inquire about returning to the main screen.

Here, in the above-described embodiments of the present invention, the present invention has been described by taking the case of sending an invitation code to a desired party as an example, but the present invention is not necessarily limited to this case. In other words, the present invention For example, it may be configured to allow entry using a password method, or it may be configured to allow random entry to a public room or unspecified user, etc., so long as there is a host creating the room and a guest entering, various options may be provided as needed. It should be kept in mind that it can be configured in any form.

Next, referring to FIG. 8, FIG. 8 is a diagram schematically showing an example of the configuration of the service main screen displayed after the invitation and admission processing is completed.

As shown in Figure 8, when the invited party's entrance is completed, the main screen including various menus for providing on-tact teahouse activity services is displayed, and AR ground scanning is performed using the camera provided in the user terminal 11. Create a table on the screen.

More specifically, as shown in Figure 8, the service main screen includes a menu button for selecting various tools for making tea, such as a tea cup, bowl, strainer, and plate. A toolbar menu including is displayed at the top of the screen to scroll left and right, and an exit button that displays an exit pop-up window is displayed on one side of the top of the screen.

In addition, a menu button for performing an AR ground scan is displayed in the middle of the screen, and on the left and right sides are displayed multiple water selection menus and tea selection menus that allow you to adjust the amount of water and the type and amount of tea, respectively, and at the bottom of the screen. There is a camera menu button to automatically save images, a voice chat menu button to activate voice chat so that the user and the other party can communicate with each other, and a play menu button to exchange turns between the host (user) and the guest (the other party). Each of these can be configured to be displayed.

In addition, table creation using AR can be configured to be performed automatically upon completion of entry or by touching the AR scan menu button displayed on the screen, and all functions and menus except the camera and voice chat are disabled until the ground scan is completed. The button is displayed as inactive.

Moreover, when a table is created in an appropriate location after scanning the AR ground, all menu buttons are activated, and when it is your turn and the play button is activated, you select each menu button to perform the task of making tea, and when it is your opponent's turn, you perform the task of making tea. It can be configured to observe the play of.

At this time, the total number of turns and the time for each turn are determined according to predetermined settings, and each water and tea menu is configured so that the total number of uses is limited, for example, 3 times, and a bowl is placed on the table. ) is placed, the water is automatically filled when you touch the water button, and the color can be configured to change depending on the combination of water and tea.

That is, referring to FIG. 9, FIG. 9 is a diagram schematically showing a configuration example of a tea making play screen in which a user and an opponent take turns making tea.

As shown in Figure 9, when the user selects a desired tool, the edge of the selected tool becomes bold and slightly enlarged, and is displayed as an AR image in the center of the screen. The user sets the position by dragging the AR image displayed on the screen, and at this time, It can be configured to enable position fixation and release by holding for more than 1 second.

In addition, tools in use (placed on the table) are displayed in the form of an empty shadow in the tool selection menu, and the user can drag the desired tool and place it on the table. At this time, only the tools currently in the tool selection menu can be selected. If you want to use a tool that is being used by another user, you must return it to make it usable.

In addition, the water and tea menu buttons are designed so that the corresponding menu disappears when touched, making it easy to understand the limit on the number of uses, and by using the gyro function of the smartphone, the speed or amount of water stream is displayed differently depending on the tilt of the cup. It can be configured to do so.

Here, if the exit menu is selected from any side while making tea, an exit pop-up window is displayed on all user terminals. At this time, if even one person chooses to quit, the play can be configured to end and move to the end shooting screen.

More specifically, referring to FIG. 10, FIG. 10 is a diagram schematically showing a configuration example of an end shooting screen displayed after the tea making play ends.

As shown in Figure 10, the end shooting screen corresponds to the last part of the service, and there is a live shooting menu button for shooting an AR image with a real background and a virtual shooting menu button for shooting an AR image with a virtual background at the top of the screen. Each can be displayed and configured to record the corresponding play content as a photo or video.

Additionally, it can optionally be configured to display a voice chat menu button along with the shooting button, and can be configured to move to a preview screen where you can check the shooting results by touching the camera button displayed at the bottom of the screen.

That is, referring to FIG. 11, FIG. 11 is a diagram schematically showing a configuration example of a preview screen.

As shown in Figure 11, on the preview screen, the game end, share, and gallery menu buttons are displayed at the bottom along with the captured content, and at this time, the amount of water used, the type of tea used, and the captured content are displayed. It can be configured to display information such as the amount, the time the user and the other party drank tea, and the distance between each other, so that the contents of the relevant play can be easily confirmed.

In addition, the share menu performs the same processing as the share menu button described above with reference to FIG. 6. When the game end menu is selected, a menu asking whether to end the play is displayed, and when quit is selected, the captured content is saved. and upload processing is performed. When the gallery menu is selected, a menu asking whether to move to the gallery is displayed, and when move is selected, a warning message indicating that the currently captured content will not be saved is displayed.

Therefore, as described above, it is possible to implement an on-tact teahouse activity service using augmented reality according to an embodiment of the present invention. That is, referring to FIGS. 12 to 21, FIGS. 12 to 21 are examples of the embodiment of the present invention. This is a drawing showing the actual implementation and execution of the on-tact teahouse activity service using augmented reality.

More specifically, first, Figure 12 is a diagram showing the initial screen of the on-tact teahouse activity service according to an embodiment of the present invention, and Figure 13 is a diagram showing the invitation screen of the on-tact teahouse activity service according to an embodiment of the present invention. It is a diagram, and FIG. 14 is a diagram showing an invitation code input screen displayed on the user terminal of the other party who has received an invitation code in the on-tact teahouse activity service according to an embodiment of the present invention.

In addition, referring to FIGS. 15 to 19, FIGS. 15 to 19 are diagrams showing screens displayed on the user terminal during the tea making process of the on-tact teahouse activity service according to an embodiment of the present invention. First, FIG. 15 is a diagram showing the screen displayed in the process of creating a table and determining its location using AR to proceed with the tea making process.

More specifically, when the user invites the desired party and completes the entry, the table and the put down and reset menu buttons are displayed on the screen through AR, respectively, as shown in Figure 15, and the user moves the table by dragging it to the desired location. You can then decide by touching the put down button or reset the table position by pressing the reset button.

In addition, when the table position is determined as described above, a start button is created as shown in the right screen of FIG. 15, and when the start button is pressed, the tea making process begins.

That is, referring to FIGS. 16 to 18, FIGS. 16 to 18 are diagrams showing screens displayed while users of the on-tact teahouse activity service according to an embodiment of the present invention take turns making tea.

More specifically, as shown in Figure 16, when a table is created, the desired tool can be placed on the table using the tool menu. At this time, the position of the tool can be fixed with the pin button, and the microphone can be selectively turned on. , you can freely decide whether to use voice chat by turning it OFF.

In addition, the tool can be rotated (tilted) as shown in FIG. 17 to perform actions such as pouring water. In this embodiment, the tea material consists of four types of leaves, fruits, stems, and flowers. Each tea material can be used only once and can be configured to display unused and used materials in different colors.

In addition, as shown in Figure 18, in this embodiment, each user starts with a total of 4 turns and is provided with a total of 8 turns, and each time a turn is used, the UI indicating the number of turns changes, and the turn Although the UI may be configured to disappear when all are used, it should be noted that the present invention is not necessarily limited to this configuration.

Continuing with reference to FIG. 19, FIG. 19 is a diagram illustrating a screen displayed while users of the on-tact teahouse activity service according to an embodiment of the present invention are drinking finished tea.

That is, after the users take turns making tea using each tool in a turn manner as described above, the process proceeds with drinking tea together. In this embodiment, as shown in FIG. 19, each user makes his or her own tea. It can be configured to provide an experience like drinking tea while cooling it by performing an operation of blowing into the microphone of the user terminal 11.

Next, referring to FIGS. 20 and 21, FIGS. 20 and 21 are diagrams showing a screen displayed during the termination process of an on-tact teahouse activity service according to an embodiment of the present invention.

As shown in Figure 20, when users drink tea and select the end button, the video recorded while the users are making and drinking tea can be automatically played and then stored in each user's user terminal 11.

At this time, the time and distance for drinking tea together can be displayed in numbers so that you can easily check the history of drinking tea together, and a share button can also be displayed so that you can immediately save and share the current information in the gallery. It can be.

That is, as shown in FIG. 21, when you select the share button, you can go to your account screen and upload or delete the desired post.

Therefore, as described above, it is possible to implement an on-tact interaction service provision system using augmented reality and an on-tact interaction service provision method using the same according to an embodiment of the present invention, and thereby, according to the present invention, each user can provide the service. It is configured to include a user terminal for requesting and receiving services, and a server that performs processing to provide the requested service from the user terminal using augmented reality (AR) technology, and the user accesses the server through his or her user terminal. Log in, select the desired activity, create a room, and invite the desired person, or open it to an unspecified number of people, and when the person who accepted the invitation or another user enters the room, each user's user terminal uses AR recognition to preview the content for the activity in advance. As soon as a given object is created, a chat function is launched so that users can communicate with each other by voice or text, allowing users and others to talk to each other and interact according to predetermined rules for each activity, thereby engaging in the selected activity together. An on-tact interaction service provision system using augmented reality and on-tact interaction using the same, in which the process is shared in real time through a server, and when the activity is completed, a series of processing processes are performed to enable sharing of the resulting photos and videos. By providing a service provision method, even in the recent era of social distancing and untact, it is possible to freely interact by communicating face-to-face with the desired person through the concept of augmented reality (AR) and metaverse, and thereby, on-tact It can give you the same pleasure as doing various activities together in an (ontact) way.

In addition, according to the present invention, as described above, using augmented reality (AR) technology, users create a room online, invite people they want, or share the process of interacting with each other by talking with an unspecified number of other users. An on-tact interaction service provision system using augmented reality that allows users to feel the pleasure of engaging in various activities with the person they want without having to gather in a specific place or meet in person, and an on-tact interaction service using the same. As a method of providing tact interaction services is provided, services that provide various contents such as learning or games using augmented reality (AR), virtual reality (VR), or mixed reality (MR) technology that combines them have been proposed. , Content that can provide users with the experience of interacting with the desired party can solve the problems of content provision services in the prior art that were never provided.

In addition, according to the present invention, using augmented reality (AR) technology, users can create a room online, invite people they want, or chat with an unspecified number of other users and share the process of interacting with each other. An on-tact interaction service provision system using augmented reality that allows users to feel the pleasure of engaging in various activities with the person they want without having to gather in a specific place or meet in person, and provide an on-tact interaction service using the same. By providing a method, meeting with people or free outdoor activities are limited due to the recent trend of requiring social distancing, non-face-to-face, and untact due to the global pandemic of COVID-19. Effectively prevents not only the inconveniences of daily life, but also mental and emotional problems such as anxiety about the spread of infectious diseases, such as corona blue, or depression and lethargy due to disconnection from social activities. At the same time, it can contribute to preventing the spread of infectious diseases caused by indiscriminate private gatherings.

Above, the details of the on-tact interaction service providing system using augmented reality and the on-tact interaction service providing method using the same according to the present invention have been described through the embodiments of the present invention as described above, but the present invention is not limited to the above-described implementation. It is not limited to the content described in the examples, and therefore, the present invention may be subject to various modifications, changes, combinations, substitutions, etc. according to design needs and various other factors by those skilled in the art to which the present invention pertains. It is natural that this is possible.

10. On-tact interaction service provision system using augmented reality
11. User terminal
12. Server

Claims (21)

In the ontact interaction service provision system using Augmented Reality (AR),
A user terminal for requesting and receiving services for activity content desired by each user; and
It is configured to include a server that performs processing to provide services for activity content requested through the user terminal, including a plurality of activity content that has been produced and stored in advance,
The system is,
When a specific user logs in to the server through his or her user terminal and creates a room for a desired activity and invites the desired other party or allows unspecified users to enter, the server sends an invitation message to the other party's user terminal to An invitation step in which processing is performed to allow other users to enter the room created by the user by inviting the other party or creating a public room that anyone can enter;
When the invited counterpart or other user's entry is completed, the service main screen is displayed, and the corresponding activity is displayed on the screen through augmented reality (AR) using the camera provided on the user terminal of the user and the other user or the other user. An augmented reality creation step in which a preset object is created and a chat function is executed to enable conversation with each other through at least one of text or voice.
Through the chat function, the user and the other person or the other user communicate with each other and perform the selected activity through interaction with each other according to predetermined rules for the activity, and the process of performing the activity is performed on the server. An activity service provision step in which processing is performed to allow real-time sharing through; and
When the activity is completed, photos and videos of the performance of the activity are saved to the user terminal and uploaded to the server, so that they can be shared through a separate SNS (Social Network Service) or sharing service. The processing is configured to perform processing that includes a termination step that is selectively performed according to the user's selection,
The activity content is,
It consists of activities related to the on-tact teahouse service,
The activity service provision step is,
It consists of a tea making service provision step and a tea drinking service provision step,
The tea making service provision step is,
Depending on the total number of turns predetermined for each user, the time per turn, the number of times the water menu is used, and the number of times the tea menu is used, each user takes turns selecting each tool to make tea. When it is the other person's turn, they play. It is configured so that you can freely turn on or off the use of voice chat during play.
When each user selects the desired tool during his or her turn, the selected tool is displayed as an AR image in the center of the screen, and the AR image displayed on the screen is dragged to set a position to place it on the table. At this time, the AR image is 1 It is possible to fix and release the position only by holding it for more than a second, and the position of the tool can be fixed with the pin button in the tool menu.
Tools in use (placed on the table) are displayed as empty shadows in the tool selection menu, and each user can only select tools currently in the tool selection menu. If they want to use the tool currently in use, they must select the tool again. It is configured to perform processing to make it usable by returning it to the menu,
The tea drinking service provision step is,
By having each user perform the action of blowing into the microphone of his or her user terminal, the experience of drinking the tea made in the tea making service provision step is provided by cooling it down,
Through the concept of augmented reality (AR) and metaverse, we provide an interactive game function where users can freely interact with each other and a tea making game function.
An on-tact interaction service provision system using augmented reality, characterized in that it is configured to provide users with the pleasure of enjoying various activities together and the pleasure of drinking tea together without having to meet the person they want in person.
According to clause 1,
The user terminal is,
Augmented reality, characterized in that it is configured by installing a dedicated program on an information processing device including dedicated hardware or a PC, which is configured to transmit and receive various data through at least one communication method of wired or wireless communication with the server. On-tact interaction service provision system used.
According to clause 1,
The user terminal is,
An on-tact interaction service provision system using augmented reality, which is configured by installing a dedicated application program on a personally portable information and communication terminal device, including the user's smartphone, tablet PC, or laptop.
According to clause 1,
The chat function is,
It is configured to selectively turn on/off the text chat function and voice chat function, respectively.
An on-tact interaction service provision system using augmented reality, characterized in that it is configured to selectively mute voice during voice chat.
According to clause 1,
The system is,
An on-tact interaction service using augmented reality, characterized in that one user can create multiple rooms at the same time, or two or more people can gather in the same room and enjoy the selected activity while talking together. provision system.
delete According to clause 1,
The invitation step is,
When the user runs the service through his/her user terminal, an initial screen is displayed including a start menu button for logging in and a gallery menu button for checking previously saved videos or records,
When the user touches the start menu button and logs in to the server, the menu button that issues an invitation code to invite someone to have tea together is displayed in the form of a water drop, and when the user touches the menu button, the water fills up. An invitation code is generated and the screen switches to the invitation code issuance screen.
The server transmits the issued invitation code and invitation message to the user terminal of the corresponding other party, and a screen for entering the invitation code is displayed on the user terminal of the other party who received the invitation code and the invitation message,
A standby screen is displayed on each user terminal until the other party who has received the invitation code inputs the invitation code and the entry process is completed, and when the entry process is completed, a process of switching to an intro screen is performed. An on-tact interaction service provision system using augmented reality, characterized by:
According to clause 7,
The invitation code issuance screen is,
A water droplet filled with water and a generated invitation code are displayed, along with a share button, previous move button, and next move button displayed at the bottom. Each time the water droplet is touched, an invitation code is reissued, and when the next move button is pressed, the water droplet is displayed. It shakes to induce touch,
When the sharing button is pressed on the invitation code issuance screen, a shortcut menu for the chat window of a sharing service including SNS (Social Network Service) or messenger, an execution menu for each SNS or messenger app, and the user An on-tact interaction service provision system using augmented reality, characterized in that the processing is performed to display a pop-up screen including file copy, print, save menu, and exit menu so that the user can perform the desired task.
According to clause 7,
The standby screen is,
It consists of an image symbolizing tea leaves, and a pop-up screen is displayed at the bottom to confirm whether or not to leave the room when touched by displaying a previous button.
When the user touches the tea leaves while waiting, the image and sound of tea leaves being picked are output, and when the user touches the background (empty space), a separate predetermined sound is output.
An on-tact interaction service provision system using augmented reality, characterized in that if the admission process is not completed within a predetermined period of time, a failure message is output and a screen is displayed to invite a re-invitation or to inquire about returning to the main screen.
According to clause 7,
The intro screen is,
An on-tact interaction service provision system using augmented reality, which is configured to display an image that repeats the teacup's size and size or rotates when the admission process is completed.
According to clause 1,
In the augmented reality creation step, the service main screen is,
A toolbar menu that includes menu buttons for selecting various tools for making tea, including cups, bowls, strainers, and plates, is displayed at the top of the screen to scroll left and right. At the top of the screen, an exit button is displayed and an exit pop-up window is displayed.
The middle part of the screen displays an AR menu button for running augmented reality (AR), and the left and right sides display multiple water selection menus and tea selection menus that allow you to adjust the amount of water and the type and amount of tea, respectively.
At the bottom of the screen, there is a camera-shaped menu button to save the image of the current screen, a voice chat menu button to activate voice chat so that the user and the other party can communicate with each other, and the host (user) and guest (the other party) take turns. An on-tact interaction service provision system using augmented reality, characterized in that each play menu button for receiving is displayed.
According to clause 11,
The augmented reality creation step is,
When the other party's entrance is completed, the creation of a table using augmented reality (AR) is performed automatically or manually by touching the AR menu button, and placed together with the table on the screen of each user terminal. Each reset menu button is displayed,
Each user is configured to drag and move the table to a desired location and then determine the location by touching the put down button or reset the location of the table with a reset button,
Until the creation of the table is completed, all functions and menu buttons except the camera and voice chat are displayed in an inactive state. Once the table is created, all menu buttons are activated,
An on-tact interaction service providing system using augmented reality, characterized in that when the position of the table is determined, a start button is created, and when the start button is pressed, processing to proceed to the tea making service provision step is performed.
delete According to clause 1,
The tea making service provision step is,
The tea ingredients of the tea menu include leaves, fruits, stems, and flowers, and each tea ingredient can be used only once, and the unused ingredients and the used ingredients are displayed differently in color,
The water menu displays a plurality of icons according to the number of uses, and the icons disappear when touched (used) so that the number of uses can be easily determined,
To perform the action of pouring water, each tool can be rotated (tilted), and the gyro function of the user terminal is used to display the speed or amount of the water stream differently depending on the tilt of each tool.
Augmented reality characterized in that the display (icon or UI) indicating the number of turns changes each time each user uses a turn, and processing is performed so that the display (icon or UI) disappears when all of the turns are used. On-tact interaction service provision system using .
delete According to clause 1,
The system is,
If the exit menu is selected at any stage during the tea making service provision step or the tea drinking service provision step, an exit pop-up window is displayed on all user terminals,
An on-tact interaction service provision system using augmented reality, characterized in that if even one person chooses to quit, the relevant play is terminated and processing to move to the end stage is performed.
According to clause 1,
In the ending step, the ending shooting screen is,
In order to record the current play content as a photo or video, a real-time shooting menu button for shooting an AR image with a real background and a virtual shooting menu button for shooting an AR image with a virtual background are displayed at the top of the screen, respectively.
At the bottom of the screen, there is a camera button that moves to the preview screen where you can check the shooting results.
An on-tact interaction service providing system using augmented reality, characterized in that it further includes a voice chat menu button displayed at the top of the screen along with the live-action shooting menu button and the virtual shooting menu button.
According to clause 17,
The ending step is,
Processing is performed to display history information including the amount of water used, the type and amount of tea used, the time when the user and the other party drank tea together, and the distance between each other along with the content captured on the end shooting screen. An on-tact interaction service provision system using augmented reality, characterized in that it consists of:
According to clause 17,
The preview screen is,
Along with the captured content, the game end menu button, share menu button, and gallery menu button are displayed at the bottom of the screen, respectively.
When the Game End menu button is selected, the video recorded while each user is making and drinking tea is automatically played, and then a menu is displayed asking if they want to end the play. If they select End, the recorded content is saved and uploaded. Processing is performed to inquire whether to do so,
When you select the gallery menu button, a menu asking whether to move to the gallery is displayed, and when you select move, a warning message is displayed indicating that the currently captured content will not be saved.
An on-tact interaction service providing system using augmented reality, characterized in that selecting the share menu button moves to one's account screen to upload or delete desired posts.
According to clause 1,
The activity content is,
It is characterized by being configured to provide activities for game content including online games, immersive games, and board games using augmented reality (AR), virtual reality (VR), or mixed reality (MR) technology. An on-tact interaction service provision system using augmented reality.
Provision of on-tact interaction service using the on-tact interaction service provision system using augmented reality described in any one of claims 1 to 5, claims 7 to 12, claim 14, and claims 16 to 20. In the method,
An invitation step in which the user logs into the server of the service provision system, creates a room for a desired activity, invites desired parties, or allows an unspecified number of other users to enter, using the user terminal of the service provision system;
When the invited party or another user enters, preset objects for the activity are created using augmented reality (AR) on each user terminal, and text and voice chat functions are executed so that they can communicate with each other. An augmented reality creation step in which processing is performed;
An activity service in which processing is performed to allow the user and the counterpart or other users to perform a selected activity according to predetermined rules while conversing with each other through each user terminal, and to share the process of performing the activity through the server. provision stage; and
When the activity is terminated, the process of allowing the user and the other party or the other user to store and share photos or videos of the process of performing the activity through each user terminal is selectively performed according to the user's selection. By being comprised of a termination step to be performed,
Through the concept of augmented reality (AR) and metaverse, it provides an interactive game function that allows users to communicate and interact freely with each other, while also allowing users to engage in various activities face-to-face without having to meet the person they want in person. A method of providing an on-tact interaction service, characterized in that it is configured to provide the pleasure of enjoying together.