WO2024080851A1

WO2024080851A1 - Method and device for concurrently participating in multiple events in virtual space

Info

Publication number: WO2024080851A1
Application number: PCT/KR2023/015928
Authority: WO
Inventors: 정혜원; 박현수
Original assignee: 주식회사 와이드브레인
Priority date: 2022-10-14
Filing date: 2023-10-16
Publication date: 2024-04-18
Also published as: KR102593239B1

Abstract

The present specification proposes a method for concurrently participating in multiple events in a virtual space and a device therefor. Specifically, the method may include the steps of: receiving invitation information with respect to a first event of a virtual space from a first manager avatar; receiving invitation information with respect to a second event of the virtual space from a second manager avatar; participating in the first event on the basis of a directly-controlled avatar; and participating in the second event concurrently progressed with the first event by using an artificial intelligence (AI)-based avatar which interacts with other avatars.

Description

Method and device for simultaneously participating in multiple events in virtual space

This specification relates to a method and device for participating in an event in a virtual space, and more specifically, to a method and device for participating in multiple events in a virtual space simultaneously.

Recently, virtual reality, augmented reality, and mixed reality technologies that apply computer graphics technology are developing. Virtual reality technology uses computers to build a virtual space that does not exist in the real world and then makes the virtual space feel like reality. Augmented reality or mixed reality technology adds computer-generated information to the real world. It is defined as a technology that allows real-time interaction with users by combining the real world and the virtual world.

Among these, augmented reality and mixed reality technologies are combined with technologies in various fields (e.g., broadcasting technology, medical technology, game technology, etc.) and are utilized/applied to provide services to users. A representative example is Meta-verse. There is. This metaverse is a compound word of 'Meta', meaning processing and abstraction, and 'Universe', meaning the real world, and refers to a three-dimensional virtual world. Metaverse is an advanced concept than the existing term virtual reality environment, and provides an augmented reality environment in which virtual worlds such as the web and the Internet are absorbed into the real world.

Meanwhile, recently, as the demand for a non-face-to-face environment has increased, various technologies have been developed to support non-face-to-face work, such as video conferencing, and the number of cases of introducing functions such as video conferencing into metaverse services is increasing. However, existing metaverse technology has the problem of not being able to participate in multiple events such as conferences and exhibitions taking place simultaneously.

This specification proposes a method and device that enable simultaneous participation in multiple events in a virtual space.

Additionally, this specification proposes a method and device that allows an artificial intelligence (AI)-based avatar to attend an event and participate in activities on behalf of the user.

Additionally, this specification proposes a method and device for displaying a screen displaying a virtual space in parallel and a graphical user interface (GUI) that changes according to the characteristics of the virtual space.

The technical problems to be achieved in this specification are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the description below. You will be able to.

The method of simultaneously participating in a plurality of events in a virtual space according to the present specification includes receiving invitation information for a first event in the virtual space from a first administrator avatar, and receiving invitation information for a second event in the virtual space. Receiving from a second manager avatar, participating in the first event based on an avatar directly controlled, and artificial intelligence (AI) interacting with other avatars in the second event that occurs simultaneously with the first event It may include a step of participating by an avatar based on artificial intelligence (AI).

In addition, in the method of the present specification, the AI-based avatar can respond to the other avatar's inquiry in real time with a message or voice, or deliver material information related to the second event, based on machine learning.

Additionally, in the method of the present specification, the AI-based avatar can inquire with another avatar through a message or voice in real time, or transmit material information related to a second event, based on machine learning.

In addition, in the method of the present specification, the AI-based avatar stores at least one of video information, audio information, and/or shared data information about the second event in the virtual space, and a request for confirmation of information from the user is received. Based on the input, at least one of the video information, the audio information, and/or the shared data information may be displayed.

Additionally, in the method of the present specification, the AI-based avatar can detect a preset voice or movement among the voices or movements of another avatar and display notification information.

In addition, in the method of the present specification, the output screen for the virtual space includes a 3D space view and a 2D view configured in parallel with the 3D space view, and the 3D space view displays the virtual space, The 2D view may display a graphical user interface that changes depending on the characteristics of the displayed virtual space.

Additionally, in the method of the present specification, the invitation information for the first event or the second event includes at least one of information about the event title, information about the event space, and/or information about the event progress time. can do.

An attendee terminal for simultaneously participating in multiple events in a virtual space of the present specification includes at least one transceiver, at least one processor, operably connected to the at least one processor, and executing by the at least one processor. At least one memory storing instructions for performing operations based on what happens, the operations comprising: receiving invitation information for a first event in the virtual space from a first administrator avatar; Receiving invitation information for a second event in the virtual space from a second manager avatar, participating in the first event based on a directly controlled avatar, and taking place simultaneously with the first event in the virtual space The second event may include participation by an artificial intelligence (AI)-based avatar that interacts with other avatars.

Additionally, in the attendee terminal of this specification, the AI-based avatar may respond to the other avatar's inquiry in real time with a message or voice, or deliver material information related to the second event, based on machine learning.

Additionally, in the attendee terminal of the present specification, the AI-based avatar can inquire with another avatar through a message or voice in real time, or transmit material information related to the second event, based on machine learning.

Additionally, in the attendee terminal of the present specification, the AI-based avatar stores at least one of video information, audio information, and/or shared data information about the second event in the virtual space, and requests confirmation of the information from the user. Based on this input, at least one of the video information, the audio information, and/or the shared material information may be displayed.

Additionally, in the attendee terminal of this specification, the AI-based avatar can detect a preset voice or movement among the voices or movements of another avatar and display notification information.

In addition, in the participant terminal of the present specification, the output screen for the virtual space includes a 3D space view and a 2D view configured in parallel with the 3D space view, and the 3D space view displays the virtual space, The 2D view may display a graphical user interface that changes depending on the characteristics of the displayed virtual space.

Additionally, in the attendee terminal of the present specification, the invitation information for the first event or the second event includes at least one of information about the event title, information about the event space, and/or information about the event progress time. It can be included.

According to this specification, there is an effect of being able to participate in multiple events in a virtual space simultaneously.

In addition, according to the present specification, there is an effect of allowing an artificial intelligence (AI)-based avatar to attend an event and participate in activities on behalf of the user.

In addition, according to the present specification, there is an effect of displaying a screen displaying a virtual space and a GUI that changes the characteristics of the virtual space in parallel.

The effects that can be obtained in this specification are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description below. .

The accompanying drawings, which are included as part of the detailed description to aid understanding of the present specification, provide examples of the present specification and explain technical features of the present specification together with the detailed description.

Figure 1 is a flow chart to explain the event participation method proposed in this specification.

Figure 2 is a diagram for explaining how the event manager proposed in this specification creates an event.

Figure 3 is a diagram to explain how the event manager proposed in this specification manages attendees.

FIG. 4 is a diagram illustrating a method for event attendees to check invitation information and approve attendance proposed in this specification.

Figure 5 is a diagram for explaining a method of directly attending an event proposed in this specification.

Figure 6 is a diagram for explaining a method of simultaneously participating in multiple events proposed in this specification.

Figure 7 is a diagram for explaining a method of configuring a 2D view in parallel with a 3D space view proposed in this specification.

Figure 8 is a flowchart illustrating a method for participant terminals to participate in multiple events simultaneously using the AI-based avatar proposed in this specification.

Figure 9 illustrates a block diagram of the event management system proposed in this specification.

Figure 10 illustrates a block diagram of an attendee terminal proposed in this specification.

Figure 11 is a diagram to explain a user interface that configures a 2D view in parallel with the 3D spatial view proposed in this specification, creates a surrogate bot, and participates in an event at the same time.

Figure 12 is a diagram for explaining an example of a user interface for simultaneously participating in an event by creating a surrogate bot proposed in this specification.

Hereinafter, preferred embodiments according to the present specification will be described in detail with reference to the attached drawings. The detailed description set forth below in conjunction with the accompanying drawings is intended to illustrate exemplary embodiments of the present disclosure and is not intended to represent the only embodiments in which the disclosure may be practiced. The following detailed description includes specific details to provide a thorough understanding of the disclosure. However, one skilled in the art will recognize that the present disclosure may be practiced without these specific details.

In some cases, in order to avoid ambiguity in the concepts of the present specification, well-known structures and devices may be omitted or may be shown in block diagram form focusing on the core functions of each structure and device.

In this specification, '/' means 'and', 'or', or 'and/or' depending on the context.

Figure 1 is a flow chart to explain the event participation method proposed in this specification. Hereinafter, with reference to FIG. 1, we will look at the operations of the administrator terminal and participant terminals. Hereinafter, in this specification, all or part of the manager terminal and attendee terminal may be replaced with the manager avatar and attendee avatar. That is, the method proposed in this specification may be explained from the perspective of an avatar in a virtual space.

First, let's look at the operation of the administrator terminal (or administrator avatar).

관리자 단말의 동작Operation of administrator terminal

The administrator terminal (or administrator avatar) may generate an event in virtual space in step S110. Figure 2 is a diagram for explaining how the event manager proposed in this specification creates an event. Referring to FIG. 2, the administrator terminal (or administrator avatar) may display a virtual space display unit 210 and a graphical user interface unit 220. For example, the administrator terminal (or administrator avatar) may display the virtual space display unit 210 and the graphic user interface unit 220 through an output unit (eg, display). The virtual space display unit 210 may display an administrator avatar (eg, a directly controlled avatar or an AI-based avatar) in the virtual space. For example, the movement and movement of the manager avatar may be displayed on the virtual space display unit 210. The graphic user interface unit 220 is an area into which an administrator avatar cannot enter, and may refer to a part that provides convenience of operation to the user. For example, the administrator terminal receives the event name, event space (event hall), event date, event details, and attachments of the graphical user interface unit 220 from the user. ) can be input as event creation information. For example, the administrator terminal may include an input unit, and may receive event creation information, etc. from the user through the input unit. The input unit may be a keyboard, mouse, wearable device, etc. When the administrator terminal receives event creation information, etc. from the manager, it can generate an event based on the event creation information.

And/or, the manager terminal (or manager avatar) may transmit/deliver event invitation information to the attendee avatar (or attendee terminal) in step S120. For example, event invitation information may be information requesting attendance at an event created by an administrator terminal (or administrator). The list of users or the list of user avatars invited to the event may be entered as included in the event creation information, or may be entered as included in the invitation request information separately after the event creation information is entered. For example, if a list of invited users or a list of user avatars is included in the event creation information, the invitation information may be transmitted/delivered to the avatars (or terminals) in the user list or the list of user avatars after event creation. . For example, if the list of invited users or the list of user avatars is included in separate invitation request information, after an event is created and the invitation request information is entered, the avatars (or terminals) in the user list or the list of user avatars Invitation information may be transmitted/delivered to the users. And/or the invitation link is delivered, and the user who receives the invitation link can receive/deliver the invitation information by clicking the invitation link.

And/or, the invitation information may be transmitted/delivered to any avatars (or terminals) displayed on the virtual space display unit 210 without receiving a separate user list or user avatar list.

And/or, the invitation information may be shared through bulletin boards in the virtual space, etc., without receiving a separate list of invited users or user avatars, and the event may be progressed by a person wishing to attend applying for the event by an avatar in the virtual space. there is.

And/or, the attendee terminal (or attendee avatar) may approve attendance in step S130. Descriptions related to attendance approval will be described later in the operation of the attendee terminal (or attendee avatar).

And/or, the manager terminal (or manager avatar) may receive/deliver information related to attendance approval from the attendee avatar (or attendee terminal) in step S140. For example, information related to attendance approval may be information indicating attendance at an event during the event progress time. In other words, the information related to attendance approval may be information indicating attendance at the event during the event progress time. And/or, the attendance approval related information may include the attendee avatar (or attendee terminal) or attendee information. For example, information related to attendance approval may include information related to attendees or attendee avatars. For example, the information related to the attendee or attendee avatar may include the avatar's identification information (e.g., the avatar's registration number, etc.), and the affiliation information of the attendee or attendee avatar (e.g., company name, department name, company location, etc.). Alternatively, the administrator terminal (or administrator avatar) may not separately receive/deliver information related to attendance approval. In other words, the next operation may proceed without receiving/transmitting information related to attendance approval.

And/or, the attendee avatar (or attendee terminal) receives the user's attendance approval through the input unit, stores the contents of the invitation information, and notifies the user through the display unit when the event progress time approaches. For example, if the event start time is 2:00 PM, the attendee avatar (or attendee terminal) may announce the start of the event at 1:50 PM through an output unit (e.g., display).

And/or, the attendee terminal (or attendee avatar) may attend the event in step S150. For example, the administrator terminal (or administrator/administrator avatar) displays the participant avatar (or participant terminal) participating in the event during the event progress time through the virtual space display unit 310 and/or the graphical user interface unit 320, as shown in FIG. You can check it through . For example, six participant avatars may be displayed on the virtual space display unit 310. And/or, the graphic user interface unit 320 may include an event name (e.g., Event 1), an event space (e.g., Metaverse Hall 1), and an event progress time (e.g., 22/12/25, 12:00PM to 14:00PM). ), a list of participants, etc. may be displayed.

And/or, event-related shared information may be shared with the administrator terminal (or administrator avatar) and/or participant terminal (or participant avatar) before the event progress time. Attendees/users can review the information in advance and attend the event.

Next, let's look at the operation of the participant's terminal (or participant's avatar).

참석자 단말 동작Attendee terminal operation

The attendee terminal (or attendee avatar) may receive/deliver event invitation information from the administrator terminal (or administrator avatar) in step S120. For example, the output unit of the attendee terminal may display a scheduler on the graphic user interface unit 420, as shown in FIG. 4. For example, Scheduler may include an Invitation part and a My Schedule part. The Invitation part may display the contents of the received invitation information. For example, the invitation part includes the event name (e.g. Event 1), event space (e.g. Metaverse Hall 1), event progress time (e.g. 22/12/25, 12:00PM~14:00PM), An O button (e.g., attendance approval button), an X button (e.g., delete button), a button to display detailed information (e.g., Show Detail button), etc. may be displayed. Information related to approved events can be displayed in the My schedule part. For example, the My Schedule part contains the event name (e.g. Event 0), event space (e.g. Metaverse Hall 0), and event time (e.g. 22/12/25, 11:00PM to 12:00PM) for approved events. ), a delete button (X) for the event, a phrase indicating that it is impossible to attend the event (e.g., "Admission is possible 10 minutes before event start"), etc. may be displayed. For example, if it is 10 minutes before the start of a future event, the text indicating that you cannot attend the event will be displayed on the direct attendance button (e.g. In Person button), the avatar attendance button (e.g. In Avatar button), and the exit button (e.g. Exit ) can be changed and displayed.

And/or, the attendee terminal (or attendee avatar) may approve attendance in step S130. For example, the attendee terminal (or attendee avatar) may receive a click on the O button for invitation information from the user and move the invitation information for the event to the My schedule part and display it. For example, when the user clicks the 0 button for Event 1 displayed in the invitation part of the graphical user interface unit 420 of FIG. 4, information about Event 1 is displayed, as in the graphical user interface unit 430. Use it as part of My schedule, including event name (e.g. Event 1), event space (e.g. Metaverse Hall 1), and event progress time (e.g. 22/12/25, 12:00PM~14:00PM) ,

And/or, the attendee terminal (or attendee avatar) may transmit/deliver information related to attendance approval to the manager avatar (or manager terminal) in step S140. However, the corresponding operation may be omitted. Information related to attendance approval is described in detail in the operation of the administrator terminal.

And/or, the attendee avatar (or attendee) may attend the event in step S150. For example, as shown in Figure 5, when the graphic user interface unit 520 is 10 minutes before the start of the event, a phrase indicating that event attendance is not possible is displayed on the direct attendance button (e.g., In Person button) (activation button) and the avatar attendance button. It can be displayed as a button (e.g. In Avatar button) (active button) and an exit button (e.g. Exit) (inactive button).

At this time, the attendee terminal (or attendee avatar/attendee) can receive a click on the direct attendance button (e.g., In Person button) for Event 0 from the user and attend Event 0 in a direct attendance manner. In other words, the user can attend Event 0 by an avatar directly controlled by the user. In this case, when attending in person, the virtual space display unit 530 displays the event space of Event 0, and the graphical user interface unit 540 changes the job attendance button (e.g., In Person button) to 'Attending' and displays it. , can be displayed by activating the exit button (e.g. Exit).

Additionally, the attendee terminal (or attendee avatar) may receive a click on the avatar attendance button (eg, In Avatar button) for Event 1 of the graphical user interface unit 540 from the user. In this case, the event space of Event 1 may be displayed in the upper right, like the virtual space display unit 610. That is, in the virtual space display unit 610, the event space of Event 0, which was attended in person, can be displayed simultaneously in full screen, and the event space of Event 1, attended by (AI-based) avatar attendance, can be displayed in a pop-up screen. . In this case, when attending using the AI-based avatar method, as shown in FIG. 6, the graphic user interface unit 620 displays the (AI-based) avatar attendance button (e.g., In Avatar button) as 'Attending' and , can be displayed by activating the exit button (e.g. Exit).

At this time, an artificial intelligence (AI)-based avatar can attend Event 1 in place of the default avatar (i.e., an avatar controlled by the user) in Event 1 attended by an avatar attendance method. The AI-based avatar can learn and save the meeting contents and conversation contents of Event 1. For example, an AI-based avatar can exchange business cards or have a conversation with other attendee avatars, manager avatars, etc. who attended Event 1 based on previously learned information, and such information is saved at the time of learning and can be shared with the user later. can be provided. For example, an AI-based avatar can send or receive messages to other participant avatars, manage schedules for future schedules discussed in Event 1, and even provide push notifications when the schedule approaches. For example, AI-based avatars can perform chatbot functions. For example, an AI-based avatar can deliver a push notification to the user or avatar participating in Event 0 when a specific word is detected during a meeting. For example, an AI-based avatar may provide information such as the user's company information and IR materials to other participants in Event 1. In other words, AI-based avatars can not only attend events on behalf of users, but also actively/proactively proceed/participate in events. That is, in this specification, 'AI-based avatar that interacts with other avatars' may mean an AI-based avatar that can actively/proactively proceed/participate in events as described above.

The above-mentioned example focuses on attending the first event in person and then attending the second event as an AI-based avatar. However, after attending as an AI-based avatar, the person attends in person, or attends multiple events. You can only attend in person, or you can attend many events only with an AI-based avatar.

The above example has been explained with the focus on the attendee terminal (or attendee) using an AI-based avatar, but of course, the administrator terminal (or manager) can also manage multiple events using an AI-based avatar.

And/or, the user can attend both Event 0 and Event 1 as an avatar. For example, in the information about Event 0 and Event 1 of My schedule displayed on the graphic user interface unit 520 of FIG. 5, the (AI-based) avatar attendance button (In Avatar) is activated by the user. A click on a button) may be input. In this case, the event space of Event 0 and the event space of Event 1 may be displayed as separate pop-up screens, or one of them may be displayed as a full screen and the other as a pop-up screen.

And/or (during the event), Event 0 may be converted to an (AI-based) avatar attendance method and Event 1 may be converted to a direct attendance method. For example, when an avatar attendance button (In Avatar button) for Event 0 displayed on the graphic user interface unit 620 of FIG. 6 is input or a direct attendance button (In Person button) for Event 1 is input, the virtual space On the display unit 630, the event space of Event 1 can be displayed in full screen, and the event space of Event 0 can be displayed in a pop-up screen. At this time, the avatar attendance button (In Avatar button) for Event 0 and the direct attendance button (In Person button) for Event 1 displayed on the graphic user interface unit 620 are set to 'Attending' like the graphic user interface unit 640. The display can be switched.

In the above-described embodiments, the description is focused on the operation of participating in two events (Event 0/Event 1), but the method is not limited thereto, and of course, the proposed method can also be applied to attending two or more events.

In the above-described embodiments, the operation of transmitting and receiving information between the manager terminal and the attendee terminal may include the operation of transmitting and receiving information based on the event management server device, as shown in FIG. 9.

3D 공간 뷰와 2D 뷰의 병렬적 구성Parallel composition of 3D spatial view and 2D view

The administrator terminal or attendee terminal can configure and display a 2D view in parallel with the screen for the virtual space. Figure 7 illustrates a parallel configuration of a 3D spatial view and a 2D view.

Referring to FIG. 7, the 3D spatial view and the 2D view can be displayed through the output unit of the administrator terminal or attendee terminal. The 2D view can be placed sequentially to the right of the 3D spatial view. The 3D spatial view may refer to a screen portion displaying a virtual space. A 2D view can include common parts and specialized parts. The specialized part may change depending on the situation of the user or avatar or the use/characteristics of the virtual space. For example, the 2D view may include a message button, an attendee button, a meeting minutes button 70, a my information button, a workspace button, a settings button, and a scheduler button. Of these, the meeting minutes button 70 may be included in the specialized part and the rest may be included in the common part. That is, if the space where the avatar is located is a conference room, the meeting minutes button 70 may be displayed in the 2D view. For example, if the avatar is located in a store in a virtual space, the meeting minutes button 70 may be changed to a shopping cart button and displayed. And/or, the 2D view may be displayed by changing the size, ratio, graphic style, theme, etc. depending on the user's or avatar's situation or the purpose/characteristics of the virtual space. This specification can increase the utilization of space within the virtual space by configuring the 3D space view and the 2D view in parallel.

Referring to FIG. 11, a 3D spatial view and a 2D view may be displayed on the user display. The 2D view may be placed sequentially to the left and/or right of the 3D spatial view. The 3D spatial view may refer to a screen portion displaying a virtual space.

In the example of Figure 11, the 2D view may include an object 1103 that allows selection of the host's dedicated server. When a user selects a random server, information on the virtual space provided by the server may be displayed through the 2D view 1102, and the virtual space may be displayed in the adjacent 3D space view 1101.

In the example of Figure 11, the user can communicate with other users after entering the private space. At this time, the user can create an avatar 1104 and enter the private space, and multiple avatars can be operated at the same time.

According to an embodiment of the present invention, a user can create a surrogate bot and operate an avatar through the surrogate bot in order to participate in multiple private spaces at the same time.

The surrogate bot learns the user's language patterns and applies the purpose of the event to communicate with other users without user input, such as 1105. At this time, the surrogate bot can determine the context of the conversation, deliver the message to the user when an important message or question is received from the user, and reflect the user input in the conversation.

Furthermore, the surrogate bot can report activity details for a preset time to the user. For example, you can report to the user that as a result of attending today's conference, 2 questions were asked, 3 people expressed gratitude, and 16 people mentioned me.

Figure 12 is a diagram for explaining an example of a user interface for participating in an event by creating a surrogate bot proposed in this specification.

Referring to Figure 12, a user can participate in an event by creating a surrogate bot. The surrogate bot can create the form of an avatar by reflecting the purpose, dress code, and items of the event without user input.

Figure 8 is a flow chart to explain a method of simultaneously participating in multiple events using the AI-based avatar proposed in this specification. For example, the method may be performed by an attendee terminal.

Referring to FIG. 8, first, the attendee terminal (or attendee avatar) may receive or receive invitation information for the first event in the virtual space from the first manager avatar in step S810. For example, invitation information may include information about the event title (e.g., Event 0), information about the event space (e.g., Metaverse Hall 0), and/or information about the time of the event (e.g., 22/12/25 11 :00PM~12:00PM).

And/or, the attendee terminal (or attendee avatar) may receive or receive invitation information for the second event in the virtual space from the second manager avatar in step S820. For example, invitation information may include information about the event title (e.g., Event 1), information about the event space (e.g., Metaverse Hall 1), and/or information about the event time (e.g., 22/12/25 11 :00PM~14:00PM).

And/or, the attendee terminal (or attendee avatar) may participate in the first event based on the avatar directly controlled in step S830. For example, when the attendee terminal receives a click on the in Person button for Event 0 of the graphical user interface unit 520 of FIG. 5, the attendee or attendee avatar can participate in the first event. For example, here, the attendee avatar may be an avatar directly controlled by the user. For example, when the in Person button for Event 0 is clicked by the user, the image of the button changes from the in Person button for Event 0 to an Attending button, as shown in the graphical user interface unit 620 of FIG. 6. It can be.

And/or, the attendee terminal (or attendee avatar) may participate in the second event held simultaneously with the first event by an artificial intelligence (AI)-based avatar that interacts with other avatars in step S840. . For example, for Event 0, the event time is 22/12/25 11:00PM~12:00PM, and for Event 1, the event time is 22/12/25 11:00PM~14:00PM, so they take place simultaneously. In Event 1, an AI-based avatar can participate on your behalf. For example, when the attendee terminal receives a click on the in Avatar button for Event 1 of the graphic user interface unit 520 of FIG. 5, the AI-based avatar can participate in the second event. For example, when the click on the in Avatar button for Event 1 is input by the user, the image of the button changes from the in Avatar button for Event 1 to the Attending button, as shown in the graphical user interface unit 620 of FIG. 6. It can be.

The AI-based avatar replaces the user or the avatar (or attendee avatar) controlled by the user, and provides information within Event 1, such as presenting opinions/receiving opinions/delivering data/receiving data, etc. to other avatars (or attendees) of Event 1. Able to perform all necessary activities.

For example, an AI-based avatar can respond to inquiries/inquiries from other avatars (or attendees) in real time with a message or voice, or deliver material information related to a second event, based on machine learning. And/or, the AI-based avatar can inquire with other avatars (or attendees) in real time through a message or voice, or deliver material information related to the second event, based on machine learning. For example, an AI-based avatar can participate in an event based on previously learned information or information learned in real time from the event. Here, the other avatar may be an avatar controlled by another attendee or an AI-based avatar of another attendee. For example, data information related to the second event may mean a data file prepared by the user related to the second event. For example, the second event-related data information may be files such as company information and IR data.

And/or, the AI-based avatar stores at least one of video information, audio information, and/or shared data information about the second event in the virtual space, and based on a request for confirmation of information input from the user, the video At least one of information, voice information, and/or shared data information may be displayed/output. For example, video information may mean a file or information in which the progress of a second event in a virtual space is stored as a video. For example, voice information may refer to all information output through a speaker, etc. during a second event in a virtual space, such as the speaker's voice, the participant's voice, and sounds generated from published materials. For example, shared material information may refer to all information shared by other attendees at the second event. For example, when a request to confirm information is input from a user through an input unit to be described later, the attendee terminal can display/output the corresponding information through an output unit to be described later. Here, displaying/outputting the relevant information may mean displaying/outputting an icon image representing the relevant information, or may mean executing and displaying/outputting the relevant information.

And/or, the AI-based avatar may detect a preset word/sentence or movement among another avatar's voice or avatar movement, and display/output notification information. For example, if the “final discussion item” is already set, the AI-based avatar detects the “final discussion item” during the event, and the attendee terminal (or attendee avatar) displays a notification about this through the output unit, which will be described later. /Can be printed. And/or, when another avatar (of another attendee) detects a hand gesture indicating the AI-based avatar, the attendee terminal (or attendee avatar) may display/output a notification about this through an output unit to be described later.

And/or, the output screen for the virtual space is a 3D space view (or 3D space portion) (e.g., 3D space view in FIG. 7) and a 2D view (or 2D portion/GUI portion) configured in parallel with the 3D space view. ) (e.g., the 2D view in FIG. 7), the 3D space view displays a virtual space, and the 2D view displays a graphical user interface (GUI) that changes depending on the characteristics of the displayed virtual space. You can. For example, the displayed virtual space may refer to a space where a user or a user avatar is located and displayed through a 3D spatial view. For example, when the displayed virtual space is a conference room, the 2D view may include a meeting minutes icon 70, as shown in FIG. 7 . For example, when the user or the user avatar moves to a store, the meeting minutes icon 70 in FIG. 7 may be changed to a shopping cart icon.

The operation of the attendee terminal (or attendee avatar) described with reference to FIG. 8 can be supplemented by the content described with reference to FIGS. 1 to 7 and 9 to 10.

Although the above-mentioned proposed method was explained focusing on an attendee terminal (or an attendee avatar), the method of simultaneously participating in multiple events using an AI-based avatar can also be applied to an administrator terminal (or an administrator avatar). In other words, the user of the manager terminal can manage multiple events simultaneously using an AI-based avatar.

The method proposed in this specification may be applied in terms of communication between the attendee terminal, the first manager terminal, the second manager terminal, and each other, and the first manager avatar in the virtual space, the second manager avatar, the attendee avatar, and each other in the virtual space. It can also be applied from the perspective of information transmission and reception.

Referring to FIG. 9, the event management system may include an attendee terminal 100, an administrator terminal 200, a communication network 300, and an event management server device 400.

The attendee terminal 100 and/or the manager terminal 200 are wired or wireless devices connected to the communication network 300, and connect to the event management server device 400 through the communication network 200, creating a virtual space as described above. It allows you to participate/manage multiple events at the same time using an AI-based avatar. The attendee terminal 100 and the administrator terminal 200 may be controlled by the user. In this specification, a user may be replaced by an attendee or an administrator, and an attendee or an administrator may be replaced by a user.

The event management server device 400 allows attendee terminals 100 and manager terminals 200 or their users connected through the communication network 300 to create/manage events, and allows attendee terminals 100 or users to create/manage events. It is a server device that allows participation in multiple events in a virtual space using an AI-based avatar, and allows the administrator terminal 200 or a user to manage multiple events in a virtual space using an AI-based avatar. For example, transmitting and receiving information between the attendee terminal 100 and the manager terminal 200 may mean transmitting and receiving information based on the event management server device 400.

For example, the attendee terminal 100, the administrator terminal 200, and the event management server device 400 are robots, XR (eXtended Reality) devices, vehicles, mobile devices, home appliances, IoT devices, AI devices/servers, etc., Or it may constitute part of them. For example, vehicles may include vehicles equipped with wireless communication functions, autonomous vehicles, vehicles capable of inter-vehicle communication, etc. Here, the vehicle may include an Unmanned Aerial Vehicle (UAV) (eg, a drone). XR devices include AR (Augmented Reality)/VR (Virtual Reality)/MR (Mixed Reality) devices, HMD (Head-Mounted Device), HUD (Head-Up Display) installed in vehicles, televisions, smartphones, It can be implemented in the form of computers, wearable devices, home appliances, digital signage, vehicles, robots, etc. Portable devices may include smartphones, smart pads, wearable devices (e.g., smartwatches, smart glasses), and computers (e.g., laptops, etc.). Home appliances may include TVs, refrigerators, washing machines, etc. IoT devices may include sensors, smart meters, etc.

Referring to FIG. 10 , the attendee terminal 100 may include one of one or more transceivers 110, one or more processors 120, and/or one or more memories 130.

Processor 120 controls memory 130 and/or transceiver 110 and may be configured to implement the descriptions, functions, procedures, suggestions, methods and/or operational flowcharts disclosed herein. For example, the processor 120 may process information in the memory 130 to generate first information/signal and then transmit a wireless signal including the first information/signal through the transceiver 110. Additionally, the processor 120 may receive a wireless signal including the second information/signal through the transceiver 110 and then store information obtained from signal processing of the second information/signal in the memory 130.

The memory 130 may be connected to the processor 120 and may store various information related to the operation of the processor 120. For example, memory 130 may perform some or all of the processes controlled by processor 120 or instructions for performing the descriptions, functions, procedures, suggestions, methods, and/or operational flowcharts disclosed herein. Software code containing them can be stored.

The transceiver 110 may be connected to the processor 120 and may transmit and/or receive wireless signals through one or more antennas. Transceiver 110 may include a transmitter and/or receiver. The transceiver 110 may be used interchangeably with an RF (Radio Frequency) unit.

And/or, the attendee terminal 100 may further include an input unit and/or an output unit. The input unit may be connected to the transceiver 110, processor 120, and/or memory 130, and may receive a command from the user and send a command to the transceiver 110, processor 120, and/or memory 130. It can be delivered. For example, the input unit may be a keyboard, mouse, joystick, controller, headset, microphone, wearable input device, or parts thereof. The output unit may be connected to the processor 120 and/or the memory 130 and may output signals to the user in response to commands from the processor 120 and/or the memory 130. For example, the output unit may be a monitor, speaker, headset, wearable output device, or parts thereof.

And/or, the manager terminal 200 may also include at least one component/means of the attendee terminal 100 of FIG. 10 .

The embodiments described above combine the elements and features of the present specification in a predetermined form. Each component or feature should be considered optional unless explicitly stated otherwise. Each component or feature may be implemented in a form that is not combined with other components or features. Additionally, it is possible to configure an embodiment of the present invention by combining some components and/or features. The order of operations described in embodiments of the present invention may be changed. Some features or features of one embodiment may be included in other embodiments or may be replaced with corresponding features or features of other embodiments. It is obvious that claims that do not have an explicit reference relationship in the patent claims can be combined to form an embodiment or included as a new claim through amendment after filing.

Embodiments according to the present specification may be implemented by various means, for example, hardware, firmware, software, or a combination thereof. In the case of implementation by hardware, an embodiment of the present invention includes one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), and FPGAs ( It can be implemented by field programmable gate arrays, processors, controllers, microcontrollers, microprocessors, etc.

In the case of implementation by firmware or software, an embodiment of the present invention may be implemented in the form of a module, procedure, function, etc. that performs the functions or operations described above. Software code can be stored in memory and run by a processor. The memory is located inside or outside the processor and can exchange data with the processor through various known means.

It is obvious to those skilled in the art that the present specification can be embodied in other specific forms without departing from the essential features of the present specification. Accordingly, the above detailed description should not be construed as restrictive in all respects and should be considered illustrative. The scope of this specification should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of this specification are included in the scope of this specification.

Claims

In a method of participating in multiple events in a virtual space simultaneously,

Receiving invitation information for a first event in the virtual space from a first administrator avatar;

Receiving invitation information for a second event in the virtual space from a second manager avatar;

Participating in the first event based on an avatar directly controlled by the user; and

Participating in the second event held simultaneously with the first event based on an artificial intelligence (AI)-based avatar that interacts with other user avatars attending the second event,

The AI-based avatar responds to inquiries from other user avatars and/or transmits data related to a second event in real time based on machine learning,

The AI-based avatar inquires in real time to the other user avatar based on the machine learning, and receives a response to the AI-based avatar's inquiry.
According to paragraph 1,

The AI-based avatar stores at least one of video information, audio information, and/or shared data information about the second event in the virtual space, and based on a request for confirmation of information input from the user, the video information , A method in which at least one of the voice information and/or the shared material information is displayed.
According to paragraph 1,

A method wherein the AI-based avatar detects a preset voice or movement among the voices or movements of the other user's avatar and displays notification information.
According to paragraph 1,

The output screen for the virtual space includes a 3D space view and a 2D view configured in parallel with the 3D space view, the 3D space view displays the virtual space, and the 2D view displays characteristics of the displayed virtual space. How to display a graphical user interface that changes depending on the
According to paragraph 1,

A method wherein the invitation information for the first event or the second event includes at least one of information about the event title, information about the event space, and/or information about the event progress time.
In an attendee terminal for simultaneously participating in multiple events in a virtual space,

at least one transceiver;

at least one processor; and

At least one memory operably coupled to the at least one processor and storing instructions to perform operations based on execution by the at least one processor,

The above operations are:

Receiving invitation information for a first event in the virtual space from a first administrator avatar;

Receiving invitation information for a second event in the virtual space from a second administrator avatar;

Participating in the first event based on an avatar directly controlled by a user of the attendee terminal; and

Based on an artificial intelligence (AI)-based avatar that interacts with other user avatars attending the second event, it includes participating in the second event that takes place simultaneously with the first event in the virtual space. However,

The AI-based avatar responds to inquiries from other user avatars and/or transmits data related to a second event in real time based on machine learning,

The AI-based avatar inquires in real time to the other user avatar based on the machine learning, and an attendee terminal that receives a response to the AI-based avatar's inquiry.
According to clause 6,

The AI-based avatar stores at least one of video information, audio information, and/or shared data information about the second event in the virtual space, and based on a request for confirmation of information input from the user, the video information , an attendee terminal on which at least one of the voice information and/or the shared material information is displayed.
According to clause 6,

The AI-based avatar is an attendee terminal that detects a preset voice or movement among the voices or movements of the other user's avatar and displays notification information.
According to clause 6,

The output screen for the virtual space includes a 3D space view and a 2D view configured in parallel with the 3D space view, the 3D space view displays the virtual space, and the 2D view displays characteristics of the displayed virtual space. An attendee terminal that displays a graphical user interface that changes depending on the user.
According to clause 6,

The invitation information for the first event or the second event includes at least one of information about the event title, information about the event space, and/or information about the event progress time.