WO2023190344A1

WO2023190344A1 - Information processing device, information processing method, and program

Info

Publication number: WO2023190344A1
Application number: PCT/JP2023/012203
Authority: WO
Inventors: 譲治堀
Original assignee: 株式会社ジクウ
Priority date: 2022-03-29
Filing date: 2023-03-27
Publication date: 2023-10-05
Also published as: JP2023146875A

Abstract

The present invention addresses the problem of improving convenience in a system that utilizes an avatar viewpoint image within a virtual space.　A virtual space arrangement unit 51 arranges, in a three-dimensional virtual space, an exhibition hall in which a booth is arranged, and an avatar that can move within the exhibition hall. An exhibitor avatar generation unit 52 generates an exhibitor avatar as an avatar that is configured using two-dimensional information, such generation being on the basis of an instruction for generating an exhibitor avatar, from among instructions issued through operations by an exhibitor on an exhibitor terminal 3. An avatar movement unit 53 moves the position of an avatar to second coordinates on the basis of an instruction from a visitor to move the avatar. An avatar viewpoint image generation unit 55 generates, as an avatar viewpoint image, a three-dimensional image captured from a viewpoint set on the basis of the second coordinates in the virtual space in which the exhibition hall, in which the booth is arranged at first coordinates, and the avatar at the second coordinates are arranged. This configuration solves the abovementioned problem.

Description

Information processing device, information processing method, and program

The present invention relates to an information processing device, an information processing method, and a program.

Conventionally, there is a technology related to VR (Virtual Reality) in which images captured from various viewpoints in a three-dimensional virtual space are viewed using an HMD (Head Mounted Display) or the like (see Patent Document 1).

Japanese Patent Application Publication No. 2017-012397

However, in the conventional technology including the technology described in Patent Document 1, the settings are simply based on an image captured from a viewpoint of a certain position (coordinates) in a predetermined three-dimensional virtual space, for example, an avatar existing in the virtual space. In the past, only an image captured from a given viewpoint (hereinafter referred to as an "avatar viewpoint image") was generated and viewed by the user. When viewing an avatar perspective image, the user knows that it includes objects that exist in the virtual space (other users' avatars, walls, etc.), but it is difficult to know which object to take an action on (for example, talking to). It was difficult to understand.
That is, in the conventional technology including the technology described in Patent Document 1, the convenience in a system using an avatar viewpoint image in a virtual space is not sufficient.

The present invention has been made in view of this situation, and aims to improve the convenience of a system that uses avatar viewpoint images in a virtual space.

To achieve the above object, an information processing device according to one embodiment of the present invention includes:
Arrangement means for arranging, in a three-dimensional virtual space, an exhibition hall in which a booth is arranged, an exhibitor avatar existing as an exhibitor in the booth, and a visitor avatar movable as a visitor within the exhibition hall. and,
An exhibitor avatar that generates the exhibitor avatar as an avatar composed of two-dimensional information based on a first instruction to generate the exhibitor avatar among instructions performed by a first user's operation on a first device. a generating means;
A visitor who moves the avatar to a predetermined position in the virtual space based on a second instruction to move the avatar to a predetermined position in the exhibition hall among instructions performed by a second user's operation on a second device. person avatar transportation means,
In the exhibition hall where the booth is located where the exhibitor avatar composed of two-dimensional information is located at a fixed position, and in the virtual space where the visitor avatar at the predetermined position is located, the coordinates are image generation means for generating a three-dimensional image captured from a viewpoint set based on the image as a visitor viewpoint image;
a display control unit that executes control to display the visitor viewpoint image on the second device;
Equipped with

An information processing method and program according to one embodiment of the present invention are methods and programs corresponding to an information processing apparatus according to one embodiment of the present invention.

According to the present invention, it is possible to improve the convenience of a system that uses avatar viewpoint images in a virtual space.

FIG. 2 is a diagram showing an example of a screen displayed in a service provided using a server according to an embodiment of an information processing device of the present invention. FIG. 2 is a diagram illustrating an example of a screen displayed in a service provided using a server according to an embodiment of the information processing device of the present invention, which is different from FIG. 1; 1 is a diagram illustrating an example of the configuration of an information processing system to which a server according to an embodiment of an information processing apparatus of the present invention is applied. 4 is a block diagram showing an example of the hardware configuration of a server in the information processing system shown in FIG. 3. FIG. FIG. 5 is a functional block diagram showing an example of the functional configuration of the server in FIG. 4 that constitutes the information processing system in FIG. 2; 6 is a diagram illustrating an example of an image showing a screen for performing various settings regarding a booth including an avatar, among images displayed on an exhibitor terminal under the control of the server having the functional configuration of FIG. 5. FIG. 6 is a diagram illustrating an example of an image showing a screen for providing visitor information to an exhibitor, among images displayed on an exhibitor terminal under the control of the server having the functional configuration of FIG. 5. FIG. 6 is a diagram illustrating an example of an image showing a screen including an attendant for visitors among images displayed on an exhibitor terminal under the control of the server having the functional configuration of FIG. 5. FIG.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a diagram showing an example of a screen displayed in a service provided using a server according to an embodiment of an information processing apparatus of the present invention.

First, before explaining the embodiment of the present invention, using FIG. 1, a service provided using a server according to an embodiment of the information processing apparatus of the present invention (hereinafter referred to as "this service") will be explained. Explain briefly.
This service is the following service.
In other words, this service provides support to organizers (for example, organizer US in Figure 2), exhibitors (for example, exhibitors UT-1 to UT-n in Figure 2), at an exhibition held in a three-dimensional virtual space. and services provided to visitors (for example, visitors UR-1 to UR-m in FIG. 2).

Specifically, for example, as shown in FIG. 1, an exhibition hall TH set by the organizer is arranged in the three-dimensional virtual space. In the exhibition hall TH, a plurality of booths B are arranged where products, etc. (content) of a plurality of exhibitors are exhibited.
A visitor operates a terminal (for example, visitor terminals 4-1 to 4-m in FIG. 2) to move within the exhibition hall TH as an avatar A and visit a booth B of interest.
Figure 1 shows an example of a three-dimensional image GA (hereinafter referred to as "avatar perspective image GA") obtained as a result of capturing a three-dimensional virtual space from a viewpoint based on avatar A, displayed on a visitor's terminal. It is shown.

Then, the visitor operates the terminal to visit booth B located in exhibition hall TH, view the exhibits in booth B, and receive explanations from exhibitors.

Here, the avatar placed in the three-dimensional virtual space is usually a 3D avatar.
In this service as well, the visitor's avatar AR (hereinafter referred to as "visitor avatar AR") is a 3D avatar. That is, the visitor avatar AR is an avatar made up of three-dimensional polygons.
However, the exhibitor's avatar AS (hereinafter referred to as "exhibitor avatar AS") is a live-action 2D avatar. That is, the exhibitor avatar AS employs a two-dimensional photographic image.
Although details will be described later, in FIG. 1, the exhibitor's avatar AS displays a message in the form of a speech bubble that reads, ``This is the booth of 〇〇, which provides 3D online event services.'' That is, a visitor who is about to stop by booth B is provided with a line from the exhibitor's avatar AS.
Below, as shown in FIG. 1, the visitor avatar AR and exhibitor avatar AS in the avatar viewpoint image GA will be explained in more detail.

Since the exhibitor avatar AS is a two-dimensional image, it will be included in the avatar viewpoint image GA with high image quality. As a result, the visitors can understand the exhibitor avatar AS through a live-action 2D avatar (photo image) that is more realistic, and therefore can feel a sense of familiarity. As a result, it becomes easier for visitors to talk to exhibitors.

Furthermore, there is also a 3D avatar that has a large number of polygons and can have high image quality on the avatar viewpoint image GA, similar to the live-action 2D avatar. However, employing such a 3D avatar for both the exhibitor avatar AS and the visitor avatar AR imposes an extremely high performance burden.
Therefore, in this service, a live-action 2D avatar is used as the exhibitor avatar AS. This has the effect of reducing the performance burden and making it easier for the above-mentioned visitors to talk to exhibitors.

Additionally, this service uses an avatar made of rough three-dimensional polygons as shown in Figure 1 as the visitor avatar AR. This reduces the performance burden. As a result, it is possible to reduce the performance load and to install a large number of avatars within the exhibition hall TH.

Furthermore, the visitor avatar AR is an avatar made up of three-dimensional polygons, and has different properties from the exhibitor avatar AS. For this reason, the exhibitor avatar AS stands out in the avatar viewpoint image GA, making it easier for visitors to grasp the exhibitor with whom they can talk.
Hereinafter, as a difference in characteristics between the visitor avatar AR and the exhibitor avatar AS, a difference in how the avatars appear in the avatar viewpoint image GA will be explained.

Consider a case where another visitor's avatar AR is viewed from the visitor's avatar AR.
In this case, the other visitor avatars are 3D avatars. Therefore, as described above, other visitor avatars are included in the avatar viewpoint image GA as relatively rough three-dimensional polygons.
In addition, when you are facing another visitor's avatar AR and move to the side of the other visitor's avatar AR while looking at the other visitor's avatar AR, The appearance of the person's avatar AR viewed from an angle or the side is reflected in the avatar viewpoint image GA.

Next, consider a case where the exhibitor avatar AS is viewed from the visitor avatar AR.
In this case, the exhibitor avatar AS is a live-action 2D avatar (a two-dimensional photographic image). Therefore, as described above, the exhibitor avatar AS is included in the avatar viewpoint image GA as a high-quality photograph.
Furthermore, a live-action 2D avatar (a two-dimensional photographic image) has no thickness in a three-dimensional virtual space. Therefore, if the exhibitor avatar is fixed in the three-dimensional virtual space, when the visitor avatar AR moves from facing the exhibitor avatar AS to the side of the exhibitor avatar AS, The exhibitor's avatar AS appears to have perspective, becomes thinner, or becomes thinner and invisible from the side.

In this way, when the visitor avatar AR moves, the way the visitor avatar AR, which is a 3D avatar, and the exhibitor avatar AS, which is a live-action 2D avatar, look different.
Thereby, the visitor can easily distinguish between the visitor avatar AR and the exhibitor avatar AS in the avatar viewpoint image GA.

Based on the above-mentioned characteristics, this service has a "2D avatar automatic direction change function" in order to obtain an avatar image more suitable for visitors. The "2D avatar automatic direction change function" will be described below with further reference to FIG. 2.

FIG. 2 is an example of a screen displayed in a service provided using a server according to an embodiment of the information processing device of the present invention, and is a diagram showing an example different from FIG. 1.

The visitor avatar AR in FIG. 2 has moved to the right (moved counterclockwise when looking at the exhibition hall TH from above) with booth B, exhibitor avatar AS, etc. in the center compared to FIG. 1. That is, in both the avatar viewpoint images GA shown in FIGS. 1 and 2, the exhibitor avatar AS is directly facing the visitor avatar.
That is, in this service, the direction of the exhibitor avatar AS is automatically changed by the automatic direction change function of the 2D avatar so that it is directly facing the position of the visitor avatar AR.
As a result, the exhibitor avatar AS does not appear perspective or thin, or becomes thin and invisible from the side, making it easy to grasp the position of the exhibitor avatar AS in the avatar viewpoint image GA.

Furthermore, as described above, when the visitor avatar AR moves, it is reflected in the avatar viewpoint image GA as an oblique view or side view of another visitor avatar AR. On the other hand, when the visitor avatar AR moves, the exhibitor avatar AS is reflected in the avatar viewpoint image GA as always facing directly.
This further facilitates understanding of the position of the exhibitor avatar AS within the avatar viewpoint image GA.

Furthermore, the basic flow of this service will be explained below.

Each of the organizers, exhibitors, and participants uses their respective terminals to manage the services provided by the provider of this service (hereinafter referred to as the "service provider") via the Internet using browser functions, etc. This service can be used by connecting to a server (for example, server 1 in FIG. 2, which will be described later). That is, this service is realized as a so-called cloud service.
Here, instead of the browser function, this service may be made available by using dedicated application software (hereinafter referred to as a "dedicated application") installed in advance on the terminal.

First, the organizer operates a terminal to determine the shape of the exhibition hall TH and the layout of the booth B.
The organizer then invites multiple exhibitors, negotiates with them, and decides on booth placement.
The organizer operates the terminal to display a management screen, and uses the management screen to arrange the booths B of the plurality of exhibitors in the exhibition hall TH based on the booth arrangement.
The exhibitor operates the terminal to display the management screen, and makes various settings for his or her booth B on the management screen. At that time, the exhibitor operates the terminal to set the avatar of the person in charge who will give explanations etc. at booth B, that is, the above-mentioned exhibitor avatar AS. The details will be described later using Figure 6, but exhibitors can use exhibitor avatar AS by selecting an arbitrary avatar from the prepared exhibitor avatar AS or by uploading a photo of the person in charge taken in advance. Set.
This allows the participant (Avatar A) to visit the exhibition hall TH in the three-dimensional virtual space.

After the visitor operates a terminal and pre-registers, he or she can log in on the day of the exhibition (event) and move around the exhibition hall TH as avatar A. The movement of avatar A is displayed on the terminal as an avatar viewpoint image GA.
Visitors can operate terminals to move around the exhibition hall TH, visit booths B that they wish to visit, view exhibits, listen to exhibitors' explanations, and so on.

Although the details will be described later, visitors can use the terminals to utilize various functions that improve the convenience of visiting each booth B.

Next, referring to FIG. 2, the configuration of an information processing system that realizes the provision of the service shown in FIG. 1 described above, that is, an information processing system to which a server according to an embodiment of the information processing apparatus of the present invention is applied explain.
FIG. 2 is a diagram illustrating an example of the configuration of an information processing system to which a server according to an embodiment of the information processing apparatus of the present invention is applied.

The information processing system shown in FIG. (m is an integer value of 1 or more independent of n).
The server 1, organizer terminal 2, exhibitor terminals 3-1 to 3-n, and visitor terminals 4-1 to 4-m are interconnected via a predetermined network NW such as the Internet.

The server 1 is an information processing device managed by a service provider. The server 1 executes various processes to realize this service while communicating with the organizer terminal 2, exhibitor terminals 3-1 to 3-n, and visitor terminals 4-1 to 4-m as appropriate. .

The organizer terminal 2 is an information processing device operated by the organizer US. The organizer terminal 2 is composed of a personal computer, a tablet, a smartphone, etc. The organizer terminal 2 receives various information input operations by the organizer US and transmits them to the server 1, and receives and displays various information transmitted from the server 1, for example. Note that although only one organizer terminal 2 is depicted in FIG. 2, this is simplified to make the explanation easier to understand. In reality, there may be organizer terminals 2 corresponding to a plurality of exhibitions (events), ie, a plurality of organizers US.

Each of the exhibitor terminals 3-1 to 3-n is an information processing device operated by each of the exhibitors UT-1 to UT-n. As described above, the exhibitor terminal 3 is composed of a personal computer, a tablet, a smartphone, etc.
Note that hereinafter, unless it is necessary to distinguish between exhibitors UT-1 to UT-n, they will be collectively referred to as exhibitors UT. Furthermore, when referred to as exhibitor UT, exhibitor terminals 3-1 to 3-n are collectively referred to as "exhibitor terminal 3."
The exhibitor terminal 3 receives various information input operations by the exhibitor UT and transmits the received information to the server 1, or receives and displays various information transmitted from the server 1, for example.

Each of the visitor terminals 4-1 to 4-n is an information processing device operated by each of the visitors UR-1 to UR-m. As described above, the visitor terminal 4 is composed of a personal computer, a tablet, a smartphone, etc.
Note that hereinafter, if there is no need to distinguish each of the visitors UR-1 to UR-m, they will be collectively referred to as the visitor UR. Furthermore, when referred to as visitor UR, visitor terminals 4-1 to 4-m are collectively referred to as "visitor terminal 4."
The visitor terminal 4 receives various information input operations by the visitor UR, for example, and transmits the received information to the server 1, or receives and displays various information transmitted from the server 1.

FIG. 3 is a block diagram showing an example of the hardware configuration of a server in the information processing system shown in FIG. 2.

The server 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input/output interface 15, an input unit 16, and an output unit. Part 17 and , a storage section 18, a communication section 19, and a drive 20.

The CPU 11 executes various processes according to programs recorded in the ROM 12 or programs loaded into the RAM 13 from the storage section 18 .
The RAM 13 also appropriately stores data necessary for the CPU 11 to execute various processes.

The CPU 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input/output interface 15 is also connected to this bus 14 . An input section 16 , an output section 17 , a storage section 18 , a communication section 19 , and a drive 20 are connected to the input/output interface 15 .

The input unit 16 includes, for example, a keyboard, and inputs various information.
The output unit 17 includes a display such as a liquid crystal display, a speaker, and the like, and outputs various information as images and sounds.
The storage unit 18 is composed of a DRAM (Dynamic Random Access Memory) or the like, and stores various data.
The communication unit 19 communicates with other devices (for example, the organizer terminal 2, exhibitor terminals 3-1 to 3-n, and visitor terminals 4-1 to 4-m in FIG. 2) via a network NW including the Internet. Communicate between.

A removable medium 31 made of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately installed in the drive 20. The program read from the removable medium 31 by the drive 20 is installed in the storage unit 18 as necessary.
Further, the removable medium 31 can also store various data stored in the storage section 18 in the same manner as the storage section 18 .

Although not shown, the organizer terminal 2, exhibitor terminal 3, and visitor terminal 4 in FIG. 2 can also have basically the same hardware configuration as the hardware configuration shown in FIG. 3. Therefore, a description of the hardware configurations of the organizer terminal 2, exhibitor terminal 3, and visitor terminal 4 will be omitted.

Various types of processing can be executed through cooperation between various types of hardware and various types of software in the server 1 shown in FIG. 3. As a result, the above-mentioned service can be provided.
The functional configuration executed in the server 1 of FIG. 3 that constitutes the information processing system of FIG. 2 will be described below.
FIG. 4 is a functional block diagram showing an example of the functional configuration of the server in FIG. 3 that constitutes the information processing system in FIG. 2.

As shown in FIG. 4, the CPU 11 of the server 1 includes an exhibition hall installation section 51, an exhibitor avatar generation section 52, an avatar movement section 53, a virtual space arrangement section 54, an avatar viewpoint image generation section 55, A display control section 56, a line acquisition section 57, a line output section 58, a chat control section 59, a locus collection section 60, and an exhibitor side control section 61 function.

The exhibition hall setting unit 51 sets the exhibition hall TH in the three-dimensional virtual space based on the organizer US's operation on the organizer terminal 2.

The exhibitor avatar generation unit 52 generates an exhibitor avatar AS for the booth B in the exhibition hall TH from among the instructions given by the organizer US's operation on the organizer terminal 2 or the exhibitor UT's operation on the exhibitor terminal 3. Based on the instruction, an avatar composed of two-dimensional information is generated as an exhibitor avatar AS in the exhibition hall TH.

Note that, as necessary, the exhibitor avatar generation unit 52 generates a plurality of pre-prepared exhibitor avatars from among the instructions issued by the organizer US's operation on the organizer terminal 2 or the exhibitor UT's operation on the exhibitor terminal 3. It is also possible to generate an avatar composed of two-dimensional information based on an instruction to select an arbitrary one from the user avatars AS.
In addition, as necessary, the exhibitor avatar generation unit 52 generates an image based on an instruction to transmit and select a photographic image of a real exhibitor or a predetermined model, among instructions performed by operating the exhibitor UT. It is also possible to generate an avatar made up of two-dimensional information.

That is, the exhibitor avatar generation unit 52 can generate an avatar by causing the exhibitor terminal 3 of the exhibitor UT to present the UI (User Interface) shown in FIG. 6 and by the operation of the exhibitor UT.
FIG. 6 is a diagram showing an example of an image showing a screen for performing various settings regarding the booth including an avatar, among images displayed on the exhibitor terminal under the control of the server having the functional configuration of FIG. 5.
As shown in FIG. 6, the screen for making various settings related to the booth, including the avatar, includes "3D booth exterior,""3D booth interior,""2Dbooth," and "booth basic information" as setting menus for booth B. , "personnel management" is included. Further, as shown in FIG. 6, the screen for making various settings regarding the booth including avatars includes "visitor list" and "chat settings" as menus regarding visitors. As shown in FIG. 6, the screen for making various settings regarding the booth including the avatar includes a data "download" menu.

The image shown in FIG. 6 includes a plurality of live-action 2D avatars (two-dimensional photographic images) as "guide characters." The exhibitor UT can select any 2D avatar (two-dimensional photographic image) included in the "usher character" as the exhibitor avatar AS.
Further, although not shown, the exhibitor UT can upload any photographic image via the exhibitor terminal 3 to use it as a guide character. This allows the exhibitor UT to use any photographic image as the exhibitor avatar AS.
That is, for example, the exhibitor UT may use, as the exhibitor avatar AS, a photographic image of the exhibitor's representative who uses the chat function described later, a photographic image of a person wearing a uniform designated by the exhibitor, etc. You will be able to do this.
Note that the 2D avatar is not limited to a photographic image. That is, for example, the exhibitor UT can also use a 2D character image (2D or 3D character CG image) prepared in advance or uploaded by the exhibitor UT as the "guide character."
In this way, the function that allows the exhibitor UT to use an image (not limited to a photographic image) set by the exhibitor UT as the exhibitor avatar AS is hereinafter referred to as an "exhibitor avatar setting function."

The avatar moving unit 53 moves the avatar in the virtual space based on a movement instruction to move the own avatar A to the second coordinate in the exhibition hall TH, among instructions issued by the visitor UR's operation on the visitor terminal 4. Move the current position to the second coordinate.

Here, among the instructions given by the visitor UR's operation on the visitor terminal 4, the movement instruction to move the own avatar A to the second coordinate in the exhibition hall TH also includes an instruction to change the posture of the avatar A. It is.
Therefore, the avatar moving unit 53 changes the posture based on the change instruction and moves the avatar A to the above-mentioned second coordinates.

The virtual space placement unit 54 places the exhibition hall TH, in which the booth B is placed at the first coordinates, in the three-dimensional virtual space, and places the avatar A at the second coordinates.
Further, based on the photographic image of the real exhibitor or a predetermined model generated by the exhibitor avatar generating section 52, the virtual space arrangement section 54 sets the photographic image as an exhibitor avatar AS at second coordinates. can be placed in
Further, the virtual space arrangement unit 54 arranges the exhibitor avatar AS in an orientation corresponding to the posture of the visitor avatar AR. Specifically, for example, the exhibitor avatar is arranged so that the exhibitor avatar AS at the position where the exhibitor avatar AS is arranged is included in the avatar viewpoint image GA seen from the position and posture of the visitor avatar AR, facing directly. do.

The avatar viewpoint image generation unit 55 generates an image from a viewpoint set based on the second coordinates in the exhibition hall TH where the booth B is located at the first coordinates and in the virtual space where the avatar A is located at the second coordinates. The captured three-dimensional image is generated as an avatar viewpoint image GA.
As a result, the exhibitor avatar AS is included in the avatar viewpoint image GA, facing directly, regardless of the position and posture of the visitor avatar AR.

The display control unit 56 executes control to display the avatar viewpoint image GA on the visitor terminal 4, as shown in FIG.

In this way, by executing the series of processes described above by the exhibition hall installation section 51, exhibitor avatar generation section 52, avatar movement section 53, virtual space arrangement section 54, avatar viewpoint image generation section 55, and display control section 56, The above-mentioned "2D avatar automatic direction change function" is realized.
In other words, the automatic direction change function of the 2D avatar means that the live-action 2D avatar ( This is a function to place a two-dimensional photographic image) in a virtual space and generate an avatar viewpoint image GA.
Note that the avatar viewpoint image GA is provided so as to directly face each of the plurality of visitors in the exhibition hall TH. That is, it can be said that the virtual space for each of the plurality of visitors is a different virtual space that is different for at least the exhibitor avatar AS.

The line acquisition unit 57 acquires lines to be output from the exhibitor avatar AS.
Specifically, for example, the line acquisition unit 57 acquires, as a line, a character string input in the "guidance message for guide message" field of the guide character shown in FIG. 6 .
The dialogue output unit 58 outputs the dialogue acquired by the dialogue acquisition unit 57 as the dialogue uttered from the exhibitor avatar AS present in the booth B to the visitor terminal 4 of the visitor UR corresponding to the visitor avatar AR. Execute control to output from.
Specifically, for example, as shown in FIG. 1, the dialogue output unit 58 outputs the dialogue by displaying it as a speech bubble of the exhibitor avatar AS superimposed on the avatar viewpoint image GA.

For example, the dialogue output unit 58 can also perform control to output dialogue input as a character string from the visitor terminal 4 as a voice read aloud by a predetermined AI or the like.
Furthermore, for example, the line acquisition unit 57 may acquire the line as audio data, and the line output unit 58 may perform control to output the line as audio from the visitor terminal 4.

Further, for example, the line acquisition unit 57 can acquire lines from a chatbot engine or an AI chat engine (not shown). At this time, data such as the name and time of the visitor UR who came to booth B, lead information, action history, chat history, etc. are provided to the chatbot engine or the AI chat engine. The chatbot engine or AI chat engine then generates lines based on this data.
As a result, different lines are acquired by the line acquisition unit 57 for, for example, a visitor UR belonging to a listed company and a visitor UR belonging to a small to medium-sized company.
As a result, the exhibitor avatar AS will speak to the exhibitor avatar AS using appropriate lines suited to the visitor's situation, so that the response from the exhibitor avatar US at booth B will be more appropriate.

Although not shown, the exhibitor UT may record the audio output from the visitor terminal 4 in the form of audio and obtain it as a line. That is, in this case, the line acquisition unit 57 acquires the voice recorded via the exhibitor terminal 3 as the line. Then, the dialogue output unit 58 causes the visitor terminal 4 to output the acquired audio dialogue.
The function in which the exhibitor UT allows the exhibitor avatar AS to use the photo image set by the exhibitor UT is hereinafter referred to as the "exhibitor avatar line function."

Here, the visitor UR (its avatar A) can chat with the person in charge by going to the booth B where he/she is present.
Note that in order to realize such a chat conversation, a chat control section 59 shown in FIG. 5 is provided in the CPU 11 of the server 1.
That is, the chat control unit 59 controls the visitor UR operated by the visitor UR in order to chat between the visitor UR corresponding to the avatar A existing in the booth B and the person in charge present at the booth B. It controls communication between the exhibitor terminal 4 and the exhibitor terminal 3 or other terminal operated by the person in charge.
Note that, hereinafter, the function of chatting between the visitor UR corresponding to avatar A present in booth B and the person in charge present at booth B will be referred to as a "chat function".
Here, a plurality of exhibitor representatives can be assigned to the exhibitor avatar AS. When the visitor UR takes an action to talk to the exhibitor avatar AS, the person in charge of the assigned exhibitor UT can respond via text chat, voice chat, video chat, etc. on the management screen.
That is, the exhibitor avatar AS is associated with the exhibitor person on the management screen. The visitor UR can have a voice chat, text chat, video chat, etc. with the person (the person in charge of the exhibitor UT) associated with the exhibitor avatar AS he/she talked to. Note that only one person may be linked.

The trajectory collection unit 60 acquires trajectory data indicating the locus of movement within the exhibition hall TH of each avatar A operated by each of the visitors UR-1 to UR-m in FIG. The locus data of each of UR-m to UR-m is aggregated and a predetermined analysis is performed.
The exhibitor-side control unit 61 measures the stay time of the visitor avatar AR staying at the booth B based on the trajectory data, and when the stay time exceeds a predetermined value, sends a predetermined notification to the exhibitor terminal 3. At least one of the control and the control for causing the exhibitor avatar AS to output a predetermined output at the visitor terminal 4 is executed.

That is, the exhibitor avatar generation unit 52 can cause the exhibitor terminal 3 of the exhibitor UT to present the UI shown in FIG. 7, and can urge the exhibitor UT to take a response to the visitor UR who has stayed longer than a predetermined time.
FIG. 7 is a diagram showing an example of an image showing a screen for providing visitor information to exhibitors, among images displayed on an exhibitor terminal under the control of the server having the functional configuration of FIG. 5.

In FIG. 7, the "visitor list" menu of FIG. 6 is selected.
As shown in FIG. 7, in the visitor list, the name and time of the visitor UR who came to booth B, lead information, action history, chat history, etc. are displayed.
Although not shown, if a visitor UR stays at booth B for a predetermined time, it is considered that the visitor UR is interested in the contents of booth B. Therefore, in this service, when the visitor avatar AR stays at booth B for a predetermined time, the visitor UR is prompted to respond.
Hereinafter, the function of prompting (guiding) the exhibitor UT to respond to the visitor UR who has come to the booth B will be referred to as the "response guidance function by the exhibitor."

Also, for example, the exhibitor side control unit 61 may speak a predetermined message to the visitor UR who has stayed at the booth B for a predetermined time via the exhibitor avatar AS. That is, for example, a message such as "Is there anything you are concerned about?" is provided to the visitor UR. This starts a chat with the visitor UR, and the exhibitor UT is prompted to take action based on the response.

In addition, the virtual space arrangement unit 54, in response to a predetermined trigger for the purpose of attending, places the exhibitor avatar at a position different from the position in the booth B and where the exhibitor avatar AS is included as a subject in the avatar viewpoint image GA. can be placed.
Specifically, as shown in FIG. 8, when the visitor avatar AR is located at a position other than booth B, the virtual space placement unit 54 may place the exhibitor avatar AS in the avatar viewpoint image GA. can. At this time, a predetermined line is output from the arranged exhibitor avatar AS.

FIG. 8 is a diagram showing an example of an image showing a screen including an attendant for a visitor among images displayed on an exhibitor terminal under the control of the server having the functional configuration of FIG. 5.
That is, in FIG. 8, the visitor avatar AR is located in a passageway other than booth B. In the avatar viewpoint image GA, an exhibitor avatar AS1 other than the exhibitor avatar AS of the booth B is arranged. Then, exhibitor avatar AS1 utters the following line in the form of a speech bubble: ``Next time, please go to the XXX booth in the back right.There will be an interesting MA.''

In this way, the avatar viewpoint image GA is displayed including the exhibitor avatar AS1 who will attend the visitor at the timing when the visitor should be attended to.
Then, in the case of automatic attendance, the booth B introduced by the exhibitor avatar AS1 will introduce the booth B selected by AI or the like or attend the next booth that is considered to be of interest.
Note that the visitor UR can also hide the attending exhibitor avatar AS1 by performing a predetermined operation.
The function of attending to the visitor UR in this way is hereinafter referred to as the "attending function using a 2D avatar."

Although one embodiment of the present invention has been described above, the present invention is not limited to the above-described embodiment, and modifications, improvements, etc. within the range that can achieve the purpose of the present invention are included in the present invention. regarded as.

The system configuration shown in FIG. 3 and the hardware configuration of the server 1 shown in FIG. 4 are merely examples for achieving the object of the present invention, and are not particularly limited.

Furthermore, the functional block diagram shown in FIG. 5 is merely an example and is not particularly limited. In other words, it is sufficient that the information processing system shown in FIG. 3 is equipped with a function that can execute the above-mentioned processing as a whole, and what kind of functional blocks and databases are used to realize this function is determined in particular by the example shown in FIG. but not limited to.

Further, the locations of the functional blocks and the database are not limited to those shown in FIG. 5, and may be arbitrary.
In the example of FIG. 5, all processing is performed under the control of the CPU 11 of the server 1 of FIG. 5 that constitutes the information processing system of FIG. 5, but the configuration is not limited thereto. For example, at least part of the functional blocks and database located on the server 1 side may be provided on the organizer terminal 2 side, the exhibitor terminal 3 side, the visitor terminal 4 side, or another information processing device (not shown). good.

Furthermore, the series of processes described above can be executed by hardware or by software.
Further, one functional block may be configured by a single piece of hardware, a single piece of software, or a combination thereof.

When a series of processes is executed by software, a program constituting the software is installed on a computer or the like from a network or a recording medium.
The computer may be a computer built into dedicated hardware.
Further, the computer may be a computer that can execute various functions by installing various programs, such as a server, a general-purpose smartphone, or a personal computer.

Recording media containing such programs not only consist of removable media (not shown) that is distributed separately from the main body of the device in order to provide the program to the user, but also are provided to the user in a state that is pre-installed in the main body of the device. Consists of provided recording media, etc.

Note that in this specification, the step of writing a program to be recorded on a recording medium is not only a process that is performed chronologically in accordance with the order, but also a process that is not necessarily performed chronologically but in parallel or individually. It also includes the processing to be executed.

To summarize the above, an information processing device to which the present invention is applied only needs to have the following configuration, and can take various embodiments.

That is, the information processing device (for example, the server 1 in FIG. 3) to which the present invention is applied,
The exhibition hall (exhibition hall TH) where the booth (booth B in Figure 1) is located, the exhibitor avatar (exhibitor avatar AS in Figure 1) existing as an exhibitor in the booth, and the visitor inside the exhibition hall. arrangement means for respectively arranging visitor avatars (visitor avatar AR in FIG. 1) that are movable as participants in a three-dimensional virtual space;
Based on the first instruction to generate the exhibitor avatar among the instructions performed by the first user (exhibitor UT) on the first device (exhibitor terminal 3 in FIG. 2), the exhibitor avatar is created by: exhibitor avatar generation means for generating an avatar made up of two-dimensional information;
Based on the second instruction to move the avatar to a predetermined position in the exhibition hall, among the instructions performed by the second user (visitor UR) on the second device (visitor terminal 4 in FIG. 2), visitor avatar moving means for moving the avatar to the predetermined position in the virtual space;
In the exhibition hall where the booth is located where the exhibitor avatar composed of two-dimensional information is located at a fixed position, and in the virtual space where the visitor avatar at the predetermined position is located, the coordinates are image generation means for generating a three-dimensional image captured from a viewpoint set based on the visitor viewpoint image (for example, the avatar viewpoint image GA in FIG. 1);
a display control unit that executes control to display the visitor viewpoint image on the second device;
Equipped with.
As a result, the above-mentioned "exhibitor avatar display function using 2D avatars" is realized.
As a result, it is possible to improve the usability of a system that uses avatar viewpoint images in a three-dimensional virtual space.

In an information processing device to which the present invention is applied,
a line acquisition means for acquiring lines to be output from the exhibitor avatar;
a line output unit that executes control to output the acquired line from the first device of the first user corresponding to the visitor avatar present in the booth;
It is also possible to further include the following.
As a result, the above-mentioned "exhibitor avatar's dialogue output function" is realized.

In an information processing device to which the present invention is applied,
The second instruction includes an instruction to change the posture of the avatar,
The avatar moving means changes the posture based on the change instruction and moves the avatar to the second coordinates,
The arrangement means may arrange the exhibitor avatar at the predetermined position in an orientation corresponding to the posture of the visitor avatar present in the booth.
As a result, the above-mentioned "2D avatar automatic direction change function" is realized.

In an information processing device to which the present invention is applied,
The first instruction includes a prepared image prepared in advance by the first user,
The exhibitor avatar generation means may also generate the exhibitor avatar based on the prepared image.
As a result, the above-mentioned "exhibitor avatar setting function" is realized.

In an information processing device to which the present invention is applied,
The second user operates the second user to chat between the second user corresponding to the visitor avatar present at the booth and the person in charge associated with the exhibitor avatar. It is possible to further include chat control means for controlling communication between the device and the first device or another device operated by the person in charge.
As a result, the above-mentioned "exhibitor-side person-in-charge assignment chat function" is realized.

In an information processing device to which the present invention is applied,
trajectory collection means for collecting trajectory data indicating a movement trajectory of the visitor avatar corresponding to the second user in the exhibition hall;
control for measuring the stay time of the visitor avatar staying at the booth based on the trajectory data, and when the stay time exceeds a predetermined value, notifying the first device of a predetermined value; exhibitor-side control means for executing at least one of the following: controlling the device to cause the exhibitor avatar to output a predetermined output;
It is possible to further include the following.
As a result, the above-mentioned "function for guiding exhibitors to respond" is realized.

In an information processing device to which the present invention is applied,
The arrangement means, in response to a predetermined trigger for the purpose of attending, places the exhibitor avatar at a position in the booth different from the fixed position and where the exhibitor avatar is included as a subject in the visitor viewpoint image. It is also possible to have it placed.
Thereby, the above-mentioned "attend function using 2D avatar" is realized.

DESCRIPTION OF SYMBOLS 1... Server, 2... Organizer terminal, 3... Exhibitor terminal, 4... Visitor terminal, 11... CPU, 20... Drive, 31... Removable media, 51 . . . Exhibition hall installation unit, 52 . Control unit, 57... Line acquisition unit, 58... Line output unit, 59... Chat control unit, 60... Trajectory collection unit, 61... Exhibitor side compatible control unit

Claims

Arrangement means for arranging, in a three-dimensional virtual space, an exhibition hall in which a booth is arranged, an exhibitor avatar existing as an exhibitor in the booth, and a visitor avatar movable as a visitor within the exhibition hall. and,
An exhibitor avatar that generates the exhibitor avatar as an avatar composed of two-dimensional information based on a first instruction to generate the exhibitor avatar among instructions performed by a first user's operation on a first device. A generating means,
A visitor who moves the avatar to a predetermined position in the virtual space based on a second instruction to move the avatar to a predetermined position in the exhibition hall among instructions performed by a second user's operation on a second device. person avatar transportation means,
In the exhibition hall where the booth is located where the exhibitor avatar composed of two-dimensional information is located at a fixed position, and in the virtual space where the visitor avatar at the predetermined position is located, the coordinates are image generation means for generating a three-dimensional image captured from a viewpoint set based on the image as a visitor viewpoint image;
a display control unit that executes control to display the visitor viewpoint image on the second device;
An information processing device comprising:
a line acquisition means for acquiring lines to be output from the exhibitor avatar;
a line output unit that executes control to output the acquired line from the first device of the first user corresponding to the visitor avatar present in the booth;
The information processing device according to claim 1, further comprising:
The second instruction includes an instruction to change the posture of the avatar,
The avatar moving means changes the posture based on the change instruction and moves the avatar to the second coordinates,
The placement means places the exhibitor avatar at the predetermined position in an orientation corresponding to the posture of the visitor avatar present in the booth.
The information processing device according to claim 1 or 2.
The first instruction includes a prepared image prepared in advance by the first user,
The exhibitor avatar generation means generates the exhibitor avatar based on the prepared image.
An information processing device according to any one of claims 1 to 3.
One or more of the K people (N is an integer value of 1 or more) belonging to the first user is associated with the exhibitor avatar,
The second user operates the second user to chat between the second user corresponding to the visitor avatar present at the booth and the person in charge associated with the exhibitor avatar. further comprising chat control means for controlling communication between the device and the first device or another device operated by the person in charge;
An information processing device according to any one of claims 1 to 4.
trajectory collection means for collecting trajectory data indicating a movement trajectory of the visitor avatar corresponding to the second user in the exhibition hall;
control for measuring the stay time of the visitor avatar staying at the booth based on the trajectory data, and when the stay time exceeds a predetermined value, notifying the first device of a predetermined value; exhibitor-side control means for executing at least one of the following: controlling the device to cause the exhibitor avatar to output a predetermined output;
The information processing device according to any one of claims 1 to 5, further comprising:
The arrangement means, in response to a predetermined trigger for the purpose of attending, places the exhibitor avatar at a position in the booth different from the fixed position and where the exhibitor avatar is included as a subject in the visitor viewpoint image. to place,
An information processing device according to any one of claims 1 to 6.
In an information processing method executed by an information processing device,
A placement step of placing an exhibition hall in which a booth is arranged, an exhibitor avatar existing as an exhibitor in the booth, and a visitor avatar that is movable as a visitor within the exhibition hall in a three-dimensional virtual space. and,
An exhibitor avatar that generates the exhibitor avatar as an avatar composed of two-dimensional information based on a first instruction to generate the exhibitor avatar among instructions performed by a first user's operation on a first device. a generation step;
A visitor who moves the avatar to a predetermined position in the virtual space based on a second instruction to move the avatar to a predetermined position in the exhibition hall among instructions performed by a second user's operation on a second device. user avatar movement step,
In the exhibition hall where the booth is located where the exhibitor avatar composed of two-dimensional information is located at a fixed position, and in the virtual space where the visitor avatar at the predetermined position is located, the coordinates are an image generation step of generating a three-dimensional image captured from a viewpoint set based on the image as a visitor viewpoint image;
a display control step of performing control to display the visitor viewpoint image on the second device;
Information processing methods including.
to the computer,
A placement step of placing an exhibition hall in which a booth is arranged, an exhibitor avatar existing as an exhibitor in the booth, and a visitor avatar that is movable as a visitor within the exhibition hall in a three-dimensional virtual space. and,
An exhibitor avatar that generates the exhibitor avatar as an avatar composed of two-dimensional information based on a first instruction to generate the exhibitor avatar among instructions performed by a first user's operation on a first device. a generation step;
A visitor who moves the avatar to a predetermined position in the virtual space based on a second instruction to move the avatar to a predetermined position in the exhibition hall among instructions performed by a second user's operation on a second device. user avatar movement step,
In the exhibition hall where the booth is located where the exhibitor avatar composed of two-dimensional information is located at a fixed position, and in the virtual space where the visitor avatar at the predetermined position is located, the coordinates are an image generation step of generating a three-dimensional image captured from a viewpoint set based on the image as a visitor viewpoint image;
a display control step of performing control to display the visitor viewpoint image on the second device;
A program that executes control processing including.