JP7113065B2 - Computer program, method and server - Google Patents

Description

The present disclosure relates to computer programs, methods, and servers.

Conventionally, when a user uses a terminal to view content executed in a virtual space displayed on the terminal, icons corresponding to other users viewing the content are often displayed in the virtual space. known (see Patent Document 1).

JP 2016-34087 A

However, in the technology described in Patent Literature 1, as the number of users viewing content increases, the number of icons displayed on the terminal also increases. Therefore, there is a problem that the load of display control on the terminal increases as the number of users viewing the content increases. It should be noted that the aforementioned Patent Literature 1 is incorporated herein by reference in its entirety.

The present disclosure provides a computer program, method, and server that reduce the possibility that the load of display control will become larger than before.

A computer program according to one aspect is a computer program that is executed by at least one processor, and which is operated by a first terminal of a first user and is operated using a first terminal. 1 data is acquired, it is determined whether or not the first condition that the first position is within the first region is satisfied, and if it is determined that the first condition is satisfied, the first second data transmitted from a terminal of a user operating at least one second avatar among at least one avatar existing in the first region other than the avatar, wherein the second data is the at least one Position data of a second avatar within the first area and operation data input to the terminal, wherein the position data is within the first area displaying a virtual object corresponding to the at least one second avatar. and determining control data for controlling the display unit of the first terminal so as to display at least the virtual object on the display unit of the first terminal based on the second data, and the control data the at least one processor to control the display based on

A computer program according to one aspect is a computer program executed by at least one processor, wherein there is a first avatar in a virtual space operated using a first terminal of a first user via a communication line. receive first data about a first position, determine whether the first position is within a first region, and determine whether the first condition is satisfied; and if the first condition is satisfied, the communication line receives second data transmitted from a terminal of a user who operates at least one second avatar among at least one avatar existing in the first region other than the first avatar, and receives the second data via The data includes position data of the at least one second avatar within the first region and operation data input to the terminal, and the position data is a virtual object corresponding to the at least one second avatar. Control data used for determining a position within the first area to be displayed, and for controlling the display unit to display at least the virtual object on the display unit of the first terminal based on the second data. and transmit the control data to the first terminal.

A method according to one aspect is a method executed by at least one processor, comprising first data relating to a first location of a first avatar in a virtual space operated using a first terminal of a first user; a step of determining whether or not the first condition satisfies the first condition that the first position is within the first region; and if it is determined that the first condition is satisfied, the receiving second data transmitted from a terminal of a user operating at least one second avatar among at least one avatar existing in the first area other than the first avatar; The data includes position data of the at least one second avatar within the first region and operation data input to the terminal, and the position data is a virtual object corresponding to the at least one second avatar. Control data used for determining a position within the first area to be displayed, and for controlling the display unit to display at least the virtual object on the display unit of the first terminal based on the second data. and controlling the display based on the control data.

A method according to one aspect is a method executed by at least one processor, wherein a first avatar in a virtual space operated using a first terminal of a first user exists via a communication line. receiving first data about a position; determining whether the first position satisfies a first condition that the first position is within a first region; a step of receiving, via a communication line, second data transmitted from a terminal of a user who operates at least one second avatar among at least one avatar existing in the first area other than the first avatar; , wherein the second data includes position data of the at least one second avatar within the first region and operation data input to the terminal, and the position data includes the at least one second avatar used to determine a position within the first region where a virtual object corresponding to the avatar is displayed, and based on the second data, at least the virtual object is displayed on the display unit of the first terminal; determining control data for controlling a display; and transmitting the control data to the first terminal.

A server according to one aspect includes at least one processor, and via a communication line, uses a first terminal of a first user to operate a first avatar in a virtual space. Data is received, it is determined whether or not the first condition that the first position is within the first region is satisfied, and if it is determined that the first condition is satisfied, the first condition is transmitted via the communication line. second data transmitted from a terminal of a user operating at least one second avatar among at least one avatar existing in the first region other than the avatar, wherein the second data is the at least one Position data of a second avatar within the first area and operation data input to the terminal, wherein the position data is within the first area displaying a virtual object corresponding to the at least one second avatar. and determining control data for controlling the display unit of the first terminal so as to display at least the virtual object on the display unit of the first terminal based on the second data, and the control data to the first terminal.

This Summary of the Invention column is included to introduce various selected concepts in a simplified form, which are described in the Detailed Description column. will be described later. All trademarks used herein are the property of their respective owners. The statements in this [Summary of the Invention] column are not intended to identify key features or essential features of the claimed invention, nor are they intended to identify the features of the claimed invention. Nor is it intended to limit the technical scope. The above and other objects, features and effects of the claimed invention will become more apparent from the description in the Detailed Description section below with reference to the accompanying drawings. Become.

FIG. 1 is a block diagram showing an example configuration of a system 1000 according to one embodiment. FIG. 2 is a block diagram showing an example of configurations of the terminal 10 and the server 20 shown in FIG. FIG. 3 is a block diagram showing an example of functions of terminal 10 shown in FIG. FIG. 4 is a block diagram showing an example of functions of the server 20 shown in FIG. FIG. 5 is a diagram showing an example of a display screen displayed by the display unit 140 of the terminal 10. As shown in FIG. FIG. 6 is a diagram showing an example of a display screen displayed by the display unit 140 of the first terminal 11. As shown in FIG. FIG. 7 is a diagram showing an example of a display screen displayed by the display unit 140 of the first terminal 11. As shown in FIG. FIG. 8 is a diagram showing an example of a display screen displayed by the display unit 140 of the first terminal 11. As shown in FIG. FIG. 9 is an example of a flowchart showing processing performed in this embodiment. FIG. 10 is an example of a flowchart showing processing performed in this embodiment. FIG. 11 is a block diagram showing an example of the functions of the terminal 10 and the configuration connected to the terminal 10 shown in FIG. FIG. 12 is a block diagram illustrating computing environment 1400 .

This specification is described in the sense of various representative embodiments, which are not intended to be limiting in any way. As used in this application, singular forms such as "a", "said", "above", "that", "the", "this", "that" do not explicitly indicate that they are not in the plural. may include plural forms as long as Also, the term "comprising" can mean "having" or "comprising." Further, the terms "coupled," "coupled," "tethered," "coupled," "connected," or "connected" refer to objects that bind, connect, or connect objects to each other; encompassing mechanical, electrical, magnetic and optical methods, as well as other methods, thus coupled, coupled, bound, connected, connected or between connected objects It does not exclude the presence of intermediate elements.

The various systems, methods and devices described herein should not be construed as limiting in any way. In practice, the present disclosure is directed to each of the various disclosed embodiments, combinations of these various embodiments with each other, and combinations of portions of these various embodiments with each other. All novel features and aspects are directed. The various systems, methods, and apparatus described herein are not limited to any particular aspect, particular feature, or combination of such particular aspects and particular features, The articles and methods described herein do not claim that one or more particular advantages exist or that any problem is solved. Moreover, various features or aspects of the various embodiments described herein, or portions of such features or aspects, may be used in combination with each other.

Although the operations of some of the various methods disclosed herein have been described in a particular order for convenience, the description in such a manner is such that the particular order follows a particular order. It should be understood to include rearranging the order of the above operations unless otherwise required by the text. For example, operations described sequentially are in some cases permuted or performed concurrently. Furthermore, for the sake of simplicity, the attached drawings do not illustrate the various ways in which the various features and methods described herein can be used with other features and methods. Additionally, this specification may use terms such as "generate," "generate," "display," "receive," "evaluate," and "distribute." These terms are high-level descriptions of the actual various operations performed. The actual various operations corresponding to these terms may vary depending on the particular implementation, and may be readily appreciated by those of ordinary skill in the art having the benefit of this disclosure.

Any theories of operation, scientific principles or other theoretical statements presented herein in connection with the disclosed apparatus or methods are provided for better understanding and to limit the technical scope. not intended to be. The devices and methods in the appended claims are not limited to devices and methods that operate according to methods described by such theory of operation.

Any of the various methods disclosed herein can be applied to one or more computer-readable media (e.g., one or more optical media discs, volatile memory components, or non-volatile memory components). It can be implemented using a plurality of computer-executable instructions stored in a non-transitory computer-readable storage medium, such as a physical memory component, and executed on a computer. Here, the plurality of volatile memory components includes, for example, DRAM or SRAM. The plurality of non-volatile memory components also includes, for example, hard drives and solid state drives (SSDs). Further, the computer includes any computer available on the market, including, for example, smartphones and other mobile devices that have computing hardware.
Any of such computer-executable instructions for implementing the techniques disclosed herein may be generated and used during implementation of the various embodiments disclosed herein. Any data may be stored on one or more computer-readable media (eg, non-transitory computer-readable storage media). Such computer-executable instructions may, for example, be part of a separate software application, or may be accessed or downloaded via a web browser or other software application (such as a remote computing application). can be part of a software application that is Such software may be implemented, for example, in a network environment, either on a single local computer (eg, as an agent running on any suitable computer available on the market) or using one or more network computers. (eg, the Internet, a wide area network, a local area network, a client-server network (such as a cloud computing network), or other such network).

For clarity, only certain selected aspects of various software-based implementations are described. Other details that are well known in the art are omitted. For example, the technology disclosed herein is not limited to any particular computer language or program. For example, the techniques disclosed herein may be implemented by software written in C, C++, Java, or any other suitable programming language. Similarly, the techniques disclosed herein are not limited to any particular computer or type of hardware. Certain details of suitable computers and hardware are well known and need not be described at length here.

Further, various such software-based embodiments (e.g., including computer-executable instructions for causing a computer to perform any of the various methods disclosed herein) can be uploaded, downloaded, or accessed remotely by any suitable communication means. Such suitable means of communication include, for example, the Internet, World Wide Web, intranets, software applications, cables (including fiber optic cables), magnetic communications, electromagnetic communications (including RF communications, microwave communications, infrared communications), Including electronic communication or other such means of communication.

Various embodiments of the present invention will now be described with reference to the accompanying drawings. In addition, the same reference numerals are attached to common components in the drawings. Also, it should be noted that components depicted in one drawing may be omitted in another drawing for convenience of explanation. Furthermore, it should be noted that the attached drawings are not necessarily drawn to scale.

1. Configuration of System 1000 FIG. 1 is a block diagram showing an example of configuration of a system 1000 according to one embodiment. As shown in FIG. 1, a system 1000 includes, for example, multiple terminals 10 connected to a communication line (communication network) not shown, and one or more servers 20 connected to the communication line. Terminal 10 includes a first terminal 11 and a second terminal 12 . The server 20 also includes, for example, a first server system 21 and a second server system 22 .

Communication lines can be cellular networks, wireless networks (e.g. RF connections via Bluetooth, WiFi (such as IEEE 802.11a/b/n), WiMax, cellular, satellite, laser, infrared), fixed telephone networks. , the Internet, an intranet, a local area network (LAN), a wide area network (WAN), and/or an Ethernet network.

1-1. terminal 10
The terminal 10 is connected to one or more servers 20 via, for example, a communication line. Terminal 10 is, for example, a smart phone, a tablet device, and/or a personal computer. The terminal 10 is, for example, configured to be able to install a predetermined application and execute the predetermined application. Terminal 10 also receives web pages (eg, HTML documents, in some examples HTML documents that encode executable code such as JavaScript or PHP code) from server 20 (second server system 22). can do.

Hereinafter, the user who operates the terminal 10 may be simply referred to as the user, the user who operates the first terminal 11 may be referred to as the first user, and the user who operates the second terminal 12 may be referred to as the second user. Also, FIG. 1 shows an example in which, for example, a first terminal 11 and a second terminal 12 are provided as the plurality of terminals 10, but the present invention is not limited to this. The multiple terminals 10 may include, for example, three or more terminals. Also, in the following description, the first terminal 11 and the second terminal 12 may be collectively referred to as the terminal 10. FIG.

1-2. server 20
The first server system 21 includes a distribution server 21A1 and a server storage device 21A2. The distribution server 21A1 receives from the terminal 10, for example, data requested for an application executed on the terminal 10. FIG. Also, the distribution server 21A1, for example, transmits data used for an application executed on the terminal 10 to the terminal 10 in response to the request. The server storage device 21A2 stores data to be transmitted from the distribution server 21A1 to the terminal 10, for example. The server storage device 21A2 also stores data received from the terminal 10 by the distribution server 21A1, for example. The first server system 21 also transmits data used in applications executed by the terminal 10 to the terminal 10, for example.

Although an example in which the terminal 10 executes an application has been described, the present invention is not limited to this. For example, a web browser installed on the terminal 10 may be used to execute processing equivalent to executing the application. Thus, when using a web browser installed in the terminal 10, the server 20 may include a web server (not shown), for example. When the server 20 includes a web server (not shown), the web server transmits data related to HTML documents such as HTML5, and the terminal 10 displays data related to the HTML documents using the web browser, User instruction data is transmitted to the terminal 10 (the web browser), and the server 20 performs display control. By performing the display control, the server 20 generates display data and transmits the display data to the terminal 10 (the web browser). Note that display control may be performed using a script such as JavaScript (registered trademark) in the web browser.

Also, in FIG. 1, an example in which the first server system 21 includes the distribution server 21A1 and the server storage device 21A2 has been described, but the present invention is not limited to this. For example, the first server system 21 may include other components in addition to the distribution server 21A1 and server storage device 21A2. In this case, the other configuration may have the function of at least one of the distribution server 21A1 and the server storage device 21A2. Further, for example, the first server system 21 may be configured with a single configuration having the functions of the distribution server 21A1 and the server storage device 21A2.

The second server system 22 is a server that transmits data regarding content to the terminal 10 . Here, for example, it is assumed that the user operates the terminal 10 to execute an application. In this case, when the second server system 22 receives a request for content-related data from the terminal 10 while the application is running, the second server system 22 transmits the content-related data to the terminal 10 . The data about the content transmitted from the second server system 22 to the terminal 10 is, for example, data about moving images.

2. Hardware Configuration of Each Apparatus Next, an example of the hardware configuration of each of the terminal 10 and the server 20 will be described.

2-1. Hardware Configuration of Terminal 10 An example of hardware configuration of each terminal 10 will be described with reference to FIG. FIG. 2 is a block diagram showing an example of the hardware configuration of the terminal 10 (server 20) shown in FIG. In FIG. 2, reference numerals in parentheses are described in relation to the server 20 as will be described later.

As shown in FIG. 2, each terminal 10 includes, for example, a central processing unit 14, a main storage device 15, an input/output interface device 16, an input device 17, an auxiliary storage device 18, and an output device 19. include. The configurations shown in FIG. 2 are connected by data buses and/or control buses.

The central processing unit 14, also called a "CPU", performs operations on the instructions and data stored in the main memory 15, and stores the results of the operations in the main memory 15. be. Furthermore, the central processing unit 14 can control an input device 17, an auxiliary storage device 18, an output device 19, and the like via an input/output interface device 16. FIG. Terminal 10 may include one or more such central processing units 14 .

The main storage device 15 is referred to as "memory", and commands and data received from the input device 17, the auxiliary storage device 18 and the communication line 30 (server 20 etc.) via the input/output interface device 16, It also stores the calculation results of the central processing unit 14 . The main storage device 15 includes volatile memory (eg, registers, cache, random access memory (RAM)), non-volatile memory (eg, read-only memory (ROM), EEPROM, flash memory), and storage (eg, hard disk computer readable media such as drives (HDD), solid state drives (SSD), magnetic tapes, optical media), etc., without limitation. As will be readily understood, the term "computer-readable recording medium" refers to data storage media such as memory and storage, rather than transmission media such as modulated data signals or transient signals. It can contain media.

The input device 17 is a device that takes in data from the outside, and includes, but is not limited to, a touch panel, buttons, keyboard, mouse and/or sensor. Sensors may include, but are not limited to, sensors including one or more cameras, etc. and/or one or more microphones, etc., as described below.

Auxiliary storage device 18 is a storage device having a larger capacity than main storage device 15 . It is possible to store instructions and data (computer programs) that constitute the above-described specific applications (video distribution application, video viewing application, etc.), web browser applications, and the like. Furthermore, the auxiliary storage device 18 can be controlled by the central processing unit 14 to transmit these instructions and data (computer programs) to the main storage device 15 via the input/output interface device 16 . Auxiliary storage device 18 may include, but is not limited to, a magnetic disk device and/or an optical disk device.

The output device 19 can include, but is not limited to, a display device, a touch panel, and/or a printer device.

In such a hardware configuration, the central processing unit 14 sequentially loads instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 18 into the main storage device 15, and loads them into the main storage device 15. By operating instructions and data, it controls the output device 19 via the input/output interface device 16, or also via the input/output interface device 16 and the communication line 2, to other devices (e.g., the server 20, other Various data can be transmitted/received to/from the terminal 10).

2-2. Hardware Configuration of Server 20 An example of hardware configuration of each server 20 will be described with reference to FIG. As the hardware configuration of each server 20 (each of the distribution server 21A1 and the server storage device 21A2), for example, the same hardware configuration as that of each terminal 10 described above can be used. Therefore, the reference numerals for the components that each server 20 has are shown in parentheses in FIG.

As shown in FIG. 2, each server 20 mainly includes a central processing unit 24, a main storage device 25, an input/output interface device 26, an input device 27, an auxiliary storage device 28, an output device 29, can include These devices are connected to each other by a data bus and/or a control bus.

The central processing unit 24, the main storage device 25, the input/output interface device 26, the input device 27, the auxiliary storage device 28, and the output device 29 are included in each terminal 10 described above, respectively. The device 15, the input/output interface device 16, the input device 17, the auxiliary storage device 18 and the output device 19 can be substantially the same.

In such a hardware configuration, the central processing unit 24 sequentially loads instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 28 into the main storage device 25, and loads them. By computing commands and data, it controls the output device 29 via the input/output interface device 26, or communicates with other devices (for example, each terminal 10) via the input/output interface device 26 and the communication line 2. Various data can be sent and received between

It should be noted that server 20 may include one or more microprocessors and/or graphics processing units (GPUs) in place of or in conjunction with central processing unit 24 .

3. Functions of Each Apparatus Next, examples of functions of the terminal 10 and the server 20 will be described with reference to FIGS. 3 and 4, respectively.

3-1. Functions of Terminal 10 FIG. 3 is a block diagram showing an example of functions of the terminal 10 shown in FIG. As shown in FIG. 3, the terminal 10 includes, for example, a communication unit 110, an acquisition unit 120, a control unit 130, a display unit 140, a user interface unit 150, and a storage unit 160.

(1) Communication unit 110
The communication unit 110 is used, for example, to transmit various data to the server 20 . Also, the communication unit 110 is used, for example, to receive various data from the server 20 . Data received by the communication unit 110 is sent to the control unit 130, for example.

(2) Acquisition unit 120
The acquisition unit 120 acquires, for example, operation data related to operations from the user. The acquisition unit 120 also acquires data detected by various sensors, for example. The data acquired by the acquisition unit 120 is sent to the control unit 130, for example. The acquisition unit 120 performs, for example, the processes of S121 of FIG. 9, S122 of FIG. 9, S121 of FIG. 10, and S122 of FIG. 10, which will be described later. For example, operational data may include one or more of the following data.
・Data indicating how the broadcaster swiped on the touchpad display ・Data indicating which part of the touchpad display the broadcaster touched ・Data indicating which object the broadcaster tapped or clicked・Data indicating how the broadcaster dragged the touchpad display ・Other such manipulation data

The data acquired by the acquiring unit 120 may be data related to non-operation (data indicating that no operation has been performed), for example, indicating that the terminal 10 has not been operated for a specific time (specific period) data and/or data indicating that a specific location in the virtual space 300 was not entered.

Further, in the present disclosure, in addition to using the terminal 10 or instead of using the terminal 10, a wearable device may be used to perform display as shown in FIGS. 6 to 8 described later. Here, the wearable device includes, for example, AR (Augmented Reality) glasses, smart glasses, HMD (Head Mounted Display), and the like. If the wearable device described above is AR glasses, for example, the AR glasses can detect data related to positional information, data obtained by reading a predetermined marker, and/or a predetermined object existing in space. Based on the identification data, a virtual display screen is displayed so as to overlap the real area.

When using such a wearable device, the user wearing the wearable device can move and/or select an object on the display screen displayed by the wearable device by performing gestures and/or actions related to line of sight. can be done. Here, the gesture is, for example, an action of moving the user's head forward, backward, left, or right. Also, the action related to the line of sight is, for example, the action of the user blinking or the action of moving the user's eyes upward, downward, left, or right. The target object is, for example, an avatar corresponding to the user. For example, in the case where the object is an avatar corresponding to the user, when the user performs an action of moving the head forward, backward, left, or right, the avatar moves forward, backward, or backward according to the action. , move left or right.

When moving and/or selecting an object on the display screen displayed by the wearable device, for example, a separate controller (not shown) may be provided. Here, the controller includes, for example, a touch pad (not shown). Accordingly, for example, the user can perform a touch operation on the touch pad to move and/or select an object on the display screen displayed by the wearable device. Here, the “touch operation” refers to at least one of tapping, double tapping, swiping, flicking, pinching in, and pinching out, for example. The controller may also include, for example, an acceleration sensor and/or a gyro sensor. Accordingly, it is possible to move and/or select an object on the display screen displayed by the wearable device based on the tilt and/or movement of the controller. The controller may be held and used by the user, or may be worn on the finger of the user, for example.

(3) Control unit 130
The control unit 130 performs various controls based on data received by the communication unit 110, for example. Also, the control unit 130 performs various controls based on the data acquired by the acquisition unit 120 . The control unit 130 performs, for example, some or all of the processes from S131 to S151 in FIG. 9, which will be described later. Also, the control unit 130 performs, for example, some or all of S131 and S151 in FIG. 10 described later.

(4) Display unit 140
The display unit 140 displays display content based on control data output from the control unit 130, for example. The display unit 140 displays, for example, a screen for selecting a predetermined application. Further, the display unit 140 displays a screen related to the virtual space, for example, when a predetermined application is selected and executed.

(5) User interface unit 150
The user interface unit 150 is for inputting various data used for executing an application through a user's operation.

(6) Storage unit 160
The storage unit 160 can store various data used for executing applications. The storage unit 160 stores data used to control the display unit 140, for example. The storage unit 160 stores, for example, module data used for generating a user's avatar.

Note that the module data is, for example, data related to parts for generating an avatar. Here, the parts for generating the avatar include, for example, data on each part of the avatar (eyes, nose, mouth, eyebrows, skin color, hairstyle, hair color, clothes, body, etc.). The module data also includes data on IDs assigned to each part for generating an avatar. If the parts of the avatar are the body, the data related to the parts used to generate the avatar include data subdivided into body types such as skinny, slightly skinny, normal, slightly obese, and obese. You can

Further, when display unit 140 displays avatar 80 (other person's avatar) other than first avatar 80A, server 20 sends ID data used for generating avatar 80 other than first avatar 80A to first terminal 11 . and the first terminal 11 constructs an avatar 80 other than the first avatar 80A based on the ID data.

When display unit 140 displays avatars 80 other than first avatar 80A (another avatar), display unit 140 may display avatars 80 other than first avatar 80A in black. However, even if the avatars 80 other than the first avatar 80A are displayed using parts and/or colors determined based on the sex (for example, male or female) of the user corresponding to the avatars 80 other than the first avatar 80A good.

3-2. Functions of Server 20 FIG. 4 is a block diagram showing an example of functions of the server 20 shown in FIG. As shown in FIG. 4, the server 20 includes, for example, a communication unit 210, a storage unit 220, and a control unit 230.

(1) Communication unit 210
The communication unit 210 is used, for example, to transmit various data to the terminal 10 . Also, the communication unit 210 is used, for example, to receive various data from the terminal 10 . Data received by communication unit 210 is sent to control unit 230 . For example, the communication unit 210
The second data is received from the second terminal 12 in FIG. 9 to be described later, and the second data is transmitted to the first terminal 11 in FIG. 9 to be described later. For example, the communication unit 210 receives second data from the second terminal 12 in FIG. 10 described later, and transmits control data to the first terminal 11 in FIG. 10 described later.

(2) Storage unit 220
The storage unit 220 stores various data used for executing applications. The storage unit 220 stores data transmitted from the second terminal 12, for example.

(3) Control unit 230
The control unit 230 performs various controls based on data received by the communication unit 210, for example. The control unit 230 performs, for example, the process of S141 in FIG. 10, which will be described later.

FIG. 5 is a diagram showing an example of a display screen displayed by the display unit 140 of the terminal 10. As shown in FIG. FIG. 5 is a diagram showing a display example displayed on the display unit 140 of the terminal 10 by operating the terminal 10 to activate an application. As shown in FIG. 5, display unit 140 displays virtual space 300 . Virtual space 300 is, for example, a three-dimensional space. An avatar 80 and a virtual venue 310 are shown in the virtual space 300 .

The avatar 80 is configured to be able to perform, for example, at least one of walking, running, and jumping (jumping) within the virtual space 300 by user's operation. Also, the avatar 80 is configured to be able to perform, for example, either examining the virtual object or sitting on the virtual object by the user's operation. Here, the virtual object is, for example, an object corresponding to the avatar 80, a door, a chair, and the like. Note that when the user operates the avatar 80 using the terminal 10 , data regarding the operation is transmitted to the server 20 .

At least one of the plurality of avatars 80 displayed on the display unit 140 may act based on a user's operation, or may act based on a predetermined action. may be Here, when the avatar 80 acts based on a predetermined motion, it means that the avatar 80 acts as an NPC (Non Player Character).

Moreover, although the display modes of the avatars 80 shown in FIG. 5 are all the same, the present invention is not limited to this. The display mode of the avatar 80 may be determined based on data relating to the user operating the avatar 80 or data relating to the ID associated with the part of the avatar 80 selected by the user. Here, the “display mode of the avatar 80 ” is the shape and/or color of the avatar 80 .

Also, the action of the avatar in the virtual space may change in conjunction with the action of the user. For example, when the user nods, the avatar in the virtual space may similarly nod. Here, motion data may be acquired using, for example, a motion capture system. As will be readily appreciated by a person of ordinary skill in the art having the benefit of this disclosure, some examples of suitable motion capture systems that may be used with the apparatus and methods disclosed in this application include: or optical motion capture systems without markers, and inertial and magnetic non-optical systems. Motion data is captured using an image capture device (such as a CCD (charge-coupled device) or CMOS (complementary metal-oxide-semiconductor) image sensor) coupled to a computer that converts the motion data into video or other image data. can be obtained by

When operating the first avatar 80A shown in FIG. 5, for example, the display unit 140 of the first terminal 11 displays a screen as shown in FIG.

FIG. 6 is a diagram showing an example of a display screen displayed by the display unit 140 of the first terminal 11. As shown in FIG. As shown in FIG. 6, display unit 140 displays virtual space 300 . Specifically, for example, the display unit 140 displays the avatar 80 and the virtual venue 310 that exist within the virtual space 300 . Hereinafter, when simply described as "control unit 130", it refers to "control unit 130 of first terminal 11", and when simply described as "display unit 140", "first terminal 11 's display unit 140".

Avatars 80 include, for example, a first avatar 80A and a second avatar 80B. The first avatar 80A is, for example, an avatar operated by the first user having the first terminal 11 displaying the virtual space 300 shown in FIG. The second avatar 80B is, for example, an avatar operated by a user other than the first user. The display unit 140 displays the back of the first avatar 80A, and the line of sight of the first user operating the first terminal 11 and the line of sight of the first avatar 80A corresponding to the first user are in the same direction.

The display unit 140 displays, for example, a region in the virtual space including the first avatar 80A with reference to a virtual viewpoint positioned closer to the viewer in FIG. 6 than the first avatar 80A. The display unit 140 displays, for example, a region of the virtual space 300 that includes the traveling direction of the first avatar 80A. That is, an area corresponding to the line-of-sight direction (field of view) of first avatar 80A is displayed on display unit 140 . The traveling direction (line-of-sight direction) of the first avatar 80A will be described later. Display unit 140 displays a predetermined area in virtual space 300 based on the action of first avatar 80A. For example, when the traveling direction of first avatar 80A is changed by 180 degrees, display unit 140 may display a virtual object or the like existing behind first avatar 80A in FIG. 6 instead of the display in FIG. good. In this manner, display unit 140 may display an area other than the area shown in FIG. 6 based on the action of first avatar 80A.

When the user operating the first terminal 11 operates the first avatar 80A and the first avatar 80A shown in FIG. 6 is positioned inside the virtual venue 310, the display unit 140 displays the display screen of FIG. 7, for example. do. The condition for display unit 140 to display the display screen of FIG. 7 is not limited to first avatar 80A shown in FIG. For example, when the first user uses the first terminal 11 to start the application described in the present disclosure, the first user uses the first terminal 11 to perform an operation for displaying a display screen as shown in FIG. If so, the display unit 140 may display the display screen of FIG.

Note that in FIG. 6, when the first user operates the first avatar 80A, the first terminal 11 acquires, for example, data regarding the position of the first avatar 80A in the virtual space 300. FIG. Note that the timing at which first terminal 11 acquires data regarding the position of first avatar 80A in virtual space 300 may be any timing. Also, the first terminal 11 may transmit the data to the server 20 . Also, the timing at which the first terminal 11 transmits the data to the server 20 may be any timing.

In addition, any area of the display unit 140 of the first terminal 11 may be touch-operated. In addition, when the first terminal 11 includes an acceleration sensor (not shown) and the first terminal 11 is operated, the display area and/or direction displayed by the display unit 140 can be changed based on the acceleration sensor. may be Here, the aforementioned "arbitrary region" includes, for example, region 301 and/or region 314 in FIG. The area 301 and/or the area 314 is an operation user interface for performing predetermined display control by performing a touch operation. Also, "touch operation" refers to, for example, at least one of tapping, double tapping, swiping, flicking, pinching in, and pinching out. Also, as shown in FIG. 6, two regions 301 may be provided, or one region or three or more regions may be provided. Note that when two or more regions 301 are provided, one region 301 corresponds to, for example, the region used for walking the first avatar 80A, and the other region 301 corresponds to, for example, the first avatar 80A. corresponds to the area used for walking. In addition, the area 301 and/or the area 314 may be at the same position or different not only when displaying FIG. 6 but also when displaying other drawings (for example, FIGS. 7 and/or 8) described later. position may be displayed.

Further, the first terminal 11 may be configured such that the first user can make the first avatar 80A jump and/or walk by performing a touch operation on the display unit 140. FIG. Here, the touch operation for jumping the first avatar 80A is, for example, an operation of tapping or double-tapping any region or region 301 of the first avatar 80A. In this case, when an arbitrary point is tapped or double-tapped, display unit 140 displays a line segment connecting first avatar 80A and the arbitrary point in an arbitrary color, and first avatar 80A , walk along the line segment to the arbitrary point. Also, the touch operation for causing the first avatar 80A to walk is an operation of tapping or double-tapping an arbitrary point. In this case, when an arbitrary point is tapped or double-tapped, display unit 140 displays a line segment connecting first avatar 80A and the arbitrary point in an arbitrary color, and first avatar 80A , walk along the line segment to the arbitrary point. Further, the touch operation for walking the first avatar 80A is performed by performing an operation of flicking any region of the first avatar 80A to change the direction of travel, and then moving an arbitrary line on the virtual straight line in the direction of travel after the change. This is an operation of tapping or double-tapping a point.

Also, the first terminal 11 may be configured such that the first user can chat with a user corresponding to at least one avatar 80 among all the avatars 80 via the area 314 of the display unit 140 . Here, the area 314 is an area for displaying a message input via the terminal 10 by the user corresponding to the avatar 80, and is, for example, a rectangular frame. The display unit 140 displays the message included in the message data transmitted from the second terminal 12 in the area 314, for example. Also, a user who chats with the first user is an individual user or an exhibiting company.

The condition for displaying the display area 314 on the display unit 140 is, for example, the case where the avatar 80 is positioned within the virtual venue 310, but is not limited to this. For example, when avatar 80 is positioned within a predetermined area in virtual space 300 , a display area corresponding to the predetermined area may be displayed on display unit 140 . That is, the display area to be displayed on display unit 140 may be determined according to the position where avatar 80 exists. As a result, for example, the first terminal 11 allows the first user to chat with users corresponding to all the avatars 80 existing within a predetermined area (within the same area) via the display area 314 of the display unit 140. can be done. Therefore, a user can exchange messages with a user corresponding to another avatar 80 existing in the same area as the area where his/her own avatar 80 exists. In addition, users can chat with users of specific attributes. Therefore, the user can easily communicate with other users who have common interests, concerns, and/or attributes.

Further, when the display unit 140 displays a plurality of messages in the area 314 , when not all the messages can be displayed in the area 314 , the display unit 140 can be displayed in the area 314 by the user performing a touch operation. You may display messages that are not displayed in the . Here, the touch operation when not all messages can be displayed in the area 314 is, for example, a swipe. This reduces the possibility that the user will miss the message displayed in area 314 .

Moreover, if the display unit 140 displays at least one message in the area 314 and then displays a new message, the new message may be preferentially displayed in the area 314 . Further, when displaying a message in area 314, display unit 140 may display the time when the message data related to the message was transmitted together with the message. This reduces the possibility that the user will miss the message displayed in area 314 .

FIG. 7 is a diagram showing an example of a display screen displayed by the display unit 140 of the first terminal 11. As shown in FIG. As shown in FIG. 7, virtual venue 310 is an example of a venue provided within virtual space 300 . As shown in FIG. 7 , display unit 140 displays virtual venue 310 . In the virtual venue 310, for example, a first avatar 80A, a chair 81, a virtual object 81B, a balloon 82 (first display area), a display area 311, and a display area 312 are provided.

Note that the URL for displaying the display screen using the web browser of the first terminal 11 when the first avatar 80A exists outside the virtual venue 310 (for example, FIG. 6) is is different from the URL in the case of displaying the display screen using the web browser of the first terminal 11 when it exists inside (for example, FIG. 7). Therefore, when using the web browser of the first terminal 11, if the first avatar 80A shown in FIG. 6 is positioned inside the virtual hall 310, the URL will be changed.

The first avatar 80A is, for example, an avatar operated by the first user using the first terminal 11 . The first user can use the first terminal 11 to move the first avatar 80A within the virtual venue 310 . Control unit 130 controls display unit 140 based on operation data for moving first avatar 80A within virtual venue 310 .

Chair 81 is a virtual object on which avatar 80 and/or virtual object 81B can sit. For example, a plurality of chairs 81 are provided. When the first user operates the first avatar 80A to approach a specific chair out of one or a plurality of chairs and perform a predetermined operation, the display unit 140 displays a message asking whether to sit in the specific chair. You may When the display unit 140 displays a message asking whether to sit in a specific chair, the first user uses the first terminal 11 to perform a predetermined operation indicating the intention to sit in the specific chair in response to the message. Thus, the display unit 140 displays that the first avatar 80A is seated on one of the chairs. A configuration may be adopted in which the avatar 80 is seated when a specific location within the virtual section 300 is specified, together with the sitable virtual object or instead of the sitable virtual object. In this case, by approaching a specific location within the virtual section 300 and performing a predetermined operation, a message asking whether to sit at the specific location may be displayed on the display screen of the first terminal 11 . When a message asking whether to sit in the specific place is displayed on the display screen of the first terminal 11, the user operates the terminal 10 and responds to the message with a predetermined message indicating the intention to sit in the specific place. Upon actuation, avatar 80 may be configured to sit at that particular location.

A virtual object 81B is a virtual object corresponding to the second avatar 80B. The virtual object 81B corresponding to the second avatar 80B is drawn, for example, based on less data than the data used for drawing the second avatar 80B. When the display unit 140 displays a plurality of virtual objects 81B, each virtual object 81B among the plurality of virtual objects 81B has substantially the same shape and/or color, for example. The color of the virtual object 81B is black, for example. In this way, by using the virtual object corresponding to the avatar 80, it is possible to reduce the load of simultaneous drawing by a large number of people with a simple expression, and for example, it becomes possible to view even a terminal such as a smartphone. Although FIG. 7 illustrates an example in which four virtual objects 81B are provided, the number of virtual objects 81B is not limited to four. Moreover, the display unit 140 may display each of the plurality of virtual objects 81B in a different manner. Here, the above-mentioned “different aspect” refers to generating the corresponding virtual object 81B based on the avatar parts stored in the storage unit 160 of the first terminal 11, for example. Here, displaying each of the plurality of virtual objects 81B in a different manner may increase the load compared to displaying each of the plurality of virtual objects 81B in the same manner. On the other hand, if each of the plurality of virtual objects 81B is displayed in a different manner, it is possible to reduce the processing load for drawing compared to the case of displaying the second avatar 80B, and to display the plurality of virtual objects 81B in the same manner. It becomes easier to identify each virtual object 81B than in the case of displaying with .

The display area 311 is an area for displaying predetermined content. The predetermined content is, for example, a moving image, but is not limited to this. The display area 312 indicates the direction in which the first avatar 80A faces. The direction from the triangular object shown inside the display area 312 toward the fan-shaped object corresponds to the direction in which the first avatar 80A faces. When the first user changes the direction of the first avatar 80A using the first terminal 11, the display unit 140 changes the direction of the fan-shaped object inside the display area 312 and displays it. This allows the first user to easily identify the direction in which the first avatar 80A is facing.

The direction in which the first avatar 80A faces is, for example, the traveling direction (line-of-sight direction) of the first avatar 80A in the virtual space 300 displayed by the display unit 140 . The direction in which the first avatar 80A faces is, for example, the direction from the first avatar 80A to the display area 311 in FIG. 7, for example, the arrow direction (arrow 90) shown in FIG. The direction in which the first avatar 80A faces can be changed, for example, by operating the first avatar 80A. For example, when an operation is performed to change the orientation of first avatar 80A by 180 degrees in FIG. 7 is the direction opposite to the direction of the arrow (root side).

A predetermined content is reproduced in the display area 311 at a predetermined time. Here, the time used in the virtual space may be the time synchronized to be the same as the real time, or the time used in the virtual space 300 separately from the real time. . It should be noted that the condition for reproducing the moving image in the display area 311 does not have to be related to time. For example, the condition for reproducing the moving image in the display area 311 may be that the first avatar 80A sits (sitting) at a predetermined position within the virtual venue 310, for example.

Here, by displaying the display area 314 in FIG. 7 , it is possible to communicate with other users through the display area 314 while viewing the content displayed in the display area 311 . When the content of the other user's message displayed in the display area 314 is related to the content displayed in the display area 311, the first user exchanges messages with the other user to obtain the first message. Even when one user is physically distant from the other user, the first user feels as if he or she is viewing the content displayed in the display area 314 together with the other user. be able to.

In FIG. 7, when the first terminal 11 receives the second data from the server 20, the display unit 140 of the first terminal 11 performs display based on the second data. The second data includes, for example, at least one of position data of the second avatar 80B within the virtual venue 310 and operation data input to the terminal 10 corresponding to the second avatar 80B. Here, the position data is used for determining the position within the virtual venue 310 where the virtual object 81B corresponding to the second avatar 80B is displayed. A specific example of the operation data will be described later.

When the operation data included in the second data includes data regarding a message input to the second terminal 12 , the display unit 140 of the first terminal 11 displays the balloon 82 and the message included in the balloon 82 . The balloon 82 is displayed around the virtual object 81B corresponding to the terminal 10 that sent the message data. Display unit 140 displays the message included in the message data in balloon 82 . This clarifies the correspondence between the balloon 82 and the user operating the terminal 10 that has transmitted the message data. Therefore, the first user can recognize the user who sent the message contained in balloon 82 .

When displaying at least one virtual object 81B and at least one balloon 82, if any virtual object 81B and any balloon 82 overlap, the display unit 140 The display positions of the virtual object 81B and/or the balloon 82 may be changed and displayed so that the virtual object 81B and the balloon 82 do not overlap. This can reduce the possibility of deteriorating the visibility of the display unit 140 .

Further, when displaying at least one virtual object 81B and at least one balloon 82, if any of the virtual objects 81B and any of the balloons 82 overlap, the display unit 140 The virtual object 81B and the speech balloon 82 may be displayed at different timings so that the virtual object 81B and the speech balloon do not overlap. This can reduce the possibility of deteriorating the visibility of the display unit 140 .

Further, when displaying a plurality of virtual objects 81B, if the display positions of the plurality of virtual objects 81B overlap, the display unit 140 of the first terminal 11 displays the balloons 82 corresponding to each of the plurality of virtual objects 81B. may be displayed with different display positions. As a result, when the display unit 140 of the first terminal 11 displays a plurality of virtual objects 81B at approximately the same positions in the virtual hall 310, the display unit 140 of the first terminal 11 displays the positions of the balloons 82. are displayed differently. This can reduce the possibility of deteriorating the visibility of the display unit 140 .

Further, the display unit 140 may change the display method depending on whether the distance between an arbitrary position in the virtual space and the virtual object 81B is greater than or equal to a predetermined value. For example, when the distance between an arbitrary position in the virtual space 300 and the virtual object 81B is less than a predetermined value, the display unit 140 displays the message of the message data transmitted from the terminal 10 of the user corresponding to the virtual object 81B. It may be displayed around the virtual object 81B. Further, when the distance between an arbitrary position in the virtual space 300 and the virtual object 81B is equal to or greater than a predetermined value, the display unit 140 displays a message indicating that data related to the message has been sent from the terminal 10 of the user corresponding to the virtual object 81B. may be displayed around the virtual object 81B. Here, the above-mentioned "arbitrary position" is, for example, the position of the first avatar 80A that exists within the virtual space 300. As shown in FIG. Accordingly, when message data is transmitted from the terminal of the user corresponding to the second avatar 80B corresponding to the virtual object 81B, the first user cannot visually recognize the message corresponding to the message data through the display unit 140. Even in this case, the display unit 140 can display the virtual object 81B corresponding to the message. Therefore, the first user can specify the virtual object 81B corresponding to the message.

Further, when the operation data included in the second data includes data designating at least one color to be applied to the virtual object 81B, the display unit 140 of the first terminal 11 displays the skin based on the designation. The changed virtual object 81B may be displayed. Further, when the operation data included in the second data includes data designating at least one color and/or shape to be applied to the balloon 82 located around the virtual object 81B, the display of the first terminal 11 Unit 140 may display balloon 82 based on the designation. This allows the first user to recognize the predetermined virtual object 81B as being different from the other virtual objects 81B.

Further, when the operation data included in the second data includes data designating the motion of the virtual object 81B, the display unit 140 displays the position data included in the second data and the operation data included in the second data. Based on this, a display (emote display) that changes the behavior of the virtual object 81B over time may be performed. Accordingly, the display unit 140 can perform display in a variety of modes.

Further, the display unit 140 may display the area 314 as in FIG. The area 314 displays, for example, a message included in the message data transmitted from the terminal 10 used by the user operating the first avatar 80A, and the area 314 is used by the user operating the second avatar 80B, for example. A message included in the message data transmitted from the terminal 10 is displayed.

Further, the display unit 140 may display the virtual object 81B such that the area 314 and another area do not overlap, for example. Here, the "other area" is, for example, the area of the second avatar 80B, the virtual object 81B and/or the balloon 82. Accordingly, it is possible to reduce the possibility that the visibility is impaired when checking the display displayed in the area 314 .

Further, after the display unit 140 displays the message of the message data transmitted from the terminal 10 of the user corresponding to the virtual object 81B in the area 314 at the first time, the message is displayed in the area 314 regardless of the passage of time. You can continue. Also, for example, after the message is displayed in area 314 at the first time, the message may not be displayed in area 314 after a predetermined period of time has elapsed. Further, for example, after the message is displayed in area 314 at the first time, if at least one other message is displayed in area 314 after the first time, the message is displayed in area 314 at the first time. You can hide the message

Further, when the display unit 140 displays the area 314 and users chat with each other, the user ID and the avatar 80 in the chat may be linked to each other, or may not be linked to each other. may

FIG. 8 is a diagram showing an example of a display screen displayed by the display unit 140 of the first terminal 11. As shown in FIG. FIG. 8 is displayed by the display unit 140 of the first terminal 11 when the first terminal 11 receives the second data transmitted from the terminal 10 of the user who operates each of the plurality of second avatars. Indicates content. Here, the second data includes attribute data regarding attributes of each of the plurality of second avatars. The position where the virtual object 81B corresponding to each avatar of the plurality of second avatars 80B is displayed is determined based on each attribute data. This is data for specifying which of the plurality of groups each avatar 80B belongs to when groups are defined. The plurality of groups includes, for example, a group that holds the briefing and a group that attends the briefing when the briefing is held in the virtual space 300 . Also, the plurality of groups includes, for example, one group and another group that competes with the one group when playing a competitive game in the virtual space 300 . In addition, for example, when there are two cheering targets displayed in the display area 311, the plurality of groups includes one group cheering one cheering target and another group cheering the other cheering target. including. In the following description, when the plurality of second avatars includes, for example, a third avatar, a fourth avatar, a fifth avatar, and a sixth avatar, and the third avatar and the fourth avatar are one group and the fifth and sixth avatars belong to another group.

Here, when the plurality of second avatars includes a third avatar and a fourth avatar, and the attribute data regarding the third avatar and the attribute data regarding the fourth avatar are the same attribute data (first attribute data), the first The display unit 140 of the terminal 11 displays the virtual object 81B3 corresponding to the third avatar and the virtual object 81B4 corresponding to the fourth avatar within the second area 91 within the virtual venue 310 . Therefore, even if the position of the third avatar in the virtual venue 310 is outside the second area 91 , the display unit 140 displays the virtual object 81 B 3 in the second area 91 in the virtual venue 310 . Moreover, even if the position of the fourth avatar in the virtual hall 310 is outside the second area 91 , the display unit 140 displays the virtual object 81 B 4 in the second area 91 in the virtual hall 310 .

Further, the plurality of second avatars includes a fifth avatar and a sixth avatar, and when the attribute data regarding the fifth avatar and the attribute data regarding the sixth avatar are the same attribute data (second attribute data), the first terminal The control data for controlling the display unit 140 of No. 11 causes the display unit to display the virtual object 81B5 corresponding to the fifth avatar and the virtual object 81B6 corresponding to the sixth avatar in the third area 92 within the virtual venue 310. Contains controlling data. Therefore, even if the position of the fifth avatar within the virtual venue 310 is outside the third area 92 , the display unit 140 displays the virtual object 81 B 5 within the third area 92 within the virtual venue 310 . Moreover, even if the position of the sixth avatar within the virtual hall 310 is outside the third area 92 , the display unit 140 displays the virtual object 81 B 5 within the third area 92 within the virtual hall 310 . The second area 91 and the third area 92 are, for example, areas that do not overlap each other.

Thus, the first terminal 11 receives the first attribute data regarding the third avatar, the first attribute data regarding the fourth avatar, the second attribute data regarding the fifth avatar, and the second attribute data regarding the sixth avatar. In this case, the display unit 140 of the first terminal 11 displays, for example, FIG. Therefore, avatars with the same attribute among the plurality of avatars are arranged so as to be close to each other in the virtual venue 310 . As a result, avatars having the same attribute can be easily identified, and communication such as chatting can be facilitated. The first user who operates the first terminal 11 can easily specify the number of avatars having the same attribute among the plurality of avatars present in the virtual venue 310 .

Note that the number of multiple second avatars is not limited to four, namely, the third avatar, the fourth avatar, the fifth avatar, and the sixth avatar. The number of multiple second avatars may be, for example, two, three, or five or more.

Also, the types of attribute data are not limited to the two types of first attribute data and second attribute data. The types of attribute data may be, for example, three types. A separate area within the virtual venue 310 may be assigned corresponding to the type of attribute data. For example, if there are three types of attribute data, one area within the virtual venue 310 is allocated corresponding to each attribute data. Therefore, when there are three types of attribute data, three independent areas are assigned within the virtual venue 310 .

In addition, the server 20 may transmit to the first terminal 11 data relating to at least one of the number of simultaneous connections, users, and event attributes. Then, first terminal 11 may receive the data and determine the total number of avatars 80 displayed by display unit 140 in consideration of drawing performance. As a result, even if first terminal 11 does not have advanced performance, first terminal 11 allows the first user operating first avatar 80A to Avatar 80 can be drawn to give a sense of synchronicity. In addition, the first terminal 11 determines the total number of avatars 80 as described above, considering at least one of the number of mesh vertices of the 3D model that can be drawn, the number of materials, and the number of textures.

7 and 8, the display unit 140 may display the balloon 82 and the message displayed in the balloon 82 at the same time, or may display the message displayed in the balloon 82 prior to the message displayed in the balloon 82. , and the balloon 82 may be displayed. Further, the display unit 140 may hide the message included in the balloon 82 after a predetermined time has elapsed since the message included in the balloon 82 was displayed. In this way, the display unit 140 displays the balloon 82 before the message, thereby informing the user that the message will be displayed thereafter. Therefore, it is possible to prevent the user from missing the message.

In addition, in FIGS. 7 and 8, the display unit 140 may hide the virtual object 81B after a predetermined period of time has passed since the virtual object 81B was displayed. As a result, the display unit 140 hides the virtual object 81B included in the control data that the first terminal 11 receives from the server 20 at a timing relatively distant from the current time, while the first terminal 11 does not display the server 20 , the virtual object 81B included in the control data received at a timing relatively close to the current time is displayed. Therefore, the display unit 140 can display the state of the virtual space 300 (virtual venue 310) closer to real time. Further, even when the display unit 140 displays a large number of virtual objects 81B in the virtual space 300, by hiding the virtual objects 81B that have been displayed for a relatively long period of time, the display unit 140 can It is possible to reduce the possibility of displaying the virtual objects 81B overlapping each other in the virtual space 300 . Therefore, the display screen in the virtual space 300 with good visibility can be provided to the first user. Alternatively, the display unit 140 may display the message in the balloon 82 after displaying the virtual object 81B, and may hide the virtual object 81B after hiding the message in the balloon 82. In this manner, the display unit 140 displays the virtual object 81B before the message, thereby informing the user that the message corresponding to the virtual object 81B will be displayed thereafter. . Therefore, it is possible to prevent the user from missing the message. Also, the display unit 140 hides the message in the balloon 82 and then hides the virtual object 81B, so that the display unit 140 displays the message and does not display the virtual object 81B corresponding to the message. It is possible to reduce the possibility of Therefore, it is possible to reduce the possibility that the first user will have difficulty in identifying the virtual object 81B that is the transmission source of the message. In this way, it is possible to reduce the possibility that the display unit 140 will not display the virtual object 81B corresponding to the message, causing a sense of discomfort.

Further, the first terminal 11 may acquire only the data related to the second avatars 80B present in the direction in which the first avatars 80A are facing, among the second avatars 80B present in the virtual hall 310 (Case 1 ). In addition, the first terminal 11 is configured to select a second avatar 80B that exists in the virtual hall 310 and that exists in a direction other than the direction in which the first avatar 80A is facing and the direction in which the first avatar 80A is facing. 80B may be obtained (Case 2). In case 2 described above, compared to case 1 described above, the display unit 140 can display the virtual object 81B relatively without delay when the orientation of the first avatar 80A is changed.

4. Operation of System 1000 The operation of system 1000 will now be described with reference to FIGS. FIGS. 9 and 10 are flowcharts illustrating exemplary operations performed using the system 1000 shown in FIG.

First, S111 to S151 will be described in order with reference to FIG.

In S111, the first user operates the first terminal 11 to activate the application, and in S112, the second user operates the second terminal 12 to activate the application.

In S121, the first terminal 11 acquires first data. The first data includes, for example, data related to an avatar in virtual space operated using the first terminal 11 . The first data is data relating to the position (first position) where the first avatar 80A corresponding to the first user exists.

In S122, the second terminal 12 acquires second data. The second data includes, for example, position data of at least one second avatar within the virtual venue 310 and operation data input to the second terminal 12 . After the process of S<b>122 , the second terminal 12 transmits the second data to the server 20 .

In S<b>131 , the first terminal 11 performs processing for controlling the display unit 140 of the first terminal 11 (first display control processing). The first display control process is, for example, a process of controlling the display unit 140 to display the display screen inside the virtual venue 310 .

In S141, the first terminal 11 performs a first determination process. Here, the first determination process determines whether or not a first condition regarding data included in the first data is satisfied. The first determination process determines, for example, whether or not the position (first position) of the first avatar 80A satisfies the first condition that it is inside the virtual venue 310 .

In S141, when the first terminal 11 determines that the first condition is satisfied, at least one second The second data transmitted from the terminal 10 of the user operating the avatar 80B is received. On the other hand, when the first terminal 11 determines in S141 that the predetermined condition is not satisfied, the process of S141 is repeated.

In S151, the first terminal 11 performs processing (second display control processing) for controlling the display unit 140 of the first terminal 11 based on the second data. In the second display control process, for example, while the display screen in the virtual hall 310 is being displayed, the position data of the second avatar 80B in the virtual hall 310 and the terminal 10 corresponding to the second avatar 80B are displayed. It refers to display control based on at least one of input operation data. Specifically, the second display control process, for example, displays the message included in the message data transmitted from the second terminal 12 in the balloon 82 while the display screen in the virtual venue 310 is being displayed. Points to the display control to display. Further, specifically, the second display control process is determined based on the position data of the second avatar 80B within the virtual hall 310 while the display screen within the virtual hall 310 is being displayed, for example. This refers to display control for displaying the virtual object 81B at a predetermined position within the virtual venue 310 .

Note that the first terminal 11 may transmit the second data to the first terminal 11 every time the second terminal 12 transmits the second data to the server 20 . Then, each time the first terminal 11 receives the second data from the server 20, the first terminal 11 may perform the process of S151. Thereby, the first terminal 11 can reflect the display content regarding the second avatar 80B operated by the second terminal 12 on the display unit 140 in real time.

Next, S111 to S151 will be described in order with reference to FIG. In FIG. 9, an example in which the first terminal 11 performs the first determination process has been described, but in FIG. 10 the server 20 performs the first determination process. Therefore, in FIG. 10, the server 20 performs the first determination process and transmits control data to the first terminal 11, unlike in FIG. Also, unlike FIG. 9, in FIG. 10, the first terminal 11 does not perform the first determination process, and therefore does not receive the second data. Therefore, in FIG. 9, the processing load on the first terminal 11 can be reduced in that the server 20 does not perform the first determination process. Moreover, in FIG. 10, the processing load on the first terminal 11 can be reduced in that the first terminal 11 does not perform the first determination process.

In S111, the first user operates the first terminal 11 to activate the application, and in S112, the second user operates the second terminal 12 to activate the application.

In S121, the first terminal 11 acquires first data. The first data includes, for example, data related to an avatar in virtual space operated using the first terminal 11 . The first data is data relating to the position (first position) where the first avatar 80A corresponding to the first user exists.

In S122, the second terminal 12 acquires second data. The second data includes, for example, position data of at least one second avatar within the virtual venue 310 and operation data input to the second terminal 12 . After the process of S<b>122 , the second terminal 12 transmits the second data to the server 20 .

In S<b>131 , the first terminal 11 performs processing for controlling the display unit 140 of the first terminal 11 (first display control processing). The first display control process is, for example, a process of controlling the display unit 140 to display the display screen inside the virtual venue 310 .

In S141, the server 20 performs a first determination process. Here, the first determination process of S141 of FIG. 10 is the same as the first determination process of S141 of FIG. In S<b>141 , when the server 20 determines that the predetermined condition (first condition) is satisfied, the server 20 determines control data and transmits the control data to the first terminal 11 . On the other hand, when it is determined in S141 that the predetermined condition is not satisfied, the processing of S141 is repeated. The control data determined in S<b>141 is data for controlling the display screen of the first terminal 11 .

When the first terminal 11 performs processing (first display control processing) for controlling the display unit 140 of the first terminal 11 based on the control data, and when the first terminal 11 receives the control data from the server 20 , the process of S151 is performed.

In S<b>151 , the first terminal 11 performs processing (second display control processing) for controlling the display unit 140 of the first terminal 11 based on control data received from the server 20 . In the second display control process, for example, while the display screen in the virtual hall 310 is being displayed, the position data of the second avatar 80B in the virtual hall 310 and the terminal 10 corresponding to the second avatar 80B are displayed. It refers to display control based on at least one of input operation data. Specifically, the second display control process, for example, displays the message included in the message data transmitted from the second terminal 12 in the balloon 82 while the display screen in the virtual venue 310 is being displayed. Points to the display control to display. Further, specifically, the second display control process is determined based on the position data of the second avatar 80B within the virtual hall 310 while the display screen within the virtual hall 310 is being displayed, for example. This refers to display control for displaying the virtual object 81B at a predetermined position within the virtual venue 310 .

Note that the first terminal 11 may transmit the control data to the first terminal 11 based on the second data every time the second terminal 12 transmits the second data to the server 20 . Then, each time the first terminal 11 receives the control data from the server 20, the first terminal 11 may perform the process of S151. Thereby, the first terminal 11 can reflect the display content regarding the second avatar 80B operated by the second terminal 12 on the display unit 140 in real time.

At least part of the processing in FIG. 9 and/or the processing in FIG. 10 may be omitted as appropriate. At least part of the processing in FIG. 9 and/or the processing in FIG. 10 may be integrated as appropriate.

As described above, the first data regarding the first position where the first avatar exists in the virtual space operated using the first terminal 11 is obtained, and the first condition that the first position is within the virtual hall 310 is set. If it is determined that the first condition is satisfied, at least one second avatar among at least one avatar existing in the virtual venue 310 other than the first avatar is selected via the communication line. Second data transmitted from the operating user's terminal 10 is received, the second data includes position data in the virtual hall 310 of at least one second avatar 80B and operation data input to the terminal, The data is used to determine the position within the virtual venue 310 where the virtual object 81B corresponding to at least one second avatar 80B is displayed, and based on the second data, at least the virtual object 81B is displayed on the first terminal 11. Control data for controlling the display unit 140 to display on the display unit 140 is determined, and the display unit 140 is controlled based on the control data. Thus, the display unit 140 of the first terminal 11 displays the virtual object 81B corresponding to the second avatar 80B instead of the second avatar 80B. Therefore, even when first terminal 11 receives a large number of second data about second avatars 80B, first terminal 11 can reduce the display load and reflect the second data on display unit 140 . As described above, it is possible to reduce the possibility that the load of the display control becomes larger than the conventional one.

5. Modification

Note that, as shown in FIG. 11, a first sensor 102a, a second sensor 102b, a camera 102c, and a microphone 102d may be provided in addition to the terminal 10 shown in FIG. FIG. 11 is a block diagram showing an example of the terminal 10 shown in FIG. 3 and a configuration connected to the terminal 10. As shown in FIG. Here, the terminal 10 and each of the first sensor 102a, the second sensor 102b, the camera 102c, and the microphone 102d are connected by wire or wirelessly, for example.

The first sensor 102a is, for example, wired or wirelessly connected to the camera 102c. The camera 102c can include, for example, an RGB camera that captures visible light and a near-infrared camera that captures near-infrared light. Camera 102c can be, for example, that included in the iPhone X® True Depth camera, for example. The second sensor 102b is, for example, wired or wirelessly connected to the microphone 102d. Note that the first sensor 102a and the camera 102c may be provided as one configuration. Also, the second sensor 102b and the microphone 102d may be provided as one configuration.

In this manner, the terminal 10 may transmit the image captured by the camera 102c to the server 20. FIG. Also, the terminal 10 may transmit voice data input to the microphone 102 d to the server 20 . Also, the terminal 10 may transmit video data using the camera 102 c and the microphone 102 d to the server 20 .

FIG. 12 is a generalization of a suitable computing environment 1400 in which the embodiments, techniques and techniques described herein, including transmitting and using tokens to render video in a computing environment, may be implemented. example. For example, computing environment 1400 may implement either a terminal device (or broadcaster or viewer), or a distribution server system, etc., as described herein.

Computing environment 1400 is not intended to suggest any limitation as to the scope of use or functionality of the technology, as the technology may be implemented in a wide variety of general purpose or special purpose computing environments. For example, the technology disclosed herein can be used in various portable devices, various multiprocessor systems, various microprocessor-based or programmable consumer electronics, various network PCs, various minicomputers, various It may also be implemented in various other computer system configurations, including mainframe computers, etc. The techniques disclosed herein may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.

Referring to FIG. 12, computing environment 1400 includes at least one central processing unit 1410 and memory 1420 . In FIG. 12, this most basic configuration 1430 is included within the dashed line. Central processing unit 1410 executes computer-executable instructions, and central processing unit 1410 may be a real processor or a virtual processor. In a multi-processing system, multiple processors can operate simultaneously so that multiple processing units execute computer-executable instructions to increase processing power. Memory 1420 may be volatile memory (eg, registers, cache, RAM), non-volatile memory (eg, ROM, EEPROM, flash memory, etc.), or some combination of the two. Memory 1420 stores, for example, software 1480, various images and videos that can implement the techniques described herein. A computing environment may have a variety of additional features. For example, computing environment 1400 includes storage 1440 , one or more input devices 1450 , one or more output devices 1460 and one or more communication connections 1470 . An interconnection mechanism (not shown) such as a bus, controller, or network interconnects the various components of computing environment 1400 . Typically, operating system software (not shown) provides an operating environment for other software running in computing environment 1400 and coordinates various activities of various components of computing environment 1400 .

Storage 1440 may or may not be removable and may be magnetic disks, magnetic tapes or cassettes, CD-ROMs, CD-RWs, DVDs, or any other device used to store information. and any other medium that can be accessed within computing environment 1400 . Storage 1440 stores instructions for software 1480, plug-in data, and messages that may be used to implement the techniques described herein.

One or more input devices 1450 may be a touch input device such as a keyboard, keypad, mouse, touch screen display, pen or trackball, voice input device, scanning device, or other device that provides input to the computing environment 1400 . device. For audio, the input device(s) 1450 may be a sound card or similar device that accepts audio input in analog or digital form, or a CD-ROM reader that provides various audio samples to the computing environment 1400. good. Output device(s) 1460 may be a display, printer, speakers, CD writer, or another device that provides output from computing environment 1400 .

One or more communication connections 1470 enable communication over a communication medium (eg, a connection network) to another computing entity. The communication medium conveys information such as computer-executable instructions, compressed graphics information, video or other data contained in a modulated data signal. The one or more communication connections 1470 are not limited to wired connections (e.g., Megabit or Gigabit Ethernet, InfiniBand, or Fiber Channel over electrical or fiber optic connections), but also wireless technologies (e.g., Bluetooth, WiFi (IEEE 802.11a/b/n), WiMax, Cellular, Satellite, Laser, Infrared, RF connections via), and various agents, bridges, and destination agents disclosed herein. and various other suitable communication connections for providing network connectivity to any data consumer. In a virtual host environment, one or more communication connections may be virtualized network connections provided by the virtual host.

Various embodiments of the various methods disclosed herein are performed in the compute cloud 1490 using computer-executable instructions implementing all or part of the techniques disclosed herein. can be For example, different agents can perform different vulnerability scanning functions in a compute environment, while agent platforms (e.g., bridges) and destination agent data consumer services can be located within compute cloud 1490. can be run on any server.

Computer readable media are any available media that can be accessed within computing environment 1400 . By way of example, and not limitation, with respect to computing environment 1400 , computer readable media include memory 1420 and/or storage 1440 . As will be readily understood, the term computer readable media includes media for data storage such as memory 1420 and storage 1440 and does not include transmission media such as modulated data signals of any kind.

The various embodiments described above can be used in combination with each other as long as no contradiction or inconvenience occurs. In view of the many possible embodiments in which the principles of the invention disclosed herein may be applied, the various illustrated embodiments are merely various preferred examples and techniques for the claimed invention. It should be understood that the scope should not be considered limited to these preferred various examples. Indeed, the scope of the claimed invention is defined by the appended claims. Therefore, all matters falling within the technical scope of the invention described in the claims are claimed as inventions of the present inventors.

A computer program according to a first aspect is defined as "a computer program executed by at least one processor, wherein a first position in which a first avatar in a virtual space operated using a first terminal of a first user exists. and determines whether the first condition that the first position is within the first region is satisfied, and if it is determined that the first condition is satisfied, the second data transmitted from a terminal of a user operating at least one second avatar among at least one avatar existing in the first region other than the first avatar, wherein the second data is the at least Position data of one second avatar within the first region and operation data input to the terminal, wherein the position data is the first virtual object that displays a virtual object corresponding to the at least one second avatar. Determining control data for controlling the display unit of the first terminal so as to display at least the virtual object on the display unit of the first terminal, based on the second data, the control data being used for determining a position within the area; functioning the at least one processor to control the display based on the control data.

A computer program according to the second aspect is defined as "a computer program executed by at least one processor, wherein a first avatar in a virtual space is operated using a first terminal of a first user via a communication line. receives first data about a first position where the receiving, via a communication line, second data transmitted from a terminal of a user who operates at least one second avatar among at least one avatar existing in the first area other than the first avatar; The second data includes position data of the at least one second avatar within the first region and operation data input to the terminal, wherein the position data is virtual data corresponding to the at least one second avatar. used to determine a position within the first area where the object is to be displayed, and controlling the display unit to display at least the virtual object on the display unit of the first terminal based on the second data; operable to determine control data and to transmit said control data to said first terminal.

A computer program according to a third aspect is characterized in that, in the first aspect or the second aspect described above, "the operation data includes data relating to a message input to the terminal and specifying at least one color for the color of the virtual object. and/or data specifying the behavior of the virtual object.

A computer program according to a fourth aspect is the computer program according to the above-described third aspect, wherein "the operation data includes data relating to a message input to the terminal, and the control data is the position data and the operation data. data for controlling the display of the first terminal to display a virtual object and a first display area for the message positioned around the virtual object on the display of the first terminal.

A computer program according to a fifth aspect is a computer program according to the above fourth aspect, wherein: "the operation data includes data specifying at least one color to be applied to the virtual object; and data specifying at least one color and/or shape to be applied to the first display area for displaying a message, wherein the control data determines the at least one color based on the position data and the operation data. and/or to display the first display area using the at least one color and/or shape. be.

A computer program according to a sixth aspect is a computer program according to any one of the above-described third to fifth aspects, wherein "the operation data includes data specifying an action of the virtual object, and the control data includes the position data and the data for controlling the display unit so as to change the motion of the virtual object over time based on the operation data.

A computer program according to a seventh aspect, in the above-described fourth aspect, wherein "the second data includes position data of each of the plurality of avatars within the first region of the avatar and each avatar of the plurality of avatars; and operation data input to a terminal of an operating user, wherein the control data displays a message included in each of the operation data on the display unit when each of the position data indicates the same position. including data for controlling the display units so that their positions are different from each other.

A computer program according to an eighth aspect, in the above fourth aspect, wherein "the second data includes position data of each of the plurality of avatars within the first region of the avatar and operating the avatar of each of the plurality of avatars. and operation data input to a user's terminal, wherein the control data is the time at which the message included in each of the operation data is displayed on the display unit when each of the position data indicates the same position. and data for controlling the display unit to make the display units different from each other.

A computer program according to a ninth aspect is characterized in that, in the fourth aspect described above, "the control data displays the message according to the distance between the first avatar and the virtual object in the virtual space. and data for controlling said display to display around a.

A computer program according to a tenth aspect is, in any one of the above first to ninth aspects, "the control data is such that the distance between the first avatar and the virtual object in the virtual space is less than a predetermined value. In some cases, controlling the display unit to display the message included in the data transmitted from the terminal of the user operating the at least one second avatar corresponding to the virtual object around the virtual object. contains data;

The computer program according to the eleventh aspect is the computer program according to the above-described ninth aspect, wherein "the control data controls the virtual object when the distance between the first avatar and the virtual object in the virtual space is equal to or greater than a predetermined value. data for controlling the display unit so as to display around the virtual object that the data regarding the message has been transmitted from the terminal of the user who operates the at least one second avatar corresponding to be.

A computer program according to a twelfth aspect is a computer program according to any one of the first to eleventh aspects above, wherein: "the control data indicates that the virtual object is displayed on the display unit after a predetermined time has elapsed, the virtual object is including data for controlling said display to display.

A computer program according to a thirteenth aspect is the computer program according to the above fourth aspect, wherein "the control data displays a message included in message data transmitted from a terminal operating the at least one second avatar on the display unit. including data for controlling the display unit to hide the message after a predetermined time has passed since the display.

A computer program according to a fourteenth aspect is, in the above-described thirteenth aspect, "the control data displays the message on the display unit after displaying the virtual object on the display unit; and data for controlling the display to hide the virtual object displayed on the display after hiding the message displayed on the display.

A computer program according to a fifteenth aspect is characterized in that, in the first aspect or the second aspect described above, "the at least one second avatar is a plurality of second avatars, and the second data comprises the plurality of second avatars, data transmitted from a terminal of a user operating each of two avatars, wherein the second data includes attribute data relating to attributes of each of the plurality of second avatars, and each of the plurality of second avatars position within the first area where the virtual object corresponding to the avatar is displayed is determined based on each of the attribute data.

The computer program according to the sixteenth aspect is characterized in that, in the fifteenth aspect described above, "the plurality of second avatars includes a third avatar and a fourth avatar, attribute data about the third avatar and attribute data about the fourth avatar is the first attribute data, the control data displays a virtual object corresponding to the third avatar and a virtual object corresponding to the fourth avatar in a second area within the first area. including data for controlling said display unit.

A computer program according to a seventeenth aspect, wherein in the sixteenth aspect described above, "the plurality of second avatars includes a fifth avatar and a sixth avatar, attribute data about the fifth avatar and attribute data about the sixth avatar is the second attribute data, the control data displays a virtual object corresponding to the fifth avatar and a virtual object corresponding to the sixth avatar in a third area within the first area. including data for controlling the display, wherein the second area and the third area have no overlapping area.

A computer program according to an eighteenth aspect is the computer program according to any one of the first to seventeenth aspects above, wherein "a second display area for displaying a moving image is provided in the first area."

A computer program according to a nineteenth aspect is, in any one of the above first to eighteenth aspects, "the virtual space is a three-dimensional space."

A computer program according to a twentieth aspect is, in any one of the above first to nineteenth aspects, "the communication line includes the Internet."

The computer program according to the 21st aspect is characterized in that, in any one of the 1st to 20th aspects above, "the at least one processor comprises a central processing unit (CPU), a microprocessor, and/or a graphics processing unit ( GPU).

The method according to the twenty-second aspect is the method according to any one of the first to twenty-first aspects above, wherein: "the at least one processor is installed in a server, smartphone, tablet, mobile phone, or personal computer;
is a thing.

A method according to a twenty-third aspect is described as "a method executed by at least one processor, wherein a first position of a first avatar in a virtual space operated using a first terminal of a first user is present. a step of acquiring 1 data; a step of determining whether or not a first condition that the first position is within a first region is satisfied; and receiving second data transmitted from a terminal of a user who operates at least one second avatar among at least one avatar existing in the first area other than the first avatar, The second data includes position data of the at least one second avatar within the first region and operation data input to the terminal, wherein the position data is virtual data corresponding to the at least one second avatar. used to determine a position within the first area where the object is to be displayed, and controlling the display unit to display at least the virtual object on the display unit of the first terminal based on the second data; determining control data; and controlling said display based on said control data.

A method according to a twenty-fourth aspect is defined as "a method executed by at least one processor, wherein there is a first avatar in a virtual space operated using a first terminal of a first user via a communication line. receiving first data about a first location; determining whether the first location satisfies a first condition that the first location is within a first region; and receiving, via the communication line, second data transmitted from a terminal of a user who operates at least one second avatar among at least one avatar existing in the first area other than the first avatar. and wherein the second data includes position data of the at least one second avatar within the first region and operation data input to the terminal, and the position data includes the at least one used for determining a position within the first area where a virtual object corresponding to a second avatar is displayed, and for displaying at least the virtual object on the display unit of the first terminal based on the second data; determining control data for controlling the display unit; and transmitting the control data to the first terminal.

A method according to a twenty-fifth aspect is the method according to the twenty-third or twenty-fourth aspect above, wherein "the virtual space is a three-dimensional space."

The method according to the twenty-sixth aspect is of the twenty-fourth or twenty-fifth aspect above "wherein said communication line comprises the Internet."

The method according to the twenty-seventh aspect is the method according to any one of the twenty-third to twenty-sixth aspects above, wherein: "the at least one processor comprises a central processing unit (CPU), a microprocessor, and/or a graphics processing unit (GPU) ), including

The method according to the twenty-eighth aspect is any of the above-described twenty-third to twenty-seventh aspects, wherein: "the at least one processor is installed in a server, smart phone, tablet, mobile phone, or personal computer;
is a thing.

A server according to the twenty-ninth aspect "comprising at least one processor, via a communication line, a server related to a first location where a first avatar in a virtual space is operated using a first terminal of a first user. It receives the first data, determines whether or not the first condition that the first position is within the first region is satisfied, and if it is determined that the first condition is satisfied, the communication is performed via the communication line. second data transmitted from a terminal of a user operating at least one second avatar among at least one avatar existing in the first region other than the first avatar, wherein the second data is the at least Position data of one second avatar within the first region and operation data input to the terminal, wherein the position data is the first virtual object that displays a virtual object corresponding to the at least one second avatar. Determining control data for controlling the display unit of the first terminal so as to display at least the virtual object on the display unit of the first terminal, based on the second data, the control data being used for determining a position within the area; transmitting control data to said first terminal.

The server according to the thirtieth aspect is, in the above twenty-ninth aspect, "the virtual space is a three-dimensional space."

The server according to the thirty-first aspect is the server according to the twenty-ninth aspect or the thirtieth aspect, wherein "the communication line includes the Internet."

The server according to the thirty-second aspect, in any one of the above-mentioned twenty-ninth to thirty-first aspects, "the at least one processor comprises a central processing unit (CPU), a microprocessor, and/or a graphics processing unit ( GPU).

2 communication line 10 terminal 11 first terminal 12 second terminal 14, 24 central processing unit 15, 25 main storage device 16, 26 input/output interface 17, 27 input device 18, 28 auxiliary storage device 19, 29 output device 20 server 21 First server system 21A1 Distribution server 21A2 Server storage device 22 Second server system 30 Communication line 80 Avatar 80A First avatar 80B Second avatar 81 Chair 81B, 81B3, 81B4, 81B5, 81B6 Virtual object 82 Balloon (first display area)
90 arrow 91 second area 92 third area 102a first sensor 102b second sensor 102c camera 102d microphone 110 communication unit 120 acquisition unit 130 control unit 140 display unit 150 user interface unit 160 storage unit 210 communication unit 220 storage unit 230 control unit 300 virtual space 310 virtual venue 311, 312 display area 314 area 1000 system 1400 computing environment 1410 processing unit 1420 memory 1430 configuration 1440 storage 1450 input device 1460 output device 1470 communication connection 1480 software instruction 1490 computing cloud

Claims (31)

A computer program executed by at least one processor, comprising:
Acquiring first data about a first position where a first avatar exists in a virtual space operated using a first terminal of a first user;
Determining whether the first position satisfies a first condition that the first position is within the first region;
When it is determined that the first condition is satisfied, the terminal of the user who operates at least one second avatar among at least one avatar existing in the first area other than the first avatar via a communication line. receive second data transmitted from
The second data is
position data of the at least one second avatar within the first region and operation data input to the terminal;
the position data is used to determine positions within the first region for displaying a plurality of virtual objects;
determining control data for controlling the display unit to display at least the virtual object on the display unit of the first terminal, based on the second data;
functioning the at least one processor to control the display based on the control data;
The operation data is
including data relating to messages input to the terminal;
The control data are
Data for controlling the display unit to display on the display unit a first display area for the virtual object and the message positioned around the virtual object based on the position data and the operation data ;
The at least one second avatar is a plurality of second avatars, the plurality of virtual objects includes at least a virtual object corresponding to each of the plurality of second avatars, and a virtual object corresponding to the second avatar. drawing data of the object is less than drawing data of the second avatar;
virtual objects corresponding to each of the plurality of second avatars have substantially the same shape and color;
computer program. A computer program executed by at least one processor, comprising:
receiving, via a communication line, first data relating to a first location of a first avatar in a virtual space operated using a first terminal of a first user;
Determining whether the first position satisfies a first condition that the first position is within the first region;
When it is determined that the first condition is satisfied, the user who operates at least one second avatar among at least one avatar other than the first avatar existing in the first area via the communication line. receiving the second data transmitted from the terminal;
The second data is
position data of the at least one second avatar within the first region and operation data input to the terminal;
the position data is used to determine positions within the first region for displaying a plurality of virtual objects;
determining control data for controlling the display unit to display at least the virtual object on the display unit of the first terminal, based on the second data;
functioning the at least one processor to transmit the control data to the first terminal;
The operation data is
including data relating to messages input to the terminal;
The control data are
Data for controlling the display unit to display on the display unit a first display area for the virtual object and the message positioned around the virtual object based on the position data and the operation data ;
The at least one second avatar is a plurality of second avatars, the plurality of virtual objects includes at least a virtual object corresponding to each of the plurality of second avatars, and a virtual object corresponding to the second avatar. drawing data of the object is less than drawing data of the second avatar;
Virtual objects corresponding to each of the plurality of second avatars are configured with substantially the same shape and color,
computer program. The operation data is
further comprising at least one of data specifying at least one color of the virtual object and data specifying an action of the virtual object;
3. A computer program according to claim 1 or claim 2. The operation data is
data specifying at least one color for the color of the virtual object; and specifying at least one color and/or shape to be applied to the first display area positioned around the virtual object and displaying the message. data, including
The control data are
displaying the virtual object using the at least one color and/or displaying the first display area using the at least one color and/or shape based on the position data and the operation data; , including data for controlling the display such as
2. A computer program as claimed in claim 1. The operation data is
including data specifying behavior of the virtual object;
The control data are
including data for controlling the display unit to change the motion of the virtual object over time based on the position data and the operation data;
The computer program according to any one of claims 3-4 . The second data is
Position data of each of the plurality of avatars within the first region and operation data input to a terminal of a user who operates each of the plurality of avatars,
The control data are
including data for controlling the display unit such that, when each of the position data indicates the same position, the display unit displays different positions of messages included in each of the operation data;
2. A computer program as claimed in claim 1. The second data is
Position data of each of the plurality of avatars within the first region and operation data input to a terminal of a user who operates each of the plurality of avatars,
The control data are
including data for controlling the display unit such that, when each of the position data indicates the same position, the message included in each of the operation data is displayed at different times on the display unit;
2. A computer program as claimed in claim 1. The control data are
including data for controlling the display unit to display a display related to the message around the virtual object according to the distance between the first avatar and the virtual object in the virtual space;
2. A computer program as claimed in claim 1. The control data are
Data transmitted from a terminal of a user operating said at least one second avatar corresponding to said virtual object when the distance between said first avatar and said virtual object in said virtual space is less than a predetermined value including data for controlling the display to display the included message around the virtual object;
Computer program according to claim 8 . The control data are
When the distance between the first avatar and the virtual object in the virtual space is equal to or greater than a predetermined value, data regarding the message is received from a terminal of a user operating the at least one second avatar corresponding to the virtual object. including data for controlling the display unit to display the fact that it has been transmitted around the virtual object;
Computer program according to claim 8 . The control data are
including data for controlling the display unit to hide the virtual object after a predetermined time has elapsed since the virtual object was displayed on the display unit;
A computer program according to any one of claims 1-10 . The control data are
Data for controlling the display unit so that the message included in the message data transmitted from the terminal operating the at least one second avatar is displayed on the display unit and the message is hidden after a predetermined time has elapsed. including,
A computer program as claimed in claim 1 or claim 11 depending on claim 1. The control data are
After displaying the virtual object on the display unit, the message is displayed on the display unit, and after hiding the message displayed on the display unit, the virtual object displayed on the display unit is hidden. including data for controlling the display to
A computer program as claimed in claim 12 when dependent on claim 11 . The at least one second avatar is a plurality of second avatars,
The second data is
Data transmitted from a terminal of a user who operates each avatar of the plurality of second avatars,
The second data is
including attribute data relating to attributes of each of the plurality of second avatars;
A position within the first region where a virtual object corresponding to each avatar of the plurality of second avatars is displayed is determined based on each of the attribute data;
3. A computer program according to claim 1 or claim 2. The plurality of second avatars includes a third avatar and a fourth avatar,
When the attribute data related to the third avatar and the attribute data related to the fourth avatar are the first attribute data, the control data control the virtual object corresponding to the third avatar and the virtual object corresponding to the fourth avatar. including data for controlling the display unit to display in a third area within the first area;
15. Computer program according to claim 14 . The plurality of second avatars includes a fifth avatar and a sixth avatar,
When the attribute data related to the fifth avatar and the attribute data related to the sixth avatar are the second attribute data, the control data control the virtual object corresponding to the fifth avatar and the virtual object corresponding to the sixth avatar. including data for controlling the display unit to display in a fourth area within the first area, wherein the third area and the fourth area do not have an overlapping area;
16. Computer program according to claim 15 . A third display area for displaying a moving image is provided in the first area,
A computer program according to any one of claims 1-16 . the virtual space is a three-dimensional space,
A computer program according to any one of claims 1-17 . wherein said communication line comprises the Internet;
A computer program according to any one of claims 1-18 . the at least one processor;
including a central processing unit (CPU), microprocessor, and/or graphics processing unit (GPU);
A computer program according to any one of claims 1-19 . wherein the at least one processor is installed in a server, smart phone, tablet, mobile phone, or personal computer;
A computer program according to any one of claims 1-20 . A method performed by at least one processor, comprising:
obtaining first data about a first location of a first avatar in a virtual space operated using a first terminal of a first user;
Determining whether the first position satisfies a first condition that the first position is within the first region;
When it is determined that the first condition is satisfied, the terminal of the user who operates at least one second avatar among at least one avatar existing in the first area other than the first avatar via a communication line. receiving second data transmitted from
The second data is
position data of the at least one second avatar within the first region and operation data input to the terminal;
the position data is used to determine positions within the first region for displaying a plurality of virtual objects;
The method further comprises:
determining control data for controlling the display unit of the first terminal to display at least the virtual object on the display unit, based on the second data;
and controlling the display unit based on the control data;
The operation data is
including data relating to messages input to the terminal;
The control data are
Data for controlling the display unit to display on the display unit a first display area for the virtual object and the message positioned around the virtual object based on the position data and the operation data ;
The at least one second avatar is a plurality of second avatars, the plurality of virtual objects includes at least a virtual object corresponding to each of the plurality of second avatars, and a virtual object corresponding to the second avatar. drawing data of the object is less than drawing data of the second avatar;
virtual objects corresponding to each of the plurality of second avatars have substantially the same shape and color;
Method. A method performed by at least one processor, comprising:
receiving, via a communication line, first data relating to a first location of a first avatar in a virtual space operated using a first terminal of a first user;
Determining whether the first position satisfies a first condition that the first position is within the first region;
When it is determined that the first condition is satisfied, the user who operates at least one second avatar among at least one avatar other than the first avatar existing in the first area via the communication line. receiving second data transmitted from the terminal;
The second data is
position data of the at least one second avatar within the first region and operation data input to the terminal;
the position data is used to determine positions within the first region for displaying a plurality of virtual objects;
The method further comprises:
determining control data for controlling the display unit of the first terminal to display at least the virtual object on the display unit, based on the second data;
transmitting the control data to the first terminal;
The operation data is
including data relating to messages input to the terminal;
The control data are
Data for controlling the display unit to display on the display unit a first display area for the virtual object and the message positioned around the virtual object based on the position data and the operation data ;
The at least one second avatar is a plurality of second avatars, the plurality of virtual objects includes at least a virtual object corresponding to each of the plurality of second avatars, and a virtual object corresponding to the second avatar. drawing data of the object is less than drawing data of the second avatar;
virtual objects corresponding to each of the plurality of second avatars have substantially the same shape and color;
Method. the virtual space is a three-dimensional space,
24. A method according to claim 22 or claim 23 . wherein said communication line comprises the Internet;
The method according to any one of claims 22-24 . the at least one processor;
including a central processing unit (CPU), microprocessor, and/or graphics processing unit (GPU);
The method according to any one of claims 22-25 . wherein the at least one processor is installed in a server, smart phone, tablet, mobile phone, or personal computer;
A method according to any one of claims 22-26 . comprising at least one processor;
receiving, via a communication line, first data relating to a first location of a first avatar in a virtual space operated using a first terminal of a first user;
Determining whether the first position satisfies a first condition that the first position is within the first region;
When it is determined that the first condition is satisfied, the user who operates at least one second avatar among at least one avatar other than the first avatar existing in the first area via the communication line. receiving the second data transmitted from the terminal;
The second data is
position data of the at least one second avatar within the first region and operation data input to the terminal;
the position data is used to determine positions within the first region for displaying a plurality of virtual objects;
determining control data for controlling the display unit to display at least the virtual object on the display unit of the first terminal, based on the second data;
transmitting the control data to the first terminal;
The operation data is
including data relating to messages input to the terminal;
The control data are
Data for controlling the display unit to display on the display unit a first display area for the virtual object and the message positioned around the virtual object based on the position data and the operation data ;
The at least one second avatar is a plurality of second avatars, the plurality of virtual objects includes at least a virtual object corresponding to each of the plurality of second avatars, and a virtual object corresponding to the second avatar. drawing data of the object is less than drawing data of the second avatar;
virtual objects corresponding to each of the plurality of second avatars have substantially the same shape and color;
server. the virtual space is a three-dimensional space,
29. A server according to claim 28 . wherein said communication line comprises the Internet;
30. A server according to claim 28 or claim 29 . the at least one processor;
including a central processing unit (CPU), microprocessor, and/or graphics processing unit (GPU);
The server according to any one of claims 28-30 .

Images