JP7291106B2 - Content delivery system, content delivery method, and content delivery program - Google Patents

Description

One aspect of the present disclosure relates to a content distribution system, a content distribution method, and a content distribution program.

A mechanism is known for switching whether or not to share a virtual space (virtual reality space) with another user according to a user's request. For example, Patent Document 1 discloses an information processing device that alternately switches between a shared mode in which the virtual space is shared with other users and a non-shared mode in which the virtual space is not shared with other users by clicking a switch button. is disclosed.

JP-A-10-105541

In the mechanism disclosed in Patent Document 1, whether or not the virtual space is shared with other users depends on the mode selected by the user. For this reason, for example, a situation in which the behavior of the user's avatar in the virtual space should be hidden from other users (for example, a situation in which the avatar enters a personal identification code or the like that should be kept secret from other users in the virtual space) etc.), if the selection by the user is inappropriate (that is, if the shared mode is set), there is a risk that other users will see the actions of the user's avatar.

Accordingly, one aspect of the present disclosure provides a content distribution system, a content distribution method, and a content distribution program capable of appropriately hiding the actions of a user's avatar in a virtual space from other users depending on the situation. for the purpose.

A content distribution system according to one aspect of the present disclosure is a content distribution system that distributes content representing a virtual space to a plurality of user terminals, and includes at least one processor. At least one processor performs a predetermined specific action of an avatar corresponding to a first user placed in the virtual space, the specific action to be hidden from a second user different from the first user. A specific situation is detected, and when the specific situation is detected, a content image expressing a virtual space in a manner in which the specific action cannot be visually recognized is displayed on the user terminal of the second user.

According to one aspect of the present disclosure, there is provided a content distribution system, a content distribution method, and a content distribution program capable of appropriately hiding actions of a user's avatar in a virtual space from other users depending on the situation. be able to.

It is a figure which shows an example of application of the content distribution system which concerns on embodiment. 2 is a diagram showing an example of a hardware configuration related to the content delivery system of FIG. 1; FIG. 2 is a diagram showing an example of a functional configuration related to the content distribution system of FIG. 1; FIG. 2 is a sequence diagram showing an example of operations of the content delivery system of FIG. 1; FIG. FIG. 4 is a diagram showing an example of a virtual space related to a first content image; FIG. FIG. 10 is a diagram for explaining a second content image related to the first generation process; FIG. FIG. 11 is a diagram for explaining a second content image related to second generation processing; FIG. FIG. 11 is a diagram for explaining a second content image related to third generation processing; FIG.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In the description of the drawings, the same or equivalent elements are denoted by the same reference numerals, and overlapping descriptions are omitted.

[System overview]
A content delivery system according to an embodiment is a computer system that delivers content to a plurality of users. Content is human-perceivable information provided by a computer or computer system. Electronic data representing content is called content data. The content expression format is not limited. Content may be represented by, for example, images (eg, photographs, videos, etc.), documents, sounds, music, or a combination of any two or more of these elements. Content can be used for various aspects of information transfer or communication. The content can be used for various occasions or purposes such as entertainment, news, education, medical care, games, chats, commercial transactions, lectures, seminars, and training. Distribution is the process of transmitting information to users via a communication network or broadcast network.

A content distribution system provides content to users by transmitting content data to user terminals. In this embodiment, as an example, content expressing the same virtual space is provided to each of user terminals of a plurality of users. This makes it possible for a plurality of users to share a common virtual space. Also, in the present embodiment, the content is expressed using at least an image that expresses the virtual space. That is, the content data includes at least a content image representing the content. A content image is an image from which a person can visually recognize some information. A content image may be a moving image (video) or a still image.

In one example, the content image represents a virtual space in which virtual objects exist. A virtual object is an object that does not exist in the real world and is represented only on a computer system. A virtual object is represented by two-dimensional or three-dimensional computer graphics (CG) using image materials independent of actual images. The representation method of the virtual object is not limited. For example, the virtual object may be represented using animation material, or may be represented as realistically based on a photographed image. A virtual space is a virtual two-dimensional or three-dimensional space represented by images displayed on a computer. A content image is, for example, an image showing a landscape seen from a virtual camera set in the virtual space. A virtual camera is set in the virtual space so as to correspond to the line of sight of the user viewing the content image. The content image or virtual space may further include real objects, which are objects that actually exist in the real world.

An example of a virtual object is an avatar that is a user's alter ego. The avatar is represented by two-dimensional or three-dimensional computer graphics (CG) using image materials independent of the original image, rather than the person being photographed. The avatar expression method is not limited. For example, avatars may be represented using animation materials, or may be represented as realistically based on actual images. Note that the position and direction of the virtual camera described above may match the viewpoint and line of sight of the avatar. In this case, the user is provided with a first-person-view content image. Alternatively, the position and orientation of the virtual camera may not match the avatar's viewpoint and line of sight. For example, the virtual camera may be placed in the space behind the avatar, or the like. In this case, the content image of the third person viewpoint is provided to the user. A user can experience augmented reality (AR), virtual reality (VR), or mixed reality (MR) by viewing content images.

In this disclosure, the phrase "transmitting" data or information from a first computer to a second computer means transmitting data or information for eventual delivery to the second computer. That is, the phrase includes cases where another computer or communication device relays the data or information in its transmission.

The purpose and use scene of the content are not limited. As an example in this embodiment, the content provides users with an experience similar to reality in a virtual facility provided in a virtual space shared by a plurality of users. For example, the content may provide the user with an experience of shopping at a shopping facility provided in the virtual space, or provide the user with a game experience (for example, a so-called VR escape game) in the virtual space. may be provided.

[Overall configuration of content distribution system]
FIG. 1 is a diagram showing an example of application of a content distribution system 1 according to an embodiment. In this embodiment, the content distribution system 1 includes a server 10, a plurality of user terminals 20 and 30, and a content database DB.

The server 10 is a computer that distributes content data to the user terminals 20 and 30 . The server 10 is connected via a communication network N to user terminals 20 and 30 and a content database DB. The configuration of the communication network N is not limited. For example, the communication network N may include the Internet, or may include an intranet.

User terminals 20 and 30 are computers used by users who use content. In this embodiment, the user terminals 20 and 30 have a function of capturing a video, a function of accessing the content distribution system 1 to transmit electronic data (video data) representing the video, and a function of transmitting content data from the content distribution system 1. and the ability to receive and display the The types and configurations of the user terminals 20 and 30 are not limited. For example, the user terminals 20 and 30 can be mobile terminals such as high-performance mobile phones (smartphones), tablet terminals, wearable terminals (e.g., head-mounted displays (HMD), smart glasses, etc.), laptop personal computers, and mobile phones. good. Alternatively, the user terminals 20 and 30 may be stationary terminals such as desktop personal computers.

In the present embodiment, the user terminal 20 is the user terminal of one user (first user) of interest among a plurality of users (that is, the user terminal used by the first user), and the user terminal 30 is the first user. It is a user terminal (that is, a user terminal used by the second user) of a user (second user) different from one user. Although FIG. 1 illustrates two user terminals 30, the number of user terminals 30 (that is, the number of second users) is not particularly limited. In this embodiment, as described above, when focusing on a certain user, the user is referred to as the first user and the other users are referred to as the second user for the sake of convenience. Therefore, the user terminal 20 and the user terminal 30 have the same hardware configuration and functional configuration. In other words, each user terminal functions as a user terminal 20 described later in one scene, and functions as a user terminal 30 described later in another scene.

The user can use the content by, for example, operating the user terminals 20 and 30 and logging into the content distribution system 1 . As an example, the user can have various experiences in the virtual space represented by the content via his/her own avatar. In this embodiment, it is assumed that the user of the content distribution system 1 has already logged in.

The content database DB is a non-temporary storage medium or storage device that stores generated content data. The content database DB can be said to be a library of existing content. Content data is stored in the content database DB by any computer such as the server 10, the user terminals 20, 30, or another computer.

The content data is stored in the content database DB after being associated with a content ID that uniquely identifies the content. In one example, content data includes virtual space data, model data, and scenarios.

Virtual space data is electronic data representing a virtual space that constitutes content. For example, the virtual space data may include information indicating the arrangement of individual virtual objects that make up the background, the position of the virtual camera, the position of the virtual light source, or the like.

Model data is electronic data used to define the specifications of virtual objects that make up content. A specification of a virtual object refers to the conventions or methods for controlling the virtual object. For example, the virtual object specification includes at least one of the virtual object's configuration (eg, shape and size), behavior, and audio. The data structure of the avatar model data is not limited and may be arbitrarily designed. For example, the model data may include information on multiple joints and multiple bones that make up the avatar, graphic data indicating the appearance design of the avatar, attributes of the avatar, and an avatar ID that is an identifier of the avatar. Examples of information about joints and bones include the three-dimensional coordinates of individual joints and combinations of adjacent joints (ie, bones). However, the configuration of the information is not limited to these and may be arbitrarily designed. An avatar's attributes are any information set to characterize the avatar, and may include, for example, nominal dimensions, voice quality, or personality.

A scenario is electronic data that defines the behavior of an individual virtual object, virtual camera, or virtual light source over time within a virtual space. It can be said that the scenario is information for determining the story of the content. Behavior of a virtual object is not limited to visually perceptible movement, and may include auditory perceivable sound production.

Content data may include information about real objects. For example, content data may include a photographed image of a real object. If the content data includes a physical object, the scenario may further define when and where the physical object should be displayed.

The installation location of the content database DB is not limited. For example, the content database DB may be provided in a computer system separate from the content distribution system 1 or may be a component of the content distribution system 1 .

[Hardware configuration of content distribution system]
FIG. 2 is a diagram showing an example of a hardware configuration related to the content distribution system 1. As shown in FIG. FIG. 2 shows a server computer 100 functioning as the server 10 and a terminal computer 200 functioning as the user terminal 20 or user terminal 30 .

As an example, the server computer 100 includes a processor 101, a main storage section 102, an auxiliary storage section 103, and a communication section 104 as hardware components.

The processor 101 is a computing device that executes an operating system and application programs. Examples of processors include a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit), but the type of processor 101 is not limited to these. For example, processor 101 may be a combination of sensors and dedicated circuitry. The dedicated circuit may be a programmable circuit such as an FPGA (Field-Programmable Gate Array), or other types of circuits.

The main storage unit 102 is a device that stores a program for realizing the server 10, a calculation result output from the processor 101, and the like. The main storage unit 102 is configured by, for example, ROM (Read Only Memory) or RAM (Random Access Memory).

Auxiliary storage unit 103 is generally a device capable of storing a larger amount of data than main storage unit 102 . The auxiliary storage unit 103 is composed of a non-volatile storage medium such as a hard disk or flash memory. The auxiliary storage unit 103 stores a server program P1 for causing the server computer 100 to function as the server 10 and various data. For example, the auxiliary storage unit 103 may store data relating to at least one of a virtual object such as an avatar and a virtual space. In this embodiment, the content distribution program is implemented as a server program P1.

The communication unit 104 is a device that executes data communication with another computer via the communication network N. FIG. The communication unit 104 is configured by, for example, a network card or a wireless communication module.

Each functional element of the server 10 is realized by causing the processor 101 or the main storage unit 102 to read the server program P1 and causing the processor 101 to execute the server program P1. The server program P1 includes codes for realizing each functional element of the server 10. FIG. The processor 101 operates the communication unit 104 according to the server program P1 to read and write data in the main storage unit 102 or the auxiliary storage unit 103 . Each functional element of the server 10 is implemented by such processing.

The server 10 can be composed of one or more computers. When a plurality of computers are used, one server 10 is logically configured by connecting the plurality of computers to each other via a communication network.

As an example, the terminal computer 200 includes a processor 201, a main storage unit 202, an auxiliary storage unit 203, a communication unit 204, an input interface 205, an output interface 206, and an imaging unit 207 as hardware components.

Processor 201 is a computing device that executes an operating system and application programs. Processor 201 can be, for example, a CPU or GPU, but the type of processor 201 is not limited to these.

The main storage unit 202 is a device that stores programs for realizing the user terminals 20 and 30, calculation results output from the processor 201, and the like. The main storage unit 202 is configured by, for example, ROM or RAM.

Auxiliary storage unit 203 is generally a device capable of storing a larger amount of data than main storage unit 202 . The auxiliary storage unit 203 is configured by a non-volatile storage medium such as a hard disk or flash memory. The auxiliary storage unit 203 stores a client program P2 and various data for causing the terminal computer 200 to function as the user terminals 20 and 30 . For example, the auxiliary storage unit 203 may store data relating to at least one of a virtual object such as an avatar and a virtual space.

The communication unit 204 is a device that performs data communication with another computer via the communication network N. FIG. The communication unit 204 is configured by, for example, a network card or a wireless communication module.

The input interface 205 is a device that receives data based on user's operations or actions. For example, the input interface 205 is composed of at least one of a controller, keyboard, operation buttons, pointing device, microphone, sensor, and camera. A keyboard and operation buttons may be displayed on the touch panel. Since the type of input interface 205 is not limited, the data input to input interface 205 is also not limited. For example, input interface 205 may accept data entered or selected by a keyboard, operating buttons, or pointing device. Alternatively, input interface 205 may accept voice data input by a microphone. Alternatively, the input interface 205 may accept image data (for example, video data or still image data) captured by a camera. Alternatively, the input interface 205 may accept, as motion data, data indicative of a user's non-verbal activity (eg, eye gaze, gestures, facial expressions, etc.) detected by a motion capture function using a sensor or camera.

The output interface 206 is a device that outputs data processed by the terminal computer 200 . For example, the output interface 206 is configured by at least one of a monitor, touch panel, HMD, and speaker. Display devices such as monitors, touch panels, and HMDs display the processed data on their screens. A speaker outputs the sound indicated by the processed audio data.

The imaging unit 207 is a device that captures an image of the real world, and is specifically a camera. The imaging unit 207 may shoot a moving image (video) or may shoot a still image (photograph). When shooting a moving image, the imaging unit 207 acquires a series of frame images arranged in time series as a moving image by processing the video signal based on a given frame rate. The imaging unit 207 can also function as the input interface 205 .

Each functional element of the user terminals 20 and 30 is realized by causing the processor 201 or the main storage unit 202 to read the client program P2 and execute the client program P2. The client program P2 includes code for realizing each functional element of the user terminals 20,30. The processor 201 operates the communication unit 204, the input interface 205, the output interface 206, or the imaging unit 207 according to the client program P2, and reads and writes data in the main storage unit 202 or the auxiliary storage unit 203. FIG. Each functional element of the user terminals 20 and 30 is realized by this process.

At least one of the server program P1 and the client program P2 may be provided after being fixedly recorded on a tangible recording medium such as a CD-ROM, DVD-ROM, semiconductor memory, or the like. Alternatively, at least one of these programs may be provided via a communication network as a data signal superimposed on a carrier wave. These programs may be provided separately or together.

[Functional configuration of content distribution system]
FIG. 3 is a diagram showing an example of a functional configuration related to the content distribution system 1. As shown in FIG. The server 10 includes a receiver 11, a detector 12, a generator, and a transmitter 14 as functional elements.

The receiving unit 11 receives data signals transmitted from the user terminal 20 . The data signal may include at least one of operational information and operational information. Action information is information that defines actions of an avatar (hereinafter simply referred to as “avatar”) corresponding to the first user placed in the virtual space. The operation information is information for instructing the execution of an event (for example, activation of a setting screen, etc.) other than the action of the avatar.

Based on the data signal received from the user terminal 20, the detection unit 12 detects a specific situation in which the avatar performs a specific action. A specific action is a predetermined action that should be hidden from the second user. As an example, the specific action is an action in which the first user inputs information (for example, a personal identification number such as a PIN (Personal Identification Number) code) that is unknown to another user (second user) in the virtual space. (For example, an action of pressing an operation button of a virtual input device arranged in the virtual space with the avatar's finger). The specific situation may include not only the situation in which the specific action is actually being performed, but also the situation in which the specific action is about to be performed (that is, the situation immediately before the specific action is performed).

The generation unit 13 generates content data to be distributed to each user (that is, each user terminal 20, 30) according to the detection result of the detection unit 12. FIG. The content data includes content image data relating to content images to be displayed on the display devices of the user terminals 20 and 30 . Content data may include data other than images (for example, audio). The transmission unit 14 transmits the content data generated by the generation unit 13 to each of the user terminals 20 and 30 .

The user terminal 20 includes an acquisition unit 21, a transmission unit 22, a reception unit 23, and a display control unit 24 as functional elements.

The acquisition unit 21 acquires action information or operation information received by the input interface 205 of the user terminal 20 . The motion information is, for example, the motion data described above. In this case, the motion of the first user in the physical space is reflected in the motion of the avatar in the virtual space. Alternatively, the motion information may be information indicating the content of a predetermined input operation performed by the user on the controller. In this case, the action corresponding to the content of the input operation is reflected as the action of the avatar, and the action of the first user in the physical space is not directly reflected in the action of the avatar. Thus, the motion information that defines the motion of the avatar may reflect the actual motion of the first user, or may not reflect the actual motion of the first user. Examples of operation information include information indicating an operation for causing a virtual object (a non-shared object to be described later) for entering a personal identification number such as the PIN code described above to appear in the virtual space.

The transmission unit 22 transmits the motion information or operation information acquired by the acquisition unit 21 to the server 10 . The receiving unit 23 receives content data including content image data from the server 10 . The display control unit 24 is a functional element that displays content on the display device of the user terminal 20 based on the content data received by the receiving unit 23 .

The user terminal 30 has functional elements similar to those of the user terminal 20, as described above. Note that, in the present embodiment, attention is paid to the processing when the content representing the virtual space including the avatar of the first user is displayed on the user terminal 30 of the second user. Only the receiver 23 and the display controller 24 are shown.

[Operation of content distribution system]
The operation of the content distribution system 1 (more specifically, the operation of the server 10) will be described with reference to FIG. 4, and the content distribution method according to the present embodiment will be described. FIG. 4 is a sequence diagram showing an example of the operation of the content delivery system 1. As shown in FIG.

First, the acquisition unit 21 of the user terminal 20 of the first user acquires input information by the first user. Specifically, the acquisition unit 21 acquires the motion information or operation information described above (step S1). Subsequently, the transmission unit 22 of the user terminal 20 transmits the motion information or operation information acquired by the acquisition unit 21 to the server 10 (step S2). The motion information or operation information is received by the receiving unit 11 of the server 10 .

Subsequently, the generation unit 13 of the server 10 generates first content data based on the action information or operation information acquired by the reception unit 11 (step S3). The first content data includes first content image data. When the motion information is acquired by the receiving unit 11, the generating unit 13 generates first content image data representing a virtual space including an avatar to be moved based on the motion information. Further, when the operation information is acquired by the reception unit 11, the generation unit 13 generates the first content image data expressing the virtual space changed based on the operation information. Note that when the action of the avatar affects a virtual object placed in the virtual space (for example, when a part of the avatar touches another virtual object), the generating unit 13 generates a virtual object generated by the action. Behavior in space (eg, movement or deformation of an avatar or other virtual object, etc.) may be calculated. In this case, the first content image data may include information of the virtual space reflecting the behavior obtained by the calculation (that is, the state of each virtual object reflecting movement, deformation, etc.).

The first content image data relates to a content image representing a virtual space in a manner in which the state of the avatar reflecting the action information of the first user (that is, the action of the avatar corresponding to the action information of the first user) can be visually recognized. Data. The first content image data may be the content image itself or data for generating the content image. In the former case, the first content image data is the content image itself (that is, data after rendering) generated by executing rendering based on information regarding the state of each virtual object (including avatars) in the virtual space. . In the latter case, the first content image data is data (that is, pre-rendering data) that serves as a basis for generating a content image by executing rendering.

FIG. 5 is a diagram showing an example of a virtual space related to the first content image. FIG. 5 exemplifies a scene in which the first user performs shopping (settlement) in the virtual space V via the avatar A corresponding to the first user. In this example, avatar A operates a virtual object 40 imitating a device for entering a personal identification code (PIN code as an example) in order to perform shopping (settlement) in virtual space V. Specifically, when the input button 41 provided on the virtual object 40 is pressed by the action of the hand A1 of the avatar A, information (for example, numbers) corresponding to the pressed input button 41 is input. The first content image is an image representing the virtual space V in which such actions of the avatar A are reflected. That is, when the avatar A's hand A1 is included in the shooting range according to the position and orientation of the virtual camera, the movement of the avatar A's hand A1 is visible in the first content image.

There is no particular problem in that the first content image reflecting the action of Avatar A is provided to the user corresponding to Avatar A (that is, the first user). Rather, the first user sees the first content image in order to accurately perform the input operation of the personal identification code via avatar A. It is necessary to check the movement of the fingers of the On the other hand, there is a security problem if a second user other than the first user sees the movement of the avatar A's fingers (that is, the first user's personal identification code is stolen). Therefore, the server 10 performs the following processing.

As described above, it is preferable that the first user is provided with the first content image in which the action of the avatar A is reflected. Therefore, the server 10 transmits the first content data to the user terminal 20 of the first user. Specifically, the transmission unit 14 transmits the first content data to the user terminal 20 (step S4). The first content data is received by the receiving unit 23 of the user terminal 20 . Then, the display control unit 24 of the user terminal 20 displays the content image on the display device by processing the first content image data included in the first content data (step S5). When rendering is being executed by the server 10 (that is, when the first content image data is the content image itself), the display control unit 24 may display the content image as it is. On the other hand, if the server 10 has not performed rendering, the display control unit 24 may generate and display a content image by performing rendering based on the first content image data.

On the other hand, as exemplified in FIG. 5, in a situation (specific situation) in which an action (specific action) of avatar A to be hidden from the second user is performed in virtual space V, it is difficult to specify avatar A from the viewpoint of security. It is not preferable for the second user to be provided with a content image that reflects the action. Therefore, first, the detection unit 12 of the server 10 detects a specific situation in which the specific action of the avatar A is performed (step S6). Information defining the specific action or the specific situation is stored in advance in a location that can be referenced from the server 10 (for example, the content database DB, the auxiliary storage unit 103, etc.).

If the detection unit 12 detects a specific situation (step S6: YES), the generation unit 13 generates second content including second content image data related to a content image that expresses the virtual space V in a manner in which the specific action cannot be visually recognized. Data is generated (step S7). Then, the transmission unit 14 transmits the second content data to the user terminal 30 of the second user (step S8). The second content data is received by the receiving unit 23 of the user terminal 30 . Then, the display control unit 24 of the user terminal 30 displays the content image on the display device by processing the second content image data included in the second content data (step S10). When rendering is being executed by the server 10 (that is, when the second content image data is the content image itself), the display control unit 24 may display the content image as it is. On the other hand, if the server 10 has not performed rendering, the display control unit 24 may generate and display a content image by performing rendering based on the second content image data. In this way, by providing the user terminal 30 with the second content image in which the specific action of the avatar is expressed in such a manner that it cannot be visually recognized, the content of the specific action can be kept secret from the second user. As a result, it is possible to prevent the confidential information of the first user from leaking to the second user, and to appropriately ensure security in the virtual space.

Note that if the detection unit 12 does not detect the specific situation (step S6: NO), the generation unit 13 generates content data for the second user (that is, data related to the content image in which the specific action is anonymized). does not need to be generated. Therefore, in this case, the process of generating the second content data by the generation unit 13 (step S7) is omitted, and the transmission unit 14 transmits the first content data to the user terminal 30 of the second user (step S9). In this case, in step S10, a content image corresponding to the first content image data is displayed on the display device.

Next, several examples (first to third detection processes) of detection processing by the detection unit 12 in step S6 described above will be described.

(First detection process)
In the first detection process, the specific action is predetermined as an action (operation) for a predetermined specific virtual object (hereinafter referred to as "specific object"). A specific object is a virtual object targeted for a specific action by an avatar. In the example of FIG. 5, when the virtual object 40 is predetermined as the specific object, for example, an input operation on the input button 41 of the virtual object 40 can be predetermined as the specific action. In this case, the detection unit 12 can detect a situation in which the avatar A performs a specific action on the virtual object 40 (here, an input operation on the input button 41) as a specific situation.

For example, based on the position of the specific object placed in the virtual space V and the position of the avatar A in the virtual space V, the detection unit 12 detects whether the avatar is placed within a predetermined distance range from the specific object. It may be possible to detect a state in which the device is present, and detect a specific situation in response to the state being detected. In the example of FIG. 5, the detection unit 12 detects, for example, the position of the virtual object 40 (for example, the position coordinates of the input button 41 in the virtual space V) and the position of the avatar A (for example, the hand position of the avatar A in the virtual space V). The distance d1 from the position coordinates of A1) is calculated. Then, the detection unit 12 compares the distance d1 with a preset threshold Th, and can detect the specific situation when the distance d1 is equal to or less than the threshold Th (or the distance d1 is less than the threshold Th). . In this case, by setting the threshold value Th to a relatively large value, it is possible to detect the specific situation at a point in time before the specific action of the avatar A actually starts.

(Second detection process)
In the second detection process, the specific action is predetermined as an action (operation) with respect to a virtual object (hereinafter referred to as "non-shared object") visible only to the first user. For example, the server 10, in response to receiving operation information regarding a predetermined operation by the first user (for example, a predetermined operation on the controller (input interface 205) of the user terminal 20), transfers the non-shared object to the virtual space. may occur within A non-shared object is an object that is visible only to the first user, and is a virtual object that is controlled not to be displayed in the content image distributed to the second user. Also, the non-shared object is a virtual object that only accepts operations via the first user's avatar.

In the example of FIG. 5, consider the case where the virtual object 40 is a non-shared object generated in the virtual space V triggered by a predetermined operation by the first user. Here, the fact that the virtual object 40, which is the non-shared object to be operated by the avatar A, has occurred in the virtual space V means that the operation (specific action) by the avatar A will be executed on the non-shared object. It means scheduled. Therefore, the detection unit 12 may detect a specific situation when the virtual object 40, which is a non-shared object, is generated in the virtual space V. FIG. In this case as well, the specific situation can be detected before the specific action of avatar A actually starts.

(Third detection process)
In the third detection process, a template that defines a specific action is stored in advance in a location that can be referenced from the server 10 (for example, content database DB, auxiliary storage unit 103, etc.). An example of a template is information indicating a pattern that characterizes the movement of hand A1 of avatar A when performing an operation of inputting a personal identification code. For example, a template corresponding to such an action is information indicating a pattern of actions of hand A1 when avatar A's hand A1 continuously performs actions of pointing to a plurality of different locations with the fingertips of hand A1. The template is not limited to a specific format as long as the similarity to the actual motion of avatar A (that is, the motion information received from the user terminal 20 in step S2) can be calculated. In this case, the detection unit 12 detects motion information defining a specific motion (hereinafter referred to as “specific motion information”) by comparing the motion information acquired in step S2 with the template. Then, the detection unit 12 detects the specific situation in response to detection of the specific action information.

For example, the detection unit 12 calculates the degree of similarity between the motion information and the template acquired in step S2 by predetermined calculation processing. Then, the detection unit 12 determines whether or not the motion information acquired in step S2 corresponds to specific motion information by comparing the degree of similarity with a preset threshold value. Specifically, the detection unit 12 may determine that the motion information acquired in step S2 corresponds to the specific motion information when the degree of similarity is equal to or greater than a threshold (or larger than the threshold). Then, when the specific motion information (that is, the motion information acquired in step S2) is detected in this way, the detection unit 12 can detect the specific situation.

Next, several examples (first to third generation processes) of generation processing by the generation unit 13 in step S7 described above will be described.

(First generation process)
In the first generation process, the generation unit 13 generates second content image data that does not include the specific action information among the action information that defines the action of the avatar A in the virtual space V. FIG. When the second content image data is data before rendering, the second content image data is information that does not include the specific action information acquired in step S2. For example, the generation unit 13 may generate second content image data that does not include specific action information by including information obtained by excluding the specific action information from the action information acquired in step S2 in the second content image data. can. On the other hand, if the second content image data is data after rendering (that is, the content image itself), the second content image data is generated based on information obtained by excluding the specific action information from the action information acquired in step S2. It is a content image that has been processed. For example, the generating unit 13 determines the motion of avatar A based on the motion information obtained in step S2 excluding the specific motion information, and generates a content image in which the motion of avatar A is reflected. , the rendered second content image data that does not include the specific action information can be generated.

In any of the above cases, specific action information is not transmitted from the server 10 to the user terminal 30 . As a result, on the display device of the user terminal 30, a second content image is displayed in which the specific action of Avatar A is not visible (that is, the specific action of Avatar A is not expressed). Become. Further, since the second content image data itself transmitted to the user terminal 30 does not contain the specific action information, the second user can grasp the specific action of the avatar A even if the second content image data is analyzed. It is not possible. That is, not only can the specific action of avatar A not be visually recognized in the second content image displayed on the display device of user terminal 30, but even if the second content image data is analyzed, the specific action of avatar A can be grasped. Can not do it. Therefore, according to the second content image data generated by the first generation process, the secrecy (security) of the specific action is effectively ensured.

Note that the generation unit 13 generates the second content image based on information obtained by excluding all motion information from the time when the specific situation is detected to the time when the specific situation is no longer detected from the action information acquired in step S2. data may be generated. For example, when the above-described first detection process is executed, the generating unit 13 generates an operation (for example, a virtual object to press the input button 41) from when the specific situation is detected to when the specific action is actually performed. The second content image data may be generated after excluding the motion information related to the preliminary motion approaching 40). In this case, not only the specific action of the avatar but also the preliminary action for executing the specific action can be hidden from the second user. Thereby, the secrecy of the specific action can be further enhanced.

FIG. 6 is a diagram for explaining the second content image related to the second content image data generated by the first generation process. Here, as an example, when the detection unit 12 detects that the hand A1 of the avatar A is within the threshold distance range of the input button 41 of the virtual object 40 by the first detection process, the specific situation to detect. Then, the generating unit 13 generates the second content without using the motion information about the motion of the avatar A after the specific situation is detected (that is, the motion of approaching the virtual object 40 and pressing the input button 41 with the hand A1). Generate image data. As a result, the second content image data representing the virtual space V (see FIG. 6) in which the specific motion of the avatar A and the preliminary motion described above cannot be visually recognized is generated. That is, in this example, the second content image does not represent the action of the avatar A after the specific situation is detected. As a result, the second content image (here, when the specific situation is detected, the A picture of Avatar A resting) is provided to the second user. Note that if the virtual object 40 is the non-shared object described above, the virtual object 40 is not displayed in the second content image. When the detection unit 12 executes the second detection process, the generation unit 13 uses avatar motion information from when the non-shared object appears in the virtual space until it disappears from the virtual space. Instead, the second content image data may be generated. Also in this case, as shown in FIG. 6, the second user is provided with an image in which the avatar is stopped at a certain time (here, the time when the non-shared object is generated in the virtual space).

As described above, by providing the second content image in which the avatar A stops when the specific situation is detected to the second user, it is possible to hide the specific action of the avatar A from the second user. . However, since the second user sees the state in which the avatar A is unnaturally stopped, it may give the second user a sense of discomfort and hinder the sense of immersion in the virtual space V. . Therefore, the generation unit 13 may execute the following second generation processing.

(Second generation process)
In the second generation process, the generation unit 13 generates second content image data regarding a content image in which an object that obscures a specific action is arranged. The object is an object that hides at least a part related to a specific action of the avatar. For example, the second content image related to the second content image data is displayed by superimposing a mosaic object on the content image expressing the action of the avatar A based on the action information (including the specific action information) acquired in step S2. obtained by letting In this case, when the detection unit 12 detects the specific situation, the server 10 can display the second content image in which the object that hides the specific action is arranged on the user terminal 30 of the second user. It becomes possible.

FIG. 7 is a diagram for explaining the second content image related to the second content image data generated by the second generation process. In the example of FIG. 7, a substantially circular mosaic object M is superimposed and displayed so as to cover the part (here, the area including the hand A1) related to the specific action of the avatar A. As shown in FIG. In this case, it is possible to provide the second user with a natural image (an image in which the avatar A does not stop unnaturally), and to display the part related to the specific action of the avatar A by the mosaic object M to the second user. can be hidden. However, in the second generation process, since the second content image data includes the action information (including the specific action information) of the avatar A, the content of the specific action is determined by analyzing the second content image data. There is also a possibility that it will be grasped by two users. Therefore, the generation unit 13 may execute the following third generation processing that combines the advantages of the first generation processing and the second generation processing described above.

(Third generation process)
In the third generation process, the generation unit 13 generates second content image data related to a content image representing an avatar performing a dummy action instead of the specific action. The second content data does not include specific action information, like the second content data generated in the first generation process. Specifically, the second content data contains dummy action information indicating a dummy action, instead of the action information actually acquired in step S2. The avatar's dummy action is stored in advance in a location (for example, the content database DB, the auxiliary storage unit 103, etc.) that can be referred to by the server 10, for example. In this case, the server 10 displays, on the user terminal 30 of the second user, a second content image representing an avatar performing a dummy action instead of the specific action when the detection unit 12 detects the specific situation. It is possible to

FIG. 8 is a diagram for explaining the second content image related to the second content image data generated by the third generation process. In the example of FIG. 8, avatar A performs a dummy action (here, avatar A stands still and drinks a drink) instead of the actual action (here, the password input action shown in FIG. 5). expressed. In this case, it is possible to provide a natural image to the second user and to hide the specific action of the avatar A from the second user. Furthermore, since the second content image data does not include the specific action information, the secrecy of the specific action is effectively ensured, similarly to the second content image data generated in the first generation process described above.

[effect]
As described above, the content distribution system according to one aspect of the present disclosure is a content distribution system that distributes content expressing virtual space to a plurality of user terminals, and includes at least one processor. At least one processor performs a predetermined specific action of an avatar corresponding to a first user placed in the virtual space, the specific action to be hidden from a second user different from the first user. A specific situation is detected, and when the specific situation is detected, a content image expressing a virtual space in a manner in which the specific action cannot be visually recognized is displayed on the user terminal of the second user.

A content distribution method according to one aspect of the present disclosure is performed by a content distribution system including at least one processor. The content distribution method is a predetermined specific action of an avatar corresponding to a first user placed in a virtual space, and specifies a specific action to be hidden from a second user different from the first user. detecting a situation; and, when the specific situation is detected, displaying a content image representing a virtual space in a manner in which the specific action cannot be visually recognized on the user terminal of the second user.

A content distribution program according to one aspect of the present disclosure is a predetermined specific action of an avatar corresponding to a first user placed in a virtual space, which is hidden from a second user different from the first user. a step of detecting a specific situation in which the specific action to be performed is performed; and a step of displaying, when the specific situation is detected, a content image representing a virtual space in a manner in which the specific action cannot be visually recognized on the user terminal of the second user. and cause the computer to execute

In this aspect, in response to detection of a specific situation in which a specific action of the avatar to be hidden from the other user (second user) seen from the first user is detected, the specific action cannot be visually recognized. A second user is provided with a content image (the second content image in the above embodiment) that expresses the virtual space in . Thereby, the action of the first user's avatar in the virtual space can be appropriately hidden from other users according to the situation. That is, the second user is provided with the avatar's motions that do not need to be hidden from other users without having the first user set in advance whether to share the avatar's motions with other users. An avatar action (specific action) that must be displayed in the content image provided to the second user and hidden from other users can be prevented from being displayed in the content image provided to the second user.

As in the above embodiment, when the specific action is the action of inputting the confidential information of the first user (for example, the PIN code of a bank, credit card, etc.) in the virtual space, such an action is performed by the second user. Security in the virtual space is properly ensured by keeping it secret.

As another example of the specific action, for example, in a VR escape game, etc., a scene in which the first user answers a question set in the game in a predetermined area in the virtual space (for example, in the virtual space via an avatar). a scene in which an answer is written on a virtual object that imitates a whiteboard placed on the screen, or an answer is presented by an avatar's gestures, etc.). In this case, the response action via the avatar may be predetermined as the specific action. For example, the specific situation may be detected in response to detecting that the avatar has entered an answer area in a predetermined virtual space. According to such a configuration, it is possible to appropriately prevent the first user's answer content from being seen by the second user, and to appropriately ensure entertainment and fairness of the content.

Still another example of the specific action is an action that is inappropriate to be shown to others (for example, an action that poses vulgarly to provoke others). Such an operation may also be predetermined as a specific operation. In this case, inappropriate actions are prevented from being presented to the second user via the first user's avatar. This can prevent the second user from feeling uncomfortable.

In the content distribution system, the at least one processor may not transmit at least the specific action information defining the specific action among the action information defining the action of the avatar in the virtual space to the user terminal of the second user. That is, for example, the first generation process of the above embodiment may be executed. In this case, since the specific action information is not included in the data transmitted to the user terminal of the second user, it is possible to effectively ensure the confidentiality of the specific action.

In the content distribution system, at least one processor controls a predetermined distance range from a specific object based on the position of the specific object placed in the virtual space and the target of the specific action and the position of the avatar in the virtual space. A state in which an avatar is placed within the object may be detected, and a specific situation may be detected in response to the state being detected. That is, for example, the first detection process of the above embodiment may be executed. In this case, the specific situation can be easily detected based on the position of the specific object and the position of the avatar. Also, by setting the distance range (threshold value) to a relatively large value, it is possible to detect the specific situation at a point in time before the specific action of the avatar actually starts. As a result, the entire specific action can be reliably kept secret from the second user.

In the content delivery system, the specific action may include an avatar's operation on a non-shared object that is visible only to the first user and placed in the virtual space. Also, the at least one processor may detect a particular condition in response to the occurrence of a non-shared object within the virtual space. That is, for example, the second detection process of the above embodiment may be executed. In this case, it is possible to easily detect a specific situation according to occurrence of a non-shared object in the virtual space (for example, generation in the virtual space based on the operation of the first user). Moreover, since the specific situation can be detected before the actual operation of the non-shared object is started, the entire specific action can be reliably kept secret from the second user.

In the above-described embodiment (second detection process), the virtual object 40 is a non-shared object. It may be a window or the like that appears in a floating state in front of one user's avatar. Also, the non-shared object is not limited to an object for inputting information to be kept confidential from other users (second users). Even in such a case, the following effects can be obtained by concealing the operation to the non-shared object via the avatar as the specific action from the second user. That is, the motion of the avatar that seems to make an incomprehensible gesture to the empty space (the space in which the non-shared object is arranged as seen from the first user) seen from the second user is performed by the second user. can be hidden against As a result, it is possible to prevent the second user from feeling uncomfortable, and prevent the second user from having a feeling of being immersed in the virtual space being hindered.

In the content distribution system, at least one processor compares the action information defining the action of the avatar acquired by the user terminal of the first user with a template prepared in advance, thereby obtaining the action information defining the specific action. A particular situation may be sensed in response to sensing motion information defining a particular motion. That is, for example, the third detection process of the above embodiment may be executed. In this case, by preparing in advance a template corresponding to the target avatar's action (specific action) to be detected as the specific action, any action of the avatar can be detected as the specific action, and the specific action is performed. It becomes possible to detect the situation as a specific situation.

In the content distribution system, at least one processor may display, on the user terminal of the second user, a content image representing an avatar performing a dummy action instead of the specific action when a specific situation is detected. good. That is, for example, the third generation process of the above embodiment may be executed. In this case, it is possible to provide the second user with a content image that does not give a sense of discomfort while ensuring the secrecy of the specific action.

In the content distribution system, the at least one processor may display, on the user terminal of the second user, a content image in which an object that obscures a specific action is arranged when the specific situation is detected. That is, for example, the second generation process of the above embodiment may be executed. In this case, the confidentiality of the specific action can be ensured by the object that hides the specific action. Note that the aspect of the object that hides the specific action is not limited to the mosaic object M (see FIG. 7) shown in the above embodiment. For example, the shape of the object is not limited to a circle, and may be another shape such as a rectangle. Also, the pattern of the object is not limited to mosaic. For example, the object may be composed of an arbitrary character such as the so-called Nico-chan mark, or an arbitrary object imitating arbitrary decoration such as a star, a heart, or the like.

[Modification]
The present disclosure has been described in detail above based on the embodiments. However, the present disclosure is not limited to the above embodiments. Various modifications can be made to the present disclosure without departing from the gist thereof.

Although the content distribution system 1 is configured using the server 10 in the above embodiment, the content distribution system may be applied to direct distribution between user terminals without using the server 10 . In this case, each functional element of the server 10 may be installed in one of the user terminals, or may be installed separately in a plurality of user terminals. In this regard, the content distribution program may be implemented as a client program. The content distribution system may be configured using a server, or may be configured without using a server.

Also, some of the functions of the server 10 described above may be executed by the user terminals 20 and 30 . For example, the processing of the detection unit 12 of the server 10 may be executed by the user terminal 20 . In this case, the transmitting unit 22 of the user terminal 20 may transmit, to the server 10, motion information from which the specific motion information related to the specific motion of the avatar is excluded. Even with such a configuration, the same effect as that of the content distribution system 1 described above can be achieved.

In the present disclosure, the expression “at least one processor executes the first process, the second process, . . . This is a concept including the case where the executing subject (that is, the processor) of n processes from process 1 to process n changes in the middle. That is, this expression is a concept that includes both the case where all of the n processes are executed by the same processor and the case where the processors are changed according to an arbitrary policy in the n processes.

The processing steps of the method executed by at least one processor are not limited to the examples in the above embodiments. For example, some of the steps (processes) described above may be omitted, or the steps may be performed in a different order. Also, any two or more of the steps described above may be combined, and some of the steps may be modified or deleted. Alternatively, other steps may be performed in addition to the above steps.

DESCRIPTION OF SYMBOLS 1... Content delivery system 10... Server 11... Reception part 12... Detection part 13... Generation part 14... Transmission part 20, 30... User terminal 21... Acquisition part 22... Transmission part 23... Reception Section 24 Display control section 40 Virtual object (specific object, non-shared object) 101 Processor A Avatar DB Content database P1 Server program P2 Client program V Virtual space.

Claims (9)

A content distribution system for distributing content representing a virtual space to a plurality of user terminals,
comprising at least one processor,
The at least one processor
A predetermined specific action of an avatar corresponding to a first user placed in the virtual space, the specific action being an operation of inputting information to be hidden from a second user different from the first user. Detect specific situations in which actions are taken;
displaying a content image representing the virtual space in a manner in which the specific action cannot be visually recognized on the user terminal of the second user when the specific situation is detected;
The at least one processor
A content distribution system that detects, as the specific situation, a situation in which an input operation to input the information to be hidden is performed on a specific object to which the information to be hidden is input in the virtual space. The at least one processor causes the content image in which the object that obscures the specific action is arranged to be displayed on the user terminal of the second user when the specific situation is detected.
The content distribution system according to claim 1. wherein the at least one processor does not transmit specific action information that defines at least the specific action among the action information that defines the action of the avatar in the virtual space to the user terminal of the second user;
The content distribution system according to claim 1. The specific action includes an operation by the avatar on a non-shared object that is visible only to the first user and placed in the virtual space.
The content delivery system according to any one of claims 1 to 3 . The at least one processor detects the specific situation in response to occurrence of the non-shared object within the virtual space.
5. The content distribution system according to claim 4 . The at least one processor
detecting the action information defining the specific action by comparing action information defining the action of the avatar acquired by the user terminal of the first user with a template prepared in advance;
detecting the specific situation in response to detection of the action information defining the specific action;
The content distribution system according to any one of claims 1-4. The at least one processor displays the content image representing the avatar performing a dummy action instead of the specific action on the user terminal of the second user when the specific situation is detected.
The content distribution system according to any one of claims 1-6 . A content distribution method performed by a content distribution system comprising at least one processor, comprising:
A predetermined specific action of an avatar corresponding to a first user placed in a virtual space, the specific action being an operation of inputting information to be hidden from a second user different from the first user. detecting a particular situation in which
displaying a content image representing the virtual space in a manner in which the specific action cannot be visually recognized on the user terminal of the second user when the specific situation is detected;
including
The step of detecting the specific situation includes:
and detecting, as the specific situation, a situation in which an input operation to input the information to be hidden is performed on a specific object to which the information to be hidden is input in the virtual space. . A predetermined specific action of an avatar corresponding to a first user placed in a virtual space, the specific action being an operation of inputting information to be hidden from a second user different from the first user. detecting a particular situation in which
displaying a content image representing the virtual space in a manner in which the specific action cannot be visually recognized on the user terminal of the second user when the specific situation is detected;
on the computer, and
The step of detecting the specific situation includes:
and detecting, as the specific situation, a situation in which an input operation to input the information to be hidden is performed on a specific object to which the information to be hidden is input in the virtual space. .

Images