WO2024029497A1 - 仮想空間提供システム - Google Patents

仮想空間提供システム Download PDF

Info

Publication number
WO2024029497A1
WO2024029497A1 PCT/JP2023/027980 JP2023027980W WO2024029497A1 WO 2024029497 A1 WO2024029497 A1 WO 2024029497A1 JP 2023027980 W JP2023027980 W JP 2023027980W WO 2024029497 A1 WO2024029497 A1 WO 2024029497A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera
virtual space
user
virtual
detection unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2023/027980
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
隆文 山添
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NTT Docomo Inc
Original Assignee
NTT Docomo Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NTT Docomo Inc filed Critical NTT Docomo Inc
Priority to JP2024539145A priority Critical patent/JPWO2024029497A1/ja
Priority to US18/875,944 priority patent/US20250218125A1/en
Publication of WO2024029497A1 publication Critical patent/WO2024029497A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/35—Details of game servers
    • A63F13/355—Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
    • A63F13/525—Changing parameters of virtual cameras
    • A63F13/5252—Changing parameters of virtual cameras using two or more virtual cameras concurrently or sequentially, e.g. automatically switching between fixed virtual cameras when a character changes room or displaying a rear-mirror view in a car-driving game
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00—Digital computers in general; Data processing equipment in general
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/131—Protocols for games, networked simulations or virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/024—Multi-user, collaborative environment

Definitions

  • the present invention relates to a virtual space providing system that outputs images of a virtual space seen from a virtual camera provided in the virtual space to a plurality of terminals.
  • Patent Document 1 describes that player objects are divided into groups, a common virtual camera is arranged for each group, and individual virtual cameras are arranged for player objects that do not belong to the group.
  • an image of the virtual space is generated from a common virtual camera and an individual virtual camera, and the image is provided to a terminal.
  • the virtual space providing system has a very high processing load when generating images to be provided to multiple terminals. It takes a while.
  • the individual virtual camera generates an image of the virtual space seen from the individual virtual camera, and controls the position, orientation, etc. of each individual virtual camera in response to input from the user.
  • a very high processing load will be placed on the virtual space providing system due to the generation of images in the individual virtual cameras and the control of the positions and orientations of the individual virtual cameras.
  • the convenience of users assigned to the common virtual camera is greatly impaired.
  • the common virtual camera is controlled in response to input from multiple users, each user is not necessarily able to visually recognize a desired position and direction in the virtual space.
  • One embodiment of the present invention has been made in view of the above, and provides a virtual space providing system that is capable of suppressing a decrease in user convenience and reducing processing load.
  • the purpose is to
  • a virtual space providing system is a virtual space providing system that outputs images generated based on a virtual space in which a virtual camera is provided to a plurality of terminals. , a detection unit that detects the number of a plurality of terminals; and a detection unit that detects each terminal based on the number of terminals detected by the detection unit, and determines that at least one of the position and direction of each of the terminals corresponds to an operation from the terminal.
  • a first camera which is a virtual camera
  • a second camera which is a virtual camera whose position and direction are independent of operations from the terminal
  • an output unit that outputs the image generated by the generation unit to the terminal based on the association made by the association determination unit.
  • each terminal is associated with either the first camera or the second camera based on the number of multiple terminals. For example, if the number of users using the virtual space is small, a terminal is associated with each first camera. This makes it possible for each user to control the position and direction of the first camera via the terminal, since at least one of the position and direction of the first camera corresponds to the operation from the terminal. Become. As a result, it becomes possible to improve convenience for each user. Further, for example, when the number of users using the virtual space is increasing significantly, a plurality of terminals are associated with the second camera. This makes it possible to stop the user from controlling the virtual cameras and to reduce the number of virtual cameras. As a result, the processing load on the virtual space providing system can be reduced. From the above, it is possible to suppress a decrease in user convenience and to reduce the processing load.
  • FIG. 1 is a block diagram showing a functional configuration of an information processing system including a virtual space providing system according to the present embodiment.
  • FIG. 1 is a diagram showing an example of a virtual space provided by a virtual space providing system.
  • 3 is a diagram showing an example of an image of the virtual space seen from a virtual camera provided in the virtual space of FIG. 2.
  • FIG. 3 is a flowchart showing processing executed by the virtual space providing system according to the embodiment of the present invention.
  • FIG. 1 is a diagram showing the hardware configuration of a server that is a virtual space providing system according to an embodiment of the present invention.
  • FIG. 1 shows a server (virtual space providing system) 10 according to this embodiment.
  • the server 10 is connected to a plurality of clients (terminals) 20 so as to be able to transmit and receive information.
  • the server 10 generates images based on virtual space.
  • the server 10 outputs the generated images to a plurality of clients 20.
  • the image generated by the server 10 is an image of the virtual space viewed from a virtual camera provided in the virtual space (details will be described later).
  • the server 10 is a system for realizing services related to a virtual space in which many users participate.
  • the server 10 is, for example, a system for realizing cloud gaming, virtual live, and the like.
  • a virtual space is, for example, a virtual three-dimensional space shared among multiple users.
  • the virtual space is, for example, a space used for cloud gaming, virtual live performances, and the like.
  • the virtual space in this embodiment is a three-dimensional virtual space. Note that the dimensions of the virtual space need not be three-dimensional.
  • Each user can operate a character in the virtual space via each client 20 as follows. Specifically, first, an object is placed in the virtual space.
  • An object is a structure placed in virtual space.
  • the object is, for example, a human-like character that appears in the 3D game provided by the cloud gaming described above.
  • Objects include, for example, buildings and cars.
  • a user position is set at predetermined coordinates.
  • the user position is a position corresponding to each client 20 in the virtual space.
  • the user position is, for example, a position where a character that is a user's alter ego is placed.
  • the character placed at the user position can move within the virtual space by being controlled based on operation signals input from the client 20.
  • each user can visually recognize the inside of the virtual space via each client 20.
  • a plurality of virtual cameras are arranged in the virtual space.
  • An image of the virtual space viewed from the virtual camera is transmitted to the client 20.
  • the user visually recognizes the inside of the virtual space by viewing the image of the virtual space seen from the virtual camera on the client 20 .
  • the server 10 is configured by, for example, a computer such as a server device.
  • the server 10 may be composed of multiple computers.
  • the server 10 may be configured to have multiple functions as described later, or may be configured by devices for each function.
  • the server 10 and client 20 have a communication function.
  • the server 10 and the client 20 are connected to each other via a communication network so that they can send and receive information to and from each other.
  • the server 10 is, for example, a server that can provide services related to cloud gaming.
  • the server 10 is, for example, a server that has a built-in application (game engine) equipped with a conventional client gaming function.
  • the server 10 manages the virtual space.
  • the server 10 controls each user's position in the virtual space.
  • the server 10 arranges a virtual camera in the virtual space R.
  • the server 10 controls the position and direction of each virtual camera.
  • the server 10 generates a scene captured by the virtual camera in the virtual space as an image of the virtual space as seen from the virtual camera.
  • the server 10 controls the client 20 to display an image of the virtual space seen from the virtual camera.
  • the client 20 is a user's terminal.
  • the client 20 includes a device for outputting images (eg, a display), a device for inputting audio (eg, a microphone), and a device for outputting audio (eg, a speaker).
  • the client 20 is, for example, a personal computer (PC), a smartphone, a tablet terminal, or an XR (Cross Reality) terminal used by a user.
  • the XR terminal is, for example, a terminal such as VR (Virtual Reality) glasses.
  • the client 20 is connected to the server 10 so that it can send and receive information.
  • a communication path is formed between the server 10 and the client 20.
  • the client 20 receives a user's operation to operate at least one of the user's position in the virtual space and the virtual camera.
  • the client 20 transmits an operation signal indicating the accepted user operation to the server 10 via the communication path.
  • the client 20 receives an image of the virtual space from the virtual camera from the server 10 via the communication path, and presents the image to the user.
  • the client 20 receives information indicating sounds in the virtual space from the server 10 via a communication path, and outputs the information to a speaker of the client 20 or the like.
  • the client 20 accepts sound input from a microphone or the like, and transmits sound data based on the received input to the server 10 via the communication path. You may.
  • the server 10 includes a detection section 12, a correspondence determination section 13, and an output section 14.
  • the server 10 executes a process P that is a process for controlling a virtual space, objects in the virtual space, and a virtual camera.
  • the server 10 includes a multiplay processing unit 11 that manages a virtual space and a plurality of rendering units 15.
  • the multiplay processing unit 11 executes processing related to multiplay in the virtual space.
  • the multiplayer processing unit 11 stores in advance data used for rendering the virtual space.
  • the multiplay processing unit 11 generates a virtual space using the stored data. More specifically, when the virtual space is used for a 3D action game, the multiplayer processing unit 11 processes a plurality of objects including the user's character in the virtual space, 3D data such as a map showing the virtual space, etc. (actual data). ) is stored in advance. Further, for example, the multiplay processing unit 11 stores in advance a sound source (sound resource) for generating sound to be output in the virtual space. The multiplay processing unit 11 generates a virtual space using the above-mentioned 3D data.
  • the virtual space is, for example, a virtual space (multiplayer entity) to which a plurality of users connect.
  • the multiplay processing unit 11 executes physical calculations regarding the movement of objects in the virtual space.
  • the multiplay processing unit 11 may arrange a virtual speaker and a virtual microphone in the virtual space.
  • the multiplay processing unit 11 may generate a sound generated from an object in the virtual space, and reproduce the sound on a virtual speaker placed in the virtual space.
  • the multiplay processing unit 11 may acquire sound data from the client 20 and reproduce sound based on the sound data on virtual speakers arranged in a virtual space.
  • the multiplay processing unit 11 may transmit the sound recorded by the virtual microphone in the virtual space to the client 20 as recording data. In this case, the recorded data may be played back on the client 20's speakers.
  • the above-described physical calculations regarding the generation of the virtual space and the movement of objects can be realized by various methods and configurations using known techniques.
  • the multiplay processing unit 11 acquires an operation signal from the client 20 for operating at least one of the user position in the virtual space and the virtual camera.
  • the multiplay processing unit 11 controls the user position in the virtual space based on the operation signal transmitted from the client 20.
  • the multiplay processing unit 11 changes the user position based on the acquired operation signal so that the user position corresponds to the user's operation in real time.
  • the control of the user's position in the virtual space described above can be realized by various methods and configurations using known techniques.
  • the multiplay processing unit 11 arranges two types of virtual cameras, a first camera and a second camera, in the virtual space, and controls the position and direction of each virtual camera.
  • the rendering unit 15 generates an image of the virtual space seen from the virtual camera. In other words, the rendering unit 15 generates an image captured by the virtual camera in the virtual space.
  • the first camera is a virtual camera whose position and/or direction correspond to operations from the client 20 .
  • the second camera is a virtual camera whose position and direction are independent of operations from the client 20.
  • the multiplay processing unit 11 arranges a first camera in the virtual space, and controls at least one of the position and direction of the first camera based on an operation signal input from the client 20. More specifically, when the client 20 is associated with the first camera, the multiplay processing unit 11 newly arranges a first camera in the virtual space corresponding to the user position corresponding to the client 20. The position and direction of the first camera are controlled to follow the movement of the user's position. Such a first camera is a free viewpoint camera. Note that at least one of the position and direction of the first camera may be controlled by the user independently of movement of the user's position. Further, the first camera may be placed in advance in the virtual space. Although the first camera is arranged by the multiplay processing unit 11, the present invention is not limited thereto. The first camera may be placed by an administrator of the server 10, for example. Control of the position and direction of the first camera can be realized by various techniques and configurations using known techniques.
  • the multiplay processing unit 11 arranges the second camera in the virtual space and controls the position and direction of the second camera. More specifically, the multiplay processing unit 11 may arrange the second camera in advance, or may newly arrange the second camera as necessary. The multiplay processing unit 11 controls the position and direction of the second camera independently of operations from the client 20. Such a second camera is, for example, a fixed point camera. Control of the position and direction of the second camera can be achieved by various techniques and configurations using known techniques.
  • the images of the virtual space seen from the first camera and the second camera are the scenes seen from the reference position in the virtual space.
  • the reference position corresponding to the first camera may be, for example, the position of the user's character's eyes or a position around the character in the virtual space.
  • the reference position is the position of the eyes of a character imitating a human (first-person viewpoint).
  • the reference position may be a position overlooking a character imitating a human (third-person viewpoint).
  • the reference position corresponding to the second camera is, for example, fixed in the virtual space and is a position overlooking the user's character in the virtual space.
  • FIG. 2 is a diagram showing a virtual space and a virtual camera placed in the virtual space.
  • the first camera C1 is arranged corresponding to the user position L1 in the virtual space R.
  • FIG. 3(a) is a diagram showing an image of the virtual space R seen from the first camera C1 in FIG.
  • the image of the virtual space R seen from the first camera C1 is a view looking down on the character from the reference position in the virtual space R, with the position preset for the character as the reference position. It's a sight.
  • the second camera C2 is provided in the virtual space R.
  • FIG. 3(b) is a diagram showing an image of the virtual space R viewed from the second camera C2 in FIG.
  • the image viewed from the second camera C2 in the virtual space R includes user positions L2, L3, and L4.
  • the detection unit 12 detects the number of clients 20.
  • the number of clients 20 detected by the detection unit 12 is the number of clients 20 currently connected to the server 10 and using the virtual space. For example, the detection unit 12 detects the number of communication paths established between the clients 20 and the server 10 at the time of detection as the number of clients 20.
  • the detection unit 12 acquires (detects) the user position in the virtual space corresponding to each client 20 from the multiplay processing unit 11 .
  • the detection unit 12 detects a group including multiple clients 20.
  • a group is a group to which multiple users belong.
  • a group is, for example, a party, a team, etc. in a 3D game in which multiple users participate.
  • the party is set in advance by the multiplay processing unit 11, the client 20, or the like.
  • the detection unit 12 detects a group and the clients 20 corresponding to the group by acquiring information indicating the clients 20 corresponding to users belonging to the group from the multiplay processing unit 11. For example, if users form a group in the virtual space, information indicating the group and the client 20 corresponding to the user belonging to the group is stored in the server 10.
  • the detection unit 12 acquires the stored information and detects a group in which the number of users belonging to the group is greater than or equal to a preset number (for example, five) and a client 20 corresponding to the user belonging to the group.
  • a preset number for example, five
  • the minimum value of the number of people in the group detected by the detection unit 12 may be increased as the number of clients 20 increases. In other words, as the number of users of the virtual space increases, the restrictions on the size of the group detected by the detection unit 12 become stricter.
  • the detection unit 12 detects communication between a plurality of users who respectively correspond to a plurality of clients 20, and detects a plurality of clients 20 corresponding to the communication as one group.
  • communication is voice chat.
  • the detection unit 12 acquires information regarding a voice chat in which multiple users participate from another server (not shown) used for the voice chat.
  • the detection unit 12 detects a plurality of clients 20 connected to the voice chat as one group based on the acquired information.
  • communication is a user's utterance in a virtual space. When a user speaks in the virtual space, the detection unit 12 detects a plurality of other user positions located within a predetermined distance from the user position.
  • the detection unit 12 detects a plurality of clients 20 corresponding to the user position and a plurality of other detected user positions as one group. Note that communication may be interaction between users using other means of communication other than voice.
  • the association determining unit 13 Based on the number of clients 20 detected by the detection unit 12, the association determining unit 13 associates each of the clients 20 with either the first camera or the second camera. Specifically, the association determination unit 13 compares the number of clients 20 detected by the detection unit 12 with a preset threshold. The association determining unit 13 associates each of the clients 20 with either the first camera or the second camera based on the comparison result.
  • the association determining unit 13 associates each of the clients 20 with either the first camera or the second camera. You can.
  • the association determination unit 13 associates the clients 20 only with the second camera when the number of clients 20 detected by the detection unit 12 is greater than or equal to a preset threshold.
  • the association determining unit 13 associates a second camera capable of capturing an image of the user position corresponding to the client 20 with the client 20.
  • the identification of the second camera capable of capturing an image at a predetermined position can be realized by various methods and configurations using known techniques. Further, the association determining unit 13 may associate the second camera with the client 20 in a manner other than the above.
  • the association determining unit 13 may associate the second camera closest to the user position corresponding to the client 20 with the client 20.
  • the threshold value may be set in advance, for example, by the administrator of the server 10, or may be set in advance by the server 10 itself in consideration of the processing performance of the server 10.
  • the association determination unit 13 may select the same number of clients 20 detected by the detection unit 12.
  • One camera is prepared, and each first camera is associated with each client 20 one by one.
  • the first camera is a free viewpoint virtual camera that can be operated by the user, and is a virtual camera that can be occupied by one user. That is, in the server 10, if the number of users of the virtual space is sufficient, the virtual camera associated with each user is used as a free viewpoint camera whose position and direction can be manipulated by the user. The position and direction of this virtual camera are controlled in accordance with the user's position.
  • the image of the virtual space viewed from this virtual camera is an image of the virtual space viewed from a first-person viewpoint, an image of the virtual space viewed from a third-person viewpoint, or the like.
  • the number of users using the virtual space increases, and the association determination unit 13 may not be able to prepare first cameras for all users. In this way, when the number of users using the virtual space is equal to or greater than the threshold, the association determining unit 13 associates all the clients 20 with one of the plurality of second cameras as described above.
  • the association determination unit 13 associates one second camera with the plurality of clients 20 included in the group detected by the detection unit 12. Specifically, the association determination unit 13 outputs information indicating a plurality of clients 20 included in the group detected by the detection unit 12 to the multiplay processing unit 11.
  • the multiplay processing unit 11 acquires a plurality of user positions corresponding to the plurality of clients 20 based on information indicating the plurality of clients 20 included in the group, and sets one second camera to correspond to the plurality of user positions. and place it. For example, the multiplay processing unit 11 arranges the second camera so that all of the plurality of user positions are reflected in the image viewed from the second camera in the virtual space.
  • the association determination unit 13 associates the plurality of clients 20 included in the group with the second camera arranged by the multiplay processing unit 11. Note that the above process may be executed with priority over the process based on the number of clients 20 detected by the detection unit 12, but is not limited to this. For example, if the number of clients 20 detected by the detection unit 12 is greater than or equal to a threshold value, the association determination unit 13 may associate the second camera with the group. In this case, convenience for users belonging to the group is improved. Further, for example, the association determination unit 13 may associate the second camera with the group even if the number of clients 20 detected by the detection unit 12 is less than a threshold value. In this case, since a plurality of clients 20 corresponding to a plurality of users are associated with the second camera, the total number of virtual cameras is reduced, and the processing load on the server 10 is reduced.
  • the association determining unit 13 associates the client 20 with the second camera. It is associated with another second camera.
  • the predetermined range is, for example, the range that appears in the image of the virtual space seen from the second camera (individually assigned virtual camera) corresponding to the group.
  • the association determination unit 13 switches the virtual camera corresponding to the client 20 from the second camera (individually assigned virtual camera) corresponding to the group to another second camera.
  • the image that the user views through the client 20 changes from the image of the virtual space seen from the second camera corresponding to the group (second camera's viewpoint) to the image of the virtual space seen from another second camera (separate). (second camera viewpoint).
  • the association determination unit 13 associates one second camera with a plurality of clients 20 included in a group
  • the multiplay processing unit 11 moves the user position corresponding to the clients 20 included in the group.
  • the possible range may be limited to a certain distance (width).
  • the user position may be movable within a range captured in the image of the virtual space seen from the second camera. In this way, the user position corresponding to the client 20 included in the group is assigned a second camera instead of being restricted from movement.
  • the detection unit 12 detects a plurality of clients 20 corresponding to communication as one group
  • the association determining unit 13 allocates the second camera to the plurality of users participating in the communication.
  • the association determination unit 13 Based on the user position of each client 20 detected by the detection unit 12, the association determination unit 13 associates each client 20 with either the first camera or the second camera. Specifically, the association determination unit 13 associates the client 20 corresponding to the user position with either the first camera or the second camera based on the area where the user position exists in the virtual space.
  • the multiplayer processing unit 11 sets an area in the virtual space that is not reflected in the image of the virtual space seen from the second camera as a blind spot area.
  • the association determination unit 13 notifies the multiplay processing unit 11 of this fact.
  • the multiplay processing unit 11 receives the notification, it arranges a first camera capable of capturing an image of the blind spot area in the virtual space.
  • the association determining unit 13 associates the client 20 corresponding to the user position with the first camera.
  • the blind spot area may be set in advance, for example, by the administrator of the server 10, or may be set by another method other than the above.
  • determination of an area in the virtual space that is not visible in the image of the virtual space seen from the second camera can be realized by various methods and configurations using known techniques. Further, the above process may be performed with priority over a process based on a threshold value regarding the number of clients 20 detected by the detection unit 12. For example, when the number of clients 20 detected by the detection unit 12 is equal to or greater than a threshold value, the association determination unit 13 detects the client 20 corresponding to the user position existing in the blind spot area using a first camera that can image the blind spot area. It may also be associated with In this case, it is possible to maintain a state in which the user position corresponding to the client 20 is reflected in the image sent to the client 20, thereby improving convenience for the user.
  • the administrator of the server 10 or the like fixes the position of the first camera in the virtual space in advance, and arranges only the direction of the first camera so that the user can operate it.
  • the association determination unit 13 associates the client 20 corresponding to the user position with the first camera.
  • the administrator of the server 10 or the like places a telescope in the virtual space in advance. In this case, when the detection unit 12 detects a user position that has approached the telescope by a predetermined distance, the association determination unit 13 associates the client 20 corresponding to the user position with the telescope.
  • the above process may be executed in priority to the process based on the number of clients 20 detected by the detection unit 12, but is not limited to this.
  • the number of user positions that can be approached up to a predetermined distance may be limited based on the number of clients detected by the detection unit 12 by the restriction unit 11a, which will be described later.
  • the above-mentioned telescope is a telescope that can be used by only one person at the same time.
  • the association determining unit 13 associates the first camera with the client 20 corresponding to the user position existing in a certain area set in advance in the virtual space, and also associates the first camera with the client 20 corresponding to the user position existing in a certain area set in advance.
  • the second camera is associated with the client 20 corresponding to the second camera. For example, if the virtual space is a VR concert venue or stadium where a large number of users participate, many users gather in front of the stage in the live venue to watch the live performance performed on the stage. There are many things.
  • the association determining unit 13 sends a message to the client 20 corresponding to the user position that can be shared by a large number of people.
  • Associate two cameras fixed point cameras). The second camera is provided at a position where it can image the stage.
  • the detection unit 12 detects the user position in an area where users do not gather (an area that is not crowded) such as an area away from the stage (a place behind a live venue)
  • the association determination unit 13 determines whether the user A first camera (free viewpoint camera) is associated with the client 20 corresponding to the position.
  • an area for associating a first camera with the client 20 corresponding to the user's position (hereinafter referred to as the area for associating the first camera) and an area for associating the second camera with the client 20 corresponding to the user's position (hereinafter referred to as the area for associating the second camera) may be set based on the number of clients 20 (number of participants) detected by the detection unit 12. For example, the larger the number of clients 20, the wider the area to which the second camera is associated may be set. The smaller the number of clients 20, the wider the area to which the first camera is associated may be set. That is, the range of free viewpoints (free angles) may be controlled depending on the number of participants.
  • the restriction unit 11a of the multiplay processing unit 11 limits the number of user positions located in a predetermined area in the virtual space to a predetermined number or less based on the number of clients 20 detected by the detection unit 12. . Specifically, when the number of users using the virtual space (number of users) is equal to or greater than a predetermined threshold, the restriction unit 11a limits the number of user positions located in a predetermined area in the virtual space.
  • the restriction unit 11a limits the number of user positions that can simultaneously exist in a predetermined area included in the virtual space to a predetermined number or less.
  • the restriction unit 11a presets a predetermined area in which the number of characters (hereinafter referred to as PC (Player Character)) operated by the user is restricted.
  • PC Player Character
  • the restriction unit 11a controls other PCs to access the area when the number of PCs located in the area reaches a predetermined number. prevent the entry of At this time, the restriction unit 11a prevents the PC from entering in a manner that does not make the user feel uncomfortable (in a natural manner).
  • the restriction unit 11a arranges an object and an NPC (Non Player Character) at the entrance of the area.
  • the restriction unit 11a may set objects and NPCs so that the PC cannot pass through the entrance of a predetermined area, or may set the PC to be able to escape from a predetermined area but not be able to enter the predetermined area.
  • Objects and NPCs may be set like this.
  • the threshold value may be set in advance, for example, by the administrator of the server 10, or may be set in advance by the server 10 itself in consideration of the processing performance of the server 10.
  • the predetermined area may be, for example, the blind spot area mentioned above, or the area where the first camera is placed in advance (the area around the telescope mentioned above).
  • the predetermined number may be set in advance by the restriction unit 11a, or may be set in advance by the administrator of the server 10 or the like. For example, if the area is a blind spot area or an area where the first camera is placed, the predetermined number may be set in consideration of the number of clients 20, the processing capacity of the server 10, and the like. For example, if the area is the blind spot area described above, the predetermined number is set to 10, thereby setting the number of PCs that can simultaneously exist (intrude) in the blind spot area to 10 people.
  • the number of PCs that can simultaneously exist in the blind spot area may be set to five by setting the predetermined number to five.
  • the number of first cameras arranged corresponding to the character located in the blind spot area decreases, making it possible to reduce the processing load on the server 10. .
  • the plurality of rendering units (generation units) 15 generate images of the virtual space viewed from at least one of the first camera and the second camera. Specifically, a plurality of rendering units 15 are provided for each virtual camera in process P. When a virtual camera is newly placed, a new rendering unit 15 is provided in process P. Each rendering unit 15 renders and generates an image of the virtual space seen from a first camera or a second camera arranged in the virtual space (performs internal rendering processing). Each rendering unit 15 outputs the generated image and information indicating the virtual camera corresponding to itself to the output unit 14. Note that the process of rendering the image of the virtual space seen from the virtual camera described above can be realized by various methods and configurations using known techniques.
  • Each rendering unit 15 may generate an image by lowering the quality of the image of the virtual space seen from the first camera based on the number of clients 20 detected by the detection unit 12. Specifically, each rendering unit 15 may lower the quality of the image of the virtual space seen from the first camera when the number of clients 20 detected by the detection unit 12 is equal to or greater than a threshold value. For example, when the user position exists in the blind spot area of the second camera, the association determination unit 13 arranges the first camera that can image the blind spot area, and controls the first camera in association with the client 20 . At this time, if the number of clients 20 detected by the detection unit 12 is greater than or equal to the threshold (when the number of users increases), the processing load on the server 10 will become too large.
  • each rendering unit 15 may reduce the quality of the image of the virtual space (the quality of free-angle drawing processing) seen from the first camera arranged in the virtual space. This reduces the processing load on the server 10. As a result, it becomes possible for more users to use the virtual space (multiple user use of the virtual space).
  • each rendering unit 15 may generate an image by lowering the quality of the image of the virtual space seen from the first camera that can image the blind spot area.
  • the threshold value may be set in advance, for example, by the administrator of the server 10, or may be set in advance by the server 10 itself in consideration of the processing performance of the server 10. Further, the processing in the rendering unit 15 described above may be executed by another server 10 outside the server 10 (or may be processed by cloud rendering).
  • the output unit 14 outputs the images generated by each rendering unit 15 to the client 20 based on the association made by the association determination unit 13. Specifically, the output unit 14 acquires the image generated by the rendering unit 15. The output unit 14 acquires information indicating the virtual camera corresponding to each rendering unit 15 from the association determination unit 13. The output unit 14 transmits the image to the client 20 that has been associated with the virtual camera by the association determination unit 13.
  • the output unit 14 is, for example, a function of WebRTC (Web Real-Time Communication).
  • WebRTC Web Real-Time Communication
  • the rendering unit 15 generates an image of the virtual space R viewed from the first camera C1, and the output unit 14 detects the generated image by the detection unit
  • the user position L1 is transmitted to the client 20 corresponding to the user position L1.
  • the rendering unit 15 generates an image of the virtual space R viewed from the second camera C2, and the output unit 14 outputs the generated image corresponding to the user positions L2, L3, and L4 detected by the detection unit 12.
  • the information is transmitted to the respective clients 20 that are to be used.
  • the client 20 connects to the server 10.
  • the server 10 prepares the same number of first cameras as the number of clients 20.
  • An image of the virtual space seen from each first camera is assigned to each user using each client 20. At this time, each user occupies each first camera.
  • the server 10 If the number of clients 20 (users of the virtual space) connecting to the server 10 increases and the first camera, which is occupied by one user, cannot be prepared for all users, the server 10, for example, The virtual camera associated with the client 20 used by the user is switched from the first camera to the second camera. That is, the server 10 switches the image sent to the client 20 from the image of the virtual space seen from the first camera (free viewpoint camera display) to the image of the virtual space seen from the second camera (fixed point camera display).
  • the association determination unit 13 associates each of the clients 20 with either the first camera or the second camera based on the number of clients 20 detected by the detection unit 12 (S02).
  • each rendering unit 15 generates an image of the virtual space viewed from at least one of the first camera and the second camera (S03).
  • the output unit 14 outputs the images generated by each rendering unit 15 to the client 20 based on the association made by the association determination unit 13 (S04).
  • a very high processing load will be placed on the virtual space providing system when generating images to be provided to multiple clients.
  • a virtual camera operated by a user generates an image of the virtual space seen from the virtual camera, and controls the position, orientation, etc. of each virtual camera in response to input from the user.
  • a very high processing load will be required to provide the virtual space due to the generation of images in each virtual camera and the control of the position and orientation of the virtual camera operated by the user. It depends on the system.
  • the convenience of a user assigned to a virtual camera shared among multiple users is greatly impaired.
  • the virtual camera is controlled in response to inputs from multiple users, each user is not necessarily able to visually recognize a desired position and direction in the virtual space.
  • each client 20 is associated with either the first camera or the second camera based on the number of multiple clients 20. For example, if the number of users using the virtual space is small, each first camera is associated with the client 20. As a result, at least one of the position and direction of the first camera corresponds to the operation from the client 20, so each user can control the position and direction of the first camera via the client 20. It becomes possible. As a result, it becomes possible to improve convenience for each user. Further, for example, when the number of users using the virtual space is significantly increasing, a plurality of clients 20 are associated with the second camera. This makes it possible to stop the user from controlling the virtual cameras and to reduce the number of virtual cameras. As a result, the processing load on the server 10 can be reduced. From the above, it is possible to suppress a decrease in user convenience, and it is also possible to reduce the processing load on the server 10.
  • the association determining unit 13 compares the number of clients 20 detected by the detecting unit 12 with a preset threshold, and selects each of the clients 20 based on the comparison result. , may be associated with either the first camera or the second camera. According to this configuration, each client 20 is associated with either the first camera or the second camera based on whether the number of multiple clients 20 is equal to or greater than the threshold value. For example, when the number of multiple clients 20 is less than or equal to a threshold value, multiple clients 20 are associated with the first camera. This allows each user to control the position and direction of the first camera via the client 20 if there is enough processing load on the server 10, thereby improving convenience for each user. becomes possible.
  • multiple clients 20 are associated with the second camera. This makes it possible to cancel the user's control of the virtual cameras and to reduce the number of virtual cameras when the processing load on the server 10 is insufficient.
  • the association of clients 20 with either the first camera or the second camera does not necessarily need to be performed based on the comparison result between the number of clients 20 and a threshold value.
  • the detection unit 12 detects the user positions corresponding to the respective clients 20 in the virtual space
  • the association determination unit 13 detects the user positions of the respective clients 20 detected by the detection unit 12. Based on this, each of the clients 20 may be associated with either the first camera or the second camera. This makes it possible to associate each of the clients 20 corresponding to the user's position with either the first camera or the second camera, taking into consideration the characteristics of each place where the user's position exists in the virtual space.
  • the association determination unit 13 associates the client 20 corresponding to the user position with a first camera that can image the blind spot area. You can.
  • the association determination unit 13 when the detection unit 12 detects that the user position operated by the client 20 associated with the second camera has moved to the blind spot area of the second camera, the association determination unit 13 In addition, the virtual camera associated with the client 20 can be switched from the second camera to the first camera that can image the blind spot area. As a result, it is possible to maintain a state in which the user's position is reflected in the image presented to the user on the client 20, so it is possible to maintain user convenience.
  • the association determination unit 13 may move the client 20 corresponding to the user position to the first camera. It may also be associated with Thereby, when the detection unit 12 detects that the user position corresponding to the second camera approaches the place where the first camera is placed in advance, the association determining unit 13 determines that the user position corresponding to the user position 20 can be associated with the first camera. For example, when the detection unit 12 detects that the user position approaches a predetermined location, the association determination unit 13 determines the virtual space as seen from the free viewpoint camera from the image seen from the fixed point camera. It becomes possible to switch the image to be sent to the client 20.
  • the administrator of the server 10 wishes to provide the user with the image seen from the free viewpoint camera at a predetermined location in the area (within the fixed point camera area) that appears in the image of the virtual space seen from the fixed point camera. Furthermore, it becomes possible to provide an image seen from the free-angle camera to a user who approaches the predetermined location (the server 10 sends an instruction to switch the free-angle viewpoint to the client 20).
  • the association determination unit 13 associates the first camera with the client 20 corresponding to the user position detected by the detection unit 12 to exist in a certain area in the virtual space, and
  • the second camera may be associated with the client 20 corresponding to the user position detected by the detection unit 12 as being present in the client 20 .
  • the user views the virtual space from a first-person perspective in an area with a large number of user positions (an area with too many people), movement of the virtual camera and viewing of the virtual space will be obstructed by other user positions. Therefore, the operability of the virtual camera and the visibility of the virtual space are not good for the user.
  • the first camera is associated with the client 20 corresponding to the user position detected by the detection unit 12 as existing in an area with a small number of user positions
  • the first camera is associated with the client 20 corresponding to the user position existing in an area with a large number of user positions.
  • the second camera is associated with the client 20 corresponding to the user position detected by the detection unit 12.
  • the user can view the user position in the virtual space from above by viewing the image of the virtual space seen from the second camera, which is a fixed point camera.
  • visibility of the virtual space on the user's client 20 can be maintained.
  • the user views the virtual space from a third-person viewpoint, movement of the virtual camera is also prevented from being obstructed by other user positions. As a result, it is expected that the user will not feel uncomfortable controlling the virtual camera.
  • the user can visually recognize the desired position and direction in the virtual space. As a result, it is possible to improve the convenience of the user viewing the virtual space.
  • the user's position in the virtual space may be used for communication with other users (other visitors), participation in a sub-event (experiencing a sub-event) that is different from the main event in the virtual space, etc.
  • the user position is associated with the client 20 corresponding to the user position according to the area where the user position detected by the detection unit 12 exists.
  • the virtual camera that is displayed is switched as described above. As a result, it is possible to reduce (control) the processing load on the server 10 in the entire virtual space (total), and to realize a situation in which a large number of people can use the same virtual space.
  • the association of the client 20 with either the first camera or the second camera does not necessarily need to be performed based on the user position.
  • the restriction unit 11a may limit the number of user positions located in a predetermined area in the virtual space to a predetermined number or less based on the number of clients 20 detected by the detection unit 12. good. This makes it possible to limit the number of user positions located in areas where the load is placed on the server 10, based on the number of clients 20. For example, when the detection unit 12 detects that the user position exists in the blind spot area of the second camera, the processing load on the server 10 increases because the first camera is associated with the user position. Here, if the number of clients 20 detected by the detection unit 12 is greater than or equal to a predetermined threshold, there is a possibility that the processing load on the server 10 will exceed the limit.
  • the rendering unit 15 may generate an image by lowering the quality of the image of the virtual space seen from the first camera based on the number of clients 20 detected by the detection unit 12.
  • an image can be generated by lowering the quality of the image of the virtual space seen from the first camera. I can do it.
  • the quality of the image of the virtual space seen from the first camera does not necessarily need to be set based on the number of clients 20 detected by the detection unit 12.
  • the detection unit 12 detects a group including a plurality of clients 20, and the association determination unit 13 assigns one Two cameras may be associated. This reduces the total number of virtual cameras compared to the case where each client 20 is associated with one first camera, so the processing load on the server 10 is reduced. Further, since the first camera can be newly placed in the virtual space by the reduced processing load on the server 10, it is possible to maximize the number of people who can use the first camera at the same time. Furthermore, since other users who are related to the user are included in images sent to the client 20 corresponding to the user with priority over other users who are not related to the user, convenience for the user who uses the client 20 is improved. will improve.
  • the user positions of other users who belong to the same group as the user are prioritized over other users who do not belong to the group. and included.
  • convenience for the user who uses the client 20 that receives the image is improved.
  • the detection unit 12 may detect communication between a plurality of users who respectively correspond to a plurality of clients 20, and may detect the plurality of clients 20 corresponding to the communication as one group. For example, when the detection unit 12 detects communication such as voice chat between multiple people, one second camera is assigned to the member who is communicating. According to this configuration, multiple clients 20 participating in one communication are associated with one second camera, and images of the virtual space viewed from the second camera are transmitted to the multiple clients 20. As a result, the images sent to each client 20 include the user positions of other users who participate in communication together with the user using each client 20. As a result, convenience for users who use each client 20 is improved.
  • multiple clients 20 can be associated with one second camera.
  • images can be rendered for multiple clients 20 by one process. This makes it possible to share the physical calculation of the movement of an object in the virtual space and the generation of an image of the virtual space as seen from the virtual camera between the users' clients 20 . As a result, the processing load on the client 20 can be reduced.
  • a plurality of rendering units 15 are provided in one process P.
  • the processing in the multiplay processing section 11 can be shared among the plurality of rendering sections 15.
  • the virtual space providing system is configured by one server 10 having one process P, but the present invention is not limited to this.
  • the virtual space providing system may be configured by a plurality of servers 10.
  • one virtual space is divided into a plurality of parts, and each of the plurality of servers 10 is associated with one of the plurality of parts (the plurality of virtual spaces) of the virtual space.
  • Each server 10 executes a plurality of processes P for managing the plurality of parts, respectively.
  • Each multiplay processing unit 11 in one server 10 maintains processing consistency between each process P. Further, a multiplay processing server is provided between each server 10. The multiplay processing server maintains processing consistency between processes P of different servers 10.
  • an upper level server may be provided to maintain processing consistency among the multiplay processing servers.
  • the virtual space may be managed by multiple processes, multiple servers, and higher-level servers. As a result, more users can participate in the virtual space, and even if the scale of the virtual space increases, complex communication expressions, physical calculations, etc. can be processed in real time in each process P.
  • the multiplay processing unit 11 of each process P may function as a server or a client for multiplay in a local environment.
  • the server 10 may include multiple servers.
  • the server 10 may include a main server including a multiplay processing unit 11, a detection unit 12, a correspondence determination unit 13, and a rendering unit 15, and a relay server including an output unit 14.
  • the relay server is a server that relays communication between the main server and multiple clients 20.
  • the relay server is, for example, an SFU (Selective Forwarding Unit).
  • SFU Selective Forwarding Unit
  • the association determination unit 13 instructs the client 20 via the relay server about the virtual camera to be associated with the client 20.
  • the client 20 requests the relay server for an image of the virtual space seen from the designated virtual camera.
  • the output unit 14 of the relay server transmits the image requested by the client 20 to the client 20.
  • the multiplay processing unit 11 is provided in the same process P as the plurality of rendering units 15, but it is sufficient if the processing in the multiplay processing unit 11 is shared among the plurality of rendering units 15. .
  • the multiplay processing unit 11 may be provided in a separate process from the plurality of rendering units 15.
  • the association determination unit 13 may associate the first camera with the client 20 even when the number of clients 20 detected by the detection unit 12 is equal to or greater than a threshold value. For example, when the number of clients 20 detected by the detection unit 12 is equal to or greater than a threshold, the association determination unit 13 determines whether the number of clients 20 detected by the detection unit 12 is equal to is less than or equal to a preset threshold value), the first camera may be associated with a preset number of clients 20. Thereby, it is possible to improve convenience for each user while considering the processing load of the server 10.
  • the association determination unit 13 may associate the first camera with the client 20 of the user who has paid a fee to the provider of the service using the virtual space.
  • the association determining unit 13 may associate the second camera with the client 20 of the user who does not pay the fee.
  • a user may be able to use a free-viewpoint (free-angle) camera for a fee, and may also be able to use a fixed-point camera for free.
  • the server 10 may include a first camera (free angle) server provided with the rendering unit 15. In this case, the rendering unit 15 of the server for the first camera generates an image of the virtual space seen from the first camera associated with the client 20 of the user who paid the fee.
  • the association determining unit 13 may associate the first camera with the client 20 of the user who has paid something other than the fee. For example, when a user uses a service, points linked to the user's account may be accumulated. In this case, the association determining unit 13 may associate the first camera with the client 20 of the user who has paid the points to the service provider.
  • the virtual space providing system of the present disclosure has the following configuration.
  • a virtual space providing system that outputs images generated based on a virtual space in which a virtual camera is provided to a plurality of terminals, a detection unit that detects the number of the plurality of terminals; a first camera that is the virtual camera whose position and/or direction of each of the terminals corresponds to an operation from the terminal, based on the number of the terminals detected by the detection unit; an association determination unit that associates the second camera with the virtual camera whose position and direction are independent of operations from the terminal; a generation unit that generates the image of the virtual space viewed from at least one of the first camera and the second camera;
  • a virtual space providing system comprising: an output section that outputs the image generated by the generation section to the terminal based on the association made by the association determination section.
  • the association determination unit compares the number of the terminals detected by the detection unit with a preset threshold, and based on the comparison result, assigns each of the terminals to the first camera. and the virtual space providing system according to [1], which is associated with either of the second cameras.
  • the detection unit detects a user position that is a position corresponding to each of the terminals in the virtual space, The association determination unit associates each of the terminals with either the first camera or the second camera based on the user position of each of the terminals detected by the detection unit [1] or [ 2].
  • each functional block may be realized using one physically or logically coupled device, or may be realized using two or more physically or logically separated devices directly or indirectly (e.g. , wired, wireless, etc.) and may be realized using a plurality of these devices.
  • the functional block may be realized by combining software with the one device or the plurality of devices.
  • Functions include judgment, decision, judgment, calculation, calculation, processing, derivation, investigation, exploration, confirmation, reception, transmission, output, access, resolution, selection, selection, establishment, comparison, assumption, expectation, consideration, These include, but are not limited to, broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocating, mapping, and assigning. I can't.
  • a functional block (configuration unit) that performs transmission is called a transmitting unit or transmitter. In either case, as described above, the implementation method is not particularly limited.
  • the server 10 in an embodiment of the present disclosure may function as a computer that processes the wireless communication method of the present disclosure.
  • FIG. 5 is a diagram illustrating an example of the hardware configuration of the server 10 according to an embodiment of the present disclosure.
  • the server 10 described above may be physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, and the like.
  • the client 20 may have a similar configuration to the hardware described here.
  • the word “apparatus” can be read as a circuit, a device, a unit, etc.
  • the hardware configuration of the server 10 may include one or more of the devices shown in the figure, or may not include some of the devices.
  • Each function in the server 10 is performed by loading predetermined software (programs) onto hardware such as the processor 1001 and the memory 1002, so that the processor 1001 performs calculations, controls communication by the communication device 1004, and controls the memory 1002 and the memory 1002. This is realized by controlling at least one of reading and writing data in the storage 1003.
  • the processor 1001 operates an operating system to control the entire computer.
  • the processor 1001 may be configured by a central processing unit (CPU) including an interface with peripheral devices, a control device, an arithmetic unit, registers, and the like.
  • CPU central processing unit
  • each function in the server 10 may be realized by the processor 1001.
  • the processor 1001 may include a GPU (Graphics Processing Unit).
  • the rendering unit 15 shown in FIG. 1 may be implemented by the processor 1001.
  • the processor 1001 reads programs (program codes), software modules, data, etc. from at least one of the storage 1003 and the communication device 1004 to the memory 1002, and executes various processes in accordance with these.
  • programs program codes
  • software modules software modules
  • data etc.
  • the program a program that causes a computer to execute at least part of the operations described in the above embodiments is used.
  • each function in the server 10 may be realized by a control program stored in the memory 1002 and operated in the processor 1001, and may be realized in the same way with other functional blocks.
  • Processor 1001 may be implemented by one or more chips. Note that the program may be transmitted from a network via a telecommunications line.
  • the memory 1002 is a computer-readable recording medium, and includes at least one of ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), RAM (Random Access Memory), etc. may be done.
  • Memory 1002 may be called a register, cache, main memory, or the like.
  • the memory 1002 can store executable programs (program codes), software modules, and the like to implement a wireless communication method according to an embodiment of the present disclosure.
  • the storage 1003 is a computer-readable recording medium, such as an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, a magneto-optical disk (such as a compact disk, a digital versatile disk, or a Blu-ray disk). (registered trademark disk), smart card, flash memory (eg, card, stick, key drive), floppy disk, magnetic strip, etc.
  • Storage 1003 may also be called an auxiliary storage device.
  • the storage medium included in the server 10 may be, for example, a database including at least one of the memory 1002 and the storage 1003, a server, or other appropriate medium.
  • the communication device 1004 is hardware (transmission/reception device) for communicating between computers via at least one of a wired network and a wireless network, and is also referred to as, for example, a network device, network controller, network card, communication module, etc.
  • the input device 1005 is an input device (eg, keyboard, mouse, microphone, switch, button, sensor, etc.) that accepts input from the outside.
  • the output device 1006 is an output device (for example, a display, a speaker, an LED lamp, etc.) that performs output to the outside. Note that the input device 1005 and the output device 1006 may have an integrated configuration (for example, a touch panel).
  • each device such as the processor 1001 and the memory 1002 is connected by a bus 1007 for communicating information.
  • the bus 1007 may be configured using a single bus, or may be configured using different buses for each device.
  • the server 10 also includes hardware such as a microprocessor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), and a field programmable gate array (FPGA).
  • DSP digital signal processor
  • ASIC application specific integrated circuit
  • PLD programmable logic device
  • FPGA field programmable gate array
  • the input/output information may be stored in a specific location (for example, memory) or may be managed using a management table. Information etc. to be input/output may be overwritten, updated, or additionally written. The output information etc. may be deleted. The input information etc. may be transmitted to other devices.
  • Judgment may be made using a value expressed by 1 bit (0 or 1), a truth value (Boolean: true or false), or a comparison of numerical values (for example, a predetermined value). (comparison with a value).
  • notification of prescribed information is not limited to being done explicitly, but may also be done implicitly (for example, not notifying the prescribed information). Good too.
  • Software includes instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, whether referred to as software, firmware, middleware, microcode, hardware description language, or by any other name. , should be broadly construed to mean an application, software application, software package, routine, subroutine, object, executable, thread of execution, procedure, function, etc.
  • software, instructions, information, etc. may be sent and received via a transmission medium.
  • a transmission medium For example, if the software uses wired technology (coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), etc.) and/or wireless technology (infrared, microwave, etc.) to create a website, When transmitted from a server or other remote source, these wired and/or wireless technologies are included within the definition of transmission medium.
  • wired technology coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), etc.
  • wireless technology infrared, microwave, etc.
  • system and “network” are used interchangeably.
  • information, parameters, etc. described in this disclosure may be expressed using absolute values, relative values from a predetermined value, or using other corresponding information. may be expressed.
  • determining may encompass a wide variety of operations.
  • “Judgment” and “decision” include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, search, and inquiry. (e.g., searching in a table, database, or other data structure), and regarding an ascertaining as a “judgment” or “decision.”
  • judgment and “decision” refer to receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, and access.
  • (accessing) may include considering something as a “judgment” or “decision.”
  • judgment and “decision” refer to resolving, selecting, choosing, establishing, comparing, etc. as “judgment” and “decision”. may be included.
  • judgment and “decision” may include regarding some action as having been “judged” or “determined.”
  • judgment (decision) may be read as “assuming", “expecting", “considering”, etc.
  • connection refers to any connection or coupling, direct or indirect, between two or more elements and to each other. It may include the presence of one or more intermediate elements between two elements that are “connected” or “coupled.”
  • the bonds or connections between elements may be physical, logical, or a combination thereof. For example, "connection” may be read as "access.”
  • two elements may include one or more electrical wires, cables, and/or printed electrical connections, as well as in the radio frequency domain, as some non-limiting and non-inclusive examples. , electromagnetic energy having wavelengths in the microwave and optical (both visible and non-visible) ranges, and the like.
  • the phrase “based on” does not mean “based solely on” unless explicitly stated otherwise. In other words, the phrase “based on” means both “based only on” and “based at least on.”
  • any reference to elements using the designations "first,” “second,” etc. does not generally limit the amount or order of those elements. These designations may be used in this disclosure as a convenient way to distinguish between two or more elements. Thus, reference to a first and second element does not imply that only two elements may be employed or that the first element must precede the second element in any way.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Information Transfer Between Computers (AREA)
  • Processing Or Creating Images (AREA)
PCT/JP2023/027980 2022-08-04 2023-07-31 仮想空間提供システム Ceased WO2024029497A1 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2024539145A JPWO2024029497A1 (https=) 2022-08-04 2023-07-31
US18/875,944 US20250218125A1 (en) 2022-08-04 2023-07-31 Virtual space provision system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2022-124694 2022-08-04
JP2022124694 2022-08-04

Publications (1)

Publication Number Publication Date
WO2024029497A1 true WO2024029497A1 (ja) 2024-02-08

Family

ID=89849336

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2023/027980 Ceased WO2024029497A1 (ja) 2022-08-04 2023-07-31 仮想空間提供システム

Country Status (3)

Country Link
US (1) US20250218125A1 (https=)
JP (1) JPWO2024029497A1 (https=)
WO (1) WO2024029497A1 (https=)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012011467A1 (ja) * 2010-07-20 2012-01-26 シャープ株式会社 データ配信システム、データ配信方法、配信側データ中継装置、及び受信側データ中継装置
WO2015011741A1 (ja) * 2013-07-25 2015-01-29 株式会社スクウェア・エニックス・ホールディングス 画像処理プログラム、サーバ装置、画像処理システムおよび画像処理方法
JP2017212592A (ja) * 2016-05-25 2017-11-30 キヤノン株式会社 制御装置、制御方法、及び、プログラム

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012011467A1 (ja) * 2010-07-20 2012-01-26 シャープ株式会社 データ配信システム、データ配信方法、配信側データ中継装置、及び受信側データ中継装置
WO2015011741A1 (ja) * 2013-07-25 2015-01-29 株式会社スクウェア・エニックス・ホールディングス 画像処理プログラム、サーバ装置、画像処理システムおよび画像処理方法
JP2017212592A (ja) * 2016-05-25 2017-11-30 キヤノン株式会社 制御装置、制御方法、及び、プログラム

Also Published As

Publication number Publication date
JPWO2024029497A1 (https=) 2024-02-08
US20250218125A1 (en) 2025-07-03

Similar Documents

Publication Publication Date Title
CN110637274B (zh) 信息处理设备、信息处理方法以及程序
WO2018225149A1 (ja) 複合現実表示システム及び複合現実表示端末
JP2001515630A (ja) 仮想環境視点制御
JP2018085722A (ja) 自由視点映像データ配信システム
WO2021257868A1 (en) Video chat with spatial interaction and eye contact recognition
WO2024029497A1 (ja) 仮想空間提供システム
CN116962737A (zh) 直播处理方法、装置、计算机设备和计算机可读存储介质
JP4844093B2 (ja) 情報処理装置および方法、記録媒体、並びにプログラム
CN115120970B (zh) 虚拟场景的烘焙方法、装置、设备以及存储介质
JP7733815B2 (ja) 仮想空間提供装置
JP3276057B2 (ja) ３次元仮想世界表示システム
CN108111374A (zh) 同步设备列表的方法、装置、设备和计算机存储介质
JPH11250278A (ja) 仮想空間内における仮想共有表示方法およびその表示プログラムを記録した記録媒体
WO2024029275A1 (ja) 表示制御システム
WO2025224919A1 (ja) 装置及び方法
JPH08336166A (ja) 映像視聴装置
JP2025011428A (ja) 配信システム
JP2025011426A (ja) 配信システム
JP2025011427A (ja) 配信システム
JP2025011429A (ja) 配信システム
CN116764189B (zh) 虚拟空间的分配方法、装置、介质、设备及产品
JP7829696B2 (ja) 仮想オブジェクトの表示制御装置、及び表示システム
JP7647562B2 (ja) 情報処理装置および方法
JP2024109309A (ja) 提供システムおよびその制御方法
WO2026074684A1 (ja) 装置及び方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23850051

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2024539145

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 18875944

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

WWP Wipo information: published in national office

Ref document number: 18875944

Country of ref document: US

122 Ep: pct application non-entry in european phase

Ref document number: 23850051

Country of ref document: EP

Kind code of ref document: A1