JP7470337B2 - Information processing system, information processing method, and computer program - Google Patents

Description

Article 30, paragraph 2 of the Patent Act applies [Website posting date] August 6, 2021 [Website address] https://twitter.com/REALITY_app/status/1423604281257586697?s=20 [Publisher] REALITY Co., Ltd. [Disclosed content of the invention] A video about the world function related to the invention of this application has been published.

Article 30, Paragraph 2 of the Patent Act applies [Website posting date] August 6, 2021 [Website address] https://reality.app/notice/page/n6ffzPPDnow [Publisher] REALITY Co., Ltd. [Disclosed content of the invention] An explanation and video regarding the world function related to the invention of this application have been published.

Article 30, paragraph 2 of the Patent Act applies [Website posting date] August 6, 2021 to August 16, 2021 [Website address] https://reality.app/ https://itunes.apple.com/us/app/reality/idl404176564?l=ja&ls=1&mt=8 https://play.google.com/store/apps/details?id=net.wrightflyer.le.reality [Publisher] REALITY Co., Ltd. [Disclosed content of the invention] A world function related to the invention of this application has been disclosed in the virtual live listening and distribution app "REALITY".

The present invention relates to an information processing system, an information processing method, and a computer program.

There is known an information processing system that generates animation of a character object based on the movement of an actor and distributes a video including the animation of the character object (see, for example, Patent Document 1).

JP 2015-184689 A

In this technical field, an important issue is how to increase distribution users' willingness to distribute, viewing users' willingness to watch, and/or users' willingness to interact with each other.

Therefore, an object of the present disclosure is to provide a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above. One of the more specific objects of the present disclosure is to provide an information processing system, an information processing method, and a computer program that can increase distribution users' motivation to distribute, viewing users' motivation to watch, and/or users' motivation to interact with each other.

The information processing system of the present disclosure includes one or more computer processors, which include a transmission unit that transmits information about a video including a character object of a first user to a second user terminal of a second user, a reception unit that receives a display request for a first object from the second user terminal, a first video generation unit that generates first information for displaying the character object of the first user and the first object in a first area in a virtual space as a first video, and a second video generation unit that generates second information for displaying a second object different from the first object in a second area in the virtual space as a second video and displaying the character object of the first user movably in the first area and the second area, and the second video generation unit displays the first object at a predetermined position in the first area or at a position associated with the character object of the first user based on placement position information associated with the first object.

When displaying the first object, the second video generation unit can display a system comment indicating that the first object is being displayed in the second video.

The one or more computer processors may further include a movement operation receiving unit that receives a movement operation of the first user's character object in the virtual space, and a virtual camera control unit that controls the operation of a virtual camera that captures images in the virtual space.

When the first object is displayed at a predetermined position in the first area, the virtual camera control unit can control the operation of the virtual camera according to the positional relationship between the predetermined position and the virtual camera.

When the first object and the character object cannot be included on the same screen due to the positional relationship between the specified position and the virtual camera, the virtual camera control unit can control the operation of the virtual camera to include the first object on the screen.

When displaying the first object at a predetermined position in the first area, the second video generation unit can display a marker object indicating the position of the first object in the virtual space according to the position of the character object in the virtual space.

The second video generation unit can display the first object at a position associated with the first user's character object, even if the placement position information associated with the first object indicates that the first object should be displayed at a specified position in the first area.

The facial movement of the first user's character object is generated based on the facial movement of the first user captured by the front camera of the first user terminal, the first video generation unit generates the facial movement of the first user's character object in an inverted state that is the inverse of the facial movement of the first user, and the second video generation unit can generate the facial movement of the first user's character object in an inverted or non-inverted state depending on the positional relationship between the first user's character object and the virtual camera.

The second video generation unit can make the character object of the first user reappear from another position in the virtual space if the character object moves beyond the movable area.

The information processing method of the present disclosure includes:
The method includes a transmitting step of transmitting information regarding a video including a character object of a first user to a second user terminal of a second user; a receiving step of receiving a display request for a first object from the second user terminal; a first video generation step of generating first information for displaying the character object of the first user and the first object in a first area in a virtual space as a first video; and a second video generation step of displaying a second object different from the first object in a second area in the virtual space as a second video and generating second information for displaying the character object of the first user movably in the first area and the second area, and in the second video generation step, the first object is displayed at a predetermined position in the first area or at a position associated with the character object of the first user based on placement position information associated with the first object.

The information processing method of the present disclosure includes causing one or more computer processors to execute a transmission step of transmitting information about a video including a character object of a first user to a server device, a first video generation step of generating first information for displaying, as a first video, the character object of the first user and a first object requested to be displayed from a second user terminal in a first area in a virtual space, and a second video generation step of displaying, as a second video, a second object different from the first object in a second area in the virtual space and generating second information for displaying the character object of the first user movably in the first area and the second area, and the second video generation step is characterized in that the first object is displayed at a predetermined position in the first area or at a position associated with the character object of the first user based on placement position information associated with the first object.

The computer program of the present disclosure provides one or more computer processors with a transmission function for transmitting information about a video including a character object of a first user to a server device, a first video generation function for generating first information for displaying, as a first video, the character object of the first user and a first object requested to be displayed from a second user terminal in a first area in a virtual space, and a second video generation function for displaying, as a second video, a second object different from the first object in a second area in the virtual space and generating second information for displaying the character object of the first user movably in the first area and the second area, and the second video generation function is characterized in that the first object is displayed at a predetermined position in the first area or at a position associated with the character object of the first user based on placement position information associated with the first object.

The information processing method of the present disclosure includes causing one or more computer processors to execute a receiving step of receiving information about a video including a character object of a first user from a server device, a transmitting step of transmitting a display request for the first object to the server device, and a display step of displaying the character object of the first user and the first object requested to be displayed from the second user terminal in a first area in a virtual space as the first video, displaying a second object different from the first object in a second area in the virtual space as the second video, and displaying the character object of the first user movably in the first area and the second area, and the display step is characterized in that the first object is displayed at a predetermined position in the first area in the virtual space or at a position associated with the character object of the first user based on placement position information associated with the first object.

The computer program of the present disclosure provides one or more computer processors with a receiving function for receiving information about a video including a character object of a first user from a server device, a transmitting function for transmitting a display request for the first object to the server device, and a display function for displaying, as a first video, the character object of the first user and a first object requested to be displayed from a second user terminal in a first area in a virtual space, and, as a second video, a second object different from the first object in a second area in a virtual space, and displaying the character object of the first user movably in the first area and the second area, and the display function is characterized in that, based on placement position information associated with the first object, the first object is displayed at a predetermined position in the first area in the virtual space or at a position associated with the character object of the first user.

According to the present disclosure, it is possible to provide technical improvements that solve or alleviate at least some of the problems of the conventional technology described above. Specifically, according to the present disclosure, it is possible to improve the willingness of broadcasting users to broadcast, the willingness of viewing users to view, and/or the willingness of users to interact with each other.

1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. 1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. 1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. FIG. 2 is a configuration diagram showing an example of a hardware configuration of a server device, a first user terminal, and a second user terminal in the present disclosure. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 2 is a configuration diagram illustrating an example of a functional configuration of a server device according to the first embodiment of the present disclosure. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 1 is a conceptual diagram showing an image of a virtual space in the present disclosure. FIG. 1 is a conceptual diagram showing an image of a virtual space in the present disclosure. FIG. 1 is a conceptual diagram showing an image of a virtual space in the present disclosure. FIG. 1 is a conceptual diagram showing an image of a virtual space in the present disclosure. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 1 is a conceptual diagram showing an image of a virtual space in the present disclosure. FIG. 11 is a configuration diagram showing another example of the functional configuration of the server device according to the first embodiment of the present disclosure. FIG. 11 is a configuration diagram illustrating an example of a functional configuration of a server device according to a second embodiment of the present disclosure. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a configuration diagram showing another example of the functional configuration of the server device according to the second embodiment of the present disclosure. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 13 is a configuration diagram illustrating an example of a functional configuration of a server device according to a third embodiment of the present disclosure. FIG. 1 is a conceptual diagram showing an image of a virtual space in the present disclosure. FIG. 11 is a conceptual diagram showing an image of a third object and a fourth object in the present disclosure. FIG. 2 is a conceptual diagram showing an image of a loading image in the present disclosure. FIG. 13 is a configuration diagram showing another example of the functional configuration of the server device according to the third embodiment of the present disclosure. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 2 is a flow diagram showing an example of a processing flow in the present disclosure. FIG. 2 is a flow diagram showing an example of a processing flow in the present disclosure. FIG. 13 is a conceptual diagram showing an image of a fifth object in the present disclosure. FIG. 13 is a configuration diagram showing an example of a functional configuration of a first user terminal in a fourth embodiment of the present disclosure. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 13 is a configuration diagram showing an example of a functional configuration of a first user terminal in a fifth embodiment of the present disclosure. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 13 is a configuration diagram showing another example of the functional configuration of the first user terminal in the fifth embodiment of the present disclosure. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 1 is a flow diagram showing an example of the flow of an information processing method according to the present disclosure. FIG. 2 is a circuit configuration diagram showing an example of a circuit configuration for realizing a computer program according to the present disclosure. FIG. 2 is a configuration diagram showing an example of a functional configuration of a first user terminal in the present disclosure. 11 is a flow diagram showing an example of the flow of an information processing method in a first user terminal in the present disclosure. FIG. 2 is a circuit diagram showing an example of a circuit configuration for realizing a computer program executed in a first user terminal in the present disclosure. FIG. 2 is a configuration diagram showing an example of a functional configuration of a second user terminal in the present disclosure. 11 is a flow diagram showing an example of the flow of an information processing method in a second user terminal in the present disclosure. FIG. 11 is a circuit diagram showing an example of a circuit configuration for realizing a computer program executed in a second user terminal in the present disclosure.

First, an overview of an information processing system according to an embodiment of the present disclosure will be described with reference to the drawings.

The information processing system in this disclosure is an information processing system that includes one or more information processing devices and a server device, and includes one or more computer processors.

The video displayed on each device will be described as including animation of a character object generated based on the broadcasting user's movements, but is not limited to this and may include animation of a character object generated in response to the broadcasting user's operations, or may include an image of the broadcasting user himself. Also, these character objects and the broadcasting user may not be displayed, and only the voice of the broadcasting user may be included.

The space displayed in the video may be a virtual space, a real space, or an augmented reality space that combines these. The video may be something like a karaoke video or a game commentary video that plays back at least a specific image and the voice of the broadcasting user, or may be a display in which a character object or an actual image of the broadcasting user is superimposed on these.

In addition, if the real space includes a broadcast user, a character object generated based on the broadcast user's movements may be displayed superimposed on an actual image of the broadcast user. Also, an animation of a gift object or the like may be displayed superimposed on an image captured in real space.

The information processing system in the embodiment of the present disclosure is a digital world in which many people can participate simultaneously and freely engage in activities such as interacting, working, and playing through character objects (avatars) at a level close to that of the real world, and can be used to provide a next-generation Internet space (metaverse) in which social activities can take place beyond the gap between reality and virtuality.

In this embodiment, as one element of the metaverse, it can be used to realize a "world function" that allows users' avatars (character objects) to roam freely in a virtual space and communicate with each other.

<System Configuration>
As shown as an example in FIG. 1, the information processing system 1000 of the present disclosure may include one or more viewing user terminals 1100, and an information processing device (support computer) 1300 located in a video distribution studio, etc., connected to these viewing user terminals 1100 via a network 1200.

The information processing device 1300 may be connected to a server device via the Internet, and some or all of the processing that should be performed by the information processing device 1300 may be performed by the server device. Such a server device may be the information processing device 2400 shown in FIG. 2.

In this specification, such distribution by the information processing system 1000 is referred to as studio distribution.

In studio streaming, the entire body movements of the streaming user (actor) are captured by a camera installed in the studio using markers attached to the streaming user, and are reflected in the character in real time using known motion capture technology.

The information processing system 1000 of the present invention can also be linked to another information processing system 2000, shown as an example in FIG. 2. The information processing system 2000 shown in FIG. 2 can include a broadcast user terminal 2100, one or more viewing user terminals 2200, and an information processing device (server device) 2400 connected to the broadcast user terminal 2100 and the viewing user terminal 2200 via a network 2300.

In the above example, the broadcast user terminal 2100 can be an information processing terminal such as a smartphone. In this specification, broadcasting by such an information processing system 2000 is referred to as mobile broadcasting.

In mobile distribution, the facial movements of the broadcast user are captured by a camera installed in the broadcast user terminal 2100, and are reflected on the character's face in real time using known face tracking technology.

In addition, there is no particular distinction between broadcast users and viewing users in mobile distribution; viewing users can broadcast via mobile at any time, and broadcast users can become viewing users when viewing videos of other broadcast users.

The videos generated by the information processing system 1000 and the information processing system 2000 can be distributed to viewing users from a single video distribution platform, as an example.

In addition, in any broadcast, the process of generating animation by reflecting motion on a character and the process of displaying gifts (described below) may be shared among the broadcast user terminal, the viewing user terminal, an information processing device, and other devices.

In other words, "distribution" here refers to the transmission of information that enables the video to be viewed on the viewing user's terminal, and the rendering of the video may be performed on the information processing device 1300, 2400 side, or on the distribution user terminal 2100 or the viewing user terminal 1100, 2200 side.

Specifically, facial motion data and voice data of the broadcasting user are transmitted from the broadcasting user terminal or information processing device to a terminal or device that generates (renders) the animation of the character object. Body motion may also be transmitted in addition to facial motion.

In this disclosure, the process of generating animation is described as being performed on both the broadcasting user terminal and the viewing user terminal, but is not limited to this.

The information processing system of the present disclosure can be applied to either of the examples shown in FIG. 1 and FIG. 2. Also, since it is not necessary to distinguish between "broadcast users" and "viewing users", the information processing system 3000 in the embodiment of the present disclosure will be described as including a first user terminal 100, a second user terminal 200, and a server device 400 that can be connected to the first user terminal 100 and the second user terminal 200 via a network 300, as shown in FIG. 3.

The first user terminal 100 functions at least as the information processing device 1300 or the broadcasting user terminal 2100 described above, the second user terminal 200 functions at least as one or more of the viewing user terminals 1100, 2200 described above, and the server device 400 functions at least as the server device or the information processing device 2400 described above.

In the present disclosure, the first user terminal 100 and the second user terminal 200 can be a smartphone (multifunction phone terminal), a tablet terminal, a personal computer, a console game machine, a head mounted display (HMD), a wearable computer such as a glasses-type wearable terminal (AR glasses, etc.), and an information processing device capable of playing videos other than these devices. Furthermore, these terminals may be standalone devices that operate independently, or may be composed of multiple devices connected to each other so that they can send and receive various data.

<Hardware Configuration>
Here, the hardware configuration of the first user terminal 100 will be described with reference to Fig. 4. The first user terminal 100 includes a processor 101, a memory 102, a storage 103, an input/output interface (input/output I/F) 104, and a communication interface (communication I/F) 105. The components are connected to each other via a bus B.

The first user terminal 100 can realize the functions and methods described in this embodiment through cooperation between the processor 101, memory 102, storage 103, input/output I/F 104, and communication I/F 105.

The processor 101 executes functions and/or methods realized by codes or instructions included in a program stored in the storage 103. The processor 101 includes, for example, a central processing unit (CPU), a micro processing unit (MPU), a graphics processing unit (GPU), a microprocessor, a processor core, a multiprocessor, an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc., and may realize each process disclosed in each embodiment by a logic circuit (hardware) or a dedicated circuit formed in an integrated circuit (an integrated circuit (IC) chip, a large scale integration (LSI)), etc.). These circuits may be realized by one or more integrated circuits, and multiple processes shown in each embodiment may be realized by one integrated circuit. In addition, an LSI may be called a VLSI, a super LSI, an ultra LSI, etc. depending on the degree of integration.

The memory 102 temporarily stores the programs loaded from the storage 103 and provides a working area for the processor 101. The memory 102 also temporarily stores various data generated while the processor 101 is executing the programs. The memory 102 includes, for example, a RAM (Random Access Memory), a ROM (Read Only Memory), etc.

Storage 103 stores programs. Storage 103 includes, for example, a hard disk drive (HDD), a solid state drive (SSD), flash memory, etc.

The communication I/F 105 is implemented as hardware such as a network adapter, communication software, or a combination of these, and transmits and receives various data via the network 300. The communication may be performed either wired or wirelessly, and any communication protocol may be used as long as mutual communication can be performed. The communication I/F 105 communicates with other information processing devices via the network 300. The communication I/F 105 transmits various data to other information processing devices according to instructions from the processor 101. The communication I/F 105 also receives various data transmitted from other information processing devices and transmits it to the processor 101.

The input/output I/F 104 includes an input device for inputting various operations to the first user terminal 100, and an output device for outputting the results of processing performed by the first user terminal 100. The input/output I/F 104 may be an integrated input device and output device, or may be separate input device and output device.

The input device is realized by any type of device, or a combination of devices, that can receive input from a user and transmit information related to the input to the processor 101. Examples of input devices include hardware keys such as a touch panel, a touch display, and a keyboard, pointing devices such as a mouse, a camera (operation input via images), and a microphone (operation input via voice).

The input device may include a sensor unit. The sensor unit is one or more sensors that detect face motions indicating changes in the user's facial expression and body motions indicating changes in the relative position of the user's body with respect to the sensor unit. Face motions include blinking, opening and closing of the mouth, and other movements. The sensor unit may be a publicly known one. An example of the sensor unit includes a ToF sensor that measures and detects the time of flight (Time of Flight) until light irradiated toward the user is reflected by the user's face and returns, a camera that captures the user's face, and an image processing unit that processes the data captured by the camera. The sensor unit may also include an RGB camera that captures visible light and a near-infrared camera that captures near-infrared light. The RGB camera and the near-infrared camera may be, for example, True Depth of the "iPhoneX (registered trademark)", or "LIDER" of the "iPad Pro (registered trademark)", or other ToF sensors installed in smartphones. Specifically, this camera uses a dot projector to project tens of thousands of invisible dots onto the user's face, etc. Then, it detects and analyzes the reflected light from the dot pattern to form a depth map of the face, and captures an infrared image of the face, etc., thereby capturing accurate facial data. The sensor unit's processing unit generates various information based on the depth map and the infrared image, and compares the information with registered reference data to calculate the depth of each point on the face (the distance between each point and the near-infrared camera) and positional deviations other than depth.

The sensor unit may also have a function of tracking not only the user's face but also their hands (hand tracking). The sensor unit may further include sensors other than the above-mentioned sensors, such as an acceleration sensor or a gyro sensor. The sensor unit may have a spatial mapping function of recognizing objects in the real space in which the user exists based on the detection results of the above-mentioned ToF sensor or other known sensors, and mapping the recognized objects on a spatial map. Hereinafter, when face motion detection data and body motion detection data are described without making a distinction between them, they will simply be referred to as "tracking data". Note that the image processing unit of the sensor unit may be provided in a control unit that can be provided in the information processing system of the present invention.

The operation unit as an input device can be one that corresponds to the type of the user terminal. Examples of the operation unit include a touch panel integrated with a display, operation buttons provided on the housing of the user terminal, a keyboard, a mouse, and a controller operated by the user's hand. The controller may have various known sensors built in, such as an acceleration sensor and an inertial measurement unit (IMU) such as a gyroscope. Another example of the operation unit may be a tracking device that identifies the user's hand movement, eye movement, head movement, and gaze direction. In this aspect, for example, the user's instructions can be determined based on the user's hand movement, and various operations can be performed, such as starting or ending the distribution of a video, rating a message or a video, and requesting the display of a specific object (for example, a gift, which will be described later). Note that if the sensor unit also has an input interface function such as a hand truck function, the operation unit can be omitted.

The output device outputs the processing results processed by the processor 101. The output device includes, for example, a touch panel, a speaker, etc.

In addition, the second user terminal 200 and server device 400 in this disclosure can also be configured with the same hardware configuration as shown in FIG. 4, unless otherwise noted.

Next, various functions that can be executed on a user terminal that has launched an application realized by an information processing system in an embodiment of the present disclosure, and the transition of the displayed screens will be explained with reference to the drawings.

Figure 5 shows the top screen T10 that is displayed on the user terminal when the video distribution and viewing application is launched.

As shown in FIG. 5, a user can watch a video being played on one of the distribution channels by selecting one of the distribution channels (distribution slot, distribution program, distribution video, etc.) from thumbnail images of one or more recommended distribution channels T12 displayed in a list in the Recommendations tab T11 on the top screen T10.

Alternatively, a user can view a video being played on a specific distribution channel by accessing a fixed link for that specific distribution channel. Such a fixed link can be obtained through notifications from distribution users who the user is following, or through notifications of shares sent by other users.

In this way, the user watching the video becomes the viewing user, and the terminal watching the video becomes the second user terminal 200.

As shown in FIG. 5, the top screen T10 may also display a display area T13 for notifications such as campaigns and events. This notification display area T13 can be switched to display other notifications by sliding the display area.

The top screen T10 displays a follow tab T14, a game tab T15 for displaying game categories, a collaboration waiting tab T16 for displaying distribution channels waiting for collaboration, and a beginner tab T17 for displaying distribution channels for beginners. By selecting these (by switching between tabs), the top screen T10 transitions to each of the different screens.

The service name display T18 and search button T19 in the upper frame of the top screen T10 may remain fixed and displayed on the destination screen.

Similarly, the home button T20, message button T21, delivery preparation button T22, gacha button T23, and profile button T24 in the lower frame of the top screen T10 may also be fixed and remain displayed on the transition destination screen.

On the top screen T10 shown in FIG. 5, a user who selects a displayed thumbnail image T12 can become a viewing user (second user) who watches the video as described above, and a user who selects the distribution preparation button T22 can become a distribution user (first user) who distributes the video.

As an example, when the distribution preparation button T22 is selected on the top screen T10 shown in FIG. 5, the screen transitions to the avatar setting screen D10 shown in FIG. 6. Then, when the distribution button D11 is selected on the avatar setting screen D10, the screen transitions to the distribution setting screen D20 shown in FIG. 7. Then, when the start distribution button D25 is selected on the distribution setting screen D20, the screen transitions to the avatar distribution screen D30 shown in FIG. 8.

Next, we will explain the details of the flow until video distribution begins.

The one or more computer processors in the present disclosure may include a distribution start request receiving unit, a distribution setting unit, and a distribution start unit.

The distribution start request receiving unit receives a request to start distribution of a first video including animation of a character object from a broadcast user terminal of the broadcast user.

Here, the first video refers to a video that includes animation of a character object. Note that in this specification, a character object may also be called an "avatar."

The request to start distribution can be transmitted from a user terminal (later becoming the distribution user terminal 2100) to the information processing device 2400 by selecting a distribution button D11 located on an avatar setting screen or the like transitioned to from the above-mentioned top screen displayed on the user terminal that has launched a dedicated application (video distribution/viewing application) for accessing the video distribution platform.

Figure 6 shows an example of an avatar setting screen D10. The avatar setting screen D10 can display a character object CO, a distribution button D11, a gacha button D12, a change of clothes button D13, a photo button D14, etc.

When the user selects the change clothes button D13, a closet screen appears for selecting various avatar parts for the character object CO, such as eyes, nose, mouth, hair, accessories, clothes, and background.

When the user selects the gacha button D12, a lottery screen for obtaining the avatar parts appears.

When the user selects the photo button D14, a shooting screen appears for taking a still image of the character object.

When the user selects the distribution button D11, a distribution start request is sent to the information processing device 2400 (server device 400).

The distribution setting unit sets the distribution settings of the first video based on the specifications from the distribution user terminal 2100 in response to a request to start distribution of the first video accepted by the distribution start request accepting unit.

As an example, when the broadcast button D11 is selected, the screen displayed on the broadcast user terminal 2100 transitions from the avatar setting screen D10 shown in FIG. 6 to the broadcast setting screen D20 shown in FIG. 7.

The distribution settings may include at least one of the following: a setting regarding the title of the first video, a setting regarding whether other users can appear in the first video, a setting regarding the number of people who can appear in the first video, and a setting regarding a password.

These distribution settings can be set in the title setting field D21, collaboration setting field D22, number of people setting field D23, and password setting field D24 in FIG. 7. In addition, FIG. 7 also displays a collaboration setting field D26 for anyone and a SNS posting setting field D27.

The title of the first video can be freely determined by the broadcasting user within the range of the maximum number of characters allowed. If there is no input from the broadcasting user, a pre-set title including the name of the broadcasting user or character object, such as "This is XXX's broadcast ♪", may be automatically determined.

The distributing user can freely decide whether or not other users can appear in the first video. If it is allowed, other users can make an appearance request to the distributing user, and if it is not allowed, other users cannot make an appearance request to the distributing user. In this specification, the state in which other users appear in the distributing user's video is sometimes referred to as "collaboration." More details on collaboration will be provided later.

The number of people who can appear in the first video can only be set if other users are allowed to appear in the first video as described above, and can be freely determined by the distributor user within the range of the maximum number of people allowed.

The password can be set arbitrarily only if other users are allowed to appear in the first video described above, and the distribution user can freely decide the number of digits specified. When other users apply to appear in the first video, they are required to enter the password. Note that the password setting field D24 may be configured to be active only if the collaboration permission setting field D26 is OFF.

The distribution start unit distributes information about the first video to the viewing user terminal 2200 of the viewing user based on the conditions set by the distribution setting unit.

The instruction to start such distribution is sent by selecting the distribution start button D25 shown in FIG. 7.

As an example, the distribution starting unit distributes (avatar distributes) information about a video (first video) including animation of the distribution user's character object to the viewing user terminal 2200 of the viewing user.

The information about the first video includes, for example, motion information showing the movement of the character object, audio information of the broadcasting user, and gift object information showing gifts sent by other viewing users. The gift object information includes at least gift object identification information that specifies the type of gift object, and position information that indicates the position where the gift object is displayed.

Then, the distribution start unit can live-stream the video via the video distribution platform described above.

Figure 8 shows the avatar distribution screen D30 displayed on the distribution user terminal 2100.

The avatar distribution screen D30 displays the character object CO, as well as a comment input button D31 for the distribution user to input a comment, a photo button D32 for saving a still image of the screen, a start play button D33 for playing a game described below, an external service linkage button D34 for watching videos provided by an external service, and a gacha button D12 for obtaining avatar parts.

In addition, the top of the avatar distribution screen D30 can display a cumulative viewer count D35, a cumulative like count D36, a collaborator count D37, a share button for external SNS D38, a guest details button D39, a ranking display button D40, a settings button D41, and an audio switch button D42 for switching audio ON/OFF. Also displayed is an end button D43 for ending the distribution.

A detailed description of these displays and buttons will be omitted, but by selecting the settings button D41, it is possible to change the distribution settings set on the distribution settings screen D20.

Note that FIG. 8 shows an example in which distribution has been started with the distribution setting screen D20 set to allow other users to appear in the first video and the number of people who can appear in the first video set to three, so character object CO is displayed shifted to the bottom left. Up to three character objects of other users can appear in the empty space.

The above is an explanation of the screen transitions that occur when delivering an avatar according to the invention disclosed herein.

Next, we will explain the screen transitions that occur when a broadcaster plays a game while broadcasting.

The one or more computer processors in the present disclosure may include a game request receiving unit, a game video distribution unit, and a game display processing unit.

During avatar distribution as shown in FIG. 8, the broadcasting user can request to start playing the game by selecting the start play button D33.

The game displayed by selecting the play start button D33 is a dedicated game implemented in an application realized by the information processing system of the present disclosure, and may be different from a general-purpose game provided by an external service. Therefore, game distribution in the present disclosure may be distinguished from distribution of a gameplay video of a general-purpose game provided by an external service along with a live commentary by the distribution user.

Alternatively, the start play request can be transmitted from the broadcast user terminal 2100 to the information processing device 2400 by selecting a start play button located on a specified screen displayed on the broadcast user terminal 2100 of the broadcast user.

Figure 9 shows an example of a screen G10 on which a play start button G11 is arranged as the above-mentioned predetermined screen. The screen G10 shown in Figure 9 is a screen transitioned to by selecting the game tab T15 from the top screen T10 (Figure 5) displayed on a user terminal that has launched an application realized by the information processing system of the present disclosure.

Screen G10 displays at least a play start button G11 that can send a request to start playing a specific game.

Then, when the game request receiving unit receives a request to start playing a specific game, the game video distribution unit distributes information about the second video to the viewing user terminal.

Here, the second video is a gameplay video of a specific game. In this specification, the distribution of such a video so that it is displayed on the screen of the viewing user terminal 2200 is referred to as "game distribution."

In addition, after launching the application realized by the invention of the present disclosure, the user can, as a distribution user, send a request to start distribution of the second video to the information processing device 2400 by selecting a play start object placed on the game list screen and the game details screen.

These game list screens and game details screens are the first screens, which will be explained in detail below.

In other words, the game display processing unit performs display processing of a first screen including a distribution start object capable of sending a request to start distribution, a play start object capable of sending a request to start playing a specific game, and a thumbnail image of a video of a gameplay video of a specific game being distributed.

The screen G10 shown in FIG. 9 corresponds to the game list screen among the first screens. The first screen, which is the game list screen, is a screen transitioned to by selecting the game tab T15 from the top screen T10.

This first screen includes a distribution preparation button T22 as a distribution start object, a play start button G11 as a play start object, and a thumbnail image indicating the video distribution channel.

For each of the multiple playable games, the first screen displays a play start button G11, a game icon G12, the game name G13, the total number of viewers of the game's distribution channel G14, and a distribution list G15 that includes thumbnail images of the distribution channels currently distributing the game.

The order of thumbnail images displayed in the distribution list G15 displayed here can be different depending on the viewing user. As an example, the order is arranged in the following order of priority: most frequently viewed by the viewing user who is following the content, most frequently viewed by the viewing user, most frequently viewed by the cumulative number of viewers, and oldest distribution start date. The display range of thumbnail images in this distribution list G15 can be changed by scrolling horizontally.

The games displayed on this game list screen are the top 10 titles with the following priorities: As an example, the priorities are determined within 48 hours of the game distribution start date and time, in descending order of the date when the viewing user last played the game within the last 30 days, in descending order of the priority of the period ID.

This distribution list G15 is updated when you return from another tab screen or when you perform a pull-to-refresh operation.

Figure 10 corresponds to the game details screen of the first screen. The first screen, which is the game details screen, is G20, which is the screen transitioned to by selecting the game icon G12 or game name G13 displayed on the game list screen shown in Figure 9.

This first screen includes a distribution preparation button T22, which is a distribution start object, a play start button G21, which is a play start object, and a thumbnail image indicating the distribution channel for the video.

The first screen also displays a game icon G22, a game name G23, the total number of viewers of the game's distribution channel G24, and a distribution list G25 that includes thumbnail images of the distribution channels currently distributing the game.

The order of thumbnail images displayed in the distribution list G25 displayed here can be different depending on the viewing user. As an example, the order is arranged in the following order of priority: most frequently viewed by the viewing user who is following the content, most frequently viewed by the viewing user, most frequently viewed by the cumulative number of viewers, and oldest distribution start date. The display range of thumbnail images in this distribution list G25 can be changed by vertical scrolling.

This distribution list G25 is updated when you return from another tab screen or when you perform a pull-to-refresh operation.

As described above, a user who selects a broadcast start object or a play start object becomes a broadcast user who makes a broadcast start request or a play start request.

In addition, the user who selects the thumbnail image becomes the viewing user who will watch the second video.

The first screen also includes a first area in which scrolling is not possible and a second area in which scrolling is possible.

The first screen referred to here is the first screen shown in FIG. 10. The first screen includes a first area R1 and a second area R2. Specifically, the game title is displayed in the first area R1, and the above-mentioned play start button G21, game icon G22, game name G23, number of viewers G24, and distribution list G25 are displayed in the second area R2.

The first region R1 is a portion that is fixedly displayed on the display screen and cannot be scrolled, while the second region R2 is a portion that can be scrolled by the user. By scrolling the second region R2, the user can check thumbnail images that are hidden outside the screen.

However, since there is a risk that the play start button G21 may be hidden off-screen by scrolling the second area, the display processing unit in this disclosure can display the play start object (play start button G21) in the first area R1 depending on the display state of the play start object (play start button G21) displayed in the second area R2.

As an example, in FIG. 10, the play start button G21 is displayed in the second region R2, but in FIG. 11, it is displayed in the first region R1. In other words, when part or all of the play start button G21 is no longer displayed in the second region R2, the play start button G21 appears in the first region.

The game display processing unit may also cause the play start object to be displayed in stages in the first area R1 depending on the display state of the play start object displayed in the second area R2.

This representation can be achieved by changing the transparency of the play start object in accordance with the amount of scrolling of the second region R2.

As an example, a scroll amount (unit: pixels) of 0 to 50 can correspond to a button transparency of 0.0 (completely transparent) to 1.0 (completely opaque). In this way, in the initial display state, the object is completely transparent and cannot be seen, but when the object is scrolled 50 pixels or more, it becomes completely visible. It is preferable to change the object's transparency linearly in this range (0 to 50). Note that the unit of the scroll amount is logical pixels, which may differ from the actual pixels on the display.

The game request receiving unit is also capable of receiving a request to end play of a specified game from the broadcast user terminal 100 after the game video distribution unit has distributed information about the second video.

A request to end play can be sent by selecting the end button located on the game screen.

Then, when the game request receiving unit receives a request to end play of a specific game, the video distribution unit can end distribution of information about the second video and distribute information about the first video.

In other words, what is distributed here is not just a portion of the information in the first video, but all of the information in the first video.

Then, when the video distribution unit finishes distributing information about the second video and distributes information about the first video, it is assumed that the first video is displayed on the viewing user terminal 2200.

Next, we will explain the flow for starting to watch a video.

One or more processors in the present disclosure may further include a viewing reception unit.

The viewing reception unit accepts video viewing requests from users.

The video distribution unit distributes video and audio information as video information to the user's information processing terminal in response to a viewing request.

Figure 12 shows an example of a viewing screen V10 of an avatar video displayed on the viewing user terminal 2200.

A viewing user can post a comment by entering text in the comment posting field V11 and pressing the send button V12.

In addition, by pressing the gift button V13, the viewing user can display a list of gifts (screen V30 in FIG. 13) and send a display request for the specified gift by selecting it.

At this time, one or more processors in the present disclosure may include a determination unit. The determination unit determines whether or not a gift display request has been made from the viewing user terminal 2200.

The display request may include gift object information. The gift object information includes at least gift object identification information that identifies the type of gift object, and location information that indicates the location where the gift object is to be displayed.

In addition, as shown in FIG. 13, gifts can be displayed by category (free (paid) gifts, accessories, cheering goods, appeals, variety, etc.).

Here, paid gifts are gifts that can be purchased by spending My Coins purchased by the viewing user, and free gifts are gifts that can be obtained by the viewing user with or without spending My Points obtained for free.

The term "gift" used in this application has the same concept as the term "token." Therefore, it is possible to understand the technology described in this application by replacing the term "gift" with the term "token."

In addition, the viewing user can post a rating showing a favorable opinion by pressing the like button V14. Note that in addition to or instead of the like button V14, it is also possible to display a button for posting a negative rating or other emotions.

In addition, if the broadcasting user has set the option to allow other users to appear in the video in their broadcast settings, they can send a request to appear in the video by selecting the collaboration request button V15.

In addition, on the screen of a video distributed by a distributor user who is not yet being followed by the viewing user, a follow button V16 is displayed that allows the viewing user to follow the distributor user. This follow button functions as an unfollow button on the screen of a video distributed by a distributor user who is already being followed by the viewing user.

Note that this "following" may occur from viewing user to viewing user, from broadcasting user to viewing user, or from broadcasting user to broadcasting user. However, following is managed as a one-way association only, and associations in the reverse direction are managed separately as followers.

A photo button V25 for saving a still image of the screen may also be displayed.

The viewing screen V10 also displays a support ranking display button V17, a share button V18, and a ranking display button V19.

The support ranking displays a ranking of viewing users who are supporting a broadcasting user, and the ranking can be calculated based on the amount of the gift (points/coins), etc.

In addition, when sharing a video, the viewing user can press the share button V18 to check a list of SNS (social networking services) on which the video can be shared, and can send a fixed link to a specified location on a specified SNS by selecting it.

You can also request a collaboration broadcast from the broadcasting user by pressing the collaboration request button V15. A collaboration broadcast means having the viewing user's character object appear in the broadcasting user's video.

The upper part of the viewing screen V10 can display the broadcast user icon V21, the broadcast user name (character object name) V22, a cumulative number of viewers display V23, and a cumulative number of likes display V24.

In addition, when the End Viewing button V20 is selected, a screen for ending viewing appears, allowing the user to send a request to end viewing.

The screen for ending such viewing will be explained in detail below. This screen is called "small window audio distribution" and is used for viewing in a mode where only the audio is played without displaying the video image.

Selection of the above-mentioned viewing end button V20 is accepted by the viewing acceptance unit as a request to end viewing of the video.

At this time, the video distribution unit ends the distribution of information about the video in response to the request to end viewing, but does not end the distribution of information about the audio.

When information about video and audio is distributed to the user terminal, the video is displayed on the main screen of the user terminal, and when information about audio only is distributed, the video is not displayed on the user terminal, but a sub-screen indicating that a video is being viewed is displayed.

Figure 14 shows an image of screen V50 on which the above-mentioned sub-screen V51 is displayed.

When this sub-screen V51 is displayed, the main screen displayed in the background transitions to the screen before watching the video. For example, if you move from the recommendation tab to the viewing frame, it will return to displaying the recommendation tab, and if you move from the follow tab to the viewing frame, it will transition to the follow tab.

When this sub-screen V51 is displayed, operations can be performed on the main screen, and transitions to other screens are possible.

The sub-screen V51 displays a profile picture, name, title, and an audio icon that visually indicates that audio is being played.

Then, viewing can be completely ended by selecting the end icon V52 displayed on the sub-screen V51.

When the video display is to be terminated, the server device may transmit information but not display it on the terminal, or the server device may stop transmitting information altogether.

With this configuration, you can search for other broadcasts or chat with other users while listening to only the audio.

Next, we will explain "collaborations," where other users appear in a streaming user's videos.

As described above, the viewing user can send a request to join the video by pressing the collaboration request button V15 shown in FIG. 12 and going through the collaboration distribution participation request confirmation screen that is displayed.

In the present disclosure, the collaboration avatar display unit provided in one or more computer processors displays in the video a character object that is generated based on the movement of the viewing user who has made the participation request in response to the participation request received by the reception unit.

Figure 15 shows, as an example, a viewing or distribution screen in which a second avatar A2, which is a character object of a guest user, is participating in a video in which a first avatar A1, which is a character object of a host user, is displayed. Note that in Figure 15, the display of objects other than the avatars is omitted.

As shown in FIG. 16, a third avatar A3, which is a character object generated based on the movement of another viewing user, may also participate in the video. Note that in FIG. 16, the third avatar A3 is placed behind the first avatar A1 and the second avatar A2, but the three may be placed in a horizontal line. The placement positions of the avatars may be specified by the distribution user.

Figure 17 shows a list screen T30 of users who have mutual follow relationships, which is displayed by selecting the Follow tab on the top screen shown in Figure 5. Mutual follow refers to a relationship in which each user is a follower of the other.

This list screen T30 displays the profile images and names of users with whom you have a mutual follow relationship.

As shown in FIG. 17, the list screen T30 displays a first object T31 for each user who has a mutual follow relationship. In addition, a chat object T32 may be displayed together with the first object T31. By selecting this chat object, it is possible to transition to an individual chat screen with the second user.

The first object T31 sends a specified notification to the terminal of the user associated with the first object T31.

The specified notification may be, for example, a call notification.

First Embodiment
Next, various functions executable by the first user terminal 100, the second user terminal 200 and/or the server device 400 provided in the information processing system 3000 according to the first embodiment of the present disclosure will be described with reference to the drawings.

The one or more computer processors included in the information processing system 3000 according to the first embodiment of the present disclosure include a transmission unit 411, a reception unit 412, a first video generation unit 413, a second video generation unit 414, and a video switching unit 415, as shown in FIG. 18.

Here, the sending unit 411, the receiving unit 412, the first video generating unit 413, the second video generating unit 414, and the video switching unit 415 are all described as being provided in the server device 400, but are not limited to this.

The transmission unit 411 transmits information about the video including the character object of the first user to the second user terminal 200 of the second user.

The video may include the first user's character object CO, as shown as an example in FIG. 19.

The information regarding the video may be information that enables the video to be viewed on the second user terminal 200, and rendering of the video may be performed on the server device 400 or the first user terminal 100, or may be performed on the second user terminal 200.

At least the facial portion of the character object CO included in the video may reflect the facial movements of the first user captured by a camera (here, the in-camera as an example) provided on the first user terminal 100.

The reception unit 412 receives a request to display the first object from the second user terminal 200.

The first object may be, as an example, the gift object described above. As shown in FIG. 13 and FIG. 20, the second user may send a display request for a desired gift object from the gift list screen V30 displayed on the second user terminal 200. The points (P, pt) shown in the figure are available to the user free of charge as rewards or in events in the system, and the coins (C) shown in the figure are available to the user for a fee by purchasing them.

The first video generation unit 413 generates first information for displaying the first user's character object and the first object in a first area in the virtual space as a first video.

The first information will vary depending on the content of the video, but as an example, in the case of a video in which the distributing user's character object appears as described above, it will include motion information showing the character object's movements, audio information of the distributing user, gift object information showing gifts sent by viewing users, etc. The gift object information will include at least gift object identification information that specifies the type of gift object, and location information that indicates the location where the gift object is displayed.

Figure 19 shows an image of a screen V10 displaying a first video displayed on the display unit of the first user terminal 100 and/or the second user terminal 200. The screen V10 shown in Figure 19 includes at least a character object CO and a first object G1. Although omitted in Figure 19, various displays and operation UIs may be displayed in a superimposed manner, as shown in Figures 8 and 12.

The second video generation unit 414 generates second information for displaying a second object S1 different from the first object G1 in a second area in the virtual space as a second video, and displaying the first user's character object CO movably between the first area and the second area.

The second object S1 is not displayed in response to a display request from the second user terminal 200, as is the first object G1, but rather the display position and timing are controlled by the server device 400 (system side).

Figure 21 shows an image of a screen V40 displaying a second video displayed on the display unit of the first user terminal 100 and/or the second user terminal 200. The screen V40 shown in Figure 21 includes at least a character object CO and a second object S1. Although omitted in Figure 21, various displays and operation UIs may be displayed superimposed, as shown in Figures 8 and 12.

Here, we will explain in detail the image of the expansion of virtual space in this disclosure with reference to Figure 22.

As shown as an example in FIG. 22, the virtual space in this embodiment is arranged so that a disk-shaped island (world) appears floating in the air. This island is an object that resembles an upside-down tower-shaped cake, and various objects can be arranged on the disk-shaped ground. Note that this island and ground are shown as examples, and their display forms are not particularly limited.

At least the above-mentioned character object CO, first object G1, and second object S1 can be displayed as objects.

In this way, the "world" is provided as the content of the second video, and this "world" is expanded by executing the "world function" described above.

Figure 23 is a top view of the ground shown in Figure 22, and is an image diagram for explaining the first and second areas in the above configuration. Note that each object is drawn as seen from the front for ease of viewing.

As shown in FIG. 23, the areas in which the character object CO can move can be a first area R10 and a second area R20 in the virtual space.

The first region R10 and the second region R20 need only be continuous regions, and there are no particular limitations on their positional relationship or shape.

As an example, the first video is generated as an image of the first region R10 captured from the position of the virtual camera VC1 shown in FIG. 24 (FIG. 19). Note that the position and orientation of this virtual camera VC1 can be changed within a predetermined range by the operation of the first user.

As another example, the second video is generated as an image of the first region R10 and/or the second region R20 captured from the position of the virtual camera VC2 shown in FIG. 25 (FIG. 21). Note that the position and orientation of this virtual camera VC2 can be changed by the operation of the first user, but the virtual camera basically moves in accordance with the movement of the character object CO. The method of operating the virtual camera VC2 will be described in detail later.

In this way, the first video and the second video can be videos taken in the same virtual space (world). Alternatively, the first video and the second video can be videos taken in different virtual spaces. In this case, the second video is a video taken in the world.

In addition, the first user's room, which is the first user's private space in the virtual space, may be set as the first area, and the area outside the room, which is the public space, may be set as the second area, and the user may be able to move between these areas.

The video switching unit 415 is characterized in that it switches the video displayed on the second user terminal 200 between the first video and the second video in response to an instruction from the first user terminal 100 of the first user.

The above instruction can be transmitted to the server device 400 by operating a specific operation UI displayed on the first video and the second video displayed on the first user terminal 100.

As an example, switching from a first video to a second video/from the second video to the first video can be performed by selecting a switching button displayed on the first video and the second video.

If the world function as the second video is provided as one of the games described above, the above-mentioned game distribution start and end procedures can be applied.

Specifically, switching from the first video to the second video can be performed by selecting the play button D33 (Figure 8) of the game displayed in the first video, or the play button G11, G21 (Figures 9, 10) of a game selected from a list of games displayed on the screen transitioned to by selecting the play button D33.

In addition, switching from the second video to the first video can be performed by selecting the play end button V41 (Figure 21, etc.) displayed on the second video.

The above configuration can provide a technical improvement that solves or alleviates at least some of the problems with the conventional technology described above. Specifically, the above configuration can improve the distribution user's willingness to distribute, the viewing user's willingness to watch, and/or the willingness of users to interact with each other.

Specifically, first, the presence of two types of videos, a first video and a second video, increases the interest of the videos.

In particular, the virtual space "world" where the second video is set is populated with attractive second objects that fit the theme, and the character objects can be moved freely to generate videos from any location and perspective, allowing users to create videos that reflect their individuality more than the first video.

In addition, by generating videos of people exploring the world, it will be easier to create topics for conversation and comments.

In addition, by being able to switch between these two types of video, it will inevitably be possible to extend the distribution time.

In this way, the existence of two types of video, the first video and the second video, and the ability to switch between them, improves the quality of the video content compared to the past.

In addition, as the quality of video content improves, users will be more willing to watch the videos, and as the number of viewers increases, so will the willingness of broadcasters to continue broadcasting.

And as the willingness to broadcast and watch increases, so will the interaction between broadcast users and viewer users, and even between broadcast users themselves and between viewer users themselves.

The virtual space displayed by executing the world function described above has been described as a space for distributing the second video, but it can also be used as a virtual space in which multiple avatars corresponding to multiple users can roam freely and communicate with each other, rather than being limited to a space for distributing the second video.

And one of the multiple avatars in the virtual space (first user) may be configured to distribute a first video as a distribution user. In other words, according to the information processing system disclosed herein, one-to-many video distribution can be performed in a many-to-many metaverse virtual space.

Next, we will explain other application examples of the first embodiment.

When the video switching unit 415 switches the video from the first video to the second video, the second video generating unit 414 can generate the second information while maintaining the display of the already-displayed first object G1 in the first area.

Specifically, the first object G1 (apple object) displayed on the first video screen V10 shown in FIG. 19 continues to be displayed even when it changes to the second video screen V40 shown in FIG. 21.

When the video switching unit 415 switches the video from the second video to the first video, the first video generating unit 413 can generate the first information while maintaining the display of the already-displayed first object G1 in the first area.

Specifically, the first object G1 (apple object) displayed on the second video screen V40 shown in FIG. 21 continues to be displayed even when the screen changes to the first video screen V10 shown in FIG. 19. At this time, not only the first object G1 displayed in the first area, but also the first object G1 displayed in the second area can be configured to change its display position and continue to be displayed.

Note that the display of the first object G1 is controlled based on the display time set for each first object G1, and therefore the display of the first object G1 ends when the display time has elapsed from the start of display. A request to display the first object G1 can be made while the first video or the second video is being displayed, and in either case, the display of the first object G1 continues until the display time has elapsed, regardless of whether the video is switched in between. In other words, the display time of the gift deposited by the viewing user is not changed by the operation (action) of the distribution user, and therefore the viewing user who deposited the gift by consuming coins or the like is not dissatisfied.

The second video generating unit 414 can change at least the second object S1 to another second object S1 based on a predetermined condition.

In the examples shown in Figures 21 and 22, the second objects S1 are, for example, a dog object, a pumpkin object, a tower cake object, etc., but as for these second objects S1, as for example, at least the dog object and the pumpkin object can be changed to a jellyfish object and a fish object, as shown in Figures 26 and 27. Also, there may be second objects S1 that do not change, such as tower cake objects. In this disclosure, changing such second objects S1 is referred to as changing the theme.

The predetermined condition may be the arrival of a scheduled time, the passage of a scheduled time, or the receipt of a change instruction from the first user or another user.

When the specified condition is the arrival of the scheduled time, the second video generation unit 414 changes the second object to another second object when the scheduled time arrives, regardless of the start time of video distribution. As an example, the scheduled time can be set to regular intervals such as 10:20, 10:40, and 11:00. The scheduled time can also be set to morning (6:00), midday (12:00), and night (18:00). Note that this time may be changed according to the actual times of sunrise and sunset.

The arrival of the scheduled time also includes the arrival of the scheduled date and time. In this case, the second video generation unit 414 changes the second object to another second object when the scheduled date and time arrives, regardless of the distribution start time of the video. As an example, the scheduled date and time can be the start date and time of an event, such as October 31st, 0:00 (Halloween), December 25th, 0:00 (Christmas), January 1st, 0:00 (New Year's Day), etc.

If the specified condition is the passage of a scheduled time, the second video generation unit 414 changes the second object to another second object when the scheduled time has elapsed from the start time of distribution of the video. As an example, the scheduled time can be a regular interval such as 20 minutes, 40 minutes, or 60 minutes from the start of distribution.

If the predetermined condition is that a change instruction has been received from the first user or another user, the second video generating unit 414 changes the second object to another second object when a change instruction is received from the first user or another user during distribution of the video. As an example, the change instruction can be given by selecting a change instruction object displayed on the screen. Note that the other users mentioned here include not only viewing users but also guest users, which will be described later.

If the specified condition is the arrival of a scheduled time or the passage of a scheduled time, the scheduled time or the time until the second object is changed may be displayed in the video.

In addition, even if the second object S2 is changed to another second object S2, the second video generating unit 414 can generate the second information while maintaining the display of the already displayed first object G1 in the first area or the second area.

Specifically, the first object G1 (apple object) displayed on the second video screen V40 shown in FIG. 21 continues to be displayed even when the screen changes to the second video screen V40 shown in FIG. 26.

The display of the first object G1 is controlled based on the display time set for each first object G1, so the display of the first object G1 ends when the display time has elapsed since the start of display. The display of the first object G1 continues until the display time has elapsed, regardless of whether the second object S1 has been changed.

Furthermore, as shown in FIG. 28, one or more computer processors in this disclosure may further include an effect generation unit 416.

The effect generation unit 416 generates a predetermined effect when an already displayed first object G1 or a newly displayed first object G1 has a specific relationship with a second object S1.

Specifically, the presence or absence of the specific relationship is determined based on combination data previously stored in a predetermined storage unit. As an example, each of the first object and the second object is associated with an identification number and/or attribute information, and if these match or are associated, it is determined that there is a specific relationship.

Attribute information includes, for example, attributes related to seasons (summer, winter, etc.), attributes related to events (Halloween, Christmas, New Year's holidays, etc.), attributes related to locations (sea, space, sky, etc.), etc.

The timing of the above determination can be when a request to display the first object is received, when the first object is displayed, or when the second object is changed to another second object.

The predetermined effect may be, for example, but is not limited to, displaying another object or generating a sound effect. The other object may be, for example, a presentation object such as a confetti object, a cracker object, or a paper balloon object.

Furthermore, as shown in FIG. 28, one or more computer processors in the present disclosure may further include a movement operation receiving unit 417 and a virtual camera control unit 418.

The movement operation receiving unit 417 receives a movement operation of the first user's character object in the virtual space. Details of the movement operation will be described later.

The virtual camera control unit 418 controls the operation of the virtual camera that captures images in the virtual space. Details of operation control will be described later.

Furthermore, in an embodiment of the present disclosure, the facial movement of the first user's character object can be generated based on the facial movement of the first user captured by the in-camera of the first user terminal 100.

The first video generation unit 413 can then generate the facial movement of the first user's character object in an inverted state that is the inverse of the facial movement of the first user.

Specifically, when the first user winks with his/her right eye, the first user's character object winks with his/her left eye. Since the first user broadcasts while looking at the face of the character object displayed on the first user terminal 100, the inverted state (mirror display) allows the first user to broadcast with an intuitive feeling (operation) as if looking in a mirror. Note that a non-inverted state where the left and right are not inverted (i.e., a state in which the character object winks with its right eye when the first user winks with its right eye) creates an awkward feeling and makes it difficult to operate with an intuitive feeling.

The second video generation unit 414 can generate the facial movement of the first user's character object in an inverted or non-inverted state depending on the positional relationship between the first user's character object and the virtual camera.

As one example, when the virtual camera is positioned within the range in front of the first user's character object (for example, within a range of 90 degrees left or right from the front of the character object), the facial movement of the character object is generated in an inverted state, and when the virtual camera is positioned outside the range in front of the first user's character (for example, within a range exceeding 90 degrees left or right from the front of the character object), the facial movement of the character object is generated in a non-inverted state.

Specifically, if the virtual camera is determined to be located within the front range of the first user's character object, when the first user winks with his/her right eye, the first user's character object will wink with his/her left eye. Conversely, if the virtual camera is determined to be located beyond the front range of the first user's character object, when the first user winks with his/her right eye, the first user's character object will wink with his/her right eye.

In the above example, we have explained the movement of the face, but the same control method can be used for the movement of the head and arms.

This can eliminate the awkwardness that can arise from the positional relationship between the virtual camera and the character object.

The inverted and non-inverted states may be switched at the command of the first user.

In addition, if the first user's character object moves beyond the movable area, the second video generation unit 414 can make it reappear from another position in the virtual space.

When the virtual space is a space as shown in Figures 22 and 27, if a character object moves beyond the edge of the disk-shaped ground, it is possible to make the character object fall below the tower and reappear by descending from the upper center of the disk-shaped ground. By making the reappearance position the center, it is convenient for the character object to go in any direction within the world. Also, if the character object gets lost within the world, it can return to the reference central position.

As described above, the configuration of the first embodiment can provide a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above. Specifically, the configuration described above can improve the distribution user's willingness to distribute, the viewing user's willingness to watch, and/or the willingness of users to interact with each other.

Second Embodiment
Next, various functions executable by the first user terminal 100, the second user terminal 200 and/or the server device 400 provided in the information processing system 3000 according to the second embodiment of the present disclosure will be described with reference to the drawings.

The one or more computer processors included in the information processing system 3000 according to the second embodiment of the present disclosure include a transmission unit 421, a reception unit 422, a first video generation unit 423, and a second video generation unit 424, as shown in FIG. 29.

Here, the transmitting unit 421, the receiving unit 422, the first video generating unit 423, and the second video generating unit 424 are all described as being provided in the server device 400, but are not limited to this.

The transmission unit 421 transmits information about the video including the character object of the first user to the second user terminal 200 of the second user. The transmission unit 421 can be configured in the same manner as the transmission unit 411 described above.

The reception unit 422 receives a display request for the first object from the second user terminal 200. The reception unit 422 may have a configuration similar to that of the reception unit 422 described above.

The first video generating unit 423 generates first information for displaying the character object and the first object of the first user in a first area in the virtual space as a first video. The first video generating unit 423 may have a configuration similar to that of the first video generating unit 413 described above.

The second video generating unit 424 generates second information for displaying a second object S1 different from the first object G1 in a second area in the virtual space as the second video, and displaying the first user's character object CO movably in the first area and the second area. The second video generating unit 424 may have a configuration similar to that of the second video generating unit 424 described above.

The second video generating unit 440 is characterized in that, based on the placement position information associated with the first object G1, the first object G1 is displayed at a predetermined position in the first region R10 (e.g., FIG. 23) or at a position associated with the first user's character object CO.

The first object information of the first object G1 includes position information (placement position information) indicating the position where the first object G1 is displayed, as described in the explanation of the gift object.

The placement position information of the first object G1 may, for example, include the coordinates of a specific position (specific area) within the first region R10, or a part of the first user's character object CO.

In this disclosure, the first object G1 having the former placement position information is referred to as a non-attached object, and the first object G1 having the latter placement position information is referred to as an attached object.

The appearance position (display start position) of the first object G1 may be different from the above placement position.

The above configuration can provide a technical improvement that solves or alleviates at least some of the problems with the conventional technology described above. Specifically, the above configuration can improve the distribution user's willingness to distribute, the viewing user's willingness to watch, and/or the willingness of users to interact with each other.

Specifically, first, the presence of two types of videos, a first video and a second video, increases the interest of the videos.

In particular, the virtual space "world" where the second video is set is populated with attractive second objects that fit the theme, and the character objects can be moved freely to generate videos from any location and perspective, allowing users to create videos that reflect their individuality more than the first video.

In addition, by generating videos of people exploring the world, it will be easier to create topics for conversation and comments.

In addition, by making it possible to display the first object not only in the first video but also in the second video, it becomes possible to provide the first video and the second video without unnecessarily reducing the viewing user's motivation to gift.

In this way, the existence of two types of videos, the first video and the second video, and gifting improve the quality of the video content more than ever before.

In addition, as the quality of video content improves, users will be more willing to watch the videos, and as the number of viewers increases, so will the willingness of broadcasters to continue broadcasting.

And as the willingness to broadcast and watch increases, so will the interaction between broadcast users and viewer users, and even between broadcast users themselves and between viewer users themselves.

The virtual space displayed by executing the world function described above has been described as a space for distributing the second video, but it can also be used as a virtual space in which multiple avatars corresponding to multiple users can roam freely and communicate with each other, rather than being limited to a space for distributing the second video.

And one of the multiple avatars (one user) in the virtual space may be configured to be able to distribute a first video as a distribution user. In other words, according to the information processing system disclosed herein, one-to-many video distribution can be performed in a many-to-many metaverse virtual space.

When displaying the first object G1, the second video generating unit 424 can display a system comment indicating that the first object G1 is being displayed in the second video.

Alternatively, when the second video generating unit 424 receives a display request for the first object G1, it can display a system comment in the second video indicating that a display request for the first object G1 has been made (that a gift has been received).

Figures 30 and 31 show a state in which comments from the first user, the second user and/or the system are displayed on a screen V40 displaying a second video displayed on the first user terminal 100 and/or the second user terminal 200. Although omitted in Figures 30 and 31, various displays and operation UIs may be displayed in a superimposed manner, as shown in Figures 8 and 12.

In the example shown in Figures 30 and 31, the comment "XXXX, I gave you 3 bananas" is displayed as a system comment to indicate that the first object G1 (banana object) is being displayed.

The system comment may be displayed in a manner different from the comments from the first user and the second user. For example, a predetermined mark (the speech bubble mark saying "It's here!" in FIG. 31) may be displayed as a system comment indicating that the first object G1 is being displayed.

In an embodiment of the present disclosure, the first user's character object CO is capable of moving through the first region R10 and the second region R20. For example, as shown in FIG. 31, if the first object G1 is placed in the first region R10 while the first user's character object CO is moving through the second region R20, which is far away from the first region R10, the first object G1 may not be displayed on the screen, and therefore displaying such a system comment is beneficial.

Furthermore, as shown in FIG. 32, one or more computer processors in the present disclosure may further include a movement operation receiving unit 425 and a virtual camera control unit 426.

The movement operation receiving unit 425 receives a movement operation of the first user's character object in the virtual space. Details of the movement operation will be described later.

The virtual camera control unit 426 controls the operation of the virtual camera that captures images in the virtual space. Details of operation control will be described later.

When the first object G1 is displayed at a predetermined position in the first region R10, the virtual camera control unit 426 can control the operation of the virtual camera according to the positional relationship between the predetermined position and the virtual camera.

As an example, the virtual camera control unit 426 adjusts the orientation and position of the virtual camera so that the first object G1 displayed at a predetermined position in the first region R10 is within the shooting range, as shown in FIG. 33. This is automatically applied even if the virtual camera is being operated by the user, as described below.

At this time, the virtual camera is controlled so that both the first object G1 and the character object CO are within the shooting range.

On the other hand, if the first object and the character object cannot be included on the same screen due to the positional relationship between the specified position and the virtual camera, the virtual camera control unit 426 can control the operation of the virtual camera to include the first object on the screen.

As an example, the virtual camera control unit 426 adjusts the orientation and position of the virtual camera so that only the first object G1 displayed at a specific position in the first region R10 is within the shooting range, as shown in FIG. 34. This is automatically applied even if the virtual camera is being operated by the user, as described below.

In addition, when the second video generating unit 224 displays the first object G1 at a predetermined position in the first region R10, it can display a marker object M1 indicating the position of the first object in the virtual space according to the position of the character object CO in the virtual space.

As an example, as shown in FIG. 35, the second video generation unit 424 displays a marker object M1 to point to (the direction of) a first object displayed at a specific position in the first region R10, regardless of the current position and orientation of the virtual camera.

In addition, even if the placement position information associated with the first object G1 indicates that the first object should be displayed at a specified position in the first region R10, the second video generation unit 424 can display the first object at a position associated with the first user's character object CO.

As an example, the second video generation unit 424 displays the first object G1 at a position (above the head) associated with the first user's character object CO, as shown in FIG. 36. According to this example, it is possible to increase the likelihood that the first object G1 will be included in the shooting range regardless of where the first user's character object CO is located in the virtual space. This makes it possible to effectively inform the distribution user and viewing user of important gifts on a display screen of limited size that cannot display the entirety of the large virtual space.

As described above, the configuration of the second embodiment can provide a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above. Specifically, the configuration described above can improve the willingness of broadcasting users to broadcast, the willingness of viewing users to watch, and/or the willingness of users to interact with each other.

Third Embodiment
Next, various functions executable by the first user terminal 100, the second user terminal 200 and/or the server device 400 provided in the information processing system 3000 according to the third embodiment of the present disclosure will be described with reference to the drawings.

The one or more computer processors included in the information processing system 3000 according to the third embodiment of the present disclosure include a transmission unit 431, a reception unit 432, a first video generation unit 433, a second video generation unit 434, and an association unit 435, as shown in FIG. 37.

Here, the sending unit 431, the receiving unit 432, the first video generating unit 433, the second video generating unit 434, and the association unit 435 are all described as being included in the server device 400, but this is not limited to the above.

The transmission unit 431 transmits information about the video including the character object CO of the first user to the second user terminal 200 of the second user. The transmission unit 431 can be configured in the same manner as the transmission unit 411 described above.

The reception unit 432 receives a request to display the first object from the second user terminal 200. The reception unit 432 may be configured in the same manner as the reception unit 412 described above.

The first video generating unit 433 generates first information for displaying the character object and the first object of the first user in a first area in the virtual space as a first video. The first video generating unit 433 may have a configuration similar to that of the first video generating unit 413 described above.

The second video generating unit 434 generates second information for displaying a second object S1 different from the first object G1 in a second area in the virtual space as the second video, and displaying the first user's character object CO movably in the first area and the second area. The second video generating unit 434 may be configured in the same manner as the second video generating unit 414 described above.

Furthermore, as shown in FIG. 38, the second video generating unit 434 displays a third object P1, which is different from the first object G1 and the second object S1, in the second region R20.

Figure 39 shows an image of the third object P1. In Figure 39, two-dimensional panel-like objects P11 to P14 are shown as the third object P1. Note that the third object is not limited to a two-dimensional panel-like object, and may be a three-dimensional object.

Each of the objects P11 to P14 displays an attached object together with a character image. The character image displayed on the image object may be an image of the first user's character object, or it may be a different image.

When a predetermined relationship is established between the first user's character object CO and the third object P1, the association unit 435 associates the first user's character object CO with the fourth object W1 that is associated with the third object P1.

The specified relationship may be at least a part of the character object CO (hands, feet, etc.) touching the third object P1, the distance between the character object CO and the third object P1 becoming a specified distance, the character object CO pressing a button object associated with the third object P1, etc. Note that touching the third object P1 includes the character object CO being in contact with the third object P1 for a specified period of time, being within a specified distance for a specified period of time, and pressing for a specified period of time.

These predetermined relationships are not particularly limited, but can be such that the second user watching the video can visually understand that the first user's character object CO is attempting to associate with the fourth object W1.

In addition, when the association unit 435 associates the fourth object W1 with the character object CO of the first user, the second video generation unit 434 displays the fourth object W1 in association with the character object CO of the first user.

That is, the attachment object displayed on the third object P1 is attached to the character object CO and displayed as the fourth object W1. In the example shown in FIG. 39, the character object CO of the first user is in a predetermined relationship with the third object P14, and the fourth object (sparkly object) W14, which is the attachment object displayed on the third object P14, is attached around the head of the character object CO.

This fourth object W1 may be the same object as a gift object that the second user can request to be displayed as a gift, as described below, or it may be a special object that cannot be thrown as a gift.

In the former case, the fourth object W1 corresponds to a high-value gift. This is because high-value gifts are rarely given by the second user, and so the first and second users have little opportunity to see/wear the object, but by making it specially available for free in the world function, the world function is activated and users are motivated to give it in the first video as well.

The third object P1 may be the same for all users, or may be different depending on the theme of the world being displayed. The third object P1 to be displayed may be determined based on information about the first user.

The above configuration can provide a technical improvement that solves or alleviates at least some of the problems with the conventional technology described above. Specifically, the above configuration can improve the distribution user's willingness to distribute, the viewing user's willingness to watch, and/or the willingness of users to interact with each other.

Specifically, first, the presence of two types of videos, a first video and a second video, increases the interest of the videos.

In particular, the virtual space "world" where the second video is set is populated with attractive second objects that fit the theme, and the character objects can be moved freely to generate videos from any location and perspective, allowing users to create videos that reflect their individuality more than the first video.

In addition, by generating videos of people exploring the world, it will be easier to create topics for conversation and comments.

In addition, by displaying a third object that appears in the second video and allowing the character object to freely wear a corresponding fourth object, it becomes easier to create topics of conversation and comments, and interactions between users become more active.

In addition, by visually showing the process of putting on the fourth object in the video, it is possible to create a sense of anticipation in the first user and/or the second user.

In addition, if the fourth object corresponds to a high-value gift, since high-value gifts are rarely cast by the second user, the first and second users will have difficulty seeing/wearing that object. However, by making it possible to specially wear the object in the world function, the world function will be activated and this will motivate users to try casting it in the first video as well.

In this way, the presence of two types of video, the first video and the second video, and the fourth object improves the quality of the video content compared to the past.

In addition, as the quality of video content improves, users will be more willing to watch the videos, and as the number of viewers increases, so will the willingness of broadcasters to continue broadcasting.

And as the willingness to broadcast and watch increases, so will the interaction between broadcast users and viewer users, and even between broadcast users themselves and between viewer users themselves.

The virtual space displayed by executing the world function described above has been described as a space for distributing the second video, but it can also be used as a virtual space in which multiple avatars corresponding to multiple users can roam freely and communicate with each other, rather than being limited to a space for distributing the second video.

And one of the multiple avatars (one user) in the virtual space may be configured to be able to distribute a first video as a distribution user. In other words, according to the information processing system disclosed herein, one-to-many video distribution can be performed in a many-to-many metaverse virtual space.

The second video generating unit 434 can display a loading image for a predetermined period of time when the association unit 435 performs the association.

Figure 40 shows an example of the loading image L1. In Figure 40, the loading image L1 is displayed at the same time as the character object CO steps on the third object P1 (P11), and when the circular meter increases from 0% to 100%, the fourth object W1 (W11) is attached to the character object CO.

By taking the time to load, the display makes it clear to the second user watching that the character object is attempting to associate with a fourth object. This can further increase the sense of anticipation of the first user and/or the second user.

The time it takes for the meter to fill up (loading time) is not particularly limited, but the loading time may be longer as the value of the fourth object increases.

As shown in FIG. 41, one or more computer processors in the present disclosure may further include a selection screen generation unit 436.

The selection screen generation unit 436 generates information for displaying a selection screen V30 on the second user terminal 200 for making a display request for the first object G1.

As shown in FIG. 20, the selection screen V30 displays multiple selectable images for requesting the display of the first object G1.

The image for requesting the display of the first object G1 related to the fourth object among the images can be displayed in a manner different from the other images, as shown in FIG. 42.

For example, in a state where the first user can freely wear a triangular hat as a fourth object in the second video, there is little display benefit to the second user giving a gift of a triangular hat (however, it does contribute to the amount (points) of the gift obtained by the first user (given by the second user), so there is a benefit in that respect).

Therefore, the image of the first object G1 related to the fourth object is displayed in a manner different from the other images, allowing the second user to make a selection after understanding the above circumstances.

Note that "related to the fourth object" does not necessarily mean that the object is the same as the fourth object, but also includes cases where the object is different from the fourth object but is displayed in approximately the same position.

As an example of the different aspect, Figure 42 shows an example in which the frame is highlighted, but it is also possible to add a badge or change the color.

In addition, when a request is made by the second user to display a first object G1 related to the fourth object, a special effect may be generated in the video.

Special effects include, but are not limited to, displaying a different object or generating a sound effect. The different object can be, for example, a presentation object such as a confetti object or a cracker object.

This configuration makes it possible to compensate for the disadvantages in terms of display.

Furthermore, as shown in FIG. 41, one or more computer processors of the present disclosure may further include a determination unit 437.

When there is a display request for a first object G1 to be displayed in association with a specific position of the first user's character object CO, the determination unit 437 determines whether or not a fourth object W1 is already being displayed in association with a specific position of the first user's character object CO.

Figure 43 shows an example of a process flow including a determination step by the determination unit 437.

As shown in FIG. 43, one or more computer processors execute a step of determining whether or not there has been a display request for a first object to be displayed in association with a particular position of a character object of a first user (S401).

When it is determined that there is a display request for a first object to be displayed in association with a specific position of the first user's character object, a step of determining whether or not a fourth object is displayed in association with the specific position of the first user's character object is executed (S402). The specific position may be the same position, and also includes a substantially same position.

If it is determined that the fourth object is already being displayed in association with a specific position of the first user's character object, the second video generating unit 440 can either display the first object in place of the fourth object, or display both the fourth object and the first object in association with a specific position.

That is, if it is determined that the fourth object is displayed in association with a specific position of the character object of the first user, the second video generating unit 440 executes a step (S403) of displaying the first object in place of the fourth object, or displaying both the fourth object and the first object in association with a specific position.

Whether to display the first object in place of the fourth object or both the fourth object and the first object can be determined based on the properties of the first object. For example, if the value of the first object is higher than a standard, the first object is displayed in place of the fourth object, and if the value of the first object is lower than the standard, both are displayed. The standard may be the value of the fourth object when it is a gift, or may be set by the first user or the management side.

If it is determined that the fourth object is not displayed in association with a specific position of the first user's character object, the second video generating unit 440 executes a step of displaying the first object in association with a specific position (S404).

As another example, when there is a display request for a first object to be displayed in association with a specific position of the first user's character object, if the determination unit 437 determines that a fourth object is already being displayed in association with a specific position of the first user's character object, the second video generation unit 434 can display the first object instead of the fourth object based on an instruction from the first user terminal.

At this time, a display instruction object for performing the above instruction may be displayed on the first user's screen. This allows the first user to display the first object, which is a gift from the second user, at a time of his or her choosing.

In the above example, we determined whether the fourth object was already displayed, but the reverse is also true.

That is, as shown in FIG. 44, one or more computer processors execute a step of determining whether or not a predetermined relationship has been established between the first user's character object CO and the third object P1 (S405).

Then, if it is determined that the first user's character object CO and the third object P1 have a predetermined relationship, a step is executed (S406) of determining whether the first object is displayed in association with a specific position of the first user's character object. The specific position may be the same position, and also includes a substantially same position.

Then, if it is determined that the first object is displayed in association with a specific position of the character object of the first user, the second video generating unit 440 executes a step of displaying a fourth object in place of the first object, or displaying both the fourth object and the first object in association with a specific position (S407).

Whether to display a fourth object in place of the first object, or to display both the fourth object and the first object, can be determined based on the properties of the fourth object. For example, if the value of the fourth object is higher than the value of the first object, the fourth object is displayed in place of the first object, and if the value of the fourth object is lower than the value of the first object, both are displayed. The value of the fourth object can be set to the value it would be if the fourth object were a gift.

If it is determined that the first object is not displayed in association with a specific position of the first user's character object, the second video generating unit 440 executes a step of displaying a fourth object in association with a specific position (S408).

As another example, if the determination unit 437 determines that a first object is already being displayed in association with a specific position of the first user's character object, the second video generation unit 434 can display a fourth object in place of the first object based on an instruction from the first user terminal.

At this time, a display instruction object for performing the above instruction may be displayed on the first user's screen. This allows the first user to display the fourth object at a timing of his or her choice.

Also, as shown in FIG. 38, the second video generating unit 440 can display a fifth object P2, which is different from the first object G1, the second object S1, and the third object P1, in the second region R20.

The fifth object P2 is, as an example, a release object as shown in FIG. 45.

The association unit 435 can then disassociate the fourth object associated with the first user's character object when a predetermined relationship is established between the first user's character object and the fifth object P2.

In other words, the fifth object P2 is an object that disassociates the fourth object W1 from the character object CO and makes them invisible. The specified relationship can be the same as that described in the explanation of the third object.

In addition, when a fourth object W1 is associated with the first user's character object CO, the association unit 435 can release the association of the fourth object W1 associated with the first user's character object CO when the first user's character object CO and the third object P1 once again have a predetermined relationship.

That is, when the character object CO steps on the third object P1 once, the fourth object W1 is associated with it, and when the character object CO steps on the third object P1 a second time, the association with the fourth object W1 is released and the object is hidden. Note that when the character object CO steps on the third time, the fourth object W1 is again associated with the character object, but there may be an upper limit on the number of times that the object can be associated.

Also, as shown in FIG. 45, for example, when a fourth object W11 is displayed in association with a third object P11 by stepping on it, if another third object P12 is then stepped on, the association of the fourth object W11 is released and a fourth object W12 corresponding to the other third object P12 is attached.

Alternatively, for example, when a fourth object W11 is displayed in association with a third object P11 by stepping on it, if another third object P12 is then stepped on, the association of the fourth object W11 is not released, and a fourth object W12 corresponding to the other third object P12 may be further attached.

Also, as described above, if the character object CO moves outside the area and reappears, the association with all fourth objects may be released.

If no display time is set for the fourth object W1, the association may not be released unless the above action is taken.

When the theme of the world is changed (when the second object S1 is changed), the third object P1 can be changed to another third object P1 in line with the theme of the world. When there are multiple third objects P1, all or part of them may be changed.

Even if the world theme is changed, the fourth object W1 that is already attached will continue to be displayed.

Using this configuration, a mission using a fourth object may be generated, and a specified effect may be generated when the mission is cleared.

An example of a mission would be to equip, after a theme change, a fourth object that has a specific relationship to the fourth object that was equipped before the theme was changed. Such a mission can also continue across multiple theme changes.

For example, if a fourth object that is an ice cream object can be equipped in each theme, the mission could be to pile ice cream onto the character object's head each time the theme changes.

The predetermined effect may be, for example, but is not limited to, displaying another object or generating a sound effect. The other object may be, for example, a presentation object such as a confetti object, a cracker object, or a paper balloon object.

These predetermined effects can be configured to become more spectacular each time the theme is changed.

The above configuration allows the first user to enjoy a longer broadcast time, and also increases the interest of the video, thereby increasing the second user's desire to watch.

As described above, the configuration of the first embodiment can provide a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above. Specifically, the configuration described above can improve the distribution user's willingness to distribute, the viewing user's willingness to watch, and/or the willingness of users to interact with each other.

<Fourth embodiment>
Next, various functions executable by the first user terminal 100, the second user terminal 200 and/or the server device 400 provided in the information processing system 3000 according to the fourth embodiment of the present disclosure will be described with reference to the drawings.

The one or more computer processors included in the information processing system 3000 according to the fourth embodiment of the present disclosure include a transmission unit 141, a movement operation reception unit 142, a virtual camera control unit 143, and a video generation unit 144, as shown in FIG. 46.

Here, the transmission unit 141, movement operation reception unit 142, virtual camera control unit 143, and video generation unit 144 are all described as being provided in the first user terminal 100, but this is not limited to the above.

The transmission unit 141 transmits information about the video including the character object of the first user to the second user terminal 200 of the second user.

As an example, the video may be a video streamed in real time by the first user.

The information regarding the video may be, for example, information for enabling the video to be viewed on the second user terminal 200, and rendering of the video may be performed on the first user terminal 100 or the server device 400, or may be performed on the second user terminal 200.

At least the facial portion of the character object included in the video may reflect the facial movements of the first user captured by a camera provided on the first user terminal.

The movement operation receiving unit 142 receives a movement operation of the first user's character object in the virtual space. The virtual space can be the space shown in FIG. 22. The method of receiving the movement operation will be described later.

The virtual camera control unit 143 accepts camera operations for the virtual camera that takes pictures in the virtual space. The method for accepting camera operations will be described later.

The video generation unit 144 generates information to enable the first user's character object to move within the virtual space based on the movement operation and camera operation.

The information generated here is the second information described above, and the video is displayed based on the second information. In other words, the video sent to the second user terminal 200 is the second video.

In this embodiment, a first movement action is applied to the character object of the first user in response to a predetermined operation on the first operation UI displayed on the first user terminal 100 of the first user.

In addition, a second movement action is applied to the first user's character object in response to a specified operation on the second operation UI displayed on the first user terminal 100.

In addition, the viewpoint of the virtual camera can be switched between a first-person viewpoint and a third-person viewpoint in response to a specific operation on the third operation UI displayed on the first user terminal 100.

Figure 47 shows an image of a screen D50 displayed on a first user terminal 100, in which a first operation UI 51, a second operation UI 52, and a third operation UI 53 are displayed.

The first operation UI51 is a virtual joystick, and can move an object horizontally in a virtual space according to the swipe direction from an initial position of a touch within an outer circular area of the first operation UI51. The inner circle within the outer circular area is displayed to move within the outer circular area according to the touch position. The moving speed of the character object may be changed according to the moving distance from the initial position. Also, the moving speed of the character object does not need to be changed according to the moving distance from the initial position. In this case, the change in speed is constant, and an easy-to-view screen can be provided.

The second operation UI 52 can move the character object vertically in the virtual space in response to a tap within a circular area of the second operation UI 52.

The third operation UI 53 switches between a first-person perspective and a third-person perspective by a tap operation. FIG. 47 shows an image of a screen displaying a video from a third-person perspective, and FIG. 48 shows an image of a screen displaying a video from a first-person perspective.

Then, the virtual camera is moved, rotated and/or scaled in response to a predetermined operation performed on an area (fifth area) in the first user terminal 100 where the first operation UI 51, the second operation UI 52 and the third operation UI 53 are not displayed.

Specifically, a rotation operation is applied to the virtual camera in response to a one-finger swipe operation on the fifth area.

In addition, a movement operation is applied to the virtual camera in response to a two-finger swipe operation on the fifth area.

In addition, a zoom operation is applied to the virtual camera in response to a two-finger pinch-in/pinch-out operation on the fifth area.

The above configuration can provide a technical improvement that solves or alleviates at least some of the problems with the conventional technology described above. Specifically, the above configuration can improve the distribution user's willingness to distribute, the viewing user's willingness to watch, and/or the willingness of users to interact with each other.

Specifically, the existence of a second video improves the quality of the video's content.

The above configuration also improves the operability of the character object in the second video.

In addition, improved video quality will increase viewing users' motivation to watch, and as the number of viewing users increases, broadcasting users' motivation to broadcast will also increase.

And as the willingness to broadcast and watch increases, it leads to more interaction between broadcast users and viewing users, and even between viewing users themselves.

The virtual space displayed by executing the world function described above has been explained as a space for distributing the second video (world function), but it can also be used as a virtual space in which multiple avatars corresponding to multiple users can roam freely and communicate with each other, rather than being limited to a space for distributing the second video.

A single avatar (single user) among multiple avatars in the virtual space may be configured to be able to distribute a first video as a distribution user. In other words, one-to-many video distribution can be performed in a many-to-many metaverse virtual space.

Depending on a specific operation on the first user terminal, it is possible to switch between displaying and not displaying comments on a video displayed on the first user terminal.

Figure 49 shows the comment section D54 displayed on the screen D50 shown in Figure 48.

Then, when switching between displaying and not displaying comments on the video, the one or more computer processors can change the display positions of the first operation UI and the second operation UI, or can hide the first operation UI 51, the second operation UI 52, and the third operation UI 53.

Specifically, in the examples shown in Figures 48 and 49, the display position is changed, while in the examples shown in Figures 48 and 50, it is not displayed.

Also, as described above, the first movement motion can be horizontal movement (e.g., walking) and the second movement motion can be vertical movement (e.g., jumping).

The one or more computer processors also apply a rotation operation to the virtual camera in response to a single-finger swipe operation on the area (fifth area).

The one or more computer processors also apply a movement operation to the virtual camera in response to a two-finger swipe operation on the area (fifth area).

The one or more computer processors also apply a zoom operation to the virtual camera in response to a two-finger pinch-in/pinch-out operation on the area (fifth area).

These operations allow you to freely project images within the virtual space.

In addition, the virtual camera control unit 143 can accept camera operations from the first user or a user authorized by the first user.

The user authorized by the first user can be, for example, one of the guest users, but details will be given later.

The above configuration can provide a technical improvement that solves or alleviates at least some of the problems with the conventional technology described above. Specifically, the above configuration can improve the distribution user's willingness to distribute, the viewing user's willingness to watch, and/or the willingness of users to interact with each other.

Fifth embodiment
Next, various functions executable by the first user terminal 100, the second user terminal 200 and/or the server device 400 provided in the information processing system 3000 according to the fifth embodiment of the present disclosure will be described with reference to the drawings.

The one or more computer processors included in the information processing system 3000 according to the fifth embodiment of the present disclosure include a transmission unit 151, a movement operation reception unit 152, a virtual camera control unit 153, and a video generation unit 154, as shown in FIG. 51.

The transmission unit 151 transmits information about the video including the character object of the first user to the second user terminal 200 of the second user. The transmission unit 151 may have a configuration similar to that of the transmission unit 141 described above.

The movement operation receiving unit 152 receives a movement operation of the first user's character object in the virtual space. The movement operation receiving unit 152 can be configured in the same manner as the movement operation receiving unit 142 described above.

The virtual camera control unit 153 accepts camera operations for a virtual camera that captures images in a virtual space. The virtual camera control unit 153 can be configured in the same manner as the virtual camera control unit 143 described above.

The video generation unit 154 generates information for enabling the first user's character object to move within the virtual space based on the movement operation and the camera operation. The video generation unit 154 can be configured in the same way as the video generation unit 144 described above.

The video generation unit 154 in this disclosure is further capable of generating information for displaying character objects of one or more other users in the video.

The video generated in this manner is called a collaboration video, in which the first user is the "host user" and the other users are the "guest users". The details of the collaboration video have been described above, but the viewing user (second user) sends a request to participate in the video via a collaboration distribution participation request confirmation screen that is displayed by pressing the collaboration application button V15 shown in FIG. 12, and the video generation unit 154 displays a character object of the viewing user (other user) who made the participation request in the video in response to the participation request accepted by the acceptance unit. Note that this character object of the other user may be generated based on the movement of the other user, or may be based on the operation of the other user. Hereinafter, guest users participating in the collaboration will be referred to as "other users", and viewing users not participating in the collaboration will be referred to as "second users".

Figure 52 shows an image of a screen V50 displaying a video showing a character object C1 of a first user (host user) and character objects C2 and C3 of other users (guest users).

The display start position of the character objects of other users is the first area. If a display request is made while the first video is being displayed, all of the character objects are in the first area, so the character objects are displayed in an aligned state (Figures 15 and 16). However, if a display request is made while the second video is being displayed, users other than the other user who made the display request are able to move freely within the first area or the second area, so the character objects may be displayed in a scattered state.

Furthermore, when switching to the second video during collaboration in the first video, the second video starts with all of the character objects in the first area. Specifically, in the first video, virtual camera VC1 is applied which shoots the character objects from the center of the virtual space (FIG. 24), while in the second video, virtual camera VC2 is applied which shoots the character objects from the edge of the virtual space (the side opposite virtual camera VC1) (FIG. 25). Therefore, at the start of the second video, a video in which virtual camera VC2 is shooting from behind the character objects is displayed.

The transmission unit 151 in this disclosure is characterized by transmitting a video of the first user's character object C1 from a first-person perspective or a third-person perspective to the second user terminal 200.

Here, the video sent to the second user terminal 200 is the second video. In other words, the collaboration video in the fifth embodiment is a video in which the world function is being executed.

Figure 52 is an example showing a video of a first user's character object C1 from a third-person perspective, in which the back of the head of the first user's character object C1 and the other users' character objects C2 and C3 are displayed. On the other hand, Figure 53 is an example showing a video of the other user's character object C2 from a first-person perspective, in which the first user's character object C1 and the other user's character object C3 are displayed. Note that the positions of the character objects and other objects are not related between Figure 52 and Figure 53.

The above-mentioned switching between the first-person viewpoint and the third-person viewpoint can be performed by operating the third operation UI 53 shown in FIG. 47. Note that the other users can operate their own character objects while their own character objects are participating in a collaboration, and the first operation UI 51, second operation UI 52, and third operation UI 53 shown in screen D50 are displayed on the screen of their own terminals.

The above configuration can provide a technical improvement that solves or alleviates at least some of the problems with the conventional technology described above. Specifically, the above configuration can improve the distribution user's willingness to distribute, the viewing user's willingness to watch, and/or the willingness of users to interact with each other.

Specifically, by providing a collaboration function for the second video as well, the quality of the video as content will be improved. It will also lead to more active interaction between users participating in the collaboration, between users participating in the collaboration and viewing users, and even between viewing users themselves.

In addition, improved video quality will increase viewing users' motivation to watch, and as the number of viewing users increases, broadcasting users' motivation to broadcast will also increase.

The transmission unit 151 can also transmit information about multiple videos of the first-person or third-person perspective of the first user's character object and the first-person or third-person perspective of the other users' character objects to the second user terminal 200.

Figure 54 shows, as an example, a display area V61 for a video of a third-person perspective of a first user's character object C1, a display area V62 for a video of a third-person perspective of a character object C2 of another user, and a display area V63 for a video of a first-person perspective of a character object C3 of another user, all displayed on a single screen V60.

Whether to display only the screen from the viewpoint of the first user's character object as in the examples shown in Figures 52 and 53, or to split and display the screens from the viewpoints of all users' character objects as in the example shown in Figure 54 can be determined by the selection of the first user or the second user, as described below. Note that in Figure 54, there is a blank space because there are two guests participating in the collaboration, but a third guest can be displayed here.

In addition, while Figure 54 shows an example in which the display area is divided equally into rectangles, the shape of the display area is not particularly limited, and the size of the display area may be distributed so that the first user is larger and the other users are smaller.

Although FIG. 54 shows a state in which the various displays and operation UIs are not displayed, the various displays and operation UIs may be displayed in a superimposed manner, as shown in FIG. 8 and FIG. 12.

In addition, the screens of users participating in the collaboration (the first user and other users) may display only their own first-person/third-person screens, or may display the first-person/third-person screens of all users as shown in FIG. 54. These may be switchable by the individual selection of the users participating in the collaboration.

Furthermore, one or more computer processors in the present disclosure may include a selection receiving unit 155, as shown in FIG. 55.

The selection receiving unit 155 receives a selection by the first user or the second user of a user from among the first user and one or more other users.

In other words, the first user who is the host user, or the second user who is the viewing user, can select one user from among the users participating in the collaboration.

At this time, the transmission unit 151 can transmit information about the video in accordance with the selection accepted by the selection acceptance unit 155.

Specifically, when the selection receiving unit 155 receives a selection by the first user of one other user from one or more other users, the transmission unit 151 transmits information related to the first-person perspective video of the one other user.

This assumes, for example, that the character object of the first user is a performer and the selected other user is a cameraman. Normally, the first user needs to operate the virtual camera while simultaneously controlling his or her own movements and/or the character object. However, to generate a higher quality video, it is easier to delegate camera operation authority to another user. In this case, the character object of the selected other user becomes a backstage staff member, so the video is automatically set to a first-person perspective rather than a third-person perspective.

In addition, when the selection receiving unit 155 receives a selection by the second user of a user from among the first user and one or more other users, the transmission unit 151 may transmit information regarding a first-person perspective or third-person perspective video of the character object of the selected user to the second user terminal.

The second user's screen may display a video from the viewpoint of the character object of the user selected by the second user, or may display a video from the viewpoint of the character object of the user who has been selected (voted) the most by multiple second users, including the second user and other second users. The type of viewpoint (first person viewpoint/third person viewpoint) displayed at this time may be the type of viewpoint selected by the user providing the video from that viewpoint, or may be further selected by the first user or the second user.

In addition, while in the above example, multiple second users vote fairly, a specific second user may be configured to determine the video to be displayed to all other second users. A specific second user may be, for example, a user who has many points calculated based on gift display requests and the value of the gifts requested to be displayed (as an example, a user who has given a large amount of gifting), a user who has viewed a large number of videos distributed by first users, etc.

In addition, when the selection receiving unit 155 receives a selection by the first user of one other user from one or more other users, one or more computer processors in the present disclosure may further include a performance receiving unit 156 and an effect generating unit 157, as shown in FIG. 55.

The effect reception unit 156 receives requests from other users to display effect effects on videos.

The effect generation unit 157 generates a visual effect for the video in response to the display request received by the effect reception unit 156.

Examples of the presentation effects include, but are not limited to, displaying another object or generating a sound effect, as shown in FIG. 56. The other object can be, for example, a presentation object such as a confetti object, a cracker object, or a paper balloon object.

The transmitting unit 151 is characterized by transmitting information about the video in which the dramatic effect is generated.

This assumes, for example, that the first user's character object is a performer, and the other selected users are special effects staff. Typically, the first user needs to activate special effects while simultaneously controlling their own movements and/or the character object. However, in order to generate a higher quality video, it is easier to delegate the authority to activate effects to other users.

In addition, when the selection receiving unit 155 receives a selection by the first user of one other user from one or more other users, one or more computer processors in the present disclosure may further include a switching receiving unit 158.

The switching reception unit 158 receives requests from other users to switch objects in a video.

An object switching request is a request to change the above-mentioned second object to another second object. In the above example, the conditions for changing the second object were described as the arrival of a scheduled time, the passage of a scheduled time, or a change instruction from the first user or another user, and this example corresponds to a change instruction from another user.

In response to a switching request received by the switching receiving unit 158, the video generating unit 154 can change objects other than the first user's character object C1 and the other user's character object C2 displayed in the virtual space to other objects (Figures 57 and 58).

As shown in Figures 57 and 58, there may be some objects that remain unchanged (such as tower cake objects).

In addition, when a viewing user makes a request to display a wearing gift, a display instruction object for displaying a gift object corresponding to the wearing gift in the video in response to the display request may be displayed on the screen of one other user whose selection by the first user or the second user is accepted by the selection accepting unit 155. This allows the other user to have the first user (or a guest user other than the other user) wear and display the wearing gift object at a time of their choice.

The above configuration can provide a technical improvement that solves or alleviates at least some of the problems with the conventional technology described above. Specifically, the above configuration can improve the distribution user's willingness to distribute, the viewing user's willingness to watch, and/or the willingness of users to interact with each other.

The first to fifth embodiments described above can be combined with each other, and parts of these embodiments can also be combined with each other.

Next, we will explain the information processing method in an embodiment of the present disclosure.

The information processing method in the embodiment of the present disclosure is an information processing method in the information processing system 3000 shown in FIG. 3. The information processing system 3000 includes one or more first user terminals 100, second user terminals 200, and a server device 400.

As shown as an example in FIG. 59, the information processing method of the present disclosure causes one or more computer processors included in the information processing system 3000 to execute a sending step S421, a receiving step S422, a first video generating step S423, and a second video generating step S424.

The transmission step S421 transmits information about the video including the character object of the first user to the second user terminal 200 of the second user. Such a transmission step S421 can be executed by the transmission unit 421 described above.

The sending step S421 may be executed on the server side (server device 400) or on the client side (first user terminal 100).

The reception step S422 receives a request to display the first object from the second user terminal 200. Such reception step S422 can be executed by the reception unit 422 described above.

The reception step S422 may be executed on the server side (server device 400) or on the client side (first user terminal 100).

The first video generation step S423 generates first information for displaying the character object and the first object of the first user in a first area in the virtual space as the first video. Such a first video generation step S423 can be executed by the first video generation unit 423 described above.

The first video generation step S423 may be executed on the server side (server device 400) or on the client side (first user terminal 100).

The second video generation step S424 generates second information for displaying a second object different from the first object in a second area in the virtual space as the second video, and displaying the character object of the first user movably in the first area and the second area. Such second video generation step S424 can be executed by the second video generation unit 424 described above.

The second video generation step S424 may be executed on the server side (server device 400) or on the client side (first user terminal 100).

Then, in a second video generation step S424, the first object is displayed at a predetermined position in the first area or at a position associated with the first user's character object based on the placement position information associated with the first object.

The above configuration can provide a technical improvement that solves or alleviates at least some of the problems with the conventional technology described above. Specifically, the above configuration can improve the distribution user's willingness to distribute, the viewing user's willingness to watch, and/or the willingness of users to interact with each other.

Next, we will explain the computer program in an embodiment of the present disclosure.

The computer program in the embodiment of the present disclosure is a computer program executed in an information processing system 3000 that distributes videos, as shown in FIG. 3. The information processing system 3000 includes one or more first user terminals 100, second user terminals 200, and a server device 400.

The computer program in the present disclosure is characterized in that it causes one or more computer processors provided in the information processing system 3000 to realize a transmission function, a reception function, a first video generation function, and a second video generation function.

The transmission function transmits information about the video including the character object of the first user to the second user terminal 200 of the second user.

The reception function accepts a request to display the first object from the second user terminal 200.

The first video generation function generates first information for displaying the first user's character object and the first object in a first area in the virtual space as a first video.

The second video generation function displays a second object different from the first object in a second area in the virtual space as a second video, and generates second information for displaying the character object of the first user movably in the first area and the second area.

Then, the second video generation function displays the first object at a predetermined position in the first area or at a position associated with the first user's character object based on the placement position information associated with the first object.

The above functions can be realized by the transmission circuit 1421, reception circuit 1422, first video generation circuit 1423, and second video generation circuit 1424 shown in FIG. 60. The transmission circuit 1421, reception circuit 1422, first video generation circuit 1423, and second video generation circuit 1424 are realized by the transmission unit 421, reception unit 422, first video generation unit 423, and second video generation unit 424 described above, respectively. Details of each unit are as described above.

The above configuration can provide a technical improvement that solves or alleviates at least some of the problems with the conventional technology described above. Specifically, the above configuration can improve the distribution user's willingness to distribute, the viewing user's willingness to watch, and/or the willingness of users to interact with each other.

Next, an information processing device in an embodiment of the present disclosure will be described. The information processing device corresponds to the first user terminal 100 in the information processing system 3000 described above.

As shown in FIG. 61, the information processing device includes a transmission unit 121, a first video generation unit 122, and a second video generation unit 123.

The transmission unit 121 transmits information about the video including the character object of the first user to the server device 400.

The first video generating unit 122 generates first information for displaying, as a first video, the character object of the first user and a first object requested to be displayed by the second user terminal 200 in a first area in the virtual space. The first video generating unit 122 may be configured in the same manner as the first video generating unit 423 described above.

The second video generating unit 123 generates second information for displaying a second object different from the first object in a second area in the virtual space as the second video, and displaying the character object of the first user movably in the first area and the second area. The second video generating unit 123 may have a configuration similar to that of the second video generating unit 424 described above.

Then, the second video generation unit 123 displays the first object at a predetermined position in the first area or at a position associated with the character object of the first user based on the placement position information associated with the first object.

The above configuration can provide a technical improvement that solves or alleviates at least some of the problems with the conventional technology described above. Specifically, the above configuration can improve the distribution user's willingness to distribute, the viewing user's willingness to watch, and/or the willingness of users to interact with each other.

Next, an information processing method according to an embodiment of the present disclosure will be described. This information processing method is executed in the information processing device (first user terminal 100) described above.

The information processing method of the present disclosure is characterized in that, as shown as an example in FIG. 62, one or more computer processors included in an information processing device execute a transmission step S121, a first video generation step S122, and a second video generation step S123.

The transmission step S121 transmits information about the video including the character object of the first user to the server device 400. Such a transmission step S121 can be executed by the transmission unit 121 described above.

The first video generation step S122 generates first information for displaying, as a first video, the character object of the first user and the first object requested to be displayed by the second user terminal 200 in a first area in the virtual space. Such a first video generation step S122 can be executed by the first video generation unit 122 described above.

The second video generation step S123 generates second information for displaying a second object different from the first object in a second area in the virtual space as the second video, and displaying the character object of the first user movably in the first area and the second area. Such second video generation step S123 can be executed by the second video generation unit 123 described above.

Then, the second video generation step S123 displays the first object at a predetermined position in the first area or at a position associated with the first user's character object based on the placement position information associated with the first object.

The above configuration can provide a technical improvement that solves or alleviates at least some of the problems with the conventional technology described above. Specifically, the above configuration can improve the distribution user's willingness to distribute, the viewing user's willingness to watch, and/or the willingness of users to interact with each other.

Next, a computer program according to an embodiment of the present disclosure will be described. Such a computer program is executed in the information processing device (first user terminal) described above.

The computer program disclosed herein is characterized in that it causes one or more processors included in an information processing system to realize a transmission function, a first video generation function, and a second video generation function.

The transmission function transmits information about the video including the first user's character object to the server device 400.

The first video generation function generates first information for displaying, as a first video, the character object of the first user and a first object requested to be displayed by the second user terminal 200 in a first area in the virtual space.

The second video generation function displays a second object different from the first object in a second area in the virtual space as a second video, and generates second information for displaying the character object of the first user movably in the first area and the second area.

Then, the second video generation function displays the first object at a predetermined position in the first area or at a position associated with the first user's character object based on the placement position information associated with the first object.

The above functions can be realized by the transmission circuit 1121, first video generation circuit 1122, and second video generation circuit 1123 shown in FIG. 63. The transmission circuit 1121, first video generation circuit 1122, and second video generation circuit 1123 are realized by the transmission unit 121, first video generation unit 122, and second video generation unit 123 described above, respectively. Details of each unit are as described above.

The above configuration can provide a technical improvement that solves or alleviates at least some of the problems with the conventional technology described above. Specifically, the above configuration can improve the distribution user's willingness to distribute, the viewing user's willingness to watch, and/or the willingness of users to interact with each other.

Next, an information processing device in an embodiment of the present disclosure will be described. The information processing device corresponds to the second user terminal 200 in the information processing system 3000 described above.

As shown in FIG. 64, the information processing device includes a receiving unit 221, a transmitting unit 222, and a display unit 223.

The receiving unit 221 receives information about the video including the character object of the first user from the server device 400.

The transmission unit 222 transmits a display request for the first object to the server device 400.

The display unit 223 displays, as a first video, the character object of the first user and a first object requested to be displayed by the second user terminal 200 in a first area in the virtual space, and displays, as a second video, a second object different from the first object in a second area in the virtual space, and displays the character object of the first user movable between the first area and the second area.

Then, based on the placement position information associated with the first object, the display unit 223 displays the first object at a predetermined position in the first area in the virtual space or at a position associated with the character object of the first user.

The above configuration can provide a technical improvement that solves or alleviates at least some of the problems with the conventional technology described above. Specifically, the above configuration can improve the distribution user's willingness to distribute, the viewing user's willingness to watch, and/or the willingness of users to interact with each other.

Next, an information processing method according to an embodiment of the present disclosure will be described. This information processing method is executed in the information processing device (second user terminal 200) described above.

The information processing method of the present disclosure is characterized in that, as shown as an example in FIG. 65, one or more computer processors provided in an information processing device execute a receiving step S221, a transmitting step S222, and a displaying step S223.

The receiving step S221 receives information about the video including the character object of the first user from the server device 400. Such receiving step S221 can be executed by the receiving unit 221 described above.

The sending step S222 sends a display request for the first object to the server device 400. Such a sending step S222 can be executed by the sending unit 222 described above.

The display step S223 displays, as a first video, the character object of the first user and a first object requested to be displayed from the second user terminal in a first area in the virtual space, and displays, as a second video, a second object different from the first object in a second area in the virtual space, and displays the character object of the first user movably in the first area and the second area. Such a display step S223 can be executed by the display unit 223 described above.

Then, in the display step S223, the first object is displayed at a predetermined position in the first area in the virtual space or at a position associated with the character object of the first user based on the placement position information associated with the first object.

The above configuration can provide a technical improvement that solves or alleviates at least some of the problems with the conventional technology described above. Specifically, the above configuration can improve the distribution user's willingness to distribute, the viewing user's willingness to watch, and/or the willingness of users to interact with each other.

Finally, we will explain the computer program in an embodiment of the present disclosure. Such a computer program is a computer program executed in the above-mentioned information processing device (second user terminal 200).

The computer program disclosed herein is characterized in that it causes one or more processors provided in an information processing system to realize a receiving function, a transmitting function, and a display function.

The receiving function receives information about a video including the first user's character object from the server device 400.

The transmission function transmits a display request for the first object to the server device 400.

The display function displays, as a first video, a character object of the first user and a first object requested to be displayed by the second user terminal 200 in a first area in the virtual space, and displays, as a second video, a second object different from the first object in a second area in the virtual space, and displays the character object of the first user movable between the first area and the second area.

Then, the display function displays the first object at a predetermined position in the first area in the virtual space or at a position associated with the first user's character object based on the placement position information associated with the first object.

The above functions can be realized by the receiving circuit 1221, the transmitting circuit 1222, and the display circuit 1223 shown in FIG. 66. The receiving circuit 1221, the transmitting circuit 1222, and the display circuit 1223 are realized by the receiving unit 221, the transmitting unit 222, and the display unit 223 described above, respectively. Details of each unit are as described above.

The above configuration can provide a technical improvement that solves or alleviates at least some of the problems with the conventional technology described above. Specifically, the above configuration can improve the distribution user's willingness to distribute, the viewing user's willingness to watch, and/or the willingness of users to interact with each other.

In addition, an information processing device such as a computer or a mobile phone can be suitably used to function as the server device or terminal device according to the above-mentioned embodiments. Such an information processing device can be realized by storing a program describing the processing contents for realizing each function of the server device or terminal device according to the embodiments in a memory unit of the information processing device, and reading and executing the program by the CPU of the information processing device.

Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are included in the scope of the invention and its equivalents described in the claims.

The method described in the embodiment can be stored as a program that can be executed by a calculator (computer) on a recording medium such as a magnetic disk (floppy disk, hard disk, etc.), optical disk (CD-ROM, DVD, MO, etc.), semiconductor memory (ROM, RAM, flash memory, etc.), and can also be distributed by transmitting it via a communication medium. The program stored on the medium also includes a setting program that configures the software means (including not only execution programs but also tables and data structures) that the calculator executes. The computer that realizes this device reads the program recorded on the recording medium, and in some cases, configures the software means using the setting program, and executes the above-mentioned processing by controlling the operation of the software means. Note that the recording medium referred to in this specification is not limited to a storage medium for distribution, but also includes a storage medium such as a magnetic disk or semiconductor memory provided inside the computer or in a device connected via a network. The storage unit may function as a main storage device, an auxiliary storage device, or a cache memory, for example.

In addition, all items sent and received in the information processing system of this disclosure, such as the above-mentioned "gifts" and "comments," are electronic "data."

The Summary section above is provided to introduce in a simplified form selected concepts that are described below in the Detailed Description section. All trademarks used herein are the property of their respective owners. The statements in this Summary section are not intended to identify key features or essential features of the claimed inventions, nor are they intended to limit the scope of the claimed inventions. The above and other objects, features, and advantages of the claimed inventions will become more apparent from the Detailed Description section presented in conjunction with the accompanying drawings.

The communication lines for implementing the above-mentioned network may include, but are not limited to, a cellular network, a wireless network (e.g., Bluetooth, WiFi (such as IEEE 802.11a/b/n), WiMax, cellular, satellite, laser, infrared, RF connection), a landline network, the Internet, an intranet, a local area network (LAN), a wide area network (WAN), and/or an Ethernet network.

The memory mentioned above may include, but is not limited to, computer readable media such as volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read only memory (ROM), EEPROM, flash memory), and storage (e.g., hard disk drive (HDD), solid state drive (SSD), magnetic tape, optical media). As will be readily understood, the term "computer readable recording medium" may include media for data storage such as memory and storage, as well as transmission media such as modulated data signals or transitory signals.

This specification is described in terms of representative embodiments that are not intended to be limiting in any manner. As used in this application, singular forms such as "a," "the," "said," "above," "the," "the," "this," and "it" can include the plural, unless the plural is clearly not indicated. Also, the term "comprises" can mean "comprises" or "has." Furthermore, the terms "coupled," "coupled," "connected," "connected," and "connected" encompass mechanical, electrical, magnetic, and optical methods of coupling, connecting, or joining objects together, as well as other methods, and do not exclude the presence of intermediate elements between objects so coupled, coupled, connected, connected, or connected.

The various systems, methods, and devices described herein should not be construed as being limited in any manner. Indeed, the present disclosure is directed to all novel features and aspects of each of the various disclosed embodiments, combinations of these various embodiments with each other, and combinations of portions of these various embodiments with each other. The various systems, methods, and devices described herein are not limited to specific aspects, specific features, or combinations of such specific aspects with specific features, nor do the products and methods described herein require that one or more specific advantages be present or problems be solved. Moreover, various features or aspects of the various embodiments described herein, or portions of such features or aspects, may be used in combination with each other.

Although the operations of some of the various methods disclosed herein have been described in a particular order for convenience, it should be understood that description in this manner encompasses rearranging the order of the operations, unless a particular order is required by specific text below. For example, operations described in a particular order may in some cases be rearranged or performed simultaneously. Furthermore, for purposes of simplicity, the accompanying drawings do not show the various ways in which the various items and methods described herein may be used with other items and methods. In addition, this specification may use terms such as "generate," "generate," "display," "receive," "evaluate," and "deliver." These terms are high-level descriptions of the various actual operations that are performed. The actual operations that correspond to these terms may vary depending on the particular implementation and can be readily recognized by one of ordinary skill in the art having the benefit of the disclosure herein.

Any theory of operation, scientific principles, or other theoretical descriptions presented herein in connection with the devices or methods of the present disclosure are provided for purposes of better understanding and are not intended to limit the scope of the technology. The devices and methods of the appended claims are not limited to devices and methods that operate in a manner described by such theories of operation.

Any of the various methods disclosed herein may be implemented and executed on a computer using computer-executable instructions stored on one or more computer-readable media (e.g., non-transitory computer-readable storage media, such as one or more optical media disks, volatile memory components, or non-volatile memory components). Here, the volatile memory components may include, for example, DRAM or SRAM. Also, the non-volatile memory components may include, for example, hard drives and solid-state drives (SSDs). Furthermore, the computer may include any computer available on the market, including, for example, smartphones and other mobile devices having hardware to perform computations.

Any such computer-executable instructions for implementing the techniques disclosed herein, along with any data generated and used during the implementation of the various embodiments disclosed herein, may be stored on one or more computer-readable media (e.g., non-transitory computer-readable storage media). Such computer-executable instructions may be, for example, part of a separate software application, or part of a software application accessed or downloaded via a web browser or other software application (such as a remote computing application). Such software may be executed, for example, on a single local computer (e.g., as an agent executing on any suitable computer available on the market) or in a network environment (e.g., the Internet, a wide area network, a local area network, a client-server network (such as a cloud computing network), or other such network) using one or more networked computers.

For clarity, only certain selected aspects of various software-based implementations are described. Other details that are well known in the art are omitted. For example, the techniques disclosed herein are not limited to a particular computer language or program. For example, the techniques disclosed herein may be implemented by software written in C, C++, Java, or any other suitable programming language. Similarly, the techniques disclosed herein are not limited to a particular computer or type of hardware. Specific details of suitable computers and hardware are well known and need not be described in detail herein.

Moreover, any of the various such software-based embodiments (e.g., including computer-executable instructions for causing a computer to perform any of the various methods disclosed herein) may be uploaded, downloaded, or accessed in a remote manner by any suitable communication means, including, for example, the Internet, the World Wide Web, an intranet, a software application, cable (including fiber optic cable), magnetic communication, electromagnetic communication (including RF, microwave, and infrared communication), electronic communication, or other such communication means.
[Additional Notes]
The matters described in the claims as originally filed in the original application are appended hereto.
[Claim 1]
The one or more computer processors
a transmission unit that transmits information about a moving image including a character object of a first user to a second user terminal of a second user;
a reception unit that receives a display request for a first object from the second user terminal;
a first moving image generating unit that generates first information for displaying a character object of the first user and the first object in a first area in a virtual space as a first moving image;
a second moving image generating unit that generates second information for displaying, as a second moving image, a second object different from the first object in a second area in the virtual space and displaying a character object of the first user movably in the first area and the second area;
The second video generation unit is an information processing system that displays the first object at a predetermined position in the first area or at a position associated with the first user's character object based on placement position information associated with the first object.
[Claim 2]
The information processing system according to claim 1, characterized in that, when displaying the first object, the second video generation unit displays a system comment indicating that the first object is displayed in the second video.
[Claim 3]
The one or more computer processors further include:
a movement operation receiving unit that receives a movement operation of a character object of the first user in the virtual space;
3. The information processing system according to claim 1, further comprising a virtual camera control unit for controlling an operation of a virtual camera that captures images of the virtual space.
[Claim 4]
The information processing system according to claim 3, characterized in that the virtual camera control unit controls the operation of the virtual camera when the first object is displayed at a predetermined position in the first area in accordance with a positional relationship between the predetermined position and the virtual camera.
[Claim 5]
The information processing system according to claim 4, characterized in that when the first object and the character object cannot be included on the same screen due to the positional relationship between the specified position and the virtual camera, the virtual camera control unit controls the operation of the virtual camera to include the first object on the screen.
[Claim 6]
An information processing system according to any one of claims 1 to 4, characterized in that when displaying the first object at a predetermined position in the first area, the second video generation unit displays a marker object indicating the position of the first object in the virtual space depending on the position of the character object in the virtual space.
[Claim 7]
An information processing system as described in any one of claims 1 to 6, characterized in that the second video generation unit displays the first object at a position associated with the character object of the first user, even if the placement position information associated with the first object indicates that the first object should be displayed at a predetermined position in the first area.
[Claim 8]
the movement of a facial part of the character object of the first user is generated based on the movement of a facial part of the first user captured by an in-camera of a first user terminal;
the first video generation unit generates a facial movement of the character object of the first user in an inverted state with respect to a facial movement of the first user;
The information processing system described in claim 3, 4 or 5, characterized in that the second video generation unit generates the facial movement of the first user's character object in the inverted state or the non-inverted state depending on the positional relationship between the first user's character object and the virtual camera.
[Claim 9]
The information processing system according to any one of claims 1 to 8, characterized in that the second video generation unit causes the character object of the first user to reappear from another position within the virtual space when the character object moves beyond the movable area.
[Claim 10]
one or more computer processors,
a transmitting step of transmitting information about the moving image including the character object of the first user to a second user terminal of a second user;
a receiving step of receiving a display request for a first object from the second user terminal;
a first moving image generating step of generating first information for displaying a character object of the first user and the first object in a first area in a virtual space as a first moving image;
a second moving image generating step of displaying, as a second moving image, a second object different from the first object in a second area in the virtual space, and generating second information for displaying a character object of the first user movably in the first area and the second area;
The second video generation step is an information processing method for displaying the first object at a predetermined position in the first area or at a position associated with the first user's character object based on placement position information associated with the first object.
[Claim 11]
one or more computer processors,
a transmitting step of transmitting information about a moving image including a character object of the first user to a server device;
a first moving image generating step of generating first information for displaying, as a first moving image, a character object of the first user and a first object requested to be displayed by a second user terminal in a first area in a virtual space;
a second moving image generating step of displaying, as a second moving image, a second object different from the first object in a second area in the virtual space, and generating second information for displaying a character object of the first user movably in the first area and the second area;
The second video generation step is an information processing method for displaying the first object at a predetermined position in the first area or at a position associated with the first user's character object based on placement position information associated with the first object.
[Claim 12]
one or more computer processors,
a transmission function for transmitting information regarding a moving image including a character object of the first user to a server device;
a first moving image generating function for generating first information for displaying, as a first moving image, a character object of the first user and a first object requested to be displayed by a second user terminal in a first area in a virtual space;
a second moving image generating function for generating second information for displaying, as a second moving image, a second object different from the first object in a second area in the virtual space and displaying a character object of the first user movably in the first area and the second area;
The second video generation function is a computer program that displays the first object at a predetermined position in the first area or at a position associated with the first user's character object based on placement position information associated with the first object.
[Claim 13]
one or more computer processors,
a receiving step of receiving information about a moving image including a character object of a first user from a server device;
a transmitting step of transmitting a display request for a first object to the server device;
a display step of displaying, as a first moving image, a character object of the first user and a first object requested to be displayed by a second user terminal in a first area in a virtual space, and displaying, as a second moving image, a second object different from the first object in a second area in the virtual space, and displaying the character object of the first user movably in the first area and the second area;
The display step is an information processing method for displaying the first object at a predetermined position in a first area in the virtual space or at a position associated with the first user's character object based on placement position information associated with the first object.
[Claim 14]
one or more computer processors,
a receiving function for receiving information regarding a video including a character object of a first user from a server device;
a transmission function for transmitting a display request for a first object to the server device;
a display function for displaying, as a first moving image, a character object of the first user and a first object requested to be displayed by a second user terminal in a first area in a virtual space, and for displaying, as a second moving image, a second object different from the first object in a second area in the virtual space, and for displaying the character object of the first user movably in the first area and the second area;
The display function is a computer program that displays the first object at a predetermined position in a first area in the virtual space or at a position associated with the first user's character object based on placement position information associated with the first object.

1000 Information processing system 2000 Information processing system 3000 Information processing system 100 First user terminal 200 Second user terminal 300 Network 400 Server device

Claims (16)

one or more computer processors,
a generation unit that generates information for displaying a character object of a first user in a virtual space including a first area and a second area;
a movement operation receiving unit that receives a movement operation of a character object of the first user in the virtual space;
a virtual camera control unit that controls an operation of a virtual camera that captures images in the virtual space;
a transmission unit that transmits the information generated by the generation unit to a first user terminal of the first user and/or a second user terminal of a second user; and a reception unit that receives a display request for a first object from the second user terminal.
an object display unit that displays the first object in the virtual space in response to the display request received by the reception unit,
The virtual camera control unit controls the operation of the virtual camera according to the relationship between the position at which the first object is displayed, the position of the character object, and the position of the virtual camera. The information processing system according to claim 1, characterized in that the object display unit displays the first object at a predetermined position in the first area or at a position associated with the character object of the first user based on placement position information associated with the first object. The one or more computer processors further include:
a position determination unit that determines a placement position of the first object in the virtual space based on a position of the character object in the virtual space,
The position determination unit is
When the character object is located in a first area, determining a placement position based on placement position information associated with the first object so as to display the first object at a predetermined position in the first area or by attaching the first object to the character object of the first user;
When the character object is located in a second area,
Displaying the first object at a predetermined position in the first area or wearing the first object on a character object of the first user based on placement position information associated with the first object, or
The information processing system described in claim 1, characterized in that the placement position of the first object is determined so as to display the first object using a position associated with the first user's character object as a display start position, regardless of placement position information associated with the first object. The information processing system according to claim 1, characterized in that the object display unit further displays a second object different from the first object in the second area. The information processing system according to claim 1, characterized in that, when displaying the first object, the object display unit causes the first user terminal to display a system comment indicating that the first object is being displayed. The information processing system according to claim 1, characterized in that the virtual camera control unit controls the operation of the virtual camera to include the first object on the screen when the first object and the character object cannot be included on the same screen due to the relationship between the position where the first object is displayed, the position of the character object, and the position of the virtual camera. The information processing system according to any one of claims 1 to 6, characterized in that, when displaying the first object, the object display unit displays a marker object indicating the position of the first object in the virtual space according to the position of the character object in the virtual space. The information processing system according to claim 2, characterized in that the object display unit displays the first object at a position associated with the character object of the first user, even if the placement position information associated with the first object indicates that the first object should be displayed at a predetermined position in the first area. the movement of a facial part of the character object of the first user is generated based on the movement of a facial part of the first user captured by an in-camera of a first user terminal;
The information processing system according to claim 1, characterized in that the generation unit generates the facial movement of the first user's character object in an inverted or non-inverted state depending on the positional relationship between the first user's character object and the virtual camera. The information processing system according to claim 1, characterized in that the generation unit makes the character object of the first user reappear from another position in the virtual space if the character object moves beyond a movable area. The one or more computer processors further include:
a first moving image generating unit that generates first information for displaying a character object of the first user in the first area within the virtual space as a first moving image;
The information processing system according to claim 1, further comprising a second video generation unit that generates second information as a second video for displaying a character object of the first user movably in the first area and the second area. one or more computer processors,
a generating step of generating information for displaying a character object of a first user in a virtual space including a first area and a second area;
a transmission step of transmitting the information generated in the generation step to a first user terminal of the first user and a second user terminal of the second user; and a movement operation reception step of receiving a movement operation of a character object of the first user in the virtual space.
a virtual camera control step of controlling an operation of a virtual camera that captures an image of the virtual space;
a receiving step of receiving a display request for a first object from the second user terminal;
an object display step of displaying the first object in the virtual space in response to the display request accepted in the accepting step;
In the virtual camera control step, an operation of the virtual camera is controlled according to a relationship between a position at which the first object is displayed, a position of the character object, and a position of the virtual camera. one or more computer processors,
a transmitting step of transmitting information about a moving image including a character object of the first user to a server device;
a receiving step of receiving information for displaying a character object of the first user in a virtual space from the server device;
a movement operation receiving step of receiving a movement operation of a character object of the first user in the virtual space;
a virtual camera control step of controlling an operation of a virtual camera that captures an image of the virtual space;
an object display step of displaying the first object in the virtual space in response to a display request for a first object from a second user terminal of a second user;
In the virtual camera control step, an operation of the virtual camera is controlled according to a relationship between a position at which the first object is displayed, a position of the character object, and a position of the virtual camera. one or more computer processors,
a transmission function for transmitting information regarding a moving image including a character object of the first user to a server device;
a receiving function for receiving information for displaying a character object of the first user in a virtual space from the server device;
a movement operation receiving function that receives a movement operation of a character object of the first user in the virtual space;
a virtual camera control function for controlling an operation of a virtual camera that captures images in the virtual space;
an object display function of displaying the first object in the virtual space in response to a display request for the first object from a second user terminal of a second user;
The virtual camera control function is a computer program that controls the operation of the virtual camera according to the relationship between the position at which the first object is displayed, the position of the character object, and the position of the virtual camera. one or more computer processors,
a receiving step of receiving information about a video including a character object of the first user displayed in a virtual space from a server device;
a transmitting step of transmitting a display request for a first object to the server device;
The information processing method includes a display step of displaying a moving image controlled by the operation of a virtual camera that photographs the virtual space according to the relationship between the position at which the first object is displayed, the position of the character object, and the position of the virtual camera. one or more computer processors,
a receiving function for receiving information regarding a video including a character object of the first user displayed in a virtual space from the server device;
a transmission function for transmitting a display request for a first object to the server device;
A computer program that realizes a display function that displays a moving image controlled by the operation of a virtual camera that takes pictures within the virtual space according to the relationship between the position where the first object is displayed, the position of the character object, and the position of the virtual camera.

Images