WO2024230511A1 - 虚拟互动方法、装置、设备和介质 - Google Patents

虚拟互动方法、装置、设备和介质 Download PDF

Info

Publication number
WO2024230511A1
WO2024230511A1 PCT/CN2024/089880 CN2024089880W WO2024230511A1 WO 2024230511 A1 WO2024230511 A1 WO 2024230511A1 CN 2024089880 W CN2024089880 W CN 2024089880W WO 2024230511 A1 WO2024230511 A1 WO 2024230511A1
Authority
WO
WIPO (PCT)
Prior art keywords
interactive
interaction
target
virtual
space
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2024/089880
Other languages
English (en)
French (fr)
Inventor
黄栗辰
黄翔宇
冀利悦
赵文珲
蒲林峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zitiao Network Technology Co Ltd
Original Assignee
Beijing Zitiao Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zitiao Network Technology Co Ltd filed Critical Beijing Zitiao Network Technology Co Ltd
Publication of WO2024230511A1 publication Critical patent/WO2024230511A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/131—Protocols for games, networked simulations or virtual reality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting

Definitions

  • the embodiments of the present application relate to the field of human-computer interaction technology, and in particular to a virtual interaction method, device, equipment and medium.
  • XR Extended Reality
  • VR Virtual Reality
  • AR Augmented Reality
  • MR Mixed Reality
  • Embodiments of the present application provide a virtual interaction method, apparatus, device and medium.
  • an embodiment of the present application provides a virtual interaction method, comprising:
  • Displaying a video stream in a first interactive space the video stream including: a target interactive object;
  • each of the virtual objects interacts with the target interactive object.
  • an embodiment of the present application provides a virtual interaction device, including:
  • a display module is used to display a video stream in a first interactive space, wherein the video stream includes: a target interactive object;
  • a control module configured to control at least one virtual object to enter a second interactive space according to the interactive prompt information, wherein the second interactive space is independent of the first interactive space;
  • the interactive module is used to allow each of the virtual objects to interact with the target interactive object in the second interactive space.
  • an electronic device including:
  • a processor and a memory wherein the memory is used to store a computer program, and the processor is used to call and run the computer program stored in the memory to execute the virtual interaction method described in the first aspect embodiment or its various implementation methods.
  • an embodiment of the present application provides a computer-readable storage medium for storing a computer program, wherein the computer program enables a computer to execute the virtual interaction method as described in the embodiment of the first aspect or its various implementations.
  • an embodiment of the present application provides a computer program product comprising program instructions, which, when executed on an electronic device, enables the electronic device to execute the virtual interaction method as described in the embodiment of the first aspect or its various implementation methods.
  • FIG1 is a schematic diagram of a flow chart of a virtual interaction method provided in an embodiment of the present application.
  • FIG2 is a schematic diagram of adding a second interactive space based on a first interactive space provided by an embodiment of the present application
  • FIG3 is a flow chart of another virtual interaction method provided in an embodiment of the present application.
  • FIG4a is a schematic diagram of displaying an interactive prompt pop-up window in a first interactive space provided by an embodiment of the present application
  • FIG4b is a schematic diagram of selecting the "Go now" interaction confirmation option in the interaction prompt pop-up window provided by an embodiment of the present application to interact with the anchor;
  • FIG5a is a schematic diagram of another method of displaying an interactive prompt pop-up window in a first interactive space provided by an embodiment of the present application;
  • FIG5b is a schematic diagram of selecting the “Give Up” interaction rejection option in the interaction prompt pop-up window to refuse interaction with the anchor provided by an embodiment of the present application;
  • 6a to 6f are schematic diagrams of a method of screening a target selection instruction and controlling a virtual object corresponding to the target selection instruction to enter a second interactive space provided by an embodiment of the present application;
  • FIG. 7 is a schematic diagram of displaying “interacting” identification information on a virtual object participating in an interaction in a first interactive space according to an embodiment of the present application
  • FIG8 is a flow chart of another virtual interaction method provided in an embodiment of the present application.
  • FIG9a is a schematic diagram of displaying a voice connection screen on an interactive screen in a second interactive space provided by an embodiment of the present application;
  • FIG9b is a method provided in an embodiment of the present application for highlighting the anchor who is interacting with the microphone via voice on the interactive screen. Schematic diagram shown;
  • FIG9c is a schematic diagram of another method of highlighting a host who is interacting via voice link on an interactive screen provided by an embodiment of the present application.
  • FIG10 is a schematic diagram of an interactive screen showing each virtual object and a target interactive object on a first display screen provided by an embodiment of the present application;
  • FIG11 is a flow chart of another virtual interaction method provided in an embodiment of the present application.
  • FIG12a is a schematic diagram of displaying an abnormality prompt pop-up window in a second interactive space provided by an embodiment of the present application
  • FIG12b is a schematic diagram of a prompt screen displayed when leaving the second interactive space provided by an embodiment of the present application.
  • FIG12c is a schematic diagram of another method of displaying an abnormality prompt pop-up window in the second interactive space provided by an embodiment of the present application.
  • FIG13 is a schematic diagram of a specific implementation method provided in an embodiment of the present application.
  • FIG14 is a schematic block diagram of a virtual interactive device provided in an embodiment of the present application.
  • FIG. 15 is a schematic block diagram of an electronic device provided in an embodiment of the present application.
  • words such as “exemplary” or “for example” are used to indicate examples, illustrations or descriptions. Any embodiment or scheme described as “exemplary” or “for example” in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or schemes. Specifically, the use of words such as “exemplary” or “for example” is intended to present related concepts in a specific way.
  • the first form of virtual interaction between viewers and hosts is barrage chat, in which the audience inputs and sends chat content in the chat box, and the host then replies based on the chat content sent by the audience.
  • the second type is gift interaction, which involves viewers giving the anchor free or paid virtual gifts.
  • This application provides a virtual interactive mode, by adding a second interactive space that is parallel and independent to the first interactive space on the basis of the existing first interactive space, so that the audience can interact with the anchor while immersed in the second interactive space, thereby improving the virtual interactive effect and enhancing the audience's interactive enthusiasm and interactive experience.
  • VR Virtual Reality
  • the virtual reality mentioned in this article includes at least visual perception, and can also include auditory perception, tactile perception, motion perception, and even taste perception, olfactory perception, etc.
  • realizing the fusion of virtual environments interactive three-dimensional dynamic vision and simulation of entity behaviors, allowing users to immerse themselves in a simulated virtual reality environment, and realizing applications in a variety of virtual environments such as maps, games, videos, education, medical treatment, simulation, collaborative training, sales, assisted manufacturing, maintenance and repair, etc.
  • VR devices virtual reality devices
  • terminals for realizing virtual reality effects can usually be provided in the form of glasses, helmet-mounted displays (Head Mount Display, HMD), and contact lenses to realize visual perception and other forms of perception.
  • HMD Head Mount Display
  • contact lenses to realize visual perception and other forms of perception.
  • the form of virtual reality devices is not limited to this, and can be further miniaturized or enlarged according to actual needs.
  • the virtual reality devices described in the embodiments of the present application may include but are not limited to the following types:
  • PC-based virtual reality (PCVR) devices use the PC to perform relevant calculations and data output for virtual reality functions.
  • External PC-based virtual reality devices use the data output by the PC to achieve virtual reality effects.
  • Mobile virtual reality devices support the configuration of mobile terminals (such as smart phones) in various ways (such as head-mounted displays with dedicated card slots). Through wired or wireless connection with the mobile terminal, the mobile terminal performs relevant calculations of virtual reality functions and outputs data to the mobile virtual reality device, such as watching virtual reality videos through the mobile terminal's APP.
  • mobile terminals such as smart phones
  • ways such as head-mounted displays with dedicated card slots.
  • the mobile terminal Through wired or wireless connection with the mobile terminal, the mobile terminal performs relevant calculations of virtual reality functions and outputs data to the mobile virtual reality device, such as watching virtual reality videos through the mobile terminal's APP.
  • All-in-one virtual reality devices have a processor for performing relevant calculations of virtual functions, and thus have independent virtual reality input and output functions. They do not need to be connected to a PC or mobile terminal and have a high degree of freedom in use.
  • Augmented Reality A technology that calculates the camera's posture parameters in the real world (or three-dimensional world, real world) in real time during the process of the camera capturing images, and adds virtual elements to the images captured by the camera based on the camera posture parameters.
  • Virtual elements include but are not limited to: images, videos and three-dimensional models.
  • AR The goal of technology is to integrate the virtual world into the real world on the screen for interaction.
  • MR Mixed Reality
  • MR Mixed Reality
  • the computer-created sensory input can adapt to changes in the sensory input from the physical set.
  • some electronic systems used to present MR sets can monitor the orientation and/or position relative to the physical set to enable virtual objects to interact with real objects (i.e., physical elements from the physical set or their representations). For example, the system can monitor movement so that virtual plants appear stationary relative to physical buildings.
  • Extended Reality refers to all real and virtual combined environments and human-computer interactions generated by computer technology and wearable devices, which include virtual reality (VR), augmented reality (AR) and mixed reality (MR) and other forms.
  • VR virtual reality
  • AR augmented reality
  • MR mixed reality
  • a virtual scene (also known as a virtual space) is a virtual scene displayed (or provided) when an application is running on an electronic device.
  • the virtual scene can be a simulation of the real world, a semi-simulated and semi-fictitious virtual scene, or a purely fictitious virtual scene.
  • the virtual scene can be any of a two-dimensional virtual scene, a 2.5-dimensional virtual scene, or a three-dimensional virtual scene.
  • the embodiments of the present application do not limit the dimensions of the virtual scene.
  • a virtual scene can include the sky, land, ocean, etc., and the land can include environmental elements such as deserts and cities.
  • Virtual objects objects that interact in virtual scenes, are controlled by users or robot programs (e.g., robot programs based on artificial intelligence), and can be stationary, move, and perform various behaviors in virtual scenes.
  • robot programs e.g., robot programs based on artificial intelligence
  • FIG. 1 is a flow chart of a virtual interaction method provided in an embodiment of the present application.
  • the virtual interaction method provided in the present application can be performed by a virtual interaction device.
  • the virtual interaction device can be composed of hardware and/or software and can be integrated into an electronic device.
  • the electronic device can be selected as any hardware device that can provide a virtual space.
  • the electronic device can be, but is not limited to: VR device, AR device, MR device, XR device, etc.
  • the present application does not specifically limit the type of electronic device.
  • the method may include the following steps:
  • the first interactive space can be understood as the first virtual space, and the first virtual space can be a virtual scene simulated by the electronic device for a live broadcast scene selected by any anchor.
  • the electronic device constructs a corresponding virtual live broadcast scene according to this type as the first interactive space in the present application.
  • the first interactive space can display the video stream of the host.
  • the video stream of the host is preferably Live video stream.
  • the live video stream at least includes a target interactive object.
  • the target interactive object can be understood as a host.
  • the target interactive object is a performer in a concert, etc.
  • the first interactive space can be understood as the virtual live broadcast room where the anchor is located.
  • a live broadcast room refers to a social networking platform, instant messaging platform, etc. where many network users gather together. Users and anchors enter the live broadcast room by logging into the client. Users exist in the live broadcast room as members. The same live broadcast room contains members with multiple identities, such as viewers, etc. Users and anchors can join or leave the live broadcast room.
  • user A selects any target live broadcast room from multiple live broadcast rooms displayed on the display screen of an electronic device through a controller such as a handle, and after entering the target live broadcast room as a viewer, he can watch the host performance in the target live broadcast room.
  • a controller such as a handle
  • S102 Control at least one virtual object to enter a second interactive space according to the interactive control information, wherein the second interactive space is independent of the first interactive space.
  • this application adds a new virtual space (second interactive space) that is parallel and independent of the first interactive space, as shown in Figure 2. Furthermore, the second interactive space is used as an independent interactive space for realizing virtual interaction, so that users and anchors can conduct various interactions in this independent interactive space, thereby enriching the interactive methods between users and anchors and improving the interactive enthusiasm between users and anchors.
  • the creation process of the second interactive space is similar to the creation process of the first interactive space.
  • the second interactive space is created by default when the host creates the first interactive space, etc., which will not be described in detail here.
  • the host can make the live broadcast content more interesting by interacting with the audience during the live broadcast. Therefore, during the live broadcast, the host can send an interaction invitation to the audience in the live broadcast room to invite any audience to interact; or the audience in the live broadcast room can actively send an interaction application to the host to apply for interaction with the host.
  • the host and the audience may establish an interactive connection in the following ways, including but not limited to:
  • the anchor can set at least one interactive session during the live broadcast. And, every time an interactive session is reached, an interactive prompt pop-up window can be displayed in the live broadcast room, so that users can participate in the interaction with the anchor based on the interactive prompt pop-up window.
  • the user participates in the interaction based on the interactive prompt pop-up window.
  • the specific implementation process can be to trigger the confirmation option in the interactive prompt pop-up window so that the virtual object (such as a virtual character, Avatar) corresponding to the user enters a special A second interactive space for various interactions, so that you can interact with the anchor in the second interactive space.
  • the virtual object such as a virtual character, Avatar
  • the virtual object corresponding to each user in the live broadcast room can be automatically configured by the electronic device according to the user's personal information when entering the live broadcast room. For example, when user S enters a live broadcast room, the gender column of the user S's personal information is obtained as male, and a male virtual object is configured for user S based on the male gender. For another example, when user W enters a live broadcast room, the gender column of the user W's personal information is obtained as female, and a female virtual object is configured for user W based on the female gender.
  • the user may also create a virtual object that meets his or her own personalized needs through the virtual object creation function provided by the electronic device, and this application does not impose any specific restrictions on this.
  • the number of users participating in the interaction can be at least one.
  • interactive controls such as microphone interactive controls
  • the host approves the interactive request, the virtual object corresponding to the user who sent the interactive request will enter the second interactive space dedicated to various interactions, and then interact with the host in the second interactive space.
  • the anchor's live broadcast room in addition to the users who have established an interactive connection with the anchor, there are other users (i.e., users who have not established an interactive connection with the anchor) in the anchor's live broadcast room. Therefore, when the virtual object corresponding to the user who has established an interactive connection with the anchor is controlled to enter the second interactive space, the interactive space where the anchor is located may not be switched, that is, the anchor still stays in the first interactive space, so that other users can continue to watch the anchor's performance in the first interactive space.
  • the present application can use the first camera in the first interactive space to capture the anchor's real-time picture and send the real-time picture to the second interactive space. Then, the anchor's real-time picture is displayed in the second interactive space, so that each virtual object in the second interactive space can interact with the anchor in various ways based on the anchor's real-time picture.
  • the first camera in the first interactive space may be understood as a camera for realizing virtual interaction, and the first camera may be optionally a 2D camera or other types of cameras, and no limitation is imposed on it herein.
  • each virtual object interacts with the target interactive object.
  • each virtual object can interact with the target interactive object (anchor).
  • the interaction can be voice interaction or video interaction.
  • voice interaction is mainly carried out through voice calls.
  • Video interaction is carried out through voice and real-time images.
  • voice interaction can only hear the voice data of the two parties in interaction, but cannot see the real-time images of the two parties in interaction.
  • Video interaction can not only hear the voice data of the two parties in interaction, but also You can see the real-time images of both parties interacting.
  • Video-linked interaction not only allows users to hear the voice data of both parties, but also allows users to see the real-time images of both parties. Therefore, in this interactive mode, each virtual object can also interact with the target interactive object in different ways.
  • the different types of interactions may include at least one of talent interactions and game interactions.
  • talent interaction may include but is not limited to: the host and each virtual object singing the same song, or the host and each virtual object dancing, etc.
  • game interactions can include but are not limited to: guessing the song by looking at the lip movements, guessing the song title by listening to the prelude, and playing idioms, etc.
  • the technical solution provided by the embodiment of the present application displays a video stream in the first interactive space, and controls at least one virtual object to enter the second interactive space according to the interactive control information, so that each virtual object interacts with the target interactive object in the second interactive space.
  • the present application adds an independent second interactive space on the basis of the first interactive space, so that the audience can interact immersively with the anchor in the independent second interactive space, thereby enriching the virtual interaction mode, improving the virtual interaction effect, and enhancing the audience's interactive enthusiasm and interactive experience.
  • the present application further explains and illustrates controlling at least one virtual object to enter the second interactive space according to the interactive control information, as shown in FIG. 3 .
  • the method may include the following steps:
  • the anchor before starting the live broadcast, can pre-set at least one interactive session, and set the interaction start time and interaction end time for each interactive session. In this way, the anchor can interact with the users in the live broadcast room in an orderly manner according to the pre-set interactive sessions, and can also better control the duration of the live broadcast.
  • the anchor can start the live broadcast, and during the live broadcast, the electronic device will detect in real time whether the current time has reached the interactive start time of the preset interactive session. If the current time is the interactive start time, an interactive prompt pop-up window will be displayed in the anchor's live broadcast room (i.e., the first interactive space), so that users in the live broadcast room can choose whether to interact with the anchor based on the interactive prompt pop-up window.
  • the interactive prompt pop-up window includes: interactive prompt information, interactive confirmation option and interactive rejection option. Therefore, users in the live broadcast room can participate in the interaction with the anchor by triggering the interactive confirmation option; or they can give up the interaction with the anchor by triggering the interactive rejection option.
  • the interactive prompt pop-up window displayed in the first interactive space includes: “XX wants to be with you Interact together” interaction prompt information, “Go now” interaction confirmation option and “Give up” interaction rejection option. If users W and T in the first interaction space want to participate in the interaction with the anchor, users W and T can respectively select the “Go now” interaction confirmation option to interact with the anchor through controllers such as handles, gestures or voice, as shown in FIG4b.
  • the interactive prompt pop-up window displayed in the first interactive space includes: "XX wants to have a voice chat with you" interactive prompt information, "Go now” interactive confirmation option, "Give up” interactive rejection option, host image and interactive dynamic effect. If the user XX in the first interactive space does not want to participate in the interaction with the host, the user XX selects the "Give up” interactive rejection option through a controller such as a handle or voice to refuse to interact with the host, as shown in FIG5b.
  • the host image can be a real image of the host, or it can be a virtual image of the host created based on the host, and there is no specific restriction on it here.
  • the interactive dynamic effect can be selected as a ripple dynamic effect or other dynamic effect for establishing an interactive connection, and there is no restriction on it here.
  • S203 In response to a selection instruction of the interaction confirmation option, control at least one virtual object to enter a second interaction space.
  • each virtual object interacts with the target interactive object.
  • the first interactive space it is detected whether any user in the first interactive space has obtained a selection instruction for the interaction confirmation option in the interactive prompt pop-up window. If a selection instruction for the interaction confirmation option is detected, it is determined that the user who sent the selection instruction wants to interact with the anchor, and at this time, the virtual object corresponding to the user can be controlled to enter the second interactive space. Thus, the interaction between the anchor and the virtual object is realized in the second interactive space.
  • this application responds to the selection instruction of the interaction confirmation option, and controls at least one virtual object to enter the second interactive space.
  • the number of virtual objects entering the second interactive space can be flexibly adjusted according to the preset duration of the interaction session of the anchor, for example, it can be 1, 3 or 4.
  • the present application first filters the target selected instruction from all the selected instructions obtained according to the screening rules. Secondly, respond to the target selected instruction and control the virtual object corresponding to the target selected instruction to enter the second interactive space. Furthermore, the virtual object entering the second interactive space can interact with the anchor.
  • the screening rule may be any strategy or algorithm for screening target selection instructions from the obtained selection instructions, and no specific restrictions are made here.
  • screening target selection instructions according to preset identification information or screening target selection instructions according to preset ID, etc., and no specific restrictions are made here.
  • identification information can be understood as information that uniquely identifies the user's identity, such as user name, user contact number, etc.
  • the preset ID can be the user's ID number, etc.
  • the present application filters the target selected instruction from all the selected instructions acquired according to the screening rules, and can determine whether the virtual object identifier corresponding to each selected instruction is a preset identifier. If the virtual object identifier corresponding to any selected instruction is a preset identifier, the selected instruction is determined to be the target selected instruction. If the selected object identifier corresponding to any selected instruction is not a preset identifier, the selected instruction is determined not to be the target selected instruction.
  • the interactive prompt pop-up window displayed in the first interactive space includes: "XX wants to have a voice chat with you" interactive prompt information, "I want to sign up” interactive confirmation option, “Give up” interactive rejection option, anchor image, interactive animation and "XXX people have signed up” dynamic prompt information, as shown in Figure 6a.
  • the "XXX people have signed up" dynamic prompt information will show a dynamic change effect as the number of registrants changes, and the update frequency of the dynamic change effect can be flexibly set according to the live broadcast delay requirements. If the live broadcast delay requirement is low, it can be updated every 5 seconds. If the live broadcast delay requirement is high, it can be updated every 1 second, etc. This application does not impose specific restrictions on it.
  • user 1, user 2, user 3, user 4, user 5 and user 6 in the first interactive space all click on the "I want to sign up” interactive confirmation option, and send a selection instruction of the "I want to sign up” interactive confirmation option to the electronic device.
  • the electronic device and/or controller such as a handle will output vibration feedback to the user to remind the user that the "I want to sign up” interactive confirmation option has been selected through vibration feedback.
  • the prompt information of "Registration successful" and "We will draw a lottery for the registered audience and notify the result later" can be displayed in the interactive prompt pop-up window in the first interactive space, as shown in Figure 6c.
  • the present application can control the prompt information to disappear after displaying for a preset time, so as to ensure that the user can fully watch the host's performance and avoid the problem of poor viewing experience caused by long-term blocking.
  • the preset time can be flexibly set according to the live broadcast requirements, such as 2 seconds or 3 seconds.
  • the screening rule is to filter the target selection instructions according to the preset user name (user nickname)
  • the user names of user 1, user 2, user 3, user 4, user 5 and user 6 are respectively compared with the preset user names in the screening rules. If the user names of user 1, user 3, user 4 and user 5 are the preset user names, the selection instructions corresponding to user 1, user 3, user 4 and user 5 are determined to be the target selection instructions.
  • the prompt information "Congratulations on becoming a lucky audience” and "You are about to enter the interactive space dedicated to interaction" are displayed in the first interactive space corresponding to user 1, user 3, user 4 and user 5, as well as the note "Please make sure your network connection is unobstructed and in a quiet environment", as shown in Figure 6d.
  • the prompt information and note are controlled to disappear.
  • a preset time duration may be presented in the first interactive space.
  • Space switching effects such as eye opening and closing effects or loading effects, etc.
  • a second interactive space will appear in front of the virtual objects corresponding to user 1, user 3, user 4 and user 5, that is, user 1, user 3, user 4 and user 5 enter the second interactive space, see Figure 6f. Then, user 1, user 3, user 4 and user 5 can interact with the anchor in various ways.
  • "interacting" identification information is also displayed on the corresponding virtual object in the first interactive space, so that users in the first interactive space can know which users are interacting with the anchor, as shown in Figure 7.
  • the second interactive space can support interaction between users and anchors, and this interaction is different from the conventional barrage chat and gift giving methods in the first interactive space. Therefore, this application can limit the interactive functions in the second interactive space to distinguish the interaction in the second interactive space from the conventional interaction methods in the first interactive space. For example, in the second interactive space, only the permissions to turn on and off the microphone and the camera are provided to users. Moreover, the permissions to turn on and off the microphone and the camera can also be uniformly managed by the anchor end, so as to avoid some virtual objects from making inappropriate remarks or making indecent actions, thereby ensuring that the entire live broadcast process can proceed smoothly.
  • the technical solution provided by the embodiment of the present application displays a video stream in the first interactive space, and controls at least one virtual object to enter the second interactive space according to the interactive control information, so that each virtual object interacts with the target interactive object in the second interactive space.
  • the present application adds an independent second interactive space on the basis of the first interactive space, so that the audience can interact immersively with the anchor in the independent second interactive space, thereby enriching the virtual interaction mode, improving the virtual interaction effect, and enhancing the audience's interactive enthusiasm and interactive experience.
  • the present application sets a first display screen in the first interactive space.
  • the interactive screen display of each virtual object and the target interactive object in the second interactive space is displayed through the first display screen.
  • the method may include the following steps:
  • S301 displaying a video stream in a first interactive space, where the video stream includes: a target interactive object.
  • S302 Control at least one virtual object to enter a second interactive space according to the interactive control information, wherein the second interactive space is independent of the first interactive space.
  • each virtual object interacts with the target interactive object.
  • the virtual objects in the second interactive space can interact with the target interactive object through a video or voice (voice chat).
  • the present application can also display a third display screen (interactive screen) in the second interactive space, and display the microphone connection screen between each virtual object and the target interactive object through the interactive screen, so that other users in the first interactive space can watch the interaction process between the virtual object and the anchor in the second interactive space.
  • the voice connection screen of the host, virtual object 1 and virtual object 2 can be displayed on the interactive screen.
  • the present application can display the interaction process between each virtual object and the target interactive object on the interactive screen, and first determine the target object that is interacting (i.e., currently speaking or performing). If the target object being interacted is the host, the host is highlighted on the interactive screen. If the target object being interacted is any virtual object, the virtual object is highlighted on the interactive screen, so that the person who is currently speaking or performing can be determined based on the highlighted object.
  • the anchor when it is detected that the target object currently interacting with the voice microphone is the anchor, the anchor is highlighted on the interactive screen, such as by highlighting the anchor image frame, etc., as shown in FIG9b.
  • the anchor image is displayed on the interactive screen, that is, the target object currently interacting with the voice microphone is displayed in a single-person display mode, as shown in FIG9c.
  • S304 Displaying an interaction screen between each virtual object and the target interactive object on a first display screen in the first interactive space.
  • the first display screen can be a secondary screen in addition to the main screen that displays the live video stream of the anchor.
  • the secondary screen can be optionally a 2D screen.
  • the present application can display the interaction screen between each virtual object in the second interactive space and the target interactive object through the first display screen in the first interactive space, so that other users who are not participating in the interaction can see the interaction content between the host and the participating interactive users, and can also intuitively see the host's performance screen, as shown in Figure 10.
  • the interactive screen between each virtual object and the target interactive object in the second interactive space displayed on the first display screen in the first interactive space can be obtained by:
  • the first step is to obtain a target picture captured by a virtual camera in the second interactive space, where the target picture is an interactive picture of each virtual object when interacting with a target interactive object.
  • a virtual camera is fixedly set in the second interactive space.
  • the virtual camera is used to capture the real-time image of the interactive virtual object, and transmit the captured real-time image to the second display screen of the first interactive space through the real-time audio and video service (Real-Time Communication, referred to as RTC), so as to obtain the real-time image of each virtual object in the second interactive space.
  • RTC Real-Time Communication
  • the second display screen is specifically a 2D large screen on site.
  • the definition of the real-time image captured by the virtual camera is at least 1080p to ensure the clarity of the real-time image captured.
  • the virtual camera in the second interactive space will collect the image information of the virtual object in real time, and transmit the image to the second display screen in the first interactive space in real time. Therefore, the interaction process of the virtual object in the second interactive space can be displayed through the second display screen, so that the anchor can respond to the interaction of the virtual object.
  • the second step is to display the target picture on the second display screen, and to capture the target picture displayed on the second display screen and the interactive picture of the target interactive object through the target camera, wherein the target camera corresponds to the first display screen and the target interactive object.
  • the third step is to generate an interaction picture between each virtual object and the target interactive object according to the target picture displayed on the second display screen and the interaction picture of the target interactive object.
  • the target camera may be a 2D camera.
  • the host is always in the first interactive space, and the second display screen in the first interactive space will display the real-time image of the virtual object in the second interactive space. Therefore, the present application can collect the host's interactive image and the target image displayed on the second display screen through the target camera in the first interactive space. Then, based on the host's interactive image collected by the target camera and the target image displayed on the second display screen, an interactive image of each virtual object and the target interactive object is generated.
  • the host's interactive screen can be spliced with the target screen displayed on the second display screen to generate an interactive screen between each virtual object and the target interactive object.
  • the host area can be cut out from the host's interactive screen, and then the host area and the target screen displayed on the second display screen are spliced to generate an interactive screen between each virtual object and the target interactive object.
  • the interactive screen between each virtual object and the target interactive object may also be generated by other methods, which are not specifically limited here.
  • the first display screen in the first interactive space can display a close-up performance picture of the host; or, display a close-up picture of the virtual object corresponding to any user in the first interactive space; or, display the background picture and/or text information associated with the first interactive space, etc., and there is no specific restriction on this here.
  • the technical solution provided by the embodiment of the present application displays a video stream in the first interactive space, and controls at least one virtual object to enter the second interactive space according to the interactive control information, so that each virtual object in the second interactive space interacts with the target interactive object.
  • the audience can interact immersively with the anchor in an independent second interactive space, thereby enriching the virtual interaction mode, improving the virtual interaction effect, and enhancing the audience's interactive enthusiasm and interactive experience.
  • any virtual object in the second interactive space may exit the second interactive space due to network or personal reasons during the interaction with the target interactive object.
  • the present application can output abnormal prompt information to the users participating in the interaction, so that the users know the reasons for exiting the interaction according to the prompt information and make adjustments in time.
  • the virtual interaction method provided by the embodiment of the present application is further described below in conjunction with Figure 11.
  • the method may include the following steps:
  • S402 Control at least one virtual object to enter a second interactive space according to the interactive control information, wherein the second interactive space is independent of the first interactive space.
  • each virtual object interacts with the target interactive object.
  • the abnormality of the interaction between any virtual object in the second interactive space and the target interactive object may include the following situations:
  • any virtual object exits the second interaction space.
  • the abnormal prompt pop-up window may include: “Leave the second interactive space” retention theme information, "Are you sure you want to leave the current interaction?" retention prompt information, "Give up” control and "Cruelly leave” control. If the user corresponding to the virtual object 1 selects the "Cruelly leave” control, the second interactive space is left, and a prompt “Retracing the real time and space, please wait” is displayed, as shown in FIG12b.
  • the network condition of the terminal device corresponding to any virtual object is poor.
  • the network of the terminal device corresponding to any virtual object is disconnected.
  • the network used by the terminal device corresponding to the virtual object may cause abnormal data connection termination during network connection due to problems with the LAN router or line, that is, network disconnection. This causes the virtual object to exit the second interactive space. In response to this situation, an abnormal prompt "There is a problem, you have left the second interactive space" can be displayed in the first interactive space.
  • the second interaction space if the virtual object in the second interaction space ends the interaction with the target interaction object normally, the second interaction space returns to the first interaction space, and the interaction end prompt message is displayed in the first interaction space.
  • the interaction end prompt message may be, but is not limited to: the interaction has ended, and we look forward to your participation next time; the interaction has ended, and thank you for your participation, etc.
  • the technical solution provided by the embodiment of the present application displays a video stream in the first interactive space, and controls at least one virtual object to enter the second interactive space according to the interactive control information, so that each virtual object interacts with the target interactive object in the second interactive space.
  • the present application allows the audience to interact immersively with the anchor in the independent second interactive space, thereby enriching the virtual interaction method, improving the virtual interaction effect, and enhancing the audience's interactive enthusiasm and interactive experience.
  • the abnormal prompt information is output to the user, so that the user can make timely adjustments to ensure that the interaction can proceed normally, thereby ensuring the quality of the interaction.
  • the live broadcast link is a solid line and the interactive link is a dotted line
  • the host is performing on the real stage.
  • the host's performance content displayed on the main playback screen can be obtained in real time through the XR camera in the first interactive space.
  • the host's interactive screen displayed on the 2D display screen (third display screen or interactive screen) in the second interactive space interact with the host in the second interactive space.
  • the host's interactive screen can be collected in real time by the interactive dedicated 2D camera in the real stage scene and sent to the 2D display screen in the second interactive space.
  • the virtual camera in the second interactive space will collect the interactive screen of the user Q corresponding to the virtual object in real time, and transmit the interactive screen to the on-site 2D large screen (second interactive space) in the first interactive space in real time. Display screen). Then, the anchor on the real stage can respond according to the virtual object interactive screen displayed on the live 2D large screen.
  • the secondary screen 2D camera corresponding to the secondary screen (first display screen) and the anchor in the real stage scene will collect the real-time screen of the anchor and the virtual object interactive screen of the live 2D large screen, and will generate the interactive content between the anchor and the participating interactive user Q based on these two types of screens for display operation through the secondary screen.
  • the virtual object of user Q can exit from the second interactive space and return to the first interactive space to continue watching the host's performance.
  • the present application enables the audience to interact immersively with the anchor in the independent second interactive space, thereby enriching the virtual interactive mode, improving the virtual interactive effect, and enhancing the audience's interactive enthusiasm and interactive experience.
  • FIG14 is a schematic block diagram of a virtual interactive device provided in an embodiment of the present application.
  • the virtual interactive device 500 includes: a display module 510 , a control module 520 and an interactive module 530 .
  • the display module 510 is used to display a video stream in the first interactive space, wherein the video stream includes: a target interactive object;
  • a control module 520 configured to control at least one virtual object to enter a second interactive space according to the interactive prompt information, wherein the second interactive space is independent of the first interactive space;
  • the interaction module 530 is used to allow each of the virtual objects to interact with the target interactive object in the second interactive space.
  • the interactive module 530 is specifically used to:
  • each of the virtual objects interacts with the target interactive object via voice communication
  • each of the virtual objects interacts with the target interactive object via video link.
  • the interactive module 530 is also used for: at least one of talent interaction and game interaction.
  • control module 520 includes:
  • a pop-up window display unit configured to display an interactive prompt pop-up window in the first interactive space if the current time is the interactive time, wherein the interactive prompt pop-up window at least includes: interactive prompt information and interactive confirmation options;
  • the response control unit is used to control at least one virtual object to enter the second interaction space in response to a selection instruction of the interaction determination option.
  • control module 520 further includes:
  • An instruction screening unit used for screening a target selected instruction from all the acquired selected instructions, wherein the selected instruction is a selected instruction of the interactive determination option;
  • the response control unit is specifically used for:
  • a virtual object corresponding to the target selection instruction is controlled to enter a second interactive space.
  • the instruction screening unit is specifically configured to:
  • the selected instruction is determined to be a target selected instruction.
  • a first display screen is provided in the first interactive space
  • the device 500 further includes:
  • the interactive display module is used to display the interactive screen between each virtual object and the target interactive object on the first display screen.
  • a second display screen is provided in the first interactive space
  • the device 500 further includes:
  • a picture acquisition module used to acquire a target picture captured by a virtual camera in the second interactive space, wherein the target picture is an interactive picture of each virtual object when interacting with the target interactive object;
  • a picture display module used for displaying the target picture on the second display screen, and collecting the interactive picture of the target picture displayed on the second display screen and the target interactive object through a target camera, wherein the target camera corresponds to the first display screen;
  • the interaction generation module is used to generate an interaction screen between each virtual object and the target interactive object according to the target screen displayed on the second display screen and the interaction screen of the target interactive object.
  • the apparatus 500 further includes:
  • a screen display module used for displaying a third display screen in the second interactive space
  • the interactive display module is also used to display the interactive screen between each virtual object and the target interactive object on the third display screen.
  • the interactive display module is specifically used for:
  • the target object is highlighted on the third display screen.
  • the apparatus 500 further includes:
  • the information output module is used to output abnormal prompt information if an abnormality occurs in the interaction between any of the virtual objects and the target interactive object.
  • the information output module is specifically used to:
  • any of the virtual objects exits the second interactive space
  • the network status of the terminal device corresponding to any of the virtual objects is poor
  • the network of the terminal device corresponding to any of the virtual objects is disconnected.
  • the information output module is specifically used to display interaction end prompt information in the first interaction space if the interaction between the virtual object and the target interactive object ends.
  • the video stream is a live video stream.
  • the device embodiment and the aforementioned method embodiment may correspond to each other, and similar descriptions may refer to the method embodiment. To avoid repetition, no further description is given here.
  • the device 500 shown in FIG14 can execute the method embodiment corresponding to FIG1, and the aforementioned and other operations and/or functions of each module in the device 500 are respectively for implementing the corresponding processes in each method in FIG1, and for the sake of brevity, no further description is given here.
  • the device 500 of the embodiment of the present application is described from the perspective of the functional module in conjunction with the accompanying drawings.
  • the functional module can be implemented in hardware form, can be implemented by instructions in software form, and can also be implemented by a combination of hardware and software modules.
  • the steps of the first aspect method embodiment in the embodiment of the present application can be completed by the hardware integrated logic circuit and/or software form instructions in the processor, and the steps of the first aspect method disclosed in conjunction with the embodiment of the present application can be directly embodied as a hardware decoding processor to perform, or a combination of hardware and software modules in the decoding processor to perform.
  • the software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, a register, etc.
  • the storage medium is located in a memory, and the processor reads the information in the memory, and completes the steps in the above-mentioned first aspect method embodiment in conjunction with its hardware.
  • FIG15 is a schematic block diagram of an electronic device provided in an embodiment of the present application. As shown in FIG15 , the electronic device 600 may include:
  • the memory 610 and the processor 620 the memory 610 is used to store the computer program and transmit the program code to the processor 620.
  • the processor 620 can call and run the computer program from the memory 610 to implement the virtual interaction method in the embodiment of the present application.
  • the processor 620 may be used to execute the above-mentioned virtual interaction method embodiment according to the instructions in the computer program.
  • the processor 620 may include but is not limited to:
  • DSP digital signal processor
  • ASIC application-specific integrated circuit
  • FPGA field programmable gate array
  • the memory 610 includes but is not limited to:
  • Non-volatile memory can be read-only memory (ROM), programmable ROM (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM) or flash memory.
  • the volatile memory can be random access memory (RAM), which is used as an external cache.
  • RAM random access memory
  • SRAM static RAM
  • DRAM dynamic RAM
  • SDRAM synchronous DRAM
  • DDR SDRAM double data rate synchronous dynamic random access memory
  • ESDRAM enhanced synchronous dynamic random access memory
  • SLDRAM synchronous link DRAM
  • Direct Rambus RAM Direct Rambus RAM
  • the computer program may be divided into one or more modules, which are stored in the memory 610 and executed by the processor 620 to complete the virtual interaction method provided by the present application.
  • the one or more modules may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program in the electronic device.
  • the electronic device 600 may further include:
  • the transceiver 630 may be connected to the processor 620 or the memory 610 .
  • the processor 620 may control the transceiver 630 to communicate with other devices, specifically, to send information or data to other devices, or to receive information or data sent by other devices.
  • the transceiver 630 may include a transmitter and a receiver.
  • the transceiver 630 may further include an antenna, and the number of antennas may be one or more.
  • bus system includes not only a data bus but also a power bus, a control bus and a status signal bus.
  • the present application also provides a computer-readable storage medium for storing a computer program, wherein the computer program enables a computer to execute the virtual interaction method described in the above method embodiment.
  • the present application also provides a computer program product including program instructions.
  • program instructions When the program instructions are executed in an electronic device When the electronic device is running, the electronic device executes the virtual interaction method of the above method embodiment.
  • the computer program product includes one or more computer instructions.
  • the computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices.
  • the computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium.
  • the computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center.
  • the computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations.
  • the available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a digital video disc (DVD)), or a semiconductor medium (e.g., a solid state disk (SSD)), etc.
  • a magnetic medium e.g., a floppy disk, a hard disk, a magnetic tape
  • an optical medium e.g., a digital video disc (DVD)
  • DVD digital video disc
  • SSD solid state disk
  • modules and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
  • the disclosed systems, devices and methods can be implemented in other ways.
  • the device embodiments described above are only schematic.
  • the division of the module is only a logical function division.
  • Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.
  • each functional module in each embodiment of the present application may be integrated into a processing module, or each module may exist physically separately, or two or more modules may be integrated into one module.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请提供了一种虚拟互动方法、装置、设备和介质，其中方法包括：在第一互动空间内显示视频流，视频流包括：目标互动对象；根据互动控制信息，控制至少一个虚拟对象进入第二互动空间，其中第二互动空间与第一互动空间相互独立；在第二互动空间内，每个虚拟对象与目标互动对象进行互动。

Description

虚拟互动方法、装置、设备和介质
相关申请的交叉引用
本申请是以申请号为202310501377.4，申请日为2023年5月5日的中国申请为基础，并主张其优先权，该中国申请的公开内容在此作为整体引入本申请中。
技术领域
本申请实施例涉及人机交互技术领域，尤其涉及一种虚拟互动方法、装置、设备和介质。
背景技术
随着技术水平的不断提升，扩展现实(Extended Reality，简称为XR)技术的应用也越来越广泛，甚至成为舞台艺术呈现方式的新标准。XR技术集成了虚拟现实(Virtual Reality，简称为VR)、增强现实(Augmented Reality，简称为AR)、混合现实(Mixed Reality，简称MR)等多种形式，既能满足舞台场景高标准的制作要求，又能为用户带来身临其境的沉浸体验。
发明内容
本申请实施例提供一种虚拟互动方法、装置、设备和介质。
第一方面，本申请实施例提供了一种虚拟互动方法，包括：
在第一互动空间内显示视频流，所述视频流包括：目标互动对象；
根据互动控制信息，控制至少一个虚拟对象进入第二互动空间，其中所述第二互动空间与所述第一互动空间相互独立；
在所述第二互动空间内，每个所述虚拟对象与所述目标互动对象进行互动。
第二方面，本申请实施例提供了一种虚拟互动装置，包括：
显示模块，用于在第一互动空间内显示视频流，所述视频流包括：目标互动对象；
控制模块，用于根据互动提示信息，控制至少一个虚拟对象进入第二互动空间，其中所述第二互动空间与所述第一互动空间相互独立；
互动模块，用于在所述第二互动空间内，每个所述虚拟对象与所述目标互动对象进行互动。
第三方面，本申请实施例提供了一种电子设备，包括：
处理器和存储器，所述存储器用于存储计算机程序，所述处理器用于调用并运行所述存储器中存储的计算机程序，以执行第一方面实施例或其各实现方式中所述的虚拟互动方法。
第四方面，本申请实施例提供了一种计算机可读存储介质，用于存储计算机程序，所述计算机程序使得计算机执行如第一方面实施例或其各实现方式中所述的虚拟互动方法。
第五方面，本申请实施例提供了一种包含程序指令的计算机程序产品，当所述程序指令在电子设备上运行时，使得所述电子设备执行如第一方面实施例或其各实现方式中所述的虚拟互动方法。
附图说明
为了更清楚地说明本申请实施例中的技术方案，下面将对实施例描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1为本申请实施例提供的一种虚拟互动方法的流程示意图；
图2为本申请实施例提供的一种在第一互动空间基础上增加第二互动空间的示意图；
图3为本申请实施例提供的另一种虚拟互动方法的流程示意图；
图4a为本申请实施例提供的一种在第一互动空间内显示互动提示弹窗的示意图；
图4b为本申请实施例提供的选中互动提示弹窗中“马上去”互动确定选项，与主播进行互动的示意图；
图5a为本申请实施例提供的另一种在第一互动空间内显示互动提示弹窗的示意图；
图5b为本申请实施例提供的选中互动提示弹窗中“放弃”互动拒绝选项拒绝与主播互动的示意图；
图6a至图6f为本申请实施例提供的一种筛选目标选中指令，并控制目标选中指令对应的虚拟对象进入第二互动空间的示意图；
图7为本申请实施例在第一互动空间内对参与互动的虚拟对象上显示“互动中”标识信息的示意图；
图8为本申请实施例提供的再一种虚拟互动方法的流程示意图；
图9a为本申请实施例提供的一种在第二互动空间内的互动屏上显示语音连麦画面的示意图；
图9b为本申请实施例提供的一种在互动屏上对正在语音连麦互动的主播进行突出显 示的示意图；
图9c为本申请实施例提供的另一种在互动屏上对正在语音连麦互动的主播进行突出显示的示意图；
图10为本申请实施例提供的一种在第一显示屏上显示每个虚拟对象与目标互动对象的互动画面的示意图；
图11为本申请实施例提供的又一种虚拟互动方法的流程示意图；
图12a为本申请实施例提供的一种在第二互动空间内显示异常提示弹窗的示意图；
图12b为本申请实施例提供的一种离开第二互动空间时显示的提示画面示意图；
图12c为本申请实施例提供的另一种在第二互动空间内显示异常提示弹窗的示意图；
图13为本申请实施例提供的一个具体实现方式示意图；
图14为本申请实施例提供的一种虚拟互动装置的示意性框图；
图15为本申请实施例提供的一种电子设备的示意性框图。
具体实施方式
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本申请一部分实施例，而不是全部的实施例。根据本申请中的实施例，本领域普通技术人员在没有做出创造性劳动的前提下所获得的所有其他实施例，都属于本申请保护的范围。
需要说明的是，本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换，以便这里描述的本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施。此外，术语“包括”和“具有”以及他们的任何变形，意图在于覆盖不排他的包含，例如，包含了一系列步骤或单元的过程、方法、系统、产品或服务器不必限于清楚地列出的那些步骤或单元，而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。
本申请实施例中，“示例性的”或者“例如”等词用于表示作例子、例证或说明，本申请实施例中被描述为“示例性的”或者“例如”的任何实施例或方案不应被解释为比其它实施例或方案更优选或更具优势。确切而言，使用“示例性的”或者“例如”等词旨在以具体方式呈现相关概念。
目前，在虚拟直播场景下，观众与主播之间的虚拟互动方式，第一种是弹幕聊天，具体为观众在聊天框中输入并发送聊天内容，进而主播根据观众发送的聊天内容进行回复。 第二种是礼物互动，具体为观众为主播赠送免费或者收费的虚拟礼物。
针对目前在虚拟直播场景下，观众与主播之间的弹幕聊天或者礼物互动这两种互动方式，存在的互动方式较为单调，互动效果较差，难以调动观众的互动积极性问题。本申请提供了一种虚拟互动方式，通过在已有的第一互动空间基础上，增设一个与第一互动空间平行且独立的第二互动空间，使得观众可以与主播在第二互动空间内进行沉浸时互动，由此可以改善虚拟互动效果，提升观众的互动积极性和互动体验。
为了便于理解本申请实施例，在描述本申请各个实施例之前，首先对本申请所有实施例中所涉及到的一些概念进行适当的解释说明，具体如下：
1)虚拟现实(Virtual Reality，VR)，创建和体验虚拟世界的技术，计算生成一种虚拟环境，是一种多源信息(本文中提到的虚拟现实至少包括视觉感知，此外还可以包括听觉感知、触觉感知、运动感知，甚至还包括味觉感知、嗅觉感知等)，实现虚拟环境的融合的、交互式的三维动态视景和实体行为的仿真，使用户沉浸到模拟的虚拟现实环境中，实现在诸如地图、游戏、视频、教育、医疗、模拟、协同训练、销售、协助制造、维护和修复等多种虚拟环境的应用。
2)虚拟现实设备(VR设备)，实现虚拟现实效果的终端，通常可以提供为眼镜、头盔式显示器(Head Mount Display，HMD)、隐形眼镜的形态，以用于实现视觉感知和其他形式的感知，当然虚拟现实设备实现的形态不限于此，根据实际需要可以进一步小型化或大型化。
在一些实施例中，本申请实施例中记载的虚拟现实设备可以包括但不限于如下几个类型：
2.1)电脑端虚拟现实(PCVR)设备，利用PC端进行虚拟现实功能的相关计算以及数据输出，外接的电脑端虚拟现实设备利用PC端输出的数据实现虚拟现实的效果。
2.2)移动虚拟现实设备，支持以各种方式(如设置有专门的卡槽的头戴式显示器)设置移动终端(如智能手机)，通过与移动终端有线或无线方式的连接，由移动终端进行虚拟现实功能的相关计算，并输出数据至移动虚拟现实设备，例如通过移动终端的APP观看虚拟现实视频。
2.3)一体机虚拟现实设备，具备用于进行虚拟功能的相关计算的处理器，因而具备独立的虚拟现实输入和输出的功能，不需要与PC端或移动终端连接，使用自由度高。
3)增强现实(Augmented Reality，AR)：一种在相机采集图像的过程中，实时地计算相机在现实世界(或称三维世界、真实世界)中的相机姿态参数，根据该相机姿态参数在相机采集的图像上添加虚拟元素的技术。虚拟元素包括但不限于：图像、视频和三维模型。AR 技术的目标是在屏幕上把虚拟世界套接在现实世界上进行互动。
4)混合现实(Mixed Reality，MR)：将计算机创建的感官输入(例如，虚拟对象)与来自物理布景的感官输入或其表示集成的模拟布景，一些MR布景中，计算机创建的感官输入可以适应于来自物理布景的感官输入的变化。另外，用于呈现MR布景的一些电子系统可以监测相对于物理布景的取向和/或位置，以使虚拟对象能够与真实对象(即来自物理布景的物理元素或其表示)交互。例如，系统可监测运动，使得虚拟植物相对于物理建筑物看起来是静止的。
5)扩展现实(Extended Reality，XR)是指由计算机技术和可穿戴设备生成的所有真实和虚拟组合环境以及人机交互，其包含了虚拟现实(VR)、增强现实(AR)以及混合现实(MR)等多种形式。
6)虚拟场景(又称为虚拟空间)，是应用程序在电子设备上运行时显示(或提供)的虚拟场景。该虚拟场景可以是对真实世界的仿真环境，也可以是半仿真半虚构的虚拟场景，还可以是纯虚构的虚拟场景。虚拟场景可以是二维虚拟场景、2.5维虚拟场景或者三维虚拟场景中的任意一种，本申请实施例对虚拟场景的维度不加以限定。例如，虚拟场景可以包括天空、陆地、海洋等，该陆地可以包括沙漠、城市等环境元素。
7)虚拟对象，虚拟场景中进行交互的对象，受到用户或机器人程序(例如，基于人工智能的机器人程序)的控制，能够在虚拟场景中静止、移动以及进行各种行为的对象。
在介绍了本申请实施例涉及到的一些概念之后，下面结合附图对本申请实施例提供的一种虚拟互动方法、装置、设备及介质进行详细说明。
图1为本申请实施例提供的一种虚拟互动方法的流程示意图。本申请提供的虚拟互动方法可由虚拟互动装置来执行。该虚拟互动装置可由硬件和/或软件组成，并可集成于电子设备中。本申请实施例中，电子设备可选为任意能够提供虚拟空间的硬件设备。示例性的，电子设备可以是但不限于：VR设备、AR设备、MR设备和XR设备等。本申请对电子设备的类型不做具体限制。
如图1所示，该方法可以包括如下步骤：
S101，在第一互动空间内显示视频流，其中视频流包括：目标互动对象。
在本申请实施例中，第一互动空间可理解为第一虚拟空间，并且该第一虚拟空间可以是电子设备针对任一主播选择的某一直播场景模拟出来的虚拟场景。例如，主播需要搭建热带森林这一类型直播场景时，电子设备根据这一类型构建相应的虚拟直播场景，作为本申请中的第一互动空间。
其中，第一互动空间内可以显示主播端的视频流，在本申请中主播端的视频流优选为 直播视频流。并且，该直播视频流至少包括有目标互动对象。在本申请中，目标互动对象可理解为主播。比如，目标互动对象为某一场演唱会的表演者等。
相应的，在该第一互动空间内显示主播端的直播视频流时，该第一互动空间可理解为主播所在的虚拟直播间。
应理解的是，直播间是指由众多网络用户聚合在一起的社交网络平台、即时通讯平台等，用户与主播通过登录客户端的方式进入直播间，用户在直播间内以成员的身份存在，同一个直播间内包含有多种身份的成员，比如观众等。用户与主播可加入或退出直播间。
示例性的，用户A通过手柄等控制器从电子设备显示屏显示的多个直播间中选择任一目标直播间，并以观众的身份进入该目标直播间之后，就可以观看目标直播间内的主播表演。
S102，根据互动控制信息，控制至少一个虚拟对象进入第二互动空间，其中第二互动空间与第一互动空间相互独立。
传统用户(观众)与主播之间的互动方式，一般是弹幕聊天或者礼物互动。然而，因为上述两种互动方式较为单调，难以调动起用户的互动积极性。所以，本申请在第一互动空间的基础上，增加了一个与第一互动空间相平行且独立的新虚拟空间(第二互动空间)，如图2所示。进而，将该第二互动空间作为实现虚拟互动的独立互动空间，使得用户与主播可以在这个独立互动空间内进行各种互动，从而可以丰富用户与主播之间的互动方式，提高用户与主播之间的互动积极性。
应理解的是，上述第二互动空间的创建过程与第一互动空间创建过程类似，示例性的可以是基于主播在创建第一互动空间的同时默认创建第二互动空间等，此处对其不做具体赘述。
通常，主播在直播过程中通过与观众进行互动，能够让直播内容变得更加有趣。所以，在直播过程中主播可向直播间内的观众发送互动邀请，以邀请任意观众进行互动；或者，还可以是直播间内的观众主动向主播发送互动申请，以申请与主播进行互动。
在一些实施例中，主播与观众建立互动连接的方式，可包括但不限于如下方式：
第一种方式，
主播在直播过程中可以设置至少一个互动环节。并且，每当到达互动环节时，可通过在直播间内显示一个互动提示弹窗，使得用户可以基于该互动提示弹窗参与到与主播的互动中。
其中，用户基于互动提示弹窗参与到互动中，具体实现过程可以是通过触发互动提示弹窗中的确定选项，使得用户对应的虚拟对象(比如虚拟角色，Avatar)进入到专门进行 各种互动的第二互动空间，从而在第二互动空间内可与主播进行互动。
在本申请中，直播间内每个用户对应的虚拟对象可以是进入直播间时电子设备根据用户个人信息自动配置的。例如，当用户S进入某一直播间时，获取到该用户S的个人信息中性别一栏为男，根据性别男为用户S配置一男性虚拟对象。又例如，当用户W进入某一直播间时，获取到该用户W的个人信息中性别一栏为女，此时根据性别女为用户W配置一女性虚拟对象。
此外，也可以是用户通过电子设备提供的虚拟对象创建功能，创建符合自身个性化需求的虚拟对象等，本申请对此不做具体限制。
应理解的是，一个直播间内的用户数量可能有多个，因此基于直播间内显示的互动提示弹窗，使得用户与主播进行互动时，参与互动的用户数量可以为至少一个。
第二种方式
在主播直播过程中，直播间内会显示互动控件，比如连麦互动控件等。如果任意用户想要与主播进行互动，则可以通过触发直播间内的连麦互动控件向主播发送互动申请。当主播通过互动申请时，发送互动申请用户所对应的虚拟对象会进入到专门进行各种互动的第二互动空间，从而在第二互动空间内与主播进行互动。
需要说明的是，主播所在直播间除了与主播建立互动连接之外的用户之外，还存在其他用户(即未与主播建立互动连接的用户)。所以，控制与主播建立互动连接的用户所对应虚拟对象进入第二互动空间时，可以不对主播所在的互动空间进行切换操作，即主播依旧停留在第一互动空间内，使得其他用户可以在第一互动空间内继续观看主播的表演。
又因为进入第二互动空间内的用户需要与主播进行互动，此时本申请可通过利用第一互动空间内的第一相机采集主播的实时画面，并将该实时画面发送到第二互动空间。进而，在第二互动空间内显示主播的实时画面，从而使得第二互动空间内的每个虚拟对象，可以基于主播的实时画面与主播进行各种互动。
其中，第一互动空间内的第一相机可理解为实现虚拟互动的相机，并且第一相机可选为2D相机或者其他类型相机，此处对其不做任何限制。
S103，在第二互动空间内，每个虚拟对象与目标互动对象进行互动。
当至少一个虚拟对象进入到第二互动空间之后，每个虚拟对象即可与目标互动对象(主播)进行互动。在本申请中，互动可以为语音连麦互动或者视频连麦互动。
其中，语音连麦互动主要是通过语音通话方式进行互动。而视频连麦互动则是通过语音和实时画面进行互动。也就是说，语音连麦互动这一方式只能听到互动双方的语音数据，看不到互动双方的实时画面，而视频连麦互动方式不仅能够听到互动双方的语音数据，还 可以看到互动双方的实时画面。
视频连麦互动不仅可以听到互动双方的语音数据，还可以看到互动双方的实时画面。所以，在视频连麦互动这一互动方式下，每个虚拟对象与目标互动对象还可以进行不同类型的互动。
在一些实施例中，不同类型的互动可以包括才艺互动和游戏互动中的至少一种。
其中，才艺互动可以包括但不限于：主播与每个虚拟对象进行合唱同一首歌曲，或者，主播与每个虚拟对象进行共舞等。
其中，游戏互动可以包括但不限于：看嘴型猜歌曲、听前奏猜歌名和成语接龙等。
本申请实施例提供的技术方案，通过在第一互动空间内显示视频流，并根据互动控制信息控制至少一个虚拟对象进入第二互动空间，进而在第二互动空间内每个虚拟对象与目标互动对象进行互动。本申请通过在第一互动空间基础上增加一个独立的第二互动空间，使得观众可以在独立的第二互动空间内与主播进行沉浸式互动，从而可以丰富虚拟互动方式，改善虚拟互动效果，提升观众的互动积极性和互动体验。
在上述实施例的基础上，对本申请中根据互动控制信息，控制至少一个虚拟对象进入第二互动空间进行进一步的解释说明，具体参见图3。
如图3所示，该方法可以包括如下步骤：
S201，在第一互动空间内显示视频流，视频流包括：目标互动对象。
S202，如果当前时间为互动时间，则在第一互动空间内显示互动提示弹窗，互动提示弹窗中至少包括：互动提示信息和互动确定选项。
在一些实施例中，在开始直播之前，主播可以预先设置至少一个互动环节，并且会为每个互动环节设置互动开始时间和互动结束时间。由此，可以根据预先设置的互动环节与直播间内的用户进行有序互动，另外还能更好的掌控直播的时长。
设置好互动环节之后，主播可以开始直播，并在直播过程中电子设备会实时检测当前时间是否达到预设互动环节的互动开始时间。如果当前时间为互动开始时间，则在主播所在直播间(即第一互动空间)内显示互动提示弹窗，使得直播间内的用户可以基于该互动提示弹窗选择是否与主播进行互动。
互动提示弹窗内包括：互动提示信息、互动确定选项和互动拒绝选项。因此，位于直播间内的用户可以通过触发互动确定选项参与到与主播的互动中；或者，也可以通过触发互动拒绝选项放弃与主播的互动。
示例性的，如图4a所示，在第一互动空间内显示的互动提示弹窗包括：“XX想跟你 一起互动”互动提示信息，“马上去”互动确定选项以及“放弃”互动拒绝选项。如果第一互动空间内的用户W和用户T想参与到与主播的互动中，则用户W和用户T可分别通过手柄等控制器、手势或者语音等方式选中“马上去”互动确定选项与主播进行互动，如图4b所示。
又例如，如图5a所示，在第一互动空间内显示的互动提示弹窗包括：“XX想跟你一起语音聊天”互动提示信息，“马上去”互动确定选项，“放弃”互动拒绝选项，主播图像以及互动动效。如果第一互动空间内的用户XX不想参与到与主播的互动中，则用户XX通过手柄等控制器或者语音等方式选中“放弃”互动拒绝选项拒绝与主播进行互动，如图5b所示。其中，主播图像可以是主播真实图像，也可以是基于主播创建的主播虚拟图像，此处对其不做具体限制。另外，互动动效可选为是波纹动效或者其他建立互动连接的动效，此处对其不做任何限制。
S203，响应于互动确定选项的选中指令，控制至少一个虚拟对象进入第二互动空间。
S204，在第二互动空间内，每个虚拟对象与目标互动对象进行互动。
在一些实施例中，检测是否获取到第一互动空间内任意用户，对互动提示弹窗内互动确定选项的选中指令。如果检测到互动确定选项的选中指令，则确定发送给选中指令的用户想要与主播进行互动，此时可控制该用户对应的虚拟对象进入到第二互动空间内。从而在第二互动空间内实现主播与虚拟对象之间的互动。
考虑到一场直播的时间长度是有限的，因此为了实现主播与用户进行互动的基础上，保证主播的正常表演，本申请响应于互动确定选项的选中指令，控制至少一个虚拟对象进入第二互动空间时，需要控制进入第二互动空间的虚拟对象数量，以确保主播与所有进入第二互动空间的虚拟对象之间的互动时长不超过互动环节预设的时长。其中，进入第二互动空间内虚拟对象的数量可根据主播预设的互动环节时长进行灵活调整，例如可以为1个、3个或者4个等。
基于上述原因，本申请根据获取到所有互动确定选项的选中指令，控制至少一个虚拟对象进入第二互动空间之前，首先根据筛选规则从获取到的所有选中指令中，筛选目标选中指令。其次，对目标选中指令进行响应操作，控制与目标选中指令对应的虚拟对象进入第二互动空间。进而，进入第二互动空间的虚拟对象可与主播进行互动。
在本申请中，筛选规则可以是任意从获取到的选中指令中筛选目标选中指令的策略或算法，此处对其不做具体限制。例如，按照预设标识信息筛选目标选中指令，或者按照预设ID筛选目标选中指令等，此处对其不做具体限制。其中，标识信息可理解为唯一确定用户身份的信息，比如用户名称、用户联系电话号码等。预设ID可以是用户的身份证号码等。
在一些实施例中，本申请根据筛选规则从获取到的所有选中指令中，筛选目标选中指令，可通过确定每个选中指令对应的虚拟对象标识是否为预设标识。如果任意选中指令对应的虚拟对象标识为预设标识，则确定该选中指令为目标选中指令。如果任意选中指令对应的选中对象标识不为预设标识，则确定该选中指令不为目标选中指令。
为了更为清楚的说明从所有选中指令中筛选目标选中指令，并控制目标选中指令对应的虚拟对象进入第二互动空间过程，下面结合图6a至图6f以具体示例进行举例说明。
具体的，假设在第一互动空间内显示的互动提示弹窗包括：“XX想跟你一起语音聊天”互动提示信息，“我要报名”互动确定选项，“放弃”互动拒绝选项，主播图像、互动动效以及“XXX人已报名”动态提示信息，如图6a所示。其中，“XXX人已报名”动态提示信息会随着报名人数的变化呈现动态变化效果，该动态变化效果的更新频率可根据直播时延要求进行灵活设置。如果直播时延要求低则可以每隔5秒钟更新一次，如果直播时延要求稿则可以每隔1秒钟更新一次等，本申请对其不做具体限制。
如图6b所示，第一互动空间内的用户1、用户2、用户3、用户4、用户5和用户6均点击“我要报名”互动确定选项，向电子设备发送“我要报名”互动确定选项的选中指令。其中，点击“我要报名”互动确定选项时电子设备和/或手柄等控制器会向用户输出震动反馈，以通过震动反馈提醒用户已选中“我要报名”互动确定选项。
并且，当电子设备获取到上述选中指令时，可以在第一互动空间内的互动提示弹窗内显示“报名成功”和“我们会对报名的观众进行抽选，结果稍后通知”的提示信息，如图6c所示。其中，为了避免该提示信息长时间显示在第一互动空间内造成遮挡主播的表演，本申请可以控制提示信息显示预设时长后执行消失操作，以保证用户能够完整的观看到主播表演，避长时间的遮挡造成的观看体验不佳的问题发生。在本申请中，预设时长可根据直播需求进行灵活设置，例如2秒钟或者3秒钟等。
如果预设互动环节最多可与4个用户进行互动，并且筛选规则是按照预设用户名称(用户昵称)筛选目标选中指令，则将用户1、用户2、用户3、用户4、用户5和用户6各自的用户名称分别与筛选规则中的预设用户名称进行比对。如果用户1、用户3、用户4和用户5各自的用户名称为预设用户名称，则确定用户1、用户3、用户4和用户5对应的选中指令为目标选中指令。然后，在用户1、用户3、用户4和用户5各自对应的第一互动空间内显示“恭喜成为幸运观众”和“您即将进入互动专用互动空间”提示信息，以及“请确保您的网络连接通畅，且处于安静环境中”备注说明，具体如图6d。其中，上述提示信息和备注说明显示达到预设时长时，控制提示信息和备注说明执行消失操作。
如图6e所示，当提示信息和备注说明消失之后，可在第一互动空间内呈现预设时长的 空间切换动效，比如睁闭眼动效或者正在加载中的动效等。当空间切换动效展示时长达到预设时长时，在用户1、用户3、用户4和用户5各自对应虚拟对象面前会分别出现第二互动空间，即用户1、用户3、用户4和用户5进入第二互动空间，参见图6f。进而，用户1、用户3、用户4和用户5可以与主播进行各种互动。
需要说明的是，当控制至少一个虚拟对象进入第二互动空间之后，在一些实施例中，还在第一互动空间内的对应虚拟对象上显示“互动中”标识信息，使得第一互动空间内的用户可以知晓哪些用户正在与主播进行互动，例如图7所示。
此外，第二互动空间可以支持用户与主播之间的互动，并且这种互动不同于第一互动空间内的常规弹幕聊天和礼物赠送方式。因此，本申请可对第二互动空间内的互动功能进行限制，以区分第二互动空间的互动与第一互动空间内的常规互动方式。例如，在第二互动空间内仅向用户提供开关麦克风以及开关摄像头的权限等。并且，开关麦克风以及开关摄像头的权限还可由主播端进行统一管理，从而避免一些虚拟对象发表不当言论或者做出不雅举动，从而保证整个直播过程能够顺畅进行。
本申请实施例提供的技术方案，通过在第一互动空间内显示视频流，并根据互动控制信息控制至少一个虚拟对象进入第二互动空间，进而在第二互动空间内每个虚拟对象与目标互动对象进行互动。本申请通过在第一互动空间基础上增加一个独立的第二互动空间，使得观众可以在独立的第二互动空间内与主播进行沉浸式互动，从而可以丰富虚拟互动方式，改善虚拟互动效果，提升观众的互动积极性和互动体验。
在本申请的一种可选的实现情形中，考虑第一互动空间中还存在未参与主播互动的其他用户。因此，为了使得这些其他用户即能看到主播与用户之间的互动内容，还可以直观看到主播的表演画面，在一些实施例中，本申请在第一互动空间内设置一个第一显示屏。从而将第二互动空间内每个虚拟对象与目标互动对象的互动画面显示通过第一显示屏进行显示。下面结合图8，对本申请实施例提供的虚拟互动方法进行进一步说明。
如图8所示，该方法可以包括如下步骤：
S301，在第一互动空间内显示视频流，视频流包括：目标互动对象。
S302，根据互动控制信息，控制至少一个虚拟对象进入第二互动空间，其中第二互动空间与第一互动空间相互独立。
S303，在第二互动空间内，每个虚拟对象与目标互动对象进行互动。
第二互动空间内的虚拟对象与目标互动对象可以连麦互动，具体视频连麦互动或者语音连麦互动(语音聊天互动)。所以，在控制至少一个虚拟对象进入第二互动空间之后， 本申请还可以在第二互动空间内显示第三显示屏(互动屏)，并通过该互动屏显示每个虚拟对象与目标互动对象的连麦画面，使得位于第一互动空间内的其他用户可以观看第二互动空间内的虚拟对象与主播之间的互动过程。
例如，如图9a所示，当第二互动空间内虚拟对象有两个，分别是虚拟对象1和虚拟对象2，那么在互动屏上可显示主播、虚拟对象1和虚拟对象2的语音连麦画面。
主播与各虚拟对象进行连麦互动过程中，有一段时间是主播在发言或表演，另一段时间是虚拟对象在发言或表演。因此，为了直观看到当前时刻是主播还是哪一虚拟对象在发言或表演，本申请可在互动屏上显示每个虚拟对象与目标互动对象的互动过程中，可首先确定正在互动(即当前正在发言或表演)的目标对象。如果正在互动的目标对象为主播，则在互动屏上对主播进行突出显示。如果正在互动的目标对象为任一虚拟对象，则在互动屏上对该虚拟对象进行突出显示，从而根据突出显示的对象可以确定当前正在发言或表演的人是谁。
继续以图9a为例进行说明，当检测到当前正在语音连麦互动的目标对象为主播时，在互动屏上对主播进行突出显示，比如主播图像边框高亮显示等，具体参见图9b。又比如，在互动屏上只显示主播图像，即通过单人显示方式显示正在语音连麦互动的目标对象，具体如图9c所示。
S304，在第一互动空间内的第一显示屏上，显示每个虚拟对象与目标互动对象的互动画面。
应理解的是，第一显示屏可以为除显示主播直播视频流主屏幕之外的副屏。并且，该副屏可选为2D屏。
在一些实施例中，在第二互动空间内的每个虚拟对象与目标互动对象的互动过程中，本申请可通过第一互动空间内的第一显示屏，显示第二互动空间内每个虚拟对象与目标互动对象的互动画面，使得没有参与互动的其他用户即能看到主播与参与互动用户之间的互动内容，还可以直观看到主播的表演画面，例如图10所示。
在本申请中，第一互动空间内第一显示屏显示的第二互动空间内每个虚拟对象与目标互动对象的互动画面，可通过如下方式获取：
第一步，获取第二互动空间内虚拟相机采集的目标画面，该目标画面是与目标互动对象进行互动时，每个虚拟对象的交互画面。
在本申请中，第二互动空间内会固定设置有虚拟相机。该虚拟相机用于捕捉互动虚拟对象的实时图像，并将捕捉到的实时图像通过实时音视频服务(Real-Time Communication，简称RTC)传输给第一互动空间的第二显示屏，以为后续获取第二互动空间内每个虚拟对 象与目标互动对象的互动画面奠定基础。其中，第二显示屏具体为现场2D大屏。
需要说明的是，虚拟相机采集的实时图像清晰度至少为1080p，以保证采集的实时图像的清晰程度。
也就是说，当虚拟对象进入到第二互动空间之后，位于第二互动空间内的虚拟相机就会实时采集虚拟对象的画面信息，并将画面实时传输到第一互动空间内的第二显示屏。从而通过第二显示屏可以显示第二互动空间内虚拟对象的互动过程，使得主播可以根据虚拟对象的互动进行响应操作。
第二步，在第二显示屏上显示目标画面，并通过目标相机采集第二显示屏显示的目标画面，和目标互动对象的交互画面，目标相机与第一显示屏和目标互动对象相对应。
第三步，根据第二显示屏显示的目标画面，和目标互动对象的交互画面，生成每个虚拟对象与所述目标互动对象的互动画面。
其中，目标相机可选为2D相机。
在一些实施例中，在互动过程中主播一直位于第一互动空间，并且第一互动空间内的第二显示屏上会显示第二互动空间内虚拟对象的实时画面。所以，本申请可以通过第一互动空间内的目标相机采集主播的交互画面，以及第二显示屏显示的目标画面。进而，根据目标相机采集的主播的交互画面，以及第二显示屏显示的目标画面生成每个虚拟对象与所述目标互动对象的互动画面。
作为一种可选的实现方式，可将主播的交互画面与第二显示屏显示的目标画面进行拼接，生成每个虚拟对象与所述目标互动对象的互动画面。
作为另一种可选的实现方式，可从主播的交互画面中抠出主播区域，然后将主播区域与第二显示屏显示的目标画面进行拼接，生成每个虚拟对象与所述目标互动对象的互动画面。
除了上述两种生成方式之外，还可以通过其他方式生成每个虚拟对象与所述目标互动对象的互动画面，此处对其不做具体限制。
需要说明的是，在主播与第一互动空间内的用户未进行互动时，第一互动空间内的第一显示屏上可以显示主播的近景表演画面；或者，显示第一互动空间内任意用户对应虚拟对象的近景画面；或者，显示与第一互动空间关联的背景画面和/或文字信息等，此处对其不做具体限制。
本申请实施例提供的技术方案，通过在第一互动空间内显示视频流，并根据互动控制信息控制至少一个虚拟对象进入第二互动空间，进而在第二互动空间内每个虚拟对象与目标互动对象进行互动。本申请通过在第一互动空间基础上增加一个独立的第二互动空间， 使得观众可以在独立的第二互动空间内与主播进行沉浸式互动，从而可以丰富虚拟互动方式，改善虚拟互动效果，提升观众的互动积极性和互动体验。此外，通过在第一互动空间内设置第一显示屏，并通过第一显示屏显示第二互动空间内每个虚拟对象与目标互动对象的互动画面，使得没有参与互动的其他用户即能看到主播与参与互动用户之间的互动内容，还可以直观看到主播的表演画面，从而满足用户观看视频流过程中的不同观看需求，从而提高用户使用体验。
在本申请的另一种可选的实现情形中，第二互动空间内的任意虚拟对象与目标互动对象进行互动过程中，可能因为网络原因或者个人原因中途退出第二互动空间。针对此种情况，本申请可通过向参与互动的用户输出异常提示信息，使得用户根据该提示信息知晓退出互动的原因并及时进行调整。下面结合图11，继续对本申请实施例提供的虚拟互动方法进行说明。
如图11所示，该方法可以包括如下步骤：
S401，在第一互动空间内显示视频流，视频流包括：目标互动对象。
S402，根据互动控制信息，控制至少一个虚拟对象进入第二互动空间，其中第二互动空间与第一互动空间相互独立。
S403，在第二互动空间内，每个虚拟对象与目标互动对象进行互动。
S404，如果任意虚拟对象与目标互动对象的互动出现异常，则输出异常提示信息。
在本申请中，位于第二互动空间内的任意虚拟对象与目标互动对象之间的互动出现异常，可包括如下情形：
情形一
在互动过程中任意虚拟对象退出第二互动空间。
示例性的，如图12a所示，在互动过程中如果虚拟对象1通过触发第二互动空间内呈现的“退出互动”控件触发退出指令，则确定虚拟对象1对应用户要主动退出第二互动空间。此时，在第二互动空间内显示异常提示弹窗。其中，该异常提示弹窗可包括：“离开第二互动空间”挽留主题信息，“您确认离开当前互动吗？”挽留提示信息，“放弃”控件和“残忍离开”控件。如果虚拟对象1对应用户选中“残忍离开”控件，则离开第二互动空间，并显示“正在回溯现实时空中，请等待”的提示，如图12b所示。
情形二
在互动过程中任意虚拟对象对应终端设备的网络状况差。
考虑实际使用过程中网络不稳定，导致互动过程中虚拟对象对应终端设备的网络状况 不佳，影响互动效果，此时可在第二互动空间内显示“当前网络状况不佳”异常提示信息，如图12c所示。
情形三
在互动过程中任意虚拟对象对应终端设备的网络掉线。
虚拟对象对应终端设备使用的网络，可能因为局域网路由器或者线路等问题，导致网络连接时出现非正常数据连接终止情况，即网络掉线。造成虚拟对象退出第二互动空间。针对该情况，可在第一互动空间内显示“遇到了问题，您已离开第二互动空间”异常提示。
在另一可实现方式中，考虑到整个互动过程没有发生任何异常情况时，如果第二互动空间内的虚拟对象与目标互动对象正常结束互动，则从第二互动空间返回到第一互动空间，并在第一互动空间内显示互动结束提示信息。其中，互动结束提示信息可选为但不限于：互动已结束，期待您下次参与；互动已结束，谢谢您的参与等。
本申请实施例提供的技术方案，通过在第一互动空间内显示视频流，并根据互动控制信息控制至少一个虚拟对象进入第二互动空间，进而在第二互动空间内每个虚拟对象与目标互动对象进行互动。本申请通过在第一互动空间基础上增加一个独立的第二互动空间，使得观众可以在独立的第二互动空间内与主播进行沉浸式互动，从而可以丰富虚拟互动方式，改善虚拟互动效果，提升观众的互动积极性和互动体验。此外，当检测到互动过程中出现异常时，通过向用户输出异常提示信息，使得用户可以及时进行调整，以确保互动可以正常进行，从而可以确保互动品质。
为了更加清楚的说明本申请提供的虚拟互动方法，下面结合图13进行示例性说明，具体如下：
如图13所示，假设观看直播链路为实线，互动链路为虚线，那么当用户Q根据观看需求进入第一互动空间之后，可在第一互动空间内的播放主屏幕上观看主播的表演。其中，主播是在现实舞台上进行表演。也就是说，播放主屏幕上显示的主播表演内容可通过第一互动空间内的XR相机实时采集得到。当到达某一互动环节时，用户Q参与并被选中之后，用户Q的虚拟对象会从第一互动空间切换到第二互动空间，即进入第二互动空间。然后，根据第二互动空间内的2D显示屏(第三显示屏或互动屏)上显示主播互动画面，在第二互动空间内与主播进行互动。其中，主播互动画面可通过现实舞台场景中的互动专用2D相机实时采集并发送给第二互动空间内的2D显示屏。
虚拟对象与主播进行互动过程中，第二互动空间内的虚拟相机会实时采集用户Q对应虚拟对象的互动画面，并将该互动画面实时传输到第一互动空间内的现场2D大屏(第二 显示屏)。进而，现实舞台上的主播可以根据现场2D大屏显示的虚拟对象互动画面进行响应。与此同时，现实舞台场景中与副屏(第一显示屏)和主播相对应的副屏2D相机会采集主播的实时画面以及现场2D大屏现实的虚拟对象互动画面，并将根据这两类画面生成主播与参与互动用户Q之间的互动内容通过副屏进行显示操作。
并且，当互动结束之后，用户Q的虚拟对象可从第二互动空间退出，并回到第一互动空间，继续观看主播的表演。
也就是说，本申请通过在第一互动空间基础上增加一个独立的第二互动空间，使得观众可以在独立的第二互动空间内与主播进行沉浸式互动，从而可以丰富虚拟互动方式，改善虚拟互动效果，提升观众的互动积极性和互动体验
下面参照附图14，对本申请实施例提出的一种虚拟互动装置进行描述。图14为本申请实施例提供的一种虚拟互动装置的示意性框图。
如图14所示，该虚拟互动装置500包括：显示模块510、控制模块520和互动模块530。
其中，显示模块510，用于在第一互动空间内显示视频流，所述视频流包括：目标互动对象；
控制模块520，用于根据互动提示信息，控制至少一个虚拟对象进入第二互动空间，其中所述第二互动空间与所述第一互动空间相互独立；
互动模块530，用于在所述第二互动空间内，每个所述虚拟对象与所述目标互动对象进行互动。
本申请实施例的一个或多个可选实现方式，互动模块530，具体用于：
在所述第二互动空间内，每个所述虚拟对象与所述目标互动对象进行语音连麦互动；
或者，
在所述第二互动空间内，每个所述虚拟对象与所述目标互动对象进行视频连麦互动。
本申请实施例的一个或多个可选实现方式，互动模块530，还用于：才艺互动和游戏互动中的至少一种。
本申请实施例的一个或多个可选实现方式，控制模块520，包括：
弹窗显示单元，用于如果当前时间为互动时间，则在所述第一互动空间内显示互动提示弹窗，所述互动提示弹窗中至少包括：互动提示信息和互动确定选项；
响应控制单元，用于响应于所述互动确定选项的选中指令，控制至少一个虚拟对象进入第二互动空间。
本申请实施例的一个或多个可选实现方式，控制模块520，还包括：
指令筛选单元，用于从获取到的所有选中指令中，筛选目标选中指令，所述选中指令为所述互动确定选项的选中指令；
相应的，响应控制单元，具体用于：
响应于所述目标选中指令，控制与所述目标选中指令对应的虚拟对象进入第二互动空间。
本申请实施例的一个或多个可选实现方式，指令筛选单元，具体用于：
确定每个选中指令对应的虚拟对象标识是否为预设标识；
如果任意选中指令对应的虚拟对象标识为预设标识，则确定所述选中指令为目标选中指令。
本申请实施例的一个或多个可选实现方式，所述第一互动空间内设置有第一显示屏；
相应的，所述装置500还包括：
互动显示模块，用于在所述第一显示屏上，显示每个所述虚拟对象与所述目标互动对象的互动画面。
本申请实施例的一个或多个可选实现方式，所述第一互动空间内设置有第二显示屏；
相应的，所述装置500还包括：
画面获取模块，用于获取所述第二互动空间内虚拟相机采集的目标画面，所述目标画面是与所述目标互动对象进行互动时，每个所述虚拟对象的交互画面；
画面显示模块，用于在所述第二显示屏上显示所述目标画面，并通过目标相机采集所述第二显示屏显示的目标画面和所述目标互动对象的交互画面，所述目标相机与所述第一显示屏对应；
互动生成模块，用于根据所述第二显示屏显示的目标画面，和所述目标互动对象的交互画面，生成每个所述虚拟对象与所述目标互动对象的互动画面。
本申请实施例的一个或多个可选实现方式，装置500还包括：
屏幕显示模块，用于在所述第二互动空间内显示第三显示屏；
互动显示模块，还用于在所述第三显示屏上，显示每个所述虚拟对象与所述目标互动对象的互动画面。
本申请实施例的一个或多个可选实现方式，互动显示模块，具体用于：
确定正在互动的目标对象，所述目标对象为所述目标互动对象或者任一虚拟对象；
在所述第三显示屏上，对所述目标对象进行突出显示。
本申请实施例的一个或多个可选实现方式，所述装置500还包括：
信息输出模块，用于如果任意所述虚拟对象与所述目标互动对象的互动出现异常，则输出异常提示信息。
本申请实施例的一个或多个可选实现方式，信息输出模块，具体用于：
在互动过程中任意所述虚拟对象退出所述第二互动空间；
或者，
在互动过程中任意所述虚拟对象对应终端设备的网络状况差；
或者，
在互动过程中任意所述虚拟对象对应终端设备的网络掉线。
本申请实施例的一个或多个可选实现方式，
信息输出模块，具体用于如果所述虚拟对象与所述目标互动对象的互动结束，则在所述第一互动空间内显示互动结束提示信息。
本申请实施例的一个或多个可选实现方式，所述视频流为直播视频流。
应理解的是，装置实施例与前述方法实施例可以相互对应，类似的描述可以参照方法实施例。为避免重复，此处不再赘述。具体地，图14所示的装置500可以执行图1对应的方法实施例，并且装置500中的各个模块的前述和其它操作和/或功能分别为了实现图1中的各个方法中的相应流程，为了简洁，在此不再赘述。
上文中结合附图从功能模块的角度描述了本申请实施例的装置500。应理解，该功能模块可以通过硬件形式实现，也可以通过软件形式的指令实现，还可以通过硬件和软件模块组合实现。具体地，本申请实施例中的第一方面方法实施例的各步骤可以通过处理器中的硬件的集成逻辑电路和/或软件形式的指令完成，结合本申请实施例公开的第一方面方法的步骤可以直接体现为硬件译码处理器执行完成，或者用译码处理器中的硬件及软件模块组合执行完成。可选地，软件模块可以位于随机存储器，闪存、只读存储器、可编程只读存储器、电可擦写可编程存储器、寄存器等本领域的成熟的存储介质中。该存储介质位于存储器，处理器读取存储器中的信息，结合其硬件完成上述第一方面方法实施例中的步骤。
图15为本申请实施例提供的一种电子设备的示意性框图。如图15所示，该电子设备600可包括：
存储器610和处理器620，该存储器610用于存储计算机程序，并将该程序代码传输给该处理器620。换言之，该处理器620可以从存储器610中调用并运行计算机程序，以实现本申请实施例中的虚拟互动方法。
例如，该处理器620可用于根据该计算机程序中的指令执行上述虚拟互动方法实施例。
在本申请的一些实施例中，该处理器620可以包括但不限于：
通用处理器、数字信号处理器(Digital Signal Processor，DSP)、专用集成电路(Application Specific Integrated Circuit，ASIC)、现场可编程门阵列(Field Programmable Gate Array，FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等等。
在本申请的一些实施例中，该存储器610包括但不限于：
易失性存储器和/或非易失性存储器。其中，非易失性存储器可以是只读存储器(Read-Only Memory，ROM)、可编程只读存储器(Programmable ROM，PROM)、可擦除可编程只读存储器(Erasable PROM，EPROM)、电可擦除可编程只读存储器(Electrically EPROM，EEPROM)或闪存。易失性存储器可以是随机存取存储器(Random Access Memory，RAM)，其用作外部高速缓存。通过示例性但不是限制性说明，许多形式的RAM可用，例如静态随机存取存储器(Static RAM，SRAM)、动态随机存取存储器(Dynamic RAM，DRAM)、同步动态随机存取存储器(Synchronous DRAM，SDRAM)、双倍数据速率同步动态随机存取存储器(Double Data Rate SDRAM，DDR SDRAM)、增强型同步动态随机存取存储器(Enhanced SDRAM，ESDRAM)、同步连接动态随机存取存储器(synch link DRAM，SLDRAM)和直接内存总线随机存取存储器(Direct Rambus RAM，DR RAM)。
在本申请的一些实施例中，该计算机程序可以被分割成一个或多个模块，该一个或者多个模块被存储在该存储器610中，并由该处理器620执行，以完成本申请提供的虚拟互动方法。该一个或多个模块可以是能够完成特定功能的一系列计算机程序指令段，该指令段用于描述该计算机程序在该电子设备中的执行过程。
如图15所示，该电子设备600还可包括：
收发器630，该收发器630可连接至该处理器620或存储器610。
其中，处理器620可以控制该收发器630与其他设备进行通信，具体地，可以向其他设备发送信息或数据，或接收其他设备发送的信息或数据。收发器630可以包括发射机和接收机。收发器630还可以进一步包括天线，天线的数量可以为一个或多个。
应当理解，该电子设备中的各个组件通过总线系统相连，其中，总线系统除包括数据总线之外，还包括电源总线、控制总线和状态信号总线。
本申请还提供了一种计算机可读存储介质，用于存储计算机程序，所述计算机程序使得计算机执行上述方法实施例所述的虚拟互动方法。
本申请实施例还提供一种包含程序指令的计算机程序产品，当所述程序指令在电子设 备上运行时，使得所述电子设备执行上述方法实施例的虚拟互动方法。
当使用软件实现时，可以全部或部分地以计算机程序产品的形式实现。该计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行该计算机程序指令时，全部或部分地产生按照本申请实施例该的流程或功能。该计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。该计算机指令可以存储在计算机可读存储介质中，或者从一个计算机可读存储介质向另一个计算机可读存储介质传输，例如，该计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(digital subscriber line，DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。该计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。该可用介质可以是磁性介质(例如，软盘、硬盘、磁带)、光介质(例如数字视频光盘(digital video disc，DVD))、或者半导体介质(例如固态硬盘(solid state disk，SSD))等。
本领域普通技术人员可以意识到，结合本文中所公开的实施例描述的各示例的模块及算法步骤，能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请的范围。
在本申请所提供的几个实施例中，应该理解到，所揭露的系统、装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，该模块的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个模块或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或模块的间接耦合或通信连接，可以是电性，机械或其它的形式。
作为分离部件说明的模块可以是或者也可以不是物理上分开的，作为模块显示的部件可以是或者也可以不是物理模块，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。例如，在本申请各个实施例中的各功能模块可以集成在一个处理模块中，也可以是各个模块单独物理存在，也可以两个或两个以上模块集成在一个模块中。
以上所述，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本申请揭露的技术范围内，可轻易想到变化或替换，都应涵盖 在本申请的保护范围之内。因此，本申请的保护范围应以该权利要求的保护范围为准。

Claims (19)

  1. 一种虚拟互动方法，包括：
    在第一互动空间内显示视频流，所述视频流包括：目标互动对象；
    根据互动控制信息，控制至少一个虚拟对象进入第二互动空间，其中所述第二互动空间与所述第一互动空间相互独立；
    在所述第二互动空间内，每个所述虚拟对象与所述目标互动对象进行互动。
  2. 根据权利要求1所述的方法，其中，所述在所述第二互动空间内，每个所述虚拟对象与所述目标互动对象进行互动，包括：
    在所述第二互动空间内，每个所述虚拟对象与所述目标互动对象进行语音连麦互动；
    或者，
    在所述第二互动空间内，每个所述虚拟对象与所述目标互动对象进行视频连麦互动。
  3. 根据权利要求2所述的方法，其中，所述在所述第二互动空间内，每个所述虚拟对象与所述目标互动对象进行视频连麦互动，包括：才艺互动和游戏互动中的至少一种。
  4. 根据权利要求1-3中任一项所述的方法，其中，所述根据互动控制信息，控制至少一个虚拟对象进入第二互动空间，包括：
    如果当前时间为互动时间，则在所述第一互动空间内显示互动提示弹窗，所述互动提示弹窗中至少包括：互动提示信息和互动确定选项；
    响应于所述互动确定选项的选中指令，控制至少一个虚拟对象进入第二互动空间。
  5. 根据权利要求4所述的方法，其中，所述响应于所述互动确定选项的选中指令，控制至少一个虚拟对象进入第二互动空间之前，还包括：
    从获取到的所有选中指令中，筛选目标选中指令，所述选中指令为所述互动确定选项的选中指令；
    其中，所述响应于所述互动确定选项的选中指令，控制至少一个虚拟对象进入第二互动空间，包括：
    响应于所述目标选中指令，控制与所述目标选中指令对应的虚拟对象进入第二互动空间。
  6. 根据权利要求5所述的方法，其中，所述从获取到的所有选中指令中，筛选目标选中指令，包括：
    确定每个选中指令对应的虚拟对象标识是否为预设标识；
    如果任意选中指令对应的虚拟对象标识为预设标识，则确定所述选中指令为目标选中 指令。
  7. 根据权利要求1-6中任一项所述的方法，其中，所述第一互动空间内设置有第一显示屏；
    所述方法还包括：
    在所述第一显示屏上，显示每个所述虚拟对象与所述目标互动对象的互动画面。
  8. 根据权利要求7所述的方法，其中，所述第一互动空间内设置有第二显示屏；
    所述在所述第一显示屏中，显示每个所述虚拟对象与所述目标互动对象的互动画面之前，还包括：
    获取所述第二互动空间内虚拟相机采集的目标画面，所述目标画面是与所述目标互动对象进行互动时，每个所述虚拟对象的交互画面；
    在所述第二显示屏上显示所述目标画面，并通过目标相机采集所述第二显示屏显示的目标画面和所述目标互动对象的交互画面，所述目标相机与所述第一显示屏对应；
    根据所述第二显示屏显示的目标画面和所述目标互动对象的交互画面，生成每个所述虚拟对象与所述目标互动对象的互动画面。
  9. 根据权利要求7或8所述的方法，其中，所述根据互动控制信息，控制至少一个虚拟对象进入第二互动空间之后，还包括：
    在所述第二互动空间内显示第三显示屏；
    在所述第三显示屏上，显示每个所述虚拟对象与所述目标互动对象的互动画面。
  10. 根据权利要求9所述的方法，其中，所述在所述第三显示屏上，显示每个所述虚拟对象与所述目标互动对象的互动画面，包括：
    确定正在互动的目标对象，所述目标对象为所述目标互动对象或者任一虚拟对象；
    在所述第三显示屏上，对所述目标对象进行突出显示。
  11. 根据权利要求1-10中任一项所述的方法，其中，所述方法还包括：
    如果任意所述虚拟对象与所述目标互动对象的互动出现异常，则输出异常提示信息。
  12. 根据权利要求11所述的方法，其中，所述任意所述虚拟对象与所述目标互动对象的互动出现异常，包括以下中的一个：
    在互动过程中任意所述虚拟对象退出所述第二互动空间；
    在互动过程中任意所述虚拟对象对应终端设备的网络状况差；
    或者，
    在互动过程中任意所述虚拟对象对应终端设备的网络掉线。
  13. 根据权利要求1-12中任一项所述的方法，其中，所述方法还包括:
    如果所述虚拟对象与所述目标互动对象的互动结束，则在所述第一互动空间内显示互动结束提示信息。
  14. 根据权利要求1-13任一项所述的方法，其中，所述视频流为直播视频流。
  15. 一种虚拟互动装置，其中，包括：
    显示模块，用于在第一互动空间内显示视频流，所述视频流包括：目标互动对象；
    控制模块，用于根据互动提示信息，控制至少一个虚拟对象进入第二互动空间，其中所述第二互动空间与所述第一互动空间相互独立；
    互动模块，用于在所述第二互动空间内，每个所述虚拟对象与所述目标互动对象进行互动。
  16. 一种电子设备，包括：
    处理器和存储器，所述存储器用于存储计算机程序，所述处理器用于调用并运行所述存储器中存储的计算机程序，以执行如权利要求1-14中任一项所述的方法。
  17. 一种计算机可读存储介质，用于存储计算机程序，所述计算机程序使得计算机执行如权利要求1-14中任一项所述的方法。
  18. 一种包含程序指令的计算机程序产品，当所述程序指令在电子设备上运行时，使得所述电子设备执行如权利要求1-14中任一项所述的方法。
  19. 一种计算机程序，包含程序指令，当所述程序指令在电子设备上运行时，使得所述电子设备执行如权利要求1-14中任一项所述的方法。
PCT/CN2024/089880 2023-05-05 2024-04-25 虚拟互动方法、装置、设备和介质 Ceased WO2024230511A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202310501377.4 2023-05-05
CN202310501377.4A CN116614543B (zh) 2023-05-05 2023-05-05 虚拟互动方法、装置、设备和介质

Publications (1)

Publication Number Publication Date
WO2024230511A1 true WO2024230511A1 (zh) 2024-11-14

Family

ID=87677386

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2024/089880 Ceased WO2024230511A1 (zh) 2023-05-05 2024-04-25 虚拟互动方法、装置、设备和介质

Country Status (2)

Country Link
CN (1) CN116614543B (zh)
WO (1) WO2024230511A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119653156A (zh) * 2024-11-20 2025-03-18 北京字跳网络技术有限公司 界面交互的方法、装置、设备和存储介质

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116614543B (zh) * 2023-05-05 2026-01-13 北京字跳网络技术有限公司 虚拟互动方法、装置、设备和介质
CN120428857B (zh) * 2025-04-22 2026-02-06 北京佰锐博雅展览展示股份有限公司 一种车展的智能交互方法、系统、电子设备及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109640191A (zh) * 2017-10-09 2019-04-16 武汉斗鱼网络科技有限公司 一种连麦直播的方法和装置
CN113467676A (zh) * 2021-05-31 2021-10-01 北京达佳互联信息技术有限公司 一种虚拟空间操作方法、装置、电子设备及存储介质
CN113691829A (zh) * 2021-10-26 2021-11-23 阿里巴巴达摩院(杭州)科技有限公司 虚拟对象互动方法、装置、存储介质及计算机程序产品
CN114205679A (zh) * 2021-12-06 2022-03-18 北京百度网讯科技有限公司 一种直播互动方法、装置、电子设备及存储介质
CN116614543A (zh) * 2023-05-05 2023-08-18 北京字跳网络技术有限公司 虚拟互动方法、装置、设备和介质

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113163267B (zh) * 2021-03-23 2022-07-22 五八有限公司 直播交互方法、装置、电子设备及存储介质
CN113467675B (zh) * 2021-05-31 2025-02-18 北京达佳互联信息技术有限公司 一种虚拟空间操作方法、装置、电子设备及存储介质

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109640191A (zh) * 2017-10-09 2019-04-16 武汉斗鱼网络科技有限公司 一种连麦直播的方法和装置
CN113467676A (zh) * 2021-05-31 2021-10-01 北京达佳互联信息技术有限公司 一种虚拟空间操作方法、装置、电子设备及存储介质
CN113691829A (zh) * 2021-10-26 2021-11-23 阿里巴巴达摩院(杭州)科技有限公司 虚拟对象互动方法、装置、存储介质及计算机程序产品
CN114205679A (zh) * 2021-12-06 2022-03-18 北京百度网讯科技有限公司 一种直播互动方法、装置、电子设备及存储介质
CN116614543A (zh) * 2023-05-05 2023-08-18 北京字跳网络技术有限公司 虚拟互动方法、装置、设备和介质

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119653156A (zh) * 2024-11-20 2025-03-18 北京字跳网络技术有限公司 界面交互的方法、装置、设备和存储介质

Also Published As

Publication number Publication date
CN116614543A (zh) 2023-08-18
CN116614543B (zh) 2026-01-13

Similar Documents

Publication Publication Date Title
JP7368886B2 (ja) 情報処理システム、情報処理方法、および情報処理プログラム
CN116614543B (zh) 虚拟互动方法、装置、设备和介质
CN104468623B (zh) 一种基于在线直播的信息展示方法、相关装置及系统
WO2020090786A1 (ja) 仮想空間中のアバター表示システム、仮想空間中のアバター表示方法、コンピュータプログラム
US20120154510A1 (en) Smart Camera for Virtual Conferences
CN112839196B (zh) 一种实现在线会议的方法、装置以及存储介质
CN108632632A (zh) 一种网络直播的数据处理方法和装置
CN112770135A (zh) 基于直播的内容讲解方法、装置、电子设备及存储介质
US12462494B2 (en) Interactive element in a replay
CN114201095A (zh) 直播界面的控制方法、装置、存储介质及电子设备
CN113996062A (zh) 画面显示的方法、装置和电子设备
CN108635863A (zh) 一种网络直播的数据处理方法和装置
CN114268841A (zh) 直播互动方法及装置
CN109788364A (zh) 视频通话互动方法、装置及电子设备
US20240040067A1 (en) Method of broadcasting real-time on-line competitions and apparatus therefor
CN116419031A (zh) 一种数据处理方法、装置以及设备
Ursu et al. Orchestration: Tv-like mixing grammars applied to video-communication for social groups
CN117221641A (zh) 虚拟互动方法、装置、设备和存储介质
JP7360989B2 (ja) 制御サーバ、端末、配信システム、制御方法、情報処理方法、及びプログラム
CN116582705B (zh) 数据处理方法、装置、可读存储介质及设备
CN114082199B (zh) 语音播放方法和语音传输方法以及存储介质和电子设备
JP2023123389A (ja) コミュニケーションシステム
CN210112172U (zh) 一种双弧幕放映系统及播控系统
KR20170085781A (ko) 유무선 통신 네트워크 기반 가상 현실 영상 제공 및 이를 위한 예매 시스템
CN113315885A (zh) 一种用于远程互动的全息演播室及系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24802796

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 24802796

Country of ref document: EP

Kind code of ref document: A1