WO2024016880A1 - 信息交互方法、装置、电子设备和存储介质 - Google Patents
信息交互方法、装置、电子设备和存储介质 Download PDFInfo
- Publication number
- WO2024016880A1 WO2024016880A1 PCT/CN2023/099052 CN2023099052W WO2024016880A1 WO 2024016880 A1 WO2024016880 A1 WO 2024016880A1 CN 2023099052 W CN2023099052 W CN 2023099052W WO 2024016880 A1 WO2024016880 A1 WO 2024016880A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- virtual reality
- reality space
- information
- configuration information
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three-dimensional [3D] modelling for computer graphics
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
Definitions
- the present disclosure relates to the field of computer technology, and specifically to an information interaction method, device, electronic equipment and storage medium.
- VR virtual reality
- virtual reality virtual Reality
- users can watch live video through, for example, head-mounted display devices and related accessories.
- the form of virtual video live broadcast provided by related technologies is relatively simple and the user experience is poor.
- an information interaction method including:
- the composite video configuration information includes virtual reality space information, at least one sub-virtual reality space information corresponding to the virtual reality space information, and video configuration information corresponding to the sub-virtual reality space information;
- an information interaction device including:
- An information receiving unit configured to receive composite video configuration information;
- the composite video configuration information includes virtual reality space information, at least one sub-virtual reality space information corresponding to the virtual reality space information, and at least one sub-virtual reality space information corresponding to the sub-virtual reality space information.
- a subspace determination unit used to determine the target sub-virtual reality space of the user's location in the virtual reality space
- a display unit configured to determine video configuration information corresponding to the target sub-virtual reality space based on the composite video configuration information, and to present video content in the target sub-virtual reality space based on the determined video configuration information.
- an electronic device including: at least one memory and at least one processor; wherein the memory is used to store program code, and the processor is used to call The program code stored in the memory enables the electronic device to execute the information interaction method provided according to one or more embodiments of the present disclosure.
- a non-transitory computer storage medium stores program code, and when the program code is executed by a computer device, such that The computer device executes the information interaction method provided according to one or more embodiments of the present disclosure.
- Figure 1 is a schematic diagram of a virtual reality device according to an embodiment of the present disclosure
- Figure 2 is an optional schematic diagram of a virtual field of view of a virtual reality device according to an embodiment of the present disclosure
- Figure 3 is a flow chart of an information interaction method provided by an embodiment of the present disclosure.
- Figure 4 is a schematic diagram of a virtual reality space provided by an embodiment of the present disclosure.
- FIG. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.
- the term “include” and its variations are open-ended, ie, "including but not limited to.”
- the term “based on” means “based at least in part on.”
- the term “one embodiment” means “at least one embodiment”; the term “another embodiment” means “at least one additional embodiment”; and the term “some embodiments” means “at least some embodiments”.
- the term “responsive to” and related terms means that one signal or event is affected by another signal or event to some extent, but not necessarily completely or directly. If event x occurs "in response to" event y, x may respond to y, directly or indirectly. For example, the occurrence of y may eventually lead to the occurrence of x, but there may be other intermediate events and/or conditions. In other cases, y may not necessarily cause x to occur, and x may occur even if y has not yet occurred. Furthermore, the term “responsive to” may also mean “responsive at least in part to.”
- the term "determine” broadly encompasses a wide variety of actions, which may include retrieving, calculating, calculating, processing, deriving, investigating, looking up (e.g., in a table, database, or other data structure), exploring, and similar actions, Also included may be receiving (e.g., receiving information), accessing (e.g., accessing data in memory), and similar actions, as well as parsing, selecting, selecting, creating, and similar actions, and the like. Relevant definitions of other terms will be given in the description below. Relevant definitions of other terms will be given in the description below. Relevant definitions of other terms will be given in the description below.
- phrase "A and/or B” means (A), (B) or (A and B).
- Extended reality technology can combine reality and virtuality through computers to provide users with a virtual reality space that allows human-computer interaction.
- users can use virtual reality devices such as Head Mount Display (HMD) to conduct social interaction, entertainment, learning, work, telecommuting, and create UGC (User Generated Content), etc. .
- HMD Head Mount Display
- UGC User Generated Content
- PCVR Computer-side virtual reality
- the external computer-side virtual reality equipment uses the data output from the PC side to achieve virtual reality effects.
- Mobile virtual reality equipment supports setting up a mobile terminal (such as a smartphone) in various ways (such as a head-mounted display with a special card slot), and through a wired or wireless connection with the mobile terminal, the mobile terminal performs virtual reality Function-related calculations and output data to mobile virtual reality devices, such as viewing virtual reality videos through mobile terminal APPs.
- a mobile terminal such as a smartphone
- ways such as a head-mounted display with a special card slot
- the mobile terminal performs virtual reality Function-related calculations and output data to mobile virtual reality devices, such as viewing virtual reality videos through mobile terminal APPs.
- the all-in-one virtual reality device has a processor for performing calculations related to virtual functions, so it has independent virtual reality input and output functions. It does not need to be connected to a PC or mobile terminal, and has a high degree of freedom in use.
- the form of the virtual reality device is not limited to this, and can be further miniaturized or enlarged as needed.
- the virtual reality device is equipped with a posture detection sensor (such as a nine-axis sensor), which is used to detect posture changes of the virtual reality device in real time. If the user wears a virtual reality device, when the user's head posture changes, the head posture will be changed.
- the real-time posture is passed to the processor to calculate the gaze point of the user's line of sight in the virtual environment. Based on the gaze point, the image in the three-dimensional model of the virtual environment within the user's gaze range (i.e., the virtual field of view) is calculated and displayed on the display screen. show, make people An immersive experience as if you were watching in a real environment.
- Figure 2 shows an optional schematic diagram of the virtual field of view of the virtual reality device provided by an embodiment of the present disclosure.
- the horizontal field of view angle and the vertical field of view angle are used to describe the distribution range of the virtual field of view in the virtual environment.
- the vertical field of view is used to describe the distribution range of the virtual field of view in the virtual environment.
- the distribution range in the direction is represented by the vertical field of view BOC
- the distribution range in the horizontal direction is represented by the horizontal field of view AOB.
- the human eye can always perceive the image in the virtual field of view in the virtual environment through the lens. It can be understood that the field of view angle The larger it is, the larger the size of the virtual field of view, and the larger the area of the virtual environment that the user can perceive.
- the field of view represents the distribution range of the viewing angle when the environment is perceived through the lens.
- the field of view of a virtual reality device represents the distribution range of the viewing angle of the human eye when the virtual environment is perceived through the lens of the virtual reality device; for another example, for a mobile terminal equipped with a camera, the field of view of the camera The angle is the distribution range of the viewing angle when the camera perceives the real environment and shoots.
- Virtual reality devices such as HMDs, integrate several cameras (such as depth cameras, RGB cameras, etc.). The purpose of the cameras is not limited to providing a pass-through view. Camera images and an integrated inertial measurement unit (IMU) provide data that can be processed through computer vision methods to automatically analyze and understand the environment. Also, HMDs are designed to support not only passive computer vision analysis, but also active computer vision analysis. Passive computer vision methods analyze image information captured from the environment. These methods can be monoscopic (images from a single camera) or stereoscopic (images from two cameras). They include, but are not limited to, feature tracking, object recognition, and depth estimation. Active computer vision methods add information to the environment by projecting patterns that are visible to the camera but not necessarily to the human visual system. Such technologies include time-of-flight (ToF) cameras, laser scanning or structured light to simplify the stereo matching problem. Active computer vision is used to achieve deep scene reconstruction.
- ToF time-of-flight
- Figure 3 shows a flow chart of an information interaction method 100 provided by an embodiment of the present disclosure.
- the method 100 includes steps S120 to S160.
- Step S120 Receive composite video configuration information; the composite video configuration information includes virtual reality space information, at least one sub-virtual reality space information corresponding to the virtual reality space information, and a video corresponding to the sub-virtual reality space information. Configuration information.
- the virtual reality space information is used to identify content presented in the virtual reality space.
- the virtual reality space information can be the scene name of the video live broadcast.
- the virtual reality space information corresponding to the virtual live broadcast space can be "Program A”.
- a corresponding virtual reality space can be configured in advance on the server side for the video content to be played (for example, program A).
- the virtual reality space can have more than two sub-virtual reality spaces, and each sub-virtual reality space
- One or more video streams can be configured, and the videos displayed in different sub-virtual reality spaces can provide different video viewing perspectives of the same object (for example, the same program), such as a stage viewing perspective, a close-up viewing perspective, and a distant viewing perspective.
- the server can provide the virtual reality space information corresponding to the virtual reality space (such as scene name, scene ID), information about how many sub-virtual reality spaces the virtual reality space has, and information about each sub-virtual reality space.
- the corresponding video configuration information is delivered to the client.
- the client can convert the composite video configuration information into a preset standard format.
- the client uniformly converts the received composite video configuration information into a preset standard format, so that the client can be compatible with and adapt to different formats or versions of composite video configuration information.
- the video configuration information includes video presentation mode information
- the video presentation mode information includes one or more of the following: screen shape information, screen number information, video dimension type information, and virtual camera information.
- the video presentation mode information can be used to describe the number of screens used to present videos in the sub-virtual reality space, the shape of each screen, the video dimension type (or 3D video or 2D video) corresponding to each screen, and the virtual camera information.
- the 3D video may include but is not limited to rectangular 3D video, half-view 3D video, panoramic 3D video or fish-eye 3D video.
- a virtual camera is a tool used to simulate the perspective and field of view that a user can see in a virtual reality environment.
- Virtual camera information includes but is not limited to focal length, imaging perspective, spatial position, etc.
- video configuration information includes video stream information.
- the video stream may adopt encoding formats such as H.265, H.264, and MPEG-4.
- the virtual reality space can be a simulation environment of the real world, a semi-simulation and semi-fictional virtual scene, or a purely fictitious virtual scene.
- the virtual scene can be a two-dimensional virtual scene or a 2.5-dimensional virtual scene. Any one of a scene or a three-dimensional virtual scene.
- the embodiments of this application do not limit the dimensions of the virtual scene.
- the virtual scene can include the sky, land, ocean, etc.
- the land can include environmental elements such as deserts and cities, and the user can control virtual objects to move in the virtual scene.
- users can enter the virtual reality space through smart terminal devices such as head-mounted VR glasses, and control their own virtual characters (Avatar) in the virtual reality space to interact socially, entertain and learn with virtual characters controlled by other users. , remote working, etc.
- smart terminal devices such as head-mounted VR glasses
- Avatar virtual characters
- the user in the virtual reality space, can implement related interactive operations through a controller, which can be a handle.
- a controller can be a handle.
- the user can perform related operation controls by operating buttons on the handle.
- gestures or voice or multi-modal control methods may be used to control the target object in the virtual reality device.
- the virtual reality space includes a virtual live broadcast space.
- audience users can control the virtual character (Avatar) to watch the performer's live video from a viewing perspective such as a first-person perspective or a third-person perspective.
- Avatar virtual character
- Step S140 Determine the target sub-virtual reality space of the user's location in the virtual reality space.
- the target sub-virtual reality space at the user's location in the virtual reality space is determined.
- the user can control the virtual character to move within the sub-virtual reality space, and make the virtual character controlled by the user switch between different sub-virtual reality spaces through preset instructions.
- a transfer point can be set in each sub-virtual reality space.
- the virtual character will be transferred to the target sub-virtual space corresponding to the transfer point. in real space.
- Step S160 Determine video configuration information corresponding to the target sub-virtual reality space based on the composite video configuration information, and present video content in the target sub-virtual reality space based on the determined video configuration information.
- the client can perform video rendering based on the video configuration information corresponding to sub-virtual reality space B received in advance, thus, the video content provided by the sub-virtual reality space B can be presented to the user.
- the video presentation method corresponding to the target sub-virtual space may be determined based on the video configuration information corresponding to the target sub-virtual space, such as the number of screens, the shape of the screens, and the dimension type of the video corresponding to the screen ( For example, 3D video or 2D video), and then create the corresponding screen and render the video in the target sub-virtual space.
- the composite video configuration information by receiving composite video configuration information and causing the composite video configuration information to include virtual reality space information, at least one sub-virtual reality space information corresponding to the virtual reality space information, and
- the video configuration information corresponding to the sub-virtual reality space information can further determine the video configuration information corresponding to the target sub-virtual reality space based on the received composite video configuration information and present the corresponding video in the target sub-virtual reality space. content, so that diverse video presentation scenarios can be built on the client, allowing users to obtain a rich and diverse viewing experience.
- videos displayed in different sub-virtual reality spaces can provide different video viewing angles of the same object (for example, the same program), such as a stage viewing angle, a close-up viewing angle, and a distant view. Viewing perspective.
- sub-virtual reality space A corresponding to the stage viewing angle
- sub-virtual reality space B and C corresponding to the close-up viewing angle
- sub-virtual reality space D corresponding to the distant viewing angle
- the user controls the virtual character to enter sub-virtual reality space A he can watch the party scene shot from the stage in sub-virtual reality space A; when the user controls the virtual character to enter sub-virtual reality space B or C, he can watch the party scene in sub-virtual reality space A.
- Virtual reality space B or C watches the party footage shot from a location close to the stage; after the user controls the virtual character to enter the sub-virtual reality space D, the user can watch the party footage shot from a location relatively far away from the stage in the sub-virtual reality space D. Therefore, users can experience different viewing perspectives according to their own needs, allowing them to experience a real live viewing experience in the virtual reality space.
- sub-virtual reality space A may be located in the stage area of the virtual reality space
- sub-virtual reality spaces B, C and D may be located in the audience area of the virtual reality space.
- video streams corresponding to different sub-virtual reality spaces can provide video content captured from camera devices with different shooting angles or camera positions.
- the same sub-virtual reality space corresponds to more than two video configuration information.
- a main screen and multiple secondary screens can be set up in a sub-virtual reality space.
- the main screen and secondary screen can correspond to different video streams, different screen shapes, and different video dimension types. For example, you can play 3D panoramic videos on the main screen and 2D videos on the secondary screen.
- main screens in different sub-virtual reality spaces can be used to present video content with different viewing angles
- secondary screens in different sub-virtual reality spaces can be used to present video content with the same viewing angle
- different video presentation environments can be presented in different virtual reality spaces, and the video presentation environments include one or more of the following: stage, scenery, lighting, props, special effects elements, and stage design.
- stage scenery
- lighting props
- special effects elements special effects elements
- stage design For example, different video contents can be played through different virtual reality spaces, such as different program contents, different anchors, different parties, etc. Different virtual reality spaces have different stage settings, lighting and dance, animation special effects, etc.
- different animation resources (such as textures, animation models, light and shadow effects, etc.) used to present the video presentation environment can be configured for different virtual reality spaces.
- the animation resources can be pre-stored in the client to It allows users to render the corresponding video presentation environment after entering a certain virtual reality space.
- the video configuration information includes live broadcast stage information
- the live broadcast stage information includes one or more of the following: a pre-live broadcast stage, a live broadcast stage, and a post-live broadcast stage.
- a pre-live broadcast stage For example, for different stages of live broadcast, different stage settings, lighting and stage scenery, and animation special effects can be displayed in the virtual reality space, so that users can obtain a rich viewing experience.
- an information interaction device including:
- An information receiving unit configured to receive composite video configuration information;
- the composite video configuration information includes virtual reality space information, at least one sub-virtual reality space information corresponding to the virtual reality space information, and at least one sub-virtual reality space information corresponding to the sub-virtual reality space information.
- a subspace determination unit used to determine the target sub-virtual reality space of the user's location in the virtual reality space
- a display unit configured to determine video configuration information corresponding to the target sub-virtual reality space based on the composite video configuration information, and to present video content in the target sub-virtual reality space based on the determined video configuration information.
- the video configuration information corresponding to different sub-virtual reality spaces in the same virtual reality space is Information can provide different viewing perspectives on the same object.
- the viewing angle includes one or more of the following: a stage viewing angle, a close-up viewing angle, and a distant viewing angle.
- the same sub-virtual reality space corresponds to more than two video configuration information.
- the two or more video configuration information include video configuration information for presenting 3D video images and video configuration information for presenting 2D video images.
- different virtual reality spaces present different video presentation environments
- the video presentation environments include one or more of the following elements: stage, scenery, lighting, props, special effects elements, and stage design.
- the virtual reality space information includes scene identification.
- the video configuration information includes video presentation mode information
- the video presentation mode information includes one or more of the following: screen shape information, screen number information, video dimension type information, and virtual camera information.
- the video configuration information includes live broadcast stage information
- the live broadcast stage information includes one or more of the following: a pre-live broadcast stage, a live broadcast stage, and a post-live broadcast stage.
- the subspace determining unit is configured to determine the target sub-virtual reality space of the user's location in the virtual reality space in response to a user-triggered instruction to cause the user-controlled virtual character to enter the target sub-virtual reality space.
- the device embodiment since it basically corresponds to the method embodiment, please refer to the partial description of the method embodiment for relevant details.
- the device embodiments described above are only illustrative, and the modules described as separate modules may or may not be separate. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. Persons of ordinary skill in the art can understand and implement the method without any creative effort.
- an electronic device including:
- the memory is used to store the program code
- the processor is used to call the program code stored in the memory to make the
- the electronic device executes the information interaction method provided according to one or more embodiments of the present disclosure.
- a non-transitory computer storage medium stores program code, and the program code can be executed by a computer device to cause the computer device to execute An information interaction method provided according to one or more embodiments of the present disclosure.
- Terminal devices in embodiments of the present disclosure may include, but are not limited to, mobile phones, laptops, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablets), PMPs (Portable Multimedia Players), vehicle-mounted terminals (such as Mobile terminals such as car navigation terminals) and fixed terminals such as digital TVs, desktop computers, etc.
- the electronic device shown in FIG. 5 is only an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.
- the electronic device 800 may include a processing device (eg, central processing unit, graphics processor, etc.) 801 , which may be loaded into a random access device according to a program stored in a read-only memory (ROM) 802 or from a storage device 808 .
- the program in the memory (RAM) 803 executes various appropriate actions and processes.
- various programs and data required for the operation of the electronic device 800 are also stored.
- the processing device 801, ROM 802 and RAM 803 are connected to each other via a bus 804.
- An input/output (I/O) interface 805 is also connected to bus 804.
- the following devices may be connected to the I/O interface 805: input devices 806 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a liquid crystal display (LCD), speakers, vibration An output device 807 such as a computer; a storage device 808 including a magnetic tape, a hard disk, etc.; and a communication device 809.
- the communication device 809 may allow the electronic device 800 to communicate wirelessly or wiredly with other devices to exchange data.
- FIG. 5 illustrates electronic device 800 with various means, it should be understood that implementation or availability of all illustrated means is not required. More or fewer means may alternatively be implemented or provided.
- embodiments of the present disclosure include a computer program product including a computer program carried on a computer-readable medium, the computer program containing program code for performing the method illustrated in the flowchart.
- the computer program may be downloaded and installed from the network via communication device 809 or from storage device 808 is installed, or is installed from ROM 802.
- the processing device 801 the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.
- the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two.
- the computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any combination thereof. More specific examples of computer readable storage media may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard drive, random access memory (RAM), read only memory (ROM), removable Programmd read-only memory (EPROM or flash memory), fiber optics, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
- a computer-readable storage medium may be any tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device.
- a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above.
- a computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device .
- Program code embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to: wire, optical cable, RF (radio frequency), etc., or any suitable combination of the above.
- the client and server can communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and can communicate with digital data in any form or medium.
- Communications e.g., communications network
- communications networks include local area networks (“LAN”), wide area networks (“WAN”), the Internet (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or developed in the future network of.
- the above-mentioned computer-readable medium may be included in the above-mentioned electronic device; it may also exist independently without being assembled into the electronic device.
- the above-mentioned computer-readable medium carries one or more programs.
- the electronic device When being prepared for execution, the electronic device is caused to execute the above-mentioned method of the present disclosure.
- Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, including object-oriented programming languages such as Java, Smalltalk, C++, and conventional Procedural programming language—such as "C" or a similar programming language.
- the program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
- the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as an Internet service provider through Internet connection).
- LAN local area network
- WAN wide area network
- Internet service provider such as an Internet service provider through Internet connection
- each block in the flowchart or block diagram may represent a module, segment, or portion of code that contains one or more logic functions that implement the specified executable instructions.
- the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown one after another may actually execute substantially in parallel, or they may sometimes execute in the reverse order, depending on the functionality involved.
- each block of the block diagram and/or flowchart illustration, and combinations of blocks in the block diagram and/or flowchart illustration can be implemented by special purpose hardware-based systems that perform the specified functions or operations. , or can be implemented using a combination of specialized hardware and computer instructions.
- the units involved in the embodiments of the present disclosure can be implemented in software or hardware. Among them, the name of a unit does not constitute a limitation on the unit itself under certain circumstances.
- FPGAs Field Programmable Gate Arrays
- ASICs Application Specific Integrated Circuits
- ASSPs Application Specific Standard Products
- SOCs Systems on Chips
- CPLD Complex Programmable Logical device
- a machine-readable medium may be a tangible medium that may contain or store instructions A program for use by or in conjunction with an execution system, device, or device.
- the machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium.
- Machine-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or devices, or any suitable combination of the foregoing.
- machine-readable storage media would include one or more wire-based electrical connections, laptop disks, hard drives, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
- RAM random access memory
- ROM read only memory
- EPROM or flash memory erasable programmable read only memory
- CD-ROM portable compact disk read-only memory
- magnetic storage device or any suitable combination of the above.
- an information interaction method including: receiving composite video configuration information; the composite video configuration information includes virtual reality space information, at least one corresponding to the virtual reality space information Sub-virtual reality space information and video configuration information corresponding to the sub-virtual reality space information; determining the target sub-virtual reality space where the user is located in the virtual reality space; determining the target sub-virtual reality space corresponding to the target sub-virtual reality space based on the composite video configuration information.
- video configuration information corresponding to the real space, and based on the determined video configuration information, the video content is presented in the target sub-virtual reality space.
- video configuration information corresponding to different sub-virtual reality spaces in the same virtual reality space can provide different viewing angles for the same object.
- the viewing angle includes one or more of the following: a stage viewing angle, a close-up viewing angle, and a distant viewing angle.
- the same sub-virtual reality space corresponds to more than two video configuration information.
- the two or more video configuration information include video configuration information for presenting 3D video images and video configuration information for presenting 2D video images.
- different virtual reality spaces present different video presentation environments
- the video presentation environments include one or more of the following elements: stage, scenery, lighting, props, special effects elements, and stage design. .
- the virtual reality space information includes a scene identification.
- the video configuration information includes video presentation mode information
- the video Video presentation mode information includes one or more of the following: screen shape information, screen number information, video dimension type information, and virtual camera information.
- the video configuration information includes live broadcast stage information
- the live broadcast stage information includes one or more of the following: a pre-live broadcast stage, a live broadcast stage, and a post-live broadcast stage.
- determining the target sub-virtual reality space of the user's location in the virtual reality space includes: in response to an instruction triggered by the user to cause the user-controlled virtual character to enter the target sub-virtual reality space, Determine the target sub-VR space of the user's location in the VR space.
- an information interaction device including: an information receiving unit configured to receive composite video configuration information; the composite video configuration information includes virtual reality space information, and the virtual reality space information. At least one sub-virtual reality space information corresponding to the space information, and video configuration information corresponding to the sub-virtual reality space information; a sub-space determination unit used to determine the target sub-virtual reality space of the user's location in the virtual reality space; display A unit configured to determine video configuration information corresponding to the target sub-virtual reality space based on the composite video configuration information, and present video content in the target sub-virtual reality space based on the determined video configuration information.
- an electronic device including: at least one memory and at least one processor; wherein the memory is used to store program code, and the processor is used to call the memory.
- the stored program code causes the electronic device to execute the information interaction method provided according to one or more embodiments of the present disclosure.
- a non-transitory computer storage medium stores program code, and when the program code is executed by a computer device, the computer device causes The information interaction method provided according to one or more embodiments of the present disclosure is executed.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Computer Hardware Design (AREA)
- Human Computer Interaction (AREA)
- Optics & Photonics (AREA)
- Geometry (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims (13)
- 一种信息交互方法,其特征在于,包括:接收复合视频配置信息;所述复合视频配置信息包括虚拟现实空间信息、与所述虚拟现实空间信息对应的至少一个子虚拟现实空间信息、以及与所述子虚拟现实空间信息对应的视频配置信息;确定虚拟现实空间中用户所在位置的目标子虚拟现实空间;基于所述复合视频配置信息确定与所述目标子虚拟现实空间对应的视频配置信息,并基于所确定的视频配置信息在所述目标子虚拟现实空间中呈现视频内容。
- 根据权利要求1所述的方法,其特征在于,在同一虚拟现实空间中不同的子虚拟现实空间所对应的视频配置信息能够提供针对同一对象的不同观看视角。
- 根据权利要求2所述的方法,其特征在于,所述观看视角包括如下中的一个或多个:舞台观看视角、近景观看视角、远景观看视角。
- 根据权利要求1所述的方法,其特征在于,同一子虚拟现实空间对应两个以上视频配置信息。
- 根据权利要求4所述的方法,其特征在于,所述两个以上视频配置信息包括用于呈现3D视频图像的视频配置信息和用于呈现2D视频图像的视频配置信息。
- 根据权利要求1所述的方法,其特征在于,不同的虚拟现实空间呈现不同的视频呈现环境,所述视频呈现环境包括如下中的一个或多个元素:舞台、布景、灯光、道具、特效元素、舞美。
- 根据权利要求1所述的方法,其特征在于,所述虚拟现实空间信息包括场景标识。
- 根据权利要求1所述的方法,其特征在于,所述视频配置信息包括视频呈现方式信息,所述视频呈现方式信息包括如下中的一种或多种:屏幕形状信息、屏幕数量信息、视频维度类型信息、虚拟摄像机信息。
- 根据权利要求1所述的方法,其特征在于,所述视频配置信息包括直播阶段信息,所述直播阶段信息包括如下中的一种或多种:直播前阶段、直播中阶段、直播后阶段。
- 根据权利要求1所述的方法,其特征在于,所述确定虚拟现实空间中用户所在位置的目标子虚拟现实空间,包括:响应于用户触发的使用户控制的虚拟角色进入目标子虚拟现实空间的指令,确定虚拟现实空间中用户所在位置的目标子虚拟现实空间。
- 一种信息交互装置,其特征在于,包括:信息接收单元,用于接收复合视频配置信息;所述复合视频配置信息包括虚拟现实空间信息、与所述虚拟现实空间信息对应的至少一个子虚拟现实空间信息、以及与所述子虚拟现实空间信息对应的视频配置信息;子空间确定单元,用于确定虚拟现实空间中用户所在位置的目标子虚拟现实空间;显示单元,用于基于所述复合视频配置信息确定与所述目标子虚拟现实空间对应的视频配置信息,并基于所确定的视频配置信息在所述目标子虚拟现实空间中呈现视频内容。
- 一种电子设备,其特征在于,包括:至少一个存储器和至少一个处理器;其中,所述存储器用于存储程序代码,所述处理器用于调用所述存储器所存储的程序代码以使所述电子设备执行权利要求1至10中任一项所述的方法。
- 一种非暂态计算机存储介质,其特征在于,所述非暂态计算机存储介质存储有程序代码,所述程序代码被计算机设备执行时,使得所述计算机设备执行权利要求1至10中任一项所述的方法。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US18/840,895 US20250175680A1 (en) | 2022-07-18 | 2023-06-08 | Information exchange method, electronic device and storage medium |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210844086.0A CN117459745A (zh) | 2022-07-18 | 2022-07-18 | 信息交互方法、装置、电子设备和存储介质 |
| CN202210844086.0 | 2022-07-18 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024016880A1 true WO2024016880A1 (zh) | 2024-01-25 |
Family
ID=89578642
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2023/099052 Ceased WO2024016880A1 (zh) | 2022-07-18 | 2023-06-08 | 信息交互方法、装置、电子设备和存储介质 |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US20250175680A1 (zh) |
| CN (1) | CN117459745A (zh) |
| WO (1) | WO2024016880A1 (zh) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106154707A (zh) * | 2016-08-29 | 2016-11-23 | 广州大西洲科技有限公司 | 虚拟现实投影成像方法和系统 |
| CN106373195A (zh) * | 2016-08-25 | 2017-02-01 | 北京国承万通信息科技有限公司 | 虚拟现实场景呈现方法和系统 |
| KR20180102399A (ko) * | 2017-03-07 | 2018-09-17 | 주식회사 브래니 | 가상 현실 게임의 제공을 위한 서버, 가상 현실 게임의 제공을 위한 시스템 및 서버의 가상 현실 게임을 제공하는 방법 |
| US20190180509A1 (en) * | 2017-12-11 | 2019-06-13 | Nokia Technologies Oy | Apparatus and associated methods for presentation of first and second virtual-or-augmented reality content |
| CN110809752A (zh) * | 2017-06-29 | 2020-02-18 | 诺基亚技术有限公司 | 用于虚拟现实内容显示的装置及相关联的方法 |
| CN114745598A (zh) * | 2022-04-12 | 2022-07-12 | 北京字跳网络技术有限公司 | 视频数据展示方法、装置、电子设备及存储介质 |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7567274B2 (en) * | 2002-12-09 | 2009-07-28 | Frank Edughom Ekpar | Method and apparatus for creating interactive virtual tours |
-
2022
- 2022-07-18 CN CN202210844086.0A patent/CN117459745A/zh active Pending
-
2023
- 2023-06-08 WO PCT/CN2023/099052 patent/WO2024016880A1/zh not_active Ceased
- 2023-06-08 US US18/840,895 patent/US20250175680A1/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106373195A (zh) * | 2016-08-25 | 2017-02-01 | 北京国承万通信息科技有限公司 | 虚拟现实场景呈现方法和系统 |
| CN106154707A (zh) * | 2016-08-29 | 2016-11-23 | 广州大西洲科技有限公司 | 虚拟现实投影成像方法和系统 |
| KR20180102399A (ko) * | 2017-03-07 | 2018-09-17 | 주식회사 브래니 | 가상 현실 게임의 제공을 위한 서버, 가상 현실 게임의 제공을 위한 시스템 및 서버의 가상 현실 게임을 제공하는 방법 |
| CN110809752A (zh) * | 2017-06-29 | 2020-02-18 | 诺基亚技术有限公司 | 用于虚拟现实内容显示的装置及相关联的方法 |
| US20190180509A1 (en) * | 2017-12-11 | 2019-06-13 | Nokia Technologies Oy | Apparatus and associated methods for presentation of first and second virtual-or-augmented reality content |
| CN114745598A (zh) * | 2022-04-12 | 2022-07-12 | 北京字跳网络技术有限公司 | 视频数据展示方法、装置、电子设备及存储介质 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117459745A (zh) | 2024-01-26 |
| US20250175680A1 (en) | 2025-05-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230405475A1 (en) | Shooting method, apparatus, device and medium based on virtual reality space | |
| EP4509962A1 (en) | Method, apparatus, electronic device, and storage for medium extended reality-based interaction control | |
| WO2024016880A1 (zh) | 信息交互方法、装置、电子设备和存储介质 | |
| CN115981544A (zh) | 基于扩展现实的交互方法、装置、电子设备和存储介质 | |
| CN116563740A (zh) | 基于扩展现实的控制方法、装置、电子设备和存储介质 | |
| US20250097515A1 (en) | Information interaction method, device, electronic apparatus and storage medium | |
| CN117994284A (zh) | 碰撞检测方法、装置、电子设备和存储介质 | |
| CN117376591A (zh) | 基于虚拟现实的场景切换处理方法、装置、设备及介质 | |
| US20240078734A1 (en) | Information interaction method and apparatus, electronic device and storage medium | |
| CN117435041A (zh) | 信息交互方法、装置、电子设备和存储介质 | |
| WO2024012106A1 (zh) | 信息交互方法、装置、电子设备和存储介质 | |
| CN117519456A (zh) | 信息交互方法、装置、电子设备和存储介质 | |
| CN117631904A (zh) | 信息交互方法、装置、电子设备和存储介质 | |
| CN116193246A (zh) | 用于拍摄视频的提示方法、装置、电子设备和存储介质 | |
| CN117631921A (zh) | 信息交互方法、装置、电子设备和存储介质 | |
| CN117641040A (zh) | 视频处理方法、装置、电子设备和存储介质 | |
| US20250184562A1 (en) | Information interaction method and apparatus, electronic device and storage medium | |
| CN117745981A (zh) | 图像生成方法、装置、电子设备和存储介质 | |
| CN117519457A (zh) | 信息交互方法、装置、电子设备和存储介质 | |
| CN117934769A (zh) | 图像显示方法、装置、电子设备和存储介质 | |
| CN118229921A (zh) | 图像显示方法、装置、电子设备和存储介质 | |
| CN117115396A (zh) | 显示控制方法、装置、终端和存储介质 | |
| CN117749964A (zh) | 图像处理方法、装置、电子设备和存储介质 | |
| CN117354484A (zh) | 基于虚拟现实的拍摄处理方法、装置、设备及介质 | |
| CN117632063A (zh) | 基于虚拟现实空间的显示处理方法、装置、设备及介质 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23841947 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 18840895 Country of ref document: US |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| WWP | Wipo information: published in national office |
Ref document number: 18840895 Country of ref document: US |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 09.05.2025) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 23841947 Country of ref document: EP Kind code of ref document: A1 |