WO2019127349A1 - 一种多媒体信息分享的方法、相关装置及系统 - Google Patents

一种多媒体信息分享的方法、相关装置及系统 Download PDF

Info

Publication number
WO2019127349A1
WO2019127349A1 PCT/CN2017/119786 CN2017119786W WO2019127349A1 WO 2019127349 A1 WO2019127349 A1 WO 2019127349A1 CN 2017119786 W CN2017119786 W CN 2017119786W WO 2019127349 A1 WO2019127349 A1 WO 2019127349A1
Authority
WO
WIPO (PCT)
Prior art keywords
multimedia information
target
information sharing
target multimedia
sharing device
Prior art date
Application number
PCT/CN2017/119786
Other languages
English (en)
French (fr)
Inventor
丁志轩
李品先
Original Assignee
腾讯科技（深圳）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 腾讯科技（深圳）有限公司 filed Critical 腾讯科技（深圳）有限公司
Priority to PCT/CN2017/119786 priority Critical patent/WO2019127349A1/zh
Priority to CN201780048513.1A priority patent/CN109644181B/zh
Publication of WO2019127349A1 publication Critical patent/WO2019127349A1/zh
Priority to US16/860,905 priority patent/US10965783B2/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/131—Protocols for games, networked simulations or virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0486—Drag-and-drop
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1101—Session protocols
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/612—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/70—Media network packetisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00—Aspects of interface with display user
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/02—Networking aspects
    • G09G2370/022—Centralised management of display operation, e.g. in a server instead of locally

Definitions

  • the present invention relates to the field of communications, and in particular, to a method, a related device and a system for sharing multimedia information.
  • Multimedia information can include pictures. , audio, video and files.
  • users can use the instant messaging application to send and receive multimedia information. For example, user A sends a picture to user B through "WeChat", or user A sends audio to multiple users in a group through “WeChat”. Other users can receive multimedia information sent by User A through "information”.
  • the multimedia information received by the instant messaging application is relatively simple, and the multimedia information cannot be used to interact with the information sender, and only the browsing function of the multimedia information is realized, which is difficult to satisfy.
  • the flexibility and diversity of information interaction is relatively simple, and the multimedia information cannot be used to interact with the information sender, and only the browsing function of the multimedia information is realized, which is difficult to satisfy.
  • the embodiment of the invention provides a multimedia information sharing method, related device and system, and processes multimedia information into VR target multimedia information, so that both the information receiver and the information sender can see the VR target multimedia in the virtual reality environment.
  • Information, VR target multimedia information has better flexibility and diversity, which is conducive to enhancing the interactivity of information sharing.
  • a first aspect of the embodiments of the present invention provides a method for sharing multimedia information, where the method is applied to a multimedia information sharing system, where the multimedia information sharing system includes a first multimedia information sharing device, a virtual reality VR server, and a second A multimedia information sharing device, the method comprising:
  • a multimedia information sharing instruction where the VR display desktop is used to display a multimedia information icon, the multimedia information sharing instruction is used to select the multimedia information icon, and the multimedia information icon has a corresponding information relationship;
  • the media information sharing device generates VR target multimedia information corresponding to the target multimedia information, and displays the VR target multimedia information;
  • a second aspect of the embodiments of the present invention provides a method for sharing multimedia information, where the method is applied to a multimedia information sharing system, where the multimedia information sharing system includes a first multimedia information sharing device, a virtual reality VR server, and a second A multimedia information sharing device, the method comprising:
  • the target multimedia information is sent by the first multimedia information sharing device to the VR server, the target multimedia information Generating, by the first multimedia information sharing device, VR target multimedia information, and displaying the VR target multimedia information;
  • a third aspect of the embodiments of the present invention provides a multimedia information sharing device, where the multimedia information sharing device is applied to a multimedia information sharing system, where the multimedia information sharing system includes a virtual reality VR server and a second multimedia information sharing device.
  • the multimedia information sharing device includes:
  • a receiving module configured to receive a multimedia information sharing instruction by using a VR display desktop, where the VR display desktop is used to display a multimedia information icon, where the multimedia information sharing instruction is used to select the multimedia information icon, and the multimedia information icon Corresponding to multimedia information;
  • a determining module configured to determine, according to the multimedia information sharing instruction received by the receiving module, target multimedia information to be sent
  • a sending module configured to send the target multimedia information determined by the determining module to the VR server, so that the VR server sends the target multimedia information to the second multimedia information sharing device, where The multimedia information is used by the second multimedia information sharing device to generate VR target multimedia information corresponding to the target multimedia information, and display the VR target multimedia information;
  • a display module configured to generate the VR target multimedia information according to the target multimedia information determined by the determining module, and display the VR target multimedia information.
  • a fourth aspect of the present invention provides a multimedia information sharing device, where the multimedia information sharing device is applied to a multimedia information sharing system, where the multimedia information sharing system includes a virtual reality VR server and a first multimedia information sharing device.
  • the multimedia information sharing device includes:
  • a receiving module configured to receive a multimedia information playing instruction
  • An acquiring module configured to acquire target multimedia information from the VR server according to the multimedia information playing instruction received by the receiving module, where the target multimedia information is the first multimedia information sharing device Transmitting, by the VR server, the target multimedia information is used by the first multimedia information sharing device to generate VR target multimedia information, and displaying the VR target multimedia information;
  • a generating module configured to generate the VR target multimedia information according to the target multimedia information acquired by the acquiring module
  • a display module configured to display the VR target multimedia information generated by the generating module.
  • a fifth aspect of the embodiments of the present invention provides a multimedia information sharing device, where the multimedia information sharing device is applied to a multimedia information sharing system, and the multimedia information sharing system further includes a virtual reality VR server and a second multimedia information sharing device.
  • the multimedia information sharing device includes: a memory, a transceiver, a processor, and a bus system;
  • the memory is used to store a program
  • the processor is configured to execute a program in the memory, including the following steps:
  • a multimedia information sharing instruction where the VR display desktop is used to display a multimedia information icon, the multimedia information sharing instruction is used to select the multimedia information icon, and the multimedia information icon has a corresponding information relationship;
  • the media information sharing device generates VR target multimedia information corresponding to the target multimedia information, and displays the VR target multimedia information;
  • the bus system is configured to connect the memory and the processor to cause the memory and the processor to communicate.
  • a sixth aspect of the embodiments of the present invention provides a multimedia information sharing device, where the multimedia information sharing device is applied to a multimedia information sharing system, and the multimedia information sharing system further includes a virtual reality VR server and a first multimedia information sharing device.
  • the multimedia information sharing device includes: a memory, a transceiver, a processor, and a bus system;
  • the memory is used to store a program
  • the processor is configured to execute a program in the memory, including the following steps:
  • the target multimedia information is sent by the first multimedia information sharing device to the VR server, the target multimedia information Generating, by the first multimedia information sharing device, VR target multimedia information, and displaying the VR target multimedia information;
  • the bus system is configured to connect the memory and the processor to cause the memory and the processor to communicate.
  • a seventh aspect of the invention provides a computer readable storage medium having stored therein instructions that, when executed on a computer, cause the computer to perform the methods described in the above aspects.
  • a method for multimedia information sharing is provided, where the method is applied to a multimedia information sharing system, where the multimedia information sharing system includes a first multimedia information sharing device, a virtual reality VR server, and a second a multimedia information sharing device, the first multimedia information sharing device receives the multimedia information sharing instruction, and then determines the multimedia information to be sent according to the multimedia information sharing instruction, and sends the multimedia information to the VR server, so that the VR server is the second largest
  • the media information sharing device transmits the multimedia information, wherein the multimedia information is used by the second multimedia information sharing device to generate the VR target multimedia information, and displays the VR target multimedia information, generates the VR target multimedia information according to the multimedia information, and displays the VR target multimedia. information.
  • the multimedia information is processed into the VR target multimedia information, so that both the information receiver and the information sender can see the VR target multimedia information in the virtual reality environment, and the VR target multimedia information has better flexibility and diversity. It is conducive to enhancing the interactivity of information sharing.
  • FIG. 1 is a structural diagram of a multimedia information sharing system according to an embodiment of the present invention.
  • FIG. 2 is a schematic diagram of an interaction embodiment of a method for sharing multimedia information according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of an embodiment of a method for sharing multimedia information according to an embodiment of the present invention.
  • mapping user input in an embodiment of the present invention is a schematic diagram of an embodiment of mapping user input in an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of a user dragging and generating a file in a virtual reality scene according to an embodiment of the present invention
  • FIG. 6 is a schematic flowchart of generating a virtual reality picture according to an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of a preset rectangular mesh model in an embodiment of the present invention.
  • FIG. 8 is a schematic diagram of mapping a first texture to a preset rectangular mesh model according to an embodiment of the present invention.
  • FIG. 9 is a schematic flowchart of generating a virtual three-dimensional model in an embodiment of the present invention.
  • FIG. 10 is a schematic diagram of a sequence of vertices of a preset three-dimensional mesh model according to an embodiment of the present invention.
  • FIG. 11 is a schematic diagram of 3D audio in an embodiment of the present invention.
  • FIG. 12 is a schematic diagram of another embodiment of a method for sharing multimedia information according to an embodiment of the present invention.
  • FIG. 13 is a schematic diagram of selecting a picture file in an application scenario of the present invention.
  • FIG. 14 is a schematic diagram of selecting a three-dimensional model file in an application scenario of the present invention.
  • 15 is a schematic diagram of selecting an audio file in an application scenario of the present invention.
  • FIG. 16 is a schematic diagram of an embodiment of a multimedia information sharing apparatus according to an embodiment of the present invention.
  • FIG. 17 is a schematic diagram of another embodiment of a multimedia information sharing apparatus according to an embodiment of the present invention.
  • FIG. 18 is a schematic diagram of an embodiment of a multimedia information sharing apparatus according to an embodiment of the present invention.
  • FIG. 19 is a schematic diagram of another embodiment of a multimedia information sharing apparatus according to an embodiment of the present invention.
  • FIG. 20 is a schematic structural diagram of a multimedia information sharing apparatus according to an embodiment of the present invention.
  • FIG. 21 is a schematic structural diagram of a multimedia information sharing apparatus according to an embodiment of the present invention.
  • FIG. 22 is a schematic diagram of an embodiment of a multimedia information sharing system according to an embodiment of the present invention.
  • FIG. 1 is a structural diagram of a multimedia information sharing system according to an embodiment of the present invention. As shown in FIG. 1, the figure includes three virtual reality (Virtual Reality, VR) Live screen and 4 VR players are only one indication. In practical applications, the number of VR players and the number of VR screens can be more or less, so there is no limit here.
  • VR Virtual Reality
  • the process of generating and sharing the entire VR multimedia file includes that the VR player as the anchor first displays the synchronous operation screen through the VR display desktop on the personal computer (PC), wherein, for the PC, Before the VR display desktop, there should be an external VR output device to output VR signals.
  • the VR display desktop Before the VR display desktop, there should be an external VR output device to output VR signals.
  • one or more multimedia files are selected on the VR display desktop, and the one or more multimedia files are uploaded to the server through the PC, and the server further forwards the multimedia files to other PCs.
  • VR technology will be used to display the multimedia files selected by the anchor VR player, that is, the desktop is rendered to the VR display screen in the form of a map.
  • VR players receive the desktop image on the host PC from the server in real time, decompress and restore the original multimedia file, and also render the picture to the VR display screen of the scene in the form of texture.
  • the viewer A can request the server to provide the picture on the host PC desktop on the local PC, and then the server can send the picture on the host PC desktop to the VR display screen 2 according to the request of the viewer A, so that the viewer A is in the VR.
  • the VR screen is seen on the display screen 2.
  • the VR display screen can be the VR display desktop, that is, the VR display desktop is mapped to the VR display screen through the external VR output device, thereby becoming one.
  • VR technology is a computer simulation system that can create and experience virtual worlds. It uses computer to generate a simulation environment. It is a multi-source information fusion, interactive 3D dynamic vision and physical behavior system, which makes users immersed. Go to the environment.
  • FIG. 2 is a schematic diagram of an interaction embodiment of a method for sharing multimedia information according to an embodiment of the present invention, and the content shown in FIG. 1 and FIG. 2 is specifically as follows:
  • step S101 the VR player as the anchor broadcasts the multimedia file to the file transfer window on the VR display desktop through the VR display desktop on the PC side;
  • step S102 the PC sends a local shared file path to the VR display screen, that is, the file window obtains the file path of the multimedia file dragged and dropped into the window, and then sends the file path to the VR display screen in the scene;
  • step S103 the VR display screen can read the user local multimedia file into the memory in binary form and divide into different data packets;
  • step S104 the VR display sends a request for sending a local file to the server, so that the server performs initialization.
  • step S105 the receiver is ready to accept the multimedia file, that is, the server sends the message that the sharer sends the multimedia file to all other recipients in the VR scene;
  • step S106 the server confirms that the initialization is successful, and feeds back to the sharer
  • step S107 to step S110 the fixed packet byte stream is sent, and after confirming that the message is sent, the sharer local VR display screen will serve as a sending thread, and each frame transmits a file byte stream of the packet according to the bandwidth capability of the server and the client, and the server After confirming that the forwarding is successful, the message will be fed back to the sender. After confirming that the transmission is successful, the sender continues to send the data of the next byte packet. The entire transmission until the shared file is completed;
  • step S111 in the VR scenario, the sharer's VR display screen generates a multimedia interaction file
  • step S112 after confirming that the transmission is successful, the sharer's VR display screen generates a corresponding interaction file according to the received file type;
  • step S113 the sharer operates the multimedia file and uploads the operation information to the server;
  • step S114 in the VR scenario, the VR display screen of the receiver generates a multimedia interaction file
  • step S115 after confirming that the transmission is successful, the VR display screen of the receiver generates a corresponding interaction file according to the received file type;
  • step S116 the receiver operates the multimedia file and uploads the operation information to the server.
  • an embodiment of the method for sharing multimedia information in the embodiment of the present invention includes:
  • 201 Receive a multimedia information sharing instruction by using a VR display desktop, wherein the VR display desktop is used to display a multimedia information icon, the multimedia information sharing instruction is used to select a multimedia information icon, and the multimedia information icon has a corresponding relationship with the multimedia information, wherein the multimedia information
  • the sharing system further includes a virtual reality VR server and a second multimedia information sharing device;
  • the multimedia information sharing system includes a first multimedia information sharing device, at least one second multimedia information sharing device, and a VR server, wherein the first multimedia information sharing device may further include three parts.
  • the controller, the VR display, and the terminal device may be a PC, a notebook computer, or a tablet computer, and are not limited herein.
  • the first multimedia information sharing device receives the multimedia information sharing instruction triggered by the user, and the multimedia information sharing instruction may be a click command or a drag command, where the user specifically refers to the sharer or anchor of the multimedia information. .
  • the VR display desktop is configured on the terminal device included in the first multimedia information sharing device, and the user can operate the multimedia information icon on the interface through the VR display interface, where each multimedia information icon corresponds to a multimedia information, such as icon A.
  • icon B corresponds to video B.
  • the first multimedia information sharing device determines the target multimedia information to be sent according to the multimedia information sharing instruction.
  • the first multimedia information sharing device determines the corresponding target multimedia information to be sent according to the multimedia information sharing instruction. For example, if the user clicks on a picture, the multimedia information sharing instruction is triggered, and then the picture is determined to be the target multimedia information to be sent.
  • the first multimedia information sharing device sends the target multimedia information to the VR server.
  • the VR server may send the target multimedia information to the second multimedia information sharing device.
  • the second multimedia information sharing device may generate corresponding VR target multimedia information according to the target multimedia information, thereby displaying the VR target multimedia information.
  • the first multimedia information sharing device generates VR target multimedia information according to the target multimedia information, and displays the VR target multimedia information.
  • the first multimedia information sharing device also generates VR target multimedia information according to the multimedia information, and displays the VR target multimedia information.
  • a method for sharing multimedia information is provided.
  • processing multimedia information into VR target multimedia information both the information receiver and the information sender can see the VR in the virtual reality environment.
  • Target multimedia information VR target multimedia information has better flexibility and diversity, which is conducive to enhancing the interactivity of information sharing.
  • the receiving the multimedia information sharing instruction by using the VR display desktop may include:
  • a multimedia information sharing instruction is generated according to the screen scale value and the real-time operation information.
  • the screen ratio value and the real-time operation information may be generated according to the multimedia information sharing instruction to determine the multimedia information to be sent in combination with the two.
  • FIG. 4 is a schematic diagram of an embodiment of mapping user input according to an embodiment of the present invention.
  • the user interacts with the VR display screen through the controller of the user's hand in the VR scene and the VR display rectangle.
  • the intersection of the projection area is mapped to the mouse operation of the user's local terminal.
  • the specific steps are as follows. First, the spatial coordinate value between the controller's ray and the VR display screen is obtained according to the multimedia information sharing instruction, wherein both the controller and the VR display screen belong to The first multimedia information sharing device.
  • the spatial coordinate value between the ray of the controller and the VR display is P w (x, y, z), and then the screen scale value is determined according to the spatial coordinate value and the reference coordinate value of the VR display.
  • the reference coordinate value of the VR display screen can be the point in the upper left corner of the screen, that is, P 0 (x 0 , y 0 , z 0 ), and the coordinate point P w (x, y, z) is based on the upper left point P 0 of the screen ( x 0 , y 0 , z 0 )
  • the ratio of the scale mapped to the screen determines the screen scale value, and the screen scale value is P s (u, v).
  • w is the width value of the VR display and h is the height of the VR display.
  • P s is the screen scale value.
  • the first multimedia information sharing device can map the left and right keys of the mouse according to the keys on the peripheral hand controller, and capture the mapping to obtain the mouse button single machine, double click and press, etc., thereby forming real-time operation information, Mouse position and button mode, the screen scale value and real-time operation information are obtained. Finally, the user click operation corresponding to the user mouse position P m is mapped to a mouse event through the application programming interface (API), thereby determining the mouse. The multimedia information to be sent corresponding to the event.
  • API application programming interface
  • how to determine the multimedia information to be sent according to the multimedia information sharing instruction triggered by the user acquires the ray of the controller and the VR display according to the multimedia information sharing instruction.
  • the spatial coordinate value is then determined according to the spatial coordinate value and the reference coordinate value of the VR display screen, and finally the screen scale value is obtained according to the screen scale value, the width value of the VR display screen, and the height value of the VR display screen.
  • the real-time operation information is obtained according to the multimedia information sharing instruction, and the multimedia information to be transmitted is determined according to the screen scale value and the real-time operation information.
  • the VR target multimedia information is generated according to the multimedia information, and the VR target multimedia is displayed.
  • the information can also include:
  • the user may further receive the operation, including the selection. At least one of moving, zooming in, zooming out, and playing.
  • the interaction operation instruction is an action of moving the VR picture
  • the first multimedia information sharing device performs a corresponding operation on the local VR display according to the action, that is, the VR picture is Move left to the right.
  • the first multimedia information sharing device generates an interaction operation information according to the interaction operation instruction, and the interaction operation information carries the content operated by the user, for example, “moving the VR picture from the left to the right”. Then, the first multimedia information sharing device sends the interaction operation information to the server, so that the server transmits the interaction operation information to the second multimedia information sharing device.
  • the second multimedia information sharing device can operate the VR target multimedia information according to the interaction operation information, that is, move the VR picture from the left to the right on the VR display of the receiver, thereby achieving synchronous display of the VR target.
  • the purpose of multimedia information is, move the VR picture from the left to the right on the VR display of the receiver, thereby achieving synchronous display of the VR target.
  • the first multimedia information sharing device may further receive an interactive operation instruction, and then operate the VR target multimedia information according to the interaction operation instruction to generate the interaction operation information, and finally
  • the interaction operation information is sent to the server, and the server sends the interaction operation information to the second multimedia information sharing device.
  • the sharer can perform corresponding operations on the VR target multimedia information according to requirements, such operations may form interactive operation information, and the receiver performs the same operation on the VR target multimedia information according to the interaction operation information, thereby improving the VR target multimedia information.
  • the flexibility and practicality of the presentation enhances the interactivity between the user and the multimedia information of the VR target.
  • FIG. 5 is a schematic diagram of a user dragging and generating a file in a virtual reality scene according to an embodiment of the present invention.
  • a pop-up window can be created on the lower right side of the terminal desktop, which can receive the file drag operation of the user in the local browser, and can read the file dragged and dropped into the window. path.
  • the user can identify whether the desktop file conforms to the predefined file format (such as pictures, text, 3D model and audio file), and package the file to the VR server, and the VR server will give it Forwarding to the second multimedia information sharing device in the VR scene.
  • predefined file format such as pictures, text, 3D model and audio file
  • the operability object is generated according to the file type for user interaction.
  • the specific steps are as follows:
  • the user can open the desktop resource manager in the VR scene, dragging or moving the file as in normal mouse operation.
  • a "gate window” will be generated on the desktop, for the user to drag and drop multimedia files (such as pictures, texts, 3D models and audio files) in the resource manager to the window, and then the window will further A preview is generated in the VR scene and forms an interactive object.
  • the multimedia information is a picture file, based on the foregoing first or second embodiment corresponding to FIG. 3 and FIG. ;
  • Generating VR target multimedia information according to the target multimedia information, and displaying the VR target multimedia information may include:
  • FIG. 6 is a schematic flowchart of generating a virtual reality picture according to an embodiment of the present invention.
  • the first multimedia information sharing device is in a graphics processing unit (Graphics Processing Unit, Within the GPU, the corresponding texture memory is dynamically created according to the image size format type, that is, the first texture is created.
  • the first texture may be read into the memory according to its format, and the texture data is bound to the GPU channel according to the corresponding first texture format.
  • a rectangular mesh model is generated at a specific position in the VR scene.
  • FIG. 7 is a schematic diagram of a preset rectangular mesh model according to an embodiment of the present invention. Arrange.
  • step 304 after having the above texture, we can sample the pixels in the texture according to the UV coordinates of the model vertex and draw it at this point, so that the texture model can be mapped to the rectangular grid model of the scene in real time.
  • FIG. 8 is a schematic diagram of mapping a first texture to a preset rectangular mesh model in an embodiment of the present invention.
  • the corresponding first texture may be created according to the image file, and then the first texture map is mapped to the preset rectangular grid model to obtain the VR image, and finally the VR image is displayed.
  • the screen shows the VR picture.
  • the multimedia information is a three-dimensional model, based on the foregoing first or second embodiment corresponding to FIG. 3 and FIG. file;
  • Generating VR target multimedia information according to the target multimedia information, and displaying the VR target multimedia information may include:
  • the VR 3D model is displayed through a VR display.
  • the drawing of the 3D model in the VR scene is similar to the drawing of the traditional 3D model in the game engine, except that the three-dimensional model shared by the user is created in real time by the first multimedia information sharing device during the running process.
  • FIG. 9 is a schematic flowchart of generating a virtual three-dimensional model according to an embodiment of the present invention.
  • the first multimedia information sharing device first dynamically creates a three-dimensional model file and correspondingly Second map.
  • the vertex stream data of the preset three-dimensional mesh model, the patch sequence data, and the second map corresponding to the model are read into the memory, and are bound to the created model and the texture memory.
  • FIG. 10 is a schematic diagram of a sequence of vertices of a preset three-dimensional mesh model according to an embodiment of the present invention.
  • a VR three-dimensional model is drawn at a specific location, and the VR three-dimensional model is colored in the GPU according to a specified style.
  • the first multimedia information sharing device may create a corresponding second map according to the three-dimensional model file, and then map the second map to the preset three-dimensional mesh model.
  • the VR 3D model is finally displayed through the VR display.
  • the multimedia information is an audio file, based on the foregoing first or second embodiment corresponding to FIG. 3 and FIG. ;
  • Generating VR target multimedia information according to the target multimedia information, and displaying the VR target multimedia information may include:
  • the audio file to be played is first determined locally, and the audio file is converted into a 3D audio file by the first multimedia information sharing device, and then the 3D audio file is played by the player.
  • FIG. 11 is a schematic diagram of 3D audio according to an embodiment of the present invention. Different from pictures and three-dimensional models, the audio data is browsed by playing the sound, but since it is a VR item, the audio is The playback is also in the form of 3D audio. Below is an explanation of 3D audio. 3D audio needs to calculate the positional relationship between the position of the player (ie, the sharer and the receiver) and the scene source of the scene in real time. In addition to the attenuation by distance, the sound itself is occluded according to the scene geometry, rebounded, etc. .
  • 3D audio can be used to mimic a seemingly existing but fictional sound.
  • a plane on the top of the speaker mimics the plane flying from left to right.
  • you close your eyes you will feel that there is a plane flying overhead from left to right. This is the effect of 3D audio.
  • the first multimedia information sharing device may first convert the audio file selected by the sender into a 3D audio file, and then play the 3D audio file. .
  • both the sender and the receiver can receive 3D audio with more stereoscopic effects, thereby improving the practicability of the solution and enhancing the user experience.
  • an embodiment of a method for multimedia information sharing in an embodiment of the present invention includes:
  • the second multimedia information sharing device in the multimedia information sharing system receives the multimedia information playing instruction, where the multimedia information sharing system further includes a first multimedia information sharing device and a virtual reality VR server;
  • the multimedia information sharing system includes a first multimedia information sharing device, a second multimedia information sharing device, and a server.
  • the second multimedia information sharing device may further include three parts, specifically
  • the device, the VR display, and the terminal device may be a PC, a notebook computer, or a tablet computer, and are not limited herein.
  • the second multimedia information sharing device receives the multimedia information playing instruction triggered by the user, and the multimedia information playing instruction may be a click command, where the user specifically refers to the recipient of the target multimedia information.
  • the second multimedia information sharing device acquires the target multimedia information from the VR server according to the multimedia information playing instruction, where the target multimedia information is sent by the first multimedia information sharing device to the VR server, and the target multimedia information is used.
  • the first multimedia information sharing device generates VR target multimedia information, and displays VR target multimedia information;
  • the second multimedia information sharing device receives the target multimedia information from the VR server according to the multimedia information playing instruction, wherein the target multimedia information is sent by the first multimedia information sharing device to the VR server in advance.
  • the first multimedia information sharing device also generates corresponding VR target multimedia information according to the target multimedia information, and displays the VR target multimedia information.
  • the second multimedia information sharing device generates VR target multimedia information according to the target multimedia information.
  • the second multimedia information sharing device generates the VR target multimedia information from the local target multimedia information.
  • the second multimedia information sharing device displays the VR target multimedia information.
  • the last second multimedia information sharing device will render the VR target multimedia information and display it, so that the receiver can see the VR target multimedia information shared by the sharer through the second multimedia information sharing device.
  • a method for sharing multimedia information can process multimedia information into VR target multimedia information, so that both the information receiver and the information sender can view the VR target multimedia information in the virtual reality environment, and the VR Target multimedia information has better flexibility and diversity, which is conducive to enhancing the interactivity of information sharing.
  • the method further includes:
  • the user may further receive the operation.
  • the interaction operation instruction is an action of moving the VR picture
  • the first multimedia information sharing device performs a corresponding operation on the local VR display according to the action, that is, the VR picture is Move up to the bottom.
  • the second multimedia information sharing device generates an interaction operation information according to the interaction operation instruction, and the interaction operation information carries the content operated by the user, for example, “moving the VR picture from above to below”. Then, the second multimedia information sharing device sends the interaction operation information to the server, so that the server transmits the interaction operation information to the first multimedia information sharing device.
  • the first multimedia information sharing device can operate the VR target multimedia information according to the interaction operation information, that is, on the sharer's VR display, and also move the VR picture from above to below, thereby achieving synchronous display of the VR target.
  • the purpose of multimedia information is, on the sharer's VR display, and also move the VR picture from above to below, thereby achieving synchronous display of the VR target.
  • the receiver can perform corresponding operations on the VR target multimedia information according to requirements, such operations may form interactive operation information, and the sharer performs the same operation on the VR target multimedia information according to the interaction operation information, thereby improving
  • the flexibility and practicability of VR target multimedia information display enhances the interactivity between users and VR target multimedia information.
  • FIG. 13 is a schematic diagram of selecting a picture file in an application scenario according to the present invention.
  • user A can select a picture locally, and then the PC converts the picture into a VR picture and projects it on user A.
  • the local VR display user A can view the VR picture through the VR display and then perform interactive operations such as grabbing and throwing.
  • the picture selected by the user A is also uploaded to the VR server, and the VR server sends the picture selected by the user A to the PC end of the user B.
  • the VR picture is also displayed on the local VR display of the user B. If User A zooms in on the picture, User B will also see that the VR picture is enlarged on the VR display.
  • FIG. 14 is a schematic diagram of selecting a three-dimensional model file in the application scenario of the present invention, such as As shown in the figure, user A can select the 3D model file locally, and then the PC converts the 3D model file into a VR 3D model and projects it on the local VR display of User A, so that User A can view through the VR display.
  • the VR 3D model is then subjected to interactive operations such as grabbing and throwing.
  • the VR 3D model selected by User A is also uploaded to the VR server, and the VR server sends the VR 3D model selected by User A to the PC end of User B. Similarly, User B's local VR display also displays this. VR 3D model. If user A performs a throwing operation on the VR three-dimensional model, user B also sees that the VR three-dimensional model is thrown on the VR display.
  • FIG. 15 is a schematic diagram of selecting an audio file in the application scenario of the present invention, as shown in the figure.
  • User A can select an audio file locally, and then the PC converts the audio file into 3D audio and plays it through the playback device.
  • User B can obtain the 3D audio from the VR server and then on user B's local playback device. Play the 3D audio.
  • the multimedia information sharing device in the present invention is described in detail below. Referring to FIG. 16, the multimedia information sharing device in the embodiment of the present invention is applied to a multimedia information sharing system, where the multimedia information sharing system further includes a virtual reality VR server and a second
  • the multimedia information sharing device 60 includes:
  • the receiving module 601 is configured to receive a multimedia information sharing instruction by using a VR display desktop, where the VR display desktop is used to display a multimedia information icon, where the multimedia information sharing instruction is used to select the multimedia information icon, and the multimedia information The icon has a corresponding relationship with the multimedia information;
  • a determining module 602 configured to determine, according to the multimedia information sharing instruction received by the receiving module 601, target multimedia information to be sent;
  • the sending module 603 is configured to send the target multimedia information determined by the determining module 602 to the VR server, so that the VR server sends the target multimedia information to the second multimedia information sharing device,
  • the multimedia information is used by the second multimedia information sharing device to generate VR target multimedia information corresponding to the target multimedia information, and display the VR target multimedia information;
  • the display module 604 is configured to generate the VR target multimedia information according to the target multimedia information determined by the determining module 603, and display the VR target multimedia information.
  • the receiving module 601 receives a multimedia information sharing instruction by using a VR display desktop, where the VR display desktop is used to display a multimedia information icon, and the multimedia information sharing instruction is used to select the multimedia information icon, and the The multimedia information icon has a corresponding relationship with the multimedia information, and the determining module 602 determines the target multimedia information to be sent according to the multimedia information sharing instruction received by the receiving module 601, and the sending module 603 determines the target multimedia determined by the determining module 602.
  • the VR server sends the target multimedia information to the second multimedia information sharing device, wherein the multimedia information is used for the second multimedia information sharing device Generating the VR target multimedia information corresponding to the target multimedia information, and displaying the VR target multimedia information, and the displaying module 604 generates the VR target multimedia information according to the target multimedia information determined by the determining module 603, and displaying the multimedia information.
  • VR target multimedia information
  • a method for sharing multimedia information is provided.
  • processing multimedia information into VR target multimedia information both the information receiver and the information sender can see the VR in the virtual reality environment.
  • Target multimedia information VR target multimedia information has better flexibility and diversity, which is conducive to enhancing the interactivity of information sharing.
  • the multimedia information sharing device 60 further includes:
  • the receiving module 601 is specifically configured to obtain a screen scale value and real-time operation information by using the VR display desktop, wherein the screen scale value is used to represent a ratio between a spatial coordinate value and a reference coordinate value, and the real-time operation Information is used to indicate user operations on the controller;
  • how to determine the multimedia information to be sent according to the multimedia information sharing instruction triggered by the user acquires the ray of the controller and the VR display according to the multimedia information sharing instruction.
  • the spatial coordinate value is then determined according to the spatial coordinate value and the reference coordinate value of the VR display screen, and finally the screen scale value is obtained according to the screen scale value, the width value of the VR display screen, and the height value of the VR display screen.
  • the real-time operation information is obtained according to the multimedia information sharing instruction, and the multimedia information to be transmitted is determined according to the screen scale value and the real-time operation information.
  • the multimedia information sharing device 60 further includes a generating module 605. ;
  • the receiving module 601 is further configured to: after the displaying module 604 generates the VR target multimedia information according to the multimedia information, and display the VR target multimedia information, receive an interactive operation instruction;
  • the generating module 605 is configured to perform operation on the VR target multimedia information according to the interaction operation instruction received by the receiving module 601 to generate interaction operation information, where the operations include selecting, moving, zooming in, zooming out, and playing At least one of them;
  • the sending module 603 is further configured to send the interaction operation information generated by the generating module 605 to the server, so that the server sends the interaction operation information to the second multimedia information sharing device,
  • the interaction operation information is used to instruct the second multimedia information sharing device to perform the operation on the VR target multimedia information.
  • the first multimedia information sharing device may further receive an interactive operation instruction, and then operate the VR target multimedia information according to the interaction operation instruction to generate the interaction operation information, and finally
  • the interaction operation information is sent to the server, and the server sends the interaction operation information to the second multimedia information sharing device.
  • the sharer can perform corresponding operations on the VR target multimedia information according to requirements, such operations may form interactive operation information, and the receiver performs the same operation on the VR target multimedia information according to the interaction operation information, thereby improving the VR target multimedia information.
  • the flexibility and practicality of the presentation enhances the interactivity between the user and the multimedia information of the VR target.
  • the multimedia information sharing device 60 further includes:
  • the multimedia information is a picture file
  • the display module 604 is specifically configured to create a corresponding first map according to the image file, where the first texture is used to bind the image data in the image file;
  • the VR picture is displayed through the VR display.
  • the corresponding first texture may be created according to the image file, and then the first texture map is mapped to the preset rectangular grid model to obtain the VR image, and finally the VR image is displayed.
  • the screen shows the VR picture.
  • the multimedia information sharing device 60 further includes:
  • the multimedia information is a three-dimensional model file
  • the display module is specifically configured to create a corresponding second map according to the three-dimensional model file, where the second map is used to bind the three-dimensional model data in the three-dimensional model file;
  • the VR three-dimensional model is displayed through the VR display.
  • the first multimedia information sharing device may create a corresponding second map according to the three-dimensional model file, and then map the second map to the preset three-dimensional mesh model.
  • the VR 3D model is finally displayed through the VR display.
  • the multimedia information sharing device 60 further includes:
  • the multimedia information is an audio file
  • the display module is specifically configured to convert the audio file into a 3D audio file
  • the first multimedia information sharing device may first convert the audio file selected by the sender into a 3D audio file, and then play the 3D audio file. .
  • both the sender and the receiver can listen to the more stereoscopic 3D audio, thereby improving the practicability of the solution and enhancing the user experience.
  • the first multimedia information sharing device in the present invention is described above.
  • the second multimedia information sharing device in the present invention will be described in detail below. Referring to FIG. 18, the multimedia information sharing device in the embodiment of the present invention is described.
  • the multimedia information sharing system further includes a first multimedia information sharing device and a virtual reality VR server, and the multimedia information sharing device 70 includes:
  • the receiving module 701 is configured to receive a multimedia information play instruction.
  • the obtaining module 702 is configured to obtain target multimedia information from the VR server according to the multimedia information playing instruction received by the receiving module 701, where the target multimedia information is the first multimedia information sharing device Sending to the VR server, the target multimedia information is used by the first multimedia information sharing device to generate VR target multimedia information, and displaying the VR target multimedia information;
  • a generating module 703, configured to generate the VR target multimedia information according to the target multimedia information acquired by the acquiring module 702;
  • the display module 704 is configured to display the VR target multimedia information generated by the generating module 703.
  • the receiving module 701 receives the multimedia information playing instruction
  • the obtaining module 702 obtains the target multimedia information from the VR server according to the multimedia information playing instruction received by the receiving module 701, where the target multimedia information is obtained.
  • Sending, by the first multimedia information sharing device, the VR server to the VR server, the target multimedia information is used by the first multimedia information sharing device to generate VR target multimedia information, and displaying the VR target multimedia information
  • the generating module 703 generates the VR target multimedia information according to the target multimedia information acquired by the acquiring module 702, and the displaying module 704 displays the VR target multimedia information generated by the generating module 703.
  • a method for sharing multimedia information can process multimedia information into VR target multimedia information, so that both the information receiver and the information sender can view the VR target multimedia information in the virtual reality environment, and the VR Target multimedia information has better flexibility and diversity, which is conducive to enhancing the interactivity of information sharing.
  • the multimedia information sharing apparatus 70 further includes sending Module 705;
  • the receiving module 701 is further configured to receive an interaction operation instruction
  • the generating module 703 is further configured to operate the VR target multimedia information according to the interaction operation instruction received by the receiving module 701 to generate interaction operation information, where the operations include selecting, moving, zooming in, zooming out, and At least one of the plays;
  • the sending module 705 is configured to send the interaction operation information generated by the generating module 703 to the server, so that the server sends the interaction operation information to the first multimedia information sharing device, where The interaction operation information is used to instruct the first multimedia information sharing device to operate on the VR target multimedia information.
  • the receiver can perform corresponding operations on the VR target multimedia information according to requirements, such operations may form interactive operation information, and the sharer performs the same operation on the VR target multimedia information according to the interaction operation information, thereby improving
  • the flexibility and practicability of VR target multimedia information display enhances the interactivity between users and VR target multimedia information.
  • FIG. 20 is a schematic structural diagram of a multimedia information sharing apparatus 80 according to an embodiment of the present invention.
  • the multimedia information sharing device 80 may include an input device 810, an output device 820, a processor 830, and a memory 840.
  • the output device in the embodiment of the present invention may be a display device.
  • Memory 840 can include read only memory and random access memory and provides instructions and data to processor 830. A portion of the memory 840 may also include a Non-Volatile Random Access Memory (NVRAM).
  • NVRAM Non-Volatile Random Access Memory
  • Memory 840 stores the following elements, executable modules or data structures, or subsets thereof, or their extended sets:
  • Operation instructions include various operation instructions for implementing various operations.
  • Operating system Includes a variety of system programs for implementing various basic services and handling hardware-based tasks.
  • the processor 830 is configured to perform the following steps:
  • a multimedia information sharing instruction where the VR display desktop is used to display a multimedia information icon, the multimedia information sharing instruction is used to select the multimedia information icon, and the multimedia information icon has a corresponding information relationship;
  • the media information sharing device generates VR target multimedia information corresponding to the target multimedia information, and displays the VR target multimedia information;
  • the processor 830 is specifically configured to perform the following steps:
  • the processor 830 is specifically configured to perform the following steps:
  • the VR target multimedia information to generate interaction operation information, where the operation includes at least one of selecting, moving, enlarging, reducing, and playing;
  • the volume information sharing device performs the operation on the VR target multimedia information.
  • the processor 830 is specifically configured to perform the following steps:
  • the VR picture is displayed through the VR display.
  • the processor 830 is specifically configured to perform the following steps:
  • the VR three-dimensional model is displayed through the VR display.
  • the processor 830 is specifically configured to perform the following steps:
  • the processor 830 controls the operation of the multimedia information sharing device 80, which may also be referred to as a central processing unit (CPU).
  • Memory 840 can include read only memory and random access memory and provides instructions and data to processor 830. A portion of the memory 840 may also include an NVRAM.
  • the components of the multimedia information sharing device 80 are coupled together by a bus system 850.
  • the bus system 850 may include a power bus, a control bus, a status signal bus, and the like in addition to the data bus. However, for clarity of description, various buses are labeled as bus system 850 in the figure.
  • Processor 830 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method may be completed by an integrated logic circuit of hardware in the processor 830 or an instruction in the form of software.
  • the processor 830 may be a general-purpose processor, a digital signal processing (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or Other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.
  • DSP digital signal processing
  • ASIC application specific integrated circuit
  • FPGA field-programmable gate array
  • the methods, steps, and logical block diagrams disclosed in the embodiments of the present invention may be implemented or carried out.
  • the general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
  • the steps of the method disclosed in the embodiments of the present invention may be directly implemented as a hardware decoding processor, or may be performed by a combination of hardware and software modules in the decoding processor.
  • the software module can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory or electrically erasable programmable memory, registers, and the like.
  • the storage medium is located in memory 840, and processor 830 reads the information in memory 840 and, in conjunction with its hardware, performs the steps of the above method.
  • FIG. 20 The related description of FIG. 20 can be understood by referring to the related description and effect of the method part of FIG. 3, and no further description is made herein.
  • FIG. 21 is a schematic structural diagram of a multimedia information sharing apparatus 90 according to an embodiment of the present invention.
  • the multimedia information sharing device 90 may include an input device 910, an output device 920, a processor 930, and a memory 940.
  • the output device in the embodiment of the present invention may be a display device.
  • Memory 940 can include read only memory and random access memory and provides instructions and data to processor 930.
  • a portion of the memory 840 may also include an NVRAM.
  • Memory 940 stores the following elements, executable modules or data structures, or subsets thereof, or their extended sets:
  • Operation instructions include various operation instructions for implementing various operations.
  • Operating system Includes a variety of system programs for implementing various basic services and handling hardware-based tasks.
  • the processor 930 is configured to perform the following steps in the embodiment of the present invention:
  • the target multimedia information is sent by the first multimedia information sharing device to the VR server, the target multimedia information Generating, by the first multimedia information sharing device, VR target multimedia information, and displaying the VR target multimedia information;
  • the processor 930 is further configured to perform the following steps:
  • the VR target multimedia information to generate interaction operation information, where the operation includes at least one of selecting, moving, enlarging, reducing, and playing;
  • the processor 930 controls the operation of the multimedia information sharing device 80, which may also be referred to as a CPU.
  • Memory 940 can include read only memory and random access memory and provides instructions and data to processor 930. A portion of the memory 940 can also include an NVRAM.
  • the components of the multimedia information sharing device 90 are coupled together by a bus system 950.
  • the bus system 950 may include a power bus, a control bus, a status signal bus, and the like in addition to the data bus. However, for clarity of description, various buses are labeled as bus system 950 in the figure.
  • Processor 930 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the foregoing method may be completed by an integrated logic circuit of hardware in the processor 930 or an instruction in a form of software.
  • the processor 930 described above may be a general purpose processor, DSP, ASIC, FPGA or other programmable logic device, discrete gate or transistor logic device, discrete hardware component.
  • the methods, steps, and logical block diagrams disclosed in the embodiments of the present invention may be implemented or carried out.
  • the general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
  • the steps of the method disclosed in the embodiments of the present invention may be directly implemented by the hardware decoding processor, or may be performed by a combination of hardware and software modules in the decoding processor.
  • the software module can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory or electrically erasable programmable memory, registers, and the like.
  • the storage medium is located in memory 940, and processor 930 reads the information in memory 940 and, in conjunction with its hardware, performs the steps of the above method.
  • FIG. 21 The related description of FIG. 21 can be understood by referring to the related description and effect of the method part of FIG. 12, and no further description is made herein.
  • FIG. 22 is a schematic diagram of an embodiment of a multimedia information sharing system according to an embodiment of the present invention.
  • the multimedia information sharing system includes a first multimedia information sharing device 1003, a virtual reality VR server 1002, and a second multimedia information sharing.
  • the device 1001, the multimedia information sharing system includes:
  • the first multimedia information sharing device 1003 receives a multimedia information sharing instruction through a VR display desktop, wherein the VR display desktop is used to display a multimedia information icon, and the multimedia information sharing instruction is used to select the multimedia information icon, and The multimedia information sharing device has a corresponding relationship with the multimedia information, and the first multimedia information sharing device 1003 determines the target multimedia information to be sent according to the multimedia information sharing instruction, and the first multimedia information sharing device 1003 uses the target multimedia information.
  • the sharing device 1001 generates VR target multimedia information corresponding to the target multimedia information, and displays the VR target multimedia information, and the first multimedia information sharing device 1003 generates the VR target multimedia information according to the target multimedia information, and Demonstrate the VR target multimedia information.
  • a multimedia information sharing system can process multimedia information into VR target multimedia information, so that both the information receiver and the information sender can see the VR target multimedia information in the virtual reality environment, and the VR target multimedia information has better flexibility and variety. Sexuality helps to improve the interactivity of information sharing.
  • the computer program product includes one or more computer instructions.
  • the computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable device.
  • the computer instructions can be stored in a computer readable storage medium or transferred from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions can be from a website site, computer, server or data center Transmission to another website site, computer, server, or data center by wire (eg, coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (eg, infrared, wireless, microwave, etc.).
  • wire eg, coaxial cable, fiber optic, Digital Subscriber Line (DSL)
  • wireless eg, infrared, wireless, microwave, etc.
  • the computer readable storage medium can be any available media that can be stored by a computer or a data storage device such as a server, data center, or the like that includes one or more available media.
  • the usable medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a DVD), or a semiconductor medium (such as a solid state disk (SSD)).
  • the disclosed system, apparatus, and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • the integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium.
  • the technical solution of the present invention which is essential or contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium.
  • a number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes. .

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • General Business, Economics & Management (AREA)
  • Business, Economics & Management (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本发明公开了一种多媒体信息分享的方法，包括：通过VR显示桌面接收多媒体信息分享指令；根据多媒体信息分享指令确定待发送的目标多媒体信息；将目标多媒体信息发送至VR服务器，VR服务器向第二多媒体信息分享装置发送目标多媒体信息，多媒体信息用于第二多媒体信息分享装置生成目标多媒体信息所对应的VR目标多媒体信息，并展示VR目标多媒体信息；根据目标多媒体信息生成VR目标多媒体信息并展示VR目标多媒体信息。本发明还提供第一多媒体信息分享装置、第二多媒体信息分享装置及系统。本发明将多媒体信息处理成VR目标多媒体信息，从而使得信息接收方与信息发送方均可以在虚拟现实环境中看到VR目标多媒体信息，有利于提升信息分享的交互性。

Description

一种多媒体信息分享的方法、相关装置及系统 技术领域
本发明涉及通信领域，尤其涉及一种多媒体信息分享的方法、相关装置及系统。
背景技术
随着计算机技术的快速发展，用户之间进行远程沟通的情况也越来越普遍，为了提升沟通的效率并丰富沟通的多样性，可以在远程沟通中进行多媒体信息的分享，多媒体信息可以包括图片、音频、视频和文件等内容。
目前，用户之间可以采用即时通讯类应用程序收发多媒体信息，比如，用户A通过“微信”向用户B发送图片等，或者用户A通过“微信”向一个群组中的多位用户发送音频等，其他用户即可通过“信息”接收用户A发送的多媒体信息。
然而，对于信息接收方而言，通过即时通讯类应用程序所接收到的多媒体信息较为单一，且无法采用该多媒体信息与信息发送方进行交互，仅仅实现了多媒体信息的浏览功能，这将难以满足信息交互的灵活性和多样性。
发明内容
本发明实施例提供了一种多媒体信息分享的方法、相关装置及系统，将多媒体信息处理成VR目标多媒体信息，从而使得信息接收方与信息发送方均可以在虚拟现实环境中看到VR目标多媒体信息，VR目标多媒体信息具有较好的灵活性和多样性，有利于提升信息分享的交互性。
本发明实施例的第一方面提供一种多媒体信息分享的方法，所述方法应用于多媒体信息分享系统，所述多媒体信息分享系统包括第一多媒体信息分享装置、虚拟现实VR服务器以及第二多媒体信息分享装置，所述方法包括：
通过VR显示桌面接收多媒体信息分享指令，其中，所述VR显示桌面用于展示多媒体信息图标，所述多媒体信息分享指令用于选择所述多媒体信息图 标，且所述多媒体信息图标与多媒体信息具有对应关系；
根据所述多媒体信息分享指令确定待发送的目标多媒体信息；
将所述目标多媒体信息发送至所述VR服务器，以使所述VR服务器向所述第二多媒体信息分享装置发送所述目标多媒体信息，其中，所述多媒体信息用于所述第二多媒体信息分享装置生成所述目标多媒体信息所对应的VR目标多媒体信息，并且展示所述VR目标多媒体信息；
根据所述目标多媒体信息生成所述VR目标多媒体信息，并且展示所述VR目标多媒体信息。
本发明实施例第二方面提供了一种多媒体信息分享的方法，所述方法应用于多媒体信息分享系统，所述多媒体信息分享系统包括第一多媒体信息分享装置、虚拟现实VR服务器以及第二多媒体信息分享装置，所述方法包括：
接收多媒体信息播放指令；
根据所述多媒体信息播放指令，从所述VR服务器中获取目标多媒体信息，其中，所述目标多媒体信息为所述第一多媒体信息分享装置向所述VR服务器发送的，所述目标多媒体信息用于所述第一多媒体信息分享装置生成VR目标多媒体信息，并且展示所述VR目标多媒体信息；
根据所述目标多媒体信息生成所述VR目标多媒体信息；
展示所述VR目标多媒体信息。
本发明实施例的第三方面提供一种多媒体信息分享装置，所述多媒体信息分享装置应用于多媒体信息分享系统，所述多媒体信息分享系统包括虚拟现实VR服务器以及第二多媒体信息分享装置，所述多媒体信息分享装置包括：
接收模块，用于通过VR显示桌面接收多媒体信息分享指令，其中，所述VR显示桌面用于展示多媒体信息图标，所述多媒体信息分享指令用于选择所述多媒体信息图标，且所述多媒体信息图标与多媒体信息具有对应关系；
确定模块，用于根据所述接收模块接收的所述多媒体信息分享指令确定待发送的目标多媒体信息；
发送模块，用于将所述确定模块确定的所述目标多媒体信息发送至所述VR服务器，以使所述VR服务器向所述第二多媒体信息分享装置发送所述目标多媒体信息，其中，所述多媒体信息用于所述第二多媒体信息分享装置生成 所述目标多媒体信息所对应的VR目标多媒体信息，并且展示所述VR目标多媒体信息；
展示模块，用于根据所述确定模块确定的所述目标多媒体信息生成所述VR目标多媒体信息，并且展示所述VR目标多媒体信息。
本发明实施例的第四方面提供一种多媒体信息分享装置，所述多媒体信息分享装置应用于多媒体信息分享系统，所述多媒体信息分享系统包括虚拟现实VR服务器以及第一多媒体信息分享装置，所述多媒体信息分享装置包括：
接收模块，用于接收多媒体信息播放指令；
获取模块，用于根据所述接收模块接收的所述多媒体信息播放指令，从所述VR服务器中获取目标多媒体信息，其中，所述目标多媒体信息为所述第一多媒体信息分享装置向所述VR服务器发送的，所述目标多媒体信息用于所述第一多媒体信息分享装置生成VR目标多媒体信息，并且展示所述VR目标多媒体信息；
生成模块，用于根据所述获取模块获取的所述目标多媒体信息生成所述VR目标多媒体信息；
展示模块，用于展示所述生成模块生成的所述VR目标多媒体信息。
本发明实施例的第五方面提供一种多媒体信息分享装置，所述多媒体信息分享装置应用于多媒体信息分享系统，所述多媒体信息分享系统还包括虚拟现实VR服务器以及第二多媒体信息分享装置，所述多媒体信息分享装置包括：存储器、收发器、处理器以及总线系统；
其中，所述存储器用于存储程序；
所述处理器用于执行所述存储器中的程序，包括如下步骤：
通过VR显示桌面接收多媒体信息分享指令，其中，所述VR显示桌面用于展示多媒体信息图标，所述多媒体信息分享指令用于选择所述多媒体信息图标，且所述多媒体信息图标与多媒体信息具有对应关系；
根据所述多媒体信息分享指令确定待发送的目标多媒体信息；
将所述目标多媒体信息发送至所述VR服务器，以使所述VR服务器向所述第二多媒体信息分享装置发送所述目标多媒体信息，其中，所述多媒体信息用于所述第二多媒体信息分享装置生成所述目标多媒体信息所对应的VR目 标多媒体信息，并且展示所述VR目标多媒体信息；
根据所述目标多媒体信息生成所述VR目标多媒体信息，并且展示所述VR目标多媒体信息；
所述总线系统用于连接所述存储器以及所述处理器，以使所述存储器以及所述处理器进行通信。
本发明实施例的第六方面提供一种多媒体信息分享装置，所述多媒体信息分享装置应用于多媒体信息分享系统，所述多媒体信息分享系统还包括虚拟现实VR服务器以及第一多媒体信息分享装置，所述多媒体信息分享装置包括：存储器、收发器、处理器以及总线系统；
其中，所述存储器用于存储程序；
所述处理器用于执行所述存储器中的程序，包括如下步骤：
接收多媒体信息播放指令；
根据所述多媒体信息播放指令，从所述VR服务器中获取目标多媒体信息，其中，所述目标多媒体信息为所述第一多媒体信息分享装置向所述VR服务器发送的，所述目标多媒体信息用于所述第一多媒体信息分享装置生成VR目标多媒体信息，并且展示所述VR目标多媒体信息；
根据所述目标多媒体信息生成所述VR目标多媒体信息；
展示所述VR目标多媒体信息；
所述总线系统用于连接所述存储器以及所述处理器，以使所述存储器以及所述处理器进行通信。
本发明的第七方面提供了一种计算机可读存储介质，所述计算机可读存储介质中存储有指令，当其在计算机上运行时，使得计算机执行上述各方面所述的方法。
本发明实施例提供的技术方案中，提供了一种多媒体信息分享的方法，该方法应用于多媒体信息分享系统，多媒体信息分享系统包括第一多媒体信息分享装置、虚拟现实VR服务器以及第二多媒体信息分享装置，第一多媒体信息分享装置接收多媒体信息分享指令，然后根据多媒体信息分享指令确定待发送的多媒体信息，将多媒体信息发送至VR服务器，以使VR服务器向第二多媒体信息分享装置发送多媒体信息，其中，多媒体信息用于第二多媒体信息分享 装置生成VR目标多媒体信息，并且展示VR目标多媒体信息，根据多媒体信息生成VR目标多媒体信息，并且展示VR目标多媒体信息。通过上述方式，将多媒体信息处理成VR目标多媒体信息，从而使得信息接收方与信息发送方均可以在虚拟现实环境中看到VR目标多媒体信息，VR目标多媒体信息具有较好的灵活性和多样性，有利于提升信息分享的交互性。
附图说明
图1为本发明实施例中多媒体信息分享系统的架构图；
图2为本发明实施例中多媒体信息分享的方法一个交互实施例示意图；
图3为本发明实施例中多媒体信息分享的方法一个实施例示意图；
图4为本发明实施例中映射用户输入的实施例示意图；
图5为本发明实施例中虚拟现实场景中用户拖动并生成文件的示意图；
图6为本发明实施例中生成虚拟现实图片的流程示意图；
图7为本发明实施例中预置矩形网格模型的示意图；
图8为本发明实施例中将第一贴图映射到预置矩形网格模型的示意图；
图9为本发明实施例中生成虚拟三维模型的流程示意图；
图10为本发明实施例中预置三维网格模型的顶点序列示意图；
图11为本发明实施例中3D音频的示意图；
图12为本发明实施例中多媒体信息分享的方法另一个实施例示意图；
图13为本发明应用场景中选择图片文件的示意图；
图14为本发明应用场景中选择三维模型文件的示意图；
图15为本发明应用场景中选择音频文件的示意图；
图16为本发明实施例中多媒体信息分享装置一个实施例示意图；
图17为本发明实施例中多媒体信息分享装置另一个实施例示意图；
图18为本发明实施例中多媒体信息分享装置一个实施例示意图；
图19为本发明实施例中多媒体信息分享装置另一个实施例示意图；
图20为本发明实施例中多媒体信息分享装置一个结构示意图；
图21为本发明实施例中多媒体信息分享装置一个结构示意图；
图22为本发明实施例中多媒体信息分享系统一个实施例示意图。
具体实施方式
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。
本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”、“第四”等(如果存在)是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换，以便这里描述的实施例能够以除了在这里图示或描述的内容以外的顺序实施。此外，术语“包括”和“具有”以及他们的任何变形，意图在于覆盖不排他的包含，例如，包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元，而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。
应理解，本发明应用于多媒体信息分享系统，请参阅图1，图1为本发明实施例中多媒体信息分享系统的架构图，如图1所示，图中包括3个虚拟现实(Virtual Reality，VR)直播屏幕以及4位VR玩家仅为一个示意，在实际应用中，VR玩家的数量和VR显示屏的数量幕可以更多或者更少，故此处不作限定。
请参阅图1，整个VR多媒体文件的生成和分享的过程包括，作为主播的VR玩家首先通过个人电脑(personal computer，PC)上的VR显示桌面展示同步操作画面，其中，对PC而言，在展示VR显示桌面之前还应该外接有VR输出设备，以能够输出VR信号。例如在VR显示桌面上选择一个或者多个多媒体文件，通过PC将这一个或多个多媒体文件上传至服务器，服务器进而将多媒体文件转发至其他PC上。与此同时，在VR显示屏幕1上会采用VR技术展示出主播VR玩家所选择的多媒体文件，也就是以贴图形式渲染桌面至VR显示屏幕上。
其他的VR玩家从服务器实时接收主播PC上的桌面画面，解压还原原始多媒体文件，同样以贴图形式将画面渲染到场景的VR显示屏幕上。比如，观众A可以在本地的PC上请求服务器提供主播PC桌面上的画面，然后服务器 能够根据观众A的请求，将主播PC桌面上的画面发送至VR显示屏幕2上，从而使得观众A在VR显示屏幕2上看到VR画面。
可以理解的是，VR显示屏幕可以就是VR显示桌面，也就是通过外接VR输出设备把VR显示桌面映射到VR显示屏幕上，以此成为一体。
VR技术是一种可以创建和体验虚拟世界的计算机仿真系统，它利用计算机生成一种模拟环境，是一种多源信息融合的，交互式的三维动态视景和实体行为的系统，使用户沉浸到该环境中。
为了便于理解，请参阅图2，图2为本发明实施例中多媒体信息分享的方法一个交互实施例示意图，结合图1和图2所示的内容，具体为：
步骤S101中，作为主播的VR玩家通过PC端上的VR显示桌面将多媒体文件拖放至VR显示桌面上的文件传送窗口；
步骤S102中，PC向VR显示屏发送本地分享文件路径，即文件窗口获得被拖放进窗口的多媒体文件的文件路径，再发送给场景中的VR显示屏；
步骤S103中，VR显示屏可以将用户本地多媒体文件以二进制形式读进内存，并分成不同的数据包；
步骤S104中，VR显示屏将发送本地文件的请求发送给服务器，使得服务器进行初始化；
步骤S105中，接收者准备接受多媒体文件，即服务器将分享者发送多媒体文件的消息发送给VR场景中全体其他接收者；
步骤S106中，由服务器确认初始化成功，并反馈至分享者；
步骤S107至步骤S110中，发送固定包字节流，确认发送消息后，分享者本地VR显示屏会起一个发送线程，每帧按服务器和用户端带宽能力发送一个包的文件字节流，服务器确认转发成功后会将消息再反馈给发送者，确认发送成功后，发送者继续发送下一个字节包的数据。整个直至分享文件全部发送完成；
步骤S111中，在VR场景下，分享者的VR显示屏生成多媒体交互文件；
步骤S112中，确认发送成功后，分享者的VR显示屏幕会根据收到的文件类型生成对应的交互文件；
步骤S113中，分享者对多媒体文件进行操作，并将操作的信息上传至服 务器中；
步骤S114中，在VR场景下，接收者的VR显示屏生成多媒体交互文件；
步骤S115中，确认发送成功后，接收者的VR显示屏幕都会根据收到的文件类型生成对应的交互文件；
步骤S116中，接收者对多媒体文件进行操作，并将操作的信息上传至服务器中。
下面将从第一多媒体信息分享装置的角度，对本发明中多媒体信息分享的方法进行介绍，请参阅图3，本发明实施例中多媒体信息分享的方法一个实施例包括：
201、通过VR显示桌面接收多媒体信息分享指令，其中，VR显示桌面用于展示多媒体信息图标，多媒体信息分享指令用于选择多媒体信息图标，且多媒体信息图标与多媒体信息具有对应关系，其中，多媒体信息分享系统还包括虚拟现实VR服务器以及第二多媒体信息分享装置；
本实施例中，多媒体信息分享系统包括第一多媒体信息分享装置，至少一个第二多媒体信息分享装置以及VR服务器，其中，第一多媒体信息分享装置还可以包括三个部分，具体为控制器、VR显示屏和终端设备，终端设备可以是PC、笔记本电脑或者平板电脑等，此处不做限定。
首先，第一多媒体信息分享装置接收用户触发的多媒体信息分享指令，多媒体信息分享指令可以是一个点击指令，也可以是一个拖动指令，这里的用户具体是指多媒体信息的分享者或者主播。
在第一多媒体信息分享装置所包括的终端设备上具有VR显示桌面，用户可以通过该VR显示界面对界面上的多媒体信息图标进行操作，每个多媒体信息图标对应一个多媒体信息，比如图标A对应图片A，图标B对应视频B。
202、第一多媒体信息分享装置根据多媒体信息分享指令确定待发送的目标多媒体信息；
本实施例中，第一多媒体信息分享装置根据多媒体信息分享指令，确定对应的待发送的目标多媒体信息。例如，用户点击一个图片，即触发了多媒体信息分享指令，然后确定该图片即为待发送的目标多媒体信息。
203、将目标多媒体信息发送至VR服务器，以使VR服务器向第二多媒 体信息分享装置发送目标多媒体信息，其中，多媒体信息用于第二多媒体信息分享装置生成目标多媒体信息所对应的VR目标多媒体信息，并且展示VR目标多媒体信息；
本实施例中，接下来第一多媒体信息分享装置将目标多媒体信息发送到VR服务器，VR服务器收到目标多媒体信息后，可以向第二多媒体信息分享装置发送该目标多媒体信息。第二多媒体信息分享装置可以根据目标多媒体信息生成对应的VR目标多媒体信息，进而展示该VR目标多媒体信息。
204、第一多媒体信息分享装置根据目标多媒体信息生成VR目标多媒体信息，并且展示VR目标多媒体信息。
本实施例中，第一多媒体信息分享装置也会根据多媒体信息生成VR目标多媒体信息，并且展示该VR目标多媒体信息。
本发明实施例提供的技术方案中，提供了一种多媒体信息分享的方法，通过将多媒体信息处理成VR目标多媒体信息，从而使得信息接收方与信息发送方均可以在虚拟现实环境中看到VR目标多媒体信息，VR目标多媒体信息具有较好的灵活性和多样性，有利于提升信息分享的交互性。
可选地，在上述图3对应的实施例的基础上，本发明实施例提供的多媒体信息分享的方法第一个可选实施例中，通过VR显示桌面接收多媒体信息分享指令，可以包括：
通过VR显示桌面获取屏幕比例值以及实时操作信息，其中，屏幕比例值用于表示空间坐标值与参考坐标值之间的比例，实时操作信息用于表示用户对控制器的操作；
根据屏幕比例值与实时操作信息生成多媒体信息分享指令。
本实施例中，在第一多媒体信息分享装置接收多媒体信息分享指令之后，还可以根据多媒体信息分享指令生成屏幕比例值和和实时操作信息，以结合两者确定待发送的多媒体信息。
请参阅图4，图4为本发明实施例中映射用户输入的实施例示意图，如图所示，用户与VR显示屏的交互是通过用户手部的控制器在VR场景中与VR显示屏矩形投影区域的交点来映射到用户本地终端的鼠标操作，具体步骤如下，首先根据多媒体信息分享指令获取控制器的射线与VR显示屏之间的空间 坐标值，其中，控制器与VR显示屏都属于第一多媒体信息分享装置。控制器的射线与VR显示屏之间的空间坐标值为P w(x,y,z)，然后根据空间坐标值与VR显示屏的参考坐标值，确定屏幕比例值。
假设，VR显示屏的参考坐标值可以是屏幕左上角的点，即P 0(x 0,y 0,z 0)，将坐标点P w(x,y,z)根据屏幕左上点P 0(x 0,y 0,z 0)映射到屏幕的比例确定屏幕比例值，屏幕比例值为P s(u,v)。
u＝(x-x 0)/w；
v＝(y-y 0)/h；
其中，w表示VR显示屏的宽度值，h表示VR显示屏的高度值。
根据计算P s可以计算出用户实时鼠标位置P m(um,vm)，um＝u×终端屏幕宽，vm＝v×终端屏幕高。P s即为屏幕比例值。
第一多媒体信息分享装置可以根据外设手部控制器上的按键映射鼠标的左键和右键，并捕捉映射得到鼠标按键单机，双击以及按下等状态，从而形成实时操作信息，有了鼠标位置和按键方式，即得到了屏幕比例值和实时操作信息，最后通过应用程序编程接口(Application Programming Interface，API)将用户鼠标位置P m对应的用户点击操作映射为鼠标事件，以此确定鼠标事件对应的待发送的多媒体信息。
其次，本发明实施例中，介绍了如何根据用户触发的多媒体信息分享指令确定待发送的多媒体信息，即第一多媒体信息分享装置根据多媒体信息分享指令获取控制器的射线与VR显示屏之间的空间坐标值，然后根据空间坐标值与VR显示屏的参考坐标值，确定屏幕比例值，最后根据屏幕比例值、VR显示屏的宽度值和VR显示屏的高度值，获取屏幕比例值，此外，还根据多媒体信息分享指令获取实时操作信息，结合屏幕比例值与实时操作信息，确定待发送的多媒体信息。通过上述方式，提升了方案在实际应用中的可行性和可操作性。
可选地，在上述图3对应的实施例的基础上，本发明实施例提供的多媒体信息分享的方法第二个可选实施例中，根据多媒体信息生成VR目标多媒体信息，并且展示VR目标多媒体信息之后，还可以包括：
接收交互操作指令；
根据交互操作指令对VR目标多媒体信息进行操作，以生成交互操作信息，操作包括选中、移动、放大、缩小和播放中的至少一种；
向服务器发送交互操作信息，以使服务器向第二多媒体信息分享装置发送交互操作信息，其中，交互操作信息用于指示第二多媒体信息分享装置对VR目标多媒体信息进行操作。
本实施例中，在第一多媒体信息分享装置根据多媒体信息生成VR目标多媒体信息，并且展示VR目标多媒体信息之后，还可以进一步接收用户(分享者)对其进行的操作，该操作包括选中、移动、放大、缩小和播放中的至少一种。首先接收用户触发的交互操作指令，比如交互操作指令是移动VR图片这一动作，则第一多媒体信息分享装置根据这个动作，在本地的VR显示屏上执行相应的操作，即将VR图片从左移动到右。与此同时，第一多媒体信息分享装置会根据交互操作指令生成一个交互操作信息，交互操作信息中携带了用户操作的内容，例如“将VR图片从左移动到右”。于是，第一多媒体信息分享装置将向服务器发送交互操作信息，以使得服务器向第二多媒体信息分享装置发送该交互操作信息。
第二多媒体信息分享装置可以根据交互操作信息，对VR目标多媒体信息进行操作，也就是在接收者的VR显示屏上，也将该VR图片从左移动到右，从而达到同步展示VR目标多媒体信息的目的。
其次，本发明实施例中，第一多媒体信息分享装置展示VR目标多媒体信息之后，还可以接收交互操作指令，然后根据交互操作指令对VR目标多媒体信息进行操作，以生成交互操作信息，最后向服务器发送交互操作信息，服务器向第二多媒体信息分享装置发送交互操作信息。通过上述方式，分享者可以根据需求对VR目标多媒体信息进行相应的操作，这样的操作会形成交互操作信息，接收者根据交互操作信息对VR目标多媒体信息进行同样的操作，从而提升VR目标多媒体信息展示的灵活性和实用性，加强用户与VR目标多媒体信息之间的交互性。
为了便于理解，下面将说明如何在VR场景中生成VR目标多媒体信息，请参阅图5，图5为本发明实施例中虚拟现实场景中用户拖动并生成文件的示意图，如图所示，在用户通过VR显示屏进行本地操作之后，可以在终端桌面 的右下方创造一个弹出式的窗口，该窗口可以接收用户在本地浏览器的文件拖拽操作，并且能够读取被拖放进窗口的文件路径。用户一旦将桌面文件拖放至窗口，就可以识别该桌面文件是否符合预先定义的文件格式(如图片、文本、三维模型和音频文件)，并将文件打包发送给VR服务器，VR服务器给将其转发给VR场景中的第二多媒体信息分享装置。
当第二多媒体信息分享装置收到文件之后，会按文件类型生成可操作性物件供用户交互。具体的步骤如下：
通过VR显示屏展示操作桌面之后，用户就可以在VR场景之中打开桌面的资源管理器，就如正常鼠标操作那样拖动或者移动文件。同时会在桌面上生成一个“传送门窗口”，供用户将一些资源管理器内的多媒体文件(如图片、文本、三维模型和音频文件)拖放至该窗口，随后该窗口会进一步将文件在VR场景中生成预览，并形成可交互的物件。
可选地，在上述图3、图3对应的第一或第二个实施例的基础上，本发明实施例提供的多媒体信息分享的方法第三个可选实施例中，多媒体信息为图片文件；
根据目标多媒体信息生成VR目标多媒体信息，并且展示VR目标多媒体信息，可以包括：
根据图片文件创建对应的第一贴图，其中，第一贴图用于绑定图片文件中的图片数据；
将第一贴图映射到预置矩形网格模型，以获取VR图片；
通过VR显示屏展示VR图片。
本实施例中，将介绍在多媒体信息为图片文件的情况下是如何生成对应的VR图片。
具体地，请参阅图6，图6为本发明实施例中生成虚拟现实图片的流程示意图，如图所示，步骤301中，第一多媒体信息分享装置在图形处理器(Graphics Processing Unit，GPU)内根据图片大小格式类型动态地创建对应贴图内存，即创建第一贴图。步骤302中，可以将第一贴图按其格式读取内存，并按对应第一贴图格式将贴图数据绑定到GPU通道中。步骤303中，在VR场景内的特定位置生成一个矩形网格模型，请参阅图7，图7为本发明实施例中预置矩 形网格模型的示意图，矩形的顶点UV按照如图7的方式进行排列。在步骤304中，有了如上的贴图之后我们可以将模型顶点按其UV坐标去采样贴图中的像素，并绘制于这一点上，如此以来贴图模型就可以实时映射到场景的矩形网格模型之上，即如图8所示，图8为本发明实施例中将第一贴图映射到预置矩形网格模型的示意图。
再次，本发明实施例中，若多媒体信息为图片文件，则可以根据图片文件创建对应的第一贴图，再将第一贴图映射到预置矩形网格模型，以获取VR图片，最后通过VR显示屏展示VR图片。通过上述方式，可以将普通的图片以VR图片的形式展示给用户观看和操作，以此增加方案的实用性和可行性。在VR场景中具有较强的多感知性、存在感和自主性。
可选地，在上述图3、图3对应的第一或第二个实施例的基础上，本发明实施例提供的多媒体信息分享的方法第四个可选实施例中，多媒体信息为三维模型文件；
根据目标多媒体信息生成VR目标多媒体信息，并且展示VR目标多媒体信息，可以包括：
根据三维模型文件创建对应的第二贴图，其中，第二贴图用于绑定三维模型文件中的三维模型数据；
将第二贴图映射到预置三维网格模型，以获取VR三维模型；
通过VR显示屏展示VR三维模型。
本实施例中，将介绍在多媒体信息为三维模型文件的情况下是如何生成对应的VR目标多媒体信息。三维模型在VR场景中的绘制与传统三维模型在游戏引擎中的绘制相似，区别在于用户分享的三维模型是在运行的过程中由第一多媒体信息分享装置实时的创建的。
具体地，请参阅图9，图9为本发明实施例中生成虚拟三维模型的流程示意图，如图所示，步骤401中，第一多媒体信息分享装置首先动态创建三维模型文件以及对应第二贴图。步骤402中，在渲染管线中，将预置三维网格模型的顶点流数据、面片序列数据以及模型对应的第二贴图读取至内存，并绑定至创建的模型以及贴图显存。请参阅图10，图10为本发明实施例中预置三维网格模型的顶点序列示意图。步骤403中，在特定位置绘制VR三维模型，并根 据指定风格在GPU中对VR三维模型进行着色。
再次，本发明实施例中，若多媒体信息为三维模型文件，则第一多媒体信息分享装置可以根据三维模型文件创建对应的第二贴图，再将第二贴图映射到预置三维网格模型，以获取VR三维模型，最后通过VR显示屏展VR三维模型。通过上述方式，可以将普通的三维模型文件以VR三维模型的形式展示给用户观看和操作，以此增加方案的实用性和可行性。在VR场景中具有较强的多感知性、存在感和自主性。
可选地，在上述图3、图3对应的第一或第二个实施例的基础上，本发明实施例提供的多媒体信息分享的方法第五个可选实施例中，多媒体信息为音频文件；
根据目标多媒体信息生成VR目标多媒体信息，并且展示VR目标多媒体信息，可以包括：
将音频文件转换为3D音频文件；
播放3D音频文件。
本实施例中，如果分享者分享音频文件，则首先在本地确定待播放的音频文件，由第一多媒体信息分享装置将音频文件转换为3D音频文件，再通过播放器播放3D音频文件。
具体地，请参阅图11，图11为本发明实施例中3D音频的示意图，区别于图片和三维模型这类可视化物件，音频数据的浏览是靠播放其声音，不过由于是是VR项目，音频的播放也使用3D音频的形式，下面是对3D音频的解释。3D的音频需要实时计算场景中玩家(即分享者和接收者)的位置和场景音源头之间的位置关系，除了按距离衰减外，声音本身按照场景几何关系还有被遮挡，被反弹等等。
3D音频的效果可以用扬声器仿造出似乎存在但是虚构的声音。例如扬声器仿造头顶上有一架飞机从左至右飞过，闭上眼睛听，就会感觉到头顶真的有一架飞机从左至右飞过。这就是3D音频的效果。
再次，本发明实施例中，当发送方选择的是多媒体信息为音频文件时，第一多媒体信息分享装置可以将发送方选择的音频文件先转换成3D音频文件，然后播放该3D音频文件。通过上述方式，可以使得发送方和接收方都能在收 听到更具有立体效果的3D音频，从而提升方案的实用性，并加强了用户体验。
上述实施例是从第一多媒体信息分享装置的角度的角度对本发明中多媒体信息分享的方法进行介绍，下面将从第二多媒体信息分享装置的角度，对本发明中多媒体信息分享的方法进行介绍，请参阅图12，本发明实施例中多媒体信息分享的方法一个实施例包括：
501、多媒体信息分享系统中的第二多媒体信息分享装置接收多媒体信息播放指令，其中，多媒体信息分享系统还包括第一多媒体信息分享装置以及虚拟现实VR服务器；
本实施例中，多媒体信息分享系统包括第一多媒体信息分享装置，第二多媒体信息分享装置以及服务器，其中，第二多媒体信息分享装置还可以包括三个部分，具体为控制器、VR显示屏和终端设备，终端设备可以是PC、笔记本电脑或者平板电脑等，此处不做限定。
首先，第二多媒体信息分享装置接收用户触发的多媒体信息播放指令，多媒体信息播放指令可以是一个点击指令，这里的用户具体是指目标多媒体信息的接收者。
502、第二多媒体信息分享装置根据多媒体信息播放指令，从VR服务器中获取目标多媒体信息，其中，目标多媒体信息为第一多媒体信息分享装置向VR服务器发送的，目标多媒体信息用于第一多媒体信息分享装置生成VR目标多媒体信息，并且展示VR目标多媒体信息；
本实施例中，第二多媒体信息分享装置根据多媒体信息播放指令，从VR服务器接收目标多媒体信息，其中，目标多媒体信息是第一多媒体信息分享装置预先向VR服务器发送的。与此同时，在第一多媒体信息分享装置也会根据目标多媒体信息生成对应的VR目标多媒体信息，并展示VR目标多媒体信息。
503、第二多媒体信息分享装置根据目标多媒体信息生成VR目标多媒体信息；
本实施例中，第二多媒体信息分享装置将本地的目标多媒体信息生成VR目标多媒体信息。
504、第二多媒体信息分享装置展示VR目标多媒体信息。
本实施例中，最后第二多媒体信息分享装置将渲染该VR目标多媒体信息 并予以展示，从而使得接收者可以通过第二多媒体信息分享装置看到分享者分享的VR目标多媒体信息。
本发明实施例中，提供了一种多媒体信息分享的方法可以将多媒体信息处理成VR目标多媒体信息，从而使得信息接收方与信息发送方均可以在虚拟现实环境中看到VR目标多媒体信息，VR目标多媒体信息具有较好的灵活性和多样性，有利于提升信息分享的交互性。
可选地，在上述图12对应的实施例的基础上，本发明实施例提供的多媒体信息分享的方法第一个可选实施例中，展示VR目标多媒体信息之后，还可以包括：
接收交互操作指令；
根据交互操作指令对VR目标多媒体信息进行操作，以生成交互操作信息，操作包括选中、移动、放大、缩小和播放中的至少一种；
向服务器发送交互操作信息，以使服务器向第一多媒体信息分享装置发送交互操作信息，其中，交互操作信息用于指示第一多媒体信息分享装置对VR目标多媒体信息进行操作。
本实施例中，在第二多媒体信息分享装置展示VR目标多媒体信息之后，还可以进一步接收用户(接收者)对其进行的操作。首先接收用户触发的交互操作指令，比如交互操作指令是移动VR图片这一动作，则第一多媒体信息分享装置根据这个动作，在本地的VR显示屏上执行相应的操作，即将VR图片从上方移动到下方。与此同时，第二多媒体信息分享装置会根据交互操作指令生成一个交互操作信息，交互操作信息中携带了用户操作的内容，例如“将VR图片从上方移动到下方”。于是，第二多媒体信息分享装置将向服务器发送交互操作信息，以使得服务器向第一多媒体信息分享装置发送该交互操作信息。
第一多媒体信息分享装置可以根据交互操作信息，对VR目标多媒体信息进行操作，也就是在分享者的VR显示屏上，也将该VR图片从上方移动到下方，从而达到同步展示VR目标多媒体信息的目的。
其次，本发明实施例中，接收者可以根据需求对VR目标多媒体信息进行相应的操作，这样的操作会形成交互操作信息，分享者根据交互操作信息对 VR目标多媒体信息进行同样的操作，从而提升VR目标多媒体信息展示的灵活性和实用性，加强用户与VR目标多媒体信息之间的交互性。
为便于理解，下面可以以具体应用场景对本发明中在生成VR目标多媒体信息的过程进行描述，例如，用户A想给用户B分享一张图片，于是用户A在PC端的VR显示桌面上选择一个图片文件，请参阅图13，图13为本发明应用场景中选择图片文件的示意图，如图所示，用户A可以在本地选择图片，然后PC会将该图片转换为VR图片，并投影在用户A本地的VR显示屏上，于是，用户A可以通过VR显示屏观看VR图片然后对其进行抓取投掷等交互操作。当然，用户A所选择的图片也会上传至VR服务器，该VR服务器向用户B的PC端发送用户A选择的图片，同样地，用户B本地的VR显示屏上也会显示这张VR图片。如果用户A对该图片进行放大操作，用户B也会在VR显示屏上看到该VR图片被放大了。
例如，用户A想给用户B分享一个三维模型，于是用户A在PC端的VR显示桌面上选择一个三维模型文件，请参阅图14，图14为本发明应用场景中选择三维模型文件的示意图，如图所示，用户A可以在本地选择三维模型文件，然后PC会将该三维模型文件转换为VR三维模型，并投影在用户A本地的VR显示屏上，于是，用户A可以通过VR显示屏观看VR三维模型后对其进行抓取投掷等交互操作。当然，用户A所选择的VR三维模型也会上传至VR服务器，该VR服务器向用户B的PC端发送用户A选择的VR三维模型，同样地，用户B本地的VR显示屏上也会显示这个VR三维模型。如果用户A对该VR三维模型进行投掷操作，用户B也会在VR显示屏上看到该VR三维模型被投掷。
例如，用户A想给用户B分享一段音乐，于是用户A在PC端的VR显示桌面上选择一个音乐文件，请参阅图15，图15为本发明应用场景中选择音频文件的示意图，如图所示，用户A可以在本地选择音频文件，然后PC会将该音频文件转换为3D音频，并通过播放设备进行播放，用户B可以从VR服务器中获取该3D音频，然后在用户B的本地播放设备上播放该3D音频。
下面对本发明中的多媒体信息分享装置进行详细描述，请参阅图16，本发明实施例中的多媒体信息分享装置应用于多媒体信息分享系统，所述多媒 体信息分享系统还包括虚拟现实VR服务器以及第二多媒体信息分享装置，所述多媒体信息分享装置60包括：
接收模块601，用于通过VR显示桌面接收多媒体信息分享指令，其中，所述VR显示桌面用于展示多媒体信息图标，所述多媒体信息分享指令用于选择所述多媒体信息图标，且所述多媒体信息图标与多媒体信息具有对应关系；
确定模块602，用于根据所述接收模块601接收的所述多媒体信息分享指令确定待发送的目标多媒体信息；
发送模块603，用于将所述确定模块602确定的所述目标多媒体信息发送至所述VR服务器，以使所述VR服务器向所述第二多媒体信息分享装置发送所述目标多媒体信息，其中，所述多媒体信息用于所述第二多媒体信息分享装置生成所述目标多媒体信息所对应的VR目标多媒体信息，并且展示所述VR目标多媒体信息；
展示模块604，用于根据所述确定模块603确定的所述目标多媒体信息生成所述VR目标多媒体信息，并且展示所述VR目标多媒体信息。
本实施例中，接收模块601通过VR显示桌面接收多媒体信息分享指令，其中，所述VR显示桌面用于展示多媒体信息图标，所述多媒体信息分享指令用于选择所述多媒体信息图标，且所述多媒体信息图标与多媒体信息具有对应关系，确定模块602根据所述接收模块601接收的所述多媒体信息分享指令确定待发送的目标多媒体信息，发送模块603将所述确定模块602确定的所述目标多媒体信息发送至所述VR服务器，以使所述VR服务器向所述第二多媒体信息分享装置发送所述目标多媒体信息，其中，所述多媒体信息用于所述第二多媒体信息分享装置生成所述目标多媒体信息所对应的VR目标多媒体信息，并且展示所述VR目标多媒体信息，展示模块604根据所述确定模块603确定的所述目标多媒体信息生成所述VR目标多媒体信息，并且展示所述VR目标多媒体信息。
本发明实施例提供的技术方案中，提供了一种多媒体信息分享的方法，通过将多媒体信息处理成VR目标多媒体信息，从而使得信息接收方与信息发送方均可以在虚拟现实环境中看到VR目标多媒体信息，VR目标多媒体信息具有较好的灵活性和多样性，有利于提升信息分享的交互性。
可选地，在上述图16所对应的实施例的基础上，本发明实施例提供的多媒体信息分享装置60的另一实施例中，多媒体信息分享装置60还包括：
所述接收模块601，具体用于通过所述VR显示桌面获取屏幕比例值以及实时操作信息，其中，所述屏幕比例值用于表示空间坐标值与参考坐标值之间的比例，所述实时操作信息用于表示用户对所述控制器的操作；
根据所述屏幕比例值与所述实时操作信息生成所述多媒体信息分享指令。
其次，本发明实施例中，介绍了如何根据用户触发的多媒体信息分享指令确定待发送的多媒体信息，即第一多媒体信息分享装置根据多媒体信息分享指令获取控制器的射线与VR显示屏之间的空间坐标值，然后根据空间坐标值与VR显示屏的参考坐标值，确定屏幕比例值，最后根据屏幕比例值、VR显示屏的宽度值和VR显示屏的高度值，获取屏幕比例值，此外，还根据多媒体信息分享指令获取实时操作信息，结合屏幕比例值与实时操作信息，确定待发送的多媒体信息。通过上述方式，提升了方案在实际应用中的可行性和可操作性。
可选地，在上述图16所对应的实施例的基础上，请参阅图17，本发明实施例提供的多媒体信息分享装置60的另一实施例中，多媒体信息分享装置60还包括生成模块605；
所述接收模块601，还用于所述展示模块604根据所述多媒体信息生成所述VR目标多媒体信息，并且展示所述VR目标多媒体信息之后，接收交互操作指令；
所述生成模块605，用于根据所述接收模块601接收的所述交互操作指令对所述VR目标多媒体信息进行操作，以生成交互操作信息，所述操作包括选中、移动、放大、缩小和播放中的至少一种；
所述发送模块603，还用于向所述服务器发送所述生成模块605生成的所述交互操作信息，以使所述服务器向所述第二多媒体信息分享装置发送所述交互操作信息，其中，所述交互操作信息用于指示所述第二多媒体信息分享装置对所述VR目标多媒体信息进行所述操作。
其次，本发明实施例中，第一多媒体信息分享装置展示VR目标多媒体信息之后，还可以接收交互操作指令，然后根据交互操作指令对VR目标多媒体 信息进行操作，以生成交互操作信息，最后向服务器发送交互操作信息，服务器向第二多媒体信息分享装置发送交互操作信息。通过上述方式，分享者可以根据需求对VR目标多媒体信息进行相应的操作，这样的操作会形成交互操作信息，接收者根据交互操作信息对VR目标多媒体信息进行同样的操作，从而提升VR目标多媒体信息展示的灵活性和实用性，加强用户与VR目标多媒体信息之间的交互性。
可选地，在上述图16所对应的实施例的基础上，本发明实施例提供的多媒体信息分享装置60的另一实施例中，多媒体信息分享装置60还包括：
所述多媒体信息为图片文件；
所述展示模块604，具体用于根据所述图片文件创建对应的第一贴图，其中，所述第一贴图用于绑定所述图片文件中的图片数据；
将所述第一贴图映射到预置矩形网格模型，以获取VR图片；
通过所述VR显示屏展示所述VR图片。
再次，本发明实施例中，若多媒体信息为图片文件，则可以根据图片文件创建对应的第一贴图，再将第一贴图映射到预置矩形网格模型，以获取VR图片，最后通过VR显示屏展示VR图片。通过上述方式，可以将普通的图片以VR图片的形式展示给用户观看和操作，以此增加方案的实用性和可行性。在VR场景中具有较强的多感知性、存在感和自主性。
可选地，在上述图16所对应的实施例的基础上，本发明实施例提供的多媒体信息分享装置60的另一实施例中，多媒体信息分享装置60还包括：
所述多媒体信息为三维模型文件；
所述展示模块，具体用于根据所述三维模型文件创建对应的第二贴图，其中，所述第二贴图用于绑定所述三维模型文件中的三维模型数据；
将所述第二贴图映射到预置三维网格模型，以获取VR三维模型；
通过所述VR显示屏展示所述VR三维模型。
再次，本发明实施例中，若多媒体信息为三维模型文件，则第一多媒体信息分享装置可以根据三维模型文件创建对应的第二贴图，再将第二贴图映射到预置三维网格模型，以获取VR三维模型，最后通过VR显示屏展VR三维模型。通过上述方式，可以将普通的三维模型文件以VR三维模型的形式展示 给用户观看和操作，以此增加方案的实用性和可行性。在VR场景中具有较强的多感知性、存在感和自主性。
可选地，在上述图16所对应的实施例的基础上，本发明实施例提供的多媒体信息分享装置60的另一实施例中，多媒体信息分享装置60还包括：
所述多媒体信息为音频文件；
所述展示模块，具体用于将所述音频文件转换为3D音频文件；
播放所述3D音频文件。
再次，本发明实施例中，当发送方选择的是多媒体信息为音频文件时，第一多媒体信息分享装置可以将发送方选择的音频文件先转换成3D音频文件，然后播放该3D音频文件。通过上述方式，可以使得发送方和接收方都能在收听到更具有立体效果的3D音频，从而提升方案的实用性，并加强了用户体验。
上面对本发明中的第一多媒体信息分享装置进行了介绍，下面将对本发明中的第二多媒体信息分享装置进行详细描述，请参阅图18，本发明实施例中的多媒体信息分享装置应用于多媒体信息分享系统，所述多媒体信息分享系统还包括第一多媒体信息分享装置和虚拟现实VR服务器，多媒体信息分享装置70包括：
接收模块701，用于接收多媒体信息播放指令；
获取模块702，用于根据所述接收模块701接收的所述多媒体信息播放指令，从所述VR服务器中获取目标多媒体信息，其中，所述目标多媒体信息为所述第一多媒体信息分享装置向所述VR服务器发送的，所述目标多媒体信息用于所述第一多媒体信息分享装置生成VR目标多媒体信息，并且展示所述VR目标多媒体信息；
生成模块703，用于根据所述获取模块702获取的所述目标多媒体信息生成所述VR目标多媒体信息；
展示模块704，用于展示所述生成模块703生成的所述VR目标多媒体信息。
本实施例中，接收模块701接收多媒体信息播放指令，获取模块702根据所述接收模块701接收的所述多媒体信息播放指令，从所述VR服务器中获取目标多媒体信息，其中，所述目标多媒体信息为所述第一多媒体信息分享装 置向所述VR服务器发送的，所述目标多媒体信息用于所述第一多媒体信息分享装置生成VR目标多媒体信息，并且展示所述VR目标多媒体信息，生成模块703根据所述获取模块702获取的所述目标多媒体信息生成所述VR目标多媒体信息，展示模块704展示所述生成模块703生成的所述VR目标多媒体信息。
本发明实施例中，提供了一种多媒体信息分享的方法可以将多媒体信息处理成VR目标多媒体信息，从而使得信息接收方与信息发送方均可以在虚拟现实环境中看到VR目标多媒体信息，VR目标多媒体信息具有较好的灵活性和多样性，有利于提升信息分享的交互性。
可选地，在上述图18所对应的实施例的基础上，请参阅图19，本发明实施例提供的多媒体信息分享装置70的另一实施例中，所述多媒体信息分享装置70还包括发送模块705；
所述接收模块701，还用于接收交互操作指令；
所述生成模块703，还用于根据所述接收模块701接收的所述交互操作指令对所述VR目标多媒体信息进行操作，以生成交互操作信息，所述操作包括选中、移动、放大、缩小和播放中的至少一种；
所述发送模块705，用于向所述服务器发送所述生成模块703生成的所述交互操作信息，以使所述服务器向所述第一多媒体信息分享装置发送所述交互操作信息，其中，所述交互操作信息用于指示所述第一多媒体信息分享装置对所述VR目标多媒体信息进行操作。
其次，本发明实施例中，接收者可以根据需求对VR目标多媒体信息进行相应的操作，这样的操作会形成交互操作信息，分享者根据交互操作信息对VR目标多媒体信息进行同样的操作，从而提升VR目标多媒体信息展示的灵活性和实用性，加强用户与VR目标多媒体信息之间的交互性。
图20是本发明实施例多媒体信息分享装置80的结构示意图。多媒体信息分享装置80可包括输入设备810、输出设备820、处理器830和存储器840。本发明实施例中的输出设备可以是显示设备。
存储器840可以包括只读存储器和随机存取存储器，并向处理器830提供指令和数据。存储器840的一部分还可以包括非易失性随机存取存储器 (Non-Volatile Random Access Memory，NVRAM)。
存储器840存储了如下的元素，可执行模块或者数据结构，或者它们的子集，或者它们的扩展集:
操作指令：包括各种操作指令，用于实现各种操作。
操作系统：包括各种系统程序，用于实现各种基础业务以及处理基于硬件的任务。
本发明实施例中处理器830用于执行如下步骤：
通过VR显示桌面接收多媒体信息分享指令，其中，所述VR显示桌面用于展示多媒体信息图标，所述多媒体信息分享指令用于选择所述多媒体信息图标，且所述多媒体信息图标与多媒体信息具有对应关系；
根据所述多媒体信息分享指令确定待发送的目标多媒体信息；
将所述目标多媒体信息发送至所述VR服务器，以使所述VR服务器向所述第二多媒体信息分享装置发送所述目标多媒体信息，其中，所述多媒体信息用于所述第二多媒体信息分享装置生成所述目标多媒体信息所对应的VR目标多媒体信息，并且展示所述VR目标多媒体信息；
根据所述目标多媒体信息生成所述VR目标多媒体信息，并且展示所述VR目标多媒体信息。
处理器830具体用于执行如下步骤：
通过所述VR显示桌面获取屏幕比例值以及实时操作信息，其中，所述屏幕比例值用于表示空间坐标值与参考坐标值之间的比例，所述实时操作信息用于表示用户对所述控制器的操作；
根据所述屏幕比例值与所述实时操作信息生成所述多媒体信息分享指令。
处理器830具体还用于执行如下步骤：
接收交互操作指令；
根据所述交互操作指令对所述VR目标多媒体信息进行操作，以生成交互操作信息，所述操作包括选中、移动、放大、缩小和播放中的至少一种；
向所述服务器发送所述交互操作信息，以使所述服务器向所述第二多媒体信息分享装置发送所述交互操作信息，其中，所述交互操作信息用于指示所述第二多媒体信息分享装置对所述VR目标多媒体信息进行所述操作。
处理器830具体用于执行如下步骤：
根据所述图片文件创建对应的第一贴图，其中，所述第一贴图用于绑定所述图片文件中的图片数据；
将所述第一贴图映射到预置矩形网格模型，以获取VR图片；
通过所述VR显示屏展示所述VR图片。
处理器830具体用于执行如下步骤：
根据所述三维模型文件创建对应的第二贴图，其中，所述第二贴图用于绑定所述三维模型文件中的三维模型数据；
将所述第二贴图映射到预置三维网格模型，以获取VR三维模型；
通过所述VR显示屏展示所述VR三维模型。
处理器830具体用于执行如下步骤：
将所述音频文件转换为3D音频文件；
播放所述3D音频文件。
处理器830控制多媒体信息分享装置80的操作，处理器830还可以称为中央处理单元(Central Processing Unit，CPU)。存储器840可以包括只读存储器和随机存取存储器，并向处理器830提供指令和数据。存储器840的一部分还可以包括NVRAM。具体的应用中，多媒体信息分享装置80的各个组件通过总线系统850耦合在一起，其中总线系统850除包括数据总线之外，还可以包括电源总线、控制总线和状态信号总线等。但是为了清楚说明起见，在图中将各种总线都标为总线系统850。
上述本发明实施例揭示的方法可以应用于处理器830中，或者由处理器830实现。处理器830可能是一种集成电路芯片，具有信号的处理能力。在实现过程中，上述方法的各步骤可以通过处理器830中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器830可以是通用处理器、数字信号处理器(Digital Signal Processing，DSP)、专用集成电路(Application Specific Integrated Circuit，ASIC)、现成可编程门阵列(Field－Programmable Gate Array，FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本发明实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本 发明实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成，或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器，闪存、只读存储器，可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器840，处理器830读取存储器840中的信息，结合其硬件完成上述方法的步骤。
图20的相关描述可以参阅图3方法部分的相关描述和效果进行理解，本处不做过多赘述。
图21是本发明实施例多媒体信息分享装置90的结构示意图。多媒体信息分享装置90可包括输入设备910、输出设备920、处理器930和存储器940。本发明实施例中的输出设备可以是显示设备。
存储器940可以包括只读存储器和随机存取存储器，并向处理器930提供指令和数据。存储器840的一部分还可以包括NVRAM。
存储器940存储了如下的元素，可执行模块或者数据结构，或者它们的子集，或者它们的扩展集:
操作指令：包括各种操作指令，用于实现各种操作。
操作系统：包括各种系统程序，用于实现各种基础业务以及处理基于硬件的任务。
本发明实施例中处理器930用于执行如下步骤：
接收多媒体信息播放指令；
根据所述多媒体信息播放指令，从所述VR服务器中获取目标多媒体信息，其中，所述目标多媒体信息为所述第一多媒体信息分享装置向所述VR服务器发送的，所述目标多媒体信息用于所述第一多媒体信息分享装置生成VR目标多媒体信息，并且展示所述VR目标多媒体信息；
根据所述目标多媒体信息生成所述VR目标多媒体信息；
展示所述VR目标多媒体信息。
所述处理器930还用于执行如下步骤：
接收交互操作指令；
根据所述交互操作指令对所述VR目标多媒体信息进行操作，以生成交互操作信息，所述操作包括选中、移动、放大、缩小和播放中的至少一种；
向所述服务器发送所述交互操作信息，以使所述服务器向所述第一多媒体信息分享装置发送所述交互操作信息，其中，所述交互操作信息用于指示所述第一多媒体信息分享装置对所述VR目标多媒体信息进行操作。
处理器930控制多媒体信息分享装置80的操作，处理器830还可以称为CPU。存储器940可以包括只读存储器和随机存取存储器，并向处理器930提供指令和数据。存储器940的一部分还可以包括NVRAM。具体的应用中，多媒体信息分享装置90的各个组件通过总线系统950耦合在一起，其中总线系统950除包括数据总线之外，还可以包括电源总线、控制总线和状态信号总线等。但是为了清楚说明起见，在图中将各种总线都标为总线系统950。
上述本发明实施例揭示的方法可以应用于处理器930中，或者由处理器830实现。处理器930可能是一种集成电路芯片，具有信号的处理能力。在实现过程中，上述方法的各步骤可以通过处理器930中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器930可以是通用处理器、DSP、ASIC、FPGA或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本发明实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本发明实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成，或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器，闪存、只读存储器，可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器940，处理器930读取存储器940中的信息，结合其硬件完成上述方法的步骤。
图21的相关描述可以参阅图12方法部分的相关描述和效果进行理解，本处不做过多赘述。
请参阅图22，图22为本发明实施例中多媒体信息分享系统一个实施例示意图，多媒体信息分享系统包括第一多媒体信息分享装置1003、虚拟现实VR服务器1002以及第二多媒体信息分享装置1001，多媒体信息分享系统包括：
第一多媒体信息分享装置1003通过VR显示桌面接收多媒体信息分享指令，其中，所述VR显示桌面用于展示多媒体信息图标，所述多媒体信息分 享指令用于选择所述多媒体信息图标，且所述多媒体信息图标与多媒体信息具有对应关系，第一多媒体信息分享装置1003根据所述多媒体信息分享指令确定待发送的目标多媒体信息，第一多媒体信息分享装置1003将所述目标多媒体信息发送至所述VR服务器1002，以使所述VR服务器1002向所述第二多媒体信息分享装置1001发送所述目标多媒体信息，其中，所述多媒体信息用于所述第二多媒体信息分享装置1001生成所述目标多媒体信息所对应的VR目标多媒体信息，并且展示所述VR目标多媒体信息，第一多媒体信息分享装置1003根据所述目标多媒体信息生成所述VR目标多媒体信息，并且展示所述VR目标多媒体信息。
本发明实施例提供的技术方案中，提供了一种多媒体信息分享系统。采用该系统，可以将多媒体信息处理成VR目标多媒体信息，从而使得信息接收方与信息发送方均可以在虚拟现实环境中看到VR目标多媒体信息，VR目标多媒体信息具有较好的灵活性和多样性，有利于提升信息分享的交互性。
在上述实施例中，可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时，可以全部或部分地以计算机程序产品的形式实现。
所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时，全部或部分地产生按照本发明实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中，或者从一个计算机可读存储介质向另一计算机可读存储介质传输，例如，所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(Digital Subscriber Line，DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存储的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质，(例如，软盘、硬盘、磁带)、光介质(例如，DVD)、或者半导体介质(例如固态硬盘Solid State Disk(SSD))等。
所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述描 述的系统，装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
在本发明所提供的几个实施例中，应该理解到，所揭露的系统，装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本发明各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(Read-Only Memory，ROM)、随机存取存储器(Random Access Memory，RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述，以上实施例仅用以说明本发明的技术方案，而非对其限制；尽管参照前述实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其 中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。

Claims (17)

  1. 一种多媒体信息分享的方法，其特征在于，所述方法应用于多媒体信息分享系统，所述多媒体信息分享系统包括第一多媒体信息分享装置、虚拟现实VR服务器以及第二多媒体信息分享装置，所述方法包括：
    通过VR显示桌面接收多媒体信息分享指令，其中，所述VR显示桌面用于展示多媒体信息图标，所述多媒体信息分享指令用于选择所述多媒体信息图标，且所述多媒体信息图标与多媒体信息具有对应关系；
    根据所述多媒体信息分享指令确定待发送的目标多媒体信息；
    将所述目标多媒体信息发送至所述VR服务器，以使所述VR服务器向所述第二多媒体信息分享装置发送所述目标多媒体信息，其中，所述多媒体信息用于所述第二多媒体信息分享装置生成所述目标多媒体信息所对应的VR目标多媒体信息，并且展示所述VR目标多媒体信息；
    根据所述目标多媒体信息生成所述VR目标多媒体信息，并且展示所述VR目标多媒体信息。
  2. 根据权利要求1所述的方法，其特征在于，所述通过VR显示桌面接收多媒体信息分享指令，包括：
    通过所述VR显示桌面获取屏幕比例值以及实时操作信息，其中，所述屏幕比例值用于表示空间坐标值与参考坐标值之间的比例，所述实时操作信息用于表示用户对所述控制器的操作；
    根据所述屏幕比例值与所述实时操作信息生成所述多媒体信息分享指令。
  3. 根据权利要求1所述的方法，其特征在于，所述根据所述多媒体信息生成所述VR目标多媒体信息，并且展示所述VR目标多媒体信息之后，所述方法还包括：
    接收交互操作指令；
    根据所述交互操作指令对所述VR目标多媒体信息进行操作，以生成交互操作信息，所述操作包括选中、移动、放大、缩小和播放中的至少一种；
    向所述服务器发送所述交互操作信息，以使所述服务器向所述第二多媒体信息分享装置发送所述交互操作信息，其中，所述交互操作信息用于指示所述第二多媒体信息分享装置对所述VR目标多媒体信息进行所述操作。
  4. 根据权利要求1至3中任一项所述的方法，其特征在于，所述多媒体信息为图片文件；
    所述根据所述目标多媒体信息生成所述VR目标多媒体信息，并且展示所述VR目标多媒体信息，包括：
    根据所述图片文件创建对应的第一贴图，其中，所述第一贴图用于绑定所述图片文件中的图片数据；
    将所述第一贴图映射到预置矩形网格模型，以获取VR图片；
    通过所述VR显示屏展示所述VR图片。
  5. 根据权利要求1至3中任一项所述的方法，其特征在于，所述多媒体信息为三维模型文件；
    所述根据所述目标多媒体信息生成所述VR目标多媒体信息，并且展示所述VR目标多媒体信息，包括：
    根据所述三维模型文件创建对应的第二贴图，其中，所述第二贴图用于绑定所述三维模型文件中的三维模型数据；
    将所述第二贴图映射到预置三维网格模型，以获取VR三维模型；
    通过所述VR显示屏展示所述VR三维模型。
  6. 根据权利要求1至3中任一项所述的方法，其特征在于，所述多媒体信息为音频文件；
    所述根据所述目标多媒体信息生成所述VR目标多媒体信息，并且展示所述VR目标多媒体信息，包括：
    将所述音频文件转换为3D音频文件；
    播放所述3D音频文件。
  7. 一种多媒体信息分享的方法，其特征在于，所述方法应用于多媒体信息分享系统，所述多媒体信息分享系统包括第一多媒体信息分享装置、虚拟现实VR服务器以及第二多媒体信息分享装置，所述方法包括：
    接收多媒体信息播放指令；
    根据所述多媒体信息播放指令，从所述VR服务器中获取目标多媒体信息，其中，所述目标多媒体信息为所述第一多媒体信息分享装置向所述VR服务器发送的，所述目标多媒体信息用于所述第一多媒体信息分享装置生成VR 目标多媒体信息，并且展示所述VR目标多媒体信息；
    根据所述目标多媒体信息生成所述VR目标多媒体信息；
    展示所述VR目标多媒体信息。
  8. 根据权利要求7所述的方法，其特征在于，所述展示所述VR目标多媒体信息之后，所述方法还包括：
    接收交互操作指令；
    根据所述交互操作指令对所述VR目标多媒体信息进行操作，以生成交互操作信息，所述操作包括选中、移动、放大、缩小和播放中的至少一种；
    向所述服务器发送所述交互操作信息，以使所述服务器向所述第一多媒体信息分享装置发送所述交互操作信息，其中，所述交互操作信息用于指示所述第一多媒体信息分享装置对所述VR目标多媒体信息进行操作。
  9. 一种多媒体信息分享装置，其特征在于，所述多媒体信息分享装置应用于多媒体信息分享系统，所述多媒体信息分享系统包括虚拟现实VR服务器以及第二多媒体信息分享装置，所述多媒体信息分享装置包括：
    接收模块，用于通过VR显示桌面接收多媒体信息分享指令，其中，所述VR显示桌面用于展示多媒体信息图标，所述多媒体信息分享指令用于选择所述多媒体信息图标，且所述多媒体信息图标与多媒体信息具有对应关系；
    确定模块，用于根据所述接收模块接收的所述多媒体信息分享指令确定待发送的目标多媒体信息；
    发送模块，用于将所述确定模块确定的所述目标多媒体信息发送至所述VR服务器，以使所述VR服务器向所述第二多媒体信息分享装置发送所述目标多媒体信息，其中，所述多媒体信息用于所述第二多媒体信息分享装置生成所述目标多媒体信息所对应的VR目标多媒体信息，并且展示所述VR目标多媒体信息；
    展示模块，用于根据所述确定模块确定的所述目标多媒体信息生成所述VR目标多媒体信息，并且展示所述VR目标多媒体信息。
  10. 一种多媒体信息分享装置，其特征在于，所述多媒体信息分享装置应用于多媒体信息分享系统，所述多媒体信息分享系统包括虚拟现实VR服务器以及第一多媒体信息分享装置，所述多媒体信息分享装置包括：
    接收模块，用于接收多媒体信息播放指令；
    获取模块，用于根据所述接收模块接收的所述多媒体信息播放指令，从所述VR服务器中获取目标多媒体信息，其中，所述目标多媒体信息为所述第一多媒体信息分享装置向所述VR服务器发送的，所述目标多媒体信息用于所述第一多媒体信息分享装置生成VR目标多媒体信息，并且展示所述VR目标多媒体信息；
    生成模块，用于根据所述获取模块获取的所述目标多媒体信息生成所述VR目标多媒体信息；
    展示模块，用于展示所述生成模块生成的所述VR目标多媒体信息。
  11. 一种多媒体信息分享装置，其特征在于，所述多媒体信息分享装置应用于多媒体信息分享系统，所述多媒体信息分享系统还包括虚拟现实VR服务器以及第二多媒体信息分享装置，所述多媒体信息分享装置包括：存储器、收发器、处理器以及总线系统；
    其中，所述存储器用于存储程序；
    所述处理器用于执行所述存储器中的程序，包括如下步骤：
    通过VR显示桌面接收多媒体信息分享指令，其中，所述VR显示桌面用于展示多媒体信息图标，所述多媒体信息分享指令用于选择所述多媒体信息图标，且所述多媒体信息图标与多媒体信息具有对应关系；
    根据所述多媒体信息分享指令确定待发送的目标多媒体信息；
    将所述目标多媒体信息发送至所述VR服务器，以使所述VR服务器向所述第二多媒体信息分享装置发送所述目标多媒体信息，其中，所述多媒体信息用于所述第二多媒体信息分享装置生成所述目标多媒体信息所对应的VR目标多媒体信息，并且展示所述VR目标多媒体信息；
    根据所述目标多媒体信息生成所述VR目标多媒体信息，并且展示所述VR目标多媒体信息；
    所述总线系统用于连接所述存储器以及所述处理器，以使所述存储器以及所述处理器进行通信。
  12. 根据权利要求11所述的多媒体信息分享装置，其特征在于，所述处理器还用于执行如下步骤：
    通过所述VR显示桌面获取屏幕比例值以及实时操作信息，其中，所述屏幕比例值用于表示空间坐标值与参考坐标值之间的比例，所述实时操作信息用于表示用户对所述控制器的操作；
    根据所述屏幕比例值与所述实时操作信息生成所述多媒体信息分享指令。
  13. 根据权利要求11所述的多媒体信息分享装置，其特征在于，所述处理器还用于执行如下步骤：
    接收交互操作指令；
    根据所述交互操作指令对所述VR目标多媒体信息进行操作，以生成交互操作信息，所述操作包括选中、移动、放大、缩小和播放中的至少一种；
    向所述服务器发送所述交互操作信息，以使所述服务器向所述第二多媒体信息分享装置发送所述交互操作信息，其中，所述交互操作信息用于指示所述第二多媒体信息分享装置对所述VR目标多媒体信息进行所述操作。
  14. 一种多媒体信息分享装置，其特征在于，所述多媒体信息分享装置应用于多媒体信息分享系统，所述多媒体信息分享系统还包括虚拟现实VR服务器以及第一多媒体信息分享装置，所述多媒体信息分享装置包括：存储器、收发器、处理器以及总线系统；
    其中，所述存储器用于存储程序；
    所述处理器用于执行所述存储器中的程序，包括如下步骤：
    接收多媒体信息播放指令；
    根据所述多媒体信息播放指令，从所述VR服务器中获取目标多媒体信息，其中，所述目标多媒体信息为所述第一多媒体信息分享装置向所述VR服务器发送的，所述目标多媒体信息用于所述第一多媒体信息分享装置生成VR目标多媒体信息，并且展示所述VR目标多媒体信息；
    根据所述目标多媒体信息生成所述VR目标多媒体信息；
    展示所述VR目标多媒体信息；
    所述总线系统用于连接所述存储器以及所述处理器，以使所述存储器以及所述处理器进行通信。
  15. 根据权利要求14所述的多媒体信息分享装置，其特征在于，所述处理器还用于执行如下步骤：
    接收交互操作指令；
    根据所述交互操作指令对所述VR目标多媒体信息进行操作，以生成交互操作信息，所述操作包括选中、移动、放大、缩小和播放中的至少一种；
    向所述服务器发送所述交互操作信息，以使所述服务器向所述第一多媒体信息分享装置发送所述交互操作信息，其中，所述交互操作信息用于指示所述第一多媒体信息分享装置对所述VR目标多媒体信息进行操作。
  16. 一种计算机可读存储介质，包括指令，当其在计算机上运行时，使得计算机执行如权利要求1-6所述的方法。
  17. 一种计算机可读存储介质，包括指令，当其在计算机上运行时，使得计算机执行如权利要求7-8所述的方法。
PCT/CN2017/119786 2017-12-29 2017-12-29 一种多媒体信息分享的方法、相关装置及系统 WO2019127349A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
PCT/CN2017/119786 WO2019127349A1 (zh) 2017-12-29 2017-12-29 一种多媒体信息分享的方法、相关装置及系统
CN201780048513.1A CN109644181B (zh) 2017-12-29 2017-12-29 一种多媒体信息分享的方法、相关装置及系统
US16/860,905 US10965783B2 (en) 2017-12-29 2020-04-28 Multimedia information sharing method, related apparatus, and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/119786 WO2019127349A1 (zh) 2017-12-29 2017-12-29 一种多媒体信息分享的方法、相关装置及系统

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/860,905 Continuation US10965783B2 (en) 2017-12-29 2020-04-28 Multimedia information sharing method, related apparatus, and system

Publications (1)

Publication Number Publication Date
WO2019127349A1 true WO2019127349A1 (zh) 2019-07-04

Family

ID=66053538

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/119786 WO2019127349A1 (zh) 2017-12-29 2017-12-29 一种多媒体信息分享的方法、相关装置及系统

Country Status (3)

Country Link
US (1) US10965783B2 (zh)
CN (1) CN109644181B (zh)
WO (1) WO2019127349A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112218145A (zh) * 2020-10-15 2021-01-12 聚好看科技股份有限公司 智能电视、vr显示设备以及相关方法
CN114942812A (zh) * 2022-05-31 2022-08-26 上海嘉车信息科技有限公司 多媒体信息共享方法、装置和电子设备

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111782056B (zh) * 2020-08-18 2024-08-09 Oppo广东移动通信有限公司 内容分享方法、装置、设备及存储介质
CN114189946A (zh) * 2020-09-15 2022-03-15 华为技术有限公司 数据分享的方法、电子设备和系统
CN112437090B (zh) * 2020-11-27 2022-11-04 深圳市商汤科技有限公司 资源加载方法及装置、电子设备和存储介质
CN113794795B (zh) * 2021-08-13 2023-01-10 维沃移动通信有限公司 信息共享方法、装置、电子设备及可读存储介质
CN114253394B (zh) * 2021-11-10 2024-02-27 深圳市华阳国际工程设计股份有限公司 一种基于bim平台的vr审图方法及系统
CN117813579A (zh) * 2022-07-29 2024-04-02 京东方科技集团股份有限公司 模型控制方法、装置、设备、系统以及计算机存储介质
US12022233B2 (en) * 2022-08-23 2024-06-25 International Business Machines Corporation Web conference contact routing
CN116700659B (zh) * 2022-09-02 2024-03-08 荣耀终端有限公司 一种界面交互方法及电子设备

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140080592A1 (en) * 2007-12-10 2014-03-20 Gary Stephen Shuster Guest management in an online multiplayer virtual reality game
CN105898694A (zh) * 2016-04-06 2016-08-24 众景视界（北京）科技有限公司 用于定位及信息交互的方法、头戴式可视设备及服务器
CN106358090A (zh) * 2016-08-26 2017-01-25 腾讯科技（深圳）有限公司 虚拟现实视频播放方法和装置、视频投射方法和装置
CN106791699A (zh) * 2017-01-18 2017-05-31 北京爱情说科技有限公司 一种远程头戴交互式视频共享系统
CN106790553A (zh) * 2016-12-24 2017-05-31 珠海市魅族科技有限公司 虚拟现实设备的界面共享方法和装置
CN106941538A (zh) * 2017-05-15 2017-07-11 百度在线网络技术（北京）有限公司 信息显示系统、方法和装置
CN107085611A (zh) * 2017-05-14 2017-08-22 深圳游视虚拟现实技术有限公司 一种虚拟现实游戏视频分享方法

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8730156B2 (en) * 2010-03-05 2014-05-20 Sony Computer Entertainment America Llc Maintaining multiple views on a shared stable virtual space
JP4935345B2 (ja) * 2006-12-25 2012-05-23 ソニー株式会社 コンテンツ再生システム、再生装置、再生制御方法及びプログラム
KR101195885B1 (ko) * 2008-03-03 2012-10-30 삼성전자주식회사 무선 오디오 출력장치 및 이를 포함하는 무선 오디오출력시스템과 이의 제어방법
KR101306288B1 (ko) * 2010-09-30 2013-09-09 주식회사 팬택 가상 객체를 이용한 증강 현실 제공 장치 및 방법
CN103257813B (zh) * 2012-02-21 2017-12-22 海尔集团公司 一种共享设备的确定方法和文件传输方法以及系统
CN102650906B (zh) * 2012-04-06 2015-11-04 深圳创维数字技术有限公司 一种用户界面的控制方法及装置
KR101491045B1 (ko) * 2013-09-25 2015-02-10 주식회사 픽스트리 컨텐츠 공유 장치 및 방법
CN103488356B (zh) * 2013-10-18 2016-02-24 武汉拓宝科技股份有限公司 一种基于红外摄像头三维成像的触摸识别方法
CN106034114A (zh) * 2015-03-12 2016-10-19 腾讯科技（深圳）有限公司 多媒体信息分享方法及装置
CN105872723A (zh) * 2015-12-28 2016-08-17 乐视致新电子科技（天津）有限公司 基于虚拟现实系统的视频分享方法及装置
WO2017143303A1 (en) * 2016-02-17 2017-08-24 Meta Company Apparatuses, methods and systems for sharing virtual elements
KR20170097980A (ko) * 2016-02-19 2017-08-29 삼성전자주식회사 전자 장치의 컨텐트 그룹 공유 방법 및 그 전자 장치
CN105610868B (zh) * 2016-03-03 2019-08-06 腾讯科技（深圳）有限公司 一种信息交互的方法、设备及系统
CN105955461A (zh) * 2016-04-25 2016-09-21 乐视控股（北京）有限公司 一种交互界面管理方法和系统
CN105892686B (zh) * 2016-05-05 2018-10-09 刘昊 一种3d虚拟现实广播交互方法及系统
US10250720B2 (en) * 2016-05-05 2019-04-02 Google Llc Sharing in an augmented and/or virtual reality environment
CN106385587B (zh) * 2016-09-14 2019-08-02 三星电子（中国）研发中心 分享虚拟现实视角的方法、装置及系统
CN106973330B (zh) * 2017-03-20 2021-03-02 腾讯科技（深圳）有限公司 一种屏幕直播方法、装置和系统
CN107168530A (zh) * 2017-04-26 2017-09-15 腾讯科技（深圳）有限公司 虚拟场景中的对象处理方法和装置

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140080592A1 (en) * 2007-12-10 2014-03-20 Gary Stephen Shuster Guest management in an online multiplayer virtual reality game
CN105898694A (zh) * 2016-04-06 2016-08-24 众景视界（北京）科技有限公司 用于定位及信息交互的方法、头戴式可视设备及服务器
CN106358090A (zh) * 2016-08-26 2017-01-25 腾讯科技（深圳）有限公司 虚拟现实视频播放方法和装置、视频投射方法和装置
CN106790553A (zh) * 2016-12-24 2017-05-31 珠海市魅族科技有限公司 虚拟现实设备的界面共享方法和装置
CN106791699A (zh) * 2017-01-18 2017-05-31 北京爱情说科技有限公司 一种远程头戴交互式视频共享系统
CN107085611A (zh) * 2017-05-14 2017-08-22 深圳游视虚拟现实技术有限公司 一种虚拟现实游戏视频分享方法
CN106941538A (zh) * 2017-05-15 2017-07-11 百度在线网络技术（北京）有限公司 信息显示系统、方法和装置

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112218145A (zh) * 2020-10-15 2021-01-12 聚好看科技股份有限公司 智能电视、vr显示设备以及相关方法
CN114942812A (zh) * 2022-05-31 2022-08-26 上海嘉车信息科技有限公司 多媒体信息共享方法、装置和电子设备
CN114942812B (zh) * 2022-05-31 2024-04-30 上海嘉车信息科技有限公司 多媒体信息共享方法、装置和电子设备

Also Published As

Publication number Publication date
CN109644181A (zh) 2019-04-16
US10965783B2 (en) 2021-03-30
US20200259931A1 (en) 2020-08-13
CN109644181B (zh) 2021-02-26

Similar Documents

Publication Publication Date Title
WO2019127349A1 (zh) 一种多媒体信息分享的方法、相关装置及系统
US11178448B2 (en) Method, apparatus for processing video, electronic device and computer-readable storage medium
CN107852573B (zh) 混合现实社交交互
US7290216B1 (en) Method and apparatus for implementing a scene-graph-aware user interface manager
CN111414225B (zh) 三维模型远程展示方法、第一终端、电子设备及存储介质
JP4901261B2 (ja) 高品質なユーザーインターフェイスによる効率的な遠隔表示を行なうシステム
WO2019127369A1 (zh) 一种直播分享的方法、相关设备及系统
US20140337792A1 (en) Display apparatus and user interface screen providing method thereof
GB2590545A (en) Video photographing method and apparatus, electronic device and computer readable storage medium
WO2019105274A1 (zh) 媒体内容的展示方法、装置、计算设备及存储介质
US20150012831A1 (en) Systems and methods for sharing graphical user interfaces between multiple computers
WO2018076939A1 (zh) 视频文件的处理方法和装置
EP3076647B1 (en) Techniques for sharing real-time content between multiple endpoints
CN111131850A (zh) 显示虚拟礼物特效的方法、装置及电子设备
CN103854200A (zh) 移动互联网内容资源的推广系统及方法
CN108259923B (zh) 一种视频直播方法、系统及设备
KR102566276B1 (ko) 원격 단말을 위한 몰입형 원격 회의 및 텔레프레즌스를 위한 오버레이 처리용 파라미터
CN110710203B (zh) 用于生成和渲染沉浸式视频内容的方法、系统和介质
JP6975370B1 (ja) 画像表示方法、プログラム及びデータ生成方法
WO2024027611A1 (zh) 视频直播方法、装置、电子设备以及存储介质
WO2023071630A1 (zh) 基于增强显示的信息交互方法、装置、设备和介质
JP6224465B2 (ja) 映像配信システム、映像配信方法及び映像配信プログラム
KR20180104915A (ko) 3차원 가상공간 애니메이션 구현 시스템
JP7419529B2 (ja) 遠隔端末のための没入型テレカンファレンス及びテレプレゼンスのインタラクティブオーバーレイ処理
KR102674102B1 (ko) 비주얼 네트워크 서비스 처리 방법 및 장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17935964

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17935964

Country of ref document: EP

Kind code of ref document: A1