CN109561333A - Video broadcasting method, device, storage medium and computer equipment - Google Patents

Video broadcasting method, device, storage medium and computer equipment Download PDF

Info

Publication number
CN109561333A
CN109561333A CN201710890314.7A CN201710890314A CN109561333A CN 109561333 A CN109561333 A CN 109561333A CN 201710890314 A CN201710890314 A CN 201710890314A CN 109561333 A CN109561333 A CN 109561333A
Authority
CN
China
Prior art keywords
virtual reality
interface
dimensional image
projection
reality device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710890314.7A
Other languages
Chinese (zh)
Other versions
CN109561333B (en
Inventor
艾立超
颜正浩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201710890314.7A priority Critical patent/CN109561333B/en
Publication of CN109561333A publication Critical patent/CN109561333A/en
Application granted granted Critical
Publication of CN109561333B publication Critical patent/CN109561333B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H04N21/43637—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment

Abstract

The present invention relates to a kind of video broadcasting method, device, storage medium and computer equipments, this method comprises: obtaining the control instruction of the operation display interface in reality environment；In response to the control instruction, the two dimensional image of the operation interface is obtained；The two dimensional image is projected as to the pseudo operation interface in reality environment；Obtain the switching command by the pseudo operation changing interface to virtual reality video pictures；It reads virtual reality video pictures specified by the switching command and exports.Scheme provided by the present application improves the video playing efficiency under reality environment.

Description

Video broadcasting method, device, storage medium and computer equipment
Technical field
The present invention relates to field of computer technology, more particularly to a kind of video broadcasting method, device, storage medium and meter Calculate machine equipment.
Background technique
With the development of computer technology and internet, virtual reality (VR, Virtual Reality) technology is forced by it It really experiences and good interactivity, it is more and more favored by the majority of users.What more and more users' using terminal provided VR viewing mode watches video, and to stay indoors can enjoy result of broadcast on the spot in person.
However, user needs manually in selection or Switch Video in reality in traditional this video display process Selection or handover operation are carried out in the operation interface of scene, after the terminal for providing video responds operation broadcasting video, then Video is watched by virtual reality device, leads to video playing low efficiency.
Summary of the invention
Based on this, it is necessary to for the low problem of control efficiency of video playing in traditional technology, provide a kind of video playing Method, apparatus, storage medium and computer equipment.
A kind of video broadcasting method, comprising:
Obtain the control instruction of the operation display interface in reality environment；
In response to the control instruction, the two dimensional image of the operation interface is obtained；
The two dimensional image is projected as to the pseudo operation interface in reality environment；
Obtain the switching command by the pseudo operation changing interface to virtual reality video pictures；
It reads virtual reality video pictures specified by the switching command and exports.
A kind of video play device, comprising:
Module is obtained, for obtaining the control instruction of the operation display interface in reality environment；
Respond module, for obtaining the two dimensional image of the operation interface in response to the control instruction；
Projection module, the pseudo operation interface for being projected as the two dimensional image in reality environment；
Switching module, for obtaining by the switching command of the pseudo operation changing interface to virtual reality video pictures；
Output module, for reading virtual reality video pictures specified by the switching command and exporting.
A kind of computer readable storage medium is stored with computer program on the computer readable storage medium, described When computer program is executed by processor, so that the processor executes following steps:
Obtain the control instruction of the operation display interface in reality environment；
In response to the control instruction, the two dimensional image of the operation interface is obtained；
The two dimensional image is projected as to the pseudo operation interface in reality environment；
Obtain the switching command by the pseudo operation changing interface to virtual reality video pictures；
It reads virtual reality video pictures specified by the switching command and exports.
A kind of computer equipment, including memory and processor store computer program, the meter in the memory When calculation machine program is executed by the processor, so that the processor executes following steps:
Obtain the control instruction of the operation display interface in reality environment；
In response to the control instruction, the two dimensional image of the operation interface is obtained；
The two dimensional image is projected as to the pseudo operation interface in reality environment；
Obtain the switching command by the pseudo operation changing interface to virtual reality video pictures；
It reads virtual reality video pictures specified by the switching command and exports.
Above-mentioned video broadcasting method, device, storage medium and computer equipment are shown in reality environment getting After showing the control instruction of operation interface, the two dimensional image that the control instruction obtains operation interface is corresponded directly to, by operation interface It is projected as the pseudo operation interface in reality environment, to virtually be virtual existing by the operation interface interacted with user Pseudo operation interface in real environment, and then referred to obtaining by the switching of pseudo operation changing interface to virtual reality video pictures When enabling, virtual reality video pictures specified by switching command can be directly read and exported, realized under reality environment Broadcasting control and video-see, avoid the need for being selected or being switched on true operation interface manually and introduced numerous Trivial operating process improves the efficiency of video playing.
Detailed description of the invention
Fig. 1 is the applied environment figure of video broadcasting method in one embodiment；
Fig. 2 is the flow diagram of video broadcasting method in one embodiment；
Fig. 3 is the interface schematic diagram of operation interface in one embodiment；
Fig. 4 is the schematic diagram of screen switching in reality environment in one embodiment；
Fig. 5 is the schematic diagram that pseudo operation interface updates in reality environment in one embodiment；
Fig. 6 is the flow diagram of video broadcasting method in another embodiment；
Fig. 7 is the timing diagram of video display process in one embodiment；
Fig. 8 is the structural block diagram of video play device in one embodiment；
Fig. 9 is the structural block diagram of video play device in another embodiment；
Figure 10 is the structural block diagram of video play device in another embodiment；
Figure 11 is the structural block diagram of video play device in further embodiment；
Figure 12 is the internal structure chart of computer equipment in one embodiment.
Specific embodiment
In order to make the objectives, technical solutions, and advantages of the present invention clearer, with reference to the accompanying drawings and embodiments, right The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and It is not used in the restriction present invention.
Fig. 1 is the applied environment figure of video broadcasting method in one embodiment.Referring to Fig.1, the video broadcasting method application In audio/video player system.The audio/video player system includes computer equipment 110, virtual reality device 120 and stereo projecting equipment 130.Wherein, computer equipment 110 can be the electronics dress of the playable video such as personal computer, TV or tablet computer It sets.Virtual reality device 120 can be virtual reality head-mounted display apparatus, such as VR glasses or VR eyeshade.Stereoprojection Equipment 130 can be the electronic device that projector etc. can be projected.Computer equipment 110, virtual reality device 120 and solid It is connected with each other between projection device 130.The connection type of equipment room specifically can be network connection, such as ZigBee connection, It can be bluetooth connection etc..
Computer equipment 110 obtains in reality environment for executing the video broadcasting method, computer equipment 110 The control instruction of operation display interface obtains the two dimensional image of operation interface in response to the control instruction, which is thrown Shadow is the pseudo operation interface in reality environment.Computer equipment 110 can be obtained again by pseudo operation changing interface to void The switching command of quasi- reality video pictures, and then read virtual reality video pictures specified by the switching command and export.Its In, two dimensional image is projected as the pseudo operation interface in reality environment process can also by stereo projecting equipment 130 It executes.Virtual reality device 120 can be used for showing that pseudo operation interface and virtual reality video in reality environment are drawn Face.
Fig. 2 is the flow diagram of video broadcasting method in one embodiment.The present embodiment is mainly applied in this way Computer equipment 110 in above-mentioned Fig. 1 illustrates.Referring to Fig. 2, which specifically comprises the following steps:
S202 obtains the control instruction of the operation display interface in reality environment.
Wherein, control instruction is the computer program that specified operation is executed for controlling computer equipment.In the present embodiment In, which is specifically used for control computer equipment and executes the operation display interface in reality environment.Virtual reality Environment is the three-dimensional virtual scene generated by computer equipment.Two-dimensional picture can be virtually reality environment by computer equipment In threedimensional model.Operation interface is the human-computer interaction interface that can receive action event.Operation interface specifically can be computer The system interface of equipment is also possible to run on the application interface of the virtual reality applications in computer equipment.
Specifically, the detectable predefined trigger action for operation interface of computer equipment, is detecting the triggering The control instruction of the operation display interface in reality environment accordingly is triggered when operation.Trigger action can be in interface The operation of control, such as to the touch control operation of control or cursor clicking operation etc..Trigger action is also possible to predefined The click of physical button, the shaking operation perhaps triggered in operation display interface or is triggered in operation display interface Voice signal input operation etc..
Fig. 3 shows the interface schematic diagram of operation interface in one embodiment.Referring to Fig. 3, which includes available Video content 310, function menu 320, control instruction trigger control 330.The computer equipment for carrying the interface may also include Control instruction trigger button 340.The detectable trigger action for control instruction trigger control 330 of computer equipment, Huo Zhejian Trigger control 330 or control instruction triggering is broadcast live to the clicking operation of control instruction trigger button 340 in stylus when the user clicks When button 340, computer equipment will acquire the control instruction of the operation display interface in reality environment.
In one embodiment, the control instruction of the operation display interface in reality environment is obtained, comprising: detection is handed over Mutual event；Extract the interaction parameter of alternative events；When the control of interaction parameter and the operation display interface in reality environment Instruction then triggers control instruction there are when mapping relations.
Wherein, alternative events are the events for interacting with computer equipment.Alternative events specifically can be voice Alternative events or movement alternative events etc..Interaction parameter is to reflect the parameter of specific interaction content.The friendship of interactive voice event Mutual parameter specifically can be voice content, and the interaction parameter for acting alternative events specifically can be movement locus.
Specifically, computer equipment can pre-establish the mapping relations between interaction parameter and computer instruction, to examine Alternative events are measured, and after extracting interaction parameter in alternative events, triggers corresponding computer instruction according to the mapping relations. Computer instruction is the computer program for instructing computer to execute specific operation.Computer instruction, such as in reality environment The control instruction of middle operation display interface, or by pseudo operation changing interface to the switching command of virtual reality video pictures Deng.The mapping relations specifically can be mapping relations between movement locus and computer instruction and voice content and computer Mapping relations between instruction.For example, the movement locus to be formed will be moved from left to right and show behaviour in reality environment The control instruction for making interface establishes mapping relations, or by voice content " display pseudo operation interface " and in reality environment The control instruction of middle operation display interface establishes mapping relations etc..
Computer equipment can acquire voice data by voice collection device, be identified to obtain to the voice data corresponding Voice content, and then according between the obtained voice content of identification and the voice content and computer instruction that pre-establish Mapping relations, there are the computer instructions of mapping relations with the voice content for lookup, to trigger the computer instruction.In this reality It applies in example, when the control instruction of the voice content and the operation display interface in reality environment is there are when mapping relations, then Trigger control instruction.
Computer equipment can also be by image acquisition device user-picture frames, with being schemed according to collected acquisition user As frame determines the motion profile of reference target, and then according to determining motion profile and the motion profile pre-established and calculating Mapping relations between machine instruction, there are the computer instructions of mapping relations with the motion profile for lookup, to trigger the calculating Machine instruction.In the present embodiment, when the control instruction of the motion profile and the operation display interface in reality environment exists When mapping relations, then control instruction is triggered.Wherein, reference target is the previously selected object for being used as reference, such as user Right-hand man or head etc..
In the present embodiment, corresponding instruction response is carried out by the alternative events of detection user's triggering, it is simple and fast, it mentions High user obtains the efficiency of information.
S204 obtains the two dimensional image of operation interface in response to control instruction.
Wherein, two dimensional image is the flat image not comprising depth information.Specifically, computer equipment is being got in void In quasi- actual environment when the control instruction of operation display interface, the screenshot instruction for the operation interface currently shown can trigger, And then instructed according to the screenshot, screenshot movement is carried out to currently displayed operation interface, obtains corresponding two dimensional image.It calculates Machine equipment can also obtain the operation currently shown when getting the control instruction of operation display interface in reality environment The interface data at interface generates the two dimensional image of the operation interface currently shown according to the interface data of acquisition.
Two dimensional image is projected as the pseudo operation interface in reality environment by S206.
Wherein, pseudo operation interface is that each operability object in two-dimensional operation interface is carried out visualization processing Obtain three dimensional virtual models.In one embodiment, three dimensional virtual models can the form of expression of operation object can be three-dimensional Button, slider bar and pull rod etc..For example, can realize that volume adjustment, progress are adjusted by the sliding block on mobile slider bar With the interactive functions such as position is mobile.
Specifically, two dimensional image can be converted to projectable directly according to preset image conversion regime by computer equipment For the intermediate image of threedimensional model, which is then projected as to the pseudo operation interface in reality environment.Wherein, Preset image conversion regime is used to generate the intermediate image of the picture format of virtual reality picture according to two dimensional image.It is virtual existing The picture format of real picture can be divided into the picture format of upper and lower picture and the picture format of left and right picture according to picture position, press The picture format of panorama, the picture format of half panorama and the picture format of field of excursion can be divided into according to field range.
Two dimensional image can be also sent to server by computer equipment, so that server is after receiving the two dimensional image, According to preset image conversion regime, two dimensional image is converted into projectable and is the intermediate image of threedimensional model, then will converted To intermediate image be sent to computer equipment, received by computer equipment.
S208 is obtained by pseudo operation changing interface to the switching command of virtual reality video pictures.
Wherein, switching command is the computer program that screen switching operation is executed for controlling computer equipment.In this reality It applies in example, switching command specifically can be control computer equipment and execute the picture from pseudo operation changing interface to virtual reality video Face.
Specifically, computer equipment can detect alternative events and extract the friendship of the alternative events after detecting alternative events Mutual parameter, and then inquire the mapping relations between the interaction parameter pre-established and computer instruction.When from currently detected The interaction parameter extracted in alternative events, with the switching command presence by pseudo operation changing interface to virtual reality video pictures When mapping relations, then switching command is triggered.
S210 reads virtual reality video pictures specified by switching command and exports.
Wherein, virtual reality video pictures are the video pictures shown in virtual reality scenario.Virtual reality video pictures From the format of video be the video format for being used to form virtual reality picture.Virtual reality video format is according to picture position Picture virtual reality video format and left and right picture virtual reality video format up and down can be divided into, can be divided into according to field range Panoramic virtual reality video format, half panoramic virtual reality video format and field of excursion virtual reality video format.
Specifically, computer equipment can extract video identifier to be played from switching command.Video identifier is for identifying The content of video out, same video identifier can correspond to multiple same source videos.Refer to that content is identical but in coding mode with source video Or the video being had differences in image procossing mode.Effect is presented in data volume size or image between multiple same source videos On have differences.For example, the video resource of virtual reality video format and the view of common video formats may be present in the same video Frequency resource.
Computer equipment can be in local according to the video identifier of extraction and the virtual reality video format positioning video of default File, and then get video file to be played.Video identifier can be also sent to server by computer equipment, and will regarded When frequency marking knowledge is sent to server, virtual reality video format is specified, so that server is according to the video identifier and specified void Quasi- reality video format positioning video file, and the video file is formed into video stream to computer equipment, by computer Equipment receives.Server can also be according to the virtual reality video format positioning video text of the video identifier and default received Part, and then the video file is formed into video stream to computer equipment, it is received by computer equipment.
Specifically, the video flowing of virtual reality video format may include left-eye video stream and right-eye video stream, computer Equipment can play left-eye video stream is synchronous with right-eye video stream frame by frame.By the eyeglass that computer equipment is internal or external, use Family can watch the visual effect similar to scenery in reality scene.
For example, Fig. 4 shows the schematic diagram at the pseudo operation interface in one embodiment in reality environment.Ginseng Examine Fig. 4, the pseudo operation interface 410 that computer equipment is shown in reality environment.It is logical that computer equipment can detect user The alternative events for crossing gesture trigger, when the interaction parameter in alternative events and by pseudo operation changing interface to virtual reality video The switching command of picture then triggers switching command there are when mapping relations, switches to virtual reality video pictures 420.
Above-mentioned video broadcasting method is being got in reality environment after the control instruction of operation display interface, directly The two dimensional image for obtaining operation interface in response to the control instruction is connect, operation interface is projected as virtual in reality environment Operation interface, thus be virtually the pseudo operation interface in reality environment by the operation interface interacted with user, into And when obtaining the switching command by pseudo operation changing interface to virtual reality video pictures, switching command can be directly read Specified virtual reality video pictures simultaneously export, and realize the broadcasting control under reality environment and video-see, avoid The troublesome operation process for manually being selected or being switched on true operation interface and introduced is needed, video playing is improved Efficiency.
In one embodiment, after two dimensional image being projected as the pseudo operation interface in reality environment, the view Frequency playback method further include: send and notify to virtual reality device, received so that virtual reality device opens projection according to notice Mode, and the pseudo operation interface in the case where projecting reception pattern in displaying reality environment.
Wherein, virtual reality device can be virtual reality head-mounted display apparatus, such as VR glasses or VR eyeshade.It is logical Know for informing that virtual reality device opens the notice of projection reception pattern.Notice can be the notice for carrying instruction, can also To be only the signal for having arranged instruction.
If notice is when carrying the notice of instruction, can be sent out by form of message or document form by computer equipment It send.After virtual reality device receives notice, the instruction carried in parsing notice, thus according to instruction execution corresponding operation, Such as it is turned on or off projection reception pattern.If notice is the signal for having arranged instruction, virtual reality device is being detected Agreement instruction corresponding operation is executed when signal, for example updates the state of Current projection reception pattern.That is, if virtual reality device When being currently at the state for opening projection reception pattern, projection reception pattern is closed immediately when receiving notice；If virtual existing When real equipment is currently at the state for closing projection reception pattern, projection reception pattern is opened immediately when receiving notice.
Projection reception pattern is the shadow signal reception state that virtual reality device is realized by physical hardware.Virtual reality Equipment can receive the optical projection that computer equipment is formed by physical optics mode in the case where projecting reception pattern.For example, calculating Machine equipment is projected two dimensional image to VR glasses by physical optics mode, the pseudo operation being imaged as in reality environment Interface, user can watch the visual effect similar to scenery in reality scene.
Virtual reality device needs to show the pseudo operation interface in reality environment in projection reception pattern.It lifts Example explanation, is projected as the pseudo operation interface in reality environment for two dimensional image by polarization mode, is by two dimensional image It is projected under orthogonal two kinds of polarization constraints respectively, projection obtains left-eye image and eye image, Jin Er respectively Polarization constraints when obtaining left-eye image with projection are added when virtual reality device receives left-eye image, are connect in virtual reality device Addition can then be watched with polarization constraints when obtaining eye image, user is projected by virtual reality device when receiving eye image To the visual effect for being similar to scenery in reality scene.
It specifically, can after two dimensional image is projected as the pseudo operation interface in reality environment by computer equipment It sends to carry to virtual reality device and opens the notice that projection reception pattern instructs, so that virtual reality device is opened according to notice Reception pattern is projected, and shows the pseudo operation interface in reality environment in the case where projecting reception pattern.Computer equipment The notification signal for being used to open projection reception pattern that agreement can be sent to virtual reality device, so that virtual reality device is being examined Projection reception pattern is opened after measuring the notification signal, and shows the virtual behaviour in reality environment in the case where projecting reception pattern Make interface.
In the present embodiment, after the completion of projection, virtual reality device is notified to open projection reception pattern, Jin Ertong in time It crosses virtual reality device and shows pseudo operation interface in reality environment in the case where projecting reception pattern, so that pseudo operation circle The displaying in face is more acurrate, and virtual reality scenario sense is stronger.
In one embodiment, virtual reality video pictures specified by switching command are read and are exported, comprising: reading is cut Change the virtual reality video pictures of instruction；Virtual reality video pictures are transferred to virtual reality device, so that virtually Real world devices close projection reception pattern, and show virtual reality video pictures after closing projection reception pattern.
Specifically, computer equipment, can be asynchronous to void when reading virtual reality video pictures specified by switching command Quasi- real world devices send the notice for carrying and closing projection reception pattern instruction, so that virtual reality device closes projection according to notice Reception pattern, and prepare to receive the virtual reality video pictures that computer equipment is transmitted after closing projection reception pattern.
Computer equipment, can also be asynchronous to virtual reality when reading virtual reality video pictures specified by switching command Equipment sends the notification signal for being used to close projection reception pattern of agreement, so that virtual reality device is detecting notice letter Projection reception pattern is closed after number, and preparation receives the virtual reality view of computer equipment transmitting after closing projection reception pattern Frequency picture.
Computer equipment can also be after reading virtual reality video pictures specified by switching command, directly by virtual reality Video pictures are transferred to virtual reality device.Virtual reality device can arrange according to prior pact, receive virtual reality view Projection reception pattern is closed when frequency picture immediately, and shows virtual reality video pictures after closing projection reception pattern.
Virtual reality video pictures may include left eye virtual reality video pictures and right eye virtual reality video pictures, void Quasi- real world devices show the left eye virtual reality video of same frame video pictures after receiving virtual reality video pictures Picture and right eye virtual reality video pictures are appeared similar to existing by the vision difference of two frame virtual reality video pictures The visual effect of scenery in real field scape.
For example, VR glasses in virtual reality device after receiving virtual reality video pictures, by same frame video The left eye virtual reality video pictures and right eye virtual reality video pictures of picture, while rendering on the eyeglass of left and right, pass through two The vision difference of frame virtual reality video pictures, makes user see the visual effect similar to scenery in reality scene.
In the present embodiment, after reading virtual reality video pictures specified by switching command, notice is virtual existing in time Real equipment closes projection reception pattern, and then virtual reality view is shown after closing projection reception pattern by virtual reality device Frequency picture, so that virtual reality video pictures are accurately shown much sooner, virtual reality scenario sense is stronger.
In one embodiment, the control instruction of the operation display interface in reality environment is obtained, comprising: when virtual When real world devices detect alternative events, the interaction parameter extracted in the slave alternative events that virtual reality device is sent is received；When There are when mapping relations, then trigger control to refer to for the control instruction of operation display interface in reality environment for interaction parameter It enables.
Specifically, virtual reality device can carry out movement alternative events detection by built-in sensor.Built-in sensing Device can be, but not limited to include the sensors such as gyroscope, accelerometer, gravity sensor or sonic transducer.Utilize these sensings Device detects the movement of user, when user rotates or is mobile, when can detecte the rotational angle or translation displacements of user, It detects movement alternative events, extracts the movement interaction parameter in the movement alternative events.Virtual reality device can also pass through sound Sound acquisition device acquires voice data, to detect interactive voice event.After collecting voice data, which is carried out Identification obtains corresponding interactive voice parameter.
Further, virtual reality device from the alternative events detected extract interaction parameter after, by the friendship of extraction Mutual parameter is sent to computer equipment.Computer equipment after receiving interaction parameter, search the interaction parameter that pre-establishes with Mapping relations between computer instruction.If the interaction parameter being currently received and the operation display interface in reality environment Control instruction there are mapping relations, then trigger control instruction.
In the present embodiment, it provides and the approach that alternative events respond come triggering command is detected by virtual reality device, The mode of detection alternative events is enriched, is intended to so as to respond user in time, shows that user is intended to the picture of viewing.
In one embodiment, it sends and notifies to virtual reality device, thrown so that virtual reality device is opened according to notice Shadow reception pattern, and before the pseudo operation interface in the case where projecting reception pattern in displaying reality environment, method further include: Connection, which is sent, to virtual reality device prepares message；It obtains virtual reality device and prepares the ready of message feedback for connection Notice；Request is initiated the connection to virtual reality device according to Notice of Readiness；Virtual reality device is received to ask in response to connection The confirmation message of return is sought, to establish connection with virtual reality device.
Wherein, it is the number for notifying virtual reality device to prepare to establish connection with computer equipment that connection, which prepares message, According to.Connection, which prepares message, can be the data for carrying connection preparation instruction, can also be only to have arranged to connect preparation instruction Signal.Notice of Readiness is for notifying computer equipment, and virtual reality device is ready for establishing the data of connection.Connection is asked It asks for requesting virtual reality device and computer equipment to establish connection.Confirmation message is for notifying computer equipment, virtually Real world devices have confirmed that the data for establishing connection.It is returned in response to connection request in computer equipment receiving virtual reality device When the confirmation message returned, the connection between computer equipment and virtual reality device is just successfully established.
Connection between computer equipment and virtual reality device can be network-based connection, be also possible to short distance Radio connection mode.In the present embodiment, the connection between computer equipment and virtual reality device specifically can be bluetooth Connection or ZigBee connection.Bluetooth technology is current using very extensive.ZigBee is then due to its low-power consumption and low cost Feature also has great advantage for the interconnection of family's Internet of Things.
Specifically, computer equipment can start link block (bluetooth module or ZigBee module), set to virtual reality Preparation send connection to prepare message.After virtual reality device receives connection preparation message by link block, which is prepared Message is handled, and prepares the connection established between computer equipment, and feed back Notice of Readiness.Computer equipment is connecing After receiving Notice of Readiness, request can be initiated the connection to virtual reality device.Virtual reality device is asked in response to the connection Detection confirmation operation is sought, confirmation message is generated after detecting confirmation operation, to establish connection with computer equipment.
It in the present embodiment, include preparing connection procedure and formal connection procedure two with the connection procedure of virtual reality device A stage, it is ensured that the accuracy of connection.
In one embodiment, two dimensional image is projected as to the pseudo operation interface in reality environment, comprising: by two Dimension image be transferred to stereo projecting equipment so that stereo projecting equipment two dimensional image is projected as it is virtual in reality environment Operation interface；It receives the projection sent after stereo projecting equipment successfully projects two dimensional image successfully to feed back, be projected into basis Function, which feeds back to send to virtual reality device, to be notified.
Wherein, stereo projecting equipment is the electronic equipment for being projected two dimensional image by physical optics mode.Specifically Two dimensional image can be projected under orthogonal two kinds of polarization constraints respectively, be projected respectively by ground, stereo projecting equipment To left-eye image and eye image, by the vision difference of two field pictures, the vision of scenery in reality scene is appeared similar to Effect, projection obtain the pseudo operation interface in reality environment.
Stereo projecting equipment is projected to computer equipment transmission and is successfully fed back, with logical after successfully projecting two dimensional image Know that projection is completed in computer equipment stereo projecting equipment, notified so that computer equipment is sent to virtual reality device, So that virtual reality device opens projection reception pattern according to notice, and shows in reality environment in the case where projecting reception pattern Pseudo operation interface.
In the present embodiment, the pseudo operation being projected as two dimensional image by stereo projecting equipment in reality environment Interface, since stereo projecting equipment is the equipment for being exclusively used in being projected, so that the void in the reality environment that projection obtains Quasi- operation interface is more acurrate.Moreover, the projection success sent after receiving stereo projecting equipment and successfully projecting two dimensional image is anti- Feedback just sends notice according to project successfully to feed back to virtual reality device, enable virtual reality device in time and accurately Show pseudo operation interface.
In one embodiment, video broadcasting method further include: according to switching command, send and tie to stereo projecting equipment Beam projection notice；After receiving stereo projecting equipment and terminating feedback for the projection for terminating projection notice transmission, switching is read The virtual reality video pictures of instruction simultaneously export.
Specifically, in the present embodiment, switching command is for being virtual reality video picture by pseudo operation changing interface The computer instruction in face.It is understood that no longer needing for operation interface to be projected as at this time virtual in virtual reality scenario Operation interface, therefore, computer equipment is according to switching command, and sending to stereo projecting equipment terminates projection notice, so that three-dimensional Projection device terminates to project, and returns to projection end feedback to computer equipment.Computer equipment can receive three-dimensional throwing again After shadow equipment terminates feedback for the projection for terminating projection notice transmission, reads virtual reality video specified by switching command and draw Face simultaneously exports, to guarantee the normal output of virtual reality video pictures.
In the present embodiment, by operation interface projection process and virtual reality video display process, two are configured to mutually Independent process, and ensure accurate switching between two processes by way of notifying and feeding back, fault-tolerance is improved, in turn It ensure that going on smoothly for operation interface projection process and virtual reality video display process.
In one embodiment, video broadcasting method further include: obtain interface operation instruction；Execution refers to interface operation Enable corresponding interface operation；Obtain the two dimensional image of the operation interface updated after executing interface operation；By the two of acquisition Tieing up image reprojection is the pseudo operation interface in reality environment.
Specifically, the detectable predefined trigger action for operation interface of computer equipment, is detecting the triggering Corresponding interface operation instruction is triggered when operation.Trigger action can be the operation to control in interface, such as the touching to control Control operation or cursor clicking operation etc..Trigger action is also possible to the click to predefined physical button, or is showing The shaking operation triggered when operation interface, or the voice signal input operation triggered in operation display interface etc..
In one embodiment, computer equipment can detect alternative events, when detecting alternative events, extract interaction thing The interaction parameter of part then triggers control instruction when interaction parameter and interface operation are instructed there are when mapping relations.Specifically, it counts Voice data can be acquired by voice collection device by calculating machine equipment, and to detect interactive voice event, computer equipment can also pass through Image acquisition device image, with detection operation alternative events.
In one embodiment, virtual reality device can carry out movement alternative events detection, inspection by built-in sensor Movement alternative events are measured, the movement interaction parameter in the movement alternative events is extracted.Virtual reality device can also pass through sound Acquisition device acquires voice data, to detect interactive voice event.After collecting voice data, which is known Corresponding interactive voice parameter is not obtained.The interaction parameter of extraction can be sent to computer equipment again by virtual reality device, when Interaction parameter and interface operation are instructed there are when mapping relations, then trigger control instruction.
Specifically, computer equipment can execute boundary corresponding with interface operation instruction after obtaining interface operation instruction Face operation shows the operation interface after interface operation to update.Computer equipment can be triggered again for currently showing The screenshot of operation interface instructs, and then is instructed according to the screenshot, carries out screenshot movement to currently displayed operation interface, obtains Corresponding two dimensional image.Computer equipment can also obtain the interface data of the operation interface currently shown, according to the interface of acquisition Data generate the two dimensional image of the operation interface currently shown, so that the two dimensional image of acquisition is projected as virtual reality again again Pseudo operation interface in environment.
In above-described embodiment, the approach being updated to the pseudo operation interface in reality environment is provided, it will be true The interface more new change of real operation interface is reflected as the update at pseudo operation interface in reality environment in real time, and avoiding needs To be selected on true operation interface manually or switched and the troublesome operation process that introduces, improve the effect of Interface Control Rate.
For example, Fig. 5 is the schematic diagram that pseudo operation interface updates in reality environment in one embodiment.With reference to Fig. 5, the operation interface 511 of computer equipment are projected as the pseudo operation interface 521 in reality environment.Computer equipment can Interface operation instruction is detected, and then executes interface operation corresponding with interface operation instruction.Computer equipment can be obtained again and held The two dimensional image of acquisition is projected as virtually existing by the two dimensional image of the operation interface 512 updated after row interface operation again Pseudo operation interface 522 in real environment.
As shown in fig. 6, in a specific embodiment, the video broadcasting method specifically includes the following steps:
S602 sends connection to virtual reality device and prepares message；It obtains virtual reality device and prepares message for connection The Notice of Readiness of feedback；Request is initiated the connection to virtual reality device according to Notice of Readiness；Virtual reality is received to set The standby confirmation message returned in response to connection request, to establish connection with virtual reality device.
S604 receives the slave alternative events that virtual reality device is sent when virtual reality device detects alternative events The interaction parameter of middle extraction.
S606, in interaction parameter, there are mapping relations for the control instruction of operation display interface in reality environment When, trigger control instruction.
S608 obtains the two dimensional image of operation interface in response to control instruction.
Two dimensional image is transferred to stereo projecting equipment by S610, so that two dimensional image is projected as void by stereo projecting equipment Pseudo operation interface in quasi- actual environment；Receive the projection success sent after stereo projecting equipment successfully projects two dimensional image Feedback, with according to project successfully feed back to virtual reality device send notice.
S612 sends to virtual reality device and notifies, so that virtual reality device opens projection reception pattern according to notice, And the pseudo operation interface in reality environment is shown in the case where projecting reception pattern.
S614 receives the slave alternative events that virtual reality device is sent when virtual reality device detects alternative events The interaction parameter of middle extraction.
S616, judgement and interaction parameter there are corresponding relationship are drawn by pseudo operation changing interface to virtual reality video The switching command or interface operation in face instruct；If switching command, then go to step S618；It is instructed if interface operation, Then go to step S622.
S618, according to switching command, sending to stereo projecting equipment terminates projection notice, is receiving stereo projecting equipment After terminating feedback for the projection for terminating projection notice transmission, virtual reality video pictures specified by switching command are read.
Virtual reality video pictures are transferred to virtual reality device by S620, are connect so that virtual reality device closes projection Receipts mode, and virtual reality video pictures are shown after closing projection reception pattern.
S622 executes interface operation corresponding with interface operation instruction；Obtain what the update after executing interface operation obtained The two dimensional image of operation interface.
The two dimensional image of acquisition is transferred to stereo projecting equipment by S624, so that stereo projecting equipment is again by X-Y scheme As the pseudo operation interface being projected as in reality environment.
In the present embodiment, it is getting in reality environment after the control instruction of operation display interface, is directly ringing It should be in the two dimensional image of control instruction acquisition operation interface, pseudo operation operation interface being projected as in reality environment Interface, to virtually be the pseudo operation interface in reality environment, Jin Er by the operation interface interacted with user When obtaining the switching command by pseudo operation changing interface to virtual reality video pictures, switching command meaning can be directly read Fixed virtual reality video pictures simultaneously export, and realize the broadcasting control under reality environment and video-see, and avoiding needs To be selected on true operation interface manually or switched and the troublesome operation process that introduces, improve the effect of video playing Rate.Moreover, stereo projecting equipment is the equipment for being exclusively used in being projected, so that virtual in the reality environment that projection obtains Operation interface is more acurrate.And by showing virtual reality video pictures and pseudo operation interface after virtual reality device, so that Virtual reality scenario sense is stronger.
It should be understood that although each step in the flow chart of the various embodiments described above is successively shown according to the instruction of arrow Show, but these steps are not that the inevitable sequence according to arrow instruction successively executes.Unless expressly state otherwise herein, this There is no stringent sequences to limit for the execution of a little steps, these steps can execute in other order.Moreover, above-mentioned each implementation At least part step in example may include that perhaps these sub-steps of multiple stages or stage be not necessarily for multiple sub-steps It is to execute completion in synchronization, but can execute at different times, the execution sequence in these sub-steps or stage It is not necessarily and successively carries out, but can be at least part wheel of the sub-step or stage of other steps or other steps Stream alternately executes.
Fig. 7 shows the timing diagram of video display process in one embodiment.With reference to Fig. 7, computer equipment (TV box Son) link block (bluetooth module or ZigBee module) can be started, connection, which is sent, to virtual reality device (VR glasses) prepares Message.After virtual reality device receives connection preparation message by link block, message is prepared to the connection and is handled, it is quasi- The standby connection established between computer equipment, and feed back Notice of Readiness.Computer equipment is receiving ready lead to After knowing, request can be initiated the connection to virtual reality device.Virtual reality device detects confirmation operation in response to the connection request, Confirmation message is generated after detecting confirmation operation and is returned.To the company of foundation between computer equipment and virtual reality device It connects.Computer equipment (TV box) can establish connection between stereo projecting equipment in the same way again.
Virtual reality device detects alternative events, after detecting alternative events, extracts and hands over from the alternative events detected Mutual parameter, then the interaction parameter extracted is sent to computer equipment.Computer equipment is after receiving interaction parameter, inquiry Mapping relations between the interaction parameter pre-established and computer instruction, when interaction parameter is shown in reality environment The control instruction of operation interface triggers control instruction there are when mapping relations, and obtains operation interface in response to control instruction Two dimensional image.
The two dimensional image that computer equipment will acquire again is transferred to stereo projecting equipment.Stereo projecting equipment is in turn by two Tieing up image projection is the pseudo operation interface in reality environment, and is projected into projecting successfully backcasting machine equipment transmission Function feedback.Computer equipment sends to virtual reality device after receiving and projecting successfully feedback and opens projection reception pattern Notice.Virtual reality device opens projection reception pattern according to notice, and shows reality environment in the case where projecting reception pattern In pseudo operation interface.
Virtual reality device can detect alternative events again, after detecting alternative events, mention from the alternative events detected Interaction parameter is taken, then the interaction parameter extracted is sent to computer equipment.Computer equipment after receiving interaction parameter, The mapping relations between the interaction parameter pre-established and computer instruction are inquired, when interaction parameter is cut with by pseudo operation interface The switching commands of virtual reality video pictures is shifted to there are when mapping relations, triggering switching command, and in response to switching command to Stereo projecting equipment, which is sent, terminates projection notice.Computer equipment is receiving stereo projecting equipment for end projection notice hair After the projection sent terminates feedback, virtual reality video pictures specified by switching command are read, virtual reality video pictures are passed It is handed to virtual reality device, so that virtual reality device closes projection reception pattern, and is shown after closing projection reception pattern Virtual reality video pictures.
Computer equipment can also be instructed in interaction parameter and interface operation there are triggering interface operation instruction when mapping relations, Interface operation corresponding with interface operation instruction is executed, the two dimension of the operation interface updated after executing interface operation is obtained Image, then the two dimensional image of acquisition is transferred to stereo projecting equipment, so that stereo projecting equipment again projects two dimensional image For the pseudo operation interface in reality environment.
As shown in figure 8, in one embodiment, providing a kind of video play device 800.Referring to Fig. 8, the video playing Device 800 includes: to obtain module 801, respond module 802, projection module 803, switching module 804 and output module 805.
Module 801 is obtained, for obtaining the control instruction of the operation display interface in reality environment.
Respond module 802, for obtaining the two dimensional image of operation interface in response to control instruction.
Projection module 803, the pseudo operation interface for being projected as two dimensional image in reality environment.
Switching module 804, for obtaining the switching command by pseudo operation changing interface to virtual reality video pictures.
Output module 805, for reading virtual reality video pictures specified by switching command and exporting.
Above-mentioned video play device 800 is being got in reality environment after the control instruction of operation display interface, Correspond directly to the two dimensional image that the control instruction obtains operation interface, void operation interface being projected as in reality environment Quasi- operation interface, thus be virtually the pseudo operation interface in reality environment by the operation interface interacted with user, And then when obtaining the switching command by pseudo operation changing interface to virtual reality video pictures, switching can be directly read and referred to It enables specified virtual reality video pictures and exports, realize the broadcasting control under reality environment and video-see, keep away The troublesome operation process for needing to be selected or switched on true operation interface manually and introduced is exempted from, has improved video and broadcast The efficiency put.
As shown in figure 9, in one embodiment, video play device 800 further include: notification module 806.
Notification module 806 is notified for sending to virtual reality device, is thrown so that virtual reality device is opened according to notice Shadow reception pattern, and the pseudo operation interface in the case where projecting reception pattern in displaying reality environment.
In one embodiment, output module 805 is also used to read virtual reality video pictures specified by switching command； Virtual reality video pictures are transferred to virtual reality device, so that virtual reality device closes projection reception pattern, and are being closed Virtual reality video pictures are shown after closing projection reception pattern.
In one embodiment, it obtains module 801 to be also used to when virtual reality device detects alternative events, receive empty The interaction parameter extracted in the slave alternative events that quasi- real world devices are sent；Show when interaction parameter and in reality environment behaviour Make the control instruction at interface there are when mapping relations, then triggers control instruction.
As shown in Figure 10, in one embodiment, video play device 800 further include: link block 807.
Link block 807 prepares message for sending connection to virtual reality device；Virtual reality device is obtained for company Connect the Notice of Readiness for preparing message feedback；Request is initiated the connection to virtual reality device according to Notice of Readiness；It receives The confirmation message that virtual reality device is returned in response to connection request, to establish connection with virtual reality device.
In one embodiment, projection module 803 is also used to two dimensional image being transferred to stereo projecting equipment, so that three-dimensional Two dimensional image is projected as the pseudo operation interface in reality environment by projection device；Stereo projecting equipment is received by X-Y scheme As the projection that sends successfully is fed back after successfully projecting, to send notice according to project successfully to feed back to virtual reality device.
In one embodiment, output module 805 is also used to according to switching command, and sending to stereo projecting equipment terminates to throw Shadow notice；After receiving stereo projecting equipment and terminating feedback for the projection for terminating projection notice transmission, switching command is read Specified virtual reality video pictures simultaneously export.
In one embodiment, module 801 is obtained to be also used to detect alternative events；Extract the interaction parameter of alternative events； When there are when mapping relations, then trigger control to refer to for the control instruction of operation display interface in reality environment for interaction parameter It enables.
As shown in figure 11, in one embodiment, video play device 800 further include: update module 808.
Update module 808, for obtaining interface operation instruction；Execute interface operation corresponding with interface operation instruction；It obtains Obtain the two dimensional image of the operation interface updated after executing interface operation；The two dimensional image of acquisition is projected as virtually again Pseudo operation interface in actual environment.
Figure 12 shows the internal structure chart of computer equipment in one embodiment.As shown in figure 12, the computer equipment It include processor, memory, network interface, input unit and the display connected by system bus including the computer equipment Screen.Wherein, memory includes non-volatile memory medium and built-in storage.The non-volatile memory medium of the computer equipment is deposited Operating system is contained, computer program can be also stored with, when which is executed by processor, processor may make to realize Video broadcasting method.Computer program can also be stored in the built-in storage, when which is executed by processor, can be made It obtains processor and executes video broadcasting method.The display screen of computer equipment can be liquid crystal display or electric ink is shown Screen, the input unit of computer equipment can be the touch layer covered on display screen, be also possible to set on computer equipment shell Key, trace ball or the Trackpad set can also be external keyboard, Trackpad or mouse etc..Those skilled in the art can be with Understand, structure shown in Figure 12, only the block diagram of part-structure relevant to application scheme, is not constituted to the application The restriction for the computer equipment that scheme is applied thereon, specific computer equipment may include than as shown in the figure more or more Few component perhaps combines certain components or with different component layouts.
In one embodiment, video play device provided by the present application can be implemented as a kind of shape of computer program Formula, computer program can be run in computer equipment as shown in figure 12, and the non-volatile memory medium of computer equipment can Storage forms each program module of the video play device, for example, acquisition module 801 shown in Fig. 8, respond module 802, throwing Shadow module 803, switching module 804 and output module 805 etc..The computer program of each program module composition sets computer Step in the standby video broadcasting method for executing each embodiment of the application described in this specification.
For example, computer equipment shown in Figure 12 can pass through the acquisition mould in video play device 800 as shown in Figure 8 Block 801 obtains the control instruction of the operation display interface in reality environment.Referred to by respond module 802 in response to control It enables, obtains the two dimensional image of operation interface.Two dimensional image is projected as by projection module 803 virtual in reality environment Operation interface.It is obtained by switching module 804 by pseudo operation changing interface to the switching command of virtual reality video pictures.It is logical Output module 805 is crossed to read virtual reality video pictures specified by switching command and export.
In one embodiment, a kind of computer readable storage medium is provided, is deposited on the computer readable storage medium Computer program is contained, when which is executed by processor, so that processor executes following steps: obtaining virtually existing The control instruction of operation display interface in real environment；In response to control instruction, the two dimensional image of operation interface is obtained；By X-Y scheme As the pseudo operation interface being projected as in reality environment；It obtains by pseudo operation changing interface to virtual reality video pictures Switching command；It reads virtual reality video pictures specified by switching command and exports.
In one embodiment, which makes processor execution that two dimensional image is projected as reality environment In pseudo operation interface after, also execution following steps: to virtual reality device send notify so that virtual reality device root Projection reception pattern is opened according to notice, and shows the pseudo operation interface in reality environment in the case where projecting reception pattern.
In one embodiment, virtual reality video pictures specified by switching command are read and are exported, comprising: reading is cut Change the virtual reality video pictures of instruction；Virtual reality video pictures are transferred to virtual reality device, so that virtually Real world devices close projection reception pattern, and show virtual reality video pictures after closing projection reception pattern.
In one embodiment, the control instruction of the operation display interface in reality environment is obtained, comprising: when virtual When real world devices detect alternative events, the interaction parameter extracted in the slave alternative events that virtual reality device is sent is received；When There are when mapping relations, then trigger control to refer to for the control instruction of operation display interface in reality environment for interaction parameter It enables.
In one embodiment, which execute processor to virtual reality device transmission notice, so that Virtual reality device opens projection reception pattern according to notice, and the void in reality environment is shown in the case where projecting reception pattern Before quasi- operation interface, following steps are also executed: sending connection to virtual reality device and prepare message；Obtain virtual reality device Prepare the Notice of Readiness of message feedback for connection；It is initiated the connection and is asked to virtual reality device according to Notice of Readiness It asks；The confirmation message that virtual reality device is returned in response to connection request is received, to establish connection with virtual reality device.
In one embodiment, two dimensional image is projected as to the pseudo operation interface in reality environment, comprising: by two Dimension image be transferred to stereo projecting equipment so that stereo projecting equipment two dimensional image is projected as it is virtual in reality environment Operation interface；It receives the projection sent after stereo projecting equipment successfully projects two dimensional image successfully to feed back, be projected into basis Function, which feeds back to send to virtual reality device, to be notified.
In one embodiment, computer program also makes processor execute following steps: according to switching command, Xiang Liti Projection device, which is sent, terminates projection notice；Terminate instead receiving stereo projecting equipment for the projection that projection notice is sent is terminated After feedback, reads virtual reality video pictures specified by switching command and export.
In one embodiment, the control instruction of the operation display interface in reality environment is obtained, comprising: detection is handed over Mutual event；Extract the interaction parameter of alternative events；When the control of interaction parameter and the operation display interface in reality environment Instruction then triggers control instruction there are when mapping relations.
In one embodiment, computer program also makes processor execute following steps: obtaining interface operation instruction；It holds Row interface operation corresponding with interface operation instruction；Obtain the X-Y scheme of the operation interface updated after executing interface operation Picture；The two dimensional image of acquisition is projected as to the pseudo operation interface in reality environment again.
Above-mentioned storage medium is being got in reality environment after the control instruction of operation display interface, is directly rung It should be in the two dimensional image of control instruction acquisition operation interface, pseudo operation operation interface being projected as in reality environment Interface, to virtually be the pseudo operation interface in reality environment, Jin Er by the operation interface interacted with user When obtaining the switching command by pseudo operation changing interface to virtual reality video pictures, switching command meaning can be directly read Fixed virtual reality video pictures simultaneously export, and realize the broadcasting control under reality environment and video-see, and avoiding needs To be selected on true operation interface manually or switched and the troublesome operation process that introduces, improve the effect of video playing Rate.
In one embodiment, a kind of computer equipment, including memory and processor are provided, is stored in memory Computer program, when computer program is executed by processor, so that processor executes following steps: obtaining in reality environment The control instruction of middle operation display interface；In response to control instruction, the two dimensional image of operation interface is obtained；Two dimensional image is projected For the pseudo operation interface in reality environment；It obtains by pseudo operation changing interface to the switching of virtual reality video pictures Instruction；It reads virtual reality video pictures specified by switching command and exports.
In one embodiment, which makes processor execution that two dimensional image is projected as reality environment In pseudo operation interface after, also execution following steps: to virtual reality device send notify so that virtual reality device root Projection reception pattern is opened according to notice, and shows the pseudo operation interface in reality environment in the case where projecting reception pattern.
In one embodiment, virtual reality video pictures specified by switching command are read and are exported, comprising: reading is cut Change the virtual reality video pictures of instruction；Virtual reality video pictures are transferred to virtual reality device, so that virtually Real world devices close projection reception pattern, and show virtual reality video pictures after closing projection reception pattern.
In one embodiment, the control instruction of the operation display interface in reality environment is obtained, comprising: when virtual When real world devices detect alternative events, the interaction parameter extracted in the slave alternative events that virtual reality device is sent is received；When There are when mapping relations, then trigger control to refer to for the control instruction of operation display interface in reality environment for interaction parameter It enables.
In one embodiment, which execute processor to virtual reality device transmission notice, so that Virtual reality device opens projection reception pattern according to notice, and the void in reality environment is shown in the case where projecting reception pattern Before quasi- operation interface, following steps are also executed: sending connection to virtual reality device and prepare message；Obtain virtual reality device Prepare the Notice of Readiness of message feedback for connection；It is initiated the connection and is asked to virtual reality device according to Notice of Readiness It asks；The confirmation message that virtual reality device is returned in response to connection request is received, to establish connection with virtual reality device.
In one embodiment, two dimensional image is projected as to the pseudo operation interface in reality environment, comprising: by two Dimension image be transferred to stereo projecting equipment so that stereo projecting equipment two dimensional image is projected as it is virtual in reality environment Operation interface；It receives the projection sent after stereo projecting equipment successfully projects two dimensional image successfully to feed back, be projected into basis Function, which feeds back to send to virtual reality device, to be notified.
In one embodiment, computer program also makes processor execute following steps: according to switching command, Xiang Liti Projection device, which is sent, terminates projection notice；Terminate instead receiving stereo projecting equipment for the projection that projection notice is sent is terminated After feedback, reads virtual reality video pictures specified by switching command and export.
In one embodiment, the control instruction of the operation display interface in reality environment is obtained, comprising: detection is handed over Mutual event；Extract the interaction parameter of alternative events；When the control of interaction parameter and the operation display interface in reality environment Instruction then triggers control instruction there are when mapping relations.
In one embodiment, computer program also makes processor execute following steps: obtaining interface operation instruction；It holds Row interface operation corresponding with interface operation instruction；Obtain the X-Y scheme of the operation interface updated after executing interface operation Picture；The two dimensional image of acquisition is projected as to the pseudo operation interface in reality environment again.
Above-mentioned computer equipment is being got in reality environment after the control instruction of operation display interface, directly The two dimensional image of operation interface, virtual behaviour operation interface being projected as in reality environment are obtained in response to the control instruction Make interface, to virtually be the pseudo operation interface in reality environment by the operation interface interacted with user, in turn When obtaining the switching command by pseudo operation changing interface to virtual reality video pictures, switching command institute can be directly read Specified virtual reality video pictures simultaneously export, and realize the broadcasting control under reality environment and video-see, avoid The troublesome operation process for being selected or being switched on true operation interface manually and introduced is needed, video playing is improved Efficiency.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with Relevant hardware is instructed to complete by computer program, the program can be stored in a non-volatile computer and can be read In storage medium, the program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, provided herein Each embodiment used in any reference to memory, storage, database or other media, may each comprise non-volatile And/or volatile memory.Nonvolatile memory may include that read-only memory (ROM), programming ROM (PROM), electricity can be compiled Journey ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include random access memory (RAM) or external cache.By way of illustration and not limitation, RAM is available in many forms, such as static state RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) directly RAM (RDRAM), straight Connect memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM) etc..
Each technical characteristic of above embodiments can be combined arbitrarily, for simplicity of description, not to above-described embodiment In each technical characteristic it is all possible combination be all described, as long as however, the combination of these technical characteristics be not present lance Shield all should be considered as described in this specification.
Only several embodiments of the present invention are expressed for above embodiments, and the description thereof is more specific and detailed, but can not Therefore limitations on the scope of the patent of the present invention are interpreted as.It should be pointed out that for those of ordinary skill in the art, Without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to protection model of the invention It encloses.Therefore, the scope of protection of the patent of the invention shall be subject to the appended claims.

Claims (15)

1. a kind of video broadcasting method, comprising:
Obtain the control instruction of the operation display interface in reality environment；
In response to the control instruction, the two dimensional image of the operation interface is obtained；
The two dimensional image is projected as to the pseudo operation interface in reality environment；
Obtain the switching command by the pseudo operation changing interface to virtual reality video pictures；
It reads virtual reality video pictures specified by the switching command and exports.
2. the method according to claim 1, wherein described be projected as reality environment for the two dimensional image In pseudo operation interface after, the method also includes:
It sends and notifies to virtual reality device, so that the virtual reality device opens projection reception pattern according to the notice, And the pseudo operation interface in reality environment is shown under the projection reception pattern.
3. according to the method described in claim 2, it is characterized in that, described read virtual reality specified by the switching command Video pictures simultaneously export, comprising:
Read virtual reality video pictures specified by the switching command；
The virtual reality video pictures are transferred to the virtual reality device, so that the virtual reality device closes projection Reception pattern, and the virtual reality video pictures are shown after closing projection reception pattern.
4. according to the method described in claim 2, it is characterized in that, acquisition operation display interface in reality environment Control instruction, comprising:
When the virtual reality device detects alternative events, receive that the virtual reality device sends from the interactive thing The interaction parameter extracted in part；
When the interaction parameter in reality environment operation display interface control instruction there are when mapping relations, then touch Send out control instruction described.
5. according to the method described in claim 2, it is characterized in that, described send to virtual reality device notifies, so that described Virtual reality device opens projection reception pattern according to the notice, and virtual reality ring is shown under the projection reception pattern Before pseudo operation interface in border, the method also includes:
Connection, which is sent, to virtual reality device prepares message；
Obtain the Notice of Readiness that the virtual reality device prepares message feedback for the connection；
Request is initiated the connection to the virtual reality device according to the Notice of Readiness；
Receive the confirmation message that the virtual reality device is returned in response to the connection request, with the virtual reality device Establish connection.
6. according to the method described in claim 2, it is characterized in that, described be projected as reality environment for the two dimensional image In pseudo operation interface, comprising:
The two dimensional image is transferred to stereo projecting equipment, so that the two dimensional image is projected as by the stereo projecting equipment Pseudo operation interface in reality environment；
It receives the projection sent after the stereo projecting equipment successfully projects the two dimensional image successfully to feed back, according to It projects successfully to feed back to send to virtual reality device and notify.
7. according to the method described in claim 6, it is characterized in that, the method also includes:
According to the switching command, Xiang Suoshu stereo projecting equipment, which is sent, terminates projection notice；
After receiving the stereo projecting equipment and terminating feedback for the projection for terminating projection notice transmission, described in reading Virtual reality video pictures specified by switching command simultaneously export.
8. the method according to claim 1, wherein acquisition operation display interface in reality environment Control instruction, comprising:
Detect alternative events；
Extract the interaction parameter of the alternative events；
When the interaction parameter in reality environment operation display interface control instruction there are when mapping relations, then touch Send out control instruction described.
9. method according to any one of claim 1 to 8, which is characterized in that the method also includes:
Obtain interface operation instruction；
Execute interface operation corresponding with interface operation instruction；
Obtain the two dimensional image of the operation interface updated after executing the interface operation；
The two dimensional image of acquisition is projected as to the pseudo operation interface in reality environment again.
10. a kind of video play device, comprising:
Module is obtained, for obtaining the control instruction of the operation display interface in reality environment；
Respond module, for obtaining the two dimensional image of the operation interface in response to the control instruction；
Projection module, the pseudo operation interface for being projected as the two dimensional image in reality environment；
Switching module, for obtaining by the switching command of the pseudo operation changing interface to virtual reality video pictures；
Output module, for reading virtual reality video pictures specified by the switching command and exporting.
11. device according to claim 10, which is characterized in that described device further include:
Notification module is notified for sending to virtual reality device, so that the virtual reality device is opened according to the notice Reception pattern is projected, and shows the pseudo operation interface in reality environment under the projection reception pattern.
12. device according to claim 11, which is characterized in that described device further include:
Link block prepares message for sending connection to virtual reality device；The virtual reality device is obtained for described Connection prepares the Notice of Readiness of message feedback；It is initiated the connection according to the Notice of Readiness to the virtual reality device Request；The confirmation message that the virtual reality device is returned in response to the connection request is received, to set with the virtual reality It is standby to establish connection.
13. device according to any one of claims 10 to 12, which is characterized in that described device further include:
Update module, for obtaining interface operation instruction；Execute interface operation corresponding with interface operation instruction；It obtains Execute the two dimensional image of the operation interface updated after the interface operation；The two dimensional image of acquisition is projected as again Pseudo operation interface in reality environment.
14. a kind of computer readable storage medium, computer program, the meter are stored on the computer readable storage medium When calculation machine program is executed by processor, so that the processor executes the step of method as claimed in any one of claims 1-9 wherein Suddenly.
15. a kind of computer equipment, including memory and processor, computer program, the meter are stored in the memory When calculation machine program is executed by the processor, so that the processor executes method as claimed in any one of claims 1-9 wherein The step of.
CN201710890314.7A 2017-09-27 2017-09-27 Video playing method and device, storage medium and computer equipment Active CN109561333B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710890314.7A CN109561333B (en) 2017-09-27 2017-09-27 Video playing method and device, storage medium and computer equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710890314.7A CN109561333B (en) 2017-09-27 2017-09-27 Video playing method and device, storage medium and computer equipment

Publications (2)

Publication Number Publication Date
CN109561333A true CN109561333A (en) 2019-04-02
CN109561333B CN109561333B (en) 2021-09-07

Family

ID=65863744

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710890314.7A Active CN109561333B (en) 2017-09-27 2017-09-27 Video playing method and device, storage medium and computer equipment

Country Status (1)

Country Link
CN (1) CN109561333B (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110825224A (en) * 2019-10-25 2020-02-21 北京威尔文教科技有限责任公司 Interaction method, interaction system and display device
CN111556357A (en) * 2020-04-30 2020-08-18 广州华多网络科技有限公司 Method, device and equipment for playing live video and storage medium
CN111683281A (en) * 2020-06-04 2020-09-18 腾讯科技（深圳）有限公司 Video playing method and device, electronic equipment and storage medium
CN115268739A (en) * 2022-08-16 2022-11-01 北京字跳网络技术有限公司 Control method, control device, electronic equipment and storage medium
CN115393551A (en) * 2022-07-26 2022-11-25 合壹(上海)展览有限公司 Display system, method, device and storage medium with augmented reality effect
CN117111873A (en) * 2023-10-23 2023-11-24 南昌市一境信息技术有限公司 Immersion interaction system based on cave environment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160026239A1 (en) * 2014-08-28 2016-01-28 Osterhout Group, Inc. External user interface for head worn computing
CN106095309A (en) * 2016-06-03 2016-11-09 广东欧珀移动通信有限公司 The method of controlling operation thereof of terminal and device
CN106201173A (en) * 2016-06-28 2016-12-07 广景视睿科技（深圳）有限公司 The interaction control method of a kind of user's interactive icons based on projection and system
CN106708255A (en) * 2016-10-31 2017-05-24 宇龙计算机通信科技(深圳)有限公司 Interaction control method and system for virtual interface

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160026239A1 (en) * 2014-08-28 2016-01-28 Osterhout Group, Inc. External user interface for head worn computing
CN106095309A (en) * 2016-06-03 2016-11-09 广东欧珀移动通信有限公司 The method of controlling operation thereof of terminal and device
CN106201173A (en) * 2016-06-28 2016-12-07 广景视睿科技（深圳）有限公司 The interaction control method of a kind of user's interactive icons based on projection and system
CN106708255A (en) * 2016-10-31 2017-05-24 宇龙计算机通信科技(深圳)有限公司 Interaction control method and system for virtual interface

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110825224A (en) * 2019-10-25 2020-02-21 北京威尔文教科技有限责任公司 Interaction method, interaction system and display device
CN111556357A (en) * 2020-04-30 2020-08-18 广州华多网络科技有限公司 Method, device and equipment for playing live video and storage medium
CN111556357B (en) * 2020-04-30 2022-06-10 广州方硅信息技术有限公司 Method, device and equipment for playing live video and storage medium
CN111683281A (en) * 2020-06-04 2020-09-18 腾讯科技（深圳）有限公司 Video playing method and device, electronic equipment and storage medium
CN115393551A (en) * 2022-07-26 2022-11-25 合壹(上海)展览有限公司 Display system, method, device and storage medium with augmented reality effect
CN115268739A (en) * 2022-08-16 2022-11-01 北京字跳网络技术有限公司 Control method, control device, electronic equipment and storage medium
CN117111873A (en) * 2023-10-23 2023-11-24 南昌市一境信息技术有限公司 Immersion interaction system based on cave environment
CN117111873B (en) * 2023-10-23 2024-01-09 南昌市一境信息技术有限公司 Immersion interaction system based on cave environment

Also Published As

Publication number Publication date
CN109561333B (en) 2021-09-07

Similar Documents

Publication Publication Date Title
CN109561333A (en) Video broadcasting method, device, storage medium and computer equipment
CN103631768B (en) Collaboration data editor and processing system
JP2020534592A (en) Systems and methods for controlling virtual cameras
WO2023279705A1 (en) Live streaming method, apparatus, and system, computer device, storage medium, and program
JP6559871B1 (en) Movie synthesis apparatus, movie synthesis method, and movie synthesis program
CN111970456B (en) Shooting control method, device, equipment and storage medium
US20210042980A1 (en) Method and electronic device for displaying animation
JP5910447B2 (en) Image processing apparatus, image processing method, and image processing program
CN112740284A (en) Moving picture composition device, moving picture composition method, and recording medium
CN114327700A (en) Virtual reality equipment and screenshot picture playing method
JP5966834B2 (en) Image processing apparatus, image processing method, and image processing program
JP2013210989A (en) Image processing device, image processing method, and image processing program
CN111161396A (en) Virtual content control method and device, terminal equipment and storage medium
CN113066189B (en) Augmented reality equipment and virtual and real object shielding display method
CN113886611A (en) Resource display method and device, computer equipment and medium
WO2013129188A1 (en) Image processing device, image processing method, and image processing program
CN112099681B (en) Interaction method and device based on three-dimensional scene application and computer equipment
KR20190035373A (en) Virtual movile device implementing system and control method for the same in mixed reality
JP7339740B2 (en) IMAGE DISPLAY DEVICE, CONTROL METHOD AND PROGRAM FOR IMAGE DISPLAY DEVICE
CN106055108B (en) Virtual touch screen control method and system
CN111782053B (en) Model editing method, device, equipment and storage medium
CN113194329A (en) Live broadcast interaction method, device, terminal and storage medium
JP5920152B2 (en) Image processing apparatus, image processing method, and image processing program
JP2013211821A (en) Image processing device, image processing method, and image processing program
JP5910446B2 (en) Image processing apparatus, image processing method, and image processing program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant