CN108810559A - Field-of-view mode switching method, the transmission method of device and live data, device - Google Patents

Field-of-view mode switching method, the transmission method of device and live data, device Download PDF

Info

Publication number
CN108810559A
CN108810559A CN201810547833.8A CN201810547833A CN108810559A CN 108810559 A CN108810559 A CN 108810559A CN 201810547833 A CN201810547833 A CN 201810547833A CN 108810559 A CN108810559 A CN 108810559A
Authority
CN
China
Prior art keywords
data
field
view mode
live
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810547833.8A
Other languages
Chinese (zh)
Inventor
汪绪龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Dajia Internet Information Technology Co Ltd
Original Assignee
Beijing Dajia Internet Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Dajia Internet Information Technology Co Ltd filed Critical Beijing Dajia Internet Information Technology Co Ltd
Priority to CN201810547833.8A priority Critical patent/CN108810559A/en
Publication of CN108810559A publication Critical patent/CN108810559A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234309—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866—Management of end-user data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508—Management of client data or end-user data
    • H04N21/4532—Management of client data or end-user data involving end-user characteristics, e.g. viewer profile, preferences

Abstract

The present invention provides a kind of field-of-view mode switching method of wearable glasses, includes the following steps：In live streaming, the field-of-view mode switching command of acquisition video data is received；Stop the coding of live data, the live data includes video data and audio data；Field-of-view mode is switched into field-of-view mode corresponding with the field-of-view mode switching command, the video data after acquisition switching field-of-view mode；Restore the coding of live data.In embodiments of the present invention, it may be implemented that equipment progress real time view pattern switching is broadcast live to the wearable glasses for being limited to physical size and space.The present invention also provides a kind of field-of-view mode switching device of wearable glasses and a kind of transmission method of live data, devices.

Description

Field-of-view mode switching method, the transmission method of device and live data, device
Technical field
The present invention relates to technical field of data transmission more particularly to a kind of field-of-view mode switching method of wearable glasses, Device and a kind of transmission method of live data, device.
Background technology
Net cast refers to being broadcast live using internet and stream media technology, and video is because having merged image, word, sound Etc. abundant element, excellent both in sound and shape, excellent is increasingly becoming the mainstream expression way of internet.Video passes through true, lively It propagates, builds strong presence, attract eyeball, reach communication effect with deep impression, that memory is lasting, it can be true, straight It sees, comprehensively publicize, showing oneself complete steaming media platform.
During the sustainable development of net cast, there is mobile live streaming, using wearable glasses (including mobile phone, Tablet, wearing class etc. follow shots equipment) when carrying out net cast, because being limited to physical size and the space of mobile device Limitation, in the selection of camera lens be generally tight shot (referring to that the focal length of camera lens cannot carry out physics adjusting), so into A kind of shooting visual angle can only be provided when row video record or net cast, be not well positioned to meet the demand of net cast.
Invention content
The present invention is directed to the shortcomings that existing way, it is proposed that a kind of field-of-view mode switching method of wearable glasses is used for Wearable glasses of the solution in the prior art during net cast cannot switch a variety of field-of-view modes progress video informations and adopt The technical issues of collection.
The present invention provides a kind of field-of-view mode switching method of wearable glasses, includes the following steps：
In live streaming, the field-of-view mode switching command of acquisition video data is received；
Stop the coding of live data, the live data includes video data and audio data；
Field-of-view mode is switched into field-of-view mode corresponding with the field-of-view mode switching command, acquisition switching visual angle mould Video data after formula；
Restore the coding of live data.
Optionally, the method further includes：
The configuration information of the video sensor of setting acquisition video data, at the beginning of carrying out field-of-view mode according to the configuration information Beginningization processing；
Wherein, the configuration information includes field-of-view mode, and with the one-to-one frame per second of the field-of-view mode, output window Position and size；The field-of-view mode includes being not limited to close shot, medium shot and distant view.
Optionally, the field-of-view mode switching command for receiving acquisition video data, including：
The field-of-view mode switching command that this terminal is pressed in physical button is obtained, confirms that is pressed on the button regards Angle mould formula switching command is by field-of-view mode switching command as far as close field-of-view mode switching command or from the near to the remote.
In addition, also providing a kind of transmission method of live data in implementation process of the present invention, include the following steps：
Field-of-view mode switching method described in above-mentioned any one；With
Live data is encoded, I frame data and corresponding coded audio data are obtained；
Using the I frame data and corresponding coded audio data as transport protocol frame data, to live streaming streaming server hair Send transport protocol frame data.
Optionally, described that live data is encoded, I frame data and corresponding coded audio data are obtained, including：
Obtain the video data and audio data in the live data after switching field-of-view mode；
Video data and audio data are encoded respectively using DSP Video codings and AAC audio codings, obtain I frames Data and corresponding coded audio data.
Optionally, described that video data and audio data are compiled respectively using DSP Video codings and AAC audio codings Code obtains I frame data and corresponding coded audio data, including：
Video data is encoded using DSP Video codings, obtains the I frame data exported in chronological order, P frame data And corresponding first time stamp；
Audio data is encoded using AAC audio codings, obtains coded audio data and corresponding second timestamp；
Judgements is synchronized by using first time stamp and second timestamp, acquisition I frame data and right The coded audio data answered.
Optionally, described that video data is encoded using DSP Video codings, including：
Video data is encoded according to pre-arranged code parameter using DSP Video codings.
Optionally, the pre-arranged code parameter includes being not limited to code check, I frame data and the P frame data layout pitch of coding Time.
In addition, a kind of transmission method of live data is also provided in implementation process of the present invention, including the above-mentioned transmission Method sends transport protocol frame data to live streaming streaming server；
Streaming server is broadcast live and receives the transport protocol frame data, to transport protocol frame data described in client push.
The present invention also provides a kind of field-of-view mode switching devices of wearable glasses comprising：
Command reception module：For in live streaming, receiving the field-of-view mode switching command of acquisition video data；
Encode stopping modular：Coding for stopping live data, the live data include video data and audio number According to；
Field-of-view mode handover module：For field-of-view mode to be switched to regard corresponding with the field-of-view mode switching command Angle mould formula, acquisition switch the video data after field-of-view mode；
Code restoration module：Coding for restoring live data.
Optionally, described device further includes：
Initialization module：Configuration information for the video sensor for setting acquisition video data matches confidence according to described Breath carries out field-of-view mode initialization process；
Wherein, the configuration information includes field-of-view mode, and with the one-to-one frame per second of the field-of-view mode, output window Position and size；The field-of-view mode includes being not limited to close shot, medium shot and distant view.
Optionally, described instruction receiving module includes：
Acquiring unit：The field-of-view mode switching command pressed in physical button for obtaining this terminal；
Confirmation unit：For confirming that the field-of-view mode switching command pressed on the button is by as far as close visual angle mould Formula switching command or field-of-view mode switching command from the near to the remote.
In addition, the embodiment of the present invention additionally provides a kind of transmitting device of live data, including：
Field-of-view mode switching device described in above-mentioned any one；With
Coding module：For being encoded to live data, I frame data and corresponding coded audio data are obtained；
Sending module：For using the I frame data and corresponding coded audio data as transport protocol frame data, Xiang Zhi It broadcasts streaming server and sends transport protocol frame data.
Optionally, the coding module includes：
Live data acquiring unit：For obtaining video data and audio number in the live data after switching field-of-view mode According to；
Audio and video recompile unit：For using DSP Video codings and AAC audio codings respectively to video data and sound Frequency obtains I frame data and corresponding coded audio data according to being encoded.
Optionally, the audio and video recompile unit and include：
Video recodification subelement：For being encoded to video data using DSP Video codings, obtain in chronological order I frame data, P frame data and the stamp of corresponding first time of output；
Audio recodification subelement：For being encoded to audio data using AAC audio codings, audio coding number is obtained According to and corresponding second timestamp；
Synchronous subelement：For synchronizing judgement by using first time stamp and second timestamp, obtain Take I frame data and corresponding coded audio data.
Optionally, the video recodification subelement includes：
For being encoded according to pre-arranged code parameter to video data using DSP Video codings.
Optionally, the pre-arranged code parameter includes being not limited to code check, I frame data and the P frame data layout pitch of coding Time.
The present invention also provides a kind of wearable glasses comprising：
Processor；
Camera；
Microphone；
Memory for storing processor-executable instruction；
Wherein, the processor is configured as：
In live streaming, the field-of-view mode switching command for receiving acquisition video data；
The coding for stopping live data sending the field-of-view mode switching command to camera, and the live data is to take the photograph The audio data that the video data and microphone acquired as head acquires；
Field-of-view mode is switched to and is cut with the field-of-view mode after receiving the field-of-view mode switching command by camera Change the corresponding field-of-view mode of instruction, the video data after acquisition switching field-of-view mode；
Restore the coding of live data.
In specific implementation process of the present invention, by the field-of-view mode switching in live streaming, receiving acquisition video data Instruction；Stop the coding of live data, the live data includes video data and audio data；By field-of-view mode switch to The corresponding field-of-view mode of field-of-view mode switching command, acquisition switch the video data after field-of-view mode；Restore live streaming number According to coding.Realize that equipment, which is broadcast live, to the wearable glasses for being limited to physical size and space carries out real time view pattern switching； And in right angle mode handoff procedure, there is no the shaking of live video, obscures, improve the viewing experience of user.
The additional aspect of the present invention and advantage will be set forth in part in the description, these will become from the following description Obviously, or practice through the invention is recognized.
Description of the drawings
Above-mentioned and/or additional aspect and advantage of the invention will become from the following description of the accompanying drawings of embodiments Obviously and it is readily appreciated that, wherein：
Fig. 1 is the flow diagram of the field-of-view mode switching method of the wearable glasses in the embodiment of the present invention；
Fig. 2 is the flow diagram of the transmission method of the live data in the embodiment of the present invention；
Fig. 3 is the flow diagram of the field-of-view mode switching method of the wearable glasses in another embodiment of the present invention；
Fig. 4 is the transmission method of the live data based on wearable glasses and live streaming streaming server in the embodiment of the present invention Flow diagram；
Fig. 5 is the structure composition schematic diagram of the field-of-view mode switching device of the wearable glasses in the embodiment of the present invention；
Fig. 6 is the structure composition schematic diagram of the transmitting device of the live data in the embodiment of the present invention；
Fig. 7 is the structure composition schematic diagram of the transmitting device of the live data in further embodiment of this invention；
Fig. 8 is the block diagram of the part-structure of the wearable glasses in the embodiment of the present invention.
Specific implementation mode
The embodiment of the present invention is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached The embodiment of figure description is exemplary, and is only used for explaining the present invention, and is not construed as limiting the claims.
Those skilled in the art of the present technique are appreciated that unless expressly stated, singulative " one " used herein, " one It is a ", " described " and "the" may also comprise plural form.It is to be further understood that is used in the specification of the present invention arranges It refers to there are the feature, integer, step, operation, element and/or component, but it is not excluded that presence or addition to take leave " comprising " Other one or more features, integer, step, operation, element, component and/or their group.It should be understood that when we claim member Part is " connected " or when " coupled " to another element, it can be directly connected or coupled to other elements, or there may also be Intermediary element.In addition, " connection " used herein or " coupling " may include being wirelessly connected or wirelessly coupling.It is used herein to arrange Diction "and/or" includes that the whole of one or more associated list items or any cell are combined with whole.
Those skilled in the art of the present technique are appreciated that unless otherwise defined, all terms used herein (including technology art Language and scientific terminology), there is meaning identical with the general understanding of the those of ordinary skill in fields of the present invention.Should also Understand, those terms such as defined in the general dictionary, it should be understood that have in the context of the prior art The consistent meaning of meaning, and unless by specific definitions as here, the meaning of idealization or too formal otherwise will not be used To explain.
Abbreviation annotation in the following example：
DSP (Digital Signal Processing), digital signal processing unit.
MIPI (Mobile Industry Processor Interface), Mobile Industry Processor Interface are MIPI connection Alliance's initiation is the open standard that mobile application processor is formulated, for carrying out video signal between internal system device Transmission.
I2S (Integrated Interchip Sound), the Digital Audio Transmission standard that Philip defines, for number Audio data transmits between internal system device.
H.264, it is to be combined by ITU-T Video Coding Experts Groups (VCEG) and ISO/IEC dynamic image expert groups (MPEG) The high compression digital video coding-coding device standard that the joint video team (JVT, Joint Video Team) of composition proposes.
I frames, also referred to as key frame can independently constitute the frame of complete image.
P frames, also referred to as reference frame forward-predictive-coded frames need I frames or P frames in conjunction with previous transmissions that could constitute completely Image.
AAC (Advanced Audio Coding), Advanced Audio Coding are a kind of codings aiming at voice data design Compressed format.
Embodiment：
Referring to Fig. 1, Fig. 1 is the flow signal of the field-of-view mode switching method of the wearable glasses in the embodiment of the present invention Figure.
As shown in Figure 1, a kind of field-of-view mode switching method of wearable glasses, includes the following steps：
S11：In live streaming, the field-of-view mode switching command of acquisition video data is received；
In specific implementation process, the video sensor of setting acquisition video data is needed before live streaming matches confidence Breath carries out field-of-view mode initialization process according to the configuration information；Wherein, the configuration information includes field-of-view mode, and with The one-to-one frame per second of the field-of-view mode, output window position and size；The field-of-view mode includes being not limited to close shot, medium shot And distant view.
Further include being set accordingly to the configuration information of the video sensor on wearable glasses, and carry out corresponding Initialize installation, by the field-of-view mode of video sensor be initialized as acquiescence field-of-view mode, such as it is assumed that setting acquiescence regard Angle mould formula is medium shot, and after initialize accordingly, the field-of-view mode of the video sensor is medium shot.
During live streaming, the video sensor on wearable glasses, may during acquiring live video data Field-of-view mode switching command of the Switch Video sensor in acquisition live video data of user's transmission is received at any time.The user The field-of-view mode switching command of the Switch Video sensor acquisition live video data of transmission is live streaming user in wearable glasses On the field-of-view mode switching command pressed.
During live streaming, the physical button for switching field-of-view mode is provided on wearable glasses；In live streaming process In, live streaming user can press the instruction of field-of-view mode switching at any time on wearable glasses, carry out field-of-view mode and switch in It is to need to confirm view angle switch instruction for by as far as close visual angle first after receiving the view angle switch instruction in physical button Pattern switching instructs or field-of-view mode switching command from the near to the remote.
Certainly, on further, the field-of-view mode switching command received can also include：The field-of-view mode that spectators send The field-of-view mode switching command that switching command and the shake of this terminal are sent.
Further, the reception field-of-view mode switching command, including：The field-of-view mode switching that spectators send is received to refer to It enables；The field-of-view mode switching command is judged for from as far as close field-of-view mode switching command, or from closely to remote visual angle mould Formula switching command；If from as far as close field-of-view mode switching command, confirm that the spectators are the first authorized user；If from close To remote field-of-view mode switching command, confirm that the spectators are the second authorized user；Wherein, the mandate of first authorized user Mode is that spectators are authorized by sending the first virtual present；The authorization of second authorized user is that spectators pass through It is authorized to send the second virtual present.
Spectators user in the client for receiving live video information can send the switching for adjusting switching field-of-view mode Instruction, but needing the switching command that there is the spectators user in the client of special access right to send just has switching field-of-view mode Permission；And the instruction of each switching field-of-view mode corresponds to may different permission；Such as from as far as close visual angle Pattern switching instruction needs the permission that the spectators user for sending the first virtual present can just possess, that is, sends the first virtual present Spectators user is sending from as far as close field-of-view mode switching command, can basis after the permission for confirming the spectators user Field-of-view mode is carried out field-of-view mode switching by switching command from as far as close；For another example from closely to remote field-of-view mode switching command need The permission that the spectators user of the second virtual present can just possess is sent, that is, the spectators user for sending the second virtual present is sending It, can be according to switching command by visual angle after the permission for confirming the spectators user from closely to remote field-of-view mode switching command Pattern is from closely to remote carry out field-of-view mode switching.Certainly, during live streaming, in order to safeguard live streaming order, wearable glasses On live streaming user or auxiliary user can have the right client terminal is arranged and watch the instruction that user sends field-of-view mode switching The number etc. that frequency or each spectators user send.And the view angle switch instruction packet that the viewing user of client terminal sends Include be not limited to it is above-mentioned from closely to remote field-of-view mode switching command and from as far as close field-of-view mode switching command, can be according to reality Border situation is arranged accordingly, and the corresponding permission of switching command can also be correspondingly arranged, and form is without being limited thereto.
Further, the reception field-of-view mode switching command, the audio/video coding for stopping live data include：Obtain this Continuous n times move the first angle of inclination of shake to terminal clockwise in the horizontal direction, and it is pre- to judge whether first angle of inclination is more than If angle, it is produced as from as far as close field-of-view mode switching command if so, confirming；Obtain this terminal continuous n times in the horizontal direction The first angle of inclination of dynamic shake counterclockwise, judges whether first angle of inclination is more than predetermined angle, if so, confirm generation from Closely arrive remote field-of-view mode switching command；Wherein, n is default integer.
The user of wearable glasses can be by controlling rotating clockwise or counterclockwise for wearable glasses, to realize Switching to field-of-view mode, especially when using wearable device as wearable glasses, this switches the function of field-of-view mode Will have preferable application scenarios.
For example sentenced when the wearable glasses angle of inclination that continuous n times are shaken clockwise in the horizontal direction by setting The value whether disconnected angle of inclination is more than predetermined angle can then be considered as wearable eyeglass users if more than the value of predetermined angle It sends from as far as close field-of-view mode switching command；Or it is that wearable glasses continuous n in the horizontal direction is worked as by setting When secondary shake angle of inclination counterclockwise, judge whether the angle of inclination is more than the value of predetermined angle, if more than the value of predetermined angle, Wearable eyeglass users can be then considered as to send from closely to remote field-of-view mode switching command.
Above-mentioned n times can be for 1 time, 2 times or more times, and user can be arranged according to specific requirements；Above-mentioned is default The value of angle can be accustomed to being arranged according to user, could be provided as 10 degree, 15 degree or other more than 0 degree of value.
It is here not limited to the mode that setting is shaken clockwise or counter-clockwise, could be provided as up and down or left and right shake Form no longer does detailed example herein.
S12：Stop the coding of live data, the live data includes video data and audio data；
In specific implementation process, in above-mentioned S11 steps, field-of-view mode switching command is being received, is confirming that this refers to It is the coding work of wearable glasses first time stopping live data after effective instruction to enable.Wherein live data includes Video data and audio data do not allow the lattice for the video data that suddenly change is encoded during video data encoding The format for the video data that formula (including the size of video, resolution ratio etc.) suddenly change is encoded, can lead to video data encoding Error；It is also corresponding to stop sending transport protocol frame data to live streaming streaming server after the coding for stopping live data, this When, client (terminal that viewing live video uses) will appear of short duration picture interim card, but have no effect on the sight of client It sees experience, because the time of subsequent entire field-of-view mode handoff procedure is very short, is completed within 600ms, the time of interim card It is very of short duration, almost it can be omitted.When can field-of-view mode be switched in this way, live streaming picture do not shake, not fuzzy or not Hua Ping etc. improves the viewing experience of viewing user.
S13：Field-of-view mode is switched into field-of-view mode corresponding with the field-of-view mode switching command, acquisition switching regards Video data after angle mould formula；
After receiving the field-of-view mode switching command that live streaming user presses on wearable glasses, will currently it adopt at once The field-of-view mode for collecting the video sensor of video data switches to the field-of-view mode switching command phase received with wearable glasses Corresponding field-of-view mode.As net cast user is pressed on wearable glasses by the visual angle of video sensor acquisition video data Pattern switching is to landscape mode, then wearable glasses are after receiving the instruction, by the video on current wearable glasses The field-of-view mode of sensor acquisition video data switches to landscape mode.
Wherein, after wearable glasses upward angle of visibility pattern switching, by the corresponding other configurations of field-of-view mode after switching On video sensor in information update to live streaming end.
S14：Restore the coding of live data.
In specific implementation process, after field-of-view mode switching, video sensor is regarded using new field-of-view mode The acquisition of frequency evidence, the format of current video data are the form of stabilization, therefore restore the coding of live data.
The field-of-view mode of the video sensor on wearable glasses is switched at any time by field-of-view mode switching command, The video sensor on wearable glasses can be made to acquire the video information under different visual angles pattern according to demand, and cut It changes during field-of-view mode, there is no live streaming pictures not to shake, does not obscure or does not spend situations such as shielding；Be conducive in live streaming process It is middle show different visual angles to spectators user under live data, improve spectators user viewing experience.
Optionally, embodiment provided by the invention：
Referring to Fig. 2, Fig. 2 is the flow diagram of the transmission method of the live data in the embodiment of the present invention.
As shown in Fig. 2, a kind of transmission method of live data, includes the following steps：
S21：In live streaming, the field-of-view mode switching command of acquisition video data is received；
S22：Stop the coding of live data, the live data includes video data and audio data；
S23：Field-of-view mode is switched into field-of-view mode corresponding with the field-of-view mode switching command, acquisition switching regards Video data after angle mould formula；
S24：Restore the coding of live data；
The specific implementation mode of S21, S22, S23 and S24 can consider and examine the above embodiments, repeat no more again.
S25：Live data is encoded, I frame data and corresponding coded audio data are obtained；
In specific implementation process, the wearable glasses of net cast the field-of-view mode for having switched live data acquisition it Afterwards, restart the audio/video coding of live data, and the audio and video of the field-of-view mode acquisition after switching are encoded accordingly.
Further, the video data and audio data being broadcast live after switching field-of-view mode are obtained；Restart DSP Video codings and AAC audio codings respectively encode video data and audio data, obtain newest I frame data and corresponding audio is compiled Code data.
Wherein, described to restart DSP Video codings and AAC audio codings respectively compile video data and audio data Code, including：Restart DSP Video codings to encode video data, obtains the I frame data exported in chronological order and P frame numbers According to and corresponding first time stamp；Restarting AAC audio codings audio data is encoded, obtain coded audio data with Corresponding second timestamp；Judgement is synchronized by using first time stamp and second timestamp, obtains I frame numbers According to this and corresponding coded audio data.
Wherein, described to restart DSP Video codings video data is encoded, including：DSP Video codings are restarted to video Data are encoded according to pre-arranged code parameter, obtain the I frame data exported in chronological order and P frame data and corresponding first Timestamp.The pre-arranged code parameter includes being not limited to code check, I frame data and the P frame data layout pitch time of coding.
In specific implementation process, wearable glasses start to acquire regarding in live data according to the field-of-view mode after switching Frequency evidence and audio data；Simultaneously restart DSP Video codings and AAC audio codings respectively resurvey wearable glasses Video data and audio data are encoded；DSP Video codings encode video data, what acquisition exported in chronological order I frame data and P frame data and stamp of corresponding first time；AAC audio codings encode audio data, obtain audio coding Data and corresponding second timestamp；Judgement is synchronized by using first time stamp and second timestamp, is obtained Take newest I frame data and corresponding coded audio data.
Wherein, it is according to presetting that the video data that acquires, which carries out coding, after DSP Video codings switch field-of-view mode Coding parameter carry out coding, the preset coding parameter include coding code check, I frame data and P frame data distribution between Every the time.
S26：Using the I frame data and corresponding coded audio data as transport protocol frame data, to live TV stream service Device sends transport protocol frame data.
In specific implementation process, live streaming end has got visual angle after a series of processing in carrying out above-mentioned steps I frame data after pattern switching and corresponding coded audio data；End is broadcast live by I frame data and corresponding coded audio data As transport protocol frame data, transport protocol frame data are sent to live streaming streaming server；Transport protocol frame data are sent to be used Transport protocol include be not limited to：RTSP,RTMP.
Transport protocol frame data are that I frame data and corresponding coded audio data are encapsulated in corresponding transport protocol, Then it is transmitted in live streaming streaming server by transmission channel (wired or wireless).
In specific implementation process of the present invention, by after field-of-view mode switches, obtaining I frame data and corresponding audio Coded data；Using the I frame data and corresponding coded audio data as transport protocol frame data, to live streaming streaming server hair Send transport protocol frame data.Realize that equipment, which is broadcast live, to the wearable glasses for being limited to physical size and space carries out real time view mould Formula switches, and promotes the live streaming usage experience sense of net cast；According to the spectators user's or wearable glasses for receiving client terminal User sends the switching command of field-of-view mode, can preferably increase the user of the spectators user and wearable glasses of client terminal Between interaction, be conducive to increase live streaming enjoyment, promote the usage experience of user；It solves in field-of-view mode handoff procedure, Situations such as existing Video coding mistake causes the video of output to shield there may be shake, fuzzy or flower.
Optionally, another embodiment provided by the invention：
Referring to Fig. 3, Fig. 3 is the flow of the field-of-view mode switching method of the wearable glasses in another embodiment of the present invention Schematic diagram.
As shown in figure 3, a kind of field-of-view mode switching method of wearable glasses, includes the following steps：
S31：Video sensor is initialized into the field-of-view mode in acquiescence；
It is first fixed first on wearable glasses before wearable glasses acquire live data in specific implementation process The configuration information of video sensor on the wearable glasses of justice, wherein there may be multiple video sensors.Video sensor Configuration information includes：Field-of-view mode and correspond frame per second, output window position and size with field-of-view mode.
According to the configuration information of video sensor, live data acquisition is set before net cast starts and is regarded based on acquiescence Angle mould formula carries out.Such as：Live data acquisition field-of-view mode there are three, respectively close shot field-of-view mode, medium shot field-of-view mode and Distant view field-of-view mode.Field-of-view mode is set to before live streaming starts the field-of-view mode of acquiescence；Such as acquiescence field-of-view mode is set It is set to medium shot field-of-view mode；Similarly, acquiescence field-of-view mode could be provided as any one in above-mentioned Three models or more pattern Kind pattern.
S32：Start audio/video coding；
In specific implementation process, starts DSP Video codings and AAC audio codings and distinguish that wearable glasses are collected to be regarded Frequency evidence and audio data are encoded.
S33：Whether judgment frame coded data is ready；If it is not, then continuing to judge, if entering in next step；
In specific implementation process, DSP Video codings and AAC audio codings are respectively to the volume of video data and audio data Whether code is ready.
S34：It obtains audio/video frames data and is transferred to live streaming streaming server；
In specific implementation process, by audio/video coding, obtaining I frame data and corresponding coded audio data, And I frame data and corresponding coded audio data are transferred to as transport protocol frame data in live streaming streaming server.
S35：Judge whether user presses field-of-view mode and cut key；If it is not, returning to S33；If so, entering in next step；
In specific implementation process, sent out to judge whether wearable glasses receive user and press field-of-view mode switch key The instruction of view angle switch.
S36：Stop audio/video coding；
In specific implementation process, after being connected to view angle switch instruction, stop tone video encoding job at once.
S37：According to push-button type by the configuration of video sensor on corresponding field-of-view mode, return S32.
In specific implementation process, according to the type for the button that user presses, field-of-view mode is switched to and push-button type On corresponding field-of-view mode；
Push-button type includes the different of the field-of-view mode that different buttons represents switching, and each button corresponds to a visual angle Pattern.
In specific implementation process of the present invention, by setting the switching command of field-of-view mode, user in wearable glasses By controlling switching command, realize that equipment, which is broadcast live, to the wearable glasses for being limited to physical size and space carries out real time view mould Formula switches, and promotes the live streaming usage experience sense of net cast.
Optionally, another embodiment provided by the invention：
Referring to Fig. 4, Fig. 4 is the live data based on wearable glasses and live streaming streaming server in the embodiment of the present invention Transmission method flow diagram.
As shown in figure 4, a kind of transmission method of live data, includes the following steps：
S41：In live streaming, the field-of-view mode switching command of acquisition video data is received；
S42：Stop the coding of live data, the live data includes video data and audio data；
S43：Field-of-view mode is switched into field-of-view mode corresponding with the field-of-view mode switching command, acquisition switching regards Video data after angle mould formula；
S44：Restore the coding of live data；
S45：Live data is encoded, I frame data and corresponding coded audio data are obtained；
S46：Using the I frame data and corresponding coded audio data as transport protocol frame data, to live TV stream service Device sends transport protocol frame data；
The specific implementation mode of above-mentioned S41-S46 sees the implementation in above-described embodiment, and details are not described herein.
S47：Streaming server is broadcast live and receives the transport protocol frame data, to transport protocol frame number described in client push According to.
In specific implementation process, live streaming streaming server is after receiving transport protocol frame data, immediately to client The transport protocol frame data are pushed, (video parses and audio by carrying out parsing accordingly to transport protocol frame data for client Parsing), the picture of live streaming and live streaming sound are presented by client, the user for watching live streaming can be watched by client The video and sound being broadcast live accordingly.
In specific implementation process of the present invention, by setting the switching command of field-of-view mode, user in wearable glasses It is realized to client push to being limited to physical bodies by controlling switching command, and by the live data after switching field-of-view mode The wearable glasses in product and space live streaming equipment carries out real time view pattern switching, promotes the live streaming usage experience of net cast Sense；The user for giving client watches the content of the live data under more field-of-view modes so that client is watched more More rich live data is conducive to the viewing user for increasing client.
The switching command that field-of-view mode is sent according to the user of the spectators user or wearable glasses that receive client terminal, can Preferably to increase the interaction between the spectators user of client terminal and the user of wearable glasses, be conducive to the pleasure for increasing live streaming Interest promotes the usage experience of user.
Embodiment：
Referring to Fig. 5, Fig. 5 is the structure composition of the field-of-view mode switching device of the wearable glasses in the embodiment of the present invention Schematic diagram.
As shown in figure 5, a kind of field-of-view mode switching device of wearable glasses, including：
Command reception module 11：For in live streaming, receiving the field-of-view mode switching command of acquisition video data；
In specific implementation process, described device further includes：Initialization module：Video for setting acquisition video data The configuration information of sensor carries out field-of-view mode initialization process according to the configuration information；Wherein, the configuration information includes Field-of-view mode, and with the one-to-one frame per second of the field-of-view mode, output window position and size；The field-of-view mode includes not It is limited to close shot, medium shot and distant view.
Further include being set accordingly to the configuration information of the video sensor on wearable glasses, and carry out corresponding Initialize installation, by the field-of-view mode of video sensor be initialized as acquiescence field-of-view mode, such as it is assumed that setting acquiescence regard Angle mould formula is medium shot, and after initialize accordingly, the field-of-view mode of the video sensor is medium shot.
Described instruction receiving module 11 includes：Acquiring unit：The visual angle pressed in physical button for obtaining this terminal Pattern switching instructs；Confirmation unit：For confirming that the field-of-view mode switching command pressed on the button is by as far as close Field-of-view mode switching command or field-of-view mode switching command from the near to the remote.
During live streaming, the video sensor on wearable glasses, may during acquiring live video data Field-of-view mode switching command of the Switch Video sensor in acquisition live video data of user's transmission is received at any time.The user The field-of-view mode switching command of the Switch Video sensor acquisition live video data of transmission is live streaming user in wearable glasses On the field-of-view mode switching command pressed.
During live streaming, the physical button for switching field-of-view mode is provided on wearable glasses；In live streaming process In, live streaming user can press the instruction of field-of-view mode switching at any time on wearable glasses, carry out field-of-view mode and switch in It is to need to confirm view angle switch instruction for by as far as close visual angle first after receiving the view angle switch instruction in physical button Pattern switching instructs or field-of-view mode switching command from the near to the remote.
Certainly, on further, the field-of-view mode switching command received can also include：The field-of-view mode that spectators send The field-of-view mode switching command that switching command and the shake of this terminal are sent.
Described instruction receiving module 11 includes：Receiving unit：Field-of-view mode switching command for receiving spectators' transmission；Sentence Disconnected unit：For judging the field-of-view mode switching command for from as far as close field-of-view mode switching command, or from closely to remote Field-of-view mode switching command；First confirmation unit：For if from as far as close field-of-view mode switching command, confirming the sight Crowd is the first authorized user；Second confirmation unit：For if from closely to remote field-of-view mode switching command, confirming the spectators For the second authorized user；Wherein, the authorization of first authorized user is that spectators are obtained by sending the first virtual present It authorizes；The authorization of second authorized user is that spectators are authorized by sending the second virtual present.
Spectators user in the client for receiving live video information can send the switching for adjusting switching field-of-view mode Instruction, but needing the switching command that there is the spectators user in the client of special access right to send just has switching field-of-view mode Permission；And the instruction of each switching field-of-view mode corresponds to may different permission；Such as from as far as close visual angle Pattern switching instruction needs the permission that the spectators user for sending the first virtual present can just possess, that is, sends the first virtual present Spectators user is sending from as far as close field-of-view mode switching command, can basis after the permission for confirming the spectators user Field-of-view mode is carried out field-of-view mode switching by switching command from as far as close；For another example from closely to remote field-of-view mode switching command need The permission that the spectators user of the second virtual present can just possess is sent, that is, the spectators user for sending the second virtual present is sending It, can be according to switching command by visual angle after the permission for confirming the spectators user from closely to remote field-of-view mode switching command Pattern is from closely to remote carry out field-of-view mode switching.Certainly, during live streaming, in order to safeguard live streaming order, wearable glasses On live streaming user or auxiliary user can have the right client terminal is arranged and watch the instruction that user sends field-of-view mode switching The number etc. that frequency or each spectators user send.And the view angle switch instruction packet that the viewing user of client terminal sends Include be not limited to it is above-mentioned from closely to remote field-of-view mode switching command and from as far as close field-of-view mode switching command, can be according to reality Border situation is arranged accordingly, and the corresponding permission of switching command can also be correspondingly arranged, and form is without being limited thereto.
Described instruction receiving module 11 includes：First acquisition unit：For obtaining this terminal, continuous n times are suitable in the horizontal direction The first angle of inclination of the dynamic shake of hour hands, judges whether first angle of inclination is more than predetermined angle, if so, confirmation be produced as from As far as close field-of-view mode switching command；Second acquisition unit：For obtaining this terminal, continuous n times are moved counterclockwise in the horizontal direction The first angle of inclination is shaken, judges whether first angle of inclination is more than predetermined angle, is produced as from closely to remote if so, confirming Field-of-view mode switching command；Wherein, N is default integer.
The user of wearable glasses can be by controlling rotating clockwise or counterclockwise for wearable glasses, to realize Switching to field-of-view mode, especially when using wearable device as wearable glasses, this switches the function of field-of-view mode Will have preferable application scenarios.
For example sentenced when the wearable glasses angle of inclination that continuous n times are shaken clockwise in the horizontal direction by setting The value whether disconnected angle of inclination is more than predetermined angle can then be considered as wearable eyeglass users if more than the value of predetermined angle It sends from as far as close field-of-view mode switching command；Or it is that wearable glasses continuous n in the horizontal direction is worked as by setting When secondary shake angle of inclination counterclockwise, judge whether the angle of inclination is more than the value of predetermined angle, if more than the value of predetermined angle, Wearable eyeglass users can be then considered as to send from closely to remote field-of-view mode switching command.
Above-mentioned n times can be for 1 time, 2 times or more times, and user can be arranged according to specific requirements；Above-mentioned is default The value of angle can be accustomed to being arranged according to user, could be provided as 10 degree, 15 degree or other more than 0 degree of value.
It is here not limited to the mode that setting is shaken clockwise or counter-clockwise, could be provided as up and down or left and right shake Form no longer does detailed example herein.
Encode stopping modular 12：Coding for stopping live data, the live data include video data and audio Data；
In specific implementation process, in above-mentioned S11 steps, field-of-view mode switching command is being received, is confirming that this refers to It is the coding work of wearable glasses first time stopping live data after effective instruction to enable.Wherein live data includes Video data and audio data do not allow the lattice for the video data that suddenly change is encoded during video data encoding The format for the video data that formula (including the size of video, resolution ratio etc.) suddenly change is encoded, can lead to video data encoding Error；It is also corresponding to stop sending transport protocol frame data to live streaming streaming server after the coding for stopping live data, this When, client (terminal that viewing live video uses) will appear of short duration picture interim card, but have no effect on the sight of client It sees experience, because the time of subsequent entire field-of-view mode handoff procedure is very short, is completed within 600ms, the time of interim card It is very of short duration, almost it can be omitted.When can field-of-view mode be switched in this way, live streaming picture do not shake, not fuzzy or not Hua Ping etc. improves the viewing experience of viewing user.
Field-of-view mode handover module 13：It is corresponding with the field-of-view mode switching command for switching to field-of-view mode Field-of-view mode, acquisition switch the video data after field-of-view mode；
After receiving the field-of-view mode switching command that live streaming user presses on wearable glasses, will currently it adopt at once The field-of-view mode for collecting the video sensor of video data switches to the field-of-view mode switching command phase received with wearable glasses Corresponding field-of-view mode.As net cast user is pressed on wearable glasses by the visual angle of video sensor acquisition video data Pattern switching is to landscape mode, then wearable glasses are after receiving the instruction, by the video on current wearable glasses The field-of-view mode of sensor acquisition video data switches to landscape mode.
Wherein, after wearable glasses upward angle of visibility pattern switching, by the corresponding other configurations of field-of-view mode after switching On video sensor in information update to live streaming end.
Code restoration module 14：Coding for restoring live data.
In specific implementation process, after field-of-view mode switching, video sensor is regarded using new field-of-view mode The acquisition of frequency evidence, the format of current video data are the form of stabilization, therefore restore the coding of live data.
The field-of-view mode of the video sensor on wearable glasses is switched at any time by field-of-view mode switching command, The video sensor on wearable glasses can be made to acquire the video information under different visual angles pattern according to demand, and cut It changes during field-of-view mode, there is no live streaming pictures not to shake, does not obscure or does not spend situations such as shielding；Be conducive in live streaming process It is middle show different visual angles to spectators user under live data, improve spectators user viewing experience.
Optionally, another embodiment：
Referring to Fig. 6, Fig. 6 is the structure composition schematic diagram of the transmitting device of the live data in the embodiment of the present invention.
As shown in fig. 6, a kind of transmitting device of live data, including：
Command reception module 21：For in live streaming, receiving the field-of-view mode switching command of acquisition video data；
Encode stopping modular 22：Coding for stopping live data, the live data include video data and audio Data；
Field-of-view mode handover module 23：It is corresponding with the field-of-view mode switching command for switching to field-of-view mode Field-of-view mode, acquisition switch the video data after field-of-view mode；
Code restoration module 24：Coding for restoring live data；
Above-metioned instruction receiving module 21 encodes stopping modular 22, field-of-view mode handover module 23 and regards code restoration module 24 specific implementation mode please consider and examine above-described embodiment, and details are not described herein.
Coding module 25：For being encoded to live data, I frame data and corresponding coded audio data are obtained；
In specific implementation process, the wearable glasses of net cast the field-of-view mode for having switched live data acquisition it Afterwards, restart the audio/video coding of live data, and the audio and video of the field-of-view mode acquisition after switching are encoded accordingly.
Further, the coding module 25 includes：Live data acquiring unit：After obtaining switching field-of-view mode Video data in live data and audio data；Audio and video recompile unit：For using DSP Video codings and AAC sounds Frequency coding respectively encodes video data and audio data, obtains I frame data and corresponding coded audio data.
Wherein, the audio and video recompile unit and include：Video recodification subelement：For using DSP Video codings Video data is encoded, the I frame data exported in chronological order and P frame data and stamp of corresponding first time are obtained；Sound Frequency recodification subelement：For being encoded to audio data using AAC audio codings, coded audio data and corresponding is obtained Second timestamp；Synchronous subelement：For synchronizing judgement by using first time stamp and second timestamp, Obtain I frame data and corresponding coded audio data.
Wherein, the video recodification subelement includes：For using DSP Video codings to video data according to default volume Code parameter is encoded.The pre-arranged code parameter includes being not limited to code check, I frame data and the P frame data layout pitch of coding Time.
In specific implementation process, wearable glasses start to acquire regarding in live data according to the field-of-view mode after switching Frequency evidence and audio data；Simultaneously restart DSP Video codings and AAC audio codings respectively resurvey wearable glasses Video data and audio data are encoded；DSP Video codings encode video data, what acquisition exported in chronological order I frame data and P frame data and stamp of corresponding first time；AAC audio codings encode audio data, obtain audio coding Data and corresponding second timestamp；Judgement is synchronized by using first time stamp and second timestamp, is obtained Take newest I frame data and corresponding coded audio data.
Wherein, it is according to presetting that the video data that acquires, which carries out coding, after DSP Video codings switch field-of-view mode Coding parameter carry out coding, the preset coding parameter include coding code check, I frame data and P frame data distribution between Every the time.
Sending module 26：For using the I frame data and corresponding coded audio data as transport protocol frame data, to Streaming server is broadcast live and sends transport protocol frame data.
In specific implementation process, live streaming end has got visual angle after a series of processing in carrying out above-mentioned steps I frame data after pattern switching and corresponding coded audio data；End is broadcast live by I frame data and corresponding coded audio data As transport protocol frame data, transport protocol frame data are sent to live streaming streaming server；Transport protocol frame data are sent to be used Transport protocol include be not limited to：RTSP,RTMP.
Transport protocol frame data are that I frame data and corresponding coded audio data are encapsulated in corresponding transport protocol, Then it is transmitted in live streaming streaming server by transmission channel (wired or wireless).
In specific implementation process of the present invention, by after field-of-view mode switches, obtaining I frame data and corresponding audio Coded data；Using the I frame data and corresponding coded audio data as transport protocol frame data, to live streaming streaming server hair Send transport protocol frame data.Realize that equipment, which is broadcast live, to the wearable glasses for being limited to physical size and space carries out real time view mould Formula switches, and promotes the live streaming usage experience sense of net cast；According to the spectators user's or wearable glasses for receiving client terminal User sends the switching command of field-of-view mode, can preferably increase the user of the spectators user and wearable glasses of client terminal Between interaction, be conducive to increase live streaming enjoyment, promote the usage experience of user；It solves in field-of-view mode handoff procedure, Situations such as existing Video coding mistake causes the video of output to shield there may be shake, fuzzy or flower.
In specific implementation process of the present invention, by setting the switching command of field-of-view mode, user in wearable glasses By controlling switching command, realize that equipment, which is broadcast live, to the wearable glasses for being limited to physical size and space carries out real time view mould Formula switches, and promotes the live streaming usage experience sense of net cast.
The switching command that field-of-view mode is sent according to the user of the spectators user or wearable glasses that receive client terminal, can Preferably to increase the interaction between the spectators user of client terminal and the user of wearable glasses, be conducive to the pleasure for increasing live streaming Interest promotes the usage experience of user.
Optionally, another embodiment：
Referring to Fig. 7, Fig. 7 is the structure composition signal of the transmitting device of the live data in further embodiment of this invention Figure.
As shown in fig. 7, a kind of transmitting device of live data, including：
Command reception module 31：For in live streaming, receiving the field-of-view mode switching command of acquisition video data；
Encode stopping modular 32：Coding for stopping live data, the live data include video data and audio Data；
Field-of-view mode handover module 33：It is corresponding with the field-of-view mode switching command for switching to field-of-view mode Field-of-view mode, acquisition switch the video data after field-of-view mode；
Code restoration module 34：Coding for restoring live data；
Coding module 35：For being encoded to live data, I frame data and corresponding coded audio data are obtained；
Sending module 36：For using the I frame data and corresponding coded audio data as transport protocol frame data, to Streaming server is broadcast live and sends transport protocol frame data；
Above-metioned instruction receiving module 21, field-of-view mode handover module 23, regards code restoration module at coding stopping modular 22 24, the specific implementation mode of coding module 25 and sending module 26 please consider and examine above-described embodiment, and details are not described herein.
Pushing module 37：The transport protocol frame data are received for streaming server to be broadcast live, are passed to described in client push Defeated agreement frame data.
In specific implementation process, live streaming streaming server is after receiving transport protocol frame data, immediately to client The transport protocol frame data are pushed, (video parses and audio by carrying out parsing accordingly to transport protocol frame data for client Parsing), the picture of live streaming and live streaming sound are presented by client, the user for watching live streaming can be watched by client The video and sound being broadcast live accordingly.
In specific implementation process of the present invention, by setting the switching command of field-of-view mode, user in wearable glasses It is realized to client push to being limited to physical bodies by controlling switching command, and by the live data after switching field-of-view mode The wearable glasses in product and space live streaming equipment carries out real time view pattern switching, promotes the live streaming usage experience of net cast Sense；The user for giving client watches the content of the live data under more field-of-view modes so that client is watched more More rich live data is conducive to the viewing user for increasing client.
The switching command that field-of-view mode is sent according to the user of the spectators user or wearable glasses that receive client terminal, can Preferably to increase the interaction between the spectators user of client terminal and the user of wearable glasses, be conducive to the pleasure for increasing live streaming Interest promotes the usage experience of user.
In above-described embodiment implementation process, wearable glasses are generally comprised with next key components：
1, coding and host processor chip, are integrated into the form of DSP+ARM, and DSP built in coded portion is realized, for that will adopt The live data collected is encoded, for example is encoded into H.264 video data frame and ACC audio data formats.
2, video sensor is used for video image acquisition, will be adopted by original video data coffret (such as MIPI) The video data transmission collected to coding and host processor chip.
3, microphone, such as digital silicon wheat are used for audio data collecting, will be adopted by audio frequency data interface (such as I2S) The original audio data collected PCM format transmission to coding and host processor chip.
4, transmit chip, according to system design difference, can wired (such as Ethernet) or wireless transmission (such as 4G, WiFi or bluetooth etc.).
A kind of computer readable storage medium provided in an embodiment of the present invention stores on the computer readable storage medium There is computer program, the transmission method of any one above-described embodiment is realized when which is executed by processor.Wherein, institute It includes but not limited to any kind of disk (including floppy disk, hard disk, CD, CD-ROM and magneto-optic to state computer readable storage medium Disk), ROM (Read-Only Memory, read-only memory), RAM (Random AcceSS Memory, immediately memory), EPROM (EraSable Programmable Read-Only Memory, Erarable Programmable Read only Memory), EEPROM (Electrically EraSable ProgrammableRead-Only Memory, Electrically Erasable Programmable Read-Only Memory), Flash memory, magnetic card or light card.It is, storage device includes by equipment (for example, computer, wearable glasses) with energy Any medium for the form storage or transmission information enough read can be read-only memory, disk or CD etc..
Fig. 8 is considered and examined, Fig. 8 is the block diagram of the part-structure of the wearable glasses in the embodiment of the present invention.
Each component parts of wearable glasses is specifically introduced with reference to Fig. 8：
RF circuits 1510 can be used for receiving and sending messages or communication process in, signal sends and receivees, particularly, by base station After downlink information receives, handled to processor 1580；In addition, the data for designing uplink are sent to base station.In general, RF circuits 1510 include but not limited to antenna, at least one amplifier, transceiver, coupler, low-noise amplifier (Low Noise Amplifier, LNA), duplexer etc..In addition, RF circuits 1510 can also be logical with network and other equipment by radio communication Letter.Above-mentioned wireless communication can use any communication standard or agreement, including but not limited to global system for mobile communications (Global System of Mobile communication, GSM), general packet radio service (General Packet Radio Service, GPRS), CDMA (Code Division Multiple Access, CDMA), wideband code division multiple access (Wideband Code Division Multiple Access, WCDMA), long term evolution (Long Term Evolution, LTE), Email, short message service (Short Messaging Service, SMS) etc..
Memory 1520 can be used for storing software program and module, and processor 1580 is stored in memory by operation 1520 software program and module, to execute various function application and the data processing of wearable glasses.Memory 1520 can include mainly storing program area and storage data field, wherein storing program area can storage program area, at least one work( Application program (such as vocal print playing function, image player function etc.) needed for energy etc.；Storage data field can be stored according to wearing Formula glasses use created data (such as audio data, phone directory etc.) etc..In addition, memory 1520 may include high speed Random access memory, can also include nonvolatile memory, a for example, at least disk memory, flush memory device or its His volatile solid-state part.
Input unit 1530 can be used for receiving the number or character information of input, and generate the user with wearable glasses Setting and the related key signals input of function control.Specifically, input unit 1530 may include touch panel 1531 and its His input equipment 1532.Touch panel 1531, also referred to as touch screen collect user on it or neighbouring touch operation (are compared Such as user is using finger, stylus any suitable object or attachment on touch panel 1531 or near touch panel 1531 Operation), and corresponding attachment device is driven according to preset formula.Optionally, touch panel 1531 may include touching Two parts of detection device and touch controller.Wherein, the touch orientation of touch detecting apparatus detection user, and detect touch behaviour Make the signal brought, transmits a signal to touch controller；Touch controller receives touch information from touch detecting apparatus, and It is converted into contact coordinate, then gives processor 1580, and order that processor 1580 is sent can be received and executed.This Outside, the multiple types such as resistance-type, condenser type, infrared ray and surface acoustic wave may be used and realize touch panel 1531.In addition to touching Panel 1531 is controlled, input unit 1530 can also include other input equipments 1532.Specifically, other input equipments 1532 can be with Including but not limited to physical keyboard, function key (such as volume control button, switch key etc.), trace ball, mouse, operating lever etc. In it is one or more.
Display unit 1540 can be used for showing information input by user or be supplied to the information of user and wearable eye The various menus of mirror.Display unit 1540 may include display panel 1541, optionally, liquid crystal display (Liquid may be used Crystal Display, LCD), the forms such as Organic Light Emitting Diode (Organic Light-Emitting Diode, OLED) To configure display panel 1541.Further, touch panel 1531 can cover display panel 1541, when touch panel 1531 detects To processor 1580 on it or after neighbouring touch operation, is sent to determine the type of touch event, it is followed by subsequent processing device 1580 provide corresponding visual output according to the type of touch event on display panel 1541.Although in the figure 7, touch panel 1531 with display panel 1541 be realize input and the input function of wearable glasses as two independent components, but In some embodiments, touch panel 1531 can be integrated with display panel 1541 and realize outputting and inputting for wearable glasses Function.
Wearable glasses may also include at least one sensor 1550, for example, optical sensor, motion sensor and other Sensor.Specifically, optical sensor may include ambient light sensor and proximity sensor, wherein ambient light sensor can basis The light and shade of ambient light adjusts the brightness of display panel 1541, proximity sensor can when wearable glasses are moved in one's ear, Close display panel 1541 and/or backlight.As a kind of motion sensor, accelerometer sensor can detect in all directions The size of (generally three axis) acceleration, can detect that size and the direction of gravity, can be used to identify wearable glasses when static The application (such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating) of posture, Vibration identification correlation function (such as meter step Device, percussion) etc.；Gyroscope, barometer, hygrometer, thermometer, infrared sensor for can also configure as wearable glasses etc. Other sensors, details are not described herein.
Voicefrequency circuit 1560, loud speaker 1561, the audio that microphone 1562 can be provided between user and wearable glasses connect Mouthful.The transformed electric signal of the audio data received can be transferred to loud speaker 1561, by loud speaker by voicefrequency circuit 1560 1561 are converted to the output of vocal print signal；On the other hand, the vocal print signal of collection is converted to electric signal by microphone 1562, by audio Circuit 1560 is converted to audio data after receiving, then by after the processing of audio data output processor 1580, through RF circuits 1510 with Such as another wearable glasses are sent to, or audio data is exported to memory 1520 to be further processed.
Wi-Fi belongs to short range wireless transmission technology, and wearable glasses can help user to receive by Wi-Fi module 1570 Send e-mails, browse webpage and access streaming video etc., it has provided wireless broadband internet to the user and has accessed.Although figure 7 show Wi-Fi module 1570, but it is understood that, and it is not belonging to must be configured into for wearable glasses, it completely can be with It is omitted in the range for the essence for not changing invention as needed.
Processor 1580 is the control centre of wearable glasses, utilizes the entire wearable glasses of various interfaces and connection Various pieces, by running or execute the software program and/or module that are stored in memory 1520, and call and be stored in Data in memory 1520 execute the various functions and processing data of wearable glasses, whole to be carried out to wearable glasses Body monitors.Optionally, processor 1580 may include one or more processing units；Preferably, processor 1580 can integrate application Processor and modem processor, wherein the main processing operation system of application processor, user interface and application program etc., Modem processor mainly handles wireless communication.It is understood that above-mentioned modem processor can not also be integrated into In processor 1580.
Wearable glasses further include the power supply 1590 (such as battery) powered to all parts, it is preferred that power supply can lead to Cross power-supply management system and processor 1580 be logically contiguous, to by power-supply management system realize management charging, electric discharge and The functions such as power managed.
Although being not shown, wearable glasses can also include camera, microphone, bluetooth module etc., and details are not described herein.
In embodiments of the present invention, which includes
Processor 1580；
Camera；
Microphone；
Memory 1520 for storing processor-executable instruction；
Wherein, the processor 1580 is configured as：
In live streaming, the field-of-view mode switching command for receiving acquisition video data；
The coding for stopping live data sending the field-of-view mode switching command to camera, and the live data is to take the photograph The audio data that the video data and microphone acquired as head acquires；
Field-of-view mode is switched to and is cut with the field-of-view mode after receiving the field-of-view mode switching command by camera Change the corresponding field-of-view mode of instruction, the video data after acquisition switching field-of-view mode；
Restore the coding of live data.
A kind of Transmission system of live data provided in an embodiment of the present invention, including：
Wearable glasses, for by any one of above-described embodiment transmission method, being sent out to live streaming streaming server Send transport protocol frame data；
Streaming server is broadcast live, for receiving the transport protocol frame data, to transport protocol frame number described in client push According to.
The realization process of the Transmission system of the live data specifically refers to above-described embodiment, and details are not described herein.
It should be understood that although each step in the flow chart of attached drawing is shown successively according to the instruction of arrow, These steps are not that the inevitable sequence indicated according to arrow executes successively.Unless expressly stating otherwise herein, these steps Execution there is no stringent sequences to limit, can execute in the other order.Moreover, at least one in the flow chart of attached drawing Part steps may include that either these sub-steps of multiple stages or stage are not necessarily in synchronization to multiple sub-steps Completion is executed, but can be executed at different times, execution sequence is also not necessarily to be carried out successively, but can be with other Either the sub-step of other steps or at least part in stage execute step in turn or alternately.
The above is only some embodiments of the present invention, it is noted that for the ordinary skill people of the art For member, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications are also answered It is considered as protection scope of the present invention.

Claims (10)

1. a kind of field-of-view mode switching method of wearable glasses, which is characterized in that include the following steps：
In live streaming, the field-of-view mode switching command of acquisition video data is received；
Stop the coding of live data, the live data includes video data and audio data；
Field-of-view mode is switched into field-of-view mode corresponding with the field-of-view mode switching command, after acquisition switches field-of-view mode Video data；
Restore the coding of live data.
2. field-of-view mode switching method according to claim 1, which is characterized in that the method further includes：
The configuration information of the video sensor of setting acquisition video data, field-of-view mode initialization is carried out according to the configuration information Processing；
Wherein, the configuration information includes field-of-view mode, and with the one-to-one frame per second of the field-of-view mode, output window position With size；The field-of-view mode includes being not limited to close shot, medium shot and distant view.
3. field-of-view mode switching method according to claim 1, which is characterized in that described receive acquires video data Field-of-view mode switching command, including：
The field-of-view mode switching command that this terminal is pressed in physical button is obtained, confirms the visual angle mould pressed on the button Formula switching command is by field-of-view mode switching command as far as close field-of-view mode switching command or from the near to the remote.
4. a kind of transmission method of live data, which is characterized in that include the following steps：
Field-of-view mode switching method described in claim 1-3 any one；With
Live data is encoded, I frame data and corresponding coded audio data are obtained；
Using the I frame data and corresponding coded audio data as transport protocol frame data, sends and pass to live streaming streaming server Defeated agreement frame data.
5. the transmission method of live data according to claim 4, which is characterized in that described to be compiled to live data Code obtains I frame data and corresponding coded audio data, including：
Obtain the video data and audio data in the live data after switching field-of-view mode；
Video data and audio data are encoded respectively using DSP Video codings and AAC audio codings, obtain I frame data And corresponding coded audio data.
6. the transmission method of live data according to claim 5, which is characterized in that it is described using DSP Video codings and AAC audio codings respectively encode video data and audio data, obtain I frame data and corresponding audio coding number According to, including：
Video data is encoded using DSP Video codings, obtains the I frame data exported in chronological order, P frame data and right The first time stamp answered；
Audio data is encoded using AAC audio codings, obtains coded audio data and corresponding second timestamp；
Judgements is synchronized by using first time stamp and second timestamp, acquisition I frame data and corresponding Coded audio data.
7. a kind of transmission method of live data, which is characterized in that including：
Wearable glasses send transport protocol by transmission method described in claim 4-6 any one, to live streaming streaming server Frame data；
Streaming server is broadcast live and receives the transport protocol frame data, to transport protocol frame data described in client push.
8. a kind of field-of-view mode switching device of wearable glasses, which is characterized in that including：
Command reception module：For in live streaming, receiving the field-of-view mode switching command of acquisition video data；
Encode stopping modular：Coding for stopping live data, the live data include video data and audio data；
Field-of-view mode handover module：For field-of-view mode to be switched to visual angle mould corresponding with the field-of-view mode switching command Formula, acquisition switch the video data after field-of-view mode；
Code restoration module：Coding for restoring live data.
9. a kind of transmitting device of live data, which is characterized in that including：
Field-of-view mode switching device according to any one of claims 8；With
Coding module：For being encoded to live data, I frame data and corresponding coded audio data are obtained；
Sending module：For using the I frame data and corresponding coded audio data as transport protocol frame data, to live TV stream Server sends transport protocol frame data.
10. a kind of wearable glasses, which is characterized in that it includes：
Processor；
Camera；
Microphone；
Memory for storing processor-executable instruction；
Wherein, the processor is configured as：
In live streaming, the field-of-view mode switching command for receiving acquisition video data；
The coding for stopping live data sending the field-of-view mode switching command to camera, and the live data is camera The audio data of video data and the microphone acquisition of acquisition；
Field-of-view mode is switched to and is referred to field-of-view mode switching after receiving the field-of-view mode switching command by camera Enable corresponding field-of-view mode, the video data after acquisition switching field-of-view mode；
Restore the coding of live data.
CN201810547833.8A 2018-05-31 2018-05-31 Field-of-view mode switching method, the transmission method of device and live data, device Pending CN108810559A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810547833.8A CN108810559A (en) 2018-05-31 2018-05-31 Field-of-view mode switching method, the transmission method of device and live data, device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810547833.8A CN108810559A (en) 2018-05-31 2018-05-31 Field-of-view mode switching method, the transmission method of device and live data, device

Publications (1)

Publication Number Publication Date
CN108810559A true CN108810559A (en) 2018-11-13

Family

ID=64089782

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810547833.8A Pending CN108810559A (en) 2018-05-31 2018-05-31 Field-of-view mode switching method, the transmission method of device and live data, device

Country Status (1)

Country Link
CN (1) CN108810559A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111450522A (en) * 2019-01-22 2020-07-28 电子技术公司 Controlling character movement in a video game
CN114025204A (en) * 2021-11-08 2022-02-08 北京量子之歌科技有限公司 Live video switching method, device, equipment and storage medium
CN114866787A (en) * 2022-07-04 2022-08-05 深圳市必提教育科技有限公司 Live broadcast implementation method and system
CN115174943A (en) * 2022-07-08 2022-10-11 叠境数字科技（上海）有限公司 Free visual angle playing method and system based on edge cloud cooperation and client self-adaption

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105744293A (en) * 2016-03-16 2016-07-06 北京小米移动软件有限公司 Video live broadcast method and device
CN105828091A (en) * 2016-03-28 2016-08-03 广州华多网络科技有限公司 Method and system for video program playing in network broadcast
CN105866966A (en) * 2016-06-14 2016-08-17 昆山罗伯斯特机器人科技有限公司 Panoramic three-dimensional stereoscopic glasses automatically switching visual angle
CN106412662A (en) * 2016-09-20 2017-02-15 腾讯科技（深圳）有限公司 Timestamp distribution method and device
CN106470343A (en) * 2016-09-29 2017-03-01 广州华多网络科技有限公司 Live video stream long-range control method and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105744293A (en) * 2016-03-16 2016-07-06 北京小米移动软件有限公司 Video live broadcast method and device
CN105828091A (en) * 2016-03-28 2016-08-03 广州华多网络科技有限公司 Method and system for video program playing in network broadcast
CN105866966A (en) * 2016-06-14 2016-08-17 昆山罗伯斯特机器人科技有限公司 Panoramic three-dimensional stereoscopic glasses automatically switching visual angle
CN106412662A (en) * 2016-09-20 2017-02-15 腾讯科技（深圳）有限公司 Timestamp distribution method and device
CN106470343A (en) * 2016-09-29 2017-03-01 广州华多网络科技有限公司 Live video stream long-range control method and device

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111450522A (en) * 2019-01-22 2020-07-28 电子技术公司 Controlling character movement in a video game
CN111450522B (en) * 2019-01-22 2024-03-08 电子技术公司 Controlling character movement in video games
CN114025204A (en) * 2021-11-08 2022-02-08 北京量子之歌科技有限公司 Live video switching method, device, equipment and storage medium
CN114025204B (en) * 2021-11-08 2024-02-13 北京量子之歌科技有限公司 Live video switching method, device, equipment and storage medium
CN114866787A (en) * 2022-07-04 2022-08-05 深圳市必提教育科技有限公司 Live broadcast implementation method and system
CN115174943A (en) * 2022-07-08 2022-10-11 叠境数字科技（上海）有限公司 Free visual angle playing method and system based on edge cloud cooperation and client self-adaption
CN115174943B (en) * 2022-07-08 2023-10-31 叠境数字科技（上海）有限公司 Free view angle playing method and system with edge cloud cooperation and client self-adaption

Similar Documents

Publication Publication Date Title
US9924205B2 (en) Video remote-commentary synchronization method and system, and terminal device
CN108810559A (en) Field-of-view mode switching method, the transmission method of device and live data, device
CN105847913B (en) A kind of method, mobile terminal and system controlling net cast
CN104967801B (en) A kind of video data handling procedure and device
CN107770438B (en) A kind of photographic method and mobile terminal
CN110636375B (en) Video stream processing method and device, terminal equipment and computer readable storage medium
CN109040643B (en) Mobile terminal and remote group photo method and device
CN106412681B (en) Live bullet screen video broadcasting method and device
CN106210754B (en) Method, server, mobile terminal, system and storage medium for controlling live video
CN106412691B (en) Video image intercepting method and device
CN106412702B (en) Video clip intercepting method and device
WO2018192415A1 (en) Data live broadcast method, and related device and system
CN107566730B (en) A kind of panoramic picture image pickup method and mobile terminal
CN106412687B (en) Method and device for intercepting audio and video clips
EP2985980B1 (en) Method and device for playing stream media data
CN109992231A (en) Throw screen method and terminal
CN110099213A (en) A kind of image display control method and terminal
CN104777991A (en) Remote interactive projection system based on mobile phone
CN108920084A (en) Visual field control method and device in a kind of game
CN108924412B (en) Shooting method and terminal equipment
CN108881920B (en) Method, terminal and server for transmitting video information
RU2745737C1 (en) Video recording method and video recording terminal
US20220222881A1 (en) Video display device and display control method for same
CN104036536A (en) Generating method and apparatus of stop motion animation
CN110536175A (en) A kind of code rate switching method and apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20181113