CN108900893A - A kind of image processing method and device - Google Patents

A kind of image processing method and device Download PDF

Info

Publication number
CN108900893A
CN108900893A CN201810934851.1A CN201810934851A CN108900893A CN 108900893 A CN108900893 A CN 108900893A CN 201810934851 A CN201810934851 A CN 201810934851A CN 108900893 A CN108900893 A CN 108900893A
Authority
CN
China
Prior art keywords
terminal
indicate
area
information
picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810934851.1A
Other languages
Chinese (zh)
Inventor
陈松
孙会
汤世祥
王海坤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
iFlytek Co Ltd
Original Assignee
iFlytek Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by iFlytek Co Ltd filed Critical iFlytek Co Ltd
Priority to CN201810934851.1A priority Critical patent/CN108900893A/en
Publication of CN108900893A publication Critical patent/CN108900893A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone

Abstract

The present invention provides a kind of image processing method and device, in the case where getting the first picture that first terminal obtains, intercept the image content in the first area of the first picture, image content in the first area intercepted is sent to second terminal, that is for any first picture that first terminal obtains, the image content for being sent to second terminal is image content in the first area of the first picture, the data volume sent to second terminal is reduced for compared with the existing technology, to reduce the transmission bandwidth of power consumption and occupancy, and the probability for transmission congestion occur can also be reduced in the case where data volume reduces.If furthermore first terminal obtains first picture with multi-angle, the information that every change is once used to indicate viewing areas can then show the different image contents in the first picture, to realize comprehensive displaying of the information by changing instruction viewing areas to the first picture, the experience of completely new browsing multi-angle picture is thus brought for user.

Description

A kind of image processing method and device
Technical field
The invention belongs to image processing technologies and communication technique field, more specifically more particularly to a kind of picture Processing method and processing device.
Background technique
Various types of information such as picture, video and text can be transmitted between terminal at present, the mode of transmission information can To be：Can directly transmit between terminal can transmit information by means of relay device (such as server) between information or terminal.
For transmitting picture between terminal, as terminal is sent, another terminal is used as to be received eventually one of terminal End sends the picture that terminal can be obtained and is sent to reception eventually by sending terminal and receiving the communication channel between terminal End sends terminal and needs to send picture by means of relay device, when the communication when the communication channel is constructed by relay device When channel is constructed not over relay device, picture can be directly transmitted to receiving terminal by sending terminal.But it is transmitted between terminal It is big that there are power consumptions when picture, and leads to the problem of transmission congestion occur because the transmission belt of occupancy is roomy.
Summary of the invention
In view of this, the purpose of the present invention is to provide a kind of image processing method and device, for reducing power consumption and The transmission bandwidth of occupancy, to reduce the probability for transmission congestion occur.Technical solution is as follows：
The present invention provides a kind of image processing method, the method includes：
Obtain the first picture that first terminal obtains；
Intercept the image content in the first area of first picture, in first picture except the first area it Image content in other outer regions retains；
Image content in the first area intercepted is sent to second terminal.
Preferably, the method also includes：Obtain the letter for being used to indicate the viewing areas that the second terminal corresponds to user Breath；
According to the information for being used to indicate the second terminal and corresponding to the viewing areas of user, firstth area is determined Domain, so that the image content in the first area determined includes at least the second terminal and corresponds to the desired viewing of user Content.
Preferably, the information for being used to indicate the viewing areas that the second terminal corresponds to user includes：It is used to indicate The rotation information of the second terminal rotational case and/or the propulsion information for being used to indicate the second terminal propulsion situation；
The information for being used to indicate the second terminal according to and corresponding to the viewing areas of user, determines described first Region includes：Range is intercepted according to the rotation information and predetermined first that are used to indicate the second terminal rotational case, Determine the first area；
Or the propulsion information of situation and predetermined second is promoted to intercept model according to the second terminal is used to indicate It encloses, determines the first area；
Or according to the rotation information that is used to indicate the second terminal rotational case and predetermined first section described Range is taken, determines the second area in first picture, and according to the propulsion for being used to indicate the second terminal propulsion situation Information and the predetermined second interception range, determine the first area from the second area.
Preferably, the method also includes：Obtain the letter for being used to indicate the viewing areas that the second terminal corresponds to user Breath, the information for being used to indicate the viewing areas that the second terminal corresponds to user include：It is used to indicate the second terminal The rotation information of rotational case and/or the propulsion information for being used to indicate the second terminal propulsion situation；
Image content in the first area of the interception first picture includes：It is being used to indicate the second terminal The rotation information of rotational case meets default rotating condition and/or is used to indicate the propulsion information that the second terminal promotes situation In the case where meeting default propulsioning condition, the image content in the first area of first picture is intercepted.
Preferably, the rotation information for being used to indicate the second terminal rotational case includes：The second terminal Rotate angle；
In the case where the rotation information for being used to indicate the second terminal rotational case meets default rotating condition, interception Image content in the first area of first picture includes：It is greater than default redundancy angle in the rotation angle of the second terminal In the case where degree, the image content in the first area of first picture is intercepted, the default redundancy angle is according to institute The angle that stating the corresponding angle in first area and the second terminal can show obtains；
Or
It is described to be used to indicate the second terminal and promote the propulsion information of situation to include：The advancing distance of the second terminal From；
In the case where being used to indicate the second terminal and the propulsion information of situation being promoted to meet default propulsioning condition, interception Image content in the first area of first picture includes：It is greater than default advancing distance in the advance distance of the second terminal From in the case where, the image content in the first area of first picture is intercepted.
Preferably, the image content in the first area that will be intercepted is sent to second terminal and includes：
Image content in the first area is encoded, the image content obtained in the first area is corresponding Coded data；
The coded data is packaged in Realtime Transport Protocol data packet, and in the Realtime Transport Protocol data packet In be packaged for the instruction interception changed information of content, the interception changed information of content that is used to indicate is for referring to Show that the second terminal terminates the picture gone out using last decoding and rebuilding；
The coded data will be packaged with and is used to indicate the real-time transport protocol number of the interception changed information of content Second terminal is sent to according to packet.
The present invention also provides a kind of image processing method, the method includes：
The image content in the first area of the first picture is obtained, first picture is obtained by first terminal, and institute The image content stated in first area intercepts to obtain by the first terminal or server；
The image content in the first area is shown by second terminal.
Preferably, the method also includes：Obtain the letter for being used to indicate the viewing areas that the second terminal corresponds to user Breath, the information for being used to indicate the viewing areas that the second terminal corresponds to user are used to determine the first area；
By it is described be used to indicate the second terminal correspond to user viewing areas Information encapsulation in preset data, institute Stating preset data is session protocol signaling or Realtime Transport Protocol data packet；
It is sent by the second terminal and is packaged with the letter for being used to indicate the viewing areas that the second terminal corresponds to user The preset data of breath.
Preferably, the method also includes：Acquisition be used to indicate the second terminal be being capable of multi-faceted presentation viewing area The information of the terminal in domain, it is described to be used to indicate the second terminal to be capable of the information of the multi-faceted terminal that viewing areas is presented and using The image content in the first area is intercepted in triggering；
It is to be capable of the Information encapsulation of the multi-faceted terminal that viewing areas is presented in session that the second terminal, which will be used to indicate, In protocol signaling；
By the second terminal transmission be packaged be used to indicate the second terminal be being capable of multi-faceted presentation viewing area The session protocol signaling of the information of the terminal in domain.
Preferably, the image content in the first area for obtaining the first picture includes：
The corresponding coded data of image content in the first area is obtained, the coded data is packaged in real-time Transmission In protocol data packet；
It is packaged in the Realtime Transport Protocol data packet when being used to indicate the interception changed information of content, to institute Coded data is stated to be decoded, obtain include image content in first area reconstruction picture.
The present invention also provides a kind of picture processing unit, described device includes：
Acquiring unit, the first picture obtained for obtaining first terminal；
Interception unit, the image content in first area for intercepting first picture remove in first picture Image content in other regions except the first area retains；
Transmission unit, for the image content in the first area intercepted to be sent to second terminal.
Preferably, the acquiring unit is also used to acquisition and is used to indicate the viewing areas that the second terminal corresponds to user Information；
Described device further includes：Determination unit corresponds to the sight of user for being used to indicate the second terminal according to The information for seeing region determines the first area, so that the image content in the first area determined includes at least institute It states second terminal and corresponds to the content that user wants viewing.
Preferably, the information for being used to indicate the viewing areas that the second terminal corresponds to user includes：It is used to indicate The rotation information of the second terminal rotational case and/or the propulsion information for being used to indicate the second terminal propulsion situation；
The determination unit is used to indicate the rotation information of the second terminal rotational case for basis and predefines First interception range, determine the first area；
Or the determination unit, for according to the propulsion information for being used to indicate the second terminal propulsion situation and in advance The second determining interception range, determines the first area；
Or the determination unit, for according to being used to indicate the rotation information of the second terminal rotational case and described Predetermined first interception range, determines the second area in first picture, and whole according to being used to indicate described second End promotes the propulsion information of situation and described predetermined second to intercept range, and described first is determined from the second area Region.
Preferably, the acquiring unit is also used to acquisition and is used to indicate the viewing areas that the second terminal corresponds to user Information, the information for being used to indicate the viewing areas that the second terminal corresponds to user includes：It is used to indicate described second The rotation information of terminal rotating situation and/or the propulsion information for being used to indicate the second terminal propulsion situation；
The interception unit, for meeting default rotation in the rotation information for being used to indicate the second terminal rotational case In the case that condition and/or the propulsion information for being used to indicate the second terminal propulsion situation meet default propulsioning condition, interception Image content in the first area of first picture.
Preferably, the rotation information for being used to indicate the second terminal rotational case includes：The second terminal Rotate angle；
The interception unit, for cutting in the case where the rotation angle of the second terminal is greater than default redundancy angle The image content in the first area of first picture is taken, the default redundancy angle is corresponding according to the first area Angle and the angle that can show of the second terminal obtain；
Or
It is described to be used to indicate the second terminal and promote the propulsion information of situation to include：The advancing distance of the second terminal From；
The interception unit, for cutting in the case where the advance distance of the second terminal is greater than default advance distance Take the image content in the first area of first picture.
Preferably, described device further includes：Coding unit, for being compiled to the image content in the first area Code, obtains the corresponding coded data of image content in the first area；
Encapsulation unit, for the coded data to be packaged in Realtime Transport Protocol data packet, and described real-time The instruction interception changed information of content is packaged in transmission protocol data packet, the interception content that is used to indicate becomes The information of change is used to indicate the second terminal and terminates the picture gone out using last decoding and rebuilding；
The transmission unit, for that will be packaged with the coded data and be used to indicate the interception changed information of content Realtime Transport Protocol data packet be sent to second terminal.
The present invention also provides a kind of picture processing unit, described device includes：
Acquiring unit, the image content in first area for obtaining the first picture, first picture pass through first Terminal obtains, and the image content in the first area intercepts to obtain by the first terminal or server；
Display unit, for showing the image content in the first area by second terminal.
Preferably, the acquiring unit is also used to acquisition and is used to indicate the viewing areas that the second terminal corresponds to user Information, it is described be used to indicate the second terminal correspond to user viewing areas information for determining the first area；
Described device further includes：Encapsulation unit, for by the viewing for being used to indicate the second terminal and corresponding to user For the Information encapsulation in region in preset data, the preset data is session protocol signaling or Realtime Transport Protocol data packet；
Transmission unit is used to indicate the second terminal and corresponds to user's for being packaged with by second terminal transmission The preset data of the information of viewing areas.
Preferably, the acquiring unit, be also used to obtain be used to indicate the second terminal be being capable of multi-faceted presentations sight See the information of the terminal in region, it is described to be used to indicate the second terminal to be capable of the letter of the multi-faceted terminal that viewing areas is presented Breath is for triggering the image content intercepted in the first area；
Described device further includes：Encapsulation unit, for will be used to indicate the second terminal be being capable of multi-faceted presentations sight See the Information encapsulation of the terminal in region in session protocol signaling；
Transmission unit, for by the second terminal transmission be packaged be used to indicate the second terminal be can be multi-party The session protocol signaling of the information of the terminal of viewing areas is presented in position.
Preferably, the acquiring unit, for obtaining the corresponding coded data of image content in the first area, It is packaged in the Realtime Transport Protocol data packet when being used to indicate the interception changed information of content, to the coded data Be decoded, obtain include image content in first area reconstruction picture, the coded data is packaged in real-time Transmission association It discusses in data packet.
The present invention also provides a kind of terminal, the terminal includes：Processor and memory；
The processor intercepts the image content in the first area of first picture for the first picture of acquisition, and The image content in intercepted first area is sent, in other regions in first picture in addition to the first area Image content retain；
The memory, for storing the image content in first picture and the first area.
Preferably, the processor, is also used to obtain and is used to indicate the viewing areas that the second terminal corresponds to user Information, and according to the information for being used to indicate the second terminal and corresponding to the viewing areas of user, determine the first area, So that the image content in the first area determined includes at least the second terminal and corresponds to the interior of the desired viewing of user Hold.
Preferably, the information for being used to indicate the viewing areas that the second terminal corresponds to user includes：It is used to indicate The rotation information of the second terminal rotational case and/or the propulsion information for being used to indicate the second terminal propulsion situation；
The processor, for according to being used to indicate the rotation information of the second terminal rotational case and predetermined First interception range, determines the first area；Or according to the propulsion information for being used to indicate the second terminal propulsion situation With predetermined second interception range, the first area is determined；Or feelings are rotated according to the second terminal is used to indicate The rotation information of condition and the predetermined first interception range, determine the second area in first picture, and according to Being used to indicate the second terminal promotes the propulsion information of situation and described predetermined second to intercept range, from described second The first area is determined in region.
Preferably, the processor, for obtaining the letter for being used to indicate the viewing areas that the second terminal corresponds to user Breath, the information for being used to indicate the viewing areas that the second terminal corresponds to user include：It is used to indicate the second terminal The rotation information of rotational case and/or the propulsion information for being used to indicate the second terminal propulsion situation；
The processor meets default rotating condition in the rotation information for being used to indicate the second terminal rotational case And/or in the case where being used to indicate the default propulsioning condition of propulsion information satisfaction that the second terminal promotes situation, described in interception Image content in the first area of first picture.
Preferably, the rotation information for being used to indicate the second terminal rotational case includes：The second terminal Rotate angle；
The processor, for intercepting in the case where the rotation angle of the second terminal is greater than default redundancy angle Image content in the first area of first picture, the default redundancy angle are corresponding according to the first area The angle that angle and the second terminal can be shown obtains；
Or
It is described to be used to indicate the second terminal and promote the propulsion information of situation to include：The advancing distance of the second terminal From；
The processor, for intercepting in the case where the advance distance of the second terminal is greater than default advance distance Image content in the first area of first picture.
Preferably, the processor obtains described first for encoding to the image content in the first area The corresponding coded data of image content in region, the coded data is packaged in Realtime Transport Protocol data packet, and It is packaged for the instruction interception changed information of content in the Realtime Transport Protocol data packet, the coding will be packaged with Data and the Realtime Transport Protocol data packet for being used to indicate the interception changed information of content are sent to second terminal, the use The second terminal, which is used to indicate, in the instruction interception changed information of content terminates the figure gone out using last decoding and rebuilding Piece.
The present invention also provides a kind of storage medium, computer program code, the calculating are stored on the storage medium Machine program code realizes above-mentioned image processing method when executing.
From above-mentioned technical proposal it is found that in the case where getting the first picture that first terminal obtains, the first figure is intercepted Image content in the first area intercepted is sent to second terminal by the image content in the first area of piece, that is, It says for any first picture that first terminal obtains, the image content for being sent to second terminal is the firstth area of the first picture Image content in domain, compared with the existing technology for reduce to second terminal send data volume, thus reduce power consumption and The transmission bandwidth of occupancy, and the probability for transmission congestion occur can also be reduced in the case where data volume reduces.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is the present invention Some embodiments for those of ordinary skill in the art without creative efforts, can also basis These attached drawings obtain other attached drawings.
Fig. 1 is a kind of flow chart of image processing method provided in an embodiment of the present invention；
Fig. 2 is the schematic diagram of area change in the first picture provided in an embodiment of the present invention；
Fig. 3 is the flow chart of another image processing method provided in an embodiment of the present invention；
Fig. 4 is a kind of signaling diagram of image processing method provided in an embodiment of the present invention；
Fig. 5 is a kind of schematic diagram of SDP signaling provided in an embodiment of the present invention；
Fig. 6 is the signaling diagram of another image processing method provided in an embodiment of the present invention；
Fig. 7 is the schematic diagram of another kind SDP signaling provided in an embodiment of the present invention；
Fig. 8 is the schematic diagram in the packet header of RTP data packet provided in an embodiment of the present invention；
Fig. 9 is the schematic diagram of the expansion in the packet header of RTP data packet provided in an embodiment of the present invention；
Figure 10 is the schematic diagram of the scene of image processing method provided in an embodiment of the present invention；
Figure 11 is a kind of structural schematic diagram of picture processing unit provided in an embodiment of the present invention；
Figure 12 is the structural schematic diagram of another picture processing unit provided in an embodiment of the present invention；
Figure 13 is the structural schematic diagram of another picture processing unit provided in an embodiment of the present invention；
Figure 14 is the structural schematic diagram of another picture processing unit provided in an embodiment of the present invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art Every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
Referring to Fig. 1, passing through reduction it illustrates a kind of flow chart of image processing method provided in an embodiment of the present invention The mode of the data volume of transmission reduces the transmission bandwidth of power consumption and occupancy, the image processing method can by terminal (as To the terminal of the first picture) or server execution, it may comprise steps of：
101：Obtain the first picture that first terminal obtains.The first picture that wherein first terminal obtains can be first eventually The first picture for taking is held, if first terminal is the terminal with multi-angle camera function, such first terminal can be with It shoots to obtain first picture with multi-angle by the multi-angle camera function, such as obtains 360 degree of panoramic pictures Or 720 degree of panoramic pictures etc..Certain first terminal can also obtain picture by other means, if first terminal is by means of other Picture collection equipment obtains the first picture or first terminal and downloads a picture from picture library as the first picture.
In the case where executing the image processing method of the present embodiment by terminal, the first picture be can be by first terminal Acquisition module obtain, image processing method is then executed by the processor in terminal, if by server execute picture processing Method can then be sent to server process after first terminal obtains the first picture, or is actively obtained by server One picture, concrete mode the present embodiment are without restriction.
102：The image content in the first area of the first picture is intercepted, wherein in the first picture in addition to first area Image content in other regions retains, that is to say, that the first picture can be divided into multiple regions, in this multiple regions only The image content in a region is intercepted, the image content in other regions retains.First area, are divided into the first picture For two regions and third region, from the image content intercepted in these three regions in first area, second area and third area Image content in domain retains, and realizes the interception to partial picture content in the first picture.
Need exist for explanation be a bit：Each region in first picture can change at random, if Fig. 2 is with the first picture It is divided into for first area, second area and third region, situation of these three regions in the first picture is to can change , such as change in these three regions at least two regions at least two in the position and/or these three regions in the first picture The area size in region, the image content of interception can be changed, to change simultaneously first area and second area such as in Fig. 2 Position, first area and second area area size for be illustrated, for other situations, this embodiment is not repeated.
103：Image content in the first area intercepted is sent to second terminal.
Corresponding second terminal is in the case where receiving the image content in first area, treatment process such as Fig. 3 It is shown, the flow chart of another image processing method provided in an embodiment of the present invention is shown, may comprise steps of：
301：The image content in the first area of the first picture is obtained, wherein the first picture is obtained by first terminal, And the image content in first area intercepts to obtain by first terminal or server so that second terminal receive first terminal or The image content that server is sent.
302：The image content in first area is shown by second terminal, such as first area is shown by second terminal In image content or second terminal by means of other display technologies, such as throw screen technology, shadow casting technique, virtual reality At least one of (Virtual Reality, VR) technology and reality enhancing (Augmented Reality, AR) technology technology To export the image content in first area.
From above-mentioned technical proposal it is found that in the case where getting the first picture that first terminal obtains, the first figure is intercepted Image content in the first area intercepted is sent to second terminal by the image content in the first area of piece, that is, It says for any first picture that first terminal obtains, the image content for being sent to second terminal is the firstth area of the first picture Image content in domain, compared with the existing technology for reduce to second terminal send data volume, thus reduce power consumption and The transmission bandwidth of occupancy, and the probability for transmission congestion occur can also be reduced in the case where data volume reduces.
Below using first terminal as transmitting terminal, second terminal by transmission end intercepts image content, passes through as receiving end Server is sent to for the output of receiving end, and image processing method provided in this embodiment is described in detail.As shown in Figure 4 The signaling diagram of image processing method, it illustrates first terminals to carry out the interception process of first time interception to the first picture, can be with Include the following steps：
401：It is to be capable of the information of the multi-faceted terminal that viewing areas is presented that second terminal, which obtains and is used to indicate second terminal, Wherein being used to indicate second terminal is to be capable of the information of the multi-faceted terminal that viewing areas is presented for triggering interception first area In image content.
In the present embodiment, second terminal can be but be not limited to be capable of the multi-faceted terminal that viewing areas is presented： It can be by the corresponding different viewing areas of rotation, so that the viewing areas that second terminal corresponds to user is different.Second terminal passes through The mode of the corresponding different viewing areas of rotation can be：Rotating device is provided in second terminal, by controlling the rotating device Rotation realize rotation to second terminal so that second terminal correspond to the different viewing areas of user, or pass through pair The rotation of preset component is in second terminal to change the viewing areas that second terminal corresponds to user, as preset component can be second The operating element of terminal changes the viewing areas or second terminal that second terminal corresponds to user by rotation operating element It can be a wearable device, change the viewing areas of second terminal by wearing user's rotation of wearable device. By taking second terminal is a VR equipment as an example, in the case where the VR equipment is worn on the head of user, head can be passed through It rotates to change the viewing areas that second terminal corresponds to user, or is one operating element of VR device configuration, pass through rotation and grasp Control component can vary in the viewing areas that the VR equipment corresponds to user.
Wherein be used to indicate second terminal be capable of it is multi-faceted present viewing areas information can include but is not limited to：For The information for indicating second terminal rotatory power such as indicates that second terminal is rotated by the rotatable angular range of second terminal Ability.In extended field included by box as shown in Figure 5, pass through " a=angle in extended field：" field carries second The rotatable angular range of terminal illustrates that second terminal does not have rotatory power, thus really if the content of the field is sky Determine second terminal cannot multi-faceted presentation viewing areas, it is as shown in Figure 5 360 (being only citing) if the content non-empty of the field Illustrate that second terminal has rotatory power, thereby determines that second terminal being capable of multi-faceted presentation viewing areas.
Or be used to indicate second terminal be capable of it is multi-faceted present viewing areas information can include but is not limited to：For The information for indicating second terminal propulsion capability, is such as indicated by the distance range that can be promoted of second terminal.Actually answering It in, can also be realized by extended field mode, such as increase extended field " b=advance：" carry second terminal The distance range that can be promoted illustrates that second terminal does not have propulsion capability if the content of the field is sky, thereby determines that the Two terminals cannot multi-faceted presentation viewing areas, if the content non-empty of the field, illustrates that second terminal has propulsion capability, by This determines that second terminal being capable of multi-faceted presentation viewing areas.
Certainly, be used to indicate second terminal be capable of it is multi-faceted present viewing areas information can also include：It is used to indicate The information of second terminal rotatory power and the information for being used to indicate second terminal propulsion capability, are no longer described in detail this present embodiment.
402：It is to be capable of the information envelope of the multi-faceted terminal that viewing areas is presented that second terminal, which will be used to indicate second terminal, Loaded in session protocol signaling.As session protocol signaling can be session initiation protocol (Seesion Initiation Protocol, SIP) and Session Description Protocol (Session Description Protocol, SDP) signaling in it is any one Kind.
In the present embodiment, being packaged for instruction second terminal is to be capable of the information of the multi-faceted terminal that viewing areas is presented A kind of mode be：By the Information encapsulation in the extended field of session protocol signaling, as shown in figure 5, increasing in SDP signaling Extended field (being extended field in box) " a=angle：" indicate whether second terminal being capable of multi-faceted presentation viewing area It is realized with capableing of the second terminal of multi-faceted presentation viewing areas by being compatible with to the extension of existing session protocol signaling in domain Conventional terminal (i.e. can not the multi-faceted terminal that viewing areas is presented) and multi-faceted can be presented in the same session protocol signaling The compatibility of the terminal of viewing areas.
Herein it should be noted is that：If first terminal can not parse the extended field, illustrate that first terminal can not root Corresponding image content is provided for second terminal according to the difference of the viewing areas of second terminal presentation, if first terminal can The extended field is parsed, illustrates that first terminal can be that second terminal mentions according to the difference of the viewing areas of second terminal presentation For corresponding image content, the same compatibility realized to two kinds of first terminal.
403：Second terminal by server will be packaged be used to indicate second terminal be being capable of multi-faceted presentation viewing area The session protocol signaling of the information of the terminal in domain is sent to first terminal.Furthermore it removes to be packaged in session protocol signaling and be used to indicate In the case that second terminal is the information for the terminal for capableing of multi-faceted presentation viewing areas, other can also be encapsulated at picture The information of reason is believed so that first terminal and second terminal pass through session protocol such as coding of graphics parameter and picture decoding parametric It enables to negotiate parameter needed for picture is handled.
404：First terminal is in the case where determining second terminal is to be capable of the terminal of multi-faceted presentation viewing areas, first Terminal intercepts the image content in the first area of the first picture.Wherein first area can be one that first terminal is arbitrarily chosen A region is determining that second terminal is that multi-faceted can present if the first picture is divided into multiple regions in advance by first terminal In the case where the terminal of viewing areas, one is arbitrarily chosen from multiple regions as first area, and adjacent is chosen twice Region it is different or first terminal is after being divided into multiple regions for the first picture, this multiple regions is ranked up, from row Sequence is successively chosen in the region for 1 to n (the region sum of division).
405：First terminal encodes the image content in first area, obtains the image content pair in first area The coded data answered, for example, the coding of graphics parameter that can obtain through consultation of first terminal to the image content in first area into Row coding.
406：Coded data is packaged in real-time transport protocol (Real-time Transport by first terminal Protocol, RTP) in data packet, and first terminal can also be packaged in RTP data packet and be used to indicate interception content hair The information for changing, to indicate that the currently transmitted coded data of first terminal is different from the coded data that the last time sends, thus After second terminal receives the RTP data packet, carried in determining RTP data packet be used to indicate interception content change Information in the case where trigger second terminal and terminate the picture gone out using last decoding and rebuilding, and to the RTP being currently received Coded data in data packet is decoded.
407：First terminal will be packaged with coded data and be used to indicate the RTP data of the interception changed information of content Packet is sent to server.
408：Server will be packaged with coded data and be used to indicate the RTP data packet of the interception changed information of content It is sent to second terminal.
409：Second terminal obtains the corresponding coded data of image content in first area, solves to coded data Code, obtain include image content in first area reconstruction picture.As second terminal extracts coded number from RTP data packet According to, and be packaged in RTP data packet in the case where be used to indicate interception content changed information, coded data is carried out Decoding, obtain include image content in first area reconstruction picture, wherein can pass through when being decoded to coded data Negotiate obtained picture decoding parametric to be decoded coded data, obtain include image content in first area reconstruction figure Piece, if illustrating to intercept content in the case where not being packaged for the instruction interception changed information of content in RTP data packet There is no variations, and second terminal can continue to use the reconstruction picture that last decoding obtains at this time.
410：Second terminal shows the reconstruction picture including the image content in first area, such as direct by second terminal The reconstruction picture or second terminal that display includes the image content in first area such as throw screen by means of other display technologies At least one of technology, shadow casting technique, VR technology and AR technology technology exports reconstruction picture.
From above-mentioned technical proposal it is found that determining that second terminal is to be capable of the end of multi-faceted presentation viewing areas in first terminal In the case where end, the image content of first area can be intercepted from the first picture that first terminal obtains for second terminal exhibition Show, so that the data volume of the image content transmitted to second terminal is reduced, it is possible thereby to reduce the transmission belt of power consumption and occupancy Width, and the probability for transmission congestion occur can also be reduced in the case where data volume reduces.And the present embodiment passes through to session The extension of protocol signaling is realized to traditional second terminal (i.e. can not the multi-faceted terminal that viewing areas is presented) and can be multi-party The compatibility of the second terminal of viewing areas is presented in position, likewise, being realized by the extension to session protocol signaling to traditional the One terminal (i.e. can not Multi-angle omnibearing shooting picture terminal) and be capable of Multi-angle omnibearing shoot picture first terminal Compatibility.
Referring to Fig. 6, it illustrates the signaling diagram of another image processing method provided in an embodiment of the present invention, the is illustrated One region is region relevant to the viewing areas of the corresponding user of second terminal, so that the image content of interception is that user wants to see The content seen, wherein image processing method shown in Fig. 6 may comprise steps of：
601：Second terminal obtains the information for being used to indicate the viewing areas that second terminal corresponds to user.Wherein it is used to indicate The information that second terminal corresponds to the viewing areas of user includes：Be used to indicate second terminal rotational case rotation information and/or It is used to indicate the propulsion information that second terminal promotes situation.
Why the viewing areas of user can be corresponded to using rotation information and/or propulsion information as instruction second terminal Information be because：In the case where second terminal different rotation angle and/or propulsion different distance, corresponding viewing areas It can change, by taking second terminal different rotation angle as an example, when second terminal is rotated to different angle, second terminal is true Orientation in real environment changes, so that user needs to rotate with the rotation of second terminal, can correspond to second in this way The display area of terminal, therefore its viewing areas for corresponding to user changes in the case where second terminal rotation, Jin Erke Rotation information to be determined as to be used to indicate the information for the viewing areas that second terminal corresponds to user.
The rotation information for being wherein used to indicate second terminal rotational case may include：The initial angle of second terminal, rotation At least one of gyration, direction of rotation, the corresponding viewing radian of second terminal.If being used to indicate second terminal rotational case Rotation information include direction of rotation, then should also simultaneously include rotation angle and second terminal it is corresponding viewing radian in one Kind, can determine first area.Be used to indicate second terminal promote situation propulsion information may include：Second terminal pushes away Into the direction of propulsion of distance, second terminal, for specifically including which information depending on the method for determination of first area, to this Without limiting in embodiment.
602：Second terminal by be used to indicate second terminal correspond to user viewing areas Information encapsulation in preset data In, wherein preset data is session protocol signaling or RTP data packet, and session protocol signaling can be above-mentioned SIP signaling and SDP Any one in signaling.
By taking SDP signaling as an example, it can increase by an extended field in SDP signaling to record and be used to indicate second terminal correspondence The information of the viewing areas of user, SDP signaling as shown in Figure 7 use " a=initial- in the extended field of the SDP signaling angle:" and " a=rotat-angle：" indicate, wherein " a=initial-angle:" field indicate second terminal it is initial Angle, " a=rotat-angle：" field indicate second terminal rotation angle.
When implementing image processing method, the initial angle of second terminal can be defaulted as 0, that is to say, that first terminal and Second terminal second terminal when carrying out the interaction of first time picture does not rotate, in this case the extended field of SDP signaling The field of the middle initial angle for indicating second terminal can be sky；If the initial angle for not defaulting second terminal is 0, need The initial angle that second terminal is written in the field of the initial angle of second terminal is indicated in the extended field of SDP signaling.
If by be used to indicate second terminal correspond to user viewing areas Information encapsulation in RTP data packet, can be with The packet header of RTP data packet is extended, it, thus can be right such as by flag bit X is set to 1 in the packet header of RTP data packet in Fig. 8 The packet header of RTP data packet is extended, and expansion is as shown in Figure 9.
Expansion write-in shown in Fig. 9 is used to indicate the information that second terminal corresponds to the viewing areas of user, in this reality It applies in example and is illustrated by taking direction of rotation and rotation angle as an example.Wherein d (1bit) field indicates rotation in expansion shown in Fig. 9 Turn direction, if d=0 indicates to reversely rotate, such as anticlockwise, d=1 expression is rotated in the forward direction, such as right rotation；Angle (8bit) field Indicate rotation angle.Furthermore there are one field c (1bit), c (1bit) field to be used to indicate interception for expansion shown in Fig. 9 Whether content changes, and such as c=0, shows that intercepting content changes, and such as c=1, shows to intercept content there is no variation, This part is written by first terminal, i.e., first terminal interception image content change in the case where, first terminal by its Field c (1bit) in the RTP data packet of transmission is set to 0.For d (1bit) field and Angle (8bit) in RTP data packet Field is then to be written in the case where second terminal rotation by second terminal, to notify that first is whole by reversed RTP data packet End carries out the change of first area.
From the description of above-mentioned SDP signaling and RTP data packet it is found that the present embodiment passes through to session protocol signaling or RTP number According to packet extension realize to be used to indicate second terminal correspond to user viewing areas information transmission, also need herein Bright is a bit：It further include extended field " a=render-angle in SDP signaling shown in above-mentioned Fig. 5 and Fig. 7:", which uses In the angle (angle being presented to the user) for indicating that second terminal can be shown, " a=trans-angle:" field list is shown as For the interception angle of predetermined first interception range, which shows the image content pair intercepted from the first picture The angular range answered.
The angle that above-mentioned interception angle and second terminal can be shown can be fixed value either variable value, such as intercept angle The value of degree can be 132 degree, or interception angle can be changed according to practical situations, such as according to current network shape State and at least one of image demand is determined.It is illustrated by taking network state as an example, setting network state and interception angle The corresponding relationship of degree, in this way in the case where getting current network state, according to the network-like of current network state and setting The corresponding relationship of state and interception angle, determines the corresponding interception angle of current network state, if " a in the extended field of SDP signaling =trans-angle:" field be sky, then it is assumed that use default value, such as above-mentioned 132 degree.Similarly in view of human eye angular field of view It is 120 degree, therefore " the a=render-angle in SDP signaling:" value can be such as 120 degree of a fixed value, either One variable value, such as " a=render-angle:" maximum value be 120 degree, to avoid the waste of the image content of interception. And the redundancy angle of human eye is 12 degree, and thus in the case where human eye angular field of view is 120 degree, interception angle is preferred 132 degree, may be implemented in this way to small angle rotation timely respond to and the smooth transition of big angle rotary.In practical applications If " a=render-angle in the extended field of SDP signaling:" field be sky, then it is assumed that use default value, such as above-mentioned 120 degree.
If indicating that second terminal corresponds to the information of the viewing areas of user with propulsion information, can also be wrapped in SDP signaling It includes for the extended field as predetermined second interception range, the second interception range can be interception width and interception is high At least one of degree etc., to this present embodiment to the first interception range and the second interception range without limiting.
Herein also it should be noted is that：It in the present embodiment can also be by session protocol signaling and RTP data packet It combines to send the information for being used to indicate the viewing areas that second terminal corresponds to user, it is such as logical in first terminal and second terminal It crosses in parameter needed for session protocol signaling negotiation picture is handled, first terminal interception figure for the first time is carried in session protocol signaling The information that second terminal corresponds to the viewing areas of user is used to indicate needed for piece content, for other times in addition to first time It is used to indicate the letter that second terminal corresponds to the viewing areas of user needed for number interception picture, then can be packaged in RTP data packet In.
If predetermined first interception range and/or the second interception range are a variable values, need becoming First terminal is notified in the case where change, a field is extended such as in the packet header of RTP data packet, for indicating the first interception range At least one of range is intercepted with second, naturally it is also possible to carry the value after variation in session protocol signaling.
603：Second terminal is used to indicate the present count of the information for the viewing areas that second terminal corresponds to user by being packaged with According to being sent to server.
604：Server is used to indicate the preset data of the information for the viewing areas that second terminal corresponds to user by being packaged with It is sent to first terminal.
605：First terminal obtains the information for being used to indicate the viewing areas that second terminal corresponds to user from preset data. Such as in the case where preset data is session protocol signaling, it can be extracted from extended field and be used to indicate second terminal correspondence The information of the viewing areas of user, such as above-mentioned initial angle, rotation angle and predetermined first interception range；In present count In the case where for RTP data packet, it can be extracted from the expansion in the packet header of RTP data packet, such as extract rotation angle With direction of rotation etc..
606：The information that first terminal corresponds to the viewing areas of user according to second terminal is used to indicate, determines the firstth area Domain, so that the image content in the first area determined includes at least second terminal and corresponds to the content that user wants viewing, by This can change first area in such a way that change is used to indicate the information of viewing areas, if first terminal obtains one in this way The first picture with multi-angle, every change are once used to indicate the information of viewing areas, can accordingly change in the picture of interception Hold, so that every change can once show the different content in the first picture, is used to indicate viewing areas by changing to realize Comprehensive displaying of the information to the first picture.
It is such as 360 degree of panoramic pictures in the first picture that first terminal obtains, viewing area is used to indicate by change The mode of the information in domain realizes the purpose for showing 360 degree of panoramic pictures, is such as referred to by control second terminal rotation mode to change Show the information of viewing areas, and then realizes through the rotation of control second terminal and show 360 degree of panoramic pictures.
In the present embodiment, a kind of mode of determining first area：According to the rotation for being used to indicate second terminal rotational case Transfering the letter breath and predetermined first interception range, determine first area.As according to being used to indicate second terminal rotational case Rotation information determines the initial position of first area, determines the firstth area according to predetermined first interception range and initial position The final position in domain.
Such as the current angular of second terminal is determined according to the rotation information for being used to indicate second terminal rotational case, by this The current angular of second terminal is determined as the initial position of first area, will be since initial position to predetermined first section Range corresponding position is taken to be determined as the final position of first area.
By taking the first interception range is interception angle as an example, second is determined according to initial angle, rotation angle and direction of rotation The current angular of terminal, such as current angular=initial angle ± rotation angle, the wherein symbol between initial angle and rotation angle Depending on number by direction of rotation, if rotating in the forward direction, symbol is+, if reversely rotating, symbol is-.If initial angle is 92 degree, RTP D=1, angle=70 in the extended field in the packet header of data packet show that second terminal rotates in the forward direction 70 degree, then first terminal phase For the first area that the last time obtains, positive 70 degree of movement is needed, the current angular of second terminal is 92+70=at this time 162 degree, corresponding final position is：162+ intercepts angle, then first area is：162 degree to 162 degree+interception angle is corresponding Range.If reversely rotating 70 degree, the current angular of second terminal is 92-70=22 degree, and corresponding final position is 22 Degree+interception angle, then first area be：The corresponding range of 22 degree to 22 degree+interception angle.
In the present embodiment, another mode for determining first area：Situation is promoted according to second terminal is used to indicate Propulsion information and predetermined second interception range, determine first area；Situation is promoted as basis is used to indicate second terminal Propulsion information determine the initial position of first area, determine first according to predetermined second interception range and initial position The final position in region promotes the propulsion information of situation to be used to show the translation of second terminal specific for instruction second terminal Position is then determined as the initial position of first area, from according to the current location that the translation position of the second terminal is determined Beginning position starts to the corresponding position of the second interception range the final position for being determined as first area.
Or in the present embodiment, a region in the first picture is determined with the second interception range, in the region A point be interception datum mark, the interception ratio using propulsion information as the region, from interception datum mark from the region cut Take the corresponding part of the interception ratio as first area, such as intercepting ratio is 2/3, then intercepts the area based on interception datum mark 2/3 part in domain is as first area, and point intercepts 2/3 part in the region as the firstth area such as centered on intercepting datum mark Domain.
In the present embodiment, another mode for determining first area：According to being used to indicate second terminal rotational case Rotation information and predetermined first interception range, determine the second area in the first picture, and according to being used to indicate second Terminal promotes the propulsion information of situation and predetermined second to intercept range, first area is determined from second area, also It is to say to determine a second area by rotation information, then select a part of region in second area based on propulsion information As first area, the explanation for please referring to above two mode is illustrated, this present embodiment is no longer illustrated.
Herein it should be noted is that：It is likely less than according to the first area that propulsion information is determined or greater than second The display area of terminal, therefore in order to completely show the image content in first area in the whole region of display area, Operation can be amplified to the image content in first area, first in the case where first area is less than display area In the case that region is greater than display area, reduction operation is carried out to the image content in first area, in interception image content The zoom operations to image content are realized simultaneously.
607：First terminal meets default cut in the determining information for being used to indicate the viewing areas that second terminal corresponds to user In the case where taking condition, the image content in the first area of the first picture is intercepted.
That is meet default interception condition in the information for being used to indicate the viewing areas that second terminal corresponds to user In the case of, just trigger the image content in first terminal interception first area, naturally it is also possible to be used to indicate second terminal pair In the case where meeting default interception condition using the information of the viewing areas at family, just basis is used to indicate second terminal and corresponds to user The information of viewing areas determine first area, and then the image content in first terminal interception first area is triggered, to drop The interception number of low first terminal reduces power consumption and transmission bandwidth in a manner of the interception number by reducing first terminal Occupancy, and then reduce and the probability of transmission congestion occur, can be depending on practical application, to this for preset condition Embodiment is without limiting.
Be used to indicate the viewing areas that second terminal corresponds to user information whether meet the mode of default interception condition can To be：Determine whether the rotation information for being used to indicate second terminal rotational case meets default rotating condition and/or be used to indicate Second terminal promotes whether the propulsion information of situation meets default propulsioning condition, and if it is explanation is used to indicate second eventually The information of the viewing areas of corresponding user is held to meet default interception condition, if otherwise explanation is used to indicate second terminal to application The information of the viewing areas at family is unsatisfactory for preset condition, wherein default rotating condition and default propulsioning condition can be according to actually answering Depending on, to this present embodiment without limiting.
In the present embodiment, if the rotation information for being used to indicate second terminal rotational case includes：The rotation of second terminal Angle illustrates to be used to indicate second terminal rotation then in the case where the rotation angle of second terminal is greater than default redundancy angle The rotation information of situation meets default rotating condition, triggers the picture in the first area of first terminal the first picture of interception at this time Content, wherein default redundancy angle is obtained according to the angle that the corresponding angle in first area and second terminal can be shown, such as the The corresponding angle in one region is predetermined interception angle, then presets redundancy angle and be：A/2, wherein A is predetermined section The difference for the angle for taking angle and second terminal that can show.
When the rotation angle of second terminal is less than or equal to default redundancy angle, illustrate the reconstruction that the second terminal last time obtains Picture still can be used, and first terminal is without carrying out intercept operation to the first picture again at this time；When the rotation angle of second terminal Greater than default redundancy angle, the reconstruction picture for illustrating that the second terminal last time obtains cannot be used, and first terminal then needs at this time Intercept operation is carried out to the first picture again.
With the corresponding angle in first area for 132 degree, the angle that second terminal can be shown is 120 degree, then presets redundancy Angle is 6 degree, and in the case where second terminal obtains rebuilding picture, second terminal can divide from the center line for rebuilding picture to two sides Not Yi Dong 60 degree obtain image content output, if the rotation angle of second terminal be less than or equal to 6 degree, second terminal can be to two Angle shown in side offsetting rotational angle in side exports to obtain image content, if the rotation angle of second terminal is greater than 6 degree, The viewing areas of second terminal cannot be covered by then illustrating to rebuild remaining image content in picture, and first terminal then needs again at this time It is secondary that intercept operation is carried out to the first picture.
In the present embodiment, if the propulsion information for being used to indicate second terminal propulsion situation includes：The propulsion of second terminal Distance illustrates to be used to indicate second terminal propulsion then in the case where the advance distance of second terminal is greater than default advance distance The propulsion information of situation meets default propulsioning condition, can intercept the image content in the first area of the first picture at this time, right It is not limited in default advance distance the present embodiment, interception number can equally be reduced by the judgement of advance distance.
Certainly, in the case where intercepting image content for the same second terminal, picture can will be intercepted in the present embodiment The condition that image content is intercepted in the condition of content and a upper embodiment of the method combines, as first time intercepts image content In the case of, it is intercepted in the above embodiment of the method in first area of the condition of image content to determine whether to intercept the first picture Image content, in i-th (i be greater than 1) interception image content, then with intercepted in the present embodiment the condition of image content come it is true Image content in the fixed first area for whether intercepting the first picture.
608：First terminal encodes the image content in first area, obtains the image content pair in first area The coded data answered, for example, the coding of graphics parameter that can obtain through consultation of first terminal to the image content in first area into Row coding.
609：Coded data is packaged in RTP data packet by first terminal, and first terminal may be used also in RTP data packet It is used to indicate the interception changed information of content to be packaged with, to indicate the currently transmitted coded data of first terminal and upper one The coded data of secondary transmission is different.
610：First terminal will be packaged with coded data and be used to indicate the RTP data of the interception changed information of content Packet is sent to server.
611：Server will be packaged with coded data and be used to indicate the RTP data packet of the interception changed information of content It is sent to second terminal.
612：Second terminal obtains the corresponding coded data of image content in first area, solves to coded data Code, obtain include image content in first area reconstruction picture.
613：Second terminal shows the reconstruction picture including the image content in first area.
In the present embodiment, step 608 is to step 613：It is identical to step 410 as above-mentioned steps 405, to this present embodiment No longer illustrate.
From above-mentioned technical proposal it is found that the present embodiment can correspond to the viewing areas of user by being used to indicate second terminal Information determines first area, so that image content in first area includes at least second terminal and correspond to what user wanted to watch Content improves user experience, and meets default interception item in the information for being used to indicate the viewing areas that second terminal corresponds to user In the case where part, the image content in first area is intercepted, can thus reduce the frequency and number of interception picture, improves institute The utilization rate of the image content of interception.And if first terminal obtains first picture with multi-angle, and every change is primary to be used In the information of instruction viewing areas, it can accordingly change the image content of interception, so that every change can once be shown in the first picture Different content, be used to indicate comprehensive displaying of the information to the first picture of viewing areas by changing to realize, thus for User brings the experience of completely new browsing multi-angle picture.
Below using real-time audio and video system shown in Figure 10 as it is provided in this embodiment can multi-angle acquisition and display diagram For the scene of piece, image processing method is illustrated, includes first terminal, real-time sound view in the real-time audio and video system Frequency server and second terminal, in the real-time audio and video system each terminal by real-time audio and video server communication, and The communication standard of real-time audio and video system is followed in communication process, then in real-time audio and video system without to terminal type into Row is distinguished, so that terminal otherness is hidden, and realizes the interconnection between each terminal by real-time audio and video server, Reach highly compatible effect.
In Figure 10 first terminal by taking panoramic shooting equipment as an example, second terminal be illustrated by taking VR equipment as an example, first Terminal obtains the first picture by its panorama camera function, and VR equipment is to have the equipment of a rotatory power, to pass through rotation It is interacted to change viewing areas, first terminal and second terminal by real-time audio and video server, such as first terminal and Two terminals carry the rotatable angle of second terminal by real-time audio and video server transport SDP signaling in the SDP signaling Angle, predetermined interception angle (as the first interception range) and the second terminal that degree range, second terminal can be shown Initial angle, it is 120 degree that wherein the initial angle of second terminal, which is the angle that default angle 0, second terminal can be shown, in advance First determining interception angle is 132 degree.
In the case where first terminal receives SDP signaling, is determined by the rotatable angular range of second terminal Two terminals can multi-faceted presentation viewing areas, then for first terminal in the case where getting the first picture, first terminal can be with The first area of the first picture is determined according to initial angle and interception angle, and then intercepts the image content in first area.It First terminal encodes the image content in first area afterwards, obtains the corresponding coded number of image content in first area According to, and coded data is packaged in RTP data packet, second is sent to by real-time audio and video server in the RTP data packet Terminal.
In the case where the viewing areas that second terminal corresponds to user changes, the feelings that are such as rotated in second terminal Under condition, direction of rotation and rotation angle are packaged in the packet header of reversed RTP data packet by second terminal, will be packaged with rotation side First terminal is sent to by real-time audio and video server to the RTP data packet with rotation angle.
First terminal extracts direction of rotation and rotation angle after receiving RTP data packet from the RTP data packet, is revolving In the case that gyration is less than or equal to default redundancy angle, illustrate that the coded data that first terminal last time sends still can be used, this When first terminal continue waiting for second terminal and send RTP data packet again, rotating the case where angle is greater than default redundancy angle Under, the coded data for illustrating that first terminal last time sends can not reuse, and first terminal is according to direction of rotation, rotation angle at this time Degree and interception angle redefine out first area, and then intercept the image content in first area again, later first terminal Image content in first area is encoded, obtains the corresponding coded data of image content in first area, and will compile Code data and the interception changed Information encapsulation of content is used to indicate in RTP data packet, by real-time in the RTP data packet Audio/video server is sent to second terminal.
By taking default redundancy angle is 6 degree as an example, in the case where rotating angle less than or equal to 6 degree, first terminal continues Send RTP data packet again to second terminal, in the case where rotating angle greater than 6 degree, first terminal redefines the firstth area Domain is intercepted, and leads to frequent updating coded data to avoid subtle rotation, and then cause to cause because of frequent updating coded data The interframe compression for being unfavorable for Video coding and reduce stability etc..Certainly in the present embodiment, second terminal can also basis Angle is rotated to decide whether to send reversed RTP data packet to first terminal, is such as greater than default redundancy angle in rotation angle In the case where, reversed RTP data packet is sent to first terminal, can reduce the occupancy to transmission bandwidth in this way, while may be used also Lead to frequent updating coded data to avoid subtle rotation.
For the various method embodiments described above, for simple description, therefore, it is stated as a series of action combinations, but Be those skilled in the art should understand that, the present invention is not limited by the sequence of acts described because according to the present invention, certain A little steps can be performed in other orders or simultaneously.Secondly, those skilled in the art should also know that, it is retouched in specification The embodiment stated belongs to preferred embodiment, and related actions and modules are not necessarily necessary for the present invention.
Corresponding with above method embodiment, the embodiment of the present invention also provides a kind of picture processing unit, and structure is as schemed Shown in 11, may include：Acquiring unit 11, interception unit 12 and transmission unit 13.
Acquiring unit 11, the first picture obtained for obtaining first terminal.
Interception unit 12, the image content in first area for intercepting the first picture, wherein except the in the first picture Image content in other regions except one region retains, that is to say, that the first picture can be divided into multiple regions, at this The image content in a region is only intercepted in multiple regions, the image content in other regions retains.With the division of the first picture For first area, second area and third region, from these three regions intercept first area in image content, second Image content in region and third region retains, and realizes the interception to partial picture content in the first picture.
In the present embodiment, interception unit 12 is to determine that second terminal is to be capable of the terminal of multi-faceted presentation viewing areas In the case where, the image content in the first area of the first picture is intercepted, for how to determine whether second terminal is that energy is more than enough The terminal of viewing areas is presented in orientation and relative content please refers to the related description in embodiment of the method, to this this reality Example is applied no longer to illustrate.And when intercepting the image content of first area, first area can be what first terminal was arbitrarily chosen One region is determining that second terminal is multi-faceted to be in if the first picture is divided into multiple regions in advance by first terminal In the case where the terminal of existing viewing areas, one is arbitrarily chosen from multiple regions as first area, and adjacent is selected twice The region that takes is different, or after the first picture is divided into multiple regions, is ranked up to this multiple regions, from being ordered as 1 It is successively chosen into the region of n (the region sum of division).
Or
In the present embodiment, acquiring unit 11 are also used to acquisition and are used to indicate the viewing areas that second terminal corresponds to user Information, the information for being used to indicate the viewing areas that second terminal corresponds to user includes：It is used to indicate second terminal rotational case Rotation information and/or be used to indicate second terminal promote situation propulsion information.Corresponding interception unit 12, for Meet default rotating condition in the rotation information of instruction second terminal rotational case and/or be used to indicate second terminal and promotes situation Propulsion information meet default propulsioning condition in the case where, intercept the image content in the first area of the first picture.
The rotation information for being such as used to indicate second terminal rotational case includes：The rotation angle of second terminal.It is corresponding Interception unit 12 intercepts the first area of the first picture in the case where the rotation angle of second terminal is greater than default redundancy angle In image content, default redundancy angle obtains according to the angle that the corresponding angle in first area and second terminal can be shown； Such as be used to indicate second terminal promote situation propulsion information include：The advance distance of second terminal.Corresponding interception unit 12, in the case where the advance distance of second terminal is greater than default advance distance, intercept the picture in the first area of the first picture Content.It illustrates and please refers to embodiment of the method, this present embodiment is no longer illustrated.
Transmission unit 13, for the image content in the first area intercepted to be sent to second terminal.
In the present embodiment, picture processing unit further includes：Coding unit 14 and encapsulation unit 15, as shown in figure 12.Its Middle coding unit 14, for encoding to the image content in first area, the image content obtained in first area is corresponding Coded data, such as the coding of graphics parameter obtained through consultation encodes the image content in first area.
Encapsulation unit 15 for coded data to be packaged in RTP data packet, and is packaged in RTP data packet The instruction interception changed information of content is used to indicate the interception changed information of content and is used to indicate second terminal termination The picture gone out using last decoding and rebuilding.
Transmission unit 13, for that will be packaged with coded data and be used to indicate the RTP of the interception changed information of content Data packet is sent to second terminal.
From above-mentioned technical proposal it is found that determining that second terminal is to be capable of the end of multi-faceted presentation viewing areas in first terminal In the case where end, the image content of first area can be intercepted from the first picture that first terminal obtains for second terminal exhibition Show, so that the data volume of the image content transmitted to second terminal is reduced, it is possible thereby to reduce the transmission belt of power consumption and occupancy Width, and the probability for transmission congestion occur can also be reduced in the case where data volume reduces, and be used to indicate second terminal In the case that the information of the viewing areas of corresponding user meets default interception condition, the image content in first area is intercepted, this Sample can reduce the frequency and number of interception picture, improve the utilization rate of intercepted image content.
Figure 13 is please referred to, it illustrates the structures of another picture processing unit provided in an embodiment of the present invention, above-mentioned It can also include determination unit 16 on the basis of Figure 11.
In the present embodiment, acquiring unit 11 are also used to acquisition and are used to indicate the viewing areas that second terminal corresponds to user Information.Determination unit 16, the information for corresponding to the viewing areas of user according to second terminal is used to indicate, determines the firstth area Domain, so that the image content in the first area determined includes at least second terminal and corresponds to the content that user wants viewing.
The information for being wherein used to indicate the viewing areas that second terminal corresponds to user includes：It is used to indicate second terminal rotation The rotation information of situation and/or the propulsion information for being used to indicate second terminal propulsion situation.Corresponding determination unit 16 determines The mode of first area is as follows：
According to the rotation information that is used to indicate second terminal rotational case and predetermined first interception range, the is determined One region.
Or promote the propulsion information of situation and predetermined second to intercept range according to second terminal is used to indicate, really Determine first area.
Or according to the rotation information and predetermined first interception range for being used to indicate second terminal rotational case, really Second area in fixed first picture, and according to the propulsion information and predetermined for being used to indicate second terminal and promoting situation Two interception ranges, determine first area from second area.
Related description in embodiment of the method is please referred to for the explanation of these three modes, this present embodiment is no longer explained It states.And by above-mentioned picture processing unit can by be used to indicate second terminal correspond to user viewing areas information come really Determine first area, so that the image content in first area includes at least second terminal and corresponds to the content that user wants viewing, mentions High user experience.If first terminal obtains the first picture of a Multi-angle omnibearing, viewing area can be used to indicate by changing The mode of the information in domain realizes and shows to the Multi-angle omnibearing of the first picture, thus brings for user completely new multi-faceted clear Look at the experience of picture.
Figure 14 is please referred to, it illustrates the structures of another picture processing unit provided in an embodiment of the present invention, can wrap It includes：Acquiring unit 21 and display unit 22.
Acquiring unit 21, the image content in first area for obtaining the first picture, the first picture are whole by first End obtains, and the image content in first area intercepts to obtain by first terminal or server.
Such as acquiring unit 21 obtains the corresponding coded data of image content in first area, in real-time transport protocol number According to be packaged in packet be used to indicate interception content changed information when, coded data is decoded, obtains including first The reconstruction picture of image content in region, coded data are packaged in Realtime Transport Protocol data packet.
Display unit 22, for showing that the image content in first area, specific exhibition method please join by second terminal The related description in embodiment of the method is read, this present embodiment is no longer illustrated.
In addition, acquiring unit 21, is also used to obtain the information for being used to indicate the viewing areas that second terminal corresponds to user, uses The information of the viewing areas of user is corresponded to for determining first area in instruction second terminal.
Corresponding picture processing unit further includes：Encapsulation unit and transmission unit.Wherein encapsulation unit, for that will be used for Indicate that second terminal correspond to the Information encapsulation of the viewing areas of user in preset data, preset data for session protocol signaling or Person's RTP data packet.Transmission unit, for being packaged with the viewing for being used to indicate second terminal and corresponding to user by second terminal transmission The preset data of the information in region.
In some embodiments of the invention, acquiring unit, be also used to obtain be used to indicate second terminal be can be multi-party The information of the terminal of viewing areas is presented in position, and being used to indicate second terminal is the letter for capableing of the multi-faceted terminal that viewing areas is presented Breath is for triggering the image content in interception first area.
Corresponding picture processing unit further includes：Encapsulation unit and transmission unit.Wherein encapsulation unit, for that will be used for Indicate that second terminal is to be capable of the Information encapsulation of the multi-faceted terminal that viewing areas is presented in session protocol signaling.It sends single Member is packaged with that be used to indicate second terminal be to be capable of the multi-faceted terminal that viewing areas is presented for sending by second terminal The session protocol signaling of information.
Herein it should be noted is that：In the present embodiment, the encapsulation unit in picture processing unit can have simultaneously For the information for being packaged for the viewing areas for indicating that second terminal corresponds to user and it is packaged for indicating that second terminal is more than enough for energy The function of the information of the terminal of viewing areas is presented in orientation.And in practical applications any terminal can be used as first terminal and Second terminal can integrate the picture processing unit of at least one attached drawing of above-mentioned Figure 11 to Figure 14 elaboration in the terminal.
In addition, the embodiment of the present invention also provides a kind of terminal, which includes：Processor and memory.Wherein processor, For obtaining the first picture, the image content in the first area of the first picture is intercepted, and send in intercepted first area Image content, the image content in other regions in the first picture in addition to first area retains；Memory, for storing Image content in first picture and first area.
In some embodiments of the invention, processor is also used to acquisition and is used to indicate the sight that second terminal corresponds to user It sees the information in region, and the information for corresponding to the viewing areas of user according to second terminal is used to indicate, determines first area, so that The image content in first area determined includes at least second terminal and corresponds to the content that user wants viewing.
In some embodiments of the invention, the information for being used to indicate the viewing areas that second terminal corresponds to user includes： It is used to indicate the rotation information of second terminal rotational case and/or is used to indicate the propulsion information that second terminal promotes situation.
Processor, for according to the rotation information and predetermined first interception for being used to indicate second terminal rotational case Range determines first area.Or according to the propulsion information and predetermined second for being used to indicate second terminal propulsion situation Range is intercepted, determines first area.Or according to the rotation information that is used to indicate second terminal rotational case and predetermined First interception range determines the second area in the first picture, and promotes the propulsion of situation to believe according to second terminal is used to indicate Breath and predetermined second interception range, determine first area from second area.
In some embodiments of the invention, processor, for obtaining the viewing for being used to indicate second terminal and corresponding to user The information in region, the information for being used to indicate the viewing areas that second terminal corresponds to user include：It is used to indicate second terminal rotation The rotation information of situation and/or the propulsion information for being used to indicate second terminal propulsion situation.It is being used to indicate second eventually accordingly The rotation information of end rotational case, which meets default rotating condition and/or is used to indicate second terminal, promotes the propulsion information of situation full In the case where the default propulsioning condition of foot, the image content in the first area of the first picture is intercepted.
In some embodiments of the invention, the rotation information for being used to indicate second terminal rotational case includes：Second eventually The rotation angle at end.Processor, for intercepting first in the case where the rotation angle of second terminal is greater than default redundancy angle Image content in the first area of picture, default redundancy angle can be shown according to the corresponding angle in first area and second terminal The angle shown obtains.
Or
Be used to indicate second terminal promote situation propulsion information include：The advance distance of second terminal.Processor is used for In the case where the advance distance of second terminal is greater than default advance distance, intercept in the picture in the first area of the first picture Hold.
In some embodiments of the invention, processor is obtained for encoding to the image content in first area The corresponding coded data of image content in first area, coded data is packaged in Realtime Transport Protocol data packet, and It is packaged for the instruction interception changed information of content in Realtime Transport Protocol data packet, coded data and use will be packaged with It is sent to second terminal in the Realtime Transport Protocol data packet of the instruction interception changed information of content, is used to indicate in interception Hold changed information and is used to indicate the picture that second terminal termination is gone out using last decoding and rebuilding.
The embodiment of the present invention also provides a kind of storage medium, and computer program code, computer are stored on storage medium Program code realizes above-mentioned image processing method when executing.
It should be noted that all the embodiments in this specification are described in a progressive manner, each embodiment weight Point explanation is the difference from other embodiments, and the same or similar parts between the embodiments can be referred to each other. For device class embodiment, since it is basically similar to the method embodiment, so being described relatively simple, related place ginseng See the part explanation of embodiment of the method.
Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation Between there are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant meaning Covering non-exclusive inclusion, so that the process, method, article or equipment for including a series of elements not only includes that A little elements, but also including other elements that are not explicitly listed, or further include for this process, method, article or The intrinsic element of equipment.In the absence of more restrictions, the element limited by sentence "including a ...", is not arranged Except there is also other identical elements in the process, method, article or apparatus that includes the element.
The foregoing description of the disclosed embodiments can be realized those skilled in the art or using the present invention.To this A variety of modifications of a little embodiments will be apparent for a person skilled in the art, and the general principles defined herein can Without departing from the spirit or scope of the present invention, to realize in other embodiments.Therefore, the present invention will not be limited It is formed on the embodiments shown herein, and is to fit to consistent with the principles and novel features disclosed in this article widest Range.
The above is only a preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art For member, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications are also answered It is considered as protection scope of the present invention.

Claims (15)

1. a kind of image processing method, which is characterized in that the method includes：
Obtain the first picture that first terminal obtains；
The image content in the first area of first picture is intercepted, in first picture in addition to the first area Image content in other regions retains；
Image content in the first area intercepted is sent to second terminal.
2. the method according to claim 1, wherein the method also includes：Acquisition is used to indicate described second Terminal corresponds to the information of the viewing areas of user；
According to the information for being used to indicate the second terminal and corresponding to the viewing areas of user, the first area is determined, with So that the image content in the first area determined is included at least the second terminal and corresponds to the content that user wants viewing.
3. according to the method described in claim 2, it is characterized in that, the sight for being used to indicate the second terminal and corresponding to user The information for seeing region includes：It is used to indicate the rotation information of the second terminal rotational case and/or is used to indicate described second The propulsion information of terminal propulsion situation；
The information for being used to indicate the second terminal according to and corresponding to the viewing areas of user, determines the first area Including：According to the rotation information and predetermined first interception range for being used to indicate the second terminal rotational case, determine The first area；
Or promote the propulsion information of situation and predetermined second to intercept range according to the second terminal is used to indicate, really The fixed first area；
Or according to the rotation information and the predetermined first interception model for being used to indicate the second terminal rotational case It encloses, determines the second area in first picture, and according to the propulsion information for being used to indicate the second terminal propulsion situation With the predetermined second interception range, the first area is determined from the second area.
4. the method according to claim 1, wherein the method also includes：Acquisition is used to indicate described second Terminal corresponds to the information of the viewing areas of user, the information for being used to indicate the second terminal and corresponding to the viewing areas of user Including：It is used to indicate the rotation information of the second terminal rotational case and/or is used to indicate the second terminal and promote situation Propulsion information；
Image content in the first area of the interception first picture includes：It is being used to indicate the second terminal rotation The rotation information of situation, which meets default rotating condition and/or is used to indicate the second terminal, promotes the propulsion information of situation to meet In the case where default propulsioning condition, the image content in the first area of first picture is intercepted.
5. according to the method described in claim 4, it is characterized in that, the rotation for being used to indicate the second terminal rotational case Transfering the letter ceases：The rotation angle of the second terminal；
In the case where the rotation information for being used to indicate the second terminal rotational case meets default rotating condition, described in interception Image content in the first area of first picture includes：It is greater than default redundancy angle in the rotation angle of the second terminal In the case of, intercept the image content in the first area of first picture, the default redundancy angle is according to described the The angle that the corresponding angle in one region and the second terminal can be shown obtains；
Or
It is described to be used to indicate the second terminal and promote the propulsion information of situation to include：The advance distance of the second terminal；
In the case where being used to indicate the second terminal and the propulsion information of situation being promoted to meet default propulsioning condition, described in interception Image content in the first area of first picture includes：It is greater than default advance distance in the advance distance of the second terminal In the case of, intercept the image content in the first area of first picture.
6. the method according to claim 1, wherein the image content in the first area that will be intercepted is sent out Giving second terminal includes：
Image content in the first area is encoded, the corresponding coding of image content in the first area is obtained Data；
The coded data is packaged in Realtime Transport Protocol data packet, and is sealed in the Realtime Transport Protocol data packet Dress is used to indicate the interception changed information of content, and the interception changed information of content that is used to indicate is used to indicate institute It states second terminal and terminates the picture gone out using last decoding and rebuilding；
The coded data will be packaged with and is used to indicate the Realtime Transport Protocol data packet of the interception changed information of content It is sent to second terminal.
7. a kind of image processing method, which is characterized in that the method includes：
The image content in the first area of the first picture is obtained, first picture is obtained by first terminal, and described Image content in one region intercepts to obtain by the first terminal or server；
The image content in the first area is shown by second terminal.
8. the method according to the description of claim 7 is characterized in that the method also includes：Acquisition is used to indicate described second Terminal corresponds to the information of the viewing areas of user, the information for being used to indicate the second terminal and corresponding to the viewing areas of user For determining the first area；
By it is described be used to indicate the second terminal correspond to user viewing areas Information encapsulation in preset data, it is described pre- If data are session protocol signaling or Realtime Transport Protocol data packet；
It is sent by the second terminal and is packaged with the information for being used to indicate the viewing areas that the second terminal corresponds to user Preset data.
9. the method according to the description of claim 7 is characterized in that the method also includes：Acquisition is used to indicate described second Terminal be capable of it is multi-faceted present viewing areas terminal information, it is described be used to indicate the second terminal be can be multi-faceted The information that the terminal of viewing areas is presented is used to trigger the image content intercepted in the first area；
It is to be capable of the Information encapsulation of the multi-faceted terminal that viewing areas is presented in session protocol that the second terminal, which will be used to indicate, In signaling；
It sends to be packaged with by the second terminal and is used to indicate the second terminal as viewing areas multi-faceted can be presented The session protocol signaling of the information of terminal.
10. the method according to the description of claim 7 is characterized in that the picture in the first area for obtaining the first picture Content includes：
The corresponding coded data of image content in the first area is obtained, the coded data is packaged in real-time transport protocol In data packet；
It is packaged in the Realtime Transport Protocol data packet when being used to indicate the interception changed information of content, to the volume Code data are decoded, obtain include image content in first area reconstruction picture.
11. a kind of picture processing unit, which is characterized in that described device includes：
Acquiring unit, the first picture obtained for obtaining first terminal；
Interception unit, the image content in first area for intercepting first picture, except described in first picture Image content in other regions except first area retains；
Transmission unit, for the image content in the first area intercepted to be sent to second terminal.
12. device according to claim 11, which is characterized in that the acquiring unit is also used to acquisition and is used to indicate institute State the information that second terminal corresponds to the viewing areas of user；
Described device further includes：Determination unit corresponds to the viewing area of user for being used to indicate the second terminal according to The information in domain determines the first area, so that the image content in the first area determined includes at least described the Two terminals correspond to the content that user wants viewing.
13. device according to claim 12, which is characterized in that described to be used to indicate the second terminal and correspond to user's The information of viewing areas includes：It is used to indicate the rotation information of the second terminal rotational case and/or is used to indicate described The propulsion information of two terminals propulsion situation；
The determination unit, for according to the rotation information for being used to indicate the second terminal rotational case and predetermined the One interception range, determines the first area；
Or the determination unit, the second terminal, which is used to indicate, for basis promotes the propulsion information of situation and predefine Second interception range, determine the first area；
Or the determination unit, for according to be used to indicate the second terminal rotational case rotation information and it is described in advance The first determining interception range, determines the second area in first picture, and push away according to the second terminal is used to indicate Propulsion information and the predetermined second interception range into situation, determine firstth area from the second area Domain.
14. device according to claim 11, which is characterized in that the acquiring unit is also used to acquisition and is used to indicate institute State the information that second terminal corresponds to the viewing areas of user, the viewing areas for being used to indicate the second terminal and corresponding to user Information include：It is used to indicate the rotation information of the second terminal rotational case and/or is used to indicate the second terminal and push away Into the propulsion information of situation；
The interception unit, for meeting default rotating condition in the rotation information for being used to indicate the second terminal rotational case And/or in the case where being used to indicate the default propulsioning condition of propulsion information satisfaction that the second terminal promotes situation, described in interception Image content in the first area of first picture.
15. device according to claim 14, which is characterized in that described to be used to indicate the second terminal rotational case Rotation information includes：The rotation angle of the second terminal；
The interception unit, for intercepting institute in the case where the rotation angle of the second terminal is greater than default redundancy angle The image content in the first area of the first picture is stated, the default redundancy angle is according to the corresponding angle in the first area The angle that degree and the second terminal can be shown obtains；
Or
It is described to be used to indicate the second terminal and promote the propulsion information of situation to include：The advance distance of the second terminal；
The interception unit, for intercepting institute in the case where the advance distance of the second terminal is greater than default advance distance State the image content in the first area of the first picture.
CN201810934851.1A 2018-08-16 2018-08-16 A kind of image processing method and device Pending CN108900893A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810934851.1A CN108900893A (en) 2018-08-16 2018-08-16 A kind of image processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810934851.1A CN108900893A (en) 2018-08-16 2018-08-16 A kind of image processing method and device

Publications (1)

Publication Number Publication Date
CN108900893A true CN108900893A (en) 2018-11-27

Family

ID=64354687

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810934851.1A Pending CN108900893A (en) 2018-08-16 2018-08-16 A kind of image processing method and device

Country Status (1)

Country Link
CN (1) CN108900893A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112445394A (en) * 2019-08-30 2021-03-05 北京沃东天骏信息技术有限公司 Screenshot method and device
CN116266868A (en) * 2021-12-17 2023-06-20 聚好看科技股份有限公司 Display equipment and viewing angle switching method

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007189357A (en) * 2006-01-11 2007-07-26 Matsushita Electric Ind Co Ltd Device and method for distributing arbitrary-viewpoint video
CN101521745A (en) * 2009-04-14 2009-09-02 王广生 Multi-lens optical center superposing type omnibearing shooting device and panoramic shooting and retransmitting method
CN103096018A (en) * 2011-11-08 2013-05-08 华为技术有限公司 Information transmitting method and terminal
CN105323552A (en) * 2015-10-26 2016-02-10 北京时代拓灵科技有限公司 Method and system for playing panoramic video
CN106101683A (en) * 2016-06-30 2016-11-09 深圳市虚拟现实科技有限公司 The remotely comprehensive real-time Transmission of panoramic picture and display packing
CN106453913A (en) * 2016-10-31 2017-02-22 北京疯景科技有限公司 Method and apparatus for previewing panoramic contents
CN107592549A (en) * 2017-10-27 2018-01-16 哈尔滨市舍科技有限公司 Panoramic video based on two-way communication plays camera system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007189357A (en) * 2006-01-11 2007-07-26 Matsushita Electric Ind Co Ltd Device and method for distributing arbitrary-viewpoint video
CN101521745A (en) * 2009-04-14 2009-09-02 王广生 Multi-lens optical center superposing type omnibearing shooting device and panoramic shooting and retransmitting method
CN103096018A (en) * 2011-11-08 2013-05-08 华为技术有限公司 Information transmitting method and terminal
CN105323552A (en) * 2015-10-26 2016-02-10 北京时代拓灵科技有限公司 Method and system for playing panoramic video
CN106101683A (en) * 2016-06-30 2016-11-09 深圳市虚拟现实科技有限公司 The remotely comprehensive real-time Transmission of panoramic picture and display packing
CN106453913A (en) * 2016-10-31 2017-02-22 北京疯景科技有限公司 Method and apparatus for previewing panoramic contents
CN107592549A (en) * 2017-10-27 2018-01-16 哈尔滨市舍科技有限公司 Panoramic video based on two-way communication plays camera system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112445394A (en) * 2019-08-30 2021-03-05 北京沃东天骏信息技术有限公司 Screenshot method and device
CN116266868A (en) * 2021-12-17 2023-06-20 聚好看科技股份有限公司 Display equipment and viewing angle switching method

Similar Documents

Publication Publication Date Title
EP3606082B1 (en) Panoramic video playback method and client terminal
WO2018054375A1 (en) Live broadcast information processing method and device, and storage medium
TWI345404B (en) High data rate interface
US8131826B2 (en) Image display system with visual server
CN112204993B (en) Adaptive panoramic video streaming using overlapping partitioned segments
CN110419224B (en) Method for consuming video content, electronic device and server
CN111193877B (en) ARM-FPGA (advanced RISC machine-field programmable gate array) cooperative wide area video real-time fusion method and embedded equipment
US4935953A (en) Cyclic video region transmission for videoconferencing systems
US20030177255A1 (en) Encoding and decoding system for transmitting streaming video data to wireless computing devices
EP3557534A1 (en) Information processing method and apparatus
CN111093098B (en) Logistic mapping-based chaotic encryption method
CN108900893A (en) A kind of image processing method and device
CN104253804B (en) A kind of method and device for transmitting view data
JP2019514313A (en) Method, apparatus and stream for formatting immersive video for legacy and immersive rendering devices
CN115567661A (en) Video data processing method, system, computer device and storage medium
WO2023040825A1 (en) Media information transmission method, computing device and storage medium
EP4125275A1 (en) A method, an apparatus and a computer program product for video conferencing
EP3637722A1 (en) Method and apparatus for processing media information
CN109963106B (en) Video image processing method and device, storage medium and terminal
CN112004101B (en) Virtual live broadcast data transmission method and device and storage medium
Pasman et al. Augmented reality with large 3D models on a PDA: implementation, performance and use experiences
CN109963185A (en) Video data transmitting method, image display method, device, system and equipment
WO2022206016A1 (en) Data layering transport method, apparatus and system
CN107634974A (en) A kind of data transmission method and device
WO2022116822A1 (en) Data processing method and apparatus for immersive media, and computer-readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20181127