CN106101684A - Remotely panoramic picture real-time Transmission and the method for smooth display - Google Patents
Remotely panoramic picture real-time Transmission and the method for smooth display Download PDFInfo
- Publication number
- CN106101684A CN106101684A CN201610510280.XA CN201610510280A CN106101684A CN 106101684 A CN106101684 A CN 106101684A CN 201610510280 A CN201610510280 A CN 201610510280A CN 106101684 A CN106101684 A CN 106101684A
- Authority
- CN
- China
- Prior art keywords
- transmission
- time
- image
- processing unit
- panoramic picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/122—Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/194—Transmission of image signals
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Processing Or Creating Images (AREA)
Abstract
The present invention provides long-range panoramic picture real-time Transmission and the method for smooth display, including server, transmission system and terminal, described terminal includes processing unit, motion detection unit and display unit, described processing unit is electrically connected with described motion detection unit and described display unit respectively, described processing unit includes that response test device, described response test device can test response time.Compared with prior art, the present invention uses the scheme according to motion detection unit testing result correspondence transmission view data, saves a lot of network bandwidths, makes long-range panoramic picture real-time Transmission and display be achieved.By the way of intercepting window image region and buffering image-region, not only reduce volume of transmitted data, and avoid the generation that black surround occurs and postpones sense.By the way of cache image and cache image integration, prevent the appearance of spinning sensation.
Description
Technical field
The present invention relates to panoramic picture transmission field, more particularly, it relates to remotely panoramic picture real-time Transmission and smoothness
The method of display.
Background technology
Panorama shows and at present general uses Curved screen or nearly eye display device to build a virtual three-dimensional scenic, allows use
No matter person towards which direction it can be seen that image in virtual world, has stronger feeling of immersion.Panoramic video or game mesh
The front good whole file of download in advance that is usually in main frame is play again, is difficulty with long-range real-time Transmission, and this is due to current
There is bigger restriction in network transfer speeds, and the transmission of panoramic video or game needs the biggest real-time Data Transmission amount, this
It is that current most network condition is implacable.Even if saving volume of transmitted data by reducing transmission image quality, but
So not only resulting in transmission image quality decrease, lattice sense is serious, also picture can be caused to interrupt due to network fluctuation, make user
Produce serious spinning sensation.
Summary of the invention
Affecting feeling of immersion and the serious defect of spinning sensation to solve current remote panoramic picture, the present invention provides feeling of immersion
The method that strong and antidinic long-range panoramic picture real-time Transmission shows with smoothness.
The technical solution adopted for the present invention to solve the technical problems is: provide a kind of remotely panoramic picture real-time Transmission and
The method of smooth display, including server, transmission system and terminal, described terminal include processing unit, motion detection unit and
Display unit, described processing unit is electrically connected with described motion detection unit and described display unit respectively, and described process is single
Unit includes that response test device, described response test device can test response time, and described response time is that terminal is to service
Device issues a signal to terminal and receives corresponding time used by return signal, long-range panoramic picture real-time Transmission and smooth display
Method comprises the following steps:
S1: described motion detection unit detects the kinestate of user and to the most described, testing result transmission is processed list
Unit；
S2: the testing result received is processed by described processing unit, and send a request to described server request
View data；
S3: described server transport correspondence image data are to described terminal.
Preferably, the view data that described processing unit storage receives, after the view data that receives with store before
Image data location overlapping, view data that lap position receives after being updated to.
Preferably, described motion detection unit includes that Attitute detecting device, described Attitute detecting device can detect use
The angle coordinate information of person.
Preferably, described server image waiting for transmission includes window image region and limit area, described processing unit
The angle coordinate information provided according to described motion detection unit draws the window image region of user, and according to user
Exercise data determines limit area.
Preferably, it is determined by the extreme boundary of window image regional change described in the mankind in corresponding time delay, is formed
The one-to-one relationship of described extreme boundary and time delay, and in determining corresponding time delay according to described extreme boundary scope
Described limit area.
Preferably, the computational methods of described limit area are:
The user angle coordinate information (α that motion detection unit described in processing unit record described in S2.11 provides0, β0,
γ0)；
Forward maximum offset (the Δ α of user angle coordinate in processing unit calculates time delay described in S2.121,
Δβ1, Δ γ1) and reverse maximum offset (Δ α2, Δ β2, Δ γ2), arrange the angle coordinate set Ф that user is likely to occur
={ (α0-Δα2<α<α0+Δα1), (β0-Δβ2<β<β0+Δβ1), (γ0-Δγ2<γ<γ0+Δγ1), | α, beta, gamma }；
The set in the window image region that S2.13 set Ф is corresponding is described limit area.
Preferably, described time delay is that user is detected the time point of kinestate to line number under server correspondence
According to the time used by end of transmission.
Preferably, user angle coordinate maximum offset is this coordinate direction largest motion angular velocity and delay of user
The product of time.
Preferably, according to the size of described time delay, described processing unit judges to need the image quality of transmission, and to use
Person advises.
Preferably, described terminal is virtual implementing helmet, augmented reality glasses or panorama Curved screen.
Compared with prior art, the present invention uses the side according to motion detection unit testing result correspondence transmission view data
Case, saves a lot of network bandwidths, makes long-range panoramic picture real-time Transmission and display be achieved.By intercepting window image
Region and the mode of buffering image-region, not only reduce volume of transmitted data, and avoid the product that black surround occurs and postpones sense
Raw.By the way of cache image and cache image integration, prevent the appearance of spinning sensation.Attitute detecting device can detect and make
The angle coordinate information of user, transmits relevant information to processing unit to determine limit area in real time.Fixed limit region with
Time delay, one_to_one corresponding can determine the scope of limit area easily.In being determined by user time delay, angle is sat
Target maximum offset can the scope in more limit of accuracy region, reduce volume of transmitted data further.Response test device is set
The network speed situation of user can be measured, it is judged that the image quality of transmission, the most conveniently draw t time delay10。
Accompanying drawing explanation
Below in conjunction with drawings and Examples, the invention will be further described, in accompanying drawing:
Fig. 1 is current remote image real-time Transmission and display packing；
Fig. 2 is that panoramic picture shows schematic diagram；
Fig. 3 is the present invention long-range panoramic picture real-time Transmission and the method structural representation of smooth display；
Fig. 4 is the present invention long-range panoramic picture real-time Transmission and the method window image area schematic of smooth display；
Fig. 5 is the method transmission image-region schematic diagram of the present invention long-range panoramic picture real-time Transmission and smooth display；
Fig. 6 is the present invention long-range panoramic picture real-time Transmission and the method image buffer storage schematic diagram of smooth display.
Detailed description of the invention
Affecting feeling of immersion and the serious defect of spinning sensation to solve current remote panoramic picture, the present invention provides feeling of immersion
The method that strong and antidinic long-range panoramic picture real-time Transmission shows with smoothness.
In order to be more clearly understood from the technical characteristic of the present invention, purpose and effect, now comparison accompanying drawing describes in detail
The detailed description of the invention of the present invention.
Refer to Fig. 1.Fig. 1 is current remote image real-time Transmission and display packing, and terminal 13 includes display unit 131,
Arrived according to the view data that the data transmission that terminal 13 is asked is corresponding to server 11 request data, server 11 by terminal 13
Terminal 13, picture signal is transmitted to display unit 131 by terminal 13 after treatment.This transmission is to terminal 13 and server 11
Processing speed and transmission data speed have certain requirement, if these speed are unable to reach requirement, video will
Card occurs, has a strong impact on experience.Current remote audio as real-time Transmission and display in, server 11 performance, terminal
13 performances and the network bandwidth and stability become the key factor of restriction phonotape and videotape transmission.Therefore, in the biography of current HD video
Defeated with in big game, terminal 13 and stable network configuration at a high speed that performance is remarkable can not lack.
Refer to Fig. 2.Fig. 2 is that panoramic picture shows schematic diagram.Panoramic picture is many by virtual implementing helmet, augmented reality
Glasses and panorama Curved screen present, and need to ensure that user 20, no matter towards what direction, can be experienced such as reality
As image, therefore in not remote virtual reality shows, need to make the image of comprehensive 360 degree, be stored in terminal 13, treat
After the motion of user 20 and location status are determined, terminal 13 transmits the image information of correspondence in display unit 131.And
Remotely in real-time Transmission, it is impossible to make the image of comprehensive 360 degree in advance, the image of real-time Transmission 360 degree can only be relied on to protect
No matter card user 20 can experience the image as reality towards what direction.But transmit so many letter simultaneously
Breath needs the biggest network bandwidth support, and current technology is unable to reach requirement, and this allows for long-range panoramic picture real-time Transmission
A biggest difficult problem is run into playing.One solution is to reduce the image quality of image, when the image quality of image is reduced to certain mark
On time, real-time data transmission amount is greatly reduced, and the network bandwidth can meet, but this can cause image the fuzzyyest, and lattice sense is tight
Weight, has a strong impact on feeling of immersion and the experience of virtual reality.And when fluctuation occurs in network, transmission image there will be interruption, makes
User is become to produce serious spinning sensation.
Refer to Fig. 3 Fig. 5, in the present invention, complete long-range panorama phonotape and videotape real-time Transmission and broadcasting need server 11,
Transmission system 12 and terminal 13, connected by transmission system 12 between server 11 and terminal 13 and mutually transmit information.Terminal
13 include processing unit 137, display unit 131, environmental simulation unit 139 and motion detection unit 135, processing unit 137 points
It is not electrically connected with display unit 131, environmental simulation unit 139 and motion detection unit 135.Environmental simulation unit 139 is permissible
Related command simulated environment scene according to processing unit 137, server 11 can with transmission environment information to terminal 13, and by
Reason unit 137 command environment analogue unit 139 is expressed.Environmental simulation unit 139 can be equipped with aerator (not shown) mould
Intend wind direction and outfit water injector (not shown) simulates environmental changes such as spraying water, rain.Motion detection unit 135 includes that attitude is examined
Survey device 1353.Processing unit 137 includes response test device 1371, and response test device 1371 can be with Measurement Network response speed
Degree.
Owing to the visual angle of people limits, in reality, people can not simultaneously view the image of 360 degree of panoramic spaces, is presented in face of people
Be one " form ", it is illustrated that window image region 31.Here tell about panoramic picture as a example by virtual reality shows and show
Principle, panorama Curved screen is similar with it with augmented reality display packing, and here is omitted.Show in not remote virtual reality
In, owing to equipment response speed is very fast, after the angle information of user 20 is detected, terminal 13 transmits the form figure of correspondence
As, in region 31 to display unit 131, whole process can control to below 11ms, and within this time less than 11ms, makes
The kinestate of user 20 will not occur the biggest change, and this part-time postpones to ignore.User 20 is at display unit 131
In see 11ms before image physiological brain on will not produce delay sense, this be non-remote dummy reality show the most former
Reason.In this transmission, the corresponding unique window image region 31 of each angle coordinate.But show in remote dummy reality
In, owing to network response speed is much larger than 11ms, re-uses this mode to propagate image and will produce the biggest delay sense.Cause
We must transmit and be stored in terminal 13 more than the image in window image region 31 these, then remeasure the angle of user 20
Coordinate, captures the window image region 31 of correspondence in display unit 131 in the image of storage.Among these, more than form figure
As region 31 image we be referred to as buffers images region 33, buffers images region 33 and window image region 31 and collectively form biography
Defeated image-region 30.
It is detected from kinestate and the positional information of user 20, passes to user to image information, need one
Individual transmission and the time cycle of process.The initial time making this time cycle is T0, then this time cycle needs: user 20
Kinestate to be detected and be delivered to time of processing unit 137 be detection time t1, processing unit 137 process time
For t2, processing unit 137 transmit data to server 11 required time t3, server 11 process time t4, server 11 is to process
Unit 137 transmits the time t of correspondence image data5。(t1+t2+t3+t4+t5) we are referred to as time delay during this period of time, note postpones
Time is t10.Time delay t10Difference according to server 11, the performance of terminal 13 and network transfer speeds is had nothing in common with each other.
Can be easy to draw, the response time that response test device 1371 is measured is (t3+t4+t5), due to t1And t2For specifically
For terminal be substantially changeless, therefore t time delay10Just can pass through response time (t3+t4+t5) and fixing
Time t1、t2Calculate.
The transmitting procedure of the method for the present invention long-range panoramic picture real-time Transmission and smooth display is: at T0In the moment, use
The angle coordinate information passive movement detector unit 135 of person 20 detects, through t1This information of time be delivered to processing unit
137, processing unit 137 is through t2The process of time is to the data of server 11 request transmission image-region 30, through t3Time number
According to request message transmission to server 11, server 11 is through t4The process of time is by descending for transmission image-region 30 corresponding data
It is transferred to terminal 13, through t5Time incoming terminal and finish receiving, be now designated as T1Moment.Meanwhile, motion detection unit
135 detection user 20 are at T1The angle coordinate information in moment, and this information is transmitted to processing unit 137, processing unit 137
After treatment, the transmission image-region 30 passed back captures corresponding T1The window image region 31 of moment angle coordinate information
And transmit to display unit 131.
In the present invention, the scope of transmission image-region 30 is important.If transmission image-region 30 is too small, use
The person 20 motion within buffer time is likely to result in the window image region 31 scope beyond transmission image-region 30, causes black surround
Appearance；If transmission image-region 30 is excessive, network condition may can not meet.We will ensure the absent variable transmission of black surround
The minimum allowed band region of image-region 30 is referred to as limit area 32, then our transmission image-region 30 have to be larger than 32
Can guarantee that black surround occurs without, will not therefore affect the display effect of virtual reality.Window image region 31 and limit area 32 are all
It is by the parts of images intercepted in the image to be transmitted of server 11.
We can use the scheme of fixed limit region 32 scope.By collecting relevant experimental data in a large number, it is right to determine
Answer t time delay10The extreme boundary of interior mankind's window image region 31 change, the set that these extreme boundary surround just constitutes
This time delay t10Corresponding limit area 32.In this programme, the extreme boundary of limit area 32 and t time delay10Exist
One-to-one relationship.Response time (t is measured at response test device 13713+t4+t5After), when processing unit 137 is according to response
Between and system regular time t1、t2Calculate t time delay10, and correspondence draws the extreme boundary scope of limit area 32, root
Limit area 32 is determined according to this extreme boundary scope.
We can determine limit area 32 in the way of using calculating user 20 maximum angle side-play amount.We set up
Virtual rectangular coordinate system, user is now α along the angle coordinate of x-axis, y-axis and z-axis0、β0、γ0, processing unit 137 passes through
The mode calculated calculates t time delay10Forward maximum offset (the Δ α of interior user 20 angle coordinate1, Δ β1, Δ γ1)
With reverse maximum offset (Δ α2, Δ β2, Δ γ2), the coordinate set that arrangement user is likely to occur:
Ф={ (α0-Δα2<α<α0+Δα1), (β0-Δβ2<β<β0+Δβ1), (γ0-Δγ2<γ<γ0+Δγ1), | α,
Beta, gamma }；
The set of the image-region that the window image region 31 that in set Ф, all coordinates are corresponding surrounds is limit area
32.Corresponding angle coordinate can be obtained by Attitute detecting device 1353 detection.
The maximum offset of angle coordinate has a lot of algorithm, and one of which is exactly the largest motion angle speed utilizing user 20
Degree calculates.Here, we make the largest motion angular velocity of user 20 be ω, then user 20 along x-axis, y-axis and z-axis each
The maximum angular rate that direction rotates is ωα、ωβ、ωγ, at t time delay10Interior user 20 is along each side of x-axis, y-axis and z-axis
It is ω to the maximum angle rotatedαt10、ωβt10、ωγt10, the excursion of angle coordinate is:
{((α0-ωαt10)≤α≤(α0+ωαt10)), ((β0-ωβt10)≤β≤(β0+ωβt10)), ((γ0-ωγt10)
≤γ≤(γ0+ωγt10)),
Now, the collection of angle coordinate is combined into:
Ф={ ((α0-ωαt10)≤α≤(α0+ωαt10)), ((β0-ωβt10)≤β≤(β0+ωβt10)), ((γ0-ωγ
t10)≤γ≤(γ0+ωγt10)) | α, beta, gamma }.
Generally, when the network condition of user 20 is good, its time delay t10Less, within time delay its
Range of movement is less, and the scope of limit area 32 is the least；When the network condition of user 20 is the best, its time delay t10Relatively
Greatly, within time delay, its range of movement is relatively big, and the scope of limit area 32 is the biggest.When the region of limit area 32 reaches and greatly
When the scope of 360 degree of panoramic pictures, it is impossible to ensureing to provide the virtual reality experience of smoothness to user, at this moment we are referred to as pole
Limit region 32 supersaturation.Reduce transmission image quality by part can reach reduce volume of transmitted data and reduce t time delay10Mesh
's.Response test device 1371 is after user 20 Connection Service device, and test response time also obtains t time delay indirectly10, root
According to t time delay10Size, processing unit 137 judge need transmission image quality.According to t time delay10From big to small, process
Unit 137 is given respectively: it is not recommended that access, low image quality, medium image quality, the judgement of high definition image quality, and is supplied to user 20 and joins
Examine.When image quality is in low image quality, limit area 32 reached supersaturation, it is not recommended that access；The limit when image quality is in low image quality
Region 32 not up to supersaturation, when image quality is in medium image quality limit area 32 supersaturation, provides the suggestion of low image quality；Work as image quality
It is in the not up to supersaturation of medium image quality limit area 32, when image quality is in high definition image quality limit area 32 supersaturation, in providing
Suggestion etc. image quality；When image quality is in the 32 not up to supersaturation of high definition image quality limit area, provide the suggestion of high definition image quality.
Referring to Fig. 6, after user 20 selects definition or system default definition, terminal 13 is single according to motion detection
The result that unit 135 detects is to server 11 request data, maximum magnitude request transmission image-region 30 number allowed with bandwidth
According to.After transmission image-region 30 data are transferred to processing unit 137, under this region image data is stored by processing unit 137
Come, form cache image region 39.The refresh rate making terminal 13 is f, then the refresh cycle is (1/f), after this is transmitted,
(1/f) the transmission image-region 30 before time becomes present cache image region 39, cache image region 39 and transmission image
Having the part of overlap between region 30, we are referred to as overlapping image region 35.After transmission starts, processing unit 137 often receives
Data to a transmission image-region 30 are just stored, and update the data of overlapping image region 35, form one
The image-region constantly updated.When network condition is normal, the data of transmission image-region 30 can meet broadcasting demand, i.e. passes
Defeated image-region 30 is more than or equal to limit area 32；When the network of user 20 occurs that fluctuation network speed declines, according to user
The real network situation of 20, reduces the scope of transmission image-region 30, and minimum can be reduced into 0, when transmission image-region 30
When scope is less than limit area 32, only use the data of transmission image-region 30 can not meet broadcasting demand.We are at transmission figure
As other image-regions beyond region 30 use the data in the cache image region 39 stored.Owing to refresh rate f is higher,
Environment around within a short period of time user 20 will not have greatly changed, the image transmitted constantly have bigger may can
There is no lofty sense together with the fusing image data stored before, thus avoid the appearance of spinning sensation, make
User 20 does not feels as the problem that network speed variation is brought.In order to avoid the image transmitted constantly under rare occasion and before
The image stored can not merge (such as running into the light such as lightning drastically scene change) very well, and we can make processing unit
137 carry out pixel detection to the edge of fusion image after image co-registration, if be detected that image border has bigger pixel poor
Do not affect syncretizing effect, then processing unit 137 abandons using the data of transmission image-region 30, continues to use the picture number stored
According to.Image so can be avoided can not to merge the lofty sense brought.
Compared with prior art, the present invention uses and transmits view data according to motion detection unit 135 testing result correspondence
Scheme, save a lot of network bandwidths, make long-range panoramic picture real-time Transmission and display be achieved.By intercepting form
Image-region 31 and the mode of buffering image-region 33, not only reduce volume of transmitted data, and avoid black surround and occur and prolong
The generation of sense late.By the way of cache image and cache image integration, prevent the appearance of spinning sensation.Attitute detecting device
The 1353 angle coordinate information that can detect user, transmit relevant information to processing unit 137 to determine limit region in real time
Territory 32.Fixed limit region 32 can determine the scope of limit area 32 easily with one_to_one corresponding time delay.By really
Determine the maximum offset of angle coordinate in user 20 time delay can the scope in more limit of accuracy region 32, reduce further
Volume of transmitted data.Response test device 1371 is set and can measure the network speed situation of user 20, it is judged that the image quality of transmission, simultaneously
Conveniently draw t time delay10。
Above in conjunction with accompanying drawing, embodiments of the invention are described, but the invention is not limited in above-mentioned concrete
Embodiment, above-mentioned detailed description of the invention is only schematic rather than restrictive, those of ordinary skill in the art
Under the enlightenment of the present invention, in the case of without departing from present inventive concept and scope of the claimed protection, it may also be made that a lot
Form, within these belong to the protection of the present invention.
Claims (10)
1. the method that remotely panoramic picture real-time Transmission and smoothness show, it is characterised in that include server, transmission system and end
End, described terminal includes processing unit, motion detection unit and display unit, and described processing unit detects with described motion respectively
Unit and described display unit are electrically connected with, and described processing unit includes response test device, and described response test device is permissible
Test response time, described response time is that terminal to server issues a signal to terminal and receives used by corresponding return signal
Time, the method for long-range panoramic picture real-time Transmission and smooth display comprises the following steps:
S1: described motion detection unit detects the kinestate of user and by testing result transmission to described processing unit；
S2: the testing result received is processed by described processing unit, and send a request to described server request image
Data；
S3: described server transport correspondence image data are to described terminal.
Long-range panoramic picture real-time Transmission the most according to claim 1 and the method for smooth display, it is characterised in that described
The view data that processing unit storage receives, after the view data that receives overlapping with the image data location stored before
, view data that lap position receives after being updated to.
Long-range panoramic picture real-time Transmission the most according to claim 2 and the method for smooth display, it is characterised in that described
Motion detection unit includes that Attitute detecting device, described Attitute detecting device can detect the angle coordinate information of user.
Long-range panoramic picture real-time Transmission the most according to claim 3 and the method for smooth display, it is characterised in that described
Server image waiting for transmission includes window image region and limit area, and described processing unit is according to described motion detection unit
The angle coordinate information provided draws the window image region of user, and determines limit region according to the exercise data of user
Territory.
Long-range panoramic picture real-time Transmission the most according to claim 4 and the method for smooth display, it is characterised in that pass through
Determine the extreme boundary of window image regional change described in the mankind in corresponding time delay, formed described extreme boundary with when postponing
Between one-to-one relationship, and determine described limit area in corresponding time delay according to described extreme boundary scope.
Long-range panoramic picture real-time Transmission the most according to claim 4 and the method for smooth display, it is characterised in that described
The computational methods of limit area are:
The user angle coordinate information (α that motion detection unit described in processing unit record described in S2.11 provides0, β0, γ0)；
Forward maximum offset (the Δ α of user angle coordinate in processing unit calculates time delay described in S2.121, Δ β1,
Δγ1) and reverse maximum offset (Δ α2, Δ β2, Δ γ2), the angle coordinate set Ф that arrangement user is likely to occur=
{(α0-Δα2<α<α0+Δα1), (β0-Δβ2<β<β0+Δβ1), (γ0-Δγ2<γ<γ0+Δγ1), | α, beta, gamma }；
The set in the window image region that S2.13 set Ф is corresponding is described limit area.
Long-range panoramic picture real-time Transmission the most according to claim 2 and the method for smooth display, it is characterised in that described
Time delay be user be detected the time point of kinestate to server correspondence downlink data transmission complete used time
Between.
Long-range panoramic picture real-time Transmission the most according to claim 7 and the method for smooth display, it is characterised in that use
Person's angle coordinate maximum offset is this coordinate direction largest motion angular velocity and product of time delay of user.
Long-range panoramic picture real-time Transmission the most according to claim 8 and the method for smooth display, it is characterised in that according to
The size of described time delay, described processing unit judges to need the image quality of transmission, and advises to user.
10., according to the long-range panoramic picture real-time Transmission described in any one of claim 19 and the method for smooth display, it is special
Levying and be, described terminal is virtual implementing helmet, augmented reality glasses or panorama Curved screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610510280.XA CN106101684A (en) | 2016-06-30 | 2016-06-30 | Remotely panoramic picture real-time Transmission and the method for smooth display |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610510280.XA CN106101684A (en) | 2016-06-30 | 2016-06-30 | Remotely panoramic picture real-time Transmission and the method for smooth display |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106101684A true CN106101684A (en) | 2016-11-09 |
Family
ID=57211648
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610510280.XA Pending CN106101684A (en) | 2016-06-30 | 2016-06-30 | Remotely panoramic picture real-time Transmission and the method for smooth display |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106101684A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106534968A (en) * | 2016-11-14 | 2017-03-22 | 墨宝股份有限公司 | Method and system for playing 3D video in VR device |
| WO2018120294A1 (en) * | 2016-12-30 | 2018-07-05 | 华为技术有限公司 | Information processing method and device |
| CN109743626A (en) * | 2019-01-02 | 2019-05-10 | 京东方科技集团股份有限公司 | A kind of image display method, image processing method and relevant device |
| CN110446070A (en) * | 2019-07-16 | 2019-11-12 | 重庆爱奇艺智能科技有限公司 | A kind of method and apparatus of video playing |
| CN107147624B (en) * | 2017-04-24 | 2019-11-22 | 珠海全志科技股份有限公司 | Panoramic picture processing method, display device and playback equipment |
| CN111131806A (en) * | 2019-12-30 | 2020-05-08 | 联想(北京)有限公司 | Method and device for displaying virtual object and electronic equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103167270A (en) * | 2011-12-14 | 2013-06-19 | 杭州普维光电技术有限公司 | Person head shooting method, system and server |
| KR101413011B1 (en) * | 2013-01-17 | 2014-07-02 | 국방과학연구소 | Augmented Reality System based on Location Coordinates and Augmented Reality Image Providing Method thereof |
| CN104364754A (en) * | 2012-06-12 | 2015-02-18 | 索尼公司 | Information processing device, information processing method, and program |
| CN104735464A (en) * | 2015-03-31 | 2015-06-24 | 华为技术有限公司 | Panorama video interactive transmission method, server and client end |
| CN105323552A (en) * | 2015-10-26 | 2016-02-10 | 北京时代拓灵科技有限公司 | Method and system for playing panoramic video |
| CN105721856A (en) * | 2014-12-05 | 2016-06-29 | 北京蚁视科技有限公司 | Remote image display method for near-to-eye display |
-
2016
- 2016-06-30 CN CN201610510280.XA patent/CN106101684A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103167270A (en) * | 2011-12-14 | 2013-06-19 | 杭州普维光电技术有限公司 | Person head shooting method, system and server |
| CN104364754A (en) * | 2012-06-12 | 2015-02-18 | 索尼公司 | Information processing device, information processing method, and program |
| KR101413011B1 (en) * | 2013-01-17 | 2014-07-02 | 국방과학연구소 | Augmented Reality System based on Location Coordinates and Augmented Reality Image Providing Method thereof |
| CN105721856A (en) * | 2014-12-05 | 2016-06-29 | 北京蚁视科技有限公司 | Remote image display method for near-to-eye display |
| CN104735464A (en) * | 2015-03-31 | 2015-06-24 | 华为技术有限公司 | Panorama video interactive transmission method, server and client end |
| CN105323552A (en) * | 2015-10-26 | 2016-02-10 | 北京时代拓灵科技有限公司 | Method and system for playing panoramic video |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106534968A (en) * | 2016-11-14 | 2017-03-22 | 墨宝股份有限公司 | Method and system for playing 3D video in VR device |
| WO2018120294A1 (en) * | 2016-12-30 | 2018-07-05 | 华为技术有限公司 | Information processing method and device |
| CN107147624B (en) * | 2017-04-24 | 2019-11-22 | 珠海全志科技股份有限公司 | Panoramic picture processing method, display device and playback equipment |
| CN109743626A (en) * | 2019-01-02 | 2019-05-10 | 京东方科技集团股份有限公司 | A kind of image display method, image processing method and relevant device |
| US11574613B2 (en) | 2019-01-02 | 2023-02-07 | Beijing Boe Optoelectronics Technology Co., Ltd. | Image display method, image processing method and relevant devices |
| CN110446070A (en) * | 2019-07-16 | 2019-11-12 | 重庆爱奇艺智能科技有限公司 | A kind of method and apparatus of video playing |
| CN111131806A (en) * | 2019-12-30 | 2020-05-08 | 联想(北京)有限公司 | Method and device for displaying virtual object and electronic equipment |
| CN111131806B (en) * | 2019-12-30 | 2021-05-18 | 联想(北京)有限公司 | Method and device for displaying virtual object and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106101684A (en) | Remotely panoramic picture real-time Transmission and the method for smooth display | |
| CN106210692A (en) | Long-range panoramic picture real-time Transmission based on pupil detection and display packing | |
| US10693938B2 (en) | Method and system for interactive transmission of panoramic video | |
| CN106464854B (en) | Image encodes and display | |
| CN106919248A (en) | It is applied to the content transmission method and equipment of virtual reality | |
| WO2019037365A1 (en) | Virtual reality panoramic video stream projection method and device | |
| CN105872698B (en) | Playback method, play system and virtual reality terminal | |
| CN105103034A (en) | Display | |
| JP6620079B2 (en) | Image processing system, image processing method, and computer program | |
| CN106775528A (en) | A kind of touring system of virtual reality | |
| BR102016007066A2 (en) | apparatus and system for displaying a bird's eye view in a viewfinder, and method of creating a bird's eye view of an aircraft cabin | |
| US20120120183A1 (en) | 3d video conference | |
| US10977852B2 (en) | VR playing method, VR playing device, and VR playing system | |
| CN106101683A (en) | The remotely comprehensive real-time Transmission of panoramic picture and display packing | |
| WO2020003860A1 (en) | Information processing device, information processing method, and program | |
| CN106453913A (en) | Method and apparatus for previewing panoramic contents | |
| CN105721856B (en) | A kind of remote image display methods for near-to-eye | |
| CN110488981A (en) | Mobile phone terminal VR scene interactivity formula display methods based on cloud rendering | |
| US11082475B1 (en) | Measuring quality-of-experience (QoE) for virtual reality (VR) streaming content | |
| US11187895B2 (en) | Content generation apparatus and method | |
| US20230186537A1 (en) | Data transmission method and related device for virtual reality system | |
| CN106170082A (en) | The remotely real-time comprehensive transmission of panoramic picture and display packing | |
| CN117542253A (en) | Pilot cockpit training system | |
| CN106686389A (en) | Method for achieving remote real-time transmission and display of panoramic image | |
| CN205007570U (en) | Remote -control toy tank at 3D visual angle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20161109 |