CN109801353A - A kind of method of image rendering, server and terminal - Google Patents
A kind of method of image rendering, server and terminal Download PDFInfo
- Publication number
- CN109801353A CN109801353A CN201910040634.2A CN201910040634A CN109801353A CN 109801353 A CN109801353 A CN 109801353A CN 201910040634 A CN201910040634 A CN 201910040634A CN 109801353 A CN109801353 A CN 109801353A
- Authority
- CN
- China
- Prior art keywords
- scene
- server
- information
- terminal
- attentively
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000009877 rendering Methods 0.000 title claims abstract description 120
- 238000000034 method Methods 0.000 title claims abstract description 109
- 210000001508 eye Anatomy 0.000 claims description 110
- 230000005540 biological transmission Effects 0.000 claims description 28
- 230000008569 process Effects 0.000 abstract description 28
- 238000004891 communication Methods 0.000 abstract description 11
- 230000000694 effects Effects 0.000 abstract description 8
- 230000006870 function Effects 0.000 description 31
- 238000010586 diagram Methods 0.000 description 20
- 238000012545 processing Methods 0.000 description 12
- 238000003860 storage Methods 0.000 description 10
- 230000000007 visual effect Effects 0.000 description 10
- 238000005516 engineering process Methods 0.000 description 6
- 239000011521 glass Substances 0.000 description 5
- 230000033001 locomotion Effects 0.000 description 5
- 230000003190 augmentative effect Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 4
- 238000013461 design Methods 0.000 description 4
- 238000011161 development Methods 0.000 description 4
- 230000004424 eye movement Effects 0.000 description 4
- 238000007726 management method Methods 0.000 description 4
- 210000001747 pupil Anatomy 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 3
- 238000004590 computer program Methods 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000004438 eyesight Effects 0.000 description 3
- 238000013178 mathematical model Methods 0.000 description 3
- 210000005252 bulbus oculi Anatomy 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000009795 derivation Methods 0.000 description 2
- 210000000744 eyelid Anatomy 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000010223 real-time analysis Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 210000004087 cornea Anatomy 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000005043 peripheral vision Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
Landscapes
- Processing Or Creating Images (AREA)
Abstract
The embodiment of the present application discloses method, server and the terminal of a kind of image rendering, for by combining cloud to render function, it avoids terminal processes hardware and is unable to reach the case where requiring, further pass through the acquisition to information is watched attentively, make cloud that can reach the rendering effect of demand without excessive system resource in render process, the pressure for wireless communication procedure is reduced, wireless communication resources have been saved.The embodiment of the present application method include: server receiving terminal send watch information attentively;The server is watched information attentively according to and is rendered to the first scene, and the second scene is obtained;The server sends second scene to the terminal.
Description
Technical field
This application involves image rendering fields, and in particular to a kind of method of image rendering, server and terminal.
Background technique
With virtual reality (virtual reality, VR), augmented reality (augmented reality, AR) and mixing
3D scene, is really presented to the user as far as possible, improves user's by the development of technologies such as real (mixed reality, MR)
" telepresenc ".This needs system that 3D model (image) is presented with high resolution ratio, thus requires high image rendering performance.
In the prior art, image rendering mainly carries image processing hardware, such as GPU by terminal to complete.
However, the promotion of raising and user demand with picture quality, and under the fast-changing scene of scene, be
Reach good rendering effect, even high-end MR, VR equipment, especially VR all-in-one machine at present, AR glasses etc. also can not be complete
Meet requirement of the image rendering to hardware.
Summary of the invention
The embodiment of the present application provides a kind of method of image rendering, by combining cloud to render function, avoids at terminal
Reason hardware is unable to reach the case where requiring, and further by the acquisition to blinkpunkt information, makes cloud nothing in render process
It needs excessive system resource that can reach the rendering effect of demand, reduces the pressure for wireless communication procedure, saved nothing
The line communication resource.
In order to achieve the above objectives, the embodiment of the present application provides the following technical solutions:
The application first aspect provides a kind of method of image rendering, and this method can be applied to VR, AR and MR etc. and need figure
In the scene of shape rendering, the relevant apparatus that the method for the image rendering is related in the process of implementation corresponds to phase in terminal device
The functional entity answered.This method may include: server receiving terminal send watch information attentively;The server is according to the note
Visual information renders the first scene, obtains the second scene;The server sends second scene to the terminal.
Optionally, in some embodiments of the present application, described to watch information attentively include blinkpunkt information, the server root
Watch information attentively according to described the first scene is rendered, obtains the second scene, comprising: the server is believed according to the blinkpunkt
It ceases and determines the first watching area;The server determines the first rendering region, first wash with watercolours according to first watching area
Dye region includes at least one first son rendering region;The server carries out wash with watercolours at least one described first son rendering region
Dye, obtains second scene.
Optionally, in some embodiments of the present application, described to watch information attentively further include watching Vector Message attentively, the service
Device is watched information attentively according to and is rendered to the first scene, and the second scene is obtained, comprising: the server is watched attentively according to
Vector Message obtains the second watching area;The server determines the second rendering region according to second watching area, described
Second rendering region includes at least one second son rendering region;The server is at least one described second son rendering region
It is rendered, obtains second scene.
The application second aspect provides a kind of method of image rendering, and this method can be applied to VR, AR and MR etc. and need figure
In the scene of shape rendering, the relevant apparatus that the method for the image rendering is related in the process of implementation is corresponding corresponding in the server
Functional entity.This method may include: that terminal obtains eye feature information;The terminal is true according to the eye feature information
Surely watch information attentively, it is described watch information attentively and be used to indicate server the first scene is rendered;The terminal to server is sent
It is described to watch information attentively;The terminal receives the second scene that the server is sent, and second scene is the server root
According to the blinkpunkt information to obtained by first scene rendering.
Optionally, in some embodiments of the present application, the terminal watches letter attentively according to eye feature information determination
Breath, comprising: the location information that the terminal is watched attentively according to eye feature acquisition of information user's eye;The terminal is according to institute's rheme
Confidence, which ceases, determines blinkpunkt information, and the blinkpunkt information, which is used to indicate, described watches information attentively.
Optionally, in some embodiments of the present application, the terminal watches letter attentively according to eye feature information determination
Breath, comprising: the directional information that the terminal is watched attentively according to eye feature acquisition of information user's eye;The terminal is according to institute
State directional information and determine and watch Vector Message attentively, it is described watch Vector Message attentively and be used to indicate described watch information attentively.
Optionally, in some embodiments of the present application, the terminal is according to the eye feature acquisition of information blinkpunkt
Information, comprising: the terminal receives the rendering data request that the server is sent;The terminal is believed according to the eye feature
Breath obtains blinkpunkt information.
The application third aspect provides a kind of method of image rendering, and this method can be applied to mobile phone, computer etc. and need figure
In the terminal device of shape rendering, the relevant apparatus that the method for the image rendering is related in the process of implementation corresponds in the server
Corresponding functional entity.This method may include: the eye feature information that server receiving terminal is sent;The server according to
Information is watched in the eye feature information determination attentively;The server is watched information attentively according to and is rendered to the first scene, obtains
To the second scene;The server sends second scene to the terminal.
The application fourth aspect provides a kind of method of image rendering, and this method can be applied to mobile phone, computer etc. and need figure
In the terminal device of shape rendering, the relevant apparatus that the method for the image rendering is related in the process of implementation corresponds in the server
Corresponding functional entity.This method may include: that terminal obtains eyes image;The terminal determines eye according to the eyes image
Portion's characteristic information, the eye feature information are used to indicate the position that user watches the first scene attentively;The terminal to server hair
Send the eye feature information;The terminal receives the second scene that the server is sent, and second scene is the clothes
Device be engaged according to obtained by eye feature information rendering first scene.
The 5th aspect of the application provides a kind of server, which, which has, realizes that above-mentioned first aspect or first aspect are any
A kind of function of the method for possible implementation.The function can also be executed corresponding by hardware realization by hardware
Software realization.The hardware or software include one or more modules corresponding with above-mentioned function.
The 6th aspect of the application provides a kind of terminal, which, which has, realizes that above-mentioned second aspect or second aspect are any one
The function of the method for the possible implementation of kind.The function can also be executed corresponding soft by hardware realization by hardware
Part is realized.The hardware or software include one or more modules corresponding with above-mentioned function.
The 7th aspect of the application provides a kind of server, which, which has, realizes that the above-mentioned third aspect or the third aspect are any
A kind of function of the method for possible implementation.The function can also be executed corresponding by hardware realization by hardware
Software realization.The hardware or software include one or more modules corresponding with above-mentioned function.
The application eighth aspect provides a kind of terminal, which, which has, realizes that above-mentioned fourth aspect or fourth aspect are any one
The function of the method for the possible implementation of kind.The function can also be executed corresponding soft by hardware realization by hardware
Part is realized.The hardware or software include one or more modules corresponding with above-mentioned function.
9th aspect, the embodiment of the present application provide a kind of server, which may include eye-tracking equipment or core
The entities such as piece, the terminal include: input/output (I/O) interface, processor and memory;The memory refers to for storing
It enables;The processor is used to execute the described instruction in the memory, so that the terminal is executed as in aforementioned first aspect
Described in any item methods.
Tenth aspect, the embodiment of the present application provide a kind of terminal, which may include terminal device or chip etc.
Entity, the server include: input/output (I/O) interface, processor and memory;The memory is for storing instruction;
The processor is used to execute described instruction in the memory, so that the server is executed as aforementioned in terms of first to fourth
Any one of described in method.
Tenth on the one hand, and the embodiment of the present application provides a kind of computer readable storage medium, including instruction, when it is being calculated
When being run on machine, so that computer is executed as aforementioned in terms of first to fourth and method described in any optional implementation.
The computer storage medium include: USB flash disk, mobile hard disk, read-only memory (read-only memory, ROM), with
Machine accesses various Jie that can store program code such as memory (random access memory, RAM), magnetic or disk
Matter.
12nd aspect, the embodiment of the present application provide a kind of computer program product, when run on a computer, make
Computer executes as aforementioned method described in any optional implementation in terms of first to fourth.
13rd aspect, this application provides a kind of chip system, which includes processor, for supporting rendering
Equipment realizes function involved in above-mentioned aspect, for example, sending or handling data and/or letter involved in the above method
Breath.In a kind of possible design, the chip system further includes memory, and the memory must for saving rendering apparatus
The program instruction and data wanted.The chip system is also possible to apply and executes phase in rendering apparatus either rendering apparatus
Answer the System on Chip/SoC of function.
As can be seen from the above technical solutions, the embodiment of the present application has the advantage that
The embodiment of the present application by combine cloud render function, avoid terminal processes hardware and be unable to reach the case where requiring,
Further by the acquisition to blinkpunkt information, reach cloud can in render process without excessive system resource is needed
The rendering effect asked reduces the pressure for wireless communication procedure, has saved wireless communication resources.
Detailed description of the invention
Fig. 1 is blinkpunkt render scenes figure provided by the embodiments of the present application;
Fig. 2 is a kind of application architecture figure provided by the embodiments of the present application;
Fig. 3 is a kind of method schematic diagram of figure rendering provided by the embodiments of the present application;
Fig. 4 is the method schematic diagram of another figure rendering provided by the embodiments of the present application;
Fig. 5 is a kind of flow diagram of image rendering method provided by the embodiments of the present application;
Fig. 6 is the flow diagram of another image rendering method provided by the embodiments of the present application;
Fig. 7 is a kind of application scenarios schematic diagram provided by the embodiments of the present application;
Fig. 8 is a kind of structural schematic diagram of server provided by the embodiments of the present application;
Fig. 9 is a kind of structural schematic diagram of terminal provided by the embodiments of the present application;
Figure 10 is the structural schematic diagram of another server provided by the embodiments of the present application;
Figure 11 is the structural schematic diagram of another terminal provided by the embodiments of the present application;
Figure 12 is the structural schematic diagram of another server provided by the embodiments of the present application.
Specific embodiment
With reference to the accompanying drawing, embodiments herein is described, it is clear that described embodiment is only the application
The embodiment of a part, instead of all the embodiments.Those of ordinary skill in the art are it is found that with the development of technology and new field
The appearance of scape, technical solution provided by the embodiments of the present application are equally applicable for similar technical problem.
The embodiment of the present application provides a kind of method of image rendering, and this method moves image rendering task from local device
Long-range cloud processing is moved on to, rendering processing result is then passed back into terminal device by network, therefore greatly reduce VR and set
The standby requirement to hardware processing capability, user can not have to rely on expensive high configuration computer again, to realize " thin " terminal.
Cloud renders the entry threshold that can significantly reduce experience, the experience of high quality is obtained in the terminal of lightweight, to promote VR/
AR's is universal;In terms of content, by the cloud of application (game, video, education etc.), the copyright of creator can be protected conscientiously
Shield, outstanding content, which is also able to continuously, to be updated.In cloud rendering platform framework, phase point will be showed using operation and application
From application processing is completed in cloud and result issues, and terminal only needs to realize that most basic video is decoded, presented, control signaling connects
It receives and uploads, without handling calculating relevant to practical business, enormously simplify the internal structure and performance requirement of glasses.
With virtual reality (virtual reality, VR), augmented reality (augmented reality, AR) and mixing
3D scene, is really presented to the user as far as possible, improves user's by the development of technologies such as real (mixed reality, MR)
" telepresenc ".This needs system that 3D model (image) is presented with high resolution ratio, thus requires high image rendering performance.
Image rendering mainly carries image processing hardware, such as GPU by terminal to complete at present.However, with picture matter
The promotion of raising and the user demand of amount, and under the fast-changing scene of scene, to reach good rendering effect, at present
Even high-end MR, VR equipment, especially VR all-in-one machine, AR glasses etc. can not also fully meet image rendering and want to hardware
It asks.
The booming impetus is presented in VR at present, but preferable user experience relies on power PC mostly or host does this
Ground rendering, so that customer consumption VR higher cost, this affects industry development to a certain degree, and it is in the urgent need to address to become industry
Problem.
In order to solve the above problem, the embodiment of the present application combination blinkpunkt Rendering and cloud Rendering provide a kind of figure
The method of shape rendering.Wherein, blinkpunkt Rendering can effectively reduce the requirement to hardware.Blinkpunkt Rendering refers to
Human eye watches central area attentively and carries out high-resolution rendering, and the method for rendering resolution ratio is reduced in excentral region, due to
Human visual system's central fovea provides clearer vision for field of view center, and the visual quality of peripheral vision is then relatively lower.
As shown in Figure 1, being blinkpunkt render scenes figure provided by the embodiments of the present application, it is seen that image has carried out wash with watercolours by different degrees of
Dye, wherein center is rendered into high-resolution, allotment area renders to intermediate-resolution, and external zones renders to low resolution, simultaneously
Because watching central area attentively is only the fraction in entire visual field, thus blinkpunkt Rendering can reduced to rendering hardware
It is required that while do not influence the visual experience of user.
In a kind of possible scene, the efficiency of transmission of home broadband is limited, and high-resolution image is often to band
Width has higher requirement, as shown in table 1, the table corresponding with the demand of family bandwidth that is general resolution ratio, and and blinkpunkt is utilized to render
Technology can substantially reduce the resolution requirements of image, reduce the demand for home broadband.
Video resolution | Home broadband demand |
Full view 4K video | 50Mbps-100Mbps |
Full view 8K video | 100Mbps-300Mbps |
Full view 12K video | 300Mbps-2Gbps |
Full view 24K video | 2Gbps-5Gbps |
Table 1
In the embodiment of the present application, the frame that can use a kind of cloud rendering executes relevant operation, as shown in Fig. 2, being
A kind of application architecture figure provided by the embodiments of the present application, includes: terminal device, internet and server in the architecture,
In, terminal device can be the combination of display equipment and eye movement tracking mould group, be also possible to be integrated with eye movement tracking function
Terminal integrated equipment, such as: VR glasses or AR equipment etc.;The eye movement data of acquisition is transmitted to by terminal device by internet
Server, wherein the server can be cloud service system, which may include content platform, management system, wash with watercolours
Contaminate task management platform and GPU cluster.Task management platform in cloud rendering system watches center attentively according to what is calculated
Region determines practical rendering task and distributed tasks are to GPU cluster, completes practical rendering task by GPU.Practical rendering task is complete
Cheng Hou, task management platform collect rendering result and result are sent back application program.
For ease of understanding, the detailed process in the present embodiment is described with reference to the accompanying drawing, as shown in figure 3, being this
Apply for a kind of method schematic diagram for figure rendering that embodiment provides, this method includes but is not limited to following steps:
301, terminal obtains eye feature information;
In the present embodiment, terminal may include eye movement tracking mould group, can be acquired with Application Optics writing-method with eye
Image obtains the eyes image of reflection eye motion that is, with camera or the eye motion situation of camera record subject, with
And eye feature is extracted from the eyes image got for establishing sight or watching the model of point estimation attentively.
In a kind of possible scene, infrared light supply or first-class figure of the device acquisition with eye of infrared photography can use
Picture, to obtain eye feature information, wherein eye feature may include: pupil position, pupil shape, iris position, iris shape
Shape, eyelid position, canthus position, hot spot (also referred to as Purkinje image) position etc..Such as: light source is pointed into eye, by Image Acquisition
Equipment shoots eye, reflection point, that is, hot spot of the corresponding photographic light sources on cornea, thus obtains the eye for having hot spot
Image, at this point, should be eye feature information with the eyes image of hot spot.
It is understood that in the process using infrared light supply or first-class image of the device acquisition with eye of infrared photography
In, infrared light supply or infrared camera can be multiple, and arrange in a predetermined manner, such as isosceles triangle, linear type etc., this is pre-
Fixed mode can be the setting in response to user, is also possible to terminal and is acquired obtained by data statistics according to history, specific to acquire
Depending on the quantity and arrangement mode of device are because of actual scene, herein without limitation.
It should be noted that the present embodiment can also utilize other methods for being not based on eyes image, such as based on contact/
Contactless sensor (such as electrode, capacitance sensor) calculates the movement of eye, the specific method for obtaining eyes image because
Depending on actual scene, herein without limitation.
302, terminal watches information attentively according to the eye feature acquisition of information;
In the present embodiment, terminal carries out real-time analysis processing according to eye feature information, so that obtain eye watches letter attentively
Breath.It is understood that this watches information attentively can be mapped with the first scene on server in the same coordinate system, that is, infuse
Visual information can be a coordinate, which can indicate corresponding position in the first scene.
Sight or blinkpunkt are watched attentively according to the eye that eye feature information obtains it is understood that watching information attentively and can be
Projected position on a certain plane, i.e. blinkpunkt information, wherein watch the process that sight or blinkpunkt determine attentively and may is that and adopt
When collecting Rotation of eyeball, the variation relation of the relative position of pupil center and hot spot is corresponding collected several with hot spot
Eyes image reflects such change in location relationship;Gone out according to the change in location relation derivation and watches sight or blinkpunkt attentively.
Optionally, watch information attentively to be also possible to watch vector (direction) attentively according to the eye that eye feature information obtains, if note
There is interaction with model in three-dimensional scenic depending on vector, then watches information attentively and be also possible to the song interacted in the 3 d space with jobbie
The set of face or multiple intersection points, depending on concrete scene is because of actual conditions, herein without limitation.
Optionally, in a kind of possible scene, terminal will be responsive to the demand of server and choose whether transmission first
Scene and information is watched attentively, at this point, the rendering data request that terminal acceptable server is sent, rendering data request may include
Demand watches the design parameter that information is included attentively, such as: location information or Vector Message, depending on concrete scene is because of actual conditions,
Herein without limitation.
Optionally, since different user's eye features is different, terminal is watched attentively according to the eye feature acquisition of information
Information can be also used for generating calibration parameter, improve the accuracy of collection process;Specifically, user is allowed to watch one or more attentively
Target point, it is assumed that the information of the target point is known sight (target point is preset), it is possible thereby to instead
Solve above-mentioned calibration parameter.It should be noted that the calibration process can carry out the demand of precision in response to user, i.e.,
It can carry out generating calibration parameter process in the high-precision scene of demand.
303, information is watched attentively described in terminal to server transmission;
In the present embodiment, watches information attentively and can be being identified in corresponding coordinate system, be also possible to as independent
Analysis information send, depending on concrete scene is because of actual conditions, herein without limitation.
304, terminal receives the second scene that the server is sent.
In the present embodiment, terminal may include display equipment, and terminal can set the second scene received by display
It is standby to be shown to user.
By the above method, blinkpunkt technology is integrated in cloud rendering function, avoiding terminal processes hardware can not reach
To the case where requirement, further by the acquisition to information is watched attentively, provide cloud in render process without excessive system
Source can reach the rendering effect of demand, reduce the pressure for wireless communication procedure, saved wireless communication resources.
In corresponding cloud rendering framework, the method flow that server is carried out is as follows, as shown in figure 4, being the application reality
The method schematic diagram of another figure rendering of example offer is applied, this method includes but is not limited to following steps:
401, what server receiving terminal was sent watches information attentively;
In the present embodiment, information is watched attentively and can be being identified in coordinate system corresponding with the first scene, it can also be with
It is to be sent as individual analysis information, depending on concrete scene is because of actual conditions, herein without limitation.
It is understood that watches that information can be eye attentively watches the projected position of sight or blinkpunkt in the plane attentively,
It is also possible to the vector of watching attentively of eye, or watches the collection of curved surface or multiple intersection points that vector is interacted with jobbie in the 3 d space attentively
It closes, depending on concrete scene is because of actual conditions, herein without limitation.
402, server watches information attentively to the first scene rendering according to, obtains the second scene.
In the present embodiment, if watching information attentively is location information, i.e. blinkpunkt information, then wash with watercolours can be determined according to location information
Dye center, it is to be understood that rendering center can be certain region, at this point, carrying out high quality rendering to rendering center;So
Central area is calculated using specified mathematical model according to rendering center afterwards, wherein be calculated using specified mathematical model
Central area can be border circular areas, polygonal region or fan-shaped region, such as: to render center as the center of circle, take certain half
Region in the circle of diameter is center region, to central area carry out in quality render, to removed in the first scene rendering center and in
Region other than heart district domain carries out low quality rendering, wherein low quality rendering can be carry out Fuzzy Processing;Render the height of quality
It is low to be embodied by resolution of screen, i.e., different resolution ratio ratios is distributed according to rendering region division, it is to be understood that
Central area may include multiple subregions, such as image to be rendered can be divided into three circles, 1.5 degree of central vision area, and 4
The secondary visual zone and outermost visual zone of degree;Using blinkpunkt as center dot, extended area is differentiated as 1.5 with radius
Degree, 4 degree, outermost region;Referring to the data of table 1, central vision area can be rendered into 14K image quality, secondary visual zone rendering
For 8K image quality, outermost visual zone is rendered into 4K image quality.
Optionally, it if watching information attentively is Vector Message, can be obtained watching vector attentively according to Vector Message, according to watching vector attentively
Centered on, it takes certain radius to do sphere, generates central area, and above-mentioned rendering processing is carried out to the first scene.Correlation rendering
If operation and rendering level can refer to the associated description watched attentively when information is location information, it is not repeated herein.
It, can also be with it should be noted that the relevant parameter in specified mathematical model can be the input in response to user
It is the empirical parameter that server is counted according to historical data, depending on concrete scene is because of actual conditions, herein without limitation.
403, server sends the second scene to terminal.
In the present embodiment, server can send second by transmission of wireless signals mode such as WIFI, bluetooth or infrared rays
Scene depending on concrete mode is because of actual scene, can also be not repeated herein by the wire signals transmission mode such as cable.
The present embodiment is reduced in rendering task by the acquisition and relevant calculating for watching information attentively for service
The operation pressure of device, and good rendering service can also be provided while simplifying operation.
In a kind of possible scene, terminal is referred to following process with server and is rendered, as shown in figure 5, being
A kind of flow diagram of image rendering method provided by the embodiments of the present application.
501, terminal obtains eye feature information;
502, terminal watches information attentively according to eye feature acquisition of information;
503, information is watched in terminal transmission attentively;
In the present embodiment, step 501-503 is similar with step 301-303, is not repeated herein.
504, information is watched in server reception attentively;
505, server obtains the second scene according to information is watched attentively to the first scene rendering;
In the present embodiment, step 504-505 is similar with step 401-402, is not repeated herein.
506, server sends the second scene to terminal;
507, terminal receives the second scene.
In the present embodiment, step 506 is similar with step 304, and step 507 is similar with step 403, is not repeated herein.
Above method embodiment can be applied to VR glasses, MR device etc. with eye tracking function and can be according to eye
Signature analysis obtains watching attentively in the terminal of information, and in a kind of possible scene, the embodiment of the present application also provides one kind and can answer
For only with eyes image obtain function terminal in, such as: mobile phone, notebook personal computer etc., with reference to the accompanying drawing into
Row explanation.
As shown in fig. 6, being the flow diagram of another image rendering method provided by the embodiments of the present application, this method packet
It includes but is not limited to following steps:
601, terminal obtains eyes image;
In the present embodiment, terminal can be mobile phone, be also possible to the terminal device that PC etc. has communication function;Eventually
End can obtain the eye figure of reflection eye motion by the eye motion situation with camera or camera record subject
Picture, depending on concrete mode is because of actual scene, herein without limitation.
602, terminal determines eye feature information according to eyes image;
In the present embodiment, terminal can extract eye feature for establishing sight/watch attentively from the eyes image got
The model of point estimation.Wherein, eye feature may include: pupil position, pupil shape, iris position, iris shape, eyelid position
It sets, canthus position, hot spot (also referred to as Purkinje image) position etc..
Optionally, since different user's eye features is different, terminal is watched attentively according to the eye feature acquisition of information
Information can be also used for generating calibration parameter, improve the accuracy of collection process;Specifically, user is allowed to watch one or more attentively
Target point, it is assumed that the information of the target point is known sight (target point is preset), it is possible thereby to instead
Solve above-mentioned calibration parameter.It should be noted that the calibration process can carry out the demand of precision in response to user, i.e.,
It can carry out generating calibration parameter process in the high-precision scene of demand.
603, terminal sends eye feature information;
In the present embodiment, terminal can be by 3G, 4G or 5G network transmission eye feature information, can also be by wirelessly protecting
True technology, infrared ray or Bluetooth transmission eye feature information, can also pass through the wire transmission sides such as USB interface, type-c interface
Formula transmits eye feature information, depending on concrete mode is because of actual scene, herein without limitation.
604, server watches information attentively according to the determination of eye feature information;
In the present embodiment, server carries out real-time analysis processing according to eye feature information, to obtain watching attentively for eye
Information.It is understood that this watches information attentively can be mapped with the first scene on server in the same coordinate system, i.e.,
Watching information attentively can be a coordinate, which can indicate corresponding position in the first scene.
Sight or blinkpunkt are watched attentively according to the eye that eye feature information obtains it is understood that watching information attentively and can be
Projected position on a certain plane, wherein when watching the process that sight or blinkpunkt determine attentively and may is that acquisition Rotation of eyeball,
The variation relation of the relative position of pupil center and hot spot, corresponding collected several eyes images with hot spot reflect
Such change in location relationship;Gone out according to the change in location relation derivation and watches sight or blinkpunkt attentively.
Optionally, watch information attentively to be also possible to watch vector (direction) attentively according to the eye that eye feature information obtains, if note
There is interaction with model in three-dimensional scenic depending on vector, then watches information attentively and be also possible to the song interacted in the 3 d space with jobbie
The set of face or multiple intersection points, depending on concrete scene is because of actual conditions, herein without limitation.
Optionally, in a kind of possible scene, server will be responsive to the demand of server and choose whether transmission
One scene and watch information attentively, at this point, the rendering data request that server acceptable server is sent, rendering data request can
The design parameter that information is included is watched attentively including demand, such as: location information or Vector Message, concrete scene is due to actual conditions
It is fixed, herein without limitation.
605, server obtains the second scene according to information is watched attentively to the first scene rendering;
606, server sends the second scene;
607, terminal receives the second scene.
In the present embodiment, step 605-607 is similar with step 505-507, is not repeated herein.
It should be noted that the server in the above method can be one, it is also possible to multiple, that is, works as first server
When channel resource is limited or unbearable corresponding rendering quality requirement, by eye feature information or information can be watched attentively it is forwarded to second
Server gets on, to achieve the purpose that rendering.
In a kind of possible scene, as shown in fig. 7, be a kind of application scenarios schematic diagram provided by the embodiments of the present application,
Multiple terminals are communicated by WI-FI with home server, but home server scene process ability is limited, at this point it is possible to will connect
The render request and data of the multiple terminals received are by 5G network transmission to cloud server, to render processing.
The embodiment of the present application can be applied in terminal according to the above method, and the division of functional module is carried out to terminal,
For example, each functional module of each function division can be corresponded to, two or more functions can also be integrated in one
In processing module.Above-mentioned integrated module both can take the form of hardware realization, can also use the shape of software function module
Formula is realized.It should be noted that being schematical, only a kind of logic function stroke to the division of module in the embodiment of the present application
Point, there may be another division manner in actual implementation.
For example, in the case where to use the integrated each functional unit of model split, as shown in figure 8, being that the application is implemented
A kind of structural schematic diagram for server that example provides.
If Fig. 8 shows, server 800 provided by the embodiments of the present application includes receiving unit 801, rendering unit 802 and sends
Unit 803.
Receiving unit 801, for receive terminal transmission watch information attentively;
Rendering unit 802 renders the first scene for watching information attentively according to, obtains the second scene;
Transmission unit 803, for sending second scene to the terminal.
As shown in figure 9, being a kind of structural schematic diagram of terminal provided by the embodiments of the present application.The terminal 900 may include
Acquiring unit 901, determination unit 902, transmission unit 903 and receiving unit 904.
Acquiring unit 901, for obtaining eye feature information;
Determination unit 902 watches information attentively for determining according to the eye feature information, described to watch information attentively and be used to indicate
Server renders the first scene;
Transmission unit 903, for watching information attentively described in sending to server;
Receiving unit 904, the second scene sent for receiving the server, second scene are the server
Information is watched attentively to obtained by first scene rendering according to described.
It as shown in Figure 10, is the structural schematic diagram of another server provided by the embodiments of the present application.
If Figure 10 shows, server 1000 provided by the embodiments of the present application includes receiving unit 1001, determination unit 1002, wash with watercolours
Contaminate unit 1003 and transmission unit 1004.
Receiving unit 1001, for receiving the eye feature information of terminal transmission;
Determination unit 1002, for watching information attentively according to eye feature information determination;
Rendering unit 1003 renders the first scene for watching information attentively according to, obtains the second scene;
Transmission unit 1004, for sending second scene to the terminal.
It as shown in figure 11, is the structural schematic diagram of another server provided by the embodiments of the present application.
If Figure 11 shows, server 1100 provided by the embodiments of the present application includes acquiring unit 1101, determination unit 1102, hair
Send unit 1103 and receiving unit 1104.
Acquiring unit 1101, for obtaining eyes image;
Determination unit 1102, for determining that eye feature information, the eye feature information are used according to the eyes image
The position of the first scene is watched attentively in instruction user;
Transmission unit 1103, for sending the eye feature information to server;
Receiving unit 1104, the second scene sent for receiving the server, second scene are the service
Device renders obtained by first scene according to the eye feature information.
Wherein, all related contents for each step that above method embodiment is related to can quote corresponding function unit
Function description, details are not described herein.
In the present embodiment, server 800 can be presented in the form of the integrated each functional module of model split.
Here " module " can refer to application-specific integrated circuit (application-specific integrated circuit,
ASIC), circuit, executes the processor and memory of one or more softwares or firmware program, integrated logic circuit and/or its
He can provide the device of above-mentioned function.In a simple embodiment, those skilled in the art is contemplated that server
800 can be using form shown in Figure 12.
It as shown in figure 12, is the structural schematic diagram of another server provided by the embodiments of the present application, server 1200 wraps
It includes: input/output (I/O) interface 1201, processor 1202, memory 1203.Specifically, processor 1202 in Figure 12 can be with
By calling the computer executed instructions stored in memory 1203, server 1200 is made to execute the reality in above method embodiment
Now watch the method for acquisition of information attentively.
Specifically, function/realization process of receiving unit 801, rendering unit 802 and transmission unit 803 in Fig. 8 can be with
The computer executed instructions stored in memory 1203 are called to realize by the processor 1202 in Figure 12.Alternatively, in Fig. 8
The function of receiving unit 801, rendering unit 802 and transmission unit 803/realization process can pass through the input/output in Figure 12
(I/O) interface 1201 is realized.
Since server 1200 provided by the embodiments of the present application can be used for executing the method for figure rendering, can obtain
The technical effect obtained can refer to above method embodiment, and details are not described herein.
In addition, each functional module of integrated model split can also be used in terminal 900, server 1000 and terminal 1100
Form is presented, and concrete mode can refer to the associated description of Figure 12, be not repeated herein.
Optionally, the embodiment of the present application provides a kind of chip system, which includes processor, for supporting end
The method that end or server realize above-mentioned image rendering.In a kind of possible design, which further includes memory.It should
Memory, for saving terminal or the necessary program instruction of server and data.The chip system can be made of chip,
It may include chip and other discrete devices, the embodiment of the present application is not especially limited this.
In the above-described embodiments, can come wholly or partly by software, hardware, firmware or any combination thereof real
It is existing.When implemented in software, it can entirely or partly realize in the form of a computer program product.
The computer program product includes one or more computer instructions.Load and execute on computers the meter
When calculation machine program instruction, entirely or partly generate according to process or function described in the embodiment of the present application.The computer can
To be general purpose computer, special purpose computer, computer network or other programmable devices.The computer instruction can be deposited
Storage in a computer-readable storage medium, or from a computer readable storage medium to another computer readable storage medium
Transmission, for example, the computer instruction can pass through wired (example from a web-site, computer, server or data center
Such as coaxial cable, optical fiber, Digital Subscriber Line (DSL)) or wireless (such as infrared, wireless, microwave) mode to another website
Website, computer, server or data center are transmitted.The computer readable storage medium can be computer and can deposit
Any usable medium of storage either includes that the data storages such as one or more usable mediums integrated server, data center are set
It is standby.The usable medium can be magnetic medium, (for example, floppy disk, hard disk, tape), optical medium (for example, DVD) or partly lead
Body medium (such as solid state hard disk solid state disk (SSD)) etc..
The description and claims of this application and term " first " in above-mentioned attached drawing, " second " etc. are for distinguishing
Similar object, without being used to describe a particular order or precedence order.It should be understood that the data used in this way are in appropriate feelings
It can be interchanged under condition, so that the embodiments described herein can be real with the sequence other than the content for illustrating or describing herein
It applies.In addition, term " includes " and " having " and their any deformation, it is intended that cover it is non-exclusive include, for example, packet
The process, method, system, product or equipment for having contained series of steps or module those of be not necessarily limited to be clearly listed step or
Module, but may include other steps being not clearly listed or intrinsic for these process, methods, product or equipment or
Module.Occur in this application to step carry out name perhaps number be not meant to must according to name or number
Indicated time/logic sequencing executes the step in method flow, and named or number process step can be with
Execution order is changed according to the technical purpose to be realized, as long as identical or similar technical effect can be reached.This Shen
Please appeared in module division, be a kind of division in logic, can have other division side when realizing in practical application
Formula, such as multiple modules can be combined into or are integrated in another system, or some features can be ignored or not executed, separately
Outside, shown or discussion mutual coupling, direct-coupling or communication connection can be through some interfaces, module
Between indirect coupling or communication connection can be electrical or other similar form, be not construed as limiting in the application.Also, make
It can be the separation that may not be physically for the module or submodule of separate part description, can be and may not be physics
Module, or can be distributed in multiple circuit modules, some or all of modules can be selected according to the actual needs
To realize the purpose of application scheme.
Those of ordinary skill in the art will appreciate that all or part of the steps in the various methods of above-described embodiment is can
It is completed with instructing relevant hardware by program, which can be stored in a computer readable storage medium, storage
Medium may include: ROM, RAM, disk or CD etc..
Detailed Jie has been carried out to the method for image rendering provided by the embodiment of the present application, server and terminal above
It continues, specific examples are used herein to illustrate the principle and implementation manner of the present application, and the explanation of above embodiments is only
It is to be used to help understand the method for this application and its core ideas;At the same time, for those skilled in the art, according to this Shen
Thought please, there will be changes in the specific implementation manner and application range, in conclusion the content of the present specification should not manage
Solution is the limitation to the application.
Claims (12)
1. a kind of method of image rendering characterized by comprising
What server receiving terminal was sent watches information attentively;
The server is watched information attentively according to and is rendered to the first scene, and the second scene is obtained;
The server sends second scene to the terminal.
2. the method according to claim 1, wherein described, to watch information attentively include blinkpunkt information, the service
Device is watched information attentively according to and is rendered to the first scene, and the second scene is obtained, comprising:
The server determines the first watching area according to the blinkpunkt information;
The server determines the first rendering region according to first watching area, and first rendering region includes at least one
A first son rendering region;
The server renders at least one described first son rendering region, obtains second scene.
3. according to the method described in claim 2, it is characterized in that, it is described to watch information attentively further include watching Vector Message attentively, it is described
Server is watched information attentively according to and is rendered to the first scene, and the second scene is obtained, comprising:
The server watches Vector Message attentively according to and obtains the second watching area;
The server determines the second rendering region according to second watching area, and second rendering region includes at least one
A second son rendering region;
The server renders at least one described second son rendering region, obtains second scene.
4. the method according to claim 1, wherein the server receiving terminal send blinkpunkt information it
Before, the method also includes:
The server receives the terminal and sends acquisition rendering data request.
5. a kind of method of image rendering characterized by comprising
Terminal obtains eye feature information;
The terminal is determined according to the eye feature information watches information attentively, described to watch information attentively and be used to indicate server to first
Scene is rendered;
The terminal to server watches information attentively described in sending;
The terminal receives the second scene that the server is sent, and second scene is that the server is watched attentively according to
Point information is to obtained by first scene rendering.
6. according to the method described in claim 5, it is characterized in that, the terminal is watched attentively according to the eye feature acquisition of information
Point information, comprising:
The rendering data request that the terminal is sent to the server;
The terminal is according to the eye feature acquisition of information blinkpunkt information.
7. a kind of method of image rendering characterized by comprising
The eye feature information that server receiving terminal is sent;
The server watches information attentively according to eye feature information determination;
The server is watched information attentively according to and is rendered to the first scene, and the second scene is obtained;
The server sends second scene to the terminal.
8. a kind of method of image rendering characterized by comprising
Terminal obtains eyes image;
The terminal determines eye feature information according to the eyes image;
The terminal to server sends the eye feature information;
The terminal receives the second scene that the server is sent, and second scene is the server according to the eye
Characteristic information renders obtained by first scene.
9. a kind of server characterized by comprising
Receiving unit, for receive terminal transmission watch information attentively;
Rendering unit renders the first scene for watching information attentively according to, obtains the second scene;
Transmission unit, for sending second scene to the terminal.
10. a kind of terminal characterized by comprising
Acquiring unit, for obtaining eye feature information;
Determination unit watches information attentively for determining according to the eye feature information, described to watch information attentively and be used to indicate server
First scene is rendered;
Transmission unit, for watching information attentively described in sending to server;
Receiving unit, the second scene sent for receiving the server, second scene is the server according to institute
It states and watches information attentively to obtained by first scene rendering.
11. a kind of server characterized by comprising
Receiving unit, for receiving the eye feature information of terminal transmission;
Determination unit, for watching information attentively according to eye feature information determination;
Rendering unit renders the first scene for watching information attentively according to, obtains the second scene;
Transmission unit, for sending second scene to the terminal.
12. a kind of terminal characterized by comprising
Acquiring unit, for obtaining eyes image;
Determination unit, for determining that eye feature information, the eye feature information are used to indicate use according to the eyes image
The position of the first scene is watched at family attentively;
Transmission unit, for sending the eye feature information to server;
Receiving unit, the second scene sent for receiving the server, second scene is the server according to institute
Eye feature information is stated to render obtained by first scene.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910040634.2A CN109801353A (en) | 2019-01-16 | 2019-01-16 | A kind of method of image rendering, server and terminal |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910040634.2A CN109801353A (en) | 2019-01-16 | 2019-01-16 | A kind of method of image rendering, server and terminal |
Publications (1)
Publication Number | Publication Date |
---|---|
CN109801353A true CN109801353A (en) | 2019-05-24 |
Family
ID=66559478
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910040634.2A Pending CN109801353A (en) | 2019-01-16 | 2019-01-16 | A kind of method of image rendering, server and terminal |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109801353A (en) |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110378914A (en) * | 2019-07-22 | 2019-10-25 | 北京七鑫易维信息技术有限公司 | Rendering method and device, system, display equipment based on blinkpunkt information |
CN111027396A (en) * | 2019-11-13 | 2020-04-17 | 量子云未来(北京)信息科技有限公司 | Driving assistance method and device, vehicle-mounted terminal and cloud server |
CN111131524A (en) * | 2020-01-20 | 2020-05-08 | 上海市特种设备监督检验技术研究院 | Real-time simulation system based on 5G |
CN111553972A (en) * | 2020-04-27 | 2020-08-18 | 北京百度网讯科技有限公司 | Method, apparatus, device and storage medium for rendering augmented reality data |
CN111901628A (en) * | 2020-08-03 | 2020-11-06 | 江西科骏实业有限公司 | Cloud rendering method based on zSpace desktop VR all-in-one machine |
CN112118463A (en) * | 2019-06-21 | 2020-12-22 | 广州虎牙科技有限公司 | Information processing method, cloud platform and information processing system |
CN112565883A (en) * | 2020-11-27 | 2021-03-26 | 深圳市纪元数码技术开发有限公司 | Video rendering processing system and computer equipment for virtual reality scene |
WO2021134710A1 (en) * | 2019-12-31 | 2021-07-08 | 深圳市大疆创新科技有限公司 | Control method and related device |
CN113570698A (en) * | 2021-07-23 | 2021-10-29 | Oppo广东移动通信有限公司 | Resource processing method, device, server and storage medium |
CN113852841A (en) * | 2020-12-23 | 2021-12-28 | 上海飞机制造有限公司 | Visual scene establishing method, device, equipment, medium and system |
CN113946402A (en) * | 2021-11-09 | 2022-01-18 | 中国电信股份有限公司 | Cloud mobile phone acceleration method, system, equipment and storage medium based on rendering separation |
WO2022133683A1 (en) * | 2020-12-21 | 2022-06-30 | 京东方科技集团股份有限公司 | Mixed reality display method, mixed reality device, and storage medium |
CN114727083A (en) * | 2021-01-04 | 2022-07-08 | 中国移动通信有限公司研究院 | Data processing method, device, terminal and network side equipment |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106485790A (en) * | 2016-09-30 | 2017-03-08 | 珠海市魅族科技有限公司 | Method and device that a kind of picture shows |
CN107590859A (en) * | 2017-09-01 | 2018-01-16 | 广州励丰文化科技股份有限公司 | A kind of mixed reality picture processing method and service equipment |
-
2019
- 2019-01-16 CN CN201910040634.2A patent/CN109801353A/en active Pending
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106485790A (en) * | 2016-09-30 | 2017-03-08 | 珠海市魅族科技有限公司 | Method and device that a kind of picture shows |
CN107590859A (en) * | 2017-09-01 | 2018-01-16 | 广州励丰文化科技股份有限公司 | A kind of mixed reality picture processing method and service equipment |
Non-Patent Citations (1)
Title |
---|
尼克·贝瑟斯等: "《大数据与物联网 面向智慧环境路线图》", 北京:国防工业出版社, pages: 379 - 380 * |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112118463A (en) * | 2019-06-21 | 2020-12-22 | 广州虎牙科技有限公司 | Information processing method, cloud platform and information processing system |
CN110378914A (en) * | 2019-07-22 | 2019-10-25 | 北京七鑫易维信息技术有限公司 | Rendering method and device, system, display equipment based on blinkpunkt information |
CN111027396A (en) * | 2019-11-13 | 2020-04-17 | 量子云未来(北京)信息科技有限公司 | Driving assistance method and device, vehicle-mounted terminal and cloud server |
WO2021134710A1 (en) * | 2019-12-31 | 2021-07-08 | 深圳市大疆创新科技有限公司 | Control method and related device |
CN111131524A (en) * | 2020-01-20 | 2020-05-08 | 上海市特种设备监督检验技术研究院 | Real-time simulation system based on 5G |
CN111553972A (en) * | 2020-04-27 | 2020-08-18 | 北京百度网讯科技有限公司 | Method, apparatus, device and storage medium for rendering augmented reality data |
CN111901628A (en) * | 2020-08-03 | 2020-11-06 | 江西科骏实业有限公司 | Cloud rendering method based on zSpace desktop VR all-in-one machine |
CN112565883A (en) * | 2020-11-27 | 2021-03-26 | 深圳市纪元数码技术开发有限公司 | Video rendering processing system and computer equipment for virtual reality scene |
WO2022133683A1 (en) * | 2020-12-21 | 2022-06-30 | 京东方科技集团股份有限公司 | Mixed reality display method, mixed reality device, and storage medium |
CN113852841A (en) * | 2020-12-23 | 2021-12-28 | 上海飞机制造有限公司 | Visual scene establishing method, device, equipment, medium and system |
CN114727083A (en) * | 2021-01-04 | 2022-07-08 | 中国移动通信有限公司研究院 | Data processing method, device, terminal and network side equipment |
CN113570698A (en) * | 2021-07-23 | 2021-10-29 | Oppo广东移动通信有限公司 | Resource processing method, device, server and storage medium |
CN113946402A (en) * | 2021-11-09 | 2022-01-18 | 中国电信股份有限公司 | Cloud mobile phone acceleration method, system, equipment and storage medium based on rendering separation |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109801353A (en) | A kind of method of image rendering, server and terminal | |
US11140317B2 (en) | Method and device for managing thumbnail of three-dimensional contents | |
US20220222790A1 (en) | Gaze Direction-Based Adaptive Pre-Filtering of Video Data | |
US10643307B2 (en) | Super-resolution based foveated rendering | |
KR102603426B1 (en) | Apparatus and method for processing an image | |
EP3023969A2 (en) | Display and method and electronic device | |
US20180063512A1 (en) | Image streaming method and electronic device for supporting the same | |
KR102499139B1 (en) | Electronic device for displaying image and method for controlling thereof | |
CN110378914A (en) | Rendering method and device, system, display equipment based on blinkpunkt information | |
CN113377316A (en) | Apparatus and method for providing screen mirroring service | |
KR102489279B1 (en) | Apparatus and method for processing an image | |
US10921595B2 (en) | Contextual adjustment to augmented reality glasses | |
KR20180023326A (en) | Electronic device and method for providing image acquired by the image sensor to application | |
US20180241943A1 (en) | Electronic device and method for displaying 360-degree image in the electronic device | |
EP3358531A1 (en) | Electronic device for providing vr image based on polyhedron and image providing method thereof | |
US20190325658A1 (en) | Device and method for rendering image | |
EP3547702A1 (en) | Image processing apparatus and image processing method therefor | |
CN111836069A (en) | Virtual gift presenting method, device, terminal, server and storage medium | |
KR20160149842A (en) | Method for processing an image and electronic device thereof | |
KR102164686B1 (en) | Image processing method and apparatus of tile images | |
US20220309725A1 (en) | Edge data network for providing three-dimensional character image to user equipment and method for operating the same | |
KR102558474B1 (en) | Method for displaying an image and an electronic device thereof | |
US20220374188A1 (en) | Electronic billboard and controlling method thereof | |
AU2017320166A1 (en) | Image streaming method and electronic device for supporting the same | |
US10969865B2 (en) | Method for transmission of eye tracking information, head mounted display and computer device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190524 |