CN109801353A - A kind of method of image rendering, server and terminal - Google Patents

A kind of method of image rendering, server and terminal Download PDF

Info

Publication number
CN109801353A
CN109801353A CN201910040634.2A CN201910040634A CN109801353A CN 109801353 A CN109801353 A CN 109801353A CN 201910040634 A CN201910040634 A CN 201910040634A CN 109801353 A CN109801353 A CN 109801353A
Authority
CN
China
Prior art keywords
scene
server
information
terminal
attentively
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910040634.2A
Other languages
Chinese (zh)
Inventor
刘乔
严海
黄通兵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing 7Invensun Technology Co Ltd
Beijing Qixin Yiwei Information Technology Co Ltd
Original Assignee
Beijing Qixin Yiwei Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Qixin Yiwei Information Technology Co Ltd filed Critical Beijing Qixin Yiwei Information Technology Co Ltd
Priority to CN201910040634.2A priority Critical patent/CN109801353A/en
Publication of CN109801353A publication Critical patent/CN109801353A/en
Pending legal-status Critical Current

Links

Landscapes

  • Processing Or Creating Images (AREA)

Abstract

The embodiment of the present application discloses method, server and the terminal of a kind of image rendering, for by combining cloud to render function, it avoids terminal processes hardware and is unable to reach the case where requiring, further pass through the acquisition to information is watched attentively, make cloud that can reach the rendering effect of demand without excessive system resource in render process, the pressure for wireless communication procedure is reduced, wireless communication resources have been saved.The embodiment of the present application method include: server receiving terminal send watch information attentively;The server is watched information attentively according to and is rendered to the first scene, and the second scene is obtained;The server sends second scene to the terminal.

Description

A kind of method of image rendering, server and terminal
Technical field
This application involves image rendering fields, and in particular to a kind of method of image rendering, server and terminal.
Background technique
With virtual reality (virtual reality, VR), augmented reality (augmented reality, AR) and mixing 3D scene, is really presented to the user as far as possible, improves user's by the development of technologies such as real (mixed reality, MR) " telepresenc ".This needs system that 3D model (image) is presented with high resolution ratio, thus requires high image rendering performance.
In the prior art, image rendering mainly carries image processing hardware, such as GPU by terminal to complete.
However, the promotion of raising and user demand with picture quality, and under the fast-changing scene of scene, be Reach good rendering effect, even high-end MR, VR equipment, especially VR all-in-one machine at present, AR glasses etc. also can not be complete Meet requirement of the image rendering to hardware.
Summary of the invention
The embodiment of the present application provides a kind of method of image rendering, by combining cloud to render function, avoids at terminal Reason hardware is unable to reach the case where requiring, and further by the acquisition to blinkpunkt information, makes cloud nothing in render process It needs excessive system resource that can reach the rendering effect of demand, reduces the pressure for wireless communication procedure, saved nothing The line communication resource.
In order to achieve the above objectives, the embodiment of the present application provides the following technical solutions:
The application first aspect provides a kind of method of image rendering, and this method can be applied to VR, AR and MR etc. and need figure In the scene of shape rendering, the relevant apparatus that the method for the image rendering is related in the process of implementation corresponds to phase in terminal device The functional entity answered.This method may include: server receiving terminal send watch information attentively;The server is according to the note Visual information renders the first scene, obtains the second scene;The server sends second scene to the terminal.
Optionally, in some embodiments of the present application, described to watch information attentively include blinkpunkt information, the server root Watch information attentively according to described the first scene is rendered, obtains the second scene, comprising: the server is believed according to the blinkpunkt It ceases and determines the first watching area;The server determines the first rendering region, first wash with watercolours according to first watching area Dye region includes at least one first son rendering region;The server carries out wash with watercolours at least one described first son rendering region Dye, obtains second scene.
Optionally, in some embodiments of the present application, described to watch information attentively further include watching Vector Message attentively, the service Device is watched information attentively according to and is rendered to the first scene, and the second scene is obtained, comprising: the server is watched attentively according to Vector Message obtains the second watching area;The server determines the second rendering region according to second watching area, described Second rendering region includes at least one second son rendering region;The server is at least one described second son rendering region It is rendered, obtains second scene.
The application second aspect provides a kind of method of image rendering, and this method can be applied to VR, AR and MR etc. and need figure In the scene of shape rendering, the relevant apparatus that the method for the image rendering is related in the process of implementation is corresponding corresponding in the server Functional entity.This method may include: that terminal obtains eye feature information;The terminal is true according to the eye feature information Surely watch information attentively, it is described watch information attentively and be used to indicate server the first scene is rendered;The terminal to server is sent It is described to watch information attentively;The terminal receives the second scene that the server is sent, and second scene is the server root According to the blinkpunkt information to obtained by first scene rendering.
Optionally, in some embodiments of the present application, the terminal watches letter attentively according to eye feature information determination Breath, comprising: the location information that the terminal is watched attentively according to eye feature acquisition of information user's eye;The terminal is according to institute's rheme Confidence, which ceases, determines blinkpunkt information, and the blinkpunkt information, which is used to indicate, described watches information attentively.
Optionally, in some embodiments of the present application, the terminal watches letter attentively according to eye feature information determination Breath, comprising: the directional information that the terminal is watched attentively according to eye feature acquisition of information user's eye;The terminal is according to institute State directional information and determine and watch Vector Message attentively, it is described watch Vector Message attentively and be used to indicate described watch information attentively.
Optionally, in some embodiments of the present application, the terminal is according to the eye feature acquisition of information blinkpunkt Information, comprising: the terminal receives the rendering data request that the server is sent;The terminal is believed according to the eye feature Breath obtains blinkpunkt information.
The application third aspect provides a kind of method of image rendering, and this method can be applied to mobile phone, computer etc. and need figure In the terminal device of shape rendering, the relevant apparatus that the method for the image rendering is related in the process of implementation corresponds in the server Corresponding functional entity.This method may include: the eye feature information that server receiving terminal is sent;The server according to Information is watched in the eye feature information determination attentively;The server is watched information attentively according to and is rendered to the first scene, obtains To the second scene;The server sends second scene to the terminal.
The application fourth aspect provides a kind of method of image rendering, and this method can be applied to mobile phone, computer etc. and need figure In the terminal device of shape rendering, the relevant apparatus that the method for the image rendering is related in the process of implementation corresponds in the server Corresponding functional entity.This method may include: that terminal obtains eyes image;The terminal determines eye according to the eyes image Portion's characteristic information, the eye feature information are used to indicate the position that user watches the first scene attentively;The terminal to server hair Send the eye feature information;The terminal receives the second scene that the server is sent, and second scene is the clothes Device be engaged according to obtained by eye feature information rendering first scene.
The 5th aspect of the application provides a kind of server, which, which has, realizes that above-mentioned first aspect or first aspect are any A kind of function of the method for possible implementation.The function can also be executed corresponding by hardware realization by hardware Software realization.The hardware or software include one or more modules corresponding with above-mentioned function.
The 6th aspect of the application provides a kind of terminal, which, which has, realizes that above-mentioned second aspect or second aspect are any one The function of the method for the possible implementation of kind.The function can also be executed corresponding soft by hardware realization by hardware Part is realized.The hardware or software include one or more modules corresponding with above-mentioned function.
The 7th aspect of the application provides a kind of server, which, which has, realizes that the above-mentioned third aspect or the third aspect are any A kind of function of the method for possible implementation.The function can also be executed corresponding by hardware realization by hardware Software realization.The hardware or software include one or more modules corresponding with above-mentioned function.
The application eighth aspect provides a kind of terminal, which, which has, realizes that above-mentioned fourth aspect or fourth aspect are any one The function of the method for the possible implementation of kind.The function can also be executed corresponding soft by hardware realization by hardware Part is realized.The hardware or software include one or more modules corresponding with above-mentioned function.
9th aspect, the embodiment of the present application provide a kind of server, which may include eye-tracking equipment or core The entities such as piece, the terminal include: input/output (I/O) interface, processor and memory;The memory refers to for storing It enables;The processor is used to execute the described instruction in the memory, so that the terminal is executed as in aforementioned first aspect Described in any item methods.
Tenth aspect, the embodiment of the present application provide a kind of terminal, which may include terminal device or chip etc. Entity, the server include: input/output (I/O) interface, processor and memory;The memory is for storing instruction; The processor is used to execute described instruction in the memory, so that the server is executed as aforementioned in terms of first to fourth Any one of described in method.
Tenth on the one hand, and the embodiment of the present application provides a kind of computer readable storage medium, including instruction, when it is being calculated When being run on machine, so that computer is executed as aforementioned in terms of first to fourth and method described in any optional implementation.
The computer storage medium include: USB flash disk, mobile hard disk, read-only memory (read-only memory, ROM), with Machine accesses various Jie that can store program code such as memory (random access memory, RAM), magnetic or disk Matter.
12nd aspect, the embodiment of the present application provide a kind of computer program product, when run on a computer, make Computer executes as aforementioned method described in any optional implementation in terms of first to fourth.
13rd aspect, this application provides a kind of chip system, which includes processor, for supporting rendering Equipment realizes function involved in above-mentioned aspect, for example, sending or handling data and/or letter involved in the above method Breath.In a kind of possible design, the chip system further includes memory, and the memory must for saving rendering apparatus The program instruction and data wanted.The chip system is also possible to apply and executes phase in rendering apparatus either rendering apparatus Answer the System on Chip/SoC of function.
As can be seen from the above technical solutions, the embodiment of the present application has the advantage that
The embodiment of the present application by combine cloud render function, avoid terminal processes hardware and be unable to reach the case where requiring, Further by the acquisition to blinkpunkt information, reach cloud can in render process without excessive system resource is needed The rendering effect asked reduces the pressure for wireless communication procedure, has saved wireless communication resources.
Detailed description of the invention
Fig. 1 is blinkpunkt render scenes figure provided by the embodiments of the present application;
Fig. 2 is a kind of application architecture figure provided by the embodiments of the present application;
Fig. 3 is a kind of method schematic diagram of figure rendering provided by the embodiments of the present application;
Fig. 4 is the method schematic diagram of another figure rendering provided by the embodiments of the present application;
Fig. 5 is a kind of flow diagram of image rendering method provided by the embodiments of the present application;
Fig. 6 is the flow diagram of another image rendering method provided by the embodiments of the present application;
Fig. 7 is a kind of application scenarios schematic diagram provided by the embodiments of the present application;
Fig. 8 is a kind of structural schematic diagram of server provided by the embodiments of the present application;
Fig. 9 is a kind of structural schematic diagram of terminal provided by the embodiments of the present application;
Figure 10 is the structural schematic diagram of another server provided by the embodiments of the present application;
Figure 11 is the structural schematic diagram of another terminal provided by the embodiments of the present application;
Figure 12 is the structural schematic diagram of another server provided by the embodiments of the present application.
Specific embodiment
With reference to the accompanying drawing, embodiments herein is described, it is clear that described embodiment is only the application The embodiment of a part, instead of all the embodiments.Those of ordinary skill in the art are it is found that with the development of technology and new field The appearance of scape, technical solution provided by the embodiments of the present application are equally applicable for similar technical problem.
The embodiment of the present application provides a kind of method of image rendering, and this method moves image rendering task from local device Long-range cloud processing is moved on to, rendering processing result is then passed back into terminal device by network, therefore greatly reduce VR and set The standby requirement to hardware processing capability, user can not have to rely on expensive high configuration computer again, to realize " thin " terminal. Cloud renders the entry threshold that can significantly reduce experience, the experience of high quality is obtained in the terminal of lightweight, to promote VR/ AR's is universal;In terms of content, by the cloud of application (game, video, education etc.), the copyright of creator can be protected conscientiously Shield, outstanding content, which is also able to continuously, to be updated.In cloud rendering platform framework, phase point will be showed using operation and application From application processing is completed in cloud and result issues, and terminal only needs to realize that most basic video is decoded, presented, control signaling connects It receives and uploads, without handling calculating relevant to practical business, enormously simplify the internal structure and performance requirement of glasses.
With virtual reality (virtual reality, VR), augmented reality (augmented reality, AR) and mixing 3D scene, is really presented to the user as far as possible, improves user's by the development of technologies such as real (mixed reality, MR) " telepresenc ".This needs system that 3D model (image) is presented with high resolution ratio, thus requires high image rendering performance.
Image rendering mainly carries image processing hardware, such as GPU by terminal to complete at present.However, with picture matter The promotion of raising and the user demand of amount, and under the fast-changing scene of scene, to reach good rendering effect, at present Even high-end MR, VR equipment, especially VR all-in-one machine, AR glasses etc. can not also fully meet image rendering and want to hardware It asks.
The booming impetus is presented in VR at present, but preferable user experience relies on power PC mostly or host does this Ground rendering, so that customer consumption VR higher cost, this affects industry development to a certain degree, and it is in the urgent need to address to become industry Problem.
In order to solve the above problem, the embodiment of the present application combination blinkpunkt Rendering and cloud Rendering provide a kind of figure The method of shape rendering.Wherein, blinkpunkt Rendering can effectively reduce the requirement to hardware.Blinkpunkt Rendering refers to Human eye watches central area attentively and carries out high-resolution rendering, and the method for rendering resolution ratio is reduced in excentral region, due to Human visual system's central fovea provides clearer vision for field of view center, and the visual quality of peripheral vision is then relatively lower. As shown in Figure 1, being blinkpunkt render scenes figure provided by the embodiments of the present application, it is seen that image has carried out wash with watercolours by different degrees of Dye, wherein center is rendered into high-resolution, allotment area renders to intermediate-resolution, and external zones renders to low resolution, simultaneously Because watching central area attentively is only the fraction in entire visual field, thus blinkpunkt Rendering can reduced to rendering hardware It is required that while do not influence the visual experience of user.
In a kind of possible scene, the efficiency of transmission of home broadband is limited, and high-resolution image is often to band Width has higher requirement, as shown in table 1, the table corresponding with the demand of family bandwidth that is general resolution ratio, and and blinkpunkt is utilized to render Technology can substantially reduce the resolution requirements of image, reduce the demand for home broadband.
Video resolution Home broadband demand
Full view 4K video 50Mbps-100Mbps
Full view 8K video 100Mbps-300Mbps
Full view 12K video 300Mbps-2Gbps
Full view 24K video 2Gbps-5Gbps
Table 1
In the embodiment of the present application, the frame that can use a kind of cloud rendering executes relevant operation, as shown in Fig. 2, being A kind of application architecture figure provided by the embodiments of the present application, includes: terminal device, internet and server in the architecture, In, terminal device can be the combination of display equipment and eye movement tracking mould group, be also possible to be integrated with eye movement tracking function Terminal integrated equipment, such as: VR glasses or AR equipment etc.;The eye movement data of acquisition is transmitted to by terminal device by internet Server, wherein the server can be cloud service system, which may include content platform, management system, wash with watercolours Contaminate task management platform and GPU cluster.Task management platform in cloud rendering system watches center attentively according to what is calculated Region determines practical rendering task and distributed tasks are to GPU cluster, completes practical rendering task by GPU.Practical rendering task is complete Cheng Hou, task management platform collect rendering result and result are sent back application program.
For ease of understanding, the detailed process in the present embodiment is described with reference to the accompanying drawing, as shown in figure 3, being this Apply for a kind of method schematic diagram for figure rendering that embodiment provides, this method includes but is not limited to following steps:
301, terminal obtains eye feature information;
In the present embodiment, terminal may include eye movement tracking mould group, can be acquired with Application Optics writing-method with eye Image obtains the eyes image of reflection eye motion that is, with camera or the eye motion situation of camera record subject, with And eye feature is extracted from the eyes image got for establishing sight or watching the model of point estimation attentively.
In a kind of possible scene, infrared light supply or first-class figure of the device acquisition with eye of infrared photography can use Picture, to obtain eye feature information, wherein eye feature may include: pupil position, pupil shape, iris position, iris shape Shape, eyelid position, canthus position, hot spot (also referred to as Purkinje image) position etc..Such as: light source is pointed into eye, by Image Acquisition Equipment shoots eye, reflection point, that is, hot spot of the corresponding photographic light sources on cornea, thus obtains the eye for having hot spot Image, at this point, should be eye feature information with the eyes image of hot spot.
It is understood that in the process using infrared light supply or first-class image of the device acquisition with eye of infrared photography In, infrared light supply or infrared camera can be multiple, and arrange in a predetermined manner, such as isosceles triangle, linear type etc., this is pre- Fixed mode can be the setting in response to user, is also possible to terminal and is acquired obtained by data statistics according to history, specific to acquire Depending on the quantity and arrangement mode of device are because of actual scene, herein without limitation.
It should be noted that the present embodiment can also utilize other methods for being not based on eyes image, such as based on contact/ Contactless sensor (such as electrode, capacitance sensor) calculates the movement of eye, the specific method for obtaining eyes image because Depending on actual scene, herein without limitation.
302, terminal watches information attentively according to the eye feature acquisition of information;
In the present embodiment, terminal carries out real-time analysis processing according to eye feature information, so that obtain eye watches letter attentively Breath.It is understood that this watches information attentively can be mapped with the first scene on server in the same coordinate system, that is, infuse Visual information can be a coordinate, which can indicate corresponding position in the first scene.
Sight or blinkpunkt are watched attentively according to the eye that eye feature information obtains it is understood that watching information attentively and can be Projected position on a certain plane, i.e. blinkpunkt information, wherein watch the process that sight or blinkpunkt determine attentively and may is that and adopt When collecting Rotation of eyeball, the variation relation of the relative position of pupil center and hot spot is corresponding collected several with hot spot Eyes image reflects such change in location relationship;Gone out according to the change in location relation derivation and watches sight or blinkpunkt attentively.
Optionally, watch information attentively to be also possible to watch vector (direction) attentively according to the eye that eye feature information obtains, if note There is interaction with model in three-dimensional scenic depending on vector, then watches information attentively and be also possible to the song interacted in the 3 d space with jobbie The set of face or multiple intersection points, depending on concrete scene is because of actual conditions, herein without limitation.
Optionally, in a kind of possible scene, terminal will be responsive to the demand of server and choose whether transmission first Scene and information is watched attentively, at this point, the rendering data request that terminal acceptable server is sent, rendering data request may include Demand watches the design parameter that information is included attentively, such as: location information or Vector Message, depending on concrete scene is because of actual conditions, Herein without limitation.
Optionally, since different user's eye features is different, terminal is watched attentively according to the eye feature acquisition of information Information can be also used for generating calibration parameter, improve the accuracy of collection process;Specifically, user is allowed to watch one or more attentively Target point, it is assumed that the information of the target point is known sight (target point is preset), it is possible thereby to instead Solve above-mentioned calibration parameter.It should be noted that the calibration process can carry out the demand of precision in response to user, i.e., It can carry out generating calibration parameter process in the high-precision scene of demand.
303, information is watched attentively described in terminal to server transmission;
In the present embodiment, watches information attentively and can be being identified in corresponding coordinate system, be also possible to as independent Analysis information send, depending on concrete scene is because of actual conditions, herein without limitation.
304, terminal receives the second scene that the server is sent.
In the present embodiment, terminal may include display equipment, and terminal can set the second scene received by display It is standby to be shown to user.
By the above method, blinkpunkt technology is integrated in cloud rendering function, avoiding terminal processes hardware can not reach To the case where requirement, further by the acquisition to information is watched attentively, provide cloud in render process without excessive system Source can reach the rendering effect of demand, reduce the pressure for wireless communication procedure, saved wireless communication resources.
In corresponding cloud rendering framework, the method flow that server is carried out is as follows, as shown in figure 4, being the application reality The method schematic diagram of another figure rendering of example offer is applied, this method includes but is not limited to following steps:
401, what server receiving terminal was sent watches information attentively;
In the present embodiment, information is watched attentively and can be being identified in coordinate system corresponding with the first scene, it can also be with It is to be sent as individual analysis information, depending on concrete scene is because of actual conditions, herein without limitation.
It is understood that watches that information can be eye attentively watches the projected position of sight or blinkpunkt in the plane attentively, It is also possible to the vector of watching attentively of eye, or watches the collection of curved surface or multiple intersection points that vector is interacted with jobbie in the 3 d space attentively It closes, depending on concrete scene is because of actual conditions, herein without limitation.
402, server watches information attentively to the first scene rendering according to, obtains the second scene.
In the present embodiment, if watching information attentively is location information, i.e. blinkpunkt information, then wash with watercolours can be determined according to location information Dye center, it is to be understood that rendering center can be certain region, at this point, carrying out high quality rendering to rendering center;So Central area is calculated using specified mathematical model according to rendering center afterwards, wherein be calculated using specified mathematical model Central area can be border circular areas, polygonal region or fan-shaped region, such as: to render center as the center of circle, take certain half Region in the circle of diameter is center region, to central area carry out in quality render, to removed in the first scene rendering center and in Region other than heart district domain carries out low quality rendering, wherein low quality rendering can be carry out Fuzzy Processing;Render the height of quality It is low to be embodied by resolution of screen, i.e., different resolution ratio ratios is distributed according to rendering region division, it is to be understood that Central area may include multiple subregions, such as image to be rendered can be divided into three circles, 1.5 degree of central vision area, and 4 The secondary visual zone and outermost visual zone of degree;Using blinkpunkt as center dot, extended area is differentiated as 1.5 with radius Degree, 4 degree, outermost region;Referring to the data of table 1, central vision area can be rendered into 14K image quality, secondary visual zone rendering For 8K image quality, outermost visual zone is rendered into 4K image quality.
Optionally, it if watching information attentively is Vector Message, can be obtained watching vector attentively according to Vector Message, according to watching vector attentively Centered on, it takes certain radius to do sphere, generates central area, and above-mentioned rendering processing is carried out to the first scene.Correlation rendering If operation and rendering level can refer to the associated description watched attentively when information is location information, it is not repeated herein.
It, can also be with it should be noted that the relevant parameter in specified mathematical model can be the input in response to user It is the empirical parameter that server is counted according to historical data, depending on concrete scene is because of actual conditions, herein without limitation.
403, server sends the second scene to terminal.
In the present embodiment, server can send second by transmission of wireless signals mode such as WIFI, bluetooth or infrared rays Scene depending on concrete mode is because of actual scene, can also be not repeated herein by the wire signals transmission mode such as cable.
The present embodiment is reduced in rendering task by the acquisition and relevant calculating for watching information attentively for service The operation pressure of device, and good rendering service can also be provided while simplifying operation.
In a kind of possible scene, terminal is referred to following process with server and is rendered, as shown in figure 5, being A kind of flow diagram of image rendering method provided by the embodiments of the present application.
501, terminal obtains eye feature information;
502, terminal watches information attentively according to eye feature acquisition of information;
503, information is watched in terminal transmission attentively;
In the present embodiment, step 501-503 is similar with step 301-303, is not repeated herein.
504, information is watched in server reception attentively;
505, server obtains the second scene according to information is watched attentively to the first scene rendering;
In the present embodiment, step 504-505 is similar with step 401-402, is not repeated herein.
506, server sends the second scene to terminal;
507, terminal receives the second scene.
In the present embodiment, step 506 is similar with step 304, and step 507 is similar with step 403, is not repeated herein.
Above method embodiment can be applied to VR glasses, MR device etc. with eye tracking function and can be according to eye Signature analysis obtains watching attentively in the terminal of information, and in a kind of possible scene, the embodiment of the present application also provides one kind and can answer For only with eyes image obtain function terminal in, such as: mobile phone, notebook personal computer etc., with reference to the accompanying drawing into Row explanation.
As shown in fig. 6, being the flow diagram of another image rendering method provided by the embodiments of the present application, this method packet It includes but is not limited to following steps:
601, terminal obtains eyes image;
In the present embodiment, terminal can be mobile phone, be also possible to the terminal device that PC etc. has communication function;Eventually End can obtain the eye figure of reflection eye motion by the eye motion situation with camera or camera record subject Picture, depending on concrete mode is because of actual scene, herein without limitation.
602, terminal determines eye feature information according to eyes image;
In the present embodiment, terminal can extract eye feature for establishing sight/watch attentively from the eyes image got The model of point estimation.Wherein, eye feature may include: pupil position, pupil shape, iris position, iris shape, eyelid position It sets, canthus position, hot spot (also referred to as Purkinje image) position etc..
Optionally, since different user's eye features is different, terminal is watched attentively according to the eye feature acquisition of information Information can be also used for generating calibration parameter, improve the accuracy of collection process;Specifically, user is allowed to watch one or more attentively Target point, it is assumed that the information of the target point is known sight (target point is preset), it is possible thereby to instead Solve above-mentioned calibration parameter.It should be noted that the calibration process can carry out the demand of precision in response to user, i.e., It can carry out generating calibration parameter process in the high-precision scene of demand.
603, terminal sends eye feature information;
In the present embodiment, terminal can be by 3G, 4G or 5G network transmission eye feature information, can also be by wirelessly protecting True technology, infrared ray or Bluetooth transmission eye feature information, can also pass through the wire transmission sides such as USB interface, type-c interface Formula transmits eye feature information, depending on concrete mode is because of actual scene, herein without limitation.
604, server watches information attentively according to the determination of eye feature information;
In the present embodiment, server carries out real-time analysis processing according to eye feature information, to obtain watching attentively for eye Information.It is understood that this watches information attentively can be mapped with the first scene on server in the same coordinate system, i.e., Watching information attentively can be a coordinate, which can indicate corresponding position in the first scene.
Sight or blinkpunkt are watched attentively according to the eye that eye feature information obtains it is understood that watching information attentively and can be Projected position on a certain plane, wherein when watching the process that sight or blinkpunkt determine attentively and may is that acquisition Rotation of eyeball, The variation relation of the relative position of pupil center and hot spot, corresponding collected several eyes images with hot spot reflect Such change in location relationship;Gone out according to the change in location relation derivation and watches sight or blinkpunkt attentively.
Optionally, watch information attentively to be also possible to watch vector (direction) attentively according to the eye that eye feature information obtains, if note There is interaction with model in three-dimensional scenic depending on vector, then watches information attentively and be also possible to the song interacted in the 3 d space with jobbie The set of face or multiple intersection points, depending on concrete scene is because of actual conditions, herein without limitation.
Optionally, in a kind of possible scene, server will be responsive to the demand of server and choose whether transmission One scene and watch information attentively, at this point, the rendering data request that server acceptable server is sent, rendering data request can The design parameter that information is included is watched attentively including demand, such as: location information or Vector Message, concrete scene is due to actual conditions It is fixed, herein without limitation.
605, server obtains the second scene according to information is watched attentively to the first scene rendering;
606, server sends the second scene;
607, terminal receives the second scene.
In the present embodiment, step 605-607 is similar with step 505-507, is not repeated herein.
It should be noted that the server in the above method can be one, it is also possible to multiple, that is, works as first server When channel resource is limited or unbearable corresponding rendering quality requirement, by eye feature information or information can be watched attentively it is forwarded to second Server gets on, to achieve the purpose that rendering.
In a kind of possible scene, as shown in fig. 7, be a kind of application scenarios schematic diagram provided by the embodiments of the present application, Multiple terminals are communicated by WI-FI with home server, but home server scene process ability is limited, at this point it is possible to will connect The render request and data of the multiple terminals received are by 5G network transmission to cloud server, to render processing.
The embodiment of the present application can be applied in terminal according to the above method, and the division of functional module is carried out to terminal, For example, each functional module of each function division can be corresponded to, two or more functions can also be integrated in one In processing module.Above-mentioned integrated module both can take the form of hardware realization, can also use the shape of software function module Formula is realized.It should be noted that being schematical, only a kind of logic function stroke to the division of module in the embodiment of the present application Point, there may be another division manner in actual implementation.
For example, in the case where to use the integrated each functional unit of model split, as shown in figure 8, being that the application is implemented A kind of structural schematic diagram for server that example provides.
If Fig. 8 shows, server 800 provided by the embodiments of the present application includes receiving unit 801, rendering unit 802 and sends Unit 803.
Receiving unit 801, for receive terminal transmission watch information attentively;
Rendering unit 802 renders the first scene for watching information attentively according to, obtains the second scene;
Transmission unit 803, for sending second scene to the terminal.
As shown in figure 9, being a kind of structural schematic diagram of terminal provided by the embodiments of the present application.The terminal 900 may include Acquiring unit 901, determination unit 902, transmission unit 903 and receiving unit 904.
Acquiring unit 901, for obtaining eye feature information;
Determination unit 902 watches information attentively for determining according to the eye feature information, described to watch information attentively and be used to indicate Server renders the first scene;
Transmission unit 903, for watching information attentively described in sending to server;
Receiving unit 904, the second scene sent for receiving the server, second scene are the server Information is watched attentively to obtained by first scene rendering according to described.
It as shown in Figure 10, is the structural schematic diagram of another server provided by the embodiments of the present application.
If Figure 10 shows, server 1000 provided by the embodiments of the present application includes receiving unit 1001, determination unit 1002, wash with watercolours Contaminate unit 1003 and transmission unit 1004.
Receiving unit 1001, for receiving the eye feature information of terminal transmission;
Determination unit 1002, for watching information attentively according to eye feature information determination;
Rendering unit 1003 renders the first scene for watching information attentively according to, obtains the second scene;
Transmission unit 1004, for sending second scene to the terminal.
It as shown in figure 11, is the structural schematic diagram of another server provided by the embodiments of the present application.
If Figure 11 shows, server 1100 provided by the embodiments of the present application includes acquiring unit 1101, determination unit 1102, hair Send unit 1103 and receiving unit 1104.
Acquiring unit 1101, for obtaining eyes image;
Determination unit 1102, for determining that eye feature information, the eye feature information are used according to the eyes image The position of the first scene is watched attentively in instruction user;
Transmission unit 1103, for sending the eye feature information to server;
Receiving unit 1104, the second scene sent for receiving the server, second scene are the service Device renders obtained by first scene according to the eye feature information.
Wherein, all related contents for each step that above method embodiment is related to can quote corresponding function unit Function description, details are not described herein.
In the present embodiment, server 800 can be presented in the form of the integrated each functional module of model split. Here " module " can refer to application-specific integrated circuit (application-specific integrated circuit, ASIC), circuit, executes the processor and memory of one or more softwares or firmware program, integrated logic circuit and/or its He can provide the device of above-mentioned function.In a simple embodiment, those skilled in the art is contemplated that server 800 can be using form shown in Figure 12.
It as shown in figure 12, is the structural schematic diagram of another server provided by the embodiments of the present application, server 1200 wraps It includes: input/output (I/O) interface 1201, processor 1202, memory 1203.Specifically, processor 1202 in Figure 12 can be with By calling the computer executed instructions stored in memory 1203, server 1200 is made to execute the reality in above method embodiment Now watch the method for acquisition of information attentively.
Specifically, function/realization process of receiving unit 801, rendering unit 802 and transmission unit 803 in Fig. 8 can be with The computer executed instructions stored in memory 1203 are called to realize by the processor 1202 in Figure 12.Alternatively, in Fig. 8 The function of receiving unit 801, rendering unit 802 and transmission unit 803/realization process can pass through the input/output in Figure 12 (I/O) interface 1201 is realized.
Since server 1200 provided by the embodiments of the present application can be used for executing the method for figure rendering, can obtain The technical effect obtained can refer to above method embodiment, and details are not described herein.
In addition, each functional module of integrated model split can also be used in terminal 900, server 1000 and terminal 1100 Form is presented, and concrete mode can refer to the associated description of Figure 12, be not repeated herein.
Optionally, the embodiment of the present application provides a kind of chip system, which includes processor, for supporting end The method that end or server realize above-mentioned image rendering.In a kind of possible design, which further includes memory.It should Memory, for saving terminal or the necessary program instruction of server and data.The chip system can be made of chip, It may include chip and other discrete devices, the embodiment of the present application is not especially limited this.
In the above-described embodiments, can come wholly or partly by software, hardware, firmware or any combination thereof real It is existing.When implemented in software, it can entirely or partly realize in the form of a computer program product.
The computer program product includes one or more computer instructions.Load and execute on computers the meter When calculation machine program instruction, entirely or partly generate according to process or function described in the embodiment of the present application.The computer can To be general purpose computer, special purpose computer, computer network or other programmable devices.The computer instruction can be deposited Storage in a computer-readable storage medium, or from a computer readable storage medium to another computer readable storage medium Transmission, for example, the computer instruction can pass through wired (example from a web-site, computer, server or data center Such as coaxial cable, optical fiber, Digital Subscriber Line (DSL)) or wireless (such as infrared, wireless, microwave) mode to another website Website, computer, server or data center are transmitted.The computer readable storage medium can be computer and can deposit Any usable medium of storage either includes that the data storages such as one or more usable mediums integrated server, data center are set It is standby.The usable medium can be magnetic medium, (for example, floppy disk, hard disk, tape), optical medium (for example, DVD) or partly lead Body medium (such as solid state hard disk solid state disk (SSD)) etc..
The description and claims of this application and term " first " in above-mentioned attached drawing, " second " etc. are for distinguishing Similar object, without being used to describe a particular order or precedence order.It should be understood that the data used in this way are in appropriate feelings It can be interchanged under condition, so that the embodiments described herein can be real with the sequence other than the content for illustrating or describing herein It applies.In addition, term " includes " and " having " and their any deformation, it is intended that cover it is non-exclusive include, for example, packet The process, method, system, product or equipment for having contained series of steps or module those of be not necessarily limited to be clearly listed step or Module, but may include other steps being not clearly listed or intrinsic for these process, methods, product or equipment or Module.Occur in this application to step carry out name perhaps number be not meant to must according to name or number Indicated time/logic sequencing executes the step in method flow, and named or number process step can be with Execution order is changed according to the technical purpose to be realized, as long as identical or similar technical effect can be reached.This Shen Please appeared in module division, be a kind of division in logic, can have other division side when realizing in practical application Formula, such as multiple modules can be combined into or are integrated in another system, or some features can be ignored or not executed, separately Outside, shown or discussion mutual coupling, direct-coupling or communication connection can be through some interfaces, module Between indirect coupling or communication connection can be electrical or other similar form, be not construed as limiting in the application.Also, make It can be the separation that may not be physically for the module or submodule of separate part description, can be and may not be physics Module, or can be distributed in multiple circuit modules, some or all of modules can be selected according to the actual needs To realize the purpose of application scheme.
Those of ordinary skill in the art will appreciate that all or part of the steps in the various methods of above-described embodiment is can It is completed with instructing relevant hardware by program, which can be stored in a computer readable storage medium, storage Medium may include: ROM, RAM, disk or CD etc..
Detailed Jie has been carried out to the method for image rendering provided by the embodiment of the present application, server and terminal above It continues, specific examples are used herein to illustrate the principle and implementation manner of the present application, and the explanation of above embodiments is only It is to be used to help understand the method for this application and its core ideas;At the same time, for those skilled in the art, according to this Shen Thought please, there will be changes in the specific implementation manner and application range, in conclusion the content of the present specification should not manage Solution is the limitation to the application.

Claims (12)

1. a kind of method of image rendering characterized by comprising
What server receiving terminal was sent watches information attentively;
The server is watched information attentively according to and is rendered to the first scene, and the second scene is obtained;
The server sends second scene to the terminal.
2. the method according to claim 1, wherein described, to watch information attentively include blinkpunkt information, the service Device is watched information attentively according to and is rendered to the first scene, and the second scene is obtained, comprising:
The server determines the first watching area according to the blinkpunkt information;
The server determines the first rendering region according to first watching area, and first rendering region includes at least one A first son rendering region;
The server renders at least one described first son rendering region, obtains second scene.
3. according to the method described in claim 2, it is characterized in that, it is described to watch information attentively further include watching Vector Message attentively, it is described Server is watched information attentively according to and is rendered to the first scene, and the second scene is obtained, comprising:
The server watches Vector Message attentively according to and obtains the second watching area;
The server determines the second rendering region according to second watching area, and second rendering region includes at least one A second son rendering region;
The server renders at least one described second son rendering region, obtains second scene.
4. the method according to claim 1, wherein the server receiving terminal send blinkpunkt information it Before, the method also includes:
The server receives the terminal and sends acquisition rendering data request.
5. a kind of method of image rendering characterized by comprising
Terminal obtains eye feature information;
The terminal is determined according to the eye feature information watches information attentively, described to watch information attentively and be used to indicate server to first Scene is rendered;
The terminal to server watches information attentively described in sending;
The terminal receives the second scene that the server is sent, and second scene is that the server is watched attentively according to Point information is to obtained by first scene rendering.
6. according to the method described in claim 5, it is characterized in that, the terminal is watched attentively according to the eye feature acquisition of information Point information, comprising:
The rendering data request that the terminal is sent to the server;
The terminal is according to the eye feature acquisition of information blinkpunkt information.
7. a kind of method of image rendering characterized by comprising
The eye feature information that server receiving terminal is sent;
The server watches information attentively according to eye feature information determination;
The server is watched information attentively according to and is rendered to the first scene, and the second scene is obtained;
The server sends second scene to the terminal.
8. a kind of method of image rendering characterized by comprising
Terminal obtains eyes image;
The terminal determines eye feature information according to the eyes image;
The terminal to server sends the eye feature information;
The terminal receives the second scene that the server is sent, and second scene is the server according to the eye Characteristic information renders obtained by first scene.
9. a kind of server characterized by comprising
Receiving unit, for receive terminal transmission watch information attentively;
Rendering unit renders the first scene for watching information attentively according to, obtains the second scene;
Transmission unit, for sending second scene to the terminal.
10. a kind of terminal characterized by comprising
Acquiring unit, for obtaining eye feature information;
Determination unit watches information attentively for determining according to the eye feature information, described to watch information attentively and be used to indicate server First scene is rendered;
Transmission unit, for watching information attentively described in sending to server;
Receiving unit, the second scene sent for receiving the server, second scene is the server according to institute It states and watches information attentively to obtained by first scene rendering.
11. a kind of server characterized by comprising
Receiving unit, for receiving the eye feature information of terminal transmission;
Determination unit, for watching information attentively according to eye feature information determination;
Rendering unit renders the first scene for watching information attentively according to, obtains the second scene;
Transmission unit, for sending second scene to the terminal.
12. a kind of terminal characterized by comprising
Acquiring unit, for obtaining eyes image;
Determination unit, for determining that eye feature information, the eye feature information are used to indicate use according to the eyes image The position of the first scene is watched at family attentively;
Transmission unit, for sending the eye feature information to server;
Receiving unit, the second scene sent for receiving the server, second scene is the server according to institute Eye feature information is stated to render obtained by first scene.
CN201910040634.2A 2019-01-16 2019-01-16 A kind of method of image rendering, server and terminal Pending CN109801353A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910040634.2A CN109801353A (en) 2019-01-16 2019-01-16 A kind of method of image rendering, server and terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910040634.2A CN109801353A (en) 2019-01-16 2019-01-16 A kind of method of image rendering, server and terminal

Publications (1)

Publication Number Publication Date
CN109801353A true CN109801353A (en) 2019-05-24

Family

ID=66559478

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910040634.2A Pending CN109801353A (en) 2019-01-16 2019-01-16 A kind of method of image rendering, server and terminal

Country Status (1)

Country Link
CN (1) CN109801353A (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110378914A (en) * 2019-07-22 2019-10-25 北京七鑫易维信息技术有限公司 Rendering method and device, system, display equipment based on blinkpunkt information
CN111027396A (en) * 2019-11-13 2020-04-17 量子云未来(北京)信息科技有限公司 Driving assistance method and device, vehicle-mounted terminal and cloud server
CN111131524A (en) * 2020-01-20 2020-05-08 上海市特种设备监督检验技术研究院 Real-time simulation system based on 5G
CN111553972A (en) * 2020-04-27 2020-08-18 北京百度网讯科技有限公司 Method, apparatus, device and storage medium for rendering augmented reality data
CN111901628A (en) * 2020-08-03 2020-11-06 江西科骏实业有限公司 Cloud rendering method based on zSpace desktop VR all-in-one machine
CN112118463A (en) * 2019-06-21 2020-12-22 广州虎牙科技有限公司 Information processing method, cloud platform and information processing system
CN112565883A (en) * 2020-11-27 2021-03-26 深圳市纪元数码技术开发有限公司 Video rendering processing system and computer equipment for virtual reality scene
WO2021134710A1 (en) * 2019-12-31 2021-07-08 深圳市大疆创新科技有限公司 Control method and related device
CN113570698A (en) * 2021-07-23 2021-10-29 Oppo广东移动通信有限公司 Resource processing method, device, server and storage medium
CN113852841A (en) * 2020-12-23 2021-12-28 上海飞机制造有限公司 Visual scene establishing method, device, equipment, medium and system
CN113946402A (en) * 2021-11-09 2022-01-18 中国电信股份有限公司 Cloud mobile phone acceleration method, system, equipment and storage medium based on rendering separation
WO2022133683A1 (en) * 2020-12-21 2022-06-30 京东方科技集团股份有限公司 Mixed reality display method, mixed reality device, and storage medium
CN114727083A (en) * 2021-01-04 2022-07-08 中国移动通信有限公司研究院 Data processing method, device, terminal and network side equipment

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106485790A (en) * 2016-09-30 2017-03-08 珠海市魅族科技有限公司 Method and device that a kind of picture shows
CN107590859A (en) * 2017-09-01 2018-01-16 广州励丰文化科技股份有限公司 A kind of mixed reality picture processing method and service equipment

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106485790A (en) * 2016-09-30 2017-03-08 珠海市魅族科技有限公司 Method and device that a kind of picture shows
CN107590859A (en) * 2017-09-01 2018-01-16 广州励丰文化科技股份有限公司 A kind of mixed reality picture processing method and service equipment

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
尼克·贝瑟斯等: "《大数据与物联网 面向智慧环境路线图》", 北京:国防工业出版社, pages: 379 - 380 *

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112118463A (en) * 2019-06-21 2020-12-22 广州虎牙科技有限公司 Information processing method, cloud platform and information processing system
CN110378914A (en) * 2019-07-22 2019-10-25 北京七鑫易维信息技术有限公司 Rendering method and device, system, display equipment based on blinkpunkt information
CN111027396A (en) * 2019-11-13 2020-04-17 量子云未来(北京)信息科技有限公司 Driving assistance method and device, vehicle-mounted terminal and cloud server
WO2021134710A1 (en) * 2019-12-31 2021-07-08 深圳市大疆创新科技有限公司 Control method and related device
CN111131524A (en) * 2020-01-20 2020-05-08 上海市特种设备监督检验技术研究院 Real-time simulation system based on 5G
CN111553972A (en) * 2020-04-27 2020-08-18 北京百度网讯科技有限公司 Method, apparatus, device and storage medium for rendering augmented reality data
CN111901628A (en) * 2020-08-03 2020-11-06 江西科骏实业有限公司 Cloud rendering method based on zSpace desktop VR all-in-one machine
CN112565883A (en) * 2020-11-27 2021-03-26 深圳市纪元数码技术开发有限公司 Video rendering processing system and computer equipment for virtual reality scene
WO2022133683A1 (en) * 2020-12-21 2022-06-30 京东方科技集团股份有限公司 Mixed reality display method, mixed reality device, and storage medium
CN113852841A (en) * 2020-12-23 2021-12-28 上海飞机制造有限公司 Visual scene establishing method, device, equipment, medium and system
CN114727083A (en) * 2021-01-04 2022-07-08 中国移动通信有限公司研究院 Data processing method, device, terminal and network side equipment
CN113570698A (en) * 2021-07-23 2021-10-29 Oppo广东移动通信有限公司 Resource processing method, device, server and storage medium
CN113946402A (en) * 2021-11-09 2022-01-18 中国电信股份有限公司 Cloud mobile phone acceleration method, system, equipment and storage medium based on rendering separation

Similar Documents

Publication Publication Date Title
CN109801353A (en) A kind of method of image rendering, server and terminal
US11140317B2 (en) Method and device for managing thumbnail of three-dimensional contents
US20220222790A1 (en) Gaze Direction-Based Adaptive Pre-Filtering of Video Data
US10643307B2 (en) Super-resolution based foveated rendering
KR102603426B1 (en) Apparatus and method for processing an image
EP3023969A2 (en) Display and method and electronic device
US20180063512A1 (en) Image streaming method and electronic device for supporting the same
KR102499139B1 (en) Electronic device for displaying image and method for controlling thereof
CN110378914A (en) Rendering method and device, system, display equipment based on blinkpunkt information
CN113377316A (en) Apparatus and method for providing screen mirroring service
KR102489279B1 (en) Apparatus and method for processing an image
US10921595B2 (en) Contextual adjustment to augmented reality glasses
KR20180023326A (en) Electronic device and method for providing image acquired by the image sensor to application
US20180241943A1 (en) Electronic device and method for displaying 360-degree image in the electronic device
EP3358531A1 (en) Electronic device for providing vr image based on polyhedron and image providing method thereof
US20190325658A1 (en) Device and method for rendering image
EP3547702A1 (en) Image processing apparatus and image processing method therefor
CN111836069A (en) Virtual gift presenting method, device, terminal, server and storage medium
KR20160149842A (en) Method for processing an image and electronic device thereof
KR102164686B1 (en) Image processing method and apparatus of tile images
US20220309725A1 (en) Edge data network for providing three-dimensional character image to user equipment and method for operating the same
KR102558474B1 (en) Method for displaying an image and an electronic device thereof
US20220374188A1 (en) Electronic billboard and controlling method thereof
AU2017320166A1 (en) Image streaming method and electronic device for supporting the same
US10969865B2 (en) Method for transmission of eye tracking information, head mounted display and computer device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190524