CN105263050A - Mobile terminal real-time rendering system and method based on cloud platform - Google Patents

Mobile terminal real-time rendering system and method based on cloud platform Download PDF

Info

Publication number
CN105263050A
CN105263050A CN201510744206.XA CN201510744206A CN105263050A CN 105263050 A CN105263050 A CN 105263050A CN 201510744206 A CN201510744206 A CN 201510744206A CN 105263050 A CN105263050 A CN 105263050A
Authority
CN
China
Prior art keywords
dimensional
rendering
mobile terminal
cluster
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510744206.XA
Other languages
Chinese (zh)
Other versions
CN105263050B (en
Inventor
杨义军
杨力群
贾佳
田李昊
刘畅
孟祥旭
曾薇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong University
Original Assignee
Shandong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong University filed Critical Shandong University
Priority to CN201510744206.XA priority Critical patent/CN105263050B/en
Publication of CN105263050A publication Critical patent/CN105263050A/en
Application granted granted Critical
Publication of CN105263050B publication Critical patent/CN105263050B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44012Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/231Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
    • H04N21/23103Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion using load balancing strategies, e.g. by placing or distributing content on different disks, different memories or different servers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/816Monomedia components thereof involving special video data, e.g 3D video

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention discloses a mobile terminal real-time rendering system and method based on a cloud platform, and the method comprises the steps: receiving viewpoint information and interaction information transmitted by a mobile terminal, inquiring and reading a model and scene file, and obtaining three-dimensional scene data; dividing the three-dimensional scene data to obtain three-dimensional scene model group data according to the type of model groups of a three-dimensional scene; storing the three-dimensional scene model group data and carrying out the automatic adjustment of storage positions according to different data demands in different three-dimensional scenes; extracting the three-dimensional scene model group data, building and managing an MIC/GPU rendering task of a three-dimensional scene image, finally obtaining rendering result data of the three-dimensional scene image, and enabling the obtained rendering result data of the three-dimensional scene image to be compressed and then transmitted to the mobile terminal; employing a dynamic load strategy to carry out the deployment and management of the MIC/GPU rendering task, and guaranteeing the load balance of a cloud server. The method consumes the calculation capability and storage space of a mobile client to the minimum degree.

Description

Based on mobile terminal real-time rendering system and the method thereof of cloud platform
Technical field
The invention belongs to image rendering field, particularly relate to a kind of mobile terminal real-time rendering system based on cloud platform and method thereof.
Background technology
This year, the market scale of China Mobile's terminal network game reached more than 200 hundred million yuan.3D modeling and playing up becomes the core technology that global related industry circle is paid close attention to, wherein based on the Rendering of ray trace with its high-quality rendering effect, become each big game manufacturer in recent years and try to be the first and adopt and the focus of research.
Owing to being subject to the restriction of scene complexity and mobile terminal computing capability, being difficult to carry out real-time scene ray trace on mobile terminals and playing up.But the mobile terminal real-time scene developed into based on cloud environment of network speed and cloud computing technology plays up the bottleneck solved on calculating and network in recent years.Render engine external is at present in absolute monopoly status at game industry circle, limits the development of China in this art.
The pattern played up based on the mobile terminal real-time scene of cloud environment is similar with conventional cloud computing, be placed in long-range server by 3D program and play up, user terminal is by Web software and by high-speed Internet access access resources, instruction sends from user terminal, server performs corresponding rendering task according to instruction, and rendering result picture is then transferred back in user terminal and is shown.
Based on the mobile terminal real-time scene of cloud environment play up will faced by difficulty more complicated more than the cloud computing application of routine, this mainly comes from 3D and plays up rigors for hardware performance and instruction response.And based on cloud environment mobile terminal real-time scene rendering system will faced by may be the request of playing up of thousands of user, this will be (commercial program such as such as Gmail, GoogleDocs is to scientific algorithm) compared with huge pressure-with the cloud computing of routine is applied for the server system of rear end, the mobile terminal real-time scene based on cloud environment is played up when meeting user's needs of same quantity, the hardware performance of required consumption at least to exceed cloud computing several times to tens times.
Summary of the invention
In order to solve the shortcoming of prior art, the invention provides a kind of mobile terminal real-time rendering system based on cloud platform and method thereof.This system makes full use of the supercomputing in high in the clouds and storage capacity and carries out real time ray tracing to scene and play up, while reaching high presence rendering effect, met the refreshing frequency of client picture by compression algorithm, minimally consume mobile client computing capability and storage area.
For achieving the above object, the present invention is by the following technical solutions:
Based on a mobile terminal real-time rendering system for cloud platform, comprising:
Be deployed in the centralized control unit of cloud server, the three-dimensional scenic management system be connected respectively with centralized control unit and cluster, distributed memory system and cluster, MIC/GPU play up management service system and cluster and SiteServer LBS and cluster;
Described three-dimensional scenic management system and cluster, it is for the type of the model group according to three-dimensional scenic, divides the three-dimensional scenic data transmitted from mobile terminal, obtains three-dimensional scene models group data;
Described distributed memory system and cluster, it for storing three-dimensional scene models group data, and carries out the automatic adjustment of memory location according to different pieces of information demand under different three-dimensional scenic;
Described MIC/GPU plays up management service system and cluster, it is for transferring the three-dimensional scene models group data being stored in distributed memory system and cluster, set up and manage the MIC/GPU rendering task of three-dimensional scene images, finally obtain three-dimensional scenic rendering result data, and be issued to mobile terminal after the three-dimensional scenic rendering result data of acquisition being compressed;
Described SiteServer LBS and cluster, it, for utilizing dynamic load strategy to MIC/GPU rendering task procedure deployment and management, guarantees the load balancing of cloud server.
Described rendering system, also comprise network english teaching system and cluster, its for centered by control unit, three-dimensional scenic management system and cluster, distributed memory system and cluster, MIC/GPU play up management service system and cluster and SiteServer LBS and cluster and provide between any two and intercom mutually.
Described three-dimensional scenic management system and cluster, comprising:
Threedimensional model and document scene loading unit, itself and mobile terminal are connected by network english teaching system and cluster, the view information sent for mobile terminal receive and interactive information, and inquiry is reading model and document scene also, obtain three-dimensional scenic data;
Threedimensional model and document scene cutting unit, threedimensional model and document scene are divided into several model block for the type of the model group according to three-dimensional scenic by it, obtain three-dimensional scene models group data;
Threedimensional model block unit of memory allocation, it is for being automatically dispensed to distributed memory system by three-dimensional scene models group data and cluster stores.
Described MIC/GPU plays up management service system and cluster, comprising:
Three-dimensional scene models group data transfer unit, and it is for transferring the three-dimensional scene models group data be stored in distributed memory system and cluster;
Rendering task creation module, it is for setting up the task of rendering three-dimensional scenes;
Rendering task Data import module, in the task of its rendering three-dimensional scenes extremely set up for the three-dimensional scene models group Data import that will transfer;
Rendering task scheduler module, it is for transferring rendering task, carries out parallel ray tracing play up the three-dimensional scene models group data loaded, and obtains three-dimensional scenic rendering result data;
Rendering result data management, it is for compressing three-dimensional scenic rendering result data, and the three-dimensional scenic rendering result data after compression are sent in mobile terminal and are shown.
Based on an implementation method for the mobile terminal real-time rendering system of cloud platform, comprising:
Step (1): the view information that mobile terminal receive sends and interactive information, inquiry is reading model and document scene also, obtains three-dimensional scenic data;
Step (2): according to the type of the model group of three-dimensional scenic, divides three-dimensional scenic data, obtains three-dimensional scene models group data;
Step (3): store three-dimensional scene models group data, and carry out the automatic adjustment of memory location according to different pieces of information demand under different three-dimensional scenic;
Step (4): the three-dimensional scene models group data transferring storage, set up and manage the MIC/GPU rendering task of three-dimensional scene images, finally obtain three-dimensional scenic rendering result data, and be issued to mobile terminal after the three-dimensional scenic rendering result data of acquisition being compressed; Wherein, utilize dynamic load strategy carry out disposing to MIC/GPU rendering task and manage, guarantee the load balancing of cloud server.
In described step (1), mobile terminal intercoms mutually with cloud server.
The process dividing three-dimensional scenic data in described step (2) is:
Step (2.1): three-dimensional scenic data are divided into several model group by the unit preset, and these model group are numbered;
Step (2.2): for each model group be divided into, according to the density of zones of different model in its model group, this group model is divided into several airtight square model block, model quantity in each model block is equal, model block each in model group is numbered again.
Obtain the process of three-dimensional scenic rendering result data in described step (4), comprising:
Step (4.1): transfer the three-dimensional scene models group data be stored in distributed memory system and cluster;
Step (4.2): the task of setting up rendering three-dimensional scenes;
Step (4.3): in the task of the rendering three-dimensional scenes that the three-dimensional scene models group Data import transferred extremely is set up;
Step (4.4): transfer rendering task, carries out parallel ray tracing play up the three-dimensional scene models group data loaded, obtain three-dimensional scenic play up after image, and then obtain rendering result data;
Step (4.5): the image after being played up by three-dimensional scenic compresses, and the image after being played up by the three-dimensional scenic after compression is sent in mobile terminal and shows.
The process that image after being played up by three-dimensional scenic in described step (4.5) carries out compressing is:
Step (4.5.1): utilize HEVC coding framework, the planarization of the image after playing up according to three-dimensional scenic, the Iamge Segmentation after being played up by three-dimensional scenic adaptively becomes some coding units, and determines best splitting scheme;
Step (4.5.2): identify splitting scheme, selects optimum predictive mode, utilizes differential coding to carry out tentative prediction; Wherein, predictive mode comprises infra-frame prediction and inter prediction;
Step (4.5.3): decide the residual error scanning sequency that three-dimensional scenic plays up rear image according to predictive mode, optimizes entropy code.
In step (4.5.2), predictive mode also comprises spatial prediction, by the combination in time domain and spatial domain, by the predictive mode of the selection optimum of pixel.
Beneficial effect of the present invention is:
(1) the mobile terminal real-time rendering system based on cloud platform of the present invention, three-dimensional scenic management system is disposed beyond the clouds and cluster, distributed memory system cluster and MIC/GPU play up management service system and cluster in server, this system makes full use of calculating and the storage capacity of these cluster servers, in advance data are loaded in the middle of storage node the internal memory of local calculation unit of current distribution, reduce memory access latency, improve rendering efficiency, finally realize scene and carry out real time ray tracing and play up;
(2) SiteServer LBS and cluster is also deployed with in server beyond the clouds, SiteServer LBS and cluster utilize dynamic load strategy to dispose and management MIC/GPU rendering task, guarantee the load balancing of cloud server, thus maximum using high in the clouds computing capability is played up.
(3) the present invention is after completing and playing up, the compression of video flowing is carried out in high in the clouds in real time, by the calculating core that MIC/GPU is a large amount of, fast efficient lossless compression is carried out to video flowing, volume is taken to reduce it as far as possible, and decompression is optimized, the computing capability relatively weak with client adapts, and makes the video flowing decompress(ion) that client can will be transmitted within a short period of time.
Accompanying drawing explanation
Fig. 1 is the flow chart of the mobile terminal real-time rendering method based on cloud platform of the present invention.
Fig. 2 is the principle schematic of the mobile terminal real-time rendering method based on cloud platform of the present invention.
Fig. 3 is Rendering realization flow figure.
Fig. 4 is compression and transfer process figure.
Fig. 5 is that user shows and control flow chart.
Embodiment
Below in conjunction with accompanying drawing and embodiment, the present invention will be further described:
Mobile terminal real-time rendering system based on cloud platform of the present invention, can the interactive operation of real-time reception user, upgrades and play up scene of game according to interactive operation and blas.
The operation principle of the mobile terminal real-time rendering system based on cloud platform of the present invention as shown in Figure 1.
This system makes full use of the supercomputing in high in the clouds and storage capacity and carries out real time ray tracing to scene and play up, while reaching high presence rendering effect, met the refreshing frequency of client picture by efficient compression algorithm and communication strategy, minimally consume mobile client computing capability and storage area.
In FIG, high in the clouds is deployed with MIC/GPU HPCC, for making full use of its performance, the present invention adopts the distributed ray tracing Rendering based on grid, carry out MIC/GPU rendering task by using dynamic load strategy on CPU to dispose and management, thus maximum using high in the clouds computing capability is played up.
The scene content that may occur under simultaneously introducing scene partitioning accurate Calculation current context is undertaken data being loaded in the middle of storage node in advance the internal memory of the local calculation unit of current distribution by the method for data pre-fetching, reduce memory access latency, improve rendering efficiency, because complex scene obtains accurate division, to be divided into according to being stored in the storage node of current optimum by distributed storage technology by model size and access times by model high for quality, carry out the automatic adjustment of memory location according to demand datas different under different scene.
Complete after playing up, the compression of video flowing is carried out in high in the clouds in real time, by a kind of parallel harmless video stream compression technology, by the calculating core that MIC/GPU is a large amount of, fast Efficient Compression is carried out to video flowing, take volume to reduce it as far as possible, and decompression is optimized, the computing capability relatively weak with client adapts, and makes the video flowing decompress(ion) that client can will be transmitted within a short period of time.
By express network link, the control flow check of video flowing and some correspondences can be transmitted after completing compression, in transmitting procedure, the sending order of stream can be determined, to ensure that client is without the need to crossing some current operation desired datas of long-time wait-receiving mode according to priority.
Client makes full use of its computing capability and carries out decompress(ion) to video flowing after reception desired data, and utilizes the API of self platform support to carry out picture and the synchronous of sound and full frame output.The instruction of the certain operations provided according to control flow check while exporting and some specify peripheral hardware to carry out specifying mutual, the video flowing that may reuse under simultaneously storing some following situations and audio stream data.In certain embodiments, by storing the restructuring of some videos or audio element and playing up in advance, reduce the excessive use to the limited computing capability of client further,
Introduce the concrete structure framework of the mobile terminal real-time rendering system based on cloud platform of the present invention below in detail:
As shown in Figure 2, the mobile terminal real-time rendering system based on cloud platform of the present invention, comprising:
Be deployed in the centralized control unit of cloud server, and the three-dimensional scenic management system be connected respectively with centralized control unit and cluster, distributed memory system and cluster, MIC/GPU play up management service system and cluster and SiteServer LBS and cluster;
Three-dimensional scenic management system and cluster, it is for the type of the model group according to three-dimensional scenic, divides the three-dimensional scenic data transmitted from mobile terminal, obtains three-dimensional scene models group data;
Distributed memory system and cluster, it for storing three-dimensional scene models group data, and carries out the automatic adjustment of memory location according to different pieces of information demand under different three-dimensional scenic;
MIC/GPU plays up management service system and cluster, it is for transferring the three-dimensional scene models group data being stored in distributed memory system and cluster, set up and manage the MIC/GPU rendering task of three-dimensional scene images, finally obtain three-dimensional scenic rendering result data, and by the three-dimensional scenic rendering result data distributing of acquisition to mobile terminal;
SiteServer LBS and cluster, it is disposed and management MIC/GPU rendering task for utilizing dynamic load strategy, guarantees the load balancing of cloud server.
Further, rendering system of the present invention, also comprise network english teaching system and cluster, its for centered by control unit, three-dimensional scenic management system and cluster, distributed memory system cluster, MIC/GPU play up management service system and cluster and to provide between any two with SiteServer LBS and cluster and intercom mutually.
Further, three-dimensional scenic management system and cluster, comprising:
Threedimensional model and document scene loading unit, itself and mobile terminal are connected by network english teaching system and cluster, the view information sent for mobile terminal receive and interactive information, and inquiry is reading model and document scene also, obtain three-dimensional scenic data;
Threedimensional model and document scene cutting unit, threedimensional model and document scene are divided into several model block for the type of the model group according to three-dimensional scenic by it, obtain three-dimensional scene models group data;
Threedimensional model block unit of memory allocation, it is for being automatically dispensed to distributed memory system by three-dimensional scene models group data and cluster stores.
Further, MIC/GPU plays up management service system and cluster, comprising:
Three-dimensional scene models group data transfer unit, and it is for transferring the three-dimensional scene models group data be stored in distributed memory system and cluster;
Rendering task creation module, it is for setting up the task of rendering three-dimensional scenes;
Rendering task Data import module, in the task of its rendering three-dimensional scenes extremely set up for the three-dimensional scene models group Data import that will transfer;
Rendering task scheduler module, it is for transferring rendering task, carries out parallel ray tracing play up the three-dimensional scene models group data loaded, and obtains three-dimensional scenic rendering result data;
Rendering result data management, it is for compressing three-dimensional scenic rendering result data, and the three-dimensional scenic rendering result data after compression are sent in mobile terminal and are shown.
As shown in Figure 1, the implementation method of the mobile terminal real-time rendering system based on cloud platform of the present invention, comprising:
Step (1): the view information that mobile terminal receive sends and interactive information, inquiry is reading model and document scene also, obtains three-dimensional scenic data;
Step (2): according to the type of the model group of three-dimensional scenic, divides three-dimensional scenic data, obtains three-dimensional scene models group data;
Step (3): store three-dimensional scene models group data, and carry out the automatic adjustment of memory location according to different pieces of information demand under different three-dimensional scenic;
Step (4): the three-dimensional scene models group data transferring storage, set up and manage the MIC/GPU rendering task of three-dimensional scene images, finally obtain three-dimensional scenic rendering result data, and by the three-dimensional scenic rendering result data distributing of acquisition to mobile terminal; Wherein, utilize dynamic load strategy to dispose and management MIC/GPU rendering task, guarantee the load balancing of cloud server.
In step (1), mobile terminal intercoms mutually with cloud server.
Below for three-dimensional scenic of playing:
Distributed memory system and clustered deploy(ment), to cloud server, first carry out parameter and performance adjustment to cloth storage system:
Two accounts are set in this cloth storage system: an account executive by name, another is for playing up account, and concrete power limit is as shown in table 1 below.Wherein account executive is in charge of the 3D model in all storages, plays up account and is responsible for calling model and plays up to computing unit.At this cloth storage system environment configuration file, make this system can realize call operation faster under current cluster.
The authority of account in table 1 distributed memory system
The process dividing three-dimensional scenic data in step (2) is:
Step (2.1): the three-dimensional scenic data of game are divided into N number of model group by the unit preset, and these model group are numbered from 0 to N-1; Wherein, the unit preset is game level;
Step (2.2): for each model group be divided into, according to the density of zones of different model in its model group, this group model is divided into the individual airtight square model block of M, model quantity in each model block is equal, model block each in model group is numbered from 0 to M-1.
Wherein, M and N is the positive integer being more than or equal to 1.
Model group is stored to high in the clouds, needs the model block memory location ensureing arbitrary model group adjacent or close.
Further, obtain the process of three-dimensional scenic rendering result data in step (4), comprising:
Step (4.1): transfer the three-dimensional scene models group data be stored in distributed memory system and cluster;
Step (4.2): the task of setting up rendering three-dimensional scenes;
Step (4.3): in the task of the rendering three-dimensional scenes that the three-dimensional scene models group Data import transferred extremely is set up;
Step (4.4): transfer rendering task, carries out parallel ray tracing play up the three-dimensional scene models group data loaded, obtain three-dimensional scenic play up after image, and then obtain rendering result data;
Step (4.5): the image after being played up by three-dimensional scenic compresses, and the image after being played up by the three-dimensional scenic after compression is sent in mobile terminal and shows.
As shown in Figure 3, before in step (4.4), parallel ray tracing is played up, first this rendering system, utilizes GPU and is applicable to the observability of biggest advantage of light track algorithm, carry out visibility processing to viewpoint; Then, MIC system is utilized accurately to divide further for three-dimensional scenic according to visibility processing result again.
In the process that parallel ray tracing is played up, the ray tracing that this rendering system of the present invention utilizes GPU to carry out real-time high-efficiency for the scene split is played up.
Wherein, viewpoint is carried out the detailed process of visibility processing and is:
Setting threshold, obtains object material information, is demarcated as a node when the reflecting rate of material is greater than setting threshold;
Set up queue, by initial position stored in queue;
Division region of memory is preserved this time and is played up required visible range;
Calculate the visible range of all nodes in queue, and therefrom delete the node after calculating, objects all in visible range are preserved, if there is node in visible range, then by node stored in queue; Otherwise division region of memory is preserved this time and is played up required visible range again.
Further, the process that the image after being played up by three-dimensional scenic in step (4.5) carries out compressing is:
Step (4.5.1): utilize HEVC coding framework, the planarization of the image after playing up according to three-dimensional scenic, the Iamge Segmentation after being played up by three-dimensional scenic adaptively becomes some coding units, and determines best splitting scheme;
Step (4.5.2): identify splitting scheme, selects optimum predictive mode, utilizes differential coding to carry out tentative prediction; Wherein, predictive mode comprises infra-frame prediction and inter prediction;
Step (4.5.3): decide the residual error scanning sequency that three-dimensional scenic plays up rear image according to predictive mode, optimizes entropy code.
In step (4.5.2), predictive mode also comprises spatial prediction, by the combination in time domain and spatial domain, by the predictive mode of the selection optimum of pixel.
Also use classification prediction, template matches and adaptive forecasting method for infra-frame prediction, reduce spatial redundancy and improve code efficiency.In addition, code efficiency is improved by inter prediction.
In step (4.5), the image after being played up by the three-dimensional scenic after compression is sent in mobile terminal and shows, and have employed the method for Fast Low-latency user terminal displays, as shown in Figure 4, its detailed process is:
Auto-Sensing mobile terminal device hardware information, is sent to high in the clouds, high in the clouds Intellectual Analysis Technology can customize to different user according to its equipment computing capability and the most suitable compression algorithm of link speed intelligent selection;
Video flowing solution is pressed on the basis of HEVC framework itself, owing to having carried out optimal segmentation to image in compression process;
Decompression procedure carries out decompress(ion) according to result of calculation beyond the clouds, utilize good concurrency, the conversion of relevant render instruction can be carried out at once after decompress(ion) terminates at the pel of segmentation, and without the need to carrying out transformation in planta after entire image completes decompress(ion) again, each frame carries out repeatedly state updating with the form of repeatedly batch processing;
According to the content in video memory, upgrade screen display.
Introduce behavior prediction, user's input is predicted, and will communicate with high in the clouds for information about, high in the clouds then can utilize information advancing updating view, once after receiving the accurate information of user operation, cancel the change of error prediction, in conjunction with information of forecasting, real change is upgraded, and the operation information new according to user does the prediction made new advances.
High in the clouds is carried out identifying according to the operating habit of different user and is learnt, in reciprocal process, improve constantly forecasting accuracy.
In the process of linking communications, mutual with operating system, improve the Web vector graphic priority of current application, to try one's best, less user uses delay.
By reference to the accompanying drawings the specific embodiment of the present invention is described although above-mentioned; but not limiting the scope of the invention; one of ordinary skill in the art should be understood that; on the basis of technical scheme of the present invention, those skilled in the art do not need to pay various amendment or distortion that creative work can make still within protection scope of the present invention.

Claims (10)

1., based on a mobile terminal real-time rendering system for cloud platform, it is characterized in that, comprising:
Be deployed in the centralized control unit of cloud server, the three-dimensional scenic management system be connected respectively with centralized control unit and cluster, distributed memory system and cluster, MIC/GPU play up management service system and cluster and SiteServer LBS and cluster;
Described three-dimensional scenic management system and cluster, it is for the type of the model group according to three-dimensional scenic, divides the three-dimensional scenic data transmitted from mobile terminal, obtains three-dimensional scene models group data;
Described distributed memory system and cluster, it for storing three-dimensional scene models group data, and carries out the automatic adjustment of memory location according to different pieces of information demand under different three-dimensional scenic;
Described MIC/GPU plays up management service system and cluster, it is for transferring the three-dimensional scene models group data being stored in distributed memory system and cluster, set up and manage the MIC/GPU rendering task of three-dimensional scene images, finally obtain three-dimensional scenic rendering result data, and be issued to mobile terminal after the three-dimensional scenic rendering result data of acquisition being compressed;
Described SiteServer LBS and cluster, it, for utilizing dynamic load strategy to MIC/GPU rendering task procedure deployment and management, guarantees the load balancing of cloud server.
2. a kind of mobile terminal real-time rendering system based on cloud platform as claimed in claim 1, it is characterized in that, described rendering system, also comprise network english teaching system and cluster, its for centered by control unit, three-dimensional scenic management system and cluster, distributed memory system and cluster, MIC/GPU play up management service system and cluster and SiteServer LBS and cluster and provide between any two and intercom mutually.
3. a kind of mobile terminal real-time rendering system based on cloud platform as claimed in claim 2, it is characterized in that, described three-dimensional scenic management system and cluster, comprising:
Threedimensional model and document scene loading unit, itself and mobile terminal are connected by network english teaching system and cluster, the view information sent for mobile terminal receive and interactive information, and inquiry is reading model and document scene also, obtain three-dimensional scenic data;
Threedimensional model and document scene cutting unit, threedimensional model and document scene are divided into several model block for the type of the model group according to three-dimensional scenic by it, obtain three-dimensional scene models group data;
Threedimensional model block unit of memory allocation, it is for being automatically dispensed to distributed memory system by three-dimensional scene models group data and cluster stores.
4. a kind of mobile terminal real-time rendering system based on cloud platform as claimed in claim 1, it is characterized in that, described MIC/GPU plays up management service system and cluster, comprising:
Three-dimensional scene models group data transfer unit, and it is for transferring the three-dimensional scene models group data be stored in distributed memory system and cluster;
Rendering task creation module, it is for setting up the task of rendering three-dimensional scenes;
Rendering task Data import module, in the task of its rendering three-dimensional scenes extremely set up for the three-dimensional scene models group Data import that will transfer;
Rendering task scheduler module, it is for transferring rendering task, carries out parallel ray tracing play up the three-dimensional scene models group data loaded, and obtains three-dimensional scenic rendering result data;
Rendering result data management, it is for compressing three-dimensional scenic rendering result data, and the three-dimensional scenic rendering result data after compression are sent in mobile terminal and are shown.
5., as claimed in claim 1 based on an implementation method for the mobile terminal real-time rendering system of cloud platform, it is characterized in that, comprising:
Step (1): the view information that mobile terminal receive sends and interactive information, inquiry is reading model and document scene also, obtains three-dimensional scenic data;
Step (2): according to the type of the model group of three-dimensional scenic, divides three-dimensional scenic data, obtains three-dimensional scene models group data;
Step (3): store three-dimensional scene models group data, and carry out the automatic adjustment of memory location according to different pieces of information demand under different three-dimensional scenic;
Step (4): the three-dimensional scene models group data transferring storage, set up and manage the MIC/GPU rendering task of three-dimensional scene images, finally obtain three-dimensional scenic rendering result data, and be issued to mobile terminal after the three-dimensional scenic rendering result data of acquisition being compressed; Wherein, utilize dynamic load strategy carry out disposing to MIC/GPU rendering task and manage, guarantee the load balancing of cloud server.
6. the implementation method of a kind of mobile terminal real-time rendering system based on cloud platform as claimed in claim 5, it is characterized in that, in described step (1), mobile terminal intercoms mutually with cloud server.
7. the implementation method of a kind of mobile terminal real-time rendering system based on cloud platform as claimed in claim 5, is characterized in that, the process dividing three-dimensional scenic data in described step (2) is:
Step (2.1): three-dimensional scenic data are divided into several model group by the unit preset, and these model group are numbered;
Step (2.2): for each model group be divided into, according to the density of zones of different model in its model group, this group model is divided into several airtight square model block, model quantity in each model block is equal, model block each in model group is numbered again.
8. the implementation method of a kind of mobile terminal real-time rendering system based on cloud platform as claimed in claim 5, is characterized in that, obtains the process of three-dimensional scenic rendering result data, comprising in described step (4):
Step (4.1): transfer the three-dimensional scene models group data be stored in distributed memory system and cluster;
Step (4.2): the task of setting up rendering three-dimensional scenes;
Step (4.3): in the task of the rendering three-dimensional scenes that the three-dimensional scene models group Data import transferred extremely is set up;
Step (4.4): transfer rendering task, carries out parallel ray tracing play up the three-dimensional scene models group data loaded, obtain three-dimensional scenic play up after image, and then obtain rendering result data;
Step (4.5): the parallelization ray tracing rendering image obtained based on step (4.4) is compressed, and the image after compression is sent in mobile terminal and shows.
9. the implementation method of a kind of mobile terminal real-time rendering system based on cloud platform as claimed in claim 8, it is characterized in that, the process that the image after being played up by three-dimensional scenic in described step (4.5) carries out compressing is:
Step (4.5.1): utilize HEVC coding framework, the planarization of the image after playing up according to three-dimensional scenic, the Iamge Segmentation after being played up by three-dimensional scenic adaptively becomes some coding units, and determines best splitting scheme;
Step (4.5.2): identify splitting scheme, selects optimum predictive mode, utilizes differential coding to carry out tentative prediction; Wherein, predictive mode comprises infra-frame prediction and inter prediction;
Step (4.5.3): decide the residual error scanning sequency that three-dimensional scenic plays up rear image according to predictive mode, optimizes entropy code.
10. the implementation method of a kind of mobile terminal real-time rendering system based on cloud platform as claimed in claim 9, it is characterized in that, in step (4.5.2), predictive mode also comprises spatial prediction, by the combination in time domain and spatial domain, by the predictive mode of the selection optimum of pixel.
CN201510744206.XA 2015-11-04 2015-11-04 Mobile terminal real-time rendering system and method based on cloud platform Active CN105263050B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510744206.XA CN105263050B (en) 2015-11-04 2015-11-04 Mobile terminal real-time rendering system and method based on cloud platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510744206.XA CN105263050B (en) 2015-11-04 2015-11-04 Mobile terminal real-time rendering system and method based on cloud platform

Publications (2)

Publication Number Publication Date
CN105263050A true CN105263050A (en) 2016-01-20
CN105263050B CN105263050B (en) 2018-01-12

Family

ID=55102529

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510744206.XA Active CN105263050B (en) 2015-11-04 2015-11-04 Mobile terminal real-time rendering system and method based on cloud platform

Country Status (1)

Country Link
CN (1) CN105263050B (en)

Cited By (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106126148A (en) * 2016-06-30 2016-11-16 联想(北京)有限公司 Display control method and electronic equipment
CN106254489A (en) * 2016-08-16 2016-12-21 王淼 A kind of cloud rendering system without file transmission and method thereof
CN106604042A (en) * 2016-12-22 2017-04-26 Tcl集团股份有限公司 Panorama webcasting system and panorama webcasting method based on cloud server
CN108009848A (en) * 2017-11-29 2018-05-08 佛山市因诺威特科技有限公司 A kind of household emulation mode and equipment
CN109085966A (en) * 2018-06-15 2018-12-25 广东康云多维视觉智能科技有限公司 A kind of three-dimensional display system and method based on cloud computing
CN109389666A (en) * 2018-09-29 2019-02-26 吉林动画学院 Distributed Real-time Rendering device and method
CN109448089A (en) * 2018-10-22 2019-03-08 美宅科技(北京)有限公司 A kind of rendering method and device
CN109448096A (en) * 2017-11-08 2019-03-08 成都生活家网络科技有限公司 A kind of design and rendering separation system and its working method based on VRay cloud platform and U3D engine platform
CN110244988A (en) * 2019-06-20 2019-09-17 深圳市瑞云科技有限公司 A kind of scene of game generation system and method based on CG real-time rendering
CN110264550A (en) * 2019-06-19 2019-09-20 深圳市瑞云科技有限公司 A kind of fireworks joint performance effect simulation display systems and method based on CG real-time rendering
CN110543684A (en) * 2019-08-05 2019-12-06 东易日盛家居装饰集团股份有限公司 Indoor effect graph generation method, server and system
CN111028329A (en) * 2019-05-22 2020-04-17 珠海随变科技有限公司 Rendering graph providing method, device and equipment and storage medium
CN111045826A (en) * 2019-12-17 2020-04-21 四川省建筑设计研究院有限公司 Computing method and system for distributed parallel rendering of local area network environment
CN111127617A (en) * 2019-12-29 2020-05-08 浙江科技学院 Rendering system and rendering method based on distributed rendering engine
CN111290124A (en) * 2020-03-31 2020-06-16 北京塞傲时代信息技术有限公司 VR glasses based on 5G cloud rendering
CN111494936A (en) * 2020-02-12 2020-08-07 阿里巴巴集团控股有限公司 Picture rendering method, device, system and storage medium
CN111583350A (en) * 2020-05-29 2020-08-25 联想(北京)有限公司 Image processing method, device and system and server
CN111739142A (en) * 2019-03-22 2020-10-02 厦门雅基软件有限公司 Scene rendering method and device, electronic equipment and computer readable storage medium
CN112002162A (en) * 2020-09-02 2020-11-27 上海上益教育设备制造有限公司 Open course platform system for online education
WO2020253871A1 (en) * 2019-06-21 2020-12-24 广州虎牙科技有限公司 Online video data output method, system, and cloud platform
CN112163986A (en) * 2020-09-28 2021-01-01 山东黄金矿业(莱州)有限公司三山岛金矿 Distributed processing method for underground logging and mining three-dimensional data of metal mine
CN112364403A (en) * 2020-11-23 2021-02-12 四川大学 3D intelligent matching display system and method for shoe moving end
CN112565818A (en) * 2020-11-30 2021-03-26 中国矿业大学(北京) Two-three-dimensional integrated operation station platform construction method and electronic equipment
CN113645484A (en) * 2021-10-16 2021-11-12 成都中科合迅科技有限公司 Data visualization accelerated rendering method based on graphic processor
CN114257629A (en) * 2021-11-15 2022-03-29 中国南方电网有限责任公司 Transformer substation three-dimensional model rendering method and system, computer equipment and storage medium
CN114708371A (en) * 2022-04-12 2022-07-05 联通(广东)产业互联网有限公司 Three-dimensional scene model rendering and displaying method, device and system and electronic equipment
CN114928754A (en) * 2022-07-22 2022-08-19 埃洛克航空科技(北京)有限公司 Data processing method for live-action three-dimensional data and electronic equipment
CN115794424A (en) * 2023-02-13 2023-03-14 成都古河云科技有限公司 Method for accessing three-dimensional model through distributed architecture
CN116433818A (en) * 2023-03-22 2023-07-14 宝钢工程技术集团有限公司 Cloud CPU and GPU parallel rendering method
CN116758201A (en) * 2023-08-16 2023-09-15 淘宝(中国)软件有限公司 Rendering processing method, device and system of three-dimensional scene and computer storage medium
CN117011461A (en) * 2023-07-18 2023-11-07 广西旅发科技有限公司 Model modeling rendering processing method based on AI technology and edge calculation
CN117456113A (en) * 2023-12-26 2024-01-26 山东山大华天软件有限公司 Cloud offline rendering interactive application implementation method and system
WO2024060663A1 (en) * 2022-09-23 2024-03-28 中国电信股份有限公司 Three-dimensional model scene interaction method, system and apparatus, and device, storage medium and computer program product
CN118118595A (en) * 2024-03-29 2024-05-31 联通沃音乐文化有限公司 Construction method of communication network video color ring XR application
CN118245230A (en) * 2024-05-27 2024-06-25 北京趋动智能科技有限公司 Image rendering task scheduling method and device based on load balancing
CN118764564A (en) * 2024-09-03 2024-10-11 西安城市发展资源信息有限公司 Image transmission method for real-time rendering of Web three-dimensional scene
CN118118595B (en) * 2024-03-29 2024-11-15 联通沃音乐文化有限公司 Construction method of communication network video color ring XR application

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102592315A (en) * 2011-01-12 2012-07-18 上海库达数字信息技术有限公司 3D rendering platform based on GPU cloud cluster
CN103324475A (en) * 2013-05-28 2013-09-25 机械工业第六设计研究院有限公司 Building information model (BIM) rendering optimization system and method based on IFC standard
CN103699656A (en) * 2013-12-27 2014-04-02 同济大学 GPU-based mass-multimedia-data-oriented MapReduce platform
US20140237527A1 (en) * 2008-06-25 2014-08-21 At&T Intellectual Property Ii, Lp Method and apparatus for presenting media programs

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140237527A1 (en) * 2008-06-25 2014-08-21 At&T Intellectual Property Ii, Lp Method and apparatus for presenting media programs
CN102592315A (en) * 2011-01-12 2012-07-18 上海库达数字信息技术有限公司 3D rendering platform based on GPU cloud cluster
CN103324475A (en) * 2013-05-28 2013-09-25 机械工业第六设计研究院有限公司 Building information model (BIM) rendering optimization system and method based on IFC standard
CN103699656A (en) * 2013-12-27 2014-04-02 同济大学 GPU-based mass-multimedia-data-oriented MapReduce platform

Cited By (47)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106126148B (en) * 2016-06-30 2020-05-26 联想(北京)有限公司 Display control method and electronic equipment
CN106126148A (en) * 2016-06-30 2016-11-16 联想(北京)有限公司 Display control method and electronic equipment
CN106254489A (en) * 2016-08-16 2016-12-21 王淼 A kind of cloud rendering system without file transmission and method thereof
CN106604042A (en) * 2016-12-22 2017-04-26 Tcl集团股份有限公司 Panorama webcasting system and panorama webcasting method based on cloud server
CN109448096A (en) * 2017-11-08 2019-03-08 成都生活家网络科技有限公司 A kind of design and rendering separation system and its working method based on VRay cloud platform and U3D engine platform
CN108009848A (en) * 2017-11-29 2018-05-08 佛山市因诺威特科技有限公司 A kind of household emulation mode and equipment
CN109085966A (en) * 2018-06-15 2018-12-25 广东康云多维视觉智能科技有限公司 A kind of three-dimensional display system and method based on cloud computing
CN109085966B (en) * 2018-06-15 2020-09-08 广东康云多维视觉智能科技有限公司 Three-dimensional display system and method based on cloud computing
CN109389666A (en) * 2018-09-29 2019-02-26 吉林动画学院 Distributed Real-time Rendering device and method
CN109448089A (en) * 2018-10-22 2019-03-08 美宅科技(北京)有限公司 A kind of rendering method and device
CN109448089B (en) * 2018-10-22 2023-04-18 美宅科技(北京)有限公司 Rendering method and device
CN111739142A (en) * 2019-03-22 2020-10-02 厦门雅基软件有限公司 Scene rendering method and device, electronic equipment and computer readable storage medium
CN111028329A (en) * 2019-05-22 2020-04-17 珠海随变科技有限公司 Rendering graph providing method, device and equipment and storage medium
CN111028329B (en) * 2019-05-22 2020-10-16 珠海随变科技有限公司 Rendering graph providing method, device and equipment and storage medium
CN110264550A (en) * 2019-06-19 2019-09-20 深圳市瑞云科技有限公司 A kind of fireworks joint performance effect simulation display systems and method based on CG real-time rendering
CN110244988A (en) * 2019-06-20 2019-09-17 深圳市瑞云科技有限公司 A kind of scene of game generation system and method based on CG real-time rendering
WO2020253871A1 (en) * 2019-06-21 2020-12-24 广州虎牙科技有限公司 Online video data output method, system, and cloud platform
CN110543684A (en) * 2019-08-05 2019-12-06 东易日盛家居装饰集团股份有限公司 Indoor effect graph generation method, server and system
CN111045826A (en) * 2019-12-17 2020-04-21 四川省建筑设计研究院有限公司 Computing method and system for distributed parallel rendering of local area network environment
CN111127617A (en) * 2019-12-29 2020-05-08 浙江科技学院 Rendering system and rendering method based on distributed rendering engine
CN111494936A (en) * 2020-02-12 2020-08-07 阿里巴巴集团控股有限公司 Picture rendering method, device, system and storage medium
CN111290124A (en) * 2020-03-31 2020-06-16 北京塞傲时代信息技术有限公司 VR glasses based on 5G cloud rendering
CN111583350A (en) * 2020-05-29 2020-08-25 联想(北京)有限公司 Image processing method, device and system and server
CN112002162A (en) * 2020-09-02 2020-11-27 上海上益教育设备制造有限公司 Open course platform system for online education
CN112163986A (en) * 2020-09-28 2021-01-01 山东黄金矿业(莱州)有限公司三山岛金矿 Distributed processing method for underground logging and mining three-dimensional data of metal mine
CN112364403A (en) * 2020-11-23 2021-02-12 四川大学 3D intelligent matching display system and method for shoe moving end
CN112565818A (en) * 2020-11-30 2021-03-26 中国矿业大学(北京) Two-three-dimensional integrated operation station platform construction method and electronic equipment
CN113645484A (en) * 2021-10-16 2021-11-12 成都中科合迅科技有限公司 Data visualization accelerated rendering method based on graphic processor
CN114257629A (en) * 2021-11-15 2022-03-29 中国南方电网有限责任公司 Transformer substation three-dimensional model rendering method and system, computer equipment and storage medium
CN114708371A (en) * 2022-04-12 2022-07-05 联通(广东)产业互联网有限公司 Three-dimensional scene model rendering and displaying method, device and system and electronic equipment
CN114928754A (en) * 2022-07-22 2022-08-19 埃洛克航空科技(北京)有限公司 Data processing method for live-action three-dimensional data and electronic equipment
CN114928754B (en) * 2022-07-22 2022-10-04 埃洛克航空科技(北京)有限公司 Data processing method for live-action three-dimensional data and electronic equipment
WO2024060663A1 (en) * 2022-09-23 2024-03-28 中国电信股份有限公司 Three-dimensional model scene interaction method, system and apparatus, and device, storage medium and computer program product
CN115794424B (en) * 2023-02-13 2023-04-11 成都古河云科技有限公司 Method for accessing three-dimensional model through distributed architecture
CN115794424A (en) * 2023-02-13 2023-03-14 成都古河云科技有限公司 Method for accessing three-dimensional model through distributed architecture
CN116433818A (en) * 2023-03-22 2023-07-14 宝钢工程技术集团有限公司 Cloud CPU and GPU parallel rendering method
CN116433818B (en) * 2023-03-22 2024-04-16 宝钢工程技术集团有限公司 Cloud CPU and GPU parallel rendering method
CN117011461A (en) * 2023-07-18 2023-11-07 广西旅发科技有限公司 Model modeling rendering processing method based on AI technology and edge calculation
CN116758201A (en) * 2023-08-16 2023-09-15 淘宝(中国)软件有限公司 Rendering processing method, device and system of three-dimensional scene and computer storage medium
CN116758201B (en) * 2023-08-16 2024-01-12 淘宝(中国)软件有限公司 Rendering processing method, device and system of three-dimensional scene and computer storage medium
CN117456113A (en) * 2023-12-26 2024-01-26 山东山大华天软件有限公司 Cloud offline rendering interactive application implementation method and system
CN117456113B (en) * 2023-12-26 2024-04-23 山东山大华天软件有限公司 Cloud offline rendering interactive application implementation method and system
CN118118595A (en) * 2024-03-29 2024-05-31 联通沃音乐文化有限公司 Construction method of communication network video color ring XR application
CN118118595B (en) * 2024-03-29 2024-11-15 联通沃音乐文化有限公司 Construction method of communication network video color ring XR application
CN118245230A (en) * 2024-05-27 2024-06-25 北京趋动智能科技有限公司 Image rendering task scheduling method and device based on load balancing
CN118245230B (en) * 2024-05-27 2024-09-20 北京趋动智能科技有限公司 Image rendering task scheduling method and device based on load balancing
CN118764564A (en) * 2024-09-03 2024-10-11 西安城市发展资源信息有限公司 Image transmission method for real-time rendering of Web three-dimensional scene

Also Published As

Publication number Publication date
CN105263050B (en) 2018-01-12

Similar Documents

Publication Publication Date Title
CN105263050A (en) Mobile terminal real-time rendering system and method based on cloud platform
Lee et al. GROOT: a real-time streaming system of high-fidelity volumetric videos
KR102602380B1 (en) METHOD AND APPARATUS FOR POINT-CLOUD STREAMING
CN102148818B (en) Method and system for realizing distributed virtual reality and visualization on mobile device
CN102855133B (en) A kind of computer processing unit interactive system
CN111932668B (en) Three-dimensional visualization method, system, medium and electronic equipment for urban landscape model
CN105262825A (en) SPICE cloud desktop transporting and displaying method and system on the basis of H.265 algorithm
CN104599315A (en) Three-dimensional scene construction method and system
WO2024037137A1 (en) Data processing method and apparatus for immersive media, and device, medium and product
CN102857531B (en) A kind of long-distance interactive system based on cloud computing
CN102857533A (en) Remote interaction type system on basis of cloud computing
CN103714569A (en) Rendering instruction processing method, device and system
US10997795B2 (en) Method and apparatus for processing three dimensional object image using point cloud data
CN116016951A (en) Point cloud processing method, device, equipment and storage medium
CN108108230A (en) Cloud platform delivery system based on docker
CN103677930A (en) GIS data loading method and device based on mosaic wall system
KR20230153468A (en) Method, device, and program for streaming 3D objects
CN114570020A (en) Data processing method and system
CN117456113B (en) Cloud offline rendering interactive application implementation method and system
Yoo et al. Real-time parallel remote rendering for mobile devices using graphics processing units
US11948338B1 (en) 3D volumetric content encoding using 2D videos and simplified 3D meshes
CN102857534A (en) Remote interaction method on basis of cloud computing
CN102857535A (en) Computer processing unit, computer gateway and interactive system
CN117115326A (en) Rendering method and device of three-dimensional scene model and distributed rendering server
CN108881473A (en) A kind of intelligent sharing optical projection system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant