CN109309867A - Display methods, display terminal and the computer readable storage medium of terminal - Google Patents
Display methods, display terminal and the computer readable storage medium of terminal Download PDFInfo
- Publication number
- CN109309867A CN109309867A CN201710636716.4A CN201710636716A CN109309867A CN 109309867 A CN109309867 A CN 109309867A CN 201710636716 A CN201710636716 A CN 201710636716A CN 109309867 A CN109309867 A CN 109309867A
- Authority
- CN
- China
- Prior art keywords
- region
- terminal
- transcoding
- data
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
Abstract
The invention discloses a kind of display methods of terminal.This method comprises: receiving the real-time video frame data and the first region of variation information in the desktop that server is sent, and the real-time video frame data are decoded, obtain the first color coding yuv data；First yuv data is divided into the video area of preset quantity by preset rules, and calculates the second region of variation information that the video area is intersected with the first region of variation information using preset algorithm；It is corresponding RGB data by the corresponding second yuv data transcoding of the second region of variation information, and is shown according to the RGB data.The invention also discloses a kind of display terminal and computer readable storage mediums.The display efficiency of terminal can be improved in the present invention, reduces the use cost of terminal.
Description
Technical field
The present invention relates to terminal field of display technology more particularly to a kind of display methods of terminal, display terminal and calculating
Machine readable storage medium storing program for executing.
Background technique
With the fast development of computer technology, the terminal devices such as PC, palm PC, smart phone are nowhere not
Becoming people's indispensable equipment at one's side.These terminal devices generally all have display function, are receiving video information
When, it can show that in the terminal therefore, people can be used to watch video by decoding and transcoding.
But at present when only some changes in all videos information, terminal also can be again to all views
Frequency information is decoded and transcoding, and then shows in the terminal.This mode makes the display efficiency of terminal relatively low, and right
The hardware requirement of terminal is also relatively high, therefore increases the use cost of terminal.
Summary of the invention
The main purpose of the present invention is to provide a kind of display methods of terminal, display terminal and computer-readable storage mediums
Matter, it is intended to improve terminal display efficiency, reduce the use cost of terminal.
To achieve the above object, the present invention provides a kind of display methods of terminal, and the display methods of the terminal includes:
The real-time video frame data and the first region of variation information in the desktop that server is sent are received, and to described real-time
Video requency frame data is decoded, and obtains the first color coding yuv data；
First yuv data is divided into the video area of preset quantity by preset rules, and is calculated using preset algorithm
The second region of variation information that the video area is intersected with the first region of variation information out；
It is corresponding RGB data by the corresponding second yuv data transcoding of the second region of variation information, and according to described
RGB data is shown.
Optionally, described that the real-time video frame data are decoded, obtain the step of the first color coding yuv data
Suddenly, comprising:
According to the format information of the real-time video frame data and prestores hardware information and judge the real-time video frame data
Whether hardware is supported to decode；
If the real-time video frame data support hardware decoding, using the decoded mode of hardware to the real-time video frame
Data are decoded, and obtain the first yuv data；
If the real-time video frame data do not support hardware to decode, using the decoded mode of software to the real-time video
Frame data are decoded, and obtain the first yuv data.
Optionally, the video area that first yuv data is divided into preset quantity by preset rules, and using in advance
Imputation method calculates the second region of variation information that the video area is intersected with the first region of variation information, comprising:
First yuv data is divided into the video area of preset quantity by preset rules；
One corresponding thread is created to each video area；
Calculate what the video area was intersected with the first region of variation information using the thread and preset algorithm
Second region of variation information.
Optionally, the step of video area that first yuv data is divided into preset quantity by preset rules, packet
It includes:
First yuv data is divided into the video area of preset quantity by the height or width of terminal display resolution
Domain.
Optionally, it is described by the corresponding second yuv data transcoding of the second region of variation information be corresponding RGB data
The step of, comprising:
Judge whether the second region of variation information supports hardware transcoding according to the hardware information that prestores；
If the second region of variation Informational support hardware transcoding, is changed by the way of hardware transcoding by described second
The corresponding second yuv data transcoding of area information is corresponding RGB data.
Optionally, it is described by the corresponding second yuv data transcoding of the second region of variation information be corresponding RGB data
The step of, further includes:
If the second region of variation information does not support hardware transcoding, hardware information is prestored according to and judges described
Whether two region of variation information support compilation transcoding；
The transcoding if the second region of variation Informational support collects, is changed by the way of the transcoding that collects by described second
The corresponding second yuv data transcoding of area information is corresponding RGB data；
If the second region of variation information does not support compilation transcoding, described second is become by the way of software transcoding
Changing the corresponding second yuv data transcoding of area information is corresponding RGB data.
Optionally, the real-time video frame data and the first region of variation information received in the desktop that server is sent
Step, comprising:
Receive the desktop that real-time video frame data and server in the desktop that server is sent are grabbed by pre-set programs
In the first region of variation information.
Optionally, the first region of variation information, the second region of variation information and the video area include
Respectively indicate the parameter of upper, left and right, lower coordinate information of the corresponding region of variation in the desktop.
In addition, to achieve the above object, the present invention also provides a kind of display terminal, the display terminal include: memory,
Processor and the display program for being stored in the terminal that can be run on the memory and on the processor, the terminal are shown
The step of showing the display methods that terminal as described above is realized when program is executed by the processor.
In addition, to achieve the above object, the present invention also provides a kind of computer readable storage mediums, which is characterized in that institute
The display program that terminal is stored on computer readable storage medium is stated, it is real when the display program of the terminal is executed by processor
Now the step of displaying method of terminal as described above.
Real-time video frame data and the first region of variation information in desktop of the present invention by receiving server transmission, and
The real-time video frame data are decoded, the first color coding yuv data is obtained；By first yuv data by default
Rule is divided into the video area of preset quantity, and calculates the video area and first region of variation using preset algorithm
Second region of variation information of information intersection；It is to correspond to by the corresponding second yuv data transcoding of the second region of variation information
RGB data, and shown according to the RGB data.By the above-mentioned means, the present invention receives the desktop sent in server
In real-time video frame data and the first region of variation information, and both calculate according to preset algorithm the second variation zone of intersection
Domain information, and be only corresponding RGB data by the corresponding second yuv data transcoding of the second region of variation information described after decoding,
To terminal only need by the second region of variation information progress transcoding display can be completed, compared with the prior art in all views
Frequency domain information carries out the mode that transcoding is shown, can reduce terminal from time of the desktop video data to display is received, to mention
The display efficiency of high terminal, while the requirement to terminal hardware resource is reduced, to reduce the use cost of terminal.
Detailed description of the invention
Fig. 1 is the terminal structure schematic diagram for the hardware running environment that the embodiment of the present invention is related to；
Fig. 2 is the flow diagram of the display methods first embodiment of terminal of the present invention；
Fig. 3 is to be decoded in the embodiment of the present invention to the real-time video frame data, obtains the refinement of the first yuv data
Flow diagram；
Fig. 4 is the video area that first yuv data is divided into preset quantity in the embodiment of the present invention by preset rules,
And the second region of variation information that the video area is intersected with the first region of variation information is calculated using preset algorithm；
It by the corresponding second yuv data transcoding of the second region of variation information is corresponding that Fig. 5, which is in the embodiment of the present invention,
RGB data, and the refinement flow diagram shown according to the RGB data.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
Since in the prior art, when only some changes in all videos information, terminal also can be again to institute
Some video informations are decoded and transcoding, and then show in the terminal.This mode makes the display efficiency of terminal relatively low,
And it is also relatively high to the hardware requirement of terminal, therefore increase the use cost of terminal.For cloud terminal, relate to
And data information amount it is more huge, therefore, how to improve the display efficiency of terminal is those skilled in the art's technology urgently to be resolved
Problem.
In order to solve the above technical problem, the present invention provides a kind of displaying method of terminal, by receiving server transmission
Real-time video frame data and the first region of variation information in desktop, and the real-time video frame data are decoded, it obtains
First color encodes yuv data；First yuv data is divided into the video area of preset quantity by preset rules, and is utilized
Preset algorithm calculates the second region of variation information that the video area is intersected with the first region of variation information；It will be described
The corresponding second yuv data transcoding of second region of variation information is corresponding RGB data, and is shown according to the RGB data
Show.By the above-mentioned means, the present invention receives the real-time video frame data and the first region of variation in the desktop sent in server
Information, and the second region of variation information that the two intersects is calculated according to preset algorithm, and only by the second variation described after decoding
The corresponding second yuv data transcoding of area information is corresponding RGB data, so that terminal is only needed the second region of variation information
Carrying out transcoding can be completed display, compared with the prior art in the mode that shows of all video area information progress transcoding, can
Terminal is reduced from time of the desktop video data to display is received, to improve the display efficiency of terminal, while being reduced to terminal
The requirement of hardware resource, to reduce the use cost of terminal.
As shown in Figure 1, Fig. 1 is the terminal structure schematic diagram for the hardware running environment that the embodiment of the present invention is related to.
The terminal of that embodiment of the invention can be PC, be also possible to smart phone, tablet computer, portable computer etc. with aobvious
The packaged type terminal device for showing function, can also be cloud terminal.
As shown in Figure 1, the terminal may include: processor 1001, such as CPU, network interface 1004, user interface
1003, memory 1005, communication bus 1002.Wherein, communication bus 1002 is for realizing the connection communication between these components.
User interface 1003 may include display screen (Display), input unit such as keyboard (Keyboard), optional user interface
1003 can also include standard wireline interface and wireless interface.Network interface 1004 optionally may include that the wired of standard connects
Mouth, wireless interface (such as WI-FI interface).Memory 1005 can be high speed RAM memory, be also possible to stable memory
(non-volatile memory), such as magnetic disk storage.Memory 1005 optionally can also be independently of aforementioned processor
1001 storage device.
Optionally, terminal can also include camera, RF (Radio Frequency, radio frequency) circuit, sensor, audio
Circuit, Wi-Fi module etc..Wherein, sensor such as optical sensor, motion sensor and other sensors.Specifically, light
Sensor may include ambient light sensor and proximity sensor, wherein ambient light sensor can according to the light and shade of ambient light come
The brightness of display screen is adjusted, proximity sensor can close display screen and/or backlight when mobile terminal is moved in one's ear.As
One kind of motion sensor, gravity accelerometer can detect the size of (generally three axis) acceleration in all directions, quiet
Size and the direction that can detect that gravity when only, the application that can be used to identify mobile terminal posture are (such as horizontal/vertical screen switching, related
Game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap) etc.；Certainly, mobile terminal can also match
The other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor are set, details are not described herein.
It will be understood by those skilled in the art that the restriction of the not structure paired terminal of terminal structure shown in Fig. 1, can wrap
It includes than illustrating more or fewer components, perhaps combines certain components or different component layouts.
As shown in Figure 1, as may include that operating system, network are logical in a kind of memory 1005 of computer storage medium
Believe the display program of module, Subscriber Interface Module SIM and terminal.
In terminal shown in Fig. 1, network interface 1004 is mainly used for connecting background server, carries out with background server
Data communication；User interface 1003 is mainly used for connecting client (user terminal), carries out data communication with client；And processor
1001 can be used for calling the display program of the terminal stored in memory 1005, and execute following operation:
The real-time video frame data and the first region of variation information in the desktop that server is sent are received, and to described real-time
Video requency frame data is decoded, and obtains the first color coding yuv data；
First yuv data is divided into the video area of preset quantity by preset rules, and is calculated using preset algorithm
The second region of variation information that the video area is intersected with the first region of variation information out；
It is corresponding RGB data by the corresponding second yuv data transcoding of the second region of variation information, and according to described
RGB data is shown.
Further, the processor 1001 can be used for calling the display program of the terminal stored in memory 1005,
Also execute following operation:
According to the format information of the real-time video frame data and prestores hardware information and judge the real-time video frame data
Whether hardware is supported to decode；
If the real-time video frame data support hardware decoding, using the decoded mode of hardware to the real-time video frame
Data are decoded, and obtain the first yuv data；
If the real-time video frame data do not support hardware to decode, using the decoded mode of software to the real-time video
Frame data are decoded, and obtain the first yuv data.
Further, the processor 1001 can be used for calling the display program of the terminal stored in memory 1005,
Also execute following operation:
First yuv data is divided into the video area of preset quantity by preset rules；
One corresponding thread is created to each video area；
Calculate what the video area was intersected with the first region of variation information using the thread and preset algorithm
Second region of variation information.
Further, the processor 1001 can be used for calling the display program of the terminal stored in memory 1005,
Also execute following operation:
First yuv data is divided into the video area of preset quantity by the height or width of terminal display resolution
Domain.
Further, the processor 1001 can be used for calling the display program of the terminal stored in memory 1005,
Also execute following operation:
Judge whether the second region of variation information supports hardware transcoding according to the hardware information that prestores；
If the second region of variation Informational support hardware transcoding, is changed by the way of hardware transcoding by described second
The corresponding second yuv data transcoding of area information is corresponding RGB data.
Further, the processor 1001 can be used for calling the display program of the terminal stored in memory 1005,
Also execute following operation:
If the second region of variation information does not support hardware transcoding, hardware information is prestored according to and judges described
Whether two region of variation information support compilation transcoding；
The transcoding if the second region of variation Informational support collects, is changed by the way of the transcoding that collects by described second
The corresponding second yuv data transcoding of area information is corresponding RGB data；
If the second region of variation information does not support compilation transcoding, described second is become by the way of software transcoding
Changing the corresponding second yuv data transcoding of area information is corresponding RGB data.
Further, the processor 1001 can be used for calling the display program of the terminal stored in memory 1005,
Also execute following operation:
Receive the desktop that real-time video frame data and server in the desktop that server is sent are grabbed by pre-set programs
In the first region of variation information.
Further, the processor 1001 can be used for calling the display program of the terminal stored in memory 1005,
Also execute following operation:
The first region of variation information, the second region of variation information and the video area include to respectively indicate
The parameter of upper, left and right, lower coordinate information of the corresponding region of variation in the desktop.
Referring to Fig. 2, Fig. 2 is the flow diagram of displaying method of terminal first embodiment of the present invention.
In embodiments of the present invention, the displaying method of terminal includes:
Step S10 receives real-time video frame data and the first region of variation information in the desktop that server is sent, and right
The real-time video frame data are decoded, and obtain the first yuv data；
In embodiments of the present invention, terminal is switched on, establishes and is connected to the network with server, and appoint that corresponding message communicates
Data structure format.Further, terminal receives the real-time video frame data in the desktop of server transmission and the first variation
Area information understands the format information according to the real-time video frame data and the terminal hardware information prestored to the real-time video frame number
According to being decoded, to obtain corresponding first color coding (Luminance, Chrominance；Brightness, coloration) YUV number
According to.Wherein, the server can be Cloud Server, be also possible to common physical server；The desktop can be cloud table
Face is also possible to the corresponding desktop such as PC, tablet computer.In addition, the server include the desktop or with the desktop phase
Connection, such as Cloud Server include cloud desktop, and physical server is connected with computer desktop.
Specifically, it referring to Fig. 3, Fig. 3 is to be decoded in the embodiment of the present invention to the real-time video frame data, obtains
The refinement flow diagram of first yuv data, step S10 include:
Step S11 according to the format information of the real-time video frame data and prestores hardware information and judges the real-time view
Whether frequency frame data support hardware to decode；
Step S12, if the real-time video frame data support hardware decoding, using the decoded mode of hardware to the reality
When video requency frame data be decoded, obtain the first yuv data；
Step S13, if the real-time video frame data do not support hardware to decode, using the decoded mode of software to described
Real-time video frame data are decoded, and obtain the first yuv data.
In embodiments of the present invention, when terminal receives the real-time video frame data and the of the current desktop of server transmission
When one region of variation information, wherein the first region of variation information is that server is grabbed in desktop by pre-set programs
's.Further, terminal can be according to the format informations of the real-time video frame data and the terminal hardware information prestored, such as centre
Device CPU and video card GPU is managed, to judge whether the real-time video frame data support hardware to decode, if the real-time video frame number
According to hardware decoding is supported, then the real-time video frame data is decoded using hardware decoded mode, obtains the first YUV number
According to；If the real-time video frame data do not support hardware to decode, using the decoded mode of software to the real-time video frame number
According to being decoded, the first yuv data is obtained.
Wherein, hardware decoding is to be decoded processing to video by GPU operation, and software decoding is allowed by software
CPU is decoded processing to video, and therefore, terminal is answered when judging whether the real-time video frame data support hardware to decode
The support situations of the hardware informations such as format information and the GPU prestored and CPU of the video data is considered simultaneously, when both propping up
When holding hardware decoding, then the real-time video frame data are decoded using hardware decoded mode；When there is one in the two
Or both when not supporting hardware to decode, then the real-time video frame data are decoded using software decoded mode.
In embodiments of the present invention, when being decoded to real-time video frame data, terminal is according to the format of video data
The hardware informations such as information and the terminal CPU and GPU that prestore support situation, and hardware decoding and the decoded mode pair of software is respectively adopted
The real-time video frame data are decoded, and the utilization rate to terminal hardware resource can be improved.
First yuv data is divided into the video area of preset quantity by step S20 by preset rules, and is utilized default
Algorithm calculates the second region of variation information that the video area is intersected with the first region of variation information；
In embodiments of the present invention, first yuv data is divided by the height or width of terminal display resolution
First yuv data specifically can be divided into n by terminal display resolution height by the video area of preset quantity
Lateral video area is divided into n longitudinal video area by display resolution width.For example, the display resolution of terminal is
1024 × 768, when pressing the height timesharing of terminal display resolution, then first yuv data is divided into n laterally with 768/n
Video area；When pressing the width timesharing of terminal display resolution, then first yuv data is divided into n longitudinal direction with 1024/n
Video area.
Further, calculate that the video area is intersected with the first region of variation information using preset algorithm
Two region of variation information.For convenience of explanation, we by the first region of variation information be denoted as Rect X (X=1,2 ...,
N), the video area is denoted as Rect Y (Y=1,2 ..., n), the second region of variation information be denoted as Rect Z (Z=1,
2 ..., M), wherein N, n, M respectively represent the number of regions of corresponding region information.In the intersecting area for calculating Rect X and Rect Y
When, using formula " Rect X and Rect Y ", obtain the intersecting area Rect Z of Rect Y Yu Rect X.Due to Rect Y
In some regions may not change, with Rect X without intersection, therefore, in embodiments of the present invention, use preset algorithm
Rect X is intersected to obtain Rect Z with Rect Y, the regional scope of Rect Z is smaller compared to Rect X at this time, therefore, can be with
The range in desktop real-time change region is further reduced, so as to shorten the transcoding time, improves terminal display efficiency.
The corresponding second yuv data transcoding of the second region of variation information is corresponding RGB data by step S30, and
It is shown according to the RGB data.
In embodiments of the present invention, terminal can be according to the support situation judgement of the hardware informations such as the terminal CPU and GPU prestored
Whether the second region of variation information supports hardware to decode, if the second region of variation Informational support hardware transcoding, is adopted
It by the corresponding second yuv data transcoding of the second region of variation information is corresponding RGB data with the mode of hardware transcoding；If
The second region of variation information does not support hardware transcoding, then the hardware informations such as CPU and GPU for further prestoring according to are sentenced
Whether the second region of variation information of breaking supports compilation transcoding；The transcoding if the second region of variation Informational support collects,
Use the mode of compilation transcoding by the corresponding second yuv data transcoding of the second region of variation information for corresponding RGB data；
If the second region of variation information does not support compilation transcoding, second region of variation is believed by the way of software transcoding
Ceasing corresponding second yuv data transcoding is corresponding RGB data.
Wherein, YUV is a kind of colour coding method (belonging to PAL) used by eurovision system.YUV is mainly used for
The transmission for optimizing colour-video signal, makes the old-fashioned black-and-white television of its back compatible.Compared with rgb video signal transmission, it is maximum
The advantages of be only occupy few bandwidth (RGB require three independent vision signal simultaneous transmissions).
" Y " indicates brightness (Luminance or Luma) in YUV, that is, grayscale value, is a baseband signal.And " U "
That indicate with " V " is then coloration (Chrominance or Chroma), and effect is description colors of image and saturation degree, for specifying
The color of pixel.U and V is not baseband signal, it two is orthogonally modulated.
By operation, YUV three-component can be restored R (red), G (green), B (indigo plant), specifically, turning between YUV and RGB
Changing formula can be with are as follows:
R=Y+1.140*V, G=Y-0.394*U-0.581*V, B=Y+2.032*U.
Further, by RGB (Red, Green, the Blue；Red, green, blue) data are converted into image, it is carried out in terminal
Refresh display.Wherein, RGB data, which is converted into corresponding RGB image, can use the programs such as Matlab.
In addition, it should be noted that, in embodiments of the present invention, the first region of variation information, second variation
Area information and the video area include { top, left, right, bottom } four parameters, respectively indicate corresponding change
Change upper, left and right, lower coordinate information of the region in the desktop, which can be used for being accurately positioned first variation
Area information, the second region of variation information and the video area corresponding region in desktop.
The embodiment of the present invention is by receiving real-time video frame data and the first region of variation in the desktop that server is sent
Information, and the real-time video frame data are decoded, obtain the first yuv data；By first yuv data by default rule
Then it is divided into the video area of preset quantity, and calculates the video area and first region of variation letter using preset algorithm
The second region of variation information that manner of breathing is handed over；It is corresponding by the corresponding second yuv data transcoding of the second region of variation information
RGB data, and shown according to the RGB data.By the above-mentioned means, the present invention receives in the desktop sent in server
Real-time video frame data and the first region of variation information, and both calculate according to preset algorithm the second region of variation of intersection
Information, and be only corresponding RGB data by the corresponding second yuv data transcoding of the second region of variation information described after decoding, from
And terminal only need by the second region of variation information progress transcoding display can be completed, compared with the prior art in all videos
Area information carries out the mode that transcoding is shown, can reduce terminal from time of the desktop video data to display is received, to improve
The display efficiency of terminal, while the requirement to terminal hardware resource is reduced, to reduce the use cost of terminal.
Referring to Fig. 4, Fig. 4 is that first yuv data is divided into preset quantity by preset rules in the embodiment of the present invention
Video area, and become using second that preset algorithm calculates that the video area intersects with the first region of variation information
Change area information, be based on embodiment shown in Fig. 2, step S20 includes:
First yuv data is divided into the video area of preset quantity by step S21 by preset rules；
Step S22 creates a corresponding thread to each video area；
Step S23 calculates the video area using the thread and preset algorithm and first region of variation is believed
The second region of variation information that manner of breathing is handed over.
In embodiments of the present invention, first yuv data is divided by the height or width of terminal display resolution
First yuv data specifically can be divided into n by terminal display resolution height by the video area of preset quantity
Lateral video area is divided into n longitudinal video area by display resolution width.For example, the display resolution of terminal is
1024 × 768, when pressing the height timesharing of terminal display resolution, then first yuv data is divided into n laterally with 768/n
Video area；When pressing the width timesharing of terminal display resolution, then first yuv data is divided into n longitudinal direction with 1024/n
Video area.
Further, a corresponding thread is created to each video area, herein, uses multiple threads, it can be abundant
Using the resource of terminal CPU, to improve the efficiency of terminal system.
Further, the video area is calculated using the thread and preset algorithm and first region of variation is believed
The second region of variation information that manner of breathing is handed over.
For convenience of explanation, the first region of variation information is denoted as Rect X (X=1,2 ..., N), the view by us
Frequency domain is denoted as Rect Y (Y=1,2 ..., n), and the second region of variation information is denoted as Rect Z (Z=1,2 ..., M),
In, N, n, M respectively represent the number of regions of corresponding region information.When calculating the intersecting area of Rect X and Rect Y, to Rect
N corresponding threads are respectively created in n region in the region Y, and utilize the thread and formula " Rect X and Rect Y ",
Obtain the intersecting area Rect Z of Rect Y Yu Rect X.Since some regions in Rect Y may not change, with Rect
X is without intersection, therefore, in embodiments of the present invention, uses multithreading and preset algorithm, Rect X is intersected to obtain with Rect Y
Rect Z, the regional scope of Rect Z is smaller compared to Rect X at this time, therefore, can further reduce desktop real-time change
The range in region improves terminal display efficiency so as to shorten the transcoding time.
Referring to Fig. 5, Fig. 5 is in the embodiment of the present invention by corresponding second yuv data of the second region of variation information
Transcoding is corresponding RGB data, and the refinement flow diagram shown according to the RGB data is based on reality shown in Fig. 2
Mode is applied, step S30 includes:
Step S31 judges whether the second region of variation information supports hardware transcoding according to the hardware information that prestores；
Step S32 will be described by the way of hardware transcoding if the second region of variation Informational support hardware transcoding
The corresponding second yuv data transcoding of second region of variation information is corresponding RGB data；
Step S33 prestores hardware information according to and sentences if the second region of variation information does not support hardware transcoding
Whether the second region of variation information of breaking supports compilation transcoding；
Step S34, the transcoding if the second region of variation Informational support collects will be described by the way of the transcoding that collects
The corresponding second yuv data transcoding of second region of variation information is corresponding RGB data；
Step S35, if the second region of variation information does not support compilation transcoding, by institute by the way of software transcoding
Stating the corresponding second yuv data transcoding of the second region of variation information is corresponding RGB data.
In the present embodiment, when terminal receives the second region of variation information, and to second region of variation
When corresponding second yuv data of information carries out video code conversion, terminal can be according to the support of the hardware informations such as the CPU and GPU prestored
Situation graduation automatically selects hardware transcoding, compilation transcoding and software transcoding mode, can further improve to terminal hardware resource
Utilization rate.
Specifically, terminal can judge that described second becomes according to the support situation of the hardware informations such as the terminal CPU and GPU prestored
Change whether area information supports hardware to decode, if the second region of variation Informational support hardware transcoding, uses hardware transcoding
Mode by the corresponding second yuv data transcoding of the second region of variation information be corresponding RGB data；If described second becomes
Change area information and do not support hardware transcoding, then the hardware informations such as CPU and GPU for further prestoring according to judge described second
Whether region of variation information supports compilation transcoding；The transcoding if the second region of variation Informational support collects, is turned using compilation
The corresponding second yuv data transcoding of the second region of variation information is corresponding RGB data by the mode of code；If described second
Region of variation information does not support compilation transcoding, then by the second region of variation information corresponding the by the way of software transcoding
Two yuv data transcodings are corresponding RGB data.
Wherein, hardware transcoding is that transcoding operation is carried out by GPU, and compilation transcoding and software transcoding are to pass through software
Transcoding operation is carried out with CPU.In contrast, hardware transcoding faster than the speed of compilation transcoding and software transcoding, while will not
Occupy too many CPU and memory；And the transcoding that collects is higher compared to software transcoding efficiency.Therefore, the sequencing judged is first
Judge whether to support hardware transcoding, then judges whether to support compilation transcoding.
The present invention also proposes a kind of computer readable storage medium, is stored with terminal on the computer readable storage medium
It shows program, realizes that the terminal as described in any of the above item embodiment is shown when the display program of the terminal is executed by processor
The step of method.
The specific embodiment of computer readable storage medium of the present invention and the basic phase of each embodiment of above-mentioned displaying method of terminal
Together, therefore not to repeat here.
It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that the process, method, article or the system that include a series of elements not only include those elements, and
And further include other elements that are not explicitly listed, or further include for this process, method, article or system institute it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including being somebody's turn to do
There is also other identical elements in the process, method of element, article or system.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on this understanding, technical solution of the present invention substantially in other words does the prior art
The part contributed out can be embodied in the form of software products, which is stored in one as described above
In storage medium (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that terminal device (it can be mobile phone,
Computer, server, air conditioner or network equipment etc.) execute method described in each embodiment of the present invention.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of display methods of terminal, which is characterized in that the display methods of the terminal the following steps are included:
The real-time video frame data and the first region of variation information in the desktop that server is sent are received, and to the real-time video
Frame data are decoded, and obtain the first color coding yuv data；
First yuv data is divided into the video area of preset quantity by preset rules, and calculates institute using preset algorithm
State the second region of variation information that video area is intersected with the first region of variation information；
It is corresponding RGB data by the corresponding second yuv data transcoding of the second region of variation information, and according to the RGB
Data are shown.
2. the display methods of terminal as described in claim 1, which is characterized in that described to be carried out to the real-time video frame data
Decoding obtains the step of the first color encodes yuv data, comprising:
According to the format information of the real-time video frame data and prestore whether hardware information judges the real-time video frame data
Support hardware decoding；
If the real-time video frame data support hardware decoding, using the decoded mode of hardware to the real-time video frame data
It is decoded, obtains the first yuv data；
If the real-time video frame data do not support hardware to decode, using the decoded mode of software to the real-time video frame number
According to being decoded, the first yuv data is obtained.
3. the display methods of terminal as described in claim 1, which is characterized in that described press first yuv data is preset
Rule is divided into the video area of preset quantity, and calculates the video area and the first region of variation using preset algorithm
The step of second region of variation information of information intersection, comprising:
First yuv data is divided into the video area of preset quantity by preset rules；
One corresponding thread is created to each video area；
Second that the video area is intersected with the first region of variation information is calculated using the thread and preset algorithm
Region of variation information.
4. the display methods of terminal as described in claim 1, which is characterized in that described press first yuv data is preset
Rule is divided into the step of video area of preset quantity, comprising:
First yuv data is divided into the video area of preset quantity by the height or width of terminal display resolution.
5. the display methods of terminal as claimed in claim 2, which is characterized in that described by the second region of variation information pair
The step of the second yuv data transcoding answered is corresponding RGB data, comprising:
Judge whether the second region of variation information supports hardware transcoding according to the hardware information that prestores；
If the second region of variation Informational support hardware transcoding, by second region of variation by the way of hardware transcoding
The corresponding second yuv data transcoding of information is corresponding RGB data.
6. the display methods of terminal as claimed in claim 5, which is characterized in that described by the second region of variation information pair
The step of the second yuv data transcoding answered is corresponding RGB data, further includes:
If the second region of variation information does not support hardware transcoding, hardware information is prestored according to and judges that described second becomes
Change whether area information supports compilation transcoding；
The transcoding if the second region of variation Informational support collects, by second region of variation by the way of the transcoding that collects
The corresponding second yuv data transcoding of information is corresponding RGB data；
If the second region of variation information does not support compilation transcoding, by second variation zone by the way of software transcoding
The corresponding second yuv data transcoding of domain information is corresponding RGB data.
7. the display methods of terminal as described in claim 1, which is characterized in that described to receive in the desktop that server is sent
The step of real-time video frame data and the first region of variation information, comprising:
Receive the desktop that real-time video frame data and the server in the desktop that server is sent are grabbed by pre-set programs
In the first region of variation information.
8. the display methods of terminal as described in claim 1, which is characterized in that the first region of variation information, described
Two region of variation information and the video area include respectively indicate corresponding region of variation in the desktop it is upper, left,
The parameter of right, lower coordinate information.
9. a kind of display terminal, which is characterized in that the display terminal includes: memory, processor and is stored in the storage
On device and the display program of terminal that can run on the processor, the display program of the terminal are executed by the processor
The step of display methods of Shi Shixian terminal as claimed in any one of claims 1 to 8.
10. a kind of computer readable storage medium, which is characterized in that be stored with terminal on the computer readable storage medium
Show that program, the display program of the terminal realize terminal as claimed in any one of claims 1 to 8 when being executed by processor
The step of display methods.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710636716.4A CN109309867A (en) | 2017-07-28 | 2017-07-28 | Display methods, display terminal and the computer readable storage medium of terminal |
| PCT/CN2018/097487 WO2019020112A1 (en) | 2017-07-28 | 2018-07-27 | Terminal display method, terminal and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710636716.4A CN109309867A (en) | 2017-07-28 | 2017-07-28 | Display methods, display terminal and the computer readable storage medium of terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109309867A true CN109309867A (en) | 2019-02-05 |
Family
ID=65039409
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710636716.4A Withdrawn CN109309867A (en) | 2017-07-28 | 2017-07-28 | Display methods, display terminal and the computer readable storage medium of terminal |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109309867A (en) |
| WO (1) | WO2019020112A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113076050A (en) * | 2021-04-25 | 2021-07-06 | 深圳创维－Rgb电子有限公司 | Man-machine interaction method and device based on memory copy, television and storage medium |
| CN113099238A (en) * | 2021-06-09 | 2021-07-09 | 广州易方信息科技股份有限公司 | Decoding method for judging video played by android mobile phone |
| JP2022140375A (en) * | 2021-03-10 | 2022-09-26 | 深▲セン▼市絵王動漫科技有限公司 | Digital tablet device connected to cloud |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101977322A (en) * | 2010-11-10 | 2011-02-16 | 上海交通大学 | Screen coding system based on universal video coding standard |
| CN103281539A (en) * | 2013-06-07 | 2013-09-04 | 华为技术有限公司 | Method, device and terminal for image encoding and decoding processing |
| CN103391442A (en) * | 2013-07-24 | 2013-11-13 | 佳都新太科技股份有限公司 | Rapid video image transmission compression algorithm based on regional division and difference comparison |
| CN104253804A (en) * | 2013-06-28 | 2014-12-31 | 广州华多网络科技有限公司 | Method and device for transmitting image data |
| WO2015100573A1 (en) * | 2013-12-31 | 2015-07-09 | 华为终端有限公司 | Display refreshing method and terminal |
| CN104980788A (en) * | 2015-02-11 | 2015-10-14 | 腾讯科技（深圳）有限公司 | Video decoding method and device |
| CN105245914A (en) * | 2015-09-30 | 2016-01-13 | 上海有孚计算机网络有限公司 | Cloud desktop high-definition video transmission protocol and cloud desktop high-definition video transmission architecture |
| KR20160109805A (en) * | 2015-03-13 | 2016-09-21 | 엔트릭스 주식회사 | System for cloud streaming service, method of image cloud streaming service using split of changed image and apparatus for the same |
| JP2016192595A (en) * | 2015-03-30 | 2016-11-10 | ソニー株式会社 | Video transmitter, video receiver, video transmission method, and video transmission system |
| CN106713937A (en) * | 2016-12-30 | 2017-05-24 | 广州虎牙信息科技有限公司 | Video playing control method and device as well as terminal equipment |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103247283A (en) * | 2013-02-21 | 2013-08-14 | 北京君正集成电路股份有限公司 | Screen refreshing method and device |
-
2017
- 2017-07-28 CN CN201710636716.4A patent/CN109309867A/en not_active Withdrawn
-
2018
- 2018-07-27 WO PCT/CN2018/097487 patent/WO2019020112A1/en active Application Filing
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101977322A (en) * | 2010-11-10 | 2011-02-16 | 上海交通大学 | Screen coding system based on universal video coding standard |
| CN103281539A (en) * | 2013-06-07 | 2013-09-04 | 华为技术有限公司 | Method, device and terminal for image encoding and decoding processing |
| CN104253804A (en) * | 2013-06-28 | 2014-12-31 | 广州华多网络科技有限公司 | Method and device for transmitting image data |
| CN103391442A (en) * | 2013-07-24 | 2013-11-13 | 佳都新太科技股份有限公司 | Rapid video image transmission compression algorithm based on regional division and difference comparison |
| WO2015100573A1 (en) * | 2013-12-31 | 2015-07-09 | 华为终端有限公司 | Display refreshing method and terminal |
| CN104980788A (en) * | 2015-02-11 | 2015-10-14 | 腾讯科技（深圳）有限公司 | Video decoding method and device |
| KR20160109805A (en) * | 2015-03-13 | 2016-09-21 | 엔트릭스 주식회사 | System for cloud streaming service, method of image cloud streaming service using split of changed image and apparatus for the same |
| JP2016192595A (en) * | 2015-03-30 | 2016-11-10 | ソニー株式会社 | Video transmitter, video receiver, video transmission method, and video transmission system |
| CN105245914A (en) * | 2015-09-30 | 2016-01-13 | 上海有孚计算机网络有限公司 | Cloud desktop high-definition video transmission protocol and cloud desktop high-definition video transmission architecture |
| CN106713937A (en) * | 2016-12-30 | 2017-05-24 | 广州虎牙信息科技有限公司 | Video playing control method and device as well as terminal equipment |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2022140375A (en) * | 2021-03-10 | 2022-09-26 | 深▲セン▼市絵王動漫科技有限公司 | Digital tablet device connected to cloud |
| JP7371153B2 (en) | 2021-03-10 | 2023-10-30 | 深▲セン▼市絵王動漫科技有限公司 | Digital tablet device connected to the cloud |
| CN113076050A (en) * | 2021-04-25 | 2021-07-06 | 深圳创维－Rgb电子有限公司 | Man-machine interaction method and device based on memory copy, television and storage medium |
| CN113076050B (en) * | 2021-04-25 | 2022-05-20 | 深圳创维－Rgb电子有限公司 | Man-machine interaction method and device based on memory copy, television and storage medium |
| CN113099238A (en) * | 2021-06-09 | 2021-07-09 | 广州易方信息科技股份有限公司 | Decoding method for judging video played by android mobile phone |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019020112A1 (en) | 2019-01-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220284844A1 (en) | Dark mode display interface processing method, electronic device, and storage medium | |
| CN111225150B (en) | Method for processing interpolation frame and related product | |
| CN102810306B (en) | Method for automatically controlling brightness of display screen wallpaper | |
| US10419744B2 (en) | Techniques for user profiles for viewing devices | |
| CN109309867A (en) | Display methods, display terminal and the computer readable storage medium of terminal | |
| WO2020108091A1 (en) | Video processing method and apparatus, and electronic device and storage medium | |
| CN106023904A (en) | Display control method and device based on electronic ink screen | |
| CN112087648B (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| US20140258895A1 (en) | Method and device for processing image data | |
| WO2018205878A1 (en) | Method for transmitting video information, terminal, server and storage medium | |
| CN110660365A (en) | Regional backlight control method, display and storage medium | |
| US20220415236A1 (en) | Display control method, display control device and storage medium | |
| CN113645476B (en) | Picture processing method and device, electronic equipment and storage medium | |
| CN111128082A (en) | Backlight adjusting method, display and storage medium | |
| CN110858388B (en) | Method and device for enhancing video image quality | |
| TWI503677B (en) | An image processing apparatus, an image processing method, and a computer-readable recording medium on which an image processing program is recorded | |
| CN116761310A (en) | Lamp strip control method and device, storage medium and electronic device | |
| JPWO2007099944A1 (en) | Mobile phone terminal, screen display control method used therefor, and program thereof | |
| CN107291468B (en) | Method for playing power-on/power-off animation, terminal and computer readable storage medium | |
| US11962950B2 (en) | HDR film source playing method, device and storage medium | |
| CN114863432A (en) | Terminal device, contrast adjusting method, device and medium | |
| WO2021036551A1 (en) | Power consumption adjustment method and device, and computer-readable storage medium | |
| CN110941413B (en) | Display screen generation method and related device | |
| CN113393391A (en) | Image enhancement method, image enhancement device, electronic apparatus, and storage medium | |
| CN107256137B (en) | Picture processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20190205 |
|
| WW01 | Invention patent application withdrawn after publication |