WO2016154816A1 - 数据处理方法及装置 - Google Patents
数据处理方法及装置 Download PDFInfo
- Publication number
- WO2016154816A1 WO2016154816A1 PCT/CN2015/075290 CN2015075290W WO2016154816A1 WO 2016154816 A1 WO2016154816 A1 WO 2016154816A1 CN 2015075290 W CN2015075290 W CN 2015075290W WO 2016154816 A1 WO2016154816 A1 WO 2016154816A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image frame
- current image
- encoding
- display
- encoded
- Prior art date
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 12
- 230000003068 static effect Effects 0.000 claims abstract description 213
- 238000000034 method Methods 0.000 claims abstract description 34
- 230000009467 reduction Effects 0.000 claims description 72
- 230000000875 corresponding effect Effects 0.000 claims description 47
- 230000006835 compression Effects 0.000 claims description 34
- 238000007906 compression Methods 0.000 claims description 34
- 238000001514 detection method Methods 0.000 claims description 25
- 230000002596 correlated effect Effects 0.000 claims description 10
- 230000005540 biological transmission Effects 0.000 claims description 8
- 230000008859 change Effects 0.000 claims description 4
- 230000000694 effects Effects 0.000 abstract description 15
- 230000006870 function Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000000605 extraction Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000005312 nonlinear dynamic Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/124—Quantisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/154—Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
- H04N19/423—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements
- H04N19/426—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements using memory downsizing methods
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/10—Special adaptations of display systems for operation with variable images
- G09G2320/103—Detection of image changes, e.g. determination of an index representative of the image change
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/02—Handling of images in compressed format, e.g. JPEG, MPEG
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2350/00—Solving problems of bandwidth in display systems
Definitions
- the present invention relates to the field of data processing, and in particular, to a data processing method and apparatus.
- the multi-screen sharing display refers to a technique of simultaneously displaying an image frame in a display buffer of a first device in a second device.
- the image frame needs to be encoded before the first device shares the image frame.
- the first device predetermines a coding quality, where the coding quality is used to indicate that the encoded image frame is restored to a reduction level of the image frame before encoding, and the quality of the coding quality is positively correlated with the reduction level, that is, the higher the coding quality, the coding The larger the amount of data afterwards, the higher the reduction level of the encoded image frame to the image frame before encoding.
- the first device processes the image frame into I frame data or P frame data or B frame data according to the encoding quality and the importance degree of the image frame, and shares the encoded image frame to the second device for display.
- the I frame data is obtained by encoding a key frame in the image frame
- the P frame data is obtained by encoding a difference between the P frame data and an I frame data or P frame data before the P frame data
- the B frame data is obtained by encoding the difference between the B frame data and an I frame data or P frame data before the B frame data, and a P frame data subsequent to the B frame data.
- the image frame is an image frame generated by the dynamic display scene
- the difference between the image frames in the dynamic display scene is large. If the encoding quality determined at this time is too high, the encoded image frame is transmitted. The amount of data is large, and it takes more time to transmit the encoded image frame, thereby reducing the real-time performance of the shared display.
- the embodiment of the present invention provides a data processing method and apparatus.
- the technical solution is as follows:
- a data processing method comprising:
- the first device detects whether the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene, where the dynamic display scene is in a predetermined time period a display scene in which an internal image frame dynamically changes, the static display scene being a display scene in which an image frame remains unchanged during the predetermined time period;
- the current image frame is an image frame generated in a dynamic display scene
- the current image frame is encoded according to a first encoding quality, where the first encoding quality is used to indicate that the encoded image frame is restored to before encoding The first reduction level of the image frame;
- the current image frame is an image frame generated in a static display scene, encoding the current image frame according to a second encoding quality, where the second encoding quality is used to indicate that the encoded image frame is restored to be before encoding a second reduction level of the image frame; the second reduction level being higher than the first reduction level;
- the encoded current image frame is shared to a second device for display.
- the method further includes:
- the static display condition is that the current image frame displayed remains unchanged
- the current image frame that is encoded again is shared to the second device for display.
- the detecting, by the first device, whether the display of the current image frame meets a static display condition including:
- the pause instruction is for instructing the first device to stop updating the current image frame in the display buffer to a next image frame.
- the first device detects the display Whether the current image frame in the buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene, including:
- Determining an application that generates the current image frame detecting whether the application belongs to a dynamic program list or a static program list, and the dynamic program list includes an application that provides a dynamic display scene
- the static program list includes an application that provides a static display scenario
- the encoding interface invoked by the application that provides the current image frame, whether the current image frame is an image frame generated under a dynamic display scene or an image frame generated under a static display scene, and the encoding interface includes a first encoding An interface and a second encoding interface, the first encoding interface is configured to instruct to encode an image frame according to the first encoding quality, and the second encoding interface is configured to instruct to encode an image frame according to the second encoding quality ;or,
- the fourth possibility in the first aspect before the first device detects whether the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene, the first device further includes:
- the resolution of the second device is higher than the resolution of the first device, performing super-resolution processing on the current image frame.
- the method further includes:
- Adjusting, according to the quality of the network, the coding parameter corresponding to the first coding quality, or Adjusting, according to the quality of the network, the coding parameter corresponding to the second coding quality, the quality of the network is positively correlated with the data amount of the encoded current image frame, and the encoded current image frame is based on The encoding parameters are encoded.
- the second encoding quality is corresponding to the lossless compression mode
- the sharing the encoded current image frame to the second device for display includes:
- the lossy compressed data channel is used to transmit an image frame encoded by lossy compression
- the lossy compressed data channel is used to transmit an image frame obtained by encoding the lossy coding protocol.
- a data processing apparatus comprising:
- the image frame detecting module is configured to: the first device detects whether the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene, where the dynamic display scene is in a predetermined time period a display scene in which an internal image frame dynamically changes, the static display scene being a display scene in which an image frame remains unchanged during the predetermined time period;
- a first encoding module configured to: when the image frame detecting module detects that the current image frame is an image frame generated in a dynamic display scene, encoding the current image frame according to a first encoding quality, where An encoding quality is used to indicate that the encoded image frame is restored to a first reduction level of the image frame before encoding;
- a second encoding module configured to: when the image frame detecting module detects that the current image frame is an image frame generated in a static display scene, encode the current image frame according to a second encoding quality, where The second encoding quality is used to indicate that the encoded image frame is restored to a second reduction level of the image frame before encoding; the second reduction level is higher than the first reduction level;
- a first sharing module configured to share the current image frame encoded by the first encoding module or the second encoding module to a second device for display.
- the device further includes:
- a display detection module configured to: after the first sharing module shares the encoded current image frame to the second device for display, if the encoded current image frame is according to the first If the code quality is obtained by encoding the current image frame, detecting whether the display of the current image frame by the first device meets a static display condition, and the static display condition is that the current image frame displayed remains unchanged. ;
- a third encoding module configured to re-pair the current image frame according to the second encoding quality when the display detecting module detects that the display of the current image frame by the first device meets the static display condition Coding
- a second sharing module configured to share the current image frame that is encoded by the third encoding module to the second device for display.
- the display detection module is specifically configured to:
- the pause instruction is for instructing the first device to stop updating the current image frame in the display buffer to a next image frame.
- the image frame detection module Specifically used for:
- Determining an application that generates the current image frame detecting whether the application belongs to a dynamic program list or a static program list, the dynamic program list including an application that provides a dynamic display scene, the static program list including providing a static display scene Application; or,
- the encoding interface invoked by the application that provides the current image frame, whether the current image frame is an image frame generated under a dynamic display scene or an image frame generated under a static display scene, and the encoding interface includes a first encoding An interface and a second encoding interface, the first encoding interface is configured to instruct to encode an image frame according to the first encoding quality, and the second encoding interface is configured to instruct to encode an image frame according to the second encoding quality ;or,
- the device further includes:
- An image frame processing module configured to: before the image frame detection module detects whether the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene, acquiring the second device The resolution of the second device is super-resolution processed if the resolution of the second device is higher than the resolution of the first device.
- the device further includes:
- a network quality obtaining module configured to acquire a quality of a network to which the encoded current image frame is to be transmitted
- a parameter adjustment module configured to adjust an encoding parameter corresponding to the first encoding quality according to the quality of the network acquired by the network quality obtaining module, or adjust the second encoding quality according to a quality of the network
- the quality of the network is positively correlated with the encoded data volume of the current image frame, and the encoded current image frame is encoded according to the coding parameters.
- the second coding quality is corresponding to the lossless compression mode
- the first sharing module is specifically configured to:
- the lossy compressed data channel is used to transmit an image frame encoded by lossy compression
- the frame sharing is performed by the second device, where the lossy encoding protocol includes an encoding protocol corresponding to the lossless compression mode, and the lossy compressed data channel is used for transmission through the lossy encoding protocol.
- the resulting image frame is performed by the second device, where the lossy encoding protocol includes an encoding protocol corresponding to the lossless compression mode, and the lossy compressed data channel is used for transmission through the lossy encoding protocol.
- a data processing apparatus comprising: a bus, and a processor, a memory, a transmitter, and a receiver coupled to the bus.
- the memory is for storing a plurality of instructions, the instructions being configured to be executed by the processor;
- the processor is configured to detect whether the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene, where the dynamic display scene is an image frame within a predetermined time period a dynamically changing display scene, the static display scene being a display scene in which the image frame remains unchanged during the predetermined time period;
- the processor is further configured to: when the current image frame is an image frame generated in a dynamic display scenario, encode the current image frame according to a first coding quality, where the first coding quality is used to indicate coding The subsequent image frame is restored to the first reduction level of the image frame before encoding;
- the processor is further configured to: when the current image frame is an image frame generated in a static display scenario, encode the current image frame according to a second encoding quality, where the second encoding quality is used to indicate encoding The subsequent image frame is restored to a second reduction level of the image frame before encoding; the second reduction level is higher than the first reduction level;
- the transmitter is configured to share the current image frame encoded by the processor to a second device for display.
- the processor is further configured to: after the transmitter shares the encoded current image frame to the second device for display, if the encoded current image frame is according to the first encoding quality pair If the current image frame is encoded, it is detected whether the display of the current image frame by the first device satisfies a static display condition, and the static display condition is that the current image frame displayed remains unchanged;
- the processor is further configured to: when the display of the current image frame by the first device meets the static display condition, re-encode the current image frame according to the second encoding quality;
- the transmitter is further configured to share the current image frame that is encoded by the processor to the second device for display.
- the processor is specifically configured to:
- the pause instruction is for instructing the first device to stop updating the current image frame in the display buffer to a next image frame.
- the processor is specifically used to:
- Determining an application that generates the current image frame detecting whether the application belongs to a dynamic program list or a static program list, the dynamic program list including an application that provides a dynamic display scene, the static program list including providing a static display scene Application; or,
- the encoding interface invoked by the application that provides the current image frame, whether the current image frame is an image frame generated under a dynamic display scene or an image frame generated under a static display scene, and the encoding interface includes a first encoding An interface and a second encoding interface, the first encoding interface is configured to instruct to encode an image frame according to the first encoding quality, and the second encoding interface is configured to instruct to encode an image frame according to the second encoding quality ;or,
- the processor is further configured to: before detecting whether the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene, obtain a resolution of the second device; The resolution of the second device is higher than the resolution of the first device, and the current image frame is subjected to super-resolution processing.
- the processor is further configured to acquire a quality of a network that is to transmit the encoded current image frame
- the processor is further configured to: adjust an encoding parameter corresponding to the first encoding quality according to a quality of the network, or adjust an encoding parameter corresponding to the second encoding quality according to a quality of the network, where The quality of the network is positively correlated with the amount of data of the encoded current image frame, and the encoded current image frame is encoded according to the encoding parameter.
- the second coding quality corresponds to a lossless compression mode
- the transmitter is specifically configured to:
- the lossy compressed data channel is used to transmit an image frame encoded by lossy compression
- the lossy compressed data channel is used to transmit an image frame obtained by encoding the lossy coding protocol.
- the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene; if the current image frame is an image frame generated under a dynamic display scene, according to the first The encoding quality encodes the current image frame, and the first encoding quality is used to indicate that the encoded image frame is restored to the first restored level of the image frame before encoding; if the current image frame is an image frame generated in the static display scene, And encoding the current image frame according to the second encoding quality, where the second encoding quality is used to indicate that the encoded image frame is restored to a second reduction level of the image frame before encoding; the second restoration level is higher than the first reduction level; The current image frame is dynamically displayed in the scene.
- the current image frame is encoded by using the first coding quality, because the first reduction level indicated by the first coding quality is lower than the second reduction level indicated by the second coding quality,
- the current image frame has a small amount of data, which solves the problem that the image frame generated in the dynamic display scene has a large difference and the restoration level indicated by the encoding quality is too high, thereby reducing the real-time performance of the shared display, and improving the shared display.
- the real-time effect is provided.
- FIG. 1 is a flowchart of a method for processing a data according to an embodiment of the present invention
- FIG. 3 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present invention.
- FIG. 4 is a schematic structural diagram of still another data processing apparatus according to an embodiment of the present invention.
- FIG. 5 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present invention.
- the data processing method may include:
- Step 101 The first device detects whether the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene, and the dynamic display scene is dynamically changed in a predetermined time period.
- the scene is displayed, and the static display scene is a display scene in which the image frame remains unchanged for a predetermined period of time.
- Step 102 If the current image frame is an image frame generated in a dynamic display scene, the current image frame is encoded according to the first encoding quality, where the first encoding quality is used to indicate that the encoded image frame is restored to the image frame before encoding. The first level of reduction.
- Step 103 If the current image frame is an image frame generated in a static display scene, according to the second The encoding quality encodes the current image frame, and the second encoding quality is used to indicate that the encoded image frame is restored to the second reduction level of the image frame before encoding; the second restoration level is higher than the first reduction level.
- Step 104 Share the encoded current image frame to the second device for display.
- the data processing method detects whether the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene; Is the image frame generated in the dynamic display scene, and the current image frame is encoded according to the first encoding quality, where the first encoding quality is used to indicate that the encoded image frame is restored to the first restoration level of the image frame before encoding;
- the current image frame is an image frame generated in a static display scene, and the current image frame is encoded according to the second encoding quality, and the second encoding quality is used to indicate that the encoded image frame is restored to the second restoration of the image frame before encoding.
- the current image frame may be encoded with the first coding quality when the current image frame is an image frame generated by the dynamic display scene, due to the first coding quality
- the first restored level of the indication is lower than the second restored level indicated by the second encoding quality, and thus the encoded current image frame
- the data processing method may include:
- Step 201 The first device detects whether the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene, and the dynamic display scene is dynamically changed in a predetermined time period.
- the scene is displayed, and the static display scene is a display scene in which the image frame remains unchanged for a predetermined period of time.
- the display buffer is a buffer for storing image frames that the first device is displaying.
- the current image frame may be a screenshot of a file being displayed by the first device.
- the file can be text, images, web pages, slides, desktops, videos, games, and the like.
- the display buffer can buffer 3 image frames, and the buffer duration of the image frames in the display buffer is related to the type of the display buffer and the type of the file.
- the type of the display buffer includes a fixed type and a refresh type, and the difference is that when the first device continuously displays a picture, the image frame buffered in the fixed type display buffer does not change, that is, the first device displays the same.
- the image frame is continuously cached in the display buffer; the image frames buffered in the refresh type display buffer are periodically refreshed to the same image.
- the image frame that is, the image frame displayed by the first device is periodically refreshed to the next identical image frame.
- the video is a video and the video displays 25 image frames in 1 second as an example.
- the buffer time of each image frame in the display buffer is 25/. 60 seconds; when the first device pauses to play the video, the image frame displayed when the first device is paused has a buffer duration in the fixed type of display buffer equal to the pause duration, and each identical image frame displayed when the first device is paused is
- the cache time in the display buffer of the refresh type is 25/60 seconds.
- the dynamic display scene refers to a display scene in which an image frame dynamically changes during a predetermined time period, for example, turning a page text within a predetermined time period, turning a page slide within a predetermined time period, refreshing a web page within a predetermined time period, at a predetermined time
- the video is played in the segment, the game screen is refreshed within a predetermined time period, the desktop icon is refreshed within a predetermined time period, the desktop button is refreshed within a predetermined time period, and the like.
- the static display scene refers to a display scene in which the image frame remains unchanged for a predetermined period of time, for example, displaying a picture within a predetermined time period, displaying a web page within a predetermined time period, and the like.
- the predetermined time period may be an empirical value set by the user, or may be other values, which is not limited in this embodiment.
- the first device detects whether the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene, including:
- the dynamic interface list includes the control interface that is called in the dynamic display scenario.
- the static interface list is included in the static display scenario. The control interface that is called; or,
- the encoding interface invoked by the application that provides the current image frame, whether the current image frame is an image frame generated under a dynamic display scene or an image frame generated under a static display scene, and the encoding interface includes a first encoding interface and a second An encoding interface, the first encoding interface is configured to instruct to encode the image frame according to the first encoding quality, and the second encoding interface is configured to instruct to encode the image frame according to the second encoding quality; or
- a frame is an image frame produced in a static display scene.
- the user can pre-set the dynamic program list and the static program list, and then add the application to the corresponding list according to the functions implemented by the application.
- the dynamic program list includes an application that provides a dynamic display scenario
- the static program list includes an application that provides a static display scenario.
- a player is used to play a video
- a play video is a dynamic display scene
- the player can be added to the dynamic program list.
- the game is a dynamic display scene, and the game program can be added to the dynamic program list.
- the dynamic program list and the static program list may be manually classified by the user, or the program type corresponding to the dynamic program list and the static program list may be preset, and the application belonging to a certain type is automatically added. Go to the corresponding list.
- the program type can be set by the developer, or it can be set by the app store, or it can be set manually by the user.
- Program types can include text, image, and video.
- Applications such as readers and text editors can be text-based; applications such as image viewing and image editing can be image-based; players, games, and the like.
- the app can be of video type. Assuming that the video type corresponds to a dynamic program list, applications such as players and games can be automatically added to the dynamic program list.
- the first device may determine an application that generates the current image frame, and if the application belongs to the dynamic program list, determine that the current image frame is an image generated in the dynamic display scene. Frame; if the application belongs to a static program list, it is determined that the current image frame is an image frame generated under a static display scene.
- the first device may detect whether each current image frame is an image frame generated in a dynamic display scene or an image frame generated in a static display scene. Since the detection of each current image frame requires more processing resources, the first device can also dynamically image the image frame generated in the image frame sequence generated by an application. The image frame generated in the display scene is detected. If the image frame is an image frame generated in a dynamic display scene, each image frame in the image frame sequence is determined as an image frame generated in the dynamic display scene. If the image frame is an image frame generated in a static display scene, each image frame in the image frame sequence is determined as an image frame generated in a static display scene.
- the user may preset a dynamic interface list and a static interface list, where the dynamic interface list includes a control interface that is called in a dynamic display scenario, and the static interface list is included in Statically displays the control interface that is called in the scene.
- the dynamic interface list includes a control interface that is called in a dynamic display scenario
- the static interface list is included in Statically displays the control interface that is called in the scene.
- a control interface invoked when the system of the first device is animated and the animation is in the foreground display state can be added to the dynamic interface list.
- the system can monitor the creation and end of the animation.
- the first device can detect whether the control interface belongs to the dynamic interface list or the static interface list. If the control interface belongs to the dynamic interface list, determine that the current image frame is a dynamic display scenario. The generated image frame; if the control interface belongs to the static interface list, it is determined that the current image frame is an image frame generated in a static display scene.
- an encoding interface may be newly added in the system, the encoding interface includes a first encoding interface for indicating that the image frame is encoded according to the first encoding amount, and for indicating the quality according to the second encoding.
- a second encoding interface that encodes an image frame.
- the application When the application invokes the encoding interface to encode the current image frame, it may determine whether the current image frame is an image frame generated under a dynamic display scene or an image frame generated under a static display scene according to an encoding interface invoked by the application. Specifically, when the application invokes the first encoding interface to encode the current image frame, determining that the current image frame is an image frame generated in a dynamic display scene; when the application calls the second encoding interface to encode the current image frame And determining that the current image frame is an image frame generated in a static display scene.
- all the image data included in the current image frame in the display buffer and the image frame adjacent to the current image frame may be acquired, and all image data is detected to be the same. If all the image data are different, Then determining that the current image frame is an image frame generated in a dynamic display scene; if all the image data are the same, determining that the current image frame is an image frame generated in a static display scene.
- the image data is a set obtained by expressing the gradation value of each pixel in the image frame by a numerical value.
- the first device compares the current image frame with the image frame adjacent to the current image frame. Since the image data contains a large amount of data, comparing all the image data requires more processing resources, and therefore, the image can also be The frame is subjected to feature extraction, and according to the obtained image feature, whether the current image frame is an image frame generated under a dynamic display scene or an image frame generated under a static display scene is detected. Since the amount of data of the image features is small, processing resources can be saved.
- the image feature may be part of the image data in the image frame, or may be summary information generated by using a specific algorithm for the image frame, or may be other information. The image feature is not limited in this embodiment.
- an algorithm for feature extraction may be determined in advance, and an image frame adjacent to the current image frame in the display buffer is acquired, and the current image frame and the adjacent image are respectively respectively according to the algorithm.
- Feature extraction is performed for each image frame in the frame to obtain two image features of the same kind, and whether the two image features are the same. If the two image features are different, it is determined that the current image frame is generated under the dynamic display scene. Image frame; if the two image features are the same, it is determined that the current image frame is an image frame generated under a static display scene.
- the image frame generated by the current image frame in the dynamic display scene or the image frame generated in the static display scene may be detected by other methods, which is not limited in this embodiment.
- the first device may further provide an option for the user to select a dynamic display scene and a static display scene.
- determining that the current image frame is an image frame generated in the dynamic display scene determining that the current image frame is an image frame generated in the dynamic display scene.
- the user selects an option to statically display the scene it is determined that the current image frame is an image frame generated under the static display scene.
- the method before the first device detects whether the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene, the method further includes: acquiring a resolution of the second device; If the resolution of the second device is higher than the resolution of the first device, the current image frame is subjected to super-resolution processing.
- the resolution of the second device may be sent to the first device after the connection is established with the first device, or the resolution of the second device may be set by the user in the first device.
- the example does not limit the manner in which the resolution of the second device is acquired.
- the super-resolution processing may be a processing performed by a nonlinear dynamic stretching or other super-resolution algorithm, and the processing procedure is already very mature, and is not described in this embodiment.
- the processing capability of the first device is stronger than the processing capability of the second device, so that the super-resolution processing of the current image frame by the first device, rather than the super-resolution processing of the current image frame by the second device, can be improved.
- the processing efficiency of the current image frame is assumed that the processing capability of the first device is stronger than the processing capability of the second device, so that the super-resolution processing of the current image frame by the first device, rather than the super-resolution processing of the current image frame by the second device, can be improved.
- Step 202 If the current image frame is an image frame generated in a dynamic display scene, the current image frame is encoded according to the first encoding quality, where the first encoding quality is used to indicate that the encoded image frame is restored to the image frame before encoding. The first level of reduction.
- the first electronic device may encode the current image frame with a poor first encoding quality, and reduce the data amount of the current image frame by the first encoding quality, thereby improving the real-time performance of the current image frame display.
- the first encoding quality is used to indicate that the encoded image frame is restored to a first restoration level of the image frame before encoding.
- the level of reduction usually refers to between the restored image frame and the image frame before restoration. Similarity.
- the embodiment further provides a third encoding quality, where the third encoding quality is used to indicate that the encoded image frame is restored to a third restoration level of the image frame before encoding, and the second restoration level is higher than the third.
- the reduction level, the third reduction level is higher than the first reduction level.
- the current image frame is an interactive dynamic display scene such as a slide show, a text page turn, or a web page update
- the current image frame may be encoded according to the first encoding quality
- the current image frame is a dynamic display scene such as a video or an animation
- the current image frame can be encoded according to the third encoding quality.
- Step 203 If the current image frame is an image frame generated in a static display scene, the current image frame is encoded according to the second encoding quality, and the second encoding quality is used to indicate that the encoded image frame is restored to the image frame before encoding. a second reduction level; the second reduction level is higher than the first reduction level.
- the first electronic device may encode the current image frame with a better second encoding quality, and increase the data amount of the current image frame by using the second encoding quality, thereby improving the display effect on the current image frame.
- Step 204 Share the encoded current image frame to the second device for display.
- the first electronic device shares the encoded current image frame encoded by step 202 or step 203 to the second device, and the second device decodes and displays the encoded current image frame.
- the second encoding quality is corresponding to the lossless compression mode
- the encoded current image frame is shared to the second device for display, including:
- the lossy compressed data channel is used to transmit image frames encoded by lossy coding protocols.
- the present embodiment provides two methods for transmitting the lossless compressed data, as follows:
- a lossless compressed data channel can be added in the existing scenario where only the lossy compressed data channel exists, that is, mutually independent lossy compressed data channels and lossless compression are set.
- the data channel, the lossy compressed data channel is used to transmit the image frame encoded by the lossy coding protocol, and the lossless compressed data channel is used to transmit the lossless compressed data encoded by the lossless coding protocol.
- an encoding protocol corresponding to the lossless compression mode may be set, and the encoding protocol is used to instruct the first device to perform encoding by lossless compression, and then add the encoding protocol to the lossy encoding protocol. That is, the lossy coding protocol supports lossless frames in addition to I frames, P frames, and B frames obtained according to lossy compression, and lossless frames are image frames obtained by encoding image frames according to lossless compression. At this time, the lossy frame can be transmitted through a lossy compressed data channel corresponding to the lossy coding protocol.
- Step 205 If the encoded current image frame is obtained by encoding the image frame according to the first encoding quality, detecting whether the display of the current image frame by the first device satisfies a static display condition, and the static display condition is the current image frame displayed. constant.
- the encoded current image frame is obtained by encoding the image frame according to the first coding quality, the data size of the encoded current image frame is small, and the display effect is poor. If the user is interested in the encoded current image frame, it is necessary to improve the display effect on the encoded current image frame.
- whether the user is interested in the encoded current image frame can be embodied by detecting whether the display of the current image frame by the first device satisfies a static display condition, and the static display condition is that the current image frame displayed remains unchanged.
- detecting whether the display of the current image frame by the first device meets the static display condition includes:
- the pause instruction is for instructing the first device to stop updating the current image frame in the display buffer to the next image frame.
- the user can control the length of time during which the current image frame is displayed.
- the first device may detect whether the duration of displaying the current image frame is greater than a preset threshold, if the user is interested in an image frame, and the first device may display the current image frame. If the duration is greater than the preset threshold, it is determined that the user is interested in the current image frame, that is, the display of the current image frame by the first device satisfies the static display condition; if the duration of the current image frame is less than the preset threshold, the user is determined to The current image frame is not of interest, ie, the display of the current image frame by the first device does not satisfy the static display condition.
- the image frame is a slide show
- the user controls the first device to switch the currently displayed slide to the next slide by triggering a page turning instruction.
- the first device can receive the page turning command, Switching the previous slide to the current slide and starting timing. If the timing reaches the preset threshold and the page turning command is not received, the display of the slide by the first device satisfies the static display condition; if the timing does not reach the preset When the page turning instruction is received at the threshold, the display of the slide by the first device does not satisfy the static display condition.
- the first device switches the current image frame to the next image frame every predetermined time interval. Since the first device can control whether the image frame is displayed for a long time when the user is interested in an image frame, the first device can detect whether the pause command is received, and if the first device receives the pause command, determine the user pair.
- the current image frame is of interest, that is, the display of the current image frame by the first device satisfies the static display condition; if the first device does not receive the pause instruction, it is determined that the user is not interested in the current image frame, that is, the first device pair
- the display of the current image frame does not satisfy the static display condition.
- the image frame is a slide show, and the currently displayed slide is switched to the next slide every predetermined time interval.
- the first device may start timing after displaying the slideshow, and detect whether a pause command is received during the time interval. If the pause command is received within the time interval, the display of the slide by the first device satisfies the static display. Condition; if the pause command is not received within the time interval, the display of the slide by the first device does not satisfy the static display condition.
- Step 206 If the display of the current image frame by the first device satisfies the static display condition, the current image frame is re-encoded according to the second encoding quality.
- Step 207 Share the re-encoded current image frame to the second device for display.
- the first device may further encode the local content in the current image frame according to the second encoding quality, and then share the encoded partial content to the second device for display.
- the local content may be an animation embedded in a webpage, a change of an interface button, or the like.
- the first device Since the first device only updates the local content in the current image frame, instead of updating the entire current image frame, the time consumed by the encoding can be reduced, and the time consumed for transmitting the encoded data can be saved, and the real-time of the shared display is improved. Sex.
- the process of sharing the re-encoded current image frame to the second device may refer to the description in step 204, and details are not described herein.
- the data processing method provided in this embodiment further includes:
- the encoded current image frame is encoded according to the encoding parameters. Arrived.
- the first device may further adjust the coding parameter corresponding to the first coding quality according to the quality of the network, or adjust the coding parameter coding parameter corresponding to the second coding quality according to the quality of the network, so as to ensure the coding quality is not guaranteed. Adjust the amount of data of the current image frame on the premise of change. Among them, the technology for obtaining the quality of the network by the first device is very mature, and will not be described here.
- the highest quality lossy compression can be adjusted to lossless compression to improve the display effect; when the quality of the network is poor, the number of key frames can be reduced to reduce the amount of data and improve Share the real-time nature of the display.
- the data processing method detects whether the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene; Is the image frame generated in the dynamic display scene, and the current image frame is encoded according to the first encoding quality, where the first encoding quality is used to indicate that the encoded image frame is restored to the first restoration level of the image frame before encoding;
- the current image frame is an image frame generated in a static display scene, and the current image frame is encoded according to the second encoding quality, and the second encoding quality is used to indicate that the encoded image frame is restored to the second restoration of the image frame before encoding.
- the current image frame may be encoded with the first coding quality when the current image frame is an image frame generated by the dynamic display scene, due to the first coding quality
- the first restored level of the indication is lower than the second restored level indicated by the second encoding quality, and thus the encoded current image frame
- the current image frame is re-encoded according to the second encoding quality; and the re-encoded current image frame is shared to the second device for display,
- the second image quality is used to re-encode and share the current image frame to improve the display effect of the second device on the current image frame.
- FIG. 3 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present invention.
- the data processing device may include:
- the image frame detection module 301 is configured to detect, by the first device, whether the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene, and dynamically display
- the scene is a display scene in which the image frame dynamically changes within a predetermined time period
- the static display scene is a display scene in which the image frame remains unchanged within a predetermined period of time;
- the first encoding module 302 is configured to: when the image frame detecting module 301 detects that the current image frame is an image frame generated in a dynamic display scene, encode the current image frame according to the first encoding quality, where the first encoding quality is used to indicate The encoded image frame is restored to a first reduction level of the image frame before encoding;
- the second encoding module 303 is configured to: when the image frame detecting module 301 detects that the current image frame is an image frame generated in a static display scene, encode the current image frame according to the second encoding quality, where the second encoding quality is used to indicate The encoded image frame is restored to a second reduction level of the image frame before encoding; the second reduction level is higher than the first reduction level;
- the first sharing module 304 is configured to share the current image frame encoded by the first encoding module 302 or the second encoding module 303 to the second device for display.
- the data processing apparatus detects whether the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene; if the current image frame Is the image frame generated in the dynamic display scene, and the current image frame is encoded according to the first encoding quality, where the first encoding quality is used to indicate that the encoded image frame is restored to the first restoration level of the image frame before encoding;
- the current image frame is an image frame generated in a static display scene, and the current image frame is encoded according to the second encoding quality, and the second encoding quality is used to indicate that the encoded image frame is restored to the second restoration of the image frame before encoding.
- the current image frame may be encoded with the first coding quality when the current image frame is an image frame generated by the dynamic display scene, due to the first coding quality
- the indicated first reduction level is lower than the second reduction level indicated by the second coding quality, thus reducing the encoded current picture
- the amount of data in the frame is small, which solves the problem that the image frame generated in the dynamic display scene has a large difference and the restoration level indicated by the encoding quality is too high, thereby reducing the real-time performance of the shared display, and improving the real-time performance of the shared display. Effect.
- FIG. 4 is a schematic structural diagram of still another data processing apparatus according to an embodiment of the present invention.
- the data processing device may include:
- the image frame detection module 401 is configured to detect, by the first device, whether the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene, and the dynamic display scene is within a predetermined time period.
- a display scene in which the image frame dynamically changes, and the static display scene is a display scene in which the image frame remains unchanged within a predetermined period of time;
- the first encoding module 402 is configured to: when the image frame detecting module 401 detects that the current image frame is an image frame generated in a dynamic display scene, encode the current image frame according to the first encoding quality, where the first encoding quality is used to indicate The encoded image frame is restored to a first reduction level of the image frame before encoding;
- the second encoding module 403 is configured to: when the image frame detecting module 401 detects that the current image frame is an image frame generated in a static display scene, encode the current image frame according to the second encoding quality, where the second encoding quality is used to indicate The encoded image frame is restored to a second reduction level of the image frame before encoding; the second reduction level is higher than the first reduction level;
- the first sharing module 404 is configured to share the current image frame encoded by the first encoding module 402 or the second encoding module 403 to the second device for display.
- the device further includes:
- the display detection module 405 is configured to: after the first sharing module 404 shares the encoded current image frame to the second device for display, if the encoded current image frame is encoded according to the first encoding quality, the current image frame is obtained. , detecting whether the display of the current image frame by the first device satisfies the static display condition, and the static display condition is that the current image frame displayed remains unchanged;
- the third encoding module 406 is configured to re-code the current image frame according to the second encoding quality when the display detecting module 405 detects that the display of the current image frame by the first device meets the static display condition;
- the second sharing module 407 is configured to share the current image frame that is encoded by the third encoding module 406 to the second device for display.
- the display detection module 405 is specifically configured to:
- pause instruction is used to instruct the first device to stop updating the current image frame in the display buffer to the next image frame.
- the image frame detection module 401 is specifically configured to:
- Determining an application that generates a current image frame detecting whether the application belongs to a dynamic program list or a static program list, the dynamic program list includes an application that provides a dynamic display scene, and the static program list includes an application that provides a static display scene; or
- the dynamic interface list includes the control interface that is called in the dynamic display scenario.
- the static interface list is included in the static display scenario. Control interface; or,
- the encoding interface includes a first encoding interface and a second encoding interface, where the first encoding interface is used to indicate that the image frame is encoded according to the first encoding quality.
- a second encoding interface configured to indicate that the image frame is encoded according to the second encoding quality;
- the device further includes:
- the image frame processing module 408 is configured to: after the image frame detection module 401 detects whether the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene, obtain the resolution of the second device. Rate; if the resolution of the second device is higher than the resolution of the first device, the current image frame is subjected to super-resolution processing.
- the device further includes:
- a network quality obtaining module 409 configured to acquire a quality of a network that is to transmit the encoded current image frame
- the parameter adjustment module 410 is configured to adjust the coding parameter corresponding to the first coding quality according to the quality of the network acquired by the network quality acquisition module 409, or adjust the coding parameter corresponding to the second coding quality according to the quality of the network, and the quality of the network. It is positively correlated with the data amount of the encoded current image frame, and the encoded current image frame is encoded according to the encoding parameters.
- the second encoding quality corresponds to the lossless compression mode
- the first sharing module 404 is specifically configured to:
- a new lossless compressed data channel is newly created, and the encoded current image frame is shared by the lossless compressed data channel to the second device for display.
- the lossless compressed data channel and the lossy compressed data channel are independent of each other, and the lossy compressed data channel is used for transmission and loss.
- the encoded current image frame is shared to the second device for display by the lossy compressed data channel corresponding to the lossy coding protocol, and the lossy coding protocol includes a new and corresponding to the lossless compression mode.
- the data processing apparatus detects whether the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene; if the current image frame Is the image frame generated in the dynamic display scene, and the current image frame is encoded according to the first encoding quality, where the first encoding quality is used to indicate that the encoded image frame is restored to the first restoration level of the image frame before encoding;
- the current image frame is an image frame generated in a static display scene, and the current image frame is encoded according to the second encoding quality, and the second encoding quality is used to indicate that the encoded image frame is restored to the second restoration of the image frame before encoding.
- the current image frame may be encoded with the first coding quality when the current image frame is an image frame generated by the dynamic display scene, due to the first coding quality
- the first restored level of the indication is lower than the second restored level indicated by the second encoding quality, and thus the encoded current image frame
- the current image frame is re-encoded according to the second encoding quality; and the re-encoded current image frame is shared to the second device for display,
- the second image quality is used to re-encode and share the current image frame to improve the display effect of the second device on the current image frame.
- FIG. 5 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present invention.
- the data processing apparatus may include a bus 501, and a processor 502, a memory 503, a transmitter 504, and a receiver 505 connected to the bus 501.
- the memory 503 is configured to store a plurality of instructions, and the instructions are configured to be executed by the processor 502;
- the processor 502 is configured to detect whether the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene, and the dynamic display scene is dynamically changed in a predetermined time period.
- the processor 502 is further configured to: when the current image frame is an image frame generated by the dynamic display scene, encode the current image frame according to the first encoding quality, where the first encoding quality is used to indicate that the encoded image frame is restored to the encoded image frame.
- the processor 502 is further configured to: when the current image frame is an image frame generated in a static display scene, encode the current image frame according to the second encoding quality, where the second encoding quality is used to indicate that the encoded image frame is restored to the encoded image frame. a second reduction level of the previous image frame; the second reduction level is higher than the first reduction level;
- the transmitter 504 is configured to share the current image frame encoded by the processor 502 to the second device for display.
- the data processing apparatus detects whether the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene; if the current image frame Is the image frame generated in the dynamic display scene, and the current image frame is encoded according to the first encoding quality, where the first encoding quality is used to indicate that the encoded image frame is restored to the first restoration level of the image frame before encoding;
- the current image frame is an image frame generated in a static display scene, and the current image frame is encoded according to the second encoding quality, and the second encoding quality is used to indicate that the encoded image frame is restored to the second restoration of the image frame before encoding.
- the current image frame may be encoded with the first coding quality when the current image frame is an image frame generated by the dynamic display scene, due to the first coding quality
- the first restored level of the indication is lower than the second restored level indicated by the second encoding quality, and thus the encoded current image frame Small amount of data, the display image frame to solve dynamic scenario difference generated when the large and high quality coding level reduction, reducing the problem of real-time shared display achieve the effect of improving the real-time sharing display.
- the data processing apparatus may include a bus 501, and a processor 502, a memory 503, a transmitter 504, and a receiver 505 connected to the bus 501.
- the memory 503 is configured to store a plurality of instructions, and the instructions are configured to be executed by the processor 502;
- the processor 502 is configured to detect whether the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene, and the dynamic display scene is dynamically changed in a predetermined time period.
- the processor 502 is further configured to: when the current image frame is an image frame generated by the dynamic display scene, encode the current image frame according to the first encoding quality, where the first encoding quality is used to indicate that the encoded image frame is restored to the encoded image frame.
- the processor 502 is further configured to: when the current image frame is an image frame generated by the static display scene, And encoding the current image frame according to the second encoding quality, where the second encoding quality is used to indicate that the encoded image frame is restored to a second reduction level of the image frame before encoding; the second restoration level is higher than the first reduction level;
- the transmitter 504 is configured to share the current image frame encoded by the processor 502 to the second device for display.
- the processor 502 is further configured to: after the transmitter 504 shares the encoded current image frame to the second device for display, if the encoded current image frame is encoded according to the first encoding quality, the image frame is obtained. , detecting whether the display of the current image frame by the first device satisfies the static display condition, and the static display condition is that the current image frame displayed remains unchanged;
- the processor 502 is further configured to: when the display of the current image frame by the first device meets the static display condition, re-encode the current image frame according to the second encoding quality;
- the transmitter 504 is further configured to share the current image frame that is re-encoded by the processor 502 to the second device for display.
- the processor 502 is specifically configured to:
- pause instruction is used to instruct the first device to stop updating the image frame in the display buffer to the next image frame.
- the processor 502 is specifically configured to:
- Determining an application that generates a current image frame detecting whether the application belongs to a dynamic program list or a static program list, the dynamic program list includes an application that provides a dynamic display scene, and the static program list includes an application that provides a static display scene; or
- the dynamic interface list includes the control interface that is called in the dynamic display scenario.
- the static interface list is included in the static display scenario. Control interface; or,
- the encoding interface detects whether the current image frame is an image frame generated in a dynamic display scene or an image frame generated in a static display scene by using an encoding interface that is provided by an application that provides the current image frame, and the encoding interface includes a first encoding interface and a second encoding interface.
- the first encoding interface is configured to instruct to encode the image frame according to the first encoding quality
- the second encoding interface is configured to instruct to encode the image frame according to the second encoding quality
- the current image frame is an image frame generated in a dynamic display scene.
- the image features are the same, it is determined that the current image frame is an image frame generated under a static display scene.
- the processor 502 is further configured to: before detecting whether the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene, acquiring a resolution of the second device; If the resolution of the second device is higher than the resolution of the first device, the current image frame is subjected to super-resolution processing.
- the processor 502 is further configured to obtain a quality of a network that is to transmit the encoded current image frame.
- the processor 502 is further configured to: adjust, according to the quality of the network, the coding parameter corresponding to the first coding quality, or adjust the coding parameter corresponding to the second coding quality according to the quality of the network, the quality of the network, and the current image frame after the coding.
- the amount of data is positively correlated, and the encoded current image frame is encoded according to the encoding parameters.
- the second encoding quality corresponds to the lossless compression mode
- the transmitter 504 is specifically configured to:
- a new lossless compressed data channel is newly created, and the encoded current image frame is shared by the lossless compressed data channel to the second device for display.
- the lossless compressed data channel and the lossy compressed data channel are independent of each other, and the lossy compressed data channel is used for transmission and loss.
- the encoded current image frame is shared to the second device for display by the lossy compressed data channel corresponding to the lossy coding protocol, and the lossy coding protocol includes a new coding protocol corresponding to the lossless compression mode, and the lossy compression
- the data channel is used to transmit image frames encoded by lossy coding protocols.
- the data processing apparatus detects whether the current image frame in the display buffer is an image frame generated in a dynamic display scene or an image frame generated in a static display scene; if the current image frame Is the image frame generated in the dynamic display scene, and the current image frame is encoded according to the first encoding quality, where the first encoding quality is used to indicate that the encoded image frame is restored to the first restoration level of the image frame before encoding;
- the current image frame is an image frame generated in a static display scene, and the current image frame is encoded according to the second encoding quality, and the second encoding quality is used to indicate that the encoded image frame is restored to the second restoration of the image frame before encoding.
- the second reduction level is higher than the first reduction level; the first image can be used when the current image frame is an image frame generated by the dynamic display scene
- the code quality encodes the current image frame, since the first restoration level indicated by the first coding quality is lower than the second reduction level indicated by the second coding quality, the encoded current image frame has a smaller amount of data
- the current image frame is re-encoded according to the second encoding quality; and the re-encoded current image frame is shared to the second device for display,
- the second image quality is used to re-encode and share the current image frame to improve the display effect of the second device on the current image frame.
- the data processing apparatus provided by the foregoing embodiment is only exemplified by the division of each functional module, and in actual applications, the function allocation may be completed by different functional modules as needed.
- the internal structure of the data processing device is divided into different functional modules to perform all or part of the functions described above.
- the data processing apparatus and the data processing method embodiment provided by the foregoing embodiments are in the same concept, and the specific implementation process is described in detail in the method embodiment, and details are not described herein again.
- the disclosed systems, devices, and methods may be implemented in other manners.
- the device embodiments described above are merely illustrative.
- the division of the unit may be only a logical function division.
- there may be another division manner for example, multiple units or components may be combined. Or it can be integrated into another system, or some features can be ignored or not executed.
- Another point, the mutual coupling shown or discussed The direct or direct coupling or communication connection may be an indirect coupling or communication connection through some interface, device or unit, and may be in electrical, mechanical or other form.
- the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
- each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
- the functions may be stored in a computer readable storage medium if implemented in the form of a software functional unit and sold or used as a standalone product.
- the technical solution of the present invention which is essential or contributes to the prior art, or a part of the technical solution, may be embodied in the form of a software product, which is stored in a storage medium, including
- the instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
- the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes. .
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Compression Of Band Width Or Redundancy In Fax (AREA)
Abstract
Description
Claims (21)
- 一种数据处理方法,其特征在于,所述方法包括:第一设备检测显示缓冲区中的当前图像帧是动态显示场景下所产生的图像帧还是静态显示场景下所产生的图像帧,所述动态显示场景是在预定时间段内图像帧动态变化的显示场景,所述静态显示场景是在所述预定时间段内图像帧保持不变的显示场景;若所述当前图像帧是动态显示场景下所产生的图像帧,则根据第一编码质量对所述当前图像帧进行编码,所述第一编码质量用于指示编码后的图像帧还原为编码前的图像帧的第一还原水平;若所述当前图像帧是静态显示场景下所产生的图像帧,则根据第二编码质量对所述当前图像帧进行编码,所述第二编码质量用于指示编码后的图像帧还原为编码前的图像帧的第二还原水平;所述第二还原水平高于所述第一还原水平;将编码后的所述当前图像帧共享给第二设备进行显示。
- 根据权利要求1所述的方法,其特征在于,所述将编码后的所述当前图像帧共享给所述第二设备进行显示之后,还包括:若编码后的所述当前图像帧是根据所述第一编码质量对所述当前图像帧进行编码得到的,则检测所述第一设备对所述当前图像帧的显示是否满足静态显示条件,所述静态显示条件为显示的所述当前图像帧保持不变;若所述第一设备对所述当前图像帧的显示满足所述静态显示条件,则根据所述第二编码质量重新对所述当前图像帧进行编码;将再次编码后的所述当前图像帧共享给所述第二设备进行显示。
- 根据权利要求2所述的方法,其特征在于,所述检测所述第一设备对所述当前图像帧的显示是否满足静态显示条件,包括:获取所述第一设备显示所述当前图像帧的时长,检测所述时长是否大于预设阈值;或者,检测是否接收到暂停指令,所述暂停指令用于指示所述第一设备停止将所述显示缓冲区中的所述当前图像帧更新为下一个图像帧。
- 根据权利要求1至3任一项所述的方法,其特征在于,所述第一设备检测显示缓冲区中的当前图像帧是动态显示场景下所产生的图像帧还是静态显示场景下所产生的图像帧,包括:确定生成所述当前图像帧的应用程序,检测所述应用程序属于动态程序列表还是静态程序列表,所述动态程序列表包括提供动态显示场景的应用程序,所述静态程序列表包括提供静态显示场景的应用程序;或者,确定显示所述当前图像帧时调用的控件接口,检测所述控件接口属于动态接口列表还是静态接口列表,所述动态接口列表包括在动态显示场景下被调用的控件接口,所述静态接口列表包括在静态显示场景下被调用的控件接口;或者,通过提供所述当前图像帧的应用程序所调用的编码接口检测所述当前图像帧是动态显示场景下所产生的图像帧还是静态显示场景下所产生的图像帧,所述编码接口包括第一编码接口和第二编码接口,所述第一编码接口用于指示根据所述第一编码质量对图像帧进行编码,所述第二编码接口用于指示根据所述第二编码质量对图像帧进行编码;或者,获取所述显示缓冲区中与所述当前图像帧相邻的图像帧,检测所述当前图像帧和所述相邻的图像帧各自所包括的图像数据是否相同,当所述图像数据不同时,确定所述当前图像帧是动态显示场景下所产生的图像帧,当所述图像数据相同时,确定所述当前图像帧是静态显示场景下所产生的图像帧;或者,获取所述显示缓冲区中与所述当前图像帧相邻的图像帧,对所述当前图像帧和所述相邻的图像帧中的同一种图像特征进行提取,检测各自得到的所述图像特征是否相同,当所述图像特征不同时,确定所述当前图像帧是动态显示场景下所产生的图像帧,当所述图像特征相同时,确定所述当前图像帧是静态显示场景下所产生的图像帧。
- 根据权利要求1至4任一项所述的方法,其特征在于,所述第一设备检测显示缓冲区中的当前图像帧是动态显示场景下所产生的图像帧还是静态显示场景下所产生的图像帧之前,还包括:获取所述第二设备的分辨率;若所述第二设备的分辨率高于所述第一设备的分辨率,则对所述当前图像 帧进行超分辨率处理。
- 根据权利要求1至5任一项所述的方法,其特征在于,所述方法,还包括:获取将要传输编码后的所述当前图像帧的网络的质量;根据所述网络的质量调整所述第一编码质量所对应的编码参数,或者,根据所述网络的质量调整所述第二编码质量所对应的编码参数,所述网络的质量与编码后的所述当前图像帧的数据量呈正相关关系,编码后的所述当前图像帧是根据所述编码参数进行编码得到的。
- 根据权利要求1所述的方法,其特征在于,所述第二编码质量对应于无损压缩方式,所述将编码后的所述当前图像帧共享给第二设备进行显示,包括:新建无损压缩数据通道,通过所述无损压缩数据通道将编码后的所述当前图像帧共享给所述第二设备进行显示,所述无损压缩数据通道与有损压缩数据通道相互独立,所述有损压缩数据通道用于传输通过有损压缩方式编码得到的图像帧;或,通过与有损编码协议对应的有损压缩数据通道,将编码后的所述当前图像帧共享给所述第二设备进行显示,所述有损编码协议包括新增的且与所述无损压缩方式对应的编码协议,所述有损压缩数据通道用于传输通过所述有损编码协议编码得到的图像帧。
- 一种数据处理装置,其特征在于,所述装置包括:图像帧检测模块,用于第一设备检测显示缓冲区中的当前图像帧是动态显示场景下所产生的图像帧还是静态显示场景下所产生的图像帧,所述动态显示场景是在预定时间段内图像帧动态变化的显示场景,所述静态显示场景是在所述预定时间段内图像帧保持不变的显示场景;第一编码模块,用于在所述图像帧检测模块检测出所述当前图像帧是动态显示场景下所产生的图像帧时,根据第一编码质量对所述当前图像帧进行编码,所述第一编码质量用于指示编码后的图像帧还原为编码前的图像帧的第一还原水平;第二编码模块,用于在所述图像帧检测模块检测出所述当前图像帧是静态 显示场景下所产生的图像帧时,根据第二编码质量对所述当前图像帧进行编码,所述第二编码质量用于指示编码后的图像帧还原为编码前的图像帧的第二还原水平;所述第二还原水平高于所述第一还原水平;第一共享模块,用于将所述第一编码模块或所述第二编码模块编码后的所述当前图像帧共享给第二设备进行显示。
- 根据权利要求8所述的装置,其特征在于,所述装置,还包括:显示检测模块,用于在所述第一共享模块将编码后的所述当前图像帧共享给所述第二设备进行显示之后,若编码后的所述当前图像帧是根据所述第一编码质量对所述当前图像帧进行编码得到的,则检测所述第一设备对所述当前图像帧的显示是否满足静态显示条件,所述静态显示条件为显示的所述当前图像帧保持不变;第三编码模块,用于在所述显示检测模块检测出所述第一设备对所述当前图像帧的显示满足所述静态显示条件时,根据所述第二编码质量重新对所述当前图像帧进行编码;第二共享模块,用于将所述第三编码模块再次编码后的所述当前图像帧共享给所述第二设备进行显示。
- 根据权利要求9所述的装置,其特征在于,所述显示检测模块,具体用于:获取所述第一设备显示所述当前图像帧的时长,检测所述时长是否大于预设阈值;或者,检测是否接收到暂停指令,所述暂停指令用于指示所述第一设备停止将所述显示缓冲区中的所述当前图像帧更新为下一个图像帧。
- 根据权利要求8至10任一项所述的装置,其特征在于,所述图像帧检测模块,具体用于:确定生成所述当前图像帧的应用程序,检测所述应用程序属于动态程序列表还是静态程序列表,所述动态程序列表包括提供动态显示场景的应用程序,所述静态程序列表包括提供静态显示场景的应用程序;或者,确定显示所述当前图像帧时调用的控件接口,检测所述控件接口属于动态 接口列表还是静态接口列表,所述动态接口列表包括在动态显示场景下被调用的控件接口,所述静态接口列表包括在静态显示场景下被调用的控件接口;或者,通过提供所述当前图像帧的应用程序所调用的编码接口检测所述当前图像帧是动态显示场景下所产生的图像帧还是静态显示场景下所产生的图像帧,所述编码接口包括第一编码接口和第二编码接口,所述第一编码接口用于指示根据所述第一编码质量对图像帧进行编码,所述第二编码接口用于指示根据所述第二编码质量对图像帧进行编码;或者,获取所述显示缓冲区中与所述当前图像帧相邻的图像帧,检测所述当前图像帧和所述相邻的图像帧各自所包括的图像数据是否相同,当所述图像数据不同时,确定所述当前图像帧是动态显示场景下所产生的图像帧,当所述图像数据相同时,确定所述当前图像帧是静态显示场景下所产生的图像帧;或者,获取所述显示缓冲区中与所述当前图像帧相邻的图像帧,对所述当前图像帧和所述相邻的图像帧中的同一种图像特征进行提取,检测各自得到的所述图像特征是否相同,当所述图像特征不同时,确定所述当前图像帧是动态显示场景下所产生的图像帧,当所述图像特征相同时,确定所述当前图像帧是静态显示场景下所产生的图像帧。
- 根据权利要求8至11任一项所述的装置,其特征在于,所述装置,还包括:图像帧处理模块,用于所述图像帧检测模块检测显示缓冲区中的当前图像帧是动态显示场景下所产生的图像帧还是静态显示场景下所产生的图像帧之前,获取所述第二设备的分辨率;若所述第二设备的分辨率高于所述第一设备的分辨率,则对所述当前图像帧进行超分辨率处理。
- 根据权利要求8至12任一项所述的装置,其特征在于,所述装置,还包括:网络质量获取模块,用于获取将要传输编码后的所述当前图像帧的网络的质量;参数调整模块,用于根据所述网络质量获取模块获取到的所述网络的质量调整所述第一编码质量所对应的编码参数,或者,根据所述网络的质量调整所 述第二编码质量所对应的编码参数,所述网络的质量与编码后的所述当前图像帧的数据量呈正相关关系,编码后的所述当前图像帧是根据所述编码参数进行编码得到的。
- 根据权利要求8所述的装置,其特征在于,所述第二编码质量对应于无损压缩方式,所述第一共享模块,具体用于:新建无损压缩数据通道,通过所述无损压缩数据通道将编码后的所述当前图像帧共享给所述第二设备进行显示,所述无损压缩数据通道与有损压缩数据通道相互独立,所述有损压缩数据通道用于传输通过有损压缩方式编码得到的图像帧;或,通过与有损编码协议对应的有损压缩数据通道,将编码后的所述当前图像帧共享给所述第二设备进行显示,所述有损编码协议包括新增的且与所述无损压缩方式对应的编码协议,所述有损压缩数据通道用于传输通过所述有损编码协议编码得到的图像帧。
- 一种数据处理装置,其特征在于,所述装置包括:总线,以及连接到所述总线的处理器、存储器、发送器和接收器。其中,所述存储器用于存储若干个指令,所述指令被配置成由所述处理器执行;所述处理器,用于检测显示缓冲区中的当前图像帧是动态显示场景下所产生的图像帧还是静态显示场景下所产生的图像帧,所述动态显示场景是在预定时间段内图像帧动态变化的显示场景,所述静态显示场景是在所述预定时间段内图像帧保持不变的显示场景;所述处理器,还用于在所述当前图像帧是动态显示场景下所产生的图像帧时,根据第一编码质量对所述当前图像帧进行编码,所述第一编码质量用于指示编码后的图像帧还原为编码前的图像帧的第一还原水平;所述处理器,还用于在所述当前图像帧是静态显示场景下所产生的图像帧时,根据第二编码质量对所述当前图像帧进行编码,所述第二编码质量用于指示编码后的图像帧还原为编码前的图像帧的第二还原水平;所述第二还原水平高于所述第一还原水平;所述发送器,用于将所述处理器编码后的所述当前图像帧共享给第二设备进行显示。
- 根据权利要求15所述的装置,其特征在于,所述处理器,还用于所述发送器将编码后的所述当前图像帧共享给所述第二设备进行显示之后,若编码后的所述当前图像帧是根据所述第一编码质量对所述当前图像帧进行编码得到的,则检测所述第一设备对所述当前图像帧的显示是否满足静态显示条件,所述静态显示条件为显示的所述当前图像帧保持不变;所述处理器,还用于在所述第一设备对所述当前图像帧的显示满足所述静态显示条件时,根据所述第二编码质量重新对所述当前图像帧进行编码;所述发送器,还用于将所述处理器再次编码后的所述当前图像帧共享给所述第二设备进行显示。
- 根据权利要求16所述的装置,其特征在于,所述处理器,具体用于:获取所述第一设备显示所述当前图像帧的时长,检测所述时长是否大于预设阈值;或者,检测是否接收到暂停指令,所述暂停指令用于指示所述第一设备停止将所述显示缓冲区中的所述当前图像帧更新为下一个图像帧。
- 根据权利要求15至17任一项所述的装置,其特征在于,所述处理器,具体用于:确定生成所述当前图像帧的应用程序,检测所述应用程序属于动态程序列表还是静态程序列表,所述动态程序列表包括提供动态显示场景的应用程序,所述静态程序列表包括提供静态显示场景的应用程序;或者,确定显示所述当前图像帧时调用的控件接口,检测所述控件接口属于动态接口列表还是静态接口列表,所述动态接口列表包括在动态显示场景下被调用的控件接口,所述静态接口列表包括在静态显示场景下被调用的控件接口;或者,通过提供所述当前图像帧的应用程序所调用的编码接口检测所述当前图像帧是动态显示场景下所产生的图像帧还是静态显示场景下所产生的图像帧,所述编码接口包括第一编码接口和第二编码接口,所述第一编码接口用于指示根据所述第一编码质量对图像帧进行编码,所述第二编码接口用于指示根据所述 第二编码质量对图像帧进行编码;或者,获取所述显示缓冲区中与所述当前图像帧相邻的图像帧,检测所述当前图像帧和所述相邻的图像帧各自所包括的图像数据是否相同,当所述图像数据不同时,确定所述当前图像帧是动态显示场景下所产生的图像帧,当所述图像数据相同时,确定所述当前图像帧是静态显示场景下所产生的图像帧;或者,获取所述显示缓冲区中与所述当前图像帧相邻的图像帧,对所述当前图像帧和所述相邻的图像帧中的同一种图像特征进行提取,检测各自得到的所述图像特征是否相同,当所述图像特征不同时,确定所述当前图像帧是动态显示场景下所产生的图像帧,当所述图像特征相同时,确定所述当前图像帧是静态显示场景下所产生的图像帧。
- 根据权利要求15至18任一项所述的装置,其特征在于,所述处理器,还用于检测显示缓冲区中的当前图像帧是动态显示场景下所产生的图像帧还是静态显示场景下所产生的图像帧之前,获取所述第二设备的分辨率;若所述第二设备的分辨率高于所述第一设备的分辨率,则对所述当前图像帧进行超分辨率处理。
- 根据权利要求15至19任一项所述的装置,其特征在于,所述处理器,还用于获取将要传输编码后的所述当前图像帧的网络的质量;所述处理器,还用于根据所述网络的质量调整所述第一编码质量所对应的编码参数,或者,根据所述网络的质量调整所述第二编码质量所对应的编码参数,所述网络的质量与编码后的所述当前图像帧的数据量呈正相关关系,编码后的所述当前图像帧是根据所述编码参数进行编码得到的。
- 根据权利要求15所述的装置,其特征在于,所述第二编码质量对应于无损压缩方式,所述发送器,具体用于:新建无损压缩数据通道,通过所述无损压缩数据通道将编码后的所述当前图像帧共享给所述第二设备进行显示,所述无损压缩数据通道与有损压缩数据通道相互独立,所述有损压缩数据通道用于传输通过有损压缩方式编码得到的图像帧;或,通过与有损编码协议对应的有损压缩数据通道,将编码后的所述当前图像 帧共享给所述第二设备进行显示,所述有损编码协议包括新增的且与所述无损压缩方式对应的编码协议,所述有损压缩数据通道用于传输通过所述有损编码协议编码得到的图像帧。
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
RU2017135314A RU2662648C1 (ru) | 2015-03-27 | 2015-03-27 | Способ и устройство для обработки данных |
CN201580065215.4A CN107004018B (zh) | 2015-03-27 | 2015-03-27 | 数据处理方法及装置 |
PCT/CN2015/075290 WO2016154816A1 (zh) | 2015-03-27 | 2015-03-27 | 数据处理方法及装置 |
JP2017550612A JP6483850B2 (ja) | 2015-03-27 | 2015-03-27 | データ処理方法および装置 |
EP15886803.4A EP3264284B1 (en) | 2015-03-27 | 2015-03-27 | Data processing method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2015/075290 WO2016154816A1 (zh) | 2015-03-27 | 2015-03-27 | 数据处理方法及装置 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2016154816A1 true WO2016154816A1 (zh) | 2016-10-06 |
Family
ID=57006428
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2015/075290 WO2016154816A1 (zh) | 2015-03-27 | 2015-03-27 | 数据处理方法及装置 |
Country Status (5)
Country | Link |
---|---|
EP (1) | EP3264284B1 (zh) |
JP (1) | JP6483850B2 (zh) |
CN (1) | CN107004018B (zh) |
RU (1) | RU2662648C1 (zh) |
WO (1) | WO2016154816A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112764705A (zh) * | 2021-01-26 | 2021-05-07 | 重庆紫光华山智安科技有限公司 | 一种用户界面共享方法及电子设备 |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20190268601A1 (en) * | 2018-02-26 | 2019-08-29 | Microsoft Technology Licensing, Llc | Efficient streaming video for static video content |
CN112714273A (zh) | 2020-12-25 | 2021-04-27 | 北京字节跳动网络技术有限公司 | 屏幕共享显示方法、装置、设备及存储介质 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070064808A1 (en) * | 2005-09-22 | 2007-03-22 | Sanyo Electric Co., Ltd. | Coding device and coding method enable high-speed moving image coding |
CN101855911A (zh) * | 2007-09-28 | 2010-10-06 | 杜比实验室特许公司 | 处理视频信息 |
CN102546917A (zh) * | 2010-12-31 | 2012-07-04 | 联想移动通信科技有限公司 | 带摄像头的移动终端及其视频处理方法 |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5990955A (en) * | 1997-10-03 | 1999-11-23 | Innovacom Inc. | Dual encoding/compression method and system for picture quality/data density enhancement |
JP2003309841A (ja) * | 2002-02-12 | 2003-10-31 | Hitachi Kokusai Electric Inc | 動画像伝送装置 |
US8964830B2 (en) * | 2002-12-10 | 2015-02-24 | Ol2, Inc. | System and method for multi-stream video compression using multiple encoding formats |
CN100512488C (zh) * | 2005-03-24 | 2009-07-08 | 华为技术有限公司 | 无线局域网向呈现系统提供呈现信息的方法及系统 |
EP1837826A1 (en) * | 2006-03-20 | 2007-09-26 | Matsushita Electric Industrial Co., Ltd. | Image acquisition considering super-resolution post-interpolation |
WO2008137432A2 (en) * | 2007-05-01 | 2008-11-13 | Dyyno | Sharing of information and formatting information for transmission over a communication network |
US8687702B2 (en) * | 2008-10-27 | 2014-04-01 | Advanced Micro Devices, Inc. | Remote transmission and display of video data using standard H.264-based video codecs |
TWI401968B (zh) * | 2009-10-30 | 2013-07-11 | Awind Inc | 螢幕畫面之編碼方法及其應用之電子裝置 |
US9578336B2 (en) * | 2011-08-31 | 2017-02-21 | Texas Instruments Incorporated | Hybrid video and graphics system with automatic content detection process, and other circuits, processes, and systems |
US9277230B2 (en) * | 2011-11-23 | 2016-03-01 | Qualcomm Incorporated | Display mode-based video encoding in wireless display devices |
JP2014200076A (ja) * | 2013-03-15 | 2014-10-23 | 株式会社リコー | 配信制御システム、配信制御方法、及びプログラム |
WO2014157889A1 (en) * | 2013-03-25 | 2014-10-02 | Samsung Electronics Co., Ltd. | Method and apparatus for improving quality of experience in sharing screen among devices, and recording medium thereof |
US9325985B2 (en) * | 2013-05-28 | 2016-04-26 | Apple Inc. | Reference and non-reference video quality evaluation |
-
2015
- 2015-03-27 CN CN201580065215.4A patent/CN107004018B/zh active Active
- 2015-03-27 JP JP2017550612A patent/JP6483850B2/ja active Active
- 2015-03-27 RU RU2017135314A patent/RU2662648C1/ru active
- 2015-03-27 EP EP15886803.4A patent/EP3264284B1/en active Active
- 2015-03-27 WO PCT/CN2015/075290 patent/WO2016154816A1/zh active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070064808A1 (en) * | 2005-09-22 | 2007-03-22 | Sanyo Electric Co., Ltd. | Coding device and coding method enable high-speed moving image coding |
CN101855911A (zh) * | 2007-09-28 | 2010-10-06 | 杜比实验室特许公司 | 处理视频信息 |
CN102546917A (zh) * | 2010-12-31 | 2012-07-04 | 联想移动通信科技有限公司 | 带摄像头的移动终端及其视频处理方法 |
Non-Patent Citations (1)
Title |
---|
See also references of EP3264284A4 * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112764705A (zh) * | 2021-01-26 | 2021-05-07 | 重庆紫光华山智安科技有限公司 | 一种用户界面共享方法及电子设备 |
Also Published As
Publication number | Publication date |
---|---|
JP6483850B2 (ja) | 2019-03-13 |
EP3264284A1 (en) | 2018-01-03 |
EP3264284B1 (en) | 2021-09-15 |
RU2662648C1 (ru) | 2018-07-26 |
EP3264284A4 (en) | 2018-04-11 |
CN107004018B (zh) | 2020-11-17 |
CN107004018A (zh) | 2017-08-01 |
JP2018514133A (ja) | 2018-05-31 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
AU2010341605B2 (en) | Systems and methods for video-aware screen capture and compression | |
CN109104610B (zh) | 实时屏幕共享 | |
CN112087633B (zh) | 视频解码方法、装置及存储介质 | |
US11627369B2 (en) | Video enhancement control method, device, electronic device, and storage medium | |
CN109309842B (zh) | 直播数据处理方法和装置、计算机设备和存储介质 | |
US10645391B2 (en) | Graphical instruction data processing method and apparatus, and system | |
CN113825020B (zh) | 视频清晰度切换方法、装置、设备、存储介质及程序产品 | |
CN115089966B (zh) | 应用于云游戏的视频渲染方法、系统及相关设备 | |
CN113301355A (zh) | 视频传输、直播与播放方法、设备及存储介质 | |
CN111343503B (zh) | 视频的转码方法、装置、电子设备及存储介质 | |
WO2016154816A1 (zh) | 数据处理方法及装置 | |
CN110418209B (zh) | 一种应用于视频传输的信息处理方法及终端设备 | |
KR102273141B1 (ko) | 클라우드 스트리밍 서비스 시스템, 스틸 이미지 압축 기법을 이용한 클라우드 스트리밍 서비스 방법 및 이를 위한 장치 | |
CN109640094B (zh) | 视频解码方法、装置以及电子设备 | |
WO2020038071A1 (zh) | 视频增强控制方法、装置、电子设备及存储介质 | |
US20210400334A1 (en) | Method and apparatus for loop-playing video content | |
CN109379630B (zh) | 视频处理方法、装置、电子设备及存储介质 | |
CN112672147A (zh) | 一种基于投屏的解码方法、设备及系统 | |
KR20160131829A (ko) | 클라우드 스트리밍 서비스 시스템, 이미지 타입에 따른 알파 값을 이용한 이미지 클라우드 스트리밍 서비스 방법 및 이를 위한 장치 | |
US20220279190A1 (en) | Transmission apparatus, reception apparatus, transmission method,reception method, and program | |
KR20220144241A (ko) | 서버 및 그 제어 방법 | |
CN116582707A (zh) | 一种视频同步显示方法、装置、设备及介质 | |
CN117956226A (zh) | 云手机的视频解码方法和装置 | |
CN117221293A (zh) | 数据传输方法、装置、电子设备及存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15886803 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2017550612 Country of ref document: JP Kind code of ref document: A |
|
REEP | Request for entry into the european phase |
Ref document number: 2015886803 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2017135314 Country of ref document: RU |