WO2018205878A1 - 一种传输视频信息的方法、终端、服务器及存储介质 - Google Patents
一种传输视频信息的方法、终端、服务器及存储介质 Download PDFInfo
- Publication number
- WO2018205878A1 WO2018205878A1 PCT/CN2018/085445 CN2018085445W WO2018205878A1 WO 2018205878 A1 WO2018205878 A1 WO 2018205878A1 CN 2018085445 W CN2018085445 W CN 2018085445W WO 2018205878 A1 WO2018205878 A1 WO 2018205878A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- data
- alpha
- channel information
- yuv
- image
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 238000012545 processing Methods 0.000 claims abstract description 29
- 238000004590 computer program Methods 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 42
- 230000006870 function Effects 0.000 description 11
- 238000004891 communication Methods 0.000 description 9
- 230000005540 biological transmission Effects 0.000 description 6
- 230000006835 compression Effects 0.000 description 6
- 238000007906 compression Methods 0.000 description 6
- 238000002156 mixing Methods 0.000 description 6
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000011084 recovery Methods 0.000 description 3
- 238000007654 immersion Methods 0.000 description 2
- 230000006798 recombination Effects 0.000 description 2
- 238000005215 recombination Methods 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 241000699670 Mus sp. Species 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000003796 beauty Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 238000010079 rubber tapping Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003238 somatosensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/40—Network security protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/762—Media network packet handling at the source
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/764—Media network packet handling at the destination
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
Definitions
- the present application relates to the field of computers, and in particular, to a method, a terminal, a server, and a storage medium for transmitting video information.
- the terminal passes the color data acquired by the camera, and then performs RGBA transcoding and compression code processing, wherein RGBA stands for Red (Red), Green (Green), Blue (Blue), and Alpha. Color space.
- RGBA stands for Red (Red), Green (Green), Blue (Blue), and Alpha. Color space.
- the alpha alpha channel information will be discarded, only the RGB channel transcoding, compression code, and transcoding into YUV data.
- the YUV data is compressed for webcasting when the video is live. After the user receives the compressed file transmitted by the network, the data is decoded and transcoded, and only the RGB data is displayed for display.
- the background in the anchor image can only be displayed what is captured, and subsequent background culling, alpha blending, and template processing cannot be performed.
- the embodiment of the present application provides a method for transmitting video information, a terminal, a server, and a depositor medium, which are used to save Alpha channel information by adding and reorganizing Alpha channel information, and the data received by the server includes YUV channel data and an alpha channel.
- a first aspect of the embodiments of the present application provides a method for transmitting video data, which may include:
- the terminal acquires image data of the target object, where the image data includes RGB format data and alpha alpha channel information;
- the terminal encodes the RGB format data to obtain YUV channel data
- the terminal adds the alpha channel information to the YUV channel data to obtain encoded data.
- the terminal transmits the encoded data to a server for the server to decode and display an image of the target object.
- a second aspect of the embodiments of the present application provides a method for transmitting video data, which may include:
- the server receives the encoded data sent by the terminal, and the encoded data includes YUV channel data and alpha alpha channel information;
- the server decodes the YUV channel data to obtain RGB format data
- the server displays an image of the target object based on the RGB format data and the alpha channel information.
- a third aspect of the embodiments of the present application provides a terminal, which may include a processor and a memory, where the memory stores an instruction executable by the processor, when the instruction is executed, the processor is configured to:
- image data of a target object including RGB format data and alpha alpha channel information
- the encoded data is sent to a server for the server to decode and display an image of the target object.
- a fourth aspect of the embodiments of the present application provides a server, which may include a processor and a memory, where the memory stores instructions executable by the processor, and when executing the instruction, the processor is configured to:
- the encoded data including YUV channel data and alpha alpha channel information
- An image of the target object is displayed based on the RGB format data and the alpha channel information.
- a fifth aspect of the embodiments of the present application provides a non-volatile computer storage medium in which a computer program for executing the above method is stored.
- Figure 1 is a schematic view showing a target image
- FIG. 2 is a schematic structural diagram of an application according to an embodiment of the present application.
- FIG. 3 is a schematic diagram of an embodiment of a method for transmitting video information according to an embodiment of the present application
- FIG. 4 is a schematic diagram of a memory of YUV channel data in the embodiment of the present application.
- 4(A) is a schematic diagram of a memory for adding and recombining Alpha channel information at the upper end position of the YUV channel data in the embodiment of the present application;
- 4(B) is a schematic diagram of a memory for adding and recombining Alpha channel information at a lower end position of YUV channel data in the embodiment of the present application;
- 4(C) is a schematic diagram of a memory for adding and recombining Alpha channel information on the left side of the YUV channel data in the embodiment of the present application;
- 4(D) is a schematic diagram of a memory for adding and recombining Alpha channel information on the right side of the YUV channel data in the embodiment of the present application;
- FIG. 5(A) is a schematic diagram of an original image in an embodiment of the present application.
- FIG. 5(B) is a schematic diagram of the original image after RGB transcoding in the embodiment of the present application.
- FIG. 5(C) is a schematic diagram showing the addition of Alpha data at the upper end position of the YUV channel data in the embodiment of the present application.
- FIG. 5(D) is a schematic diagram showing the addition of Alpha data at the lower end position of the YUV channel data in the embodiment of the present application.
- FIG. 5(E) is a schematic diagram of adding Alpha data to the left side of the YUV channel data in the embodiment of the present application.
- FIG. 5(F) is a schematic diagram of adding Alpha data to the right side of the YUV channel data in the embodiment of the present application.
- FIG. 5(G) is a diagram showing an example of restoring an alpha channel information suffix in the embodiment of the present application.
- Figure 5 (H) is a schematic diagram showing the target image displayed on another terminal
- FIG. 5(I) is a schematic diagram showing the target image displayed on another terminal in the embodiment of the present application.
- FIG. 6 is a schematic diagram of an experience of an embodiment of the present application.
- FIG. 7 is a schematic diagram of a timing diagram of an embodiment of the present application.
- FIG. 8 is a schematic diagram of an embodiment of a terminal according to an embodiment of the present application.
- FIG. 9 is a schematic diagram of an embodiment of a server according to an embodiment of the present application.
- FIG. 10 is a schematic diagram of an embodiment of a terminal according to an embodiment of the present application.
- FIG. 11 is a schematic diagram of an embodiment of a server according to an embodiment of the present application.
- the embodiment of the present application provides a method, a terminal, and a server for transmitting video information, which are used for saving and transmitting Alpha channel information, and processing the RGB format data through the Alpha channel information, so that the background image of the displayed target image can be adjusted, so that The foreground image of the target image is better fitted to the entire background displayed by the display, and the user is also better immersed.
- Alpha channel is the gray channel in the color, which is used to record the transparency information in the image, that is, the alpha channel is an 8-bit gray channel, which uses 256 levels of gray to record the transparency in the image.
- Information defining transparent, opaque, and translucent areas, where black is transparent, white is opaque, and gray is translucent.
- QT QQTALK: referred to as QT, is a team voice communication tool that supports multi-person voice communication. It is mainly for game users who need team collaboration, and also for office and home users who need multi-person voice communication.
- the software is small, flexible, easy to use, and has excellent performance. It can be used with very small bandwidth and traverse the firewall to provide clear and high-quality voice services.
- YUV is a color coding method adopted by European television systems (Phase Alternation Line (PAL)), which is a PAL and sequential transmission color signal and memory recovery color signal system (Sequential Couleur Avec Memoire, SECAM) ) Simulates the color space used by color TV systems.
- PAL Phase Alternation Line
- SECAM sequential transmission color signal and memory recovery color signal system
- the image is usually taken by a three-tube color camera or a color CCD camera, and then the obtained color image signal is subjected to color separation, separately amplified and corrected to obtain RGB, and then subjected to a matrix conversion circuit to obtain a luminance signal Y and two.
- This representation of color is the so-called YUV color space representation.
- the importance of using the YUV color space is that its luminance signal Y and chrominance signals U, V are separated.
- RGBA is the color space representing Red (Green) Green (Blue) and Alpha.
- RGB color mode is a color standard in the industry. It is obtained by changing the three color channels of red (R), green (G), and blue (B) and superimposing them on each other.
- the color, RGB is the color of the three channels of red, green and blue. This standard includes almost all the colors that human vision can perceive. It is one of the most widely used color systems.
- the terminal obtains the color data acquired by the camera, and then performs RGBA transcoding and compression code processing, and the Alpha channel information is discarded in the process of processing, and only the RGB channel is performed.
- Transcoding, compression code, transcoding to YUV data The YUV data is compressed for webcasting when the video is live. After the user receives the compressed file transmitted by the network, the data is decoded and transcoded, and only the RGB data is displayed for display.
- RGBA is a color space representing Red (Red), Green (Green), Blue (Blue), and Alpha.
- the background in the anchor image can only be displayed what is captured, and subsequent background culling, alpha blending, and template processing cannot be performed.
- FIG. 1 in order to display a schematic diagram of the target image, it can be seen that the background of the beauty anchor in the picture is a pattern, which is not well fitted to the entire background displayed by the display, and the user feels like a gesture. It is quite awkward.
- FIG. 2 it is a schematic structural diagram applied to the embodiment of the present application.
- the camera of each player environment is connected to a personal computer (PC)/client, and the player's smart terminal is connected to the server through a network.
- PC personal computer
- the player's smart terminal is connected to the server through a network.
- the alpha channel information of each frame image does not need to be separate.
- the image is stored as a sequence of pictures or compressed into a single video; finally, the alpha channel information of each frame of the image can be directly obtained when each frame of image is decoded, without additional search and synchronization processing.
- FIG. 3 it is a schematic diagram of an embodiment of a method for transmitting video information in the embodiment of the present application, including:
- the terminal acquires image data of the target object, where the image data includes RGB format data and alpha alpha channel information;
- the terminal acquires image data of the target object, and the image data includes RGB format data and alpha alpha channel information.
- the player selects the room to start the game, and the terminal starts to initialize the camera; the terminal acquires the image data of the user, and the image data is RGBA format data, wherein RGBA represents Red (red), Green (green), Blue (blue) and alpha channel data.
- a camera is connected to the terminal, and the terminal can obtain image data of each player through the camera.
- the image data is RGBA format data
- the RGBA format data is actually RGB format data and alpha alpha channel information.
- the terminal here may be any terminal device such as a mobile phone, a tablet computer, a PDA (Personal Digital Assistant), a POS (Point of Sales), a car computer, or the like.
- the terminal performs encoding processing on the RGB format data to obtain YUV channel data.
- the terminal acquires image data of the target object, and after the image data includes the RGB format data and the alpha alpha channel information, the terminal performs encoding processing on the RGB format data to obtain YUV channel data.
- the terminal acquires the image data of the target object, and displays the target object according to the image data locally in the terminal.
- the RGB format data in the image data may be encoded, because the data provided by the camera is in the RGBA format, and the terminal pair Each data channel in this data is processed separately.
- the RGB channel image information terminal in RGBA will be transcoded into YUV format data such as NV21, NV12, and YUV420 according to the coding requirements.
- the terminal adds the Alpha channel information to the YUV channel data to obtain encoded data.
- the terminal performs encoding processing on the RGB format data, and after obtaining the YUV channel data, the terminal adds the Alpha channel information to the YUV channel data to obtain encoded data.
- the terminal can include, as follows:
- the terminal adds the Alpha channel information to the upper end position of the YUV channel data, so that the background image displayed on the server is displayed at the upper end position of the foreground image, wherein the background image corresponds to the Alpha channel information, and the foreground image corresponds to the YUV channel data.
- the terminal adds the Alpha channel information to the lower end position of the YUV channel data, so that the background image displayed on the server is displayed at the lower end position of the foreground image, wherein the background image corresponds to the Alpha channel information, and the foreground image corresponds to the YUV channel data.
- the terminal adds the Alpha channel information to the left side of the YUV channel data, so that the background image displayed on the server is displayed on the left side of the foreground image, wherein the background image corresponds to the Alpha channel information, and the foreground image and the YUV channel The data corresponds.
- the terminal adds the Alpha channel information to the right side of the YUV channel data, so that the background image displayed on the server is displayed on the right side of the foreground image, wherein the background image corresponds to the Alpha channel information, and the foreground image and the YUV channel The data corresponds.
- the Alpha channel information in RGBA the terminal will be added to the previous YUV channel data according to the previous transcoding format and the encoder format selection, wherein, as shown in FIG. 4, it is a memory schematic of the YUV channel data.
- FIG. 4 it is a memory schematic of the YUV channel data.
- FIG. 4(A) A memory map; as shown in Fig. 4(B), a memory map for adding the recombined Alpha channel information at the lower end of the YUV channel data; as shown in Fig. 4(C), on the left side of the YUV channel data.
- a memory map for adding the recombined Alpha channel information as shown in Fig. 4(D), a memory map for adding the recombined alpha channel information to the right side of the YUV channel data.
- the Alpha channel information may be divided into three parts, respectively added at the upper end position of the Y channel data, the upper end position of the U channel data and the upper end position of the V channel data; or, respectively, added at the lower end position of the Y channel data, The lower end position of the U channel data and the lower end position of the V channel data; or, respectively, added to the left side position of the Y channel data, the left side position of the U channel data, and the left side position of the V channel data; or, respectively, added to the Y channel The right side of the data, the right side of the U channel data, and the right side of the V channel data.
- FIG. 5(A) is a schematic diagram of the original image; first, the original image is transcoded by RGB, as shown in Fig. 5(B). As shown in the figure, a schematic diagram of the original image after RGB transcoding is performed; afterwards, the terminal can add the Alpha channel information to the transcoded image to complete the final YUV recombination, and the corresponding diagrams of the four data recombinations mentioned above are:
- FIG. 5(C) is a schematic diagram showing the addition of Alpha data at the upper end position of the YUV channel data; as shown in FIG.
- FIG. 5(D) a schematic diagram of adding Alpha data at the lower end position of the YUV channel data
- FIG. 5(E) is a schematic diagram showing the addition of Alpha data to the left side of the YUV channel data
- FIG. 5(F) a schematic diagram of adding Alpha data to the right side of the YUV channel data.
- the terminal obtains the YUV channel image data
- the subsequent conventional compression can be performed, but since the storage of the Alpha channel information causes the width and height of the YUV channel data to be correspondingly expanded, the corresponding parameters of the encoding are adjusted at this time. can.
- the terminal sends the encoded data to the server.
- step 304 may include step a and step b as follows:
- the terminal sends the encoded data to the server, and the encoded data is used by the server to decode and display an image of the target object.
- the server receives the encoded data sent by the terminal, and the encoded data includes YUV channel data and alpha alpha channel information.
- the server decodes the YUV channel data to obtain RGB format data.
- the server decodes the YUV channel data therein to obtain RGB format data.
- the server first decodes and transcodes the YUV channel data. After obtaining the encoded data, the server can extract the alpha channel information and then fill it into the transcoded RGB format data. At this point, the RGBA complete is completed.
- Recovery process an example of suffix recovery for Alpha channel information is shown in Figure 5(G).
- the server displays an image of the target object on the display according to the RGB format data and the alpha channel information.
- the server displays the image of the target object on the display according to the RGB format data and the alpha channel information.
- the display module may be configured to: fill the RGB format data according to the Alpha channel information, acquire display data, and display an image of the target object according to the display data.
- FIG. 5(H) A schematic diagram of the target image displayed on the display screen of another terminal is shown in FIG. 5(H), and after using the technical solution of the present application, a schematic diagram of the target image displayed is shown in FIG. 5(I).
- the prior art solution cannot save the alpha channel information, and the scheme can save the alpha channel information by adding and reorganizing the Alpha channel information, so that the transparency information corresponding to the color channel always exists in the process of suppressing the video transmission. It greatly preserves the complete information of the image source. Firstly, it can facilitate the subsequent processing of image decoding and playback, such as background culling, alpha blending and template processing. Secondly, the alpha of each frame image does not need to be stored separately into a sequence of images or suppressed. Into a single video; finally the alpha channel information of each frame of the image can be directly obtained when each frame of image is decoded, no additional search and synchronization processing is required.
- the terminal acquires image data of the target object, where the image data includes RGB format data and alpha alpha channel information; the terminal encodes the RGB format data to obtain YUV channel data; the terminal uses the alpha channel Information is added to the YUV channel data to obtain encoded data; the terminal transmits the encoded data to a server for decoding and displaying an image of the target object.
- the server receives the encoded data sent by the terminal, where the encoded data includes YUV channel data and alpha alpha channel information; the server decodes the YUV channel data to obtain RGB format data; the server displays the target according to the RGB format data and the alpha channel information The image of the object.
- the server receives the encoded data, can decode the YUV channel data to obtain the RGB format data, and then performs the image on the RGB format data through the alpha channel information.
- Background culling, Alpha blending, or template processing can adjust the background image of the target image so that the foreground image of the target image fits better on the entire background of the display, and the user has a better immersion.
- FIG. 6 which is a schematic diagram of the experience of the technical solution of the present application
- the basic experience flow of the technical solution of the present application is:
- start the game client ⁇ connect 3D somatosensory camera ⁇ character to calibrate ⁇ enter the game scene ⁇ store the alpha channel data of the local camera and then transcode the compression ⁇ send to the same game player ⁇ data decoding transcode ⁇ alpha channel data mixed display.
- the local player image in the above figure is directly acquired by the camera, and the image of the player on the network side is an image that is forwarded by the server for decoding and transcoding.
- Fig. 7 is a schematic diagram of a timing chart of an embodiment of the present application, it should be understood that the player image shown in Fig. 6 described above is combined.
- the leftmost person is used for description.
- the camera of the client corresponding to the leftmost character acquires the image data of the character, and performs image processing on the RGB format data in the image data of the character, specifically the client pair.
- the RGB format data is transcoded to obtain YUV channel data, and the alpha channel information is added to the YUV channel data to be sent to the game server.
- the data received by the game server includes YUV channel data and alpha channel information, decodes the YUV channel data, obtains RGB format data, and obtains alpha channel information, and the game server processes the RGB format data according to the alpha channel information to form a final
- the image is displayed on the client of the player who is playing.
- FIG. 8 it is a schematic diagram of an embodiment of the terminal in the embodiment of the present application, including:
- the obtaining module 801 is configured to acquire image data of the target object, where the image data includes RGB format data and alpha alpha channel information;
- the encoding module 802 is configured to perform encoding processing on the RGB format data to obtain YUV channel data.
- the adding module 803 is configured to add the Alpha channel information to the YUV channel data to obtain encoded data.
- the sending module 804 is configured to send the encoded data to the server, where the encoded data is used by the server to decode and display an image of the target object.
- the adding module 803 is specifically configured to add the alpha channel information to the upper end position of the YUV channel data, so that the background image displayed on the server is displayed at the upper end position of the foreground image, wherein the background image corresponds to the alpha channel information, and the foreground image and the YUV Channel data corresponds.
- the adding module 803 is specifically configured to add the alpha channel information to the lower end position of the YUV channel data, so that the background image displayed on the server is displayed at the lower end position of the foreground image, wherein the background image corresponds to the alpha channel information, and the foreground image and the YUV Channel data corresponds.
- the adding module 803 is specifically configured to add the alpha channel information to the left side of the YUV channel data, so that the background image displayed on the server is displayed on the left side of the foreground image, wherein the background image corresponds to the alpha channel information, and the foreground image Corresponds to the YUV channel data.
- the adding module 803 is specifically configured to add the alpha channel information to the right side of the YUV channel data, so that the background image displayed on the server is displayed on the right side of the foreground image, wherein the background image corresponds to the alpha channel information, and the foreground image Corresponds to the YUV channel data.
- FIG. 9 it is a schematic diagram of an embodiment of a server in the embodiment of the present application, including:
- the receiving module 901 is configured to receive encoded data sent by the terminal, where the encoded data includes YUV channel data and alpha alpha channel information.
- the decoding module 902 is configured to decode the YUV channel data to obtain RGB format data.
- the display module 903 is configured to display an image of the target object according to the RGB format data and the alpha channel information.
- the display module 903 is specifically configured to fill the RGB format data according to the Alpha channel information, obtain display data, and display an image of the target object according to the display data.
- FIG. 10 it is a schematic diagram of an embodiment of a terminal in the embodiment of the present application, including:
- the terminal is a mobile phone as an example, and only the part related to the embodiment of the present application is shown. If the specific technical details are not disclosed, please refer to the method part of the embodiment of the present application.
- FIG. 10 is a block diagram showing a partial structure of a mobile phone related to a terminal provided by an embodiment of the present application.
- the mobile phone includes: a radio frequency (RF) circuit 1010, a memory 1020, an input unit 1030, a display unit 1040, a sensor 1050, an audio circuit 1060, a wireless fidelity (WiFi) module 1070, and a processor 1080. And power supply 1090 and other components.
- RF radio frequency
- the RF circuit 1010 can be used for receiving and transmitting signals during the transmission or reception of information or during a call. Specifically, after receiving the downlink information of the base station, it is processed by the processor 1080; in addition, the uplink data is designed to be sent to the base station.
- RF circuit 1010 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like.
- LNA Low Noise Amplifier
- RF circuit 1010 can also communicate with the network and other devices via wireless communication.
- the above wireless communication may use any communication standard or protocol, including but not limited to Global System of Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (Code Division). Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), E-mail, Short Messaging Service (SMS), and the like.
- GSM Global System of Mobile communication
- the memory 1020 can be used to store software programs and modules, and the processor 1080 executes various functional applications and data processing of the mobile phone by running software programs and modules stored in the memory 1020.
- the memory 1020 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to Data created by the use of the mobile phone (such as audio data, phone book, etc.).
- memory 1020 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
- the input unit 1030 can be configured to receive input numeric or character information and to generate key signal inputs related to user settings and function controls of the handset.
- the input unit 1030 may include a touch panel 1031 and other input devices 1032.
- the touch panel 1031 also referred to as a touch screen, can collect touch operations on or near the user (such as the user using a finger, a stylus, or the like on the touch panel 1031 or near the touch panel 1031. Operation), and drive the corresponding connecting device according to a preset program.
- the touch panel 1031 may include two parts of a touch detection device and a touch controller.
- the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information.
- the processor 1080 is provided and can receive commands from the processor 1080 and execute them.
- the touch panel 1031 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves.
- the input unit 1030 may also include other input devices 1032.
- other input devices 1032 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.
- the display unit 1040 can be used to display information input by the user or information provided to the user as well as various menus of the mobile phone.
- the display unit 1040 may include a display panel 1041.
- the display panel 1041 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.
- the touch panel 1031 may cover the display panel 1041, and when the touch panel 1031 detects a touch operation thereon or nearby, the touch panel 1031 transmits to the processor 1080 to determine the type of the touch event, and then the processor 1080 according to the touch event.
- the type provides a corresponding visual output on display panel 1041.
- touch panel 1031 and the display panel 1041 are used as two independent components to implement the input and output functions of the mobile phone in FIG. 10, in some embodiments, the touch panel 1031 and the display panel 1041 may be integrated. Realize the input and output functions of the phone.
- the handset can also include at least one type of sensor 1050, such as a light sensor, motion sensor, and other sensors.
- the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1041 according to the brightness of the ambient light, and the proximity sensor may close the display panel 1041 and/or when the mobile phone moves to the ear. Or backlight.
- the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity.
- the mobile phone can be used to identify the gesture of the mobile phone (such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for the mobile phone can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, no longer Narration.
- the gesture of the mobile phone such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration
- vibration recognition related functions such as pedometer, tapping
- the mobile phone can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, no longer Narration.
- An audio circuit 1060, a speaker 1061, and a microphone 1062 can provide an audio interface between the user and the handset.
- the audio circuit 1060 can transmit the converted electrical data of the received audio data to the speaker 1061, and convert it into a sound signal output by the speaker 1061; on the other hand, the microphone 1062 converts the collected sound signal into an electrical signal, by the audio circuit 1060. After receiving, it is converted into audio data, and then processed by the audio data output processor 1080, sent to the other mobile phone via the RF circuit 1010, or outputted to the memory 1020 for further processing.
- WiFi is a short-range wireless transmission technology.
- the mobile phone through the WiFi module 1070 can help users to send and receive e-mail, browse the web and access streaming media, etc. It provides users with wireless broadband Internet access.
- FIG. 10 shows the WiFi module 1070, it can be understood that it does not belong to the essential configuration of the mobile phone, and can be omitted as needed within the scope of not changing the essence of the application.
- the processor 1080 is the control center of the handset, which connects various portions of the entire handset using various interfaces and lines, by executing or executing software programs and/or modules stored in the memory 1020, and invoking data stored in the memory 1020, The phone's various functions and processing data, so that the overall monitoring of the phone.
- the processor 1080 may include one or more processing units; the processor 1080 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, an application, etc., and the modem processor mainly Handle wireless communications. It will be appreciated that the above described modem processor may also not be integrated into the processor 1080.
- the handset also includes a power supply 1090 (such as a battery) that powers the various components.
- the power supply can be logically coupled to the processor 1080 through a power management system to manage charging, discharging, and power management functions through the power management system.
- the mobile phone may further include a camera, a Bluetooth module, and the like, and details are not described herein again.
- the processor 1080 included in the terminal is configured to perform the steps performed by the encoding module 802 and the adding module 803 in the embodiment shown in FIG. 8 , specifically, encoding the RGB format data, and obtaining YUV channel data; adding alpha channel information to the YUV channel data to obtain encoded data;
- the RF circuit 1010 is configured to perform the steps performed by the obtaining module 801 and the sending module 804 in the embodiment shown in FIG. 8 , specifically, acquiring image data of a target object, where the image data includes RGB format data and alpha alpha channel information; The data is sent to the server, and the encoded data is used by the server to decode and display an image of the target object.
- the processor 1080 is specifically configured to add the Alpha channel information to the upper end position of the YUV channel data, so that the background image displayed on the server is displayed at the upper end position of the foreground image, wherein the background image corresponds to the Alpha channel information, and the foreground image and the YUV Channel data corresponds.
- the processor 1080 is specifically configured to add the alpha channel information to the lower end position of the YUV channel data, so that the background image displayed on the server is displayed at the lower end position of the foreground image, wherein the background image corresponds to the alpha channel information, and the foreground image and the YUV Channel data corresponds.
- the processor 1080 is specifically configured to add the alpha channel information to the left side of the YUV channel data, so that the background image displayed on the server is displayed on the left side of the foreground image, wherein the background image corresponds to the alpha channel information, and the foreground image Corresponds to the YUV channel data.
- the processor 1080 is specifically configured to add the alpha channel information to the right side of the YUV channel data, so that the background image displayed on the server is displayed on the right side of the foreground image, wherein the background image corresponds to the alpha channel information, and the foreground image Corresponds to the YUV channel data.
- FIG. 11 is a schematic diagram of an embodiment of a server in an embodiment of the present application, including:
- the server 1100 can vary considerably depending on configuration or performance, and can include one or more central processing units (CPUs) 1122 (eg, one or more processors) and memory 1132, one or one
- the storage medium 1130 (for example, one or one storage device in Shanghai) storing the application 1142 or the data 1144 above.
- the memory 1132 and the storage medium 1130 may be short-term storage or persistent storage.
- the program stored on storage medium 1130 may include one or more modules (not shown), each of which may include a series of instruction operations in the server.
- central processor 1122 can be configured to communicate with storage medium 1130, executing a series of instruction operations in storage medium 1130 on server 1100.
- Server 1100 may also include one or more power sources 1126, one or more wired or wireless network interfaces 1150, one or more input and output interfaces 1158, and/or one or more operating systems 1141, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM and more.
- operating systems 1141 such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM and more.
- the central processing unit 1122 is configured to perform the steps performed by the decoding module 902 and the display module 903 in the embodiment shown in FIG. 9 , specifically, decoding the YUV channel data to obtain RGB format data; RGB format data and alpha channel information display an image of the target object;
- the input/output interface 1158 is configured to perform the steps performed by the receiving module 901 in the embodiment shown in FIG. 9 , specifically, the encoded data sent by the receiving terminal, where the encoded data includes YUV channel data and alpha alpha channel information;
- the central processing unit 1122 is configured to: fill the RGB format data according to the alpha channel information, acquire display data, and display an image of the target object according to the display data.
- the disclosed system, apparatus, and method may be implemented in other manners.
- the device embodiments described above are merely illustrative.
- the division of cells is only a logical function division.
- multiple units or components may be combined or integrated. Go to another system, or some features can be ignored or not executed.
- the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
- the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
- each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
- the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
- An integrated unit if implemented as a software functional unit and sold or used as a standalone product, can be stored in a computer readable storage medium.
- the technical solution of the present application in essence or the contribution to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium.
- a number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the various embodiments of the present application.
- the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Controls And Circuits For Display Device (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
本申请实施例公开了一种传输视频数据的方法,用于服务器接收的数据包括YUV通道数据和Alpha通道信息,对YUV通道数据进行解码,得到RGB格式数据,使用Alpha通道信息对RGB格式数据进行处理。本申请实施例方法包括:终端获取目标对象的图像数据,图像数据包括RGB格式数据和阿尔法Alpha通道信息;终端对RGB格式数据进行编码处理,得到YUV通道数据;终端将Alpha通道信息添加在YUV通道数据中,得到编码数据;终端将编码数据向服务器发送,编码数据用于服务器解码并显示目标对象的图像。
Description
本申请要求于2017年5月11日提交中国专利局、申请号为201710330725.0、发明名称为“一种传输视频信息的方法、终端及服务器”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
本申请涉及计算机领域,尤其涉及一种传输视频信息的方法、终端、服务器及存储介质。
发明背景
在现有的视频传输技术中,终端通过摄像头获取的颜色数据,再进行RGBA的转码、压码处理,其中,RGBA是代表Red(红色)、Green(绿色)、Blue(蓝色)和Alpha的色彩空间。在处理的过程中会将阿尔法Alpha通道信息丢掉,只会进行RGB通道的转码、压码,转码为YUV数据。在视频直播的时候将YUV数据进行压缩来进行网络广播。在用户收到网络传输的压缩文件之后,对这些数据进行解码转码的时候也只是得到了RGB数据进行显示呈现。
但是,由于在转码的过程中没有进行alpha通道信息的保存,使得主播图像中的背景只能是拍到什么就显示什么,无法进行后续背景剔除、Alpha混合处理以及模板处理。
发明内容
本申请实施例提供了一种传输视频信息的方法、终端、服务器和存户介质,用于通过对Alpha通道信息的追加重组来实现Alpha通道信息的保存,服务器接收的数据包括YUV通道数据和Alpha通道信息,对YUV通道数据进行解码,得到RGB格式数据,使用Alpha通道信息对RGB格式数据进行处理,从而可以调整显示的目标图像的后景图像,使得该目标图像的前景图像更好的贴合在显示器显示的整个背景上,用户也会得到更好的沉浸感。
本申请实施例第一方面提供了一种传输视频数据的方法,可以包括:
终端获取目标对象的图像数据,该图像数据包括RGB格式数据和阿尔法Alpha通道信息;
该终端对该RGB格式数据进行编码处理,得到YUV通道数据;
该终端将该Alpha通道信息添加在该YUV通道数据中,得到编码数据;
该终端将该编码数据向服务器发送,该编码数据用于该服务器解码并显示该目标对象的图像。
本申请实施例第二方面提供一种传输视频数据的方法,可以包括:
服务器接收终端发送的编码数据,该编码数据包括YUV通道数据和阿尔法Alpha通道信息;
该服务器对该YUV通道数据进行解码,得到RGB格式数据;
该服务器根据该RGB格式数据和该Alpha通道信息显示目标对象的图像。
本申请实施例第三方面提供一种终端,可以包括处理器和存储器,所述存储器中存储可被所述处理器执行的指令,当执行所述指令时,所述处理器用于:
获取目标对象的图像数据,该图像数据包括RGB格式数据和阿尔法Alpha通道信息;
对该RGB格式数据进行编码处理,得到YUV通道数据;
将该Alpha通道信息添加在该YUV通道数据中,得到编码数据;
将该编码数据向服务器发送,该编码数据用于该服务器解码并显示该目标对象的图像。
本申请实施例第四方面提供一种服务器,可以包括处理器和存储器,所述存储器中存储可被所述处理器执行的指令,当执行所述指令时,所述处理器用于:
接收终端发送的编码数据,该编码数据包括YUV通道数据和阿尔法Alpha通道信息;
对该YUV通道数据进行解码,得到RGB格式数据;
根据该RGB格式数据和该Alpha通道信息显示目标对象的图像。
本申请实施例第五方面提供一种非易失性计算机存储介质,其中存储有计算机程序,该计算机程序用于执行上述方法。
附图简要说明
为了更清楚地说明本申请实施例技术方案,下面将对实施例和现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,还可以根据这些附图获得其它的附图。
图1为显示目标图像的一个示意图;
图2为本申请实施例所应用的一个结构示意图;
图3为本申请实施例中传输视频信息的方法的一个实施例示意图;
图4为本申请实施例中YUV通道数据的一个内存示意图;
图4(A)为本申请实施例中在YUV通道数据的上端位置进行追加重组Alpha通道信息的一个内存示意图;
图4(B)为本申请实施例中在YUV通道数据的下端位置进行追加重组Alpha通道信息的一个内存示意图;
图4(C)为本申请实施例中在YUV通道数据的左侧位置进行追加重组Alpha通道信息的一个内存示意图;
图4(D)为本申请实施例中在YUV通道数据的右侧位置进行追加重组Alpha通道信息的一个内存示意图;
图5(A)为本申请实施例中原始图像的一个示意图;
图5(B)为本申请实施例中原始图像进行RGB转码后的一个示意图;
图5(C)为本申请实施例中在YUV通道数据的上端位置进行追加Alpha数据的一个示意图;
图5(D)为本申请实施例中在YUV通道数据的下端位置进行追加Alpha数据的一个示意图;
图5(E)为本申请实施例中在YUV通道数据的左侧位置进行追加Alpha数据的一个示意图;
图5(F)为本申请实施例中在YUV通道数据的右侧位置进行追加Alpha数据的一个示意图;
图5(G)为本申请实施例中对Alpha通道信息后缀恢复的一个示例图;
图5(H)为在另一个终端上显示该目标图像的一个示意图;
图5(I)为本申请实施例中在另一个终端上显示该目标图像的一个示意图;
图6为本申请实施例的一个体验示意图;
图7为本申请实施例的一个时序图的示意图;
图8为本申请实施例终端的一个实施例示意图;
图9为本申请实施例服务器的一个实施例示意图;
图10为本申请实施例终端的一个实施例示意图;
图11为本申请实施例服务器的一个实施例示意图。
实施方式
本申请实施例提供了一种传输视频信息的方法、终端及服务器,用于保存并传输Alpha通道信息,通过Alpha通道信息对RGB格式数据的处理,可以调整显示的目标图像的后景图像,使得该目标图像的前景图像更好的贴合在显示器显示的整个背景上,用户也会得到更好的沉浸感。
为了使本技术领域的人员更好地理解本申请方案,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分的实施例,而不是全部的实施例。基于本申请中的实施例,都应当属于本申请保护的范围。
先对本申请实施例中所涉及的缩略语和关键术语做几个简单的说明,如下所示:
Alpha阿尔法通道:Alpha通道是颜色中的灰度通道,该通道用来记 录图像中的透明度信息,即阿尔法通道是一个8位的灰度通道,该通道用256级灰度来记录图像中的透明度信息,定义透明、不透明和半透明区域,其中黑表示透明,白表示不透明,灰表示半透明。
QQTALK:简称QT,是一款支持多人语音交流的团队语音通信工具,主要面向需团队协作的游戏用户,也适用于需多人语音沟通的办公和家庭用户。该软件小巧、灵活、上手简单,性能卓越,能以极小的带宽占用,穿越防火墙,提供清晰高质的语音服务。
YUV:是被欧洲电视系统所采用的一种颜色编码方法(逐行倒相,(Phase Alternation Line,PAL)),是PAL和顺序传送彩色信号与存储恢复彩色信号制(Sequential Couleur Avec Memoire,SECAM)模拟彩色电视制式采用的颜色空间。在现代彩色电视系统中,通常采用三管彩色摄影机或彩色CCD摄影机进行取像,然后把取得的彩色图像信号经分色、分别放大校正后得到RGB,再经过矩阵变换电路得到亮度信号Y和两个色差信号B-Y(即U)、R-Y(即V),最后发送端将亮度和色差三个信号分别进行编码,用同一信道发送出去。这种色彩的表示方法就是所谓的YUV色彩空间表示。采用YUV色彩空间的重要性是它的亮度信号Y和色度信号U、V是分离的。
RGBA:是代表Red(红色)Green(绿色)Blue(蓝色)和Alpha的色彩空间。
RGB:RGB色彩模式是工业界的一种颜色标准,是通过对红(R)、绿(G)、蓝(B)三个颜色通道的变化以及它们相互之间的叠加来得到各式各样的颜色的,RGB即是代表红、绿、蓝三个通道的颜色,这个标准几乎包括了人类视力所能感知的所有颜色,是目前运用最广的颜色系统之一。
在现有的QT产品中的视频传输技术中,终端通过摄像头获取的颜色数据,再进行RGBA的转码、压码处理,在处理的过程中会将阿尔法Alpha通道信息丢掉,只会进行RGB通道的转码、压码,转码为YUV数据。在视频直播的时候将YUV数据进行压缩来进行网络广播。在用户收到网络传输的压缩文件之后,对这些数据进行解码转码的时候也只 是得到了RGB数据进行显示呈现。其中,RGBA是代表Red(红色)、Green(绿色)、Blue(蓝色)和Alpha的色彩空间。
但是,由于在转码的过程中没有进行alpha通道信息的保存,使得主播图像中的背景只能是拍到什么就显示什么,无法进行后续背景剔除、Alpha混合处理以及模板处理。如图1所示,为显示目标图像的一个示意图,可以看到,图中美女主播的背景是一个花纹图案,与显示器显示的整个背景没有很好的贴合在一起,用户感官上看起来,是比较突兀的。
在本申请技术方案中,如图2所示,为本申请实施例所应用的一个结构示意图。其中,每个玩家环境的摄像头与个人计算机(Personal Computer,PC)/客户端相连,玩家的智能终端通过网络与服务器连接。通过对Alpha通道信息的追加重组来实现Alpha通道信息的保存,首先能够方便图像解码播放时的后续处理,如背景剔除、Alpha混合处理以及模板处理等;其次每帧图像的Alpha通道信息不需要单独的存储成图片序列或者压制成一个单独视频;最后每帧图像的Alpha通道信息能够在每帧图像解码的时候直接获取,不需要额外的查找和同步处理。
下面以实施例的方式对本申请实施例做进一步的说明,如图3所示,为本申请实施例中传输视频信息的方法的一个实施例示意图,包括:
301、终端获取目标对象的图像数据,图像数据包括RGB格式数据和阿尔法Alpha通道信息;
在本申请实施例中,终端获取目标对象的图像数据,图像数据包括RGB格式数据和阿尔法Alpha通道信息。首先,在游戏启动后,玩家选择房间开始游戏,同时终端上会开始初始化摄像头;终端获取用户的图像数据,图像数据为RGBA格式数据,其中,RGBA是代表Red(红色)、Green(绿色)、Blue(蓝色)和Alpha的通道数据。
在实际应用中,终端上会连接有摄像头,终端可以通过摄像头获取每个玩家的图像数据,该图像数据为RGBA格式数据,RGBA格式数据其实就是RGB格式数据和阿尔法Alpha通道信息。这里的终端可以是手机、平板电脑、PDA(Personal Digital Assistant,个人数字助理)、POS (Point of Sales,销售终端)、车载电脑等任意终端设备。
302、终端对RGB格式数据进行编码处理,得到YUV通道数据;
在本申请实施例中,终端获取目标对象的图像数据,图像数据包括RGB格式数据和阿尔法Alpha通道信息之后,终端对RGB格式数据进行编码处理,得到YUV通道数据。
应理解,终端获取目标对象的图像数据,在终端的本地会根据图像数据显示该目标对象,同时,可以对图像数据中的RGB格式数据进行编码处理,因为摄像头提供的数据是RGBA格式,终端对这个数据中的各个数据通道进行分别处理。RGBA中的RGB通道图像信息终端会根据编码的需求,转码成为NV21、NV12、YUV420等YUV格式数据。
303、终端将Alpha通道信息添加在YUV通道数据中,得到编码数据;
在本申请实施例中,终端对RGB格式数据进行编码处理,得到YUV通道数据之后,终端将Alpha通道信息添加在YUV通道数据中,得到编码数据。具体的,可以包括,如下所示:
(1)终端将Alpha通道信息添加在YUV通道数据的上端位置,使得服务器上显示的后景图像显示在前景图像上端位置,其中,后景图像与Alpha通道信息对应,前景图像与YUV通道数据对应。
(2)终端将Alpha通道信息添加在YUV通道数据的下端位置,使得服务器上显示的后景图像显示在前景图像下端位置,其中,后景图像与Alpha通道信息对应,前景图像与YUV通道数据对应。
(3)终端将Alpha通道信息添加在YUV通道数据的左侧位置,使得服务器上显示的后景图像显示在前景图像左侧位置,其中,后景图像与Alpha通道信息对应,前景图像与YUV通道数据对应。
(4)终端将Alpha通道信息添加在YUV通道数据的右侧位置,使得服务器上显示的后景图像显示在前景图像右侧位置,其中,后景图像与Alpha通道信息对应,前景图像与YUV通道数据对应。
即RGBA中的Alpha通道信息,终端会根据前面的转码格式以及编码器格式选择,追加在之前的YUV通道数据中,其中,如图4所示, 为YUV通道数据的一个内存示意图。有多种追加的方式来得到编码数据,上面只是以几种示例的方式对其进行说明,分别为:如图4(A)所示,为在YUV通道数据的上端位置进行追加重组Alpha通道信息的一个内存示意图;如图4(B)所示,为在YUV通道数据的下端位置进行追加重组Alpha通道信息的一个内存示意图;如图4(C)所示,在YUV通道数据的左侧位置进行追加重组Alpha通道信息的一个内存示意图;如图4(D)所示,为在YUV通道数据的右侧位置进行追加重组Alpha通道信息的一个内存示意图。
需要说明的是,可以将Alpha通道信息分成3份,分别添加在Y通道数据的上端位置,U通道数据的上端位置和V通道数据的上端位置;或者,分别添加在Y通道数据的下端位置,U通道数据的下端位置和V通道数据的下端位置;或者,分别添加在Y通道数据的左侧位置,U通道数据的左侧位置和V通道数据的左侧位置;或者,分别添加在Y通道数据的右侧位置,U通道数据的右侧位置和V通道数据的右侧位置。
下面可以结合具体的RGBA图像来说明YUV图像中的Alpha通道信息追加,如图5(A)所示,为原始图像的一个示意图;先对原始图像进行RGB的转码,如图5(B)所示,为原始图像进行RGB转码后的一个示意图;之后终端对于转码的图像可以追加Alpha通道信息完成最终的YUV重组,在上述中提及的四种数据重组分别对应的示意图为:如图5(C)所示,为在YUV通道数据的上端位置进行追加Alpha数据的一个示意图;如图5(D)所示,为在YUV通道数据的下端位置进行追加Alpha数据的一个示意图;如图5(E)所示,为在YUV通道数据的左侧位置进行追加Alpha数据的一个示意图;如图5(F)所示,为在YUV通道数据的右侧位置进行追加Alpha数据的一个示意图。
应理解,这里终端得到YUV通道图像数据后便可以进行后续的常规压缩,但是由于Alpha通道信息的保存会使得YUV通道数据的宽高有相应的扩充,此时只要对编码的相应参数进行调整即可。
304、终端将编码数据发送至服务器;
在本申请实施例中,步骤304可以包括步骤a和步骤b,如下所示:
a、终端将编码数据向服务器发送,编码数据用于服务器解码并显示目标对象的图像。
b、服务器接收终端发送的编码数据,编码数据包括YUV通道数据和阿尔法Alpha通道信息。
305、服务器对YUV通道数据进行解码,得到RGB格式数据;
在本申请实施例中,因为服务器接收的编码数据包括YUV通道数据和阿尔法Alpha通道信息,服务器对其中的YUV通道数据进行解码,可以得到RGB格式数据。
在这个过程中,服务器先是对YUV通道数据进行解码转码,服务器在获取编码数据后可以进行Alpha通道信息的提取,然后填充到转码好的RGB格式数据中,此时算完成了RGBA的完整恢复过程,对Alpha通道信息后缀恢复示例如图5(G)所示。
306、服务器根据RGB格式数据和Alpha通道信息在显示器上显示目标对象的图像。
在本申请实施例中,服务器对YUV通道数据进行解码,得到RGB格式数据之后,服务器根据RGB格式数据和Alpha通道信息在显示器上显示目标对象的图像。具体的,可以包括:所述显示模块,具体用于根据所述Alpha通道信息,对所述RGB格式数据进行填充,获取显示数据;根据所述显示数据显示所述目标对象的图像。在另一个终端的显示屏上显示的该目标图像的示意图如图5(H)所示,而使用本申请技术方案后,显示的该目标图像的示意图如图5(I)所示。
现有技术方案无法保存alpha通道信息,而本方案能通过对Alpha通道信息的追加重组来实现alpha通道信息的保存,使得视频在压制传输的过程中,总是存在与颜色通道相对应的透明度信息,极大的保留了图像源的完整信息,首先能够方便图像解码播放的后续处理,如背景剔除、Alpha混合处理以及模板处理等;其次每帧图像的Alpha不需要单独的存储成图片序列或者压制成一个单独视频;最后每帧图像的Alpha通道信息能够在每帧图像解码的时候直接获取,不需要额外的查找和同步处理。
在本申请实施例中,终端获取目标对象的图像数据,该图像数据包括RGB格式数据和阿尔法Alpha通道信息;该终端对该RGB格式数据进行编码处理,得到YUV通道数据;该终端将该Alpha通道信息添加在该YUV通道数据中,得到编码数据;该终端将该编码数据向服务器发送,该编码数据用于该服务器解码并显示该目标对象的图像。服务器接收终端发送的编码数据,该编码数据包括YUV通道数据和阿尔法Alpha通道信息;该服务器对该YUV通道数据进行解码,得到RGB格式数据;该服务器根据该RGB格式数据和该Alpha通道信息显示目标对象的图像。因为终端发送的编码数据包括的不仅有YUV通道数据,还包括阿尔法Alpha通道信息,所以,服务器接收编码数据,可以对YUV通道数据解码得到RGB格式数据,再通过Alpha通道信息对RGB格式数据进行图像背景剔除、Alpha混合处理或者模板处理等,可以调整目标图像的后景图像,使得目标图像的前景图像更好的贴合在显示器显示的整个背景上,用户会有更好的沉浸感。
下面可以以实际应用场景对本申请技术方案作进一步的说明,如下所示:
如图6所示,为本申请技术方案的一个体验示意图,本申请技术方案的基本体验流程为:
启动游戏客户端→连接3D体感摄像头→人物进行校准→进入游戏场景→将本地摄像头的Alpha通道数据存储后转码压缩→发送给同玩游戏玩家→数据解码转码后→Alpha通道数据混合显示。
在上述图6显示的产品形式中,有以下几点需要说明一下:
图6中显示的三个人物,最左侧的人物为本地玩家图像,最右侧为网络端的同玩游戏玩家,网络端玩家以及主播能够像本地玩家一样有着完整的Alpha通道信息呈现,从而使得服务器非常方便的进行背景剔除以及Alpha混合处理,使得人物显示非常具有沉浸感。上图中的本地玩家图像为摄像头直接获取,网络端玩家的图像是由服务器转发进行解码转码显示的图像。
如图7所示,为本申请实施例的一个时序图的示意图,应理解,结 合上述图6中显示的玩家图像进行说明。以最左侧的人物来进行说明,最左侧的人物对应的客户端的摄像头获取该人物的图像数据,并对该人物的图像数据中的RGB格式数据进行图像处理,具体的是这个客户端对RGB格式数据进行转码编码得到YUV通道数据,并将Alpha通道信息添加在YUV通道数据中向游戏服务器发送。游戏服务器收到的数据包括YUV通道数据和Alpha通道信息,对YUV通道数据进行解码,得到RGB格式数据,并获取Alpha通道信息,游戏服务器根据Alpha通道信息对RGB格式数据进行填充等处理后形成最终的图像进行在同玩的玩家的客户端上进行显示。
上面对本申请实施例中的传输视频信息的方法进行了说明,下面对本申请实施例中的终端和服务器进行描述,如图8所示,为本申请实施例中终端的一个实施例示意图,包括:
获取模块801,用于获取目标对象的图像数据,图像数据包括RGB格式数据和阿尔法Alpha通道信息;
编码模块802,用于对RGB格式数据进行编码处理,得到YUV通道数据;
添加模块803,用于将Alpha通道信息添加在YUV通道数据中,得到编码数据;
发送模块804,用于将编码数据向服务器发送,编码数据用于服务器解码并显示目标对象的图像。
在本申请的一些实施例中,
添加模块803,具体用于将Alpha通道信息添加在YUV通道数据的上端位置,使得服务器上显示的后景图像显示在前景图像上端位置,其中,后景图像与Alpha通道信息对应,前景图像与YUV通道数据对应。
在本申请的一些实施例中,
添加模块803,具体用于将Alpha通道信息添加在YUV通道数据的下端位置,使得服务器上显示的后景图像显示在前景图像下端位置,其中,后景图像与Alpha通道信息对应,前景图像与YUV通道数据对应。
在本申请的一些实施例中,
添加模块803,具体用于将Alpha通道信息添加在YUV通道数据的左侧位置,使得服务器上显示的后景图像显示在前景图像左侧位置,其中,后景图像与Alpha通道信息对应,前景图像与YUV通道数据对应。
在本申请的一些实施例中,
添加模块803,具体用于将Alpha通道信息添加在YUV通道数据的右侧位置,使得服务器上显示的后景图像显示在前景图像右侧位置,其中,后景图像与Alpha通道信息对应,前景图像与YUV通道数据对应。
如图9所示,为本申请实施例中服务器的一个实施例示意图,包括:
接收模块901,用于接收终端发送的编码数据,编码数据包括YUV通道数据和阿尔法Alpha通道信息;
解码模块902,用于对YUV通道数据进行解码,得到RGB格式数据;
显示模块903,用于根据RGB格式数据和Alpha通道信息显示目标对象的图像。
在本申请的一些实施例中,
显示模块903,具体用于根据Alpha通道信息,对RGB格式数据进行填充,获取显示数据;根据显示数据显示目标对象的图像。
如图10所示,为本申请实施例中终端的一个实施例示意图,包括:
为了便于说明,以终端为手机为例,仅示出了与本申请实施例相关的部分,具体技术细节未揭示的,请参照本申请实施例方法部分。
图10示出的是与本申请实施例提供的终端相关的手机的部分结构的框图。参考图10,手机包括:射频(Radio Frequency,RF)电路1010、存储器1020、输入单元1030、显示单元1040、传感器1050、音频电路1060、无线保真(wireless fidelity,WiFi)模块1070、处理器1080、以及电源1090等部件。本领域技术人员可以理解,图10中示出的手机结构并不构成对手机的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。
下面结合图10对手机的各个构成部件进行具体的介绍:
RF电路1010可用于收发信息或通话过程中,信号的接收和发送, 特别地,将基站的下行信息接收后,给处理器1080处理;另外,将设计上行的数据发送给基站。通常,RF电路1010包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器(Low Noise Amplifier,LNA)、双工器等。此外,RF电路1010还可以通过无线通信与网络和其他设备通信。上述无线通信可以使用任一通信标准或协议,包括但不限于全球移动通讯系统(Global System of Mobile communication,GSM)、通用分组无线服务(General Packet Radio Service,GPRS)、码分多址(Code Division Multiple Access,CDMA)、宽带码分多址(Wideband Code Division Multiple Access,WCDMA)、长期演进(Long Term Evolution,LTE)、电子邮件、短消息服务(Short Messaging Service,SMS)等。
存储器1020可用于存储软件程序以及模块,处理器1080通过运行存储在存储器1020的软件程序以及模块,从而执行手机的各种功能应用以及数据处理。存储器1020可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等;存储数据区可存储根据手机的使用所创建的数据(比如音频数据、电话本等)等。此外,存储器1020可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。
输入单元1030可用于接收输入的数字或字符信息,以及产生与手机的用户设置以及功能控制有关的键信号输入。具体地,输入单元1030可包括触控面板1031以及其他输入设备1032。触控面板1031,也称为触摸屏,可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板1031上或在触控面板1031附近的操作),并根据预先设定的程式驱动相应的连接装置。触控面板1031可包括触摸检测装置和触摸控制器两个部分。其中,触摸检测装置检测用户的触摸方位,并检测触摸操作带来的信号,将信号传送给触摸控制器;触摸控制器从触摸检测装置上接收触摸信息,并将它转换成触点坐标,再送给处理器1080,并能接收处理器1080发来的命令并加以执行。 此外,可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触控面板1031。除了触控面板1031,输入单元1030还可以包括其他输入设备1032。具体地,其他输入设备1032可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。
显示单元1040可用于显示由用户输入的信息或提供给用户的信息以及手机的各种菜单。显示单元1040可包括显示面板1041,可以采用液晶显示器(Liquid Crystal Display,LCD)、有机发光二极管(Organic Light-Emitting Diode,OLED)等形式来配置显示面板1041。进一步的,触控面板1031可覆盖显示面板1041,当触控面板1031检测到在其上或附近的触摸操作后,传送给处理器1080以确定触摸事件的类型,随后处理器1080根据触摸事件的类型在显示面板1041上提供相应的视觉输出。虽然在图10中,触控面板1031与显示面板1041是作为两个独立的部件来实现手机的输入和输出功能,但是在某些实施例中,可以将触控面板1031与显示面板1041集成而实现手机的输入和输出功能。
手机还可包括至少一种传感器1050,比如光传感器、运动传感器以及其他传感器。具体地,光传感器可包括环境光传感器及接近传感器,其中,环境光传感器可根据环境光线的明暗来调节显示面板1041的亮度,接近传感器可在手机移动到耳边时,关闭显示面板1041和/或背光。作为运动传感器的一种,加速计传感器可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别手机姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等;至于手机还可配置的陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器,在此不再赘述。
音频电路1060、扬声器1061,传声器1062可提供用户与手机之间的音频接口。音频电路1060可将接收到的音频数据转换后的电信号,传输到扬声器1061,由扬声器1061转换为声音信号输出;另一方面,传声器1062将收集的声音信号转换为电信号,由音频电路1060接收后转换为音频数据,再将音频数据输出处理器1080处理后,经RF电路 1010以发送给比如另一手机,或者将音频数据输出至存储器1020以便进一步处理。
WiFi属于短距离无线传输技术,手机通过WiFi模块1070可以帮助用户收发电子邮件、浏览网页和访问流式媒体等,它为用户提供了无线的宽带互联网访问。虽然图10示出了WiFi模块1070,但是可以理解的是,其并不属于手机的必须构成,完全可以根据需要在不改变申请的本质的范围内而省略。
处理器1080是手机的控制中心,利用各种接口和线路连接整个手机的各个部分,通过运行或执行存储在存储器1020内的软件程序和/或模块,以及调用存储在存储器1020内的数据,执行手机的各种功能和处理数据,从而对手机进行整体监控。处理器1080可包括一个或多个处理单元;处理器1080可集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器1080中。
手机还包括给各个部件供电的电源1090(比如电池),电源可以通过电源管理系统与处理器1080逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。
尽管未示出,手机还可以包括摄像头、蓝牙模块等,在此不再赘述。
在本申请实施例中,该终端所包括的处理器1080用于执行上述图8所示的实施例中编码模块802和添加模块803所执行的步骤,具体为对RGB格式数据进行编码处理,得到YUV通道数据;将Alpha通道信息添加在YUV通道数据中,得到编码数据;
RF电路1010用于执行上述图8所示的实施例中获取模块801和发送模块804所执行的步骤,具体为获取目标对象的图像数据,图像数据包括RGB格式数据和阿尔法Alpha通道信息;将编码数据向服务器发送,编码数据用于服务器解码并显示目标对象的图像。
在本申请的一些实施例中,
处理器1080,具体用于将Alpha通道信息添加在YUV通道数据的 上端位置,使得服务器上显示的后景图像显示在前景图像上端位置,其中,后景图像与Alpha通道信息对应,前景图像与YUV通道数据对应。
在本申请的一些实施例中,
处理器1080,具体用于将Alpha通道信息添加在YUV通道数据的下端位置,使得服务器上显示的后景图像显示在前景图像下端位置,其中,后景图像与Alpha通道信息对应,前景图像与YUV通道数据对应。
在本申请的一些实施例中,
处理器1080,具体用于将Alpha通道信息添加在YUV通道数据的左侧位置,使得服务器上显示的后景图像显示在前景图像左侧位置,其中,后景图像与Alpha通道信息对应,前景图像与YUV通道数据对应。
在本申请的一些实施例中,
处理器1080,具体用于将Alpha通道信息添加在YUV通道数据的右侧位置,使得服务器上显示的后景图像显示在前景图像右侧位置,其中,后景图像与Alpha通道信息对应,前景图像与YUV通道数据对应。
如图11所示,为本申请实施例中服务器的一个实施例示意图,包括:
该服务器1100可因配置或性能不同而产生比较大的差异,可以包括一个或一个以上中央处理器(central processing units,CPU)1122(例如,一个或一个以上处理器)和存储器1132,一个或一个以上存储应用程序1142或数据1144的存储介质1130(例如一个或一个以上海量存储设备)。其中,存储器1132和存储介质1130可以是短暂存储或持久存储。存储在存储介质1130的程序可以包括一个或一个以上模块(图示没标出),每个模块可以包括对服务器中的一系列指令操作。更进一步地,中央处理器1122可以设置为与存储介质1130通信,在服务器1100上执行存储介质1130中的一系列指令操作。
服务器1100还可以包括一个或一个以上电源1126,一个或一个以上有线或无线网络接口1150,一个或一个以上输入输出接口1158,和/或,一个或一个以上操作系统1141,例如Windows ServerTM,Mac OS XTM,UnixTM,LinuxTM,FreeBSDTM等等。
在本申请实施例中,中央处理器1122用于执行上述图9所示的实施例中解码模块902和显示模块903所执行的步骤,具体为对YUV通道数据进行解码,得到RGB格式数据;根据RGB格式数据和Alpha通道信息显示目标对象的图像;
输入输出接口1158用于执行上述图9所示的实施例中接收模块901所执行的步骤,具体为接收终端发送的编码数据,编码数据包括YUV通道数据和阿尔法Alpha通道信息;
在本申请的一些实施例中,
中央处理器1122,具体用于根据Alpha通道信息,对RGB格式数据进行填充,获取显示数据;根据显示数据显示目标对象的图像。
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请所提供的几个实施例中,应该理解到,所揭露的系统,装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。
集成的单元如果以软件功能单元的形式实现并作为独立的产品销 售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本申请各个实施例方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。
以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。
Claims (19)
- 一种传输视频数据的方法,适用于终端,其中,包括:终端获取目标对象的图像数据,所述图像数据包括RGB格式数据和阿尔法Alpha通道信息;所述终端对所述RGB格式数据进行编码处理,得到YUV通道数据;所述终端将所述Alpha通道信息添加在所述YUV通道数据中,得到编码数据;所述终端将所述编码数据向服务器发送,所述编码数据用于所述服务器解码并显示所述目标对象的图像。
- 根据权利要求1所述的方法,其中,所述终端将所述阿尔法Alpha通道信息添加在所述YUV数据中,包括:所述终端将所述Alpha通道信息添加在所述YUV通道数据的上端位置,使得所述服务器上显示的后景图像显示在前景图像上端位置,其中,所述后景图像与所述Alpha通道信息对应,所述前景图像与所述YUV通道数据对应。
- 根据权利要求1所述的方法,其中,所述终端将所述Alpha通道信息添加在所述YUV数据中,包括:所述终端将所述Alpha通道信息添加在所述YUV通道数据的下端位置,使得所述服务器上显示的后景图像显示在前景图像下端位置,其中,所述后景图像与所述Alpha通道信息对应,所述前景图像与所述YUV通道数据对应。
- 根据权利要求1所述的方法,其中,所述终端将所述Alpha通道信息添加在所述YUV数据中,包括:所述终端将所述Alpha通道信息添加在所述YUV通道数据的左侧位置,使得所述服务器上显示的后景图像显示在前景图像左侧位置,其中,所述后景图像与所述Alpha通道信息对应,所述前景图像与所述YUV通道数据对应。
- 根据权利要求1所述的方法,其中,所述终端将所述Alpha通道信息添加在所述YUV数据中,包括:所述终端将所述Alpha通道信息添加在所述YUV通道数据的右侧位置,使得所述服务器上显示的后景图像显示在前景图像右侧位置,其中,所述后景图像与所述Alpha通道信息对应,所述前景图像与所述YUV通道数据对应。
- 根据权利要求2所述的方法,其中,所述方法进一步包括:将所述Alpha通道信息分成三份,分别添加在Y通道数据的上端位置,U通道数据的上端位置和V通道数据的上端位置。
- 根据权利要求3所述的方法,其中,所述方法进一步包括:将所述Alpha通道信息分成三份,分别添加在Y通道数据的下端位置,U通道数据的下端位置和V通道数据的下端位置。
- 根据权利要求4所述的方法,其中,所述方法进一步包括:将所述Alpha通道信息分成三份,分别添加在Y通道数据的左端位置,U通道数据的左端位置和V通道数据的左端位置。
- 根据权利要求5所述的方法,其中,所述方法进一步包括:将所述Alpha通道信息分成三份,分别添加在Y通道数据的右端位置,U通道数据的右端位置和V通道数据的右端位置。
- 一种传输视频数据的方法,适用于服务器,其中,包括:服务器接收终端发送的编码数据,所述编码数据包括YUV通道数据和阿尔法Alpha通道信息;所述服务器对所述YUV通道数据进行解码,得到RGB格式数据;所述服务器根据所述RGB格式数据和所述Alpha通道信息在显示器上显示目标对象的图像。
- 根据权利要求10所述的方法,其中,所述服务器根据所述RGB格式数据和所述Alpha通道信息在显示器上显示目标对象的图像,包括:所述服务器根据所述Alpha通道信息,对所述RGB格式数据进行填充,获取显示数据;所述服务器根据所述显示数据在所述显示器上显示所述目标对象的图像。
- 一种终端,其中,包括处理器和存储器,所述存储器中存储可 被所述处理器执行的指令,当执行所述指令时,所述处理器用于:获取目标对象的图像数据,所述图像数据包括RGB格式数据和阿尔法Alpha通道信息;对所述RGB格式数据进行编码处理,得到YUV通道数据;将所述Alpha通道信息添加在所述YUV通道数据中,得到编码数据;将所述编码数据向服务器发送,所述编码数据用于所述服务器解码并显示所述目标对象的图像。
- 根据权利要求12所述的终端,其中,当执行所述指令时,所述处理器进一步用于:将所述Alpha通道信息添加在所述YUV通道数据的上端位置,使得所述服务器上显示的后景图像显示在前景图像上端位置,其中,所述后景图像与所述Alpha通道信息对应,所述前景图像与所述YUV通道数据对应。
- 根据权利要求12所述的终端,其中,当执行所述指令时,所述处理器进一步用于:将所述Alpha通道信息添加在所述YUV通道数据的下端位置,使得所述服务器上显示的后景图像显示在前景图像下端位置,其中,所述后景图像与所述Alpha通道信息对应,所述前景图像与所述YUV通道数据对应。
- 根据权利要求12所述的终端,其中,当执行所述指令时,所述处理器进一步用于:将所述Alpha通道信息添加在所述YUV通道数据的左侧位置,使得所述服务器上显示的后景图像显示在前景图像左侧位置,其中,所述后景图像与所述Alpha通道信息对应,所述前景图像与所述YUV通道数据对应。
- 根据权利要求12所述的终端,其中,当执行所述指令时,所述处理器进一步用于:将所述Alpha通道信息添加在所述YUV通道数据的右侧位置,使 得所述服务器上显示的后景图像显示在前景图像右侧位置,其中,所述后景图像与所述Alpha通道信息对应,所述前景图像与所述YUV通道数据对应。
- 一种服务器,其特征在于,包括处理器和存储器,所述存储器中存储可被所述处理器执行的指令,当执行所述指令时,所述处理器用于:终端发送的编码数据,所述编码数据包括YUV通道数据和阿尔法Alpha通道信息;对所述YUV通道数据进行解码,得到RGB格式数据;根据所述RGB格式数据和所述Alpha通道信息显示目标对象的图像。
- 根据权利要求17所述的服务器,其中,当执行所述指令时,所述处理器进一步用于:用于根据所述Alpha通道信息,对所述RGB格式数据进行填充,获取显示数据;根据所述显示数据显示所述目标对象的图像。
- 一种非易失性计算机存储介质,其中,其中存储有计算机程序,该计算机程序用于执行所述权利要求1至11任一项所述的方法。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710330725.0A CN108881920B (zh) | 2017-05-11 | 2017-05-11 | 一种传输视频信息的方法、终端及服务器 |
CN201710330725.0 | 2017-05-11 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018205878A1 true WO2018205878A1 (zh) | 2018-11-15 |
Family
ID=64105231
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2018/085445 WO2018205878A1 (zh) | 2017-05-11 | 2018-05-03 | 一种传输视频信息的方法、终端、服务器及存储介质 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN108881920B (zh) |
WO (1) | WO2018205878A1 (zh) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112601096A (zh) * | 2020-12-02 | 2021-04-02 | 深圳力维智联技术有限公司 | 视频解码方法、装置、设备及可读存储介质 |
CN114928730A (zh) * | 2022-06-23 | 2022-08-19 | 湖南国科微电子股份有限公司 | 图像处理方法和图像处理装置 |
CN115834898A (zh) * | 2023-02-23 | 2023-03-21 | 成都索贝数码科技股份有限公司 | 一种HDMI传输时携带α通道值的传输方法 |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2021237569A1 (zh) * | 2020-05-28 | 2021-12-02 | 深圳市大疆创新科技有限公司 | 编码方法、解码方法、装置及系统 |
CN112402958B (zh) * | 2020-10-27 | 2022-05-13 | 腾讯科技(深圳)有限公司 | 一种图像处理方法、装置和存储介质 |
CN114173157B (zh) * | 2021-12-10 | 2022-12-16 | 广州博冠信息科技有限公司 | 视频流传输方法及装置、电子设备、存储介质 |
CN115002468A (zh) * | 2022-05-26 | 2022-09-02 | 京东科技控股股份有限公司 | 视频处理方法、装置、系统以及客户端 |
CN115297312A (zh) * | 2022-08-04 | 2022-11-04 | 深圳市瑞云科技有限公司 | 一种传输图像透明度信息的方法 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101742317A (zh) * | 2009-12-31 | 2010-06-16 | 北京中科大洋科技发展股份有限公司 | 一种带阿尔法透明通道的视频压缩编码方法 |
CN102036059A (zh) * | 2009-09-25 | 2011-04-27 | 腾讯科技(深圳)有限公司 | 一种透明图像的压缩和解压缩方法、装置和系统 |
US20150074735A1 (en) * | 2013-09-06 | 2015-03-12 | Seespace Ltd. | Method and Apparatus for Rendering Video Content Including Secondary Digital Content |
CN105306941A (zh) * | 2015-11-12 | 2016-02-03 | 贺新 | 一种视频编码方法 |
CN106375759A (zh) * | 2016-08-31 | 2017-02-01 | 深圳超多维科技有限公司 | 一种视频图像数据的编、解码方法及装置 |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3655490B2 (ja) * | 1998-09-21 | 2005-06-02 | 富士写真フイルム株式会社 | 画像暗号化装置、画像暗号化方法、画像暗号化のプログラムを記録したコンピュータ読み取り可能な記録媒体及び画像ファイルが記録されたコンピュータ読み取り可能な記録媒体 |
CN102289829A (zh) * | 2011-07-12 | 2011-12-21 | 北京朗玛数联科技有限公司 | 图像存储、还原的方法、装置及图像处理系统 |
US8655086B1 (en) * | 2011-11-01 | 2014-02-18 | Zynga, Inc. | Image compression with alpha channel data |
EP2670140A1 (en) * | 2012-06-01 | 2013-12-04 | Alcatel Lucent | Method and apparatus for encoding a video stream |
US10484640B2 (en) * | 2015-06-03 | 2019-11-19 | Intel Corporation | Low power video composition using a stream out buffer |
-
2017
- 2017-05-11 CN CN201710330725.0A patent/CN108881920B/zh active Active
-
2018
- 2018-05-03 WO PCT/CN2018/085445 patent/WO2018205878A1/zh active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102036059A (zh) * | 2009-09-25 | 2011-04-27 | 腾讯科技(深圳)有限公司 | 一种透明图像的压缩和解压缩方法、装置和系统 |
CN101742317A (zh) * | 2009-12-31 | 2010-06-16 | 北京中科大洋科技发展股份有限公司 | 一种带阿尔法透明通道的视频压缩编码方法 |
US20150074735A1 (en) * | 2013-09-06 | 2015-03-12 | Seespace Ltd. | Method and Apparatus for Rendering Video Content Including Secondary Digital Content |
CN105306941A (zh) * | 2015-11-12 | 2016-02-03 | 贺新 | 一种视频编码方法 |
CN106375759A (zh) * | 2016-08-31 | 2017-02-01 | 深圳超多维科技有限公司 | 一种视频图像数据的编、解码方法及装置 |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112601096A (zh) * | 2020-12-02 | 2021-04-02 | 深圳力维智联技术有限公司 | 视频解码方法、装置、设备及可读存储介质 |
CN114928730A (zh) * | 2022-06-23 | 2022-08-19 | 湖南国科微电子股份有限公司 | 图像处理方法和图像处理装置 |
CN114928730B (zh) * | 2022-06-23 | 2023-08-22 | 湖南国科微电子股份有限公司 | 图像处理方法和图像处理装置 |
CN115834898A (zh) * | 2023-02-23 | 2023-03-21 | 成都索贝数码科技股份有限公司 | 一种HDMI传输时携带α通道值的传输方法 |
CN115834898B (zh) * | 2023-02-23 | 2023-05-12 | 成都索贝数码科技股份有限公司 | 一种HDMI传输时携带α通道值的传输方法 |
Also Published As
Publication number | Publication date |
---|---|
CN108881920B (zh) | 2022-06-10 |
CN108881920A (zh) | 2018-11-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2018205878A1 (zh) | 一种传输视频信息的方法、终端、服务器及存储介质 | |
TWI696146B (zh) | 影像處理方法、裝置、電腦可讀儲存媒體和行動終端 | |
US20220295027A1 (en) | Projection display method and electronic device | |
CN109218731B (zh) | 移动设备的投屏方法、装置及系统 | |
CN109670427B (zh) | 一种图像信息的处理方法、装置及存储介质 | |
CN106412691B (zh) | 一种视频图像的截取方法和装置 | |
US12022160B2 (en) | Live streaming sharing method, and related device and system | |
CN108287744B (zh) | 文字显示方法、装置及存储介质 | |
WO2017054605A1 (zh) | 一种图片的处理方法和装置 | |
WO2017071219A1 (zh) | 检测皮肤区域的方法和检测皮肤区域的装置 | |
CN111061445A (zh) | 投屏方法和计算设备 | |
CN110908765A (zh) | 一种界面显示方法、装置、终端设备及存储介质 | |
US10592191B2 (en) | Apparatus, system, and method of controlling display of image data in a network of multiple display terminals | |
US10957012B2 (en) | System and method for processing image information | |
US20220408020A1 (en) | Image Processing Method, Electronic Device, and Cloud Server | |
CN107846554B (zh) | 一种图像处理方法、终端和计算机可读存储介质 | |
WO2019114724A1 (zh) | 一种相机缩略图生成的方法、移动终端及存储介质 | |
US20230162324A1 (en) | Projection data processing method and apparatus | |
WO2018120657A1 (zh) | 一种共享虚拟现实数据的方法和设备 | |
CN112312144B (zh) | 一种直播方法、装置、设备和存储介质 | |
CN110917610A (zh) | 辅助游戏显示效果的方法、移动终端及计算机可读存储介质 | |
US10515613B2 (en) | Method of processing images and apparatus | |
CN112691363A (zh) | 一种云游戏跨终端切换的方法和相关装置 | |
CN113645476B (zh) | 画面处理方法、装置、电子设备及存储介质 | |
WO2019020112A1 (zh) | 终端显示方法、终端及计算机可读存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18798692 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 18798692 Country of ref document: EP Kind code of ref document: A1 |