WO2019024387A1

WO2019024387A1 - Method and apparatus for transmitting image during file transmission, terminal, and storage medium

Info

Publication number: WO2019024387A1
Application number: PCT/CN2017/116634
Authority: WO
Inventors: 李逸然
Original assignee: 广州视源电子科技股份有限公司; 广州视臻信息科技有限公司
Priority date: 2017-08-01
Filing date: 2017-12-15
Publication date: 2019-02-07
Also published as: CN107612881A; CN107612881B

Abstract

Disclosed is a method for transmitting an image during file transmission, comprising: obtaining a currently transmitted first image frame when detecting a process of transmitting a file to a first terminal in the process of transmitting images to the first terminal; clipping a first clipping region predetermined on the first image frame, and generating a second image frame; sending the second image frame to the first terminal, to enable the first terminal to read a locally pre-stored first filling content after receiving the second image frame and generate a third image frame for displaying according to the first filling content and the second image frame. Also disclosed are an apparatus for transmitting an image during file transmission, a terminal, and a computer readable storage medium. Files and images can be transmitted simultaneously without affecting the quality of images, the speed for image transmission, and the speed for file transmission.

Description

Method, device, terminal and storage medium for transferring pictures when transferring files

Technical field

The present invention relates to the field of data transmission, and in particular, to a method, system, and terminal for transmitting a picture when transmitting a file.

Background technique

The popularity and development of Internet and network technologies have brought revolutionary changes to people's lives and work. Through the Internet and network technologies, people can realize online shopping and network office without leaving their homes, giving people a working life. Brought great convenience. For example, remote conferences or video conferences based on the network can enable people in different locations to conduct face-to-face conversations through communication devices and networks to achieve cross-regional conferences.

Teleconferencing refers broadly to video conferencing, which allows remote sharing of voice and video images. For remote meetings, the primary consideration is whether the transmission of language and video images is timely and whether the display of video images is clear and smooth. However, in remote conferences, data file transmission is often required. In the process of data file transmission, the bandwidth of the picture transmission is occupied, which causes the picture to be stuck, the picture quality to be degraded, or the file transmission to be intermittent.

Summary of the invention

In view of the above problems, an object of the present invention is to provide a method, an apparatus, a terminal, and a computer readable storage medium for transmitting a picture when transferring a file, which can implement a file without affecting picture quality, picture transmission speed, and file transmission speed. Transfer at the same time as the picture.

The present invention provides a method for transmitting a picture when transferring a file, including:

Obtaining a first picture frame currently transmitted to the first terminal when detecting a process of transmitting a file to the first terminal in a process of transmitting a picture to the first terminal;

Trimming a predetermined first clipping area on the first picture frame to generate a second picture frame;

Transmitting the second picture frame to the first terminal, so that after receiving the second picture frame, the first terminal reads the locally pre-stored first padding content, according to the first padding content and the The second picture frame generates a third picture frame for display.

Preferably, the size of the first clipping region is determined by the current network condition, the size of the transmitted file, and the clarity of the transmitted picture.

Preferably, the method for transmitting a picture when transferring a file further includes:

Extracting a currently received fourth picture frame from the second terminal when simultaneously receiving pictures and files from the second terminal;

Obtaining a second clipping area in which the fourth picture frame is clipped; wherein the fourth picture frame has a second clipping area that is clipped;

Filling the second crop region of the fourth picture frame according to the second padding content to generate a fifth frame frame for display.

Preferably, the second padding content is a pop-up window having the same shape shape as the second clipping region of the fourth picture frame, and the pop-up window displays at least one of the following contents: a name of the file being transmitted, and a progress of the transmission. , remaining transmission time.

Preferably, the second trimming area of the fourth picture frame is filled according to the second padding content, and a fifth picture frame for displaying is generated, specifically:

And acquiring location information of the second clipping area of the fourth picture frame, where the location information of the second clipping area of the fourth picture frame is sent by the second terminal; or the location information of the second clipping area is read by Obtaining the locally stored default location information; or obtaining the location information of the second clipping region by parsing the fourth frame frame;

And rendering according to the second padding content, the location information of the second clipping region, and the fourth frame frame to generate a fifth frame frame.

The present invention also provides a method for transmitting a picture when transferring a file, comprising:

Extracting a currently received sixth picture frame from the third terminal when simultaneously receiving a picture and a file from the third terminal; wherein the sixth picture frame has a cropped third clipping area;

Reading the locally pre-stored third padding content;

Filling the third trimming area of the sixth picture frame according to the third padding content, and generating a seventh picture frame for display.

Preferably, the third padding content is a pop-up window having the same shape shape as the third clipping region of the sixth picture frame, and the pop-up window displays at least one of the following contents: a name of the file being transmitted, and a progress of the transmission. , remaining transmission time.

Preferably, the third trimming area of the sixth picture frame is filled according to the third padding content, Generate an eighth frame for display, specifically:

Acquiring the location information of the third clipping area of the sixth picture frame; where the location information of the third clipping area of the sixth picture frame is synchronously sent by the third terminal when transmitting the sixth picture frame; The location information of the third clipping area is obtained by reading the default location information stored locally; or the location information of the third clipping area is obtained by parsing the sixth picture frame;

And rendering according to the third padding content, the location information of the third clipping region, and the sixth frame frame to generate a seventh frame frame for display.

Obtaining an eighth picture frame currently transmitted to the fourth terminal when detecting a process of transmitting a file to the fourth terminal in a process of transmitting a picture to the fourth terminal;

And trimming a predetermined fourth clipping area on the eighth picture frame to generate a ninth picture frame;

Transmitting the ninth picture frame to the fourth terminal, so that after receiving the ninth picture frame, the fourth terminal reads the locally pre-stored fourth padding content, according to the fourth padding content and the The ninth picture frame generates a tenth picture frame for display.

At the sending terminal:

Obtaining an eleventh picture frame currently transmitted to the receiving terminal when detecting a process of transmitting a file to the receiving terminal in a process of transmitting a picture to the receiving terminal;

And cutting a fifth clipping area of the eleventh picture frame to generate a twelfth picture frame;

Transmitting the twelfth picture frame to the receiving terminal;

At the receiving terminal:

Receiving a twelfth picture frame sent by the sending terminal;

The locally pre-stored padding content is read, and a thirteenth frame frame for display is generated according to the padding content and the twelfth frame frame.

Preferably, the padding content is a pop-up window having the same shape shape as the trimming area of the eleventh picture frame, and the pop-up window displays at least one of the following contents: a name of the file being transmitted, a progress of the transmission, and a remaining transmission. time.

The present invention also provides an apparatus for transmitting a picture when transmitting a file, comprising:

a first picture frame acquiring unit, configured to detect the direction in the process of transmitting the picture to the first terminal Obtaining, by the first terminal, a process of transmitting a file, acquiring a first picture frame currently transmitted to the first terminal;

a screen clipping unit, configured to clip a predetermined first clipping area on the first picture frame to generate a second picture frame;

a picture sending unit, configured to send the second picture frame to the first terminal, so that after receiving the second picture frame, the first terminal reads the locally pre-stored first padding content, according to the first The padding content and the second picture frame generate a third picture frame for display.

a picture extracting unit, configured to: when receiving the picture and the file from the third terminal at the same time, extract the currently received sixth picture frame from the third terminal; wherein the sixth picture frame has the third cut that is clipped region;

Filling a content reading unit, configured to read the locally pre-stored third padding content;

a padding unit, configured to fill the third trimming area of the sixth picture frame according to the third padding content, and generate a seventh picture frame for display.

The present invention also provides a terminal comprising a processor, a memory, and a computer program stored in the memory; wherein the computer program is executable by the processor to implement a transfer of a file as described above when transferring a file Methods.

The present invention also provides a computer readable storage medium comprising a stored computer program, wherein, when the computer program is running, controlling a device in which the computer readable storage medium is executed performs as described above The method of transferring pictures when transferring files.

The method, the device, the terminal, and the computer readable storage medium for transmitting a picture when transmitting a file according to an embodiment of the present invention, when performing screen transmission and file transmission at the same time, trimming the first picture frame transmitted as one end of the transmission, generating The second picture frame is sent to the receiving terminal, which reduces the bandwidth resources required for transmitting the picture frame, and thus can use the part of the bandwidth resource for file transmission. The receiving end is rendered according to the second picture frame and the locally filled content, and a complete third picture frame is generated. According to the invention, when the screen transmission and the file transmission are simultaneously performed, the picture transmission quality, the picture transmission speed, the file transmission speed and the user visual experience can be balanced to meet the user's use requirements.

DRAWINGS

In order to more clearly illustrate the technical solutions of the present invention, the drawings used in the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention, which are common in the art. For the technicians, without the creative work, Other figures are obtained from these figures.

FIG. 1 is a schematic flowchart diagram of a method for transmitting a picture when a file is transmitted according to the first embodiment of the present invention.

FIG. 2 is a schematic diagram of trimming a first picture frame according to the first embodiment of the present invention.

FIG. 3 is a schematic diagram of rendering a third picture frame according to a second picture frame and padding content.

FIG. 4 is a schematic diagram of a first padding content according to a first embodiment of the present invention.

FIG. 5 is a schematic flowchart diagram of a method for transmitting a picture when a file is transmitted according to a second embodiment of the present invention.

FIG. 6 is a schematic flowchart diagram of a method for transmitting a picture when a file is transmitted according to a third embodiment of the present invention.

FIG. 7 is a schematic flowchart diagram of a method for transmitting a picture when a file is transmitted according to a fourth embodiment of the present invention.

FIG. 8 is a schematic flowchart diagram of a method for transmitting a picture when a file is transmitted according to a fifth embodiment of the present invention.

FIG. 9 is a schematic structural diagram of an apparatus for transmitting a picture when a file is transmitted according to a sixth embodiment of the present invention.

FIG. 10 is a schematic structural diagram of an apparatus for transmitting a picture when a file is transmitted according to a seventh embodiment of the present invention.

FIG. 11 is a schematic structural diagram of a terminal according to an eighth embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

The present invention provides a method, an apparatus, a terminal, and a computer readable storage medium for transmitting a picture when transferring a file, for cutting a transmitted picture frame at the same time for performing picture transmission and file transmission, so as to reduce the transmission picture. The required bandwidth, taking into account both picture transfer and file transfer. The details are described below separately.

Referring to FIG. 1, FIG. 1 is a schematic flowchart of a method for transmitting a picture when a file is transmitted according to a first embodiment of the present invention, which may be executed by a device that transmits a picture when transmitting a file, and includes the following steps:

S101. Acquire a first picture frame currently transmitted to the first terminal when detecting a process of transmitting a file to the first terminal in a process of transmitting a picture to the first terminal.

In this embodiment, the device (hereinafter referred to as the device) for transmitting a file when the file is transmitted may be a notebook computer, a desktop computer, a smart phone, a smart tablet computer, etc., and the present invention is not specifically limited.

In this embodiment, the first terminal may also be a notebook computer, a desktop computer, a smart phone, a smart tablet computer, etc., and the invention is not specifically limited.

In this embodiment, for example, a user of the device performs a video chat or a video conference with a user of the first terminal, and at this time, the device collects related images in real time (such as a user's personal image or conference). a document screen or the like is sent to the first terminal through a network, and the first terminal receives the screen and performs display.

In an actual situation, the user of the device may also need to send some files to the user of the first terminal, such as conference related materials, etc., at this time, when the device detects that the screen and the file are simultaneously sent to the first terminal. Get the first picture frame of the current transmission.

It should be noted that, in this embodiment, the number of the first terminals may be one or more, that is, the device is allowed to simultaneously transmit pictures to and simultaneously transmit files to multiple first terminals, and the present invention does not Specifically limited.

S102. Trim the predetermined first clipping area on the first picture frame to generate a second picture frame.

As shown in FIG. 2, in the embodiment, when detecting the process of transmitting a file during the screen transmission process, the device acquires the first picture frame A currently transmitted to the first terminal, and the first picture frame is The first trimming area C of the frame A is trimmed to generate a second picture frame B.

In this embodiment, the first trimming area C may be preset, such as located in the lower right corner of the first picture frame A. Of course, it should be noted that, in other embodiments of the present invention, the A clipping region C may also be other positions, such as an upper left corner, a lower left corner, an upper right corner, or upper, lower, left, and right sides, and the like, which is not specifically limited.

In addition, the first trimming area C may also be determined according to useful information of each area of the first picture frame A. For example, the transmitting terminal 100 may perform image extraction on the first picture frame A, acquire non-critical areas of the first picture frame A (such as some background environment areas), and set the non-key areas as the clipping area. These solutions are all within the scope of the present invention and will not be described herein.

In this embodiment, the size of the first cropping area C may be predefined, or may be determined according to current network conditions, the size of the file to be transmitted, and the resolution of the transmitted picture. For example, When the current network condition is good, the size of the first cropping area C may be set smaller. When the current network condition is relatively poor, the size of the first cropping area C may be set to be larger. When the transmitted file is relatively small, the size of the first cropping area C may be set smaller, and when the file to be transferred is relatively large, the size of the first cropping area C may be set to be larger. When the resolution of the transmitted picture is low, the size of the first cropping area C may be set smaller, and when the resolution of the transmitted picture is high, the size of the first cropping area C may be set larger. These solutions are all within the scope of the present invention and will not be described herein.

S103: Send the second picture frame to the first terminal, so that after receiving the second picture frame, the first terminal reads the locally pre-stored first padding content, according to the first padding content and the The second picture frame generates a third picture frame for display.

In this embodiment, as shown in FIG. 3, for the first terminal, after receiving the second picture frame B, the first pre-stored first padding content D is read, and according to the first padding content. D and the second picture frame B generate a third picture frame E and display it.

In this embodiment, the first padding content D may be a static picture, a prompt in loading, or a pop-up window associated with the file, and its size and shape are completely consistent with the first clipping area C. Preferably, as shown in FIG. 4, the first padding content D may be a pop-up window having the same shape shape as the first trimming region C of the first screen frame A, and the pop-up window displays at least the following content. One: the name of the file being transferred, the progress of the transfer, and the remaining transfer time.

In the embodiment of the present invention, the generating, by the first terminal, the third picture frame E according to the first padding content D and the second picture frame B is: first, the first terminal acquires the first picture The position information of the clipping area C of the frame A is then rendered according to the filling content D, the position information of the first clipping area C, and the second picture frame B, to generate a third picture frame E. The location information of the first clipping area C may be sent by the device to the first terminal, or may be obtained by reading the locally stored default location information by the first terminal, or may be The second picture frame is obtained by parsing, and is not specifically limited in the present invention.

In this embodiment, adding the first padding content D has two advantages, one is to maintain the integrity of the picture frame displayed on the first terminal, and does not generate a bad user visual experience; The information of the file transmission is displayed on the content D, so that the user of the first terminal can obtain the progress information of the file transmission in time, such as the name of the file being transmitted, the progress of the transmission, and the remaining transmission time. At the same time, since the first padding content D is stored locally on the first terminal, its rendering process does not occupy network bandwidth.

In summary, the method for transmitting a picture when transmitting a file according to the first embodiment of the present invention, when performing screen transmission and file transmission at the same time, by performing clipping on the transmitted first picture frame, generates a second The picture frame is sent to the first terminal, which reduces the bandwidth resources required for transmitting the picture frame, and thus can use the part of the bandwidth resource for file transmission. Based on the embodiment, when the screen transmission and the file transmission are simultaneously performed, the screen transmission quality, the screen transmission speed, the file transmission speed, and the user visual experience can be balanced to meet the user's use requirements.

Referring to FIG. 5, FIG. 5 is a schematic flowchart diagram of a method for transmitting a picture when a file is transmitted according to a second embodiment of the present invention.

Based on the first embodiment, the embodiment further includes the following steps:

S201: When receiving the picture and the file from the second terminal at the same time, extracting the currently received fourth picture frame; wherein the fourth picture frame has the second clipping area that is clipped.

S203. Read locally stored second padding content.

S204. Fill the second trimming area of the fourth picture frame according to the second padding content, and generate a fifth picture frame for display.

In the first embodiment, the device serves as a transmitting end of a picture and a file, and in some cases, the device can also serve as a receiving end of a picture and a file. For example, in this embodiment, when the user of the device and the user of the second terminal perform a video chat and a video conference, if the user of the second terminal sends a corresponding data file to the user of the device, At this time, the second terminal clips the currently transmitted picture to obtain a fourth picture frame, and sends the clipped fourth picture frame to the device, where the device obtains that the fourth picture frame is clipped. The second trimming area is then read, and the second pre-stored second filling content is read, and the second clipping area of the fourth picture frame is filled according to the second filling content to generate a fifth picture frame for display.

It should be noted that the second terminal in this embodiment may be the same terminal as the first terminal in the first embodiment, and may be different, and these solutions are all within the protection scope of the present invention, and details are not described herein.

The method for transmitting a picture when transmitting a file according to the second embodiment of the present invention, when receiving a picture and a file at the same time, filling and rendering the received fourth picture frame according to the locally stored second padding content to generate a complete fifth picture. frame. Based on the embodiment, when the screen transmission and the file transmission are simultaneously performed, the screen transmission quality, the screen transmission speed, the file transmission speed, and the user visual experience can be balanced to meet the user's use requirements.

Referring to FIG. 6, FIG. 6 is a schematic flowchart diagram of a method for transmitting a picture when a file is transmitted according to a third embodiment of the present invention. It can be executed by a device (hereinafter referred to as a device) that transmits a picture when transferring a file. And includes the following steps:

S301. When receiving the picture and the file from the third terminal at the same time, extracting the currently received sixth picture frame from the third terminal.

In this embodiment, the device may be a notebook computer, a desktop computer, a smart phone, a smart tablet, etc., and the invention is not specifically limited.

In this embodiment, the third terminal may also be a notebook computer, a desktop computer, a smart phone, a smart tablet computer, etc., and the invention is not specifically limited.

In this embodiment, when the third terminal simultaneously sends a picture and a file to the device, the third terminal clips the third clipping area of the currently transmitted picture frame to obtain a sixth picture frame.

S302. Read locally stored third padding content.

The third padding content may be a pop-up window having the same shape shape as the third trimming region of the sixth screen frame, and the pop-up window displays at least one of the following contents: the name of the file being transmitted, and the progress of the transmission. , remaining transmission time.

S303. Fill the third trimming area of the sixth picture frame according to the third padding content, and generate a seventh picture frame for display.

The location information of the third clipping area of the sixth picture frame is obtained, and the location information of the third clipping area may be synchronously sent by the third terminal when sending the sixth picture frame. It can also be obtained by reading the default location information stored locally by the device, and can also be obtained by parsing the sixth frame frame, which is not specifically limited by the present invention.

After obtaining the location information, the device may perform rendering according to the third padding content, the location information of the third clipping region, and the sixth frame frame to generate a seventh frame frame for display.

The method for transmitting a picture when transmitting a file according to the third embodiment of the present invention, when receiving a picture and a file at the same time, filling and rendering the received sixth picture frame according to the locally stored third padding content to generate a complete seventh picture. frame. Based on the embodiment, when the screen transmission and the file transmission are simultaneously performed, the screen transmission quality, the screen transmission speed, the file transmission speed, and the user visual experience can be balanced to meet the user's use requirements.

Referring to FIG. 7, FIG. 7 is a schematic flowchart diagram of a method for transmitting a picture when a file is transmitted according to a fourth embodiment of the present invention.

S401. Acquire an eighth picture frame that is currently transmitted when a process of transmitting a file to the fourth terminal is detected in a process of transmitting a picture to the fourth terminal.

S402. Cut a predetermined fourth clipping area on the eighth picture frame to generate a ninth picture frame.

S403. The ninth picture frame is sent to the fourth terminal, so that after receiving the ninth picture frame, the fourth terminal reads the locally pre-stored fourth padding content, according to the fourth padding content. And the ninth picture frame generates a tenth picture frame for display.

The fourth padding content is a pop-up window having the same shape shape as the fourth trimming region, and the pop-up window displays at least one of the following contents: a name of a file being transmitted, a progress of transmission, and a remaining transmission time.

In the foregoing third embodiment, the device is used as a receiving end. In the following case, the device may also serve as a transmitting end. The specific implementation principle is similar to that described in the first embodiment of the present invention, and the present invention does not Make specific limits.

Referring to FIG. 8, FIG. 8 is a schematic flowchart diagram of a method for transmitting a picture when a file is transmitted according to a fifth embodiment of the present invention. It includes:

At the sending terminal:

S501: Acquire an eleventh picture frame that is currently transmitted when a process of transmitting a file to the receiving terminal is detected in a process of transmitting a picture to the receiving terminal;

S502, trimming a fifth clipping area of the eleventh picture frame to generate a twelfth picture frame;

S503. Send the twelfth picture frame to the receiving terminal.

At the receiving terminal:

S504. Receive a twelfth picture frame sent by the sending terminal.

S505. Read the locally pre-stored padding content, and generate a thirteenth frame frame for display according to the padding content and the twelfth frame frame.

The padding content is a pop-up window having the same shape shape as the trimming area of the eleventh picture frame, and the pop-up window displays at least one of the following contents: the name of the file being transmitted, the progress of the transmission, and the remaining transmission time. .

The method for transmitting a picture when transmitting a file according to the fifth embodiment of the present invention generates a twelfth picture frame by trimming the transmitted eleventh picture frame while performing picture transmission and file transmission at the same time. Sending to the receiving terminal reduces the bandwidth resources required for transmitting the picture frame, and thus can use the part of the bandwidth resource for file transmission. At the same time, at the receiving terminal, the twelfth picture frame is filled with the padding content to generate a complete thirteenth picture frame. Based on the embodiment, when the screen transmission and the file transmission are simultaneously performed, the screen transmission quality, the screen transmission speed, the file transmission speed, and the user visual experience can be balanced to meet the user's use requirements.

Referring to FIG. 9, FIG. 9 is a schematic structural diagram of an apparatus for transmitting a picture when a file is transmitted according to a sixth embodiment of the present invention. The device 600 for transmitting a picture when transmitting a file includes:

The first picture frame obtaining unit 610 is configured to acquire a first picture frame that is currently transmitted when a process of transmitting a file to the first terminal is detected in a process of transmitting a picture to the first terminal.

The screen clipping unit 620 is configured to clip a predetermined first clipping area on the first picture frame to generate a second picture frame.

The picture sending unit 630 is configured to send the second picture frame to the first terminal, so that after receiving the second picture frame, the first terminal reads the locally pre-stored first padding content, according to the A padding content and the second frame frame generate a third frame frame for display.

Wherein, preferably, the size of the first clipping area is determined by the current network condition, the size of the transmitted file, and the clarity of the transmitted picture.

Preferably, the apparatus 600 for transmitting a picture when transmitting a file further includes:

a fourth picture frame receiving unit, configured to: when receiving the picture and the file from the second terminal at the same time, extract the currently received fourth picture frame;

a second clipping area obtaining unit, configured to obtain a second clipping area in which the fourth picture frame is clipped;

a second padding content reading unit, configured to read the locally pre-stored second padding content;

a padding unit, configured to fill the second clipping region of the fourth picture frame according to the second padding content, and generate a fifth frame frame for display.

Preferably, the filling unit specifically includes:

a location information acquiring module, configured to acquire location information of a second clipping area of the fourth picture frame, where location information of the second clipping area of the fourth picture frame is sent by the second terminal; or The location information of the second clipping area is obtained by reading the default location information stored locally; or the location information of the second clipping area is obtained by parsing the fourth picture frame;

And a rendering module, configured to generate, according to the second padding content, the location information of the second clipping region, and the fourth frame frame, to generate a fifth frame frame.

Referring to FIG. 10, FIG. 10 is a schematic structural diagram of an apparatus for transmitting a picture when a file is transmitted according to a seventh embodiment of the present invention. The apparatus 700 for transmitting a picture when transmitting a file includes:

The picture extracting unit 710 is configured to extract the currently received sixth picture frame when simultaneously receiving the picture and the file from the third terminal. The sixth picture frame has a third trimmed area that is clipped.

The content reading unit 720 is configured to read the locally pre-stored third padding content.

The filling unit 730 is configured to fill the third trimming area of the sixth picture frame according to the third padding content, and generate a seventh picture frame for display.

The third padding content is a pop-up window having the same shape shape as the third trimming region of the sixth screen frame, and the pop-up window displays at least one of the following contents: a name of the file being transmitted, a progress of the transmission, and a remaining transmission. time.

Preferably, the filling unit 730 is configured to acquire location information of a third clipping area of the sixth picture frame, where location information of the third clipping area of the sixth picture frame is sent by the third terminal. The sixth picture frame is synchronously transmitted; or the location information of the third clipping area is obtained by reading the locally stored default location information; or the location information of the third clipping area is passed to the sixth picture frame. Analytically obtained;

Preferably, the method further comprises:

An eighth picture frame acquiring unit, configured to acquire an eighth picture frame currently transmitted when a process of transmitting a file to the fourth terminal is detected in a process of transmitting a picture to the fourth terminal;

a fourth clipping area cropping unit, configured to trim a predetermined fourth clipping area on the eighth picture frame to generate a ninth picture frame;

a ninth picture frame sending unit, configured to send the ninth picture frame to the fourth terminal, so that the fourth terminal reads the locally pre-stored fourth padding content after receiving the ninth picture frame, Generating a tenth picture frame for display according to the fourth padding content and the ninth picture frame.

Referring to FIG. 11, an eighth embodiment of the present invention further provides a terminal, including a processor 801, a memory 802, and a computer program 803 stored in the memory 802. The computer program 803 can be used by the processor. 801 is executed to implement the methods described in the first to fourth embodiments described above.

It should be noted that, in this embodiment, an application software 804 having a screen transmission function and a file transmission function, such as QQ and the like, may be stored in the memory, and the computer program 803 may be used as a plug-in of the application software 804. presence.

In this embodiment, the terminal may further include at least one network interface 807 or other user interface 806 at least one communication bus 805. Communication bus 805 is used to implement connection communication between these components. The user interface 806 can optionally include a USB interface and other standard interfaces and wired interfaces. Network interface 807 can optionally include a Wi-Fi interface as well as other wireless interfaces.

The terminal provided in this embodiment cuts the transmitted picture frame when performing picture transmission and file transmission at the same time, which reduces the bandwidth resource required for transmitting the picture frame, and can further utilize the part of the bandwidth resource for file transmission. When performing screen reception and file reception, the locally pre-stored padding content is read, and rendered according to the padding content and the currently received frame frame to generate a complete picture frame for display. According to the embodiment of the present invention, when the screen transmission and the file transmission are simultaneously performed, the picture transmission quality, the picture transmission speed, the file transmission speed, and the user visual experience can be balanced to meet the user's use requirements.

A ninth embodiment of the present invention also provides a computer readable storage medium comprising a stored computer program, wherein a device in which the computer readable storage medium is located is executed while the computer program is running The method as described in the first to fourth embodiments above.

The above disclosure is only a preferred embodiment of the present invention, and of course, the scope of the present invention is not limited thereto, and those skilled in the art can understand all or part of the process of implementing the above embodiments, and according to the present invention. The equivalent changes required are still within the scope of the invention.

One of ordinary skill in the art can understand that all or part of the process of implementing the foregoing embodiments can be completed by a computer program to instruct related hardware, and the program can be stored in a computer readable storage medium. When executed, the flow of an embodiment of the methods as described above may be included. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

Claims

A method for transmitting a picture when transferring a file, comprising:

Obtaining a first picture frame currently transmitted to the first terminal when detecting a process of transmitting a file to the first terminal in a process of transmitting a picture to the first terminal;

Trimming a predetermined first clipping area on the first picture frame to generate a second picture frame;

Transmitting the second picture frame to the first terminal, so that after receiving the second picture frame, the first terminal reads the locally pre-stored first padding content, according to the first padding content and the The second picture frame generates a third picture frame for display.
The method of transmitting a picture while transferring a file according to claim 1, wherein the size of the first clipping area is determined by a current network condition, a size of the transmitted file, and a sharpness of the transmitted picture.
The method for transmitting a picture when transferring a file according to claim 1, wherein the method for transmitting a picture when transferring a file further comprises:

Extracting a currently received fourth picture frame from the second terminal when simultaneously receiving a picture and a file from the second terminal; wherein the fourth picture frame has a second cropped area that is clipped;

Reading the locally pre-stored second padding content;

Filling the second crop region of the fourth picture frame according to the second padding content to generate a fifth frame frame for display.
A method of transmitting a picture while transmitting a file according to claim 3, wherein

The second padding content is a pop-up window having the same shape shape as the second trimming region of the fourth picture frame, and the pop-up window displays at least one of the following contents: the name of the file being transmitted, the progress of the transmission, and the remaining transmission. time.
The method of transmitting a picture at the time of transferring a file according to claim 3, wherein the filling the second cropping area of the fourth picture frame according to the second padding content, generating a page for display Five-picture frame, specifically:

And acquiring location information of the second clipping area of the fourth picture frame, where the location information of the second clipping area of the fourth picture frame is sent by the second terminal; or the location information of the second clipping area is read by Obtaining the locally stored default location information; or obtaining the location information of the second clipping region by parsing the fourth frame frame;

And rendering according to the second padding content, the location information of the second clipping region, and the fourth frame frame to generate a fifth frame frame.
A method for transmitting a picture when transferring a file, comprising:

Extracting a currently received sixth picture frame from the third terminal when simultaneously receiving a picture and a file from the third terminal; wherein the sixth picture frame has a cropped third clipping area;

Reading the locally pre-stored third padding content;

Filling the third trimming area of the sixth picture frame according to the third padding content, and generating a seventh picture frame for display.
A method of transmitting a picture when transferring a file according to claim 6, wherein

The third padding content is a pop-up window having the same shape shape as the third trimming region of the sixth screen frame, and the pop-up window displays at least one of the following contents: a name of the file being transmitted, a progress of the transmission, and a remaining transmission. time.
The method for transmitting a picture when transferring a file according to claim 7, wherein the filling the third clipping area of the sixth picture frame according to the third padding content, generating an eighth picture for display Frame, specifically:

Acquiring the location information of the third clipping area of the sixth picture frame; where the location information of the third clipping area of the sixth picture frame is synchronously sent by the third terminal when transmitting the sixth picture frame; The location information of the third clipping area is obtained by reading the default location information stored locally; or the location information of the third clipping area is obtained by parsing the sixth picture frame;

And rendering according to the third padding content, the location information of the third clipping region, and the sixth frame frame to generate a seventh frame frame for display.
A method of transmitting a picture while transferring a file according to claim 6, wherein The method for transmitting a picture when transferring a file further includes:

Obtaining an eighth picture frame currently transmitted to the fourth terminal when detecting a process of transmitting a file to the fourth terminal in a process of transmitting a picture to the fourth terminal;

And trimming a predetermined fourth clipping area on the eighth picture frame to generate a ninth picture frame;

Transmitting the ninth picture frame to the fourth terminal, so that after receiving the ninth picture frame, the fourth terminal reads the locally pre-stored fourth padding content, according to the fourth padding content and the The ninth picture frame generates a tenth picture frame for display.
A method for transmitting a picture when transferring a file, comprising:

At the sending terminal:

Obtaining an eleventh picture frame currently transmitted to the receiving terminal when detecting a process of transmitting a file to the receiving terminal in a process of transmitting a picture to the receiving terminal;

And cutting a fifth clipping area of the eleventh picture frame to generate a twelfth picture frame;

Transmitting the twelfth picture frame to the receiving terminal;

At the receiving terminal:

Receiving a twelfth picture frame sent by the sending terminal;

The locally pre-stored padding content is read, and a thirteenth frame frame for display is generated according to the padding content and the twelfth frame frame.
A method of transmitting a picture when transferring a file according to claim 10, wherein

The padding content is a pop-up window having the same shape shape as the trimming area of the eleventh picture frame, and the pop-up window displays at least one of the following contents: a name of a file being transmitted, a progress of transmission, and a remaining transmission time.
An apparatus for transmitting a picture when transmitting a file, comprising:

a first picture frame acquiring unit, configured to: when detecting a process of transmitting a file to the first terminal in a process of transmitting a picture to the first terminal, acquiring a first picture frame currently transmitted to the first terminal;

a screen clipping unit, configured to clip a predetermined first clipping area on the first picture frame to generate a second picture frame;

a picture sending unit, configured to send the second picture frame to the first terminal, so that after receiving the second picture frame, the first terminal reads the locally pre-stored first padding content, according to the first The padding content and the second picture frame generate a third picture frame for display.
An apparatus for transmitting a picture when transmitting a file, comprising:

a picture extracting unit, configured to: when receiving the picture and the file from the third terminal at the same time, extract the currently received sixth picture frame from the third terminal; wherein the sixth picture frame has the third cut that is clipped region;

Filling a content reading unit, configured to read the locally pre-stored third padding content;

a padding unit, configured to fill the third trimming area of the sixth picture frame according to the third padding content, and generate a seventh picture frame for display.
A terminal, comprising: a processor, a memory, and a computer program stored in the memory; wherein the computer program is executable by the processor to implement any of claims 1 to 9 The method of transmitting a picture when transferring a file.
A computer readable storage medium, comprising: a stored computer program, wherein the computer readable storage medium is controlled to execute the apparatus as claimed in claim 1 A method of transmitting a picture when transferring a file as described in any of the preceding claims.