CN107612881B - Method, device, terminal and storage medium for transmitting picture during file transmission - Google Patents
Method, device, terminal and storage medium for transmitting picture during file transmission Download PDFInfo
- Publication number
- CN107612881B CN107612881B CN201710650436.9A CN201710650436A CN107612881B CN 107612881 B CN107612881 B CN 107612881B CN 201710650436 A CN201710650436 A CN 201710650436A CN 107612881 B CN107612881 B CN 107612881B
- Authority
- CN
- China
- Prior art keywords
- picture frame
- transmitting
- picture
- terminal
- file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 86
- 238000000034 method Methods 0.000 title claims abstract description 80
- 239000000945 filler Substances 0.000 claims description 17
- 238000004590 computer program Methods 0.000 claims description 14
- 238000009877 rendering Methods 0.000 claims description 13
- 238000010586 diagram Methods 0.000 description 8
- 230000000007 visual effect Effects 0.000 description 7
- 238000004891 communication Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000009966 trimming Methods 0.000 description 2
- 208000003028 Stuttering Diseases 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a method for transmitting pictures during file transmission, which comprises the following steps: when a process of transmitting a file to a first terminal is detected in the process of transmitting a picture to the first terminal, acquiring a first picture frame transmitted currently; clipping a preset first clipping area on the first picture frame to generate a second picture frame; and sending the second picture frame to the first terminal, so that the first terminal reads locally pre-stored first filling content after receiving the second picture frame, and generates a third picture frame for display according to the first filling content and the second picture frame. The invention also discloses a device, a terminal and a computer readable storage medium for transmitting the picture when transmitting the file, which can realize the simultaneous transmission of the file and the picture without influencing the picture quality, the picture transmission speed and the file transmission speed.
Description
Technical Field
The present invention relates to the field of data transmission, and in particular, to a method, a system, and a terminal for transmitting a frame when transmitting a file.
Background
The popularization and development of the internet and the network technology bring revolutionary changes to the life and work of people, and through the internet and the network technology, people can realize online shopping and online office without leaving home, thereby bringing great convenience to the work and life of people. For example, a teleconference or a video conference based on a network can allow people at different places to carry out a conference of face-to-face conversations through a communication device and the network, thereby achieving the purpose of carrying out the conference across areas.
The remote conference refers to a video conference, and voice and video images are interactively shared in a remote way. For teleconferencing, the primary considerations are whether the transmission of speech and video images is timely, and whether the display of the video images is clear and smooth. However, in the teleconference, since data file transmission is often required, bandwidth for picture transmission is occupied during the data file transmission process, and further, problems of picture stuttering, picture quality degradation, or file transmission discontinuity are caused.
Disclosure of Invention
In view of the foregoing problems, an object of the present invention is to provide a method, an apparatus, a terminal and a computer-readable storage medium for transmitting a picture during file transmission, which can simultaneously transmit a file and a picture without affecting picture quality, picture transmission speed and file transmission speed.
The invention provides a method for transmitting pictures when transmitting files, which comprises the following steps:
when a process of transmitting a file to a first terminal is detected in the process of transmitting a picture to the first terminal, acquiring a first picture frame currently transmitted to the first terminal;
clipping a preset first clipping area on the first picture frame to generate a second picture frame;
and sending the second picture frame to the first terminal, so that the first terminal reads locally pre-stored first filling content after receiving the second picture frame, and generates a third picture frame for display according to the first filling content and the second picture frame.
Preferably, the size of the first cropping zone is determined by the current network conditions, the size of the file to be transmitted and the sharpness of the picture to be transmitted.
Preferably, the method for transmitting a picture when transmitting a file further includes:
when receiving a picture and a file from a second terminal at the same time, extracting a fourth picture frame currently received from the second terminal;
obtaining a second cropping area in which the fourth picture frame is cropped; wherein the fourth picture frame has a cropped second crop area;
and filling the second cropping area of the fourth picture frame according to the second filling content to generate a fifth picture frame for display.
Preferably, the second filler content is a popup that is the same size as the second cropping zone shape of the fourth picture frame and displays at least one of: the name of the file being transferred, the progress of the transfer, the remaining transfer time.
Preferably, the filling the second cropping zone of the fourth picture frame according to the second filling content to generate a fifth picture frame for display includes:
acquiring position information of a second cropping area of the fourth picture frame; wherein the position information of the second cropping zone of the fourth picture frame is transmitted by a second terminal; or the position information of the second cropping zone is obtained by reading locally stored default position information; or the position information of the second cropping zone is obtained by analyzing the fourth picture frame;
and rendering according to the second filling content, the position information of the second cutting area and the fourth picture frame to generate a fifth picture frame.
The invention also provides a method for transmitting pictures during file transmission, which comprises the following steps:
when a picture and a file from a third terminal are received at the same time, extracting a currently received sixth picture frame from the third terminal; wherein the sixth picture frame has a third cropping area cropped;
reading third filling content prestored locally;
and filling the third cropping area of the sixth picture frame according to the third filling content to generate a seventh picture frame for display.
Preferably, the third filler content is a popup window having the same size as the third cropping zone shape of the sixth picture frame, and the popup window displays at least one of: the name of the file being transferred, the progress of the transfer, the remaining transfer time.
Preferably, the filling the third cropping zone of the sixth picture frame according to the third filling content to generate an eighth picture frame for display includes:
acquiring position information of a third cropping area of the sixth picture frame; wherein the position information of the third cropping zone of the sixth picture frame is synchronously transmitted by a third terminal when transmitting the sixth picture frame; or the position information of the third cropping zone is obtained by reading locally stored default position information; or the position information of the third cropping zone is obtained by analyzing the sixth picture frame;
and rendering according to the third filling content, the position information of the third cutting area and the sixth picture frame to generate a seventh picture frame for display.
Preferably, the method for transmitting a picture when transmitting a file further includes:
when a process of transmitting a file to a fourth terminal is detected in the process of transmitting a picture to the fourth terminal, acquiring an eighth picture frame currently transmitted to the fourth terminal;
clipping a predetermined fourth clipping region on the eighth picture frame to generate a ninth picture frame;
and sending the ninth picture frame to the fourth terminal, so that the fourth terminal reads locally pre-stored fourth filling content after receiving the ninth picture frame, and generates a tenth picture frame for display according to the fourth filling content and the ninth picture frame.
The invention also provides a method for transmitting pictures during file transmission, which comprises the following steps:
at a sending terminal:
when a process of transmitting a file to a receiving terminal is detected in the process of transmitting a picture to the receiving terminal, acquiring an eleventh picture frame currently transmitted to the receiving terminal;
clipping a fifth clipping region of the eleventh picture frame to generate a twelfth picture frame;
transmitting the twelfth picture frame to the receiving terminal;
at a receiving terminal:
receiving a twelfth picture frame sent by the sending terminal;
and reading the filling content pre-stored locally, and generating a thirteenth picture frame for display according to the filling content and the twelfth picture frame.
Preferably, the filler is a popup that displays at least one of the following: the name of the file being transferred, the progress of the transfer, the remaining transfer time.
The invention also provides a device for transmitting pictures when transmitting files, which comprises:
the device comprises a first picture frame acquisition unit, a second picture frame acquisition unit and a file transmission unit, wherein the first picture frame acquisition unit is used for acquiring a first picture frame currently transmitted to a first terminal when a process of transmitting a file to the first terminal is detected in the process of transmitting a picture to the first terminal;
the picture cutting unit is used for cutting a preset first cutting area on the first picture frame to generate a second picture frame;
and the picture sending unit is used for sending the second picture frame to the first terminal so that the first terminal reads the locally pre-stored first filling content after receiving the second picture frame, and generates a third picture frame for display according to the first filling content and the second picture frame.
The invention also provides a device for transmitting pictures when transmitting files, which comprises:
a picture extracting unit for extracting a sixth picture frame currently received from the third terminal when the picture and the file are simultaneously received from the third terminal; wherein the sixth picture frame has a third cropping area cropped;
the filling content reading unit is used for reading third filling content which is pre-stored locally;
a filling unit, configured to fill the third cropping zone of the sixth picture frame according to the third filling content, and generate a seventh picture frame for display.
The invention also provides a terminal, which comprises a processor, a memory and a computer program stored in the memory; wherein the computer program is executable by the processor to implement a method of transmitting a picture when transmitting a file as described above.
The invention also provides a computer-readable storage medium, which includes a stored computer program, wherein when the computer program runs, a device where the computer-readable storage medium is located is controlled to execute the method for transmitting the picture when the file is transmitted.
According to the method, the device, the terminal and the computer readable storage medium for transmitting the picture during file transmission, when picture transmission and file transmission are carried out simultaneously, the first picture frame transmitted is cut as a transmitting end, the second picture frame is generated and transmitted to the receiving terminal, bandwidth resources required by picture frame transmission are reduced, and further the part of the bandwidth resources can be utilized for file transmission. And rendering the received end according to the second picture frame and the filling content stored locally to generate a complete third picture frame. Based on the invention, when the picture transmission and the file transmission are carried out simultaneously, the picture transmission quality, the picture transmission speed, the file transmission speed and the user visual experience can be considered, and the use requirements of users are met.
Drawings
In order to more clearly illustrate the technical solution of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart illustrating a method for transmitting a frame when transmitting a file according to a first embodiment of the present invention.
Fig. 2 is a schematic diagram of cropping a first picture frame according to a first embodiment of the present invention.
FIG. 3 is a schematic diagram of rendering a third frame according to the second frame and the fill content.
Fig. 4 is a schematic diagram of first filler content provided by the first embodiment of the present invention.
Fig. 5 is a flowchart illustrating a method for transmitting a frame when transmitting a file according to a second embodiment of the present invention.
Fig. 6 is a flowchart illustrating a method for transmitting a frame when transmitting a file according to a third embodiment of the present invention.
Fig. 7 is a flowchart illustrating a method for transmitting a frame when transmitting a file according to a fourth embodiment of the present invention.
Fig. 8 is a flowchart illustrating a method for transmitting a frame when transmitting a file according to a fifth embodiment of the present invention.
Fig. 9 is a schematic structural diagram of an apparatus for transmitting a picture when transmitting a file according to a sixth embodiment of the present invention.
Fig. 10 is a schematic structural diagram of an apparatus for transmitting a picture when transmitting a file according to a seventh embodiment of the present invention.
Fig. 11 is a schematic structural diagram of a terminal according to an eighth embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention provides a method, a device, a terminal and a computer readable storage medium for transmitting pictures when transmitting files, which are used for clipping transmitted picture frames when picture transmission and file transmission are carried out simultaneously so as to reduce the bandwidth required by picture transmission and further give consideration to both picture transmission and file transmission. Each of which is described in detail below.
Referring to fig. 1, fig. 1 is a flowchart illustrating a method for transmitting a frame during file transmission according to a first embodiment of the present invention, which can be executed by a device for transmitting a frame during file transmission, and includes the following steps:
s101, when a process of transmitting a file to a first terminal is detected in the process of transmitting a picture to the first terminal, acquiring a first picture frame currently transmitted to the first terminal.
In this embodiment, the device for transmitting the picture during transmitting the file (hereinafter referred to as a device) may be a notebook computer, a desktop computer, a smart phone, a smart tablet computer, and the like, and the invention is not limited in particular.
In this embodiment, the first terminal may also be a notebook computer, a desktop computer, a smart phone, a smart tablet computer, and the like, and the invention is not limited in particular.
In this embodiment, for example, when a user of the apparatus and a user of the first terminal are performing a video chat or a video conference, the apparatus collects a relevant picture (such as a personal image of the user or a conference document picture) in real time and sends the relevant picture to the first terminal through a network, and the first terminal receives and displays the picture.
In practical situations, the user of the apparatus may also need to send some files to the user of the first terminal, such as meeting related materials, and at this time, when the apparatus detects that the picture and the file are sent to the first terminal at the same time, the first picture frame currently transmitted is acquired.
It should be noted that, in this embodiment, the number of the first terminals may be one or more, that is, the apparatus is allowed to simultaneously transmit the screen and simultaneously transmit the file to a plurality of first terminals, and the present invention is not particularly limited.
S102, clipping a preset first clipping area on the first picture frame to generate a second picture frame.
As shown in fig. 2, in this embodiment, when the device detects a file transmission process during a picture transmission process, the device acquires a first picture frame a currently transmitted to a first terminal, and clips a first clipping region C of the first picture frame a to generate a second picture frame B.
In this embodiment, the first cropping area C may be preset, for example, located at a lower right corner of the first picture frame a, but it should be noted that in other embodiments of the present invention, the first cropping area C may also be located at other positions, for example, at an upper left corner, a lower left corner, an upper right corner, or at upper, lower, left, and right side edges, and the present invention is not limited in particular.
The first cropping zone C may be determined based on useful information about each area of the first picture frame a. For example, the sending terminal 100 may perform image extraction on the first picture frame a, obtain non-key areas (e.g., some background environment areas) of the first picture frame a, and set the non-key areas as clipping areas, which are within the protection scope of the present invention and are not described herein again.
In this embodiment, the size of the first cropping area C may be predefined, or may be determined according to the current network condition, the size of the transmitted file, and the definition of the transmitted picture, for example, when the current network condition is good, the size of the first cropping area C may be set to be smaller, and when the current network condition is poor, the size of the first cropping area C may be set to be larger. The size of the first trimming area C may be set to be smaller when the transmitted file is smaller, and the size of the first trimming area C may be set to be larger when the transmitted file is larger. The size of the first clipping region C may be set to be smaller when the definition of the transmitted picture is lower, and the size of the first clipping region C may be set to be larger when the definition of the transmitted picture is higher.
S103, sending the second picture frame to a first terminal, so that the first terminal reads locally pre-stored first filling content after receiving the second picture frame, and generating a third picture frame for display according to the first filling content and the second picture frame.
In this embodiment, as shown in fig. 3, after receiving the second frame B, the first terminal reads a first filling content D pre-stored locally, and generates and displays a third frame E according to the first filling content D and the second frame B.
In this embodiment, the first filler D may be a still picture, a prompt in loading, or a pop-up window associated with a file, and the size and shape of the first filler D are completely consistent with those of the first cropping area C. Preferably, as shown in fig. 4, the first filler D may be a popup window having the same size as the first cropping area C of the first picture frame a, and the popup window displays at least one of the following: the name of the file being transferred, the progress of the transfer, the remaining transfer time.
In this embodiment of the present invention, the generating, by the first terminal, the third frame E according to the first filler content D and the second frame B specifically includes: first, the first terminal obtains position information of a cropping area C of the first picture frame a, and then renders according to the filling content D, the position information of the first cropping area C, and the second picture frame B, to generate a third picture frame E. The position information of the first cropping zone C may be sent to the first terminal by the apparatus, or may be obtained by the first terminal by reading locally stored default position information, or may be obtained by parsing the second picture frame, which is not limited in the present invention.
In this embodiment, the addition of the first filler content D has two advantages, one is to keep the integrity of the frame displayed on the first terminal, so as not to generate bad user visual experience; secondly, by displaying the file transmission information on the first filling content D, the user of the first terminal can obtain the file transmission progress information in time, such as the name of the file being transmitted, the transmission progress, the remaining transmission time, and the like. Meanwhile, since the first filler content D is stored locally in the first terminal, the rendering process thereof does not occupy network bandwidth.
In summary, the method for transmitting frames during file transmission according to the first embodiment of the present invention generates the second frame to be sent to the first terminal by clipping the transmitted first frame when performing the frame transmission and the file transmission simultaneously, so as to reduce the bandwidth resources required for transmitting the frame, and further, can use the bandwidth resources to perform the file transmission. Based on the embodiment, when the picture transmission and the file transmission are carried out simultaneously, the picture transmission quality, the picture transmission speed, the file transmission speed and the user visual experience can be considered, and the use requirements of users are met.
Referring to fig. 5, fig. 5 is a flowchart illustrating a method for transmitting a frame during file transmission according to a second embodiment of the present invention.
On the basis of the first embodiment, the present embodiment further includes the following steps:
s201, when receiving the picture and the file from the second terminal at the same time, extracting a fourth picture frame currently received; wherein the fourth picture frame has a second cropping area cropped.
And S203, reading the second filling content pre-stored locally.
S204, filling the second cropping zone of the fourth picture frame according to the second filling content, and generating a fifth picture frame for display.
In the first embodiment, the apparatus serves as a sending end of the picture and the file, and in some cases, the apparatus may also serve as a receiving end of the picture and the file. For example, in this embodiment, in the process of performing a video chat and a video conference between the user of the apparatus and the user of the second terminal, if the user of the second terminal sends a corresponding material file to the user of the apparatus, at this time, the second terminal crops a currently transmitted picture to obtain a fourth picture frame, and sends the cropped fourth picture frame to the apparatus, the apparatus obtains a cropped second cropping area of the fourth picture frame, then reads a locally pre-stored second filling content, and fills the second cropping area of the fourth picture frame according to the second filling content to generate a fifth picture frame for display.
It should be noted that the second terminal in this embodiment may be the same terminal as the first terminal in the first embodiment, or may be different, and these schemes are within the protection scope of the present invention, and are not described herein again.
In the method for transmitting a picture during file transmission according to the second embodiment of the present invention, when a picture and a file are received at the same time, a fourth picture frame received is subjected to padding rendering according to second padding content stored locally, so as to generate a complete fifth picture frame. Based on the embodiment, when the picture transmission and the file transmission are carried out simultaneously, the picture transmission quality, the picture transmission speed, the file transmission speed and the user visual experience can be considered, and the use requirements of users are met.
Referring to fig. 6, fig. 6 is a flowchart illustrating a method for transmitting a frame during file transmission according to a third embodiment of the present invention. Which can be performed by a device for transmitting pictures when transmitting a file (hereinafter, referred to as a device) and includes the steps of:
s301, when receiving a picture and a file from the third terminal at the same time, extracting a sixth picture frame currently received from the third terminal.
In this embodiment, the device may be a notebook computer, a desktop computer, a smart phone, a smart tablet computer, and the like, and the invention is not limited in particular.
In this embodiment, the third terminal may also be a notebook computer, a desktop computer, a smart phone, a smart tablet computer, and the like, and the invention is not limited in particular.
In this embodiment, when the third terminal sends the picture and the file to the apparatus at the same time, the third terminal may crop the third cropping zone of the currently transmitted picture frame to obtain a sixth picture frame.
And S302, reading the third filling content pre-stored locally.
Wherein the third filler content may be a popup that displays at least one of: the name of the file being transferred, the progress of the transfer, the remaining transfer time.
S303, filling the third cropping zone of the sixth picture frame according to the third filling content, and generating a seventh picture frame for display.
When filling, position information of a third cropping area of the sixth picture frame needs to be acquired first, where the position information of the third cropping area may be synchronously transmitted by a third terminal when the sixth picture frame is transmitted, or may be acquired by reading default position information locally stored in the apparatus; the sixth picture frame may also be obtained by parsing, and the present invention is not limited in particular.
After obtaining the position information, the apparatus may render the third filling content, the position information of the third cropping area, and the sixth screen frame to generate a seventh screen frame for display.
In the method for transmitting a picture during file transmission according to the third embodiment of the present invention, when a picture and a file are received at the same time, a received sixth picture frame is subjected to padding rendering according to third padding content stored locally, so as to generate a complete seventh picture frame. Based on the embodiment, when the picture transmission and the file transmission are carried out simultaneously, the picture transmission quality, the picture transmission speed, the file transmission speed and the user visual experience can be considered, and the use requirements of users are met.
Referring to fig. 7, fig. 7 is a flowchart illustrating a method for transmitting a frame during file transmission according to a fourth embodiment of the present invention.
On the basis of the first embodiment, the present embodiment further includes the following steps:
s401, when detecting the process of transmitting the file to the fourth terminal in the process of transmitting the picture to the fourth terminal, acquiring the eighth picture frame which is transmitted currently.
S402, cropping a predetermined fourth cropping zone on the eighth screen frame to generate a ninth screen frame.
And S403, sending the ninth picture frame to the fourth terminal, so that the fourth terminal reads locally pre-stored fourth filling content after receiving the ninth picture frame, and generates a tenth picture frame for display according to the fourth filling content and the ninth picture frame.
Wherein the fourth filling content is a popup window with the same shape and size as the fourth cropping zone, and the popup window displays at least one of the following contents: the name of the file being transferred, the progress of the transfer, the remaining transfer time.
In the third embodiment, the apparatus is used as a receiving end, and in a case that the apparatus is also used as a transmitting end, the specific implementation principle of the apparatus is similar to that described in the first embodiment of the present invention, and the present invention is not limited specifically herein.
Referring to fig. 8, fig. 8 is a flowchart illustrating a method for transmitting a frame during file transmission according to a fifth embodiment of the present invention. It includes:
at a sending terminal:
s501, when a process of transmitting a file to a receiving terminal is detected in the process of transmitting a picture to the receiving terminal, acquiring an eleventh picture frame which is transmitted currently;
s502, clipping a fifth clipping region of the eleventh picture frame to generate a twelfth picture frame;
s503, sending the twelfth picture frame to the receiving terminal;
at a receiving terminal:
s504, receiving a twelfth picture frame sent by the sending terminal;
and S505, reading the filling content pre-stored locally, and generating a thirteenth picture frame for display according to the filling content and the twelfth picture frame.
Wherein the filling content is a popup window with the same shape and size as the cropping zone of the eleventh picture frame, and the popup window displays at least one of the following contents: the name of the file being transferred, the progress of the transfer, the remaining transfer time.
In the method for transmitting a picture during file transmission according to the fifth embodiment of the present invention, when picture transmission and file transmission are performed simultaneously, a twelfth picture frame is generated by clipping the eleventh picture frame for transmission and is sent to the receiving terminal, so that bandwidth resources required for transmitting the picture frame are reduced, and file transmission can be performed by using the bandwidth resources. Meanwhile, at the receiving terminal, the twelfth picture frame is padded with the padding content to generate a complete thirteenth picture frame. Based on the embodiment, when the picture transmission and the file transmission are carried out simultaneously, the picture transmission quality, the picture transmission speed, the file transmission speed and the user visual experience can be considered, and the use requirements of users are met.
Referring to fig. 9, fig. 9 is a schematic structural diagram of an apparatus for transmitting a frame during file transmission according to a sixth embodiment of the present invention. The apparatus 600 for transmitting a picture when transmitting a file includes:
a first picture frame acquiring unit 610, configured to acquire a currently transmitted first picture frame when a process of transmitting a file to a first terminal is detected in a process of transmitting a picture to the first terminal.
A frame cropping unit 620, configured to crop a predetermined first cropping area on the first frame to generate a second frame.
The frame sending unit 630 is configured to send the second frame to a first terminal, so that the first terminal reads a locally pre-stored first filling content after receiving the second frame, and generates a third frame for display according to the first filling content and the second frame.
Preferably, the size of the first cropping area is determined by the current network status, the size of the transmitted file and the definition of the transmitted picture.
Preferably, the apparatus 600 for transmitting a picture when transmitting a file further includes:
a fourth picture frame receiving unit for extracting a currently received fourth picture frame when a picture and a file from the second terminal are simultaneously received;
a second cropping area obtaining unit that obtains a second cropping area in which the fourth picture frame is cropped;
the second filling content reading unit is used for reading second filling content pre-stored locally;
and the filling unit is used for filling the second cropping area of the fourth picture frame according to the second filling content to generate a fifth picture frame for display.
Preferably, the second filler content is a popup that is the same size as the second cropping zone shape of the fourth picture frame and displays at least one of: the name of the file being transferred, the progress of the transfer, the remaining transfer time.
Preferably, the filling unit specifically includes:
a position information acquisition module, configured to acquire position information of a second cropping area of the fourth picture frame; wherein the position information of the second cropping zone of the fourth picture frame is transmitted by a second terminal; or the position information of the second cropping zone is obtained by reading locally stored default position information; or the position information of the second cropping zone is obtained by analyzing the fourth picture frame;
and the rendering module is used for rendering according to the second filling content, the position information of the second cutting area and the fourth picture frame to generate a fifth picture frame.
Referring to fig. 10, fig. 10 is a schematic structural diagram of an apparatus for transmitting a frame when transmitting a file according to a seventh embodiment of the present invention. The apparatus 700 for transmitting a picture when transmitting a file includes:
a picture extracting unit 710 for extracting a sixth picture frame currently received when a picture and a file from the third terminal are simultaneously received. Wherein the sixth picture frame has a third cropping area cropped.
And a filling content reading unit 720, configured to read a third filling content pre-stored locally.
A filling unit 730, configured to fill the third cropping zone of the sixth picture frame according to the third filling content, and generate a seventh picture frame for display.
The third filling content is a popup window with the same shape and size as the third cropping zone of the sixth picture frame, and the popup window displays at least one of the following contents: the name of the file being transferred, the progress of the transfer, the remaining transfer time.
Preferably, the filling unit 730 is specifically configured to acquire position information of a third cropping area of the sixth picture frame; wherein the position information of the third cropping zone of the sixth picture frame is synchronously transmitted by a third terminal when transmitting the sixth picture frame; or the position information of the third cropping zone is obtained by reading locally stored default position information; or the position information of the third cropping zone is obtained by analyzing the sixth picture frame;
and rendering according to the third filling content, the position information of the third cutting area and the sixth picture frame to generate a seventh picture frame for display.
Preferably, the method further comprises the following steps:
an eighth picture frame acquiring unit, configured to acquire an eighth picture frame currently transmitted when a process of transmitting a file to a fourth terminal is detected in a process of transmitting a picture to the fourth terminal;
a fourth cropping zone cropping unit, configured to crop a predetermined fourth cropping zone on the eighth picture frame, so as to generate a ninth picture frame;
a ninth frame sending unit, configured to send the ninth frame to the fourth terminal, so that the fourth terminal reads locally pre-stored fourth filling content after receiving the ninth frame, and generates a tenth frame for display according to the fourth filling content and the ninth frame.
Referring to fig. 11, the eighth embodiment of the present invention further provides a terminal, which includes a processor 801, a memory 802, and a computer program 803 stored in the memory 802; wherein the computer program 803 can be executed by the processor 801 to implement the methods described in the first to fourth embodiments above.
In this embodiment, the memory may further store application software 804 having a screen transfer function and a file transfer function, such as QQ, and the computer program 803 may exist as a plug-in to the application software 804.
In this embodiment, the terminal may also include at least one network interface 807 or other user interface 806 at least one communication bus 805. A communication bus 805 is used to enable communications among the components. The user interface 806 may optionally include a USB interface, among other standard interfaces, a wired interface. The network interface 807 optionally may include a Wi-Fi interface as well as other wireless interfaces.
The terminal provided by the embodiment clips the transmitted picture frame when picture transmission and file transmission are simultaneously performed, so that bandwidth resources required for transmitting the picture frame are reduced, and further the file transmission can be performed by using the bandwidth resources. And when receiving the picture and the file, reading the filling content prestored locally, rendering according to the filling content and the currently received picture frame, and generating a complete picture frame for display. Based on the embodiment of the invention, when the picture transmission and the file transmission are carried out simultaneously, the picture transmission quality, the picture transmission speed, the file transmission speed and the user visual experience can be considered, and the use requirements of users are met.
The ninth embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium includes a stored computer program, and when the computer program runs, the apparatus on which the computer-readable storage medium is located is controlled to execute the methods described in the first to fourth embodiments.
While the invention has been described with reference to a preferred embodiment, it will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
Claims (15)
1. A method for transmitting pictures when transmitting files, comprising:
when a process of transmitting a file to a first terminal is detected in the process of transmitting a picture to the first terminal, acquiring a first picture frame currently transmitted to the first terminal;
clipping a preset first clipping area on the first picture frame to generate a second picture frame; the first cutting area is determined or preset according to the useful information of each area of the first picture frame;
sending the second image frame to the first terminal, so that the first terminal reads locally pre-stored first filling content after receiving the second image frame, and generating a third image frame for display according to the acquired position information of the first cropping area of the first image frame, the first filling content and the second image frame; wherein the first filler content has a shape and size that is consistent with the first cropping zone.
2. The method as claimed in claim 1, wherein the size of the first cropping area is determined by current network conditions, the size of the file to be transmitted and the sharpness of the picture to be transmitted.
3. The method for transmitting pictures when transmitting files according to claim 1, wherein the method for transmitting pictures when transmitting files further comprises:
when receiving a picture and a file from a second terminal at the same time, extracting a fourth picture frame currently received from the second terminal; wherein the fourth picture frame has a cropped second crop area;
reading second filling content prestored locally;
and filling the second cropping area of the fourth picture frame according to the second filling content to generate a fifth picture frame for display.
4. The method for transmitting a picture in transmitting a file according to claim 3,
the second filling content is a popup window with the same shape and size as the second cropping zone of the fourth picture frame, and the popup window displays at least one of the following contents: the name of the file being transferred, the progress of the transfer, the remaining transfer time.
5. The method according to claim 3, wherein the filling of the second cropping zone of the fourth picture frame according to the second filler content generates a fifth picture frame for display, specifically:
acquiring position information of a second cropping area of the fourth picture frame; wherein the position information of the second cropping zone of the fourth picture frame is transmitted by a second terminal; or the position information of the second cropping zone is obtained by reading locally stored default position information; or the position information of the second cropping zone is obtained by analyzing the fourth picture frame;
and rendering according to the second filling content, the position information of the second cutting area and the fourth picture frame to generate a fifth picture frame.
6. A method for transmitting pictures when transmitting files, comprising:
when a picture and a file from a third terminal are received at the same time, extracting a currently received sixth picture frame from the third terminal; wherein the sixth picture frame has a third cropping area cropped; the third cropping zone is determined or preset according to the useful information of each zone of the sixth picture frame;
reading third filling content prestored locally;
filling the third cropping area of the sixth image frame according to the acquired position information of the third cropping area and the third filling content to generate a seventh image frame for display; wherein the third filler content has a shape and size that is consistent with the third cropping zone.
7. The method for transmitting a picture in transmitting a file according to claim 6,
the third filling content is a popup window with the same shape and size as the third cropping zone of the sixth picture frame, and the popup window displays at least one of the following contents: the name of the file being transferred, the progress of the transfer, the remaining transfer time.
8. The method according to claim 7, wherein the step of generating a seventh screen frame for display by filling the third cropping zone of the sixth screen frame according to the acquired position information of the third cropping zone and the third filling content comprises:
acquiring position information of a third cropping area of the sixth picture frame; wherein the position information of the third cropping zone of the sixth picture frame is synchronously transmitted by a third terminal when transmitting the sixth picture frame; or the position information of the third cropping zone is obtained by reading locally stored default position information; or the position information of the third cropping zone is obtained by analyzing the sixth picture frame;
and rendering according to the third filling content, the position information of the third cutting area and the sixth picture frame to generate a seventh picture frame for display.
9. The method for transmitting pictures when transmitting files according to claim 6, wherein the method for transmitting pictures when transmitting files further comprises:
when a process of transmitting a file to a fourth terminal is detected in the process of transmitting a picture to the fourth terminal, acquiring an eighth picture frame currently transmitted to the fourth terminal;
clipping a predetermined fourth clipping region on the eighth picture frame to generate a ninth picture frame;
and sending the ninth picture frame to the fourth terminal, so that the fourth terminal reads locally pre-stored fourth filling content after receiving the ninth picture frame, and generates a tenth picture frame for display according to the fourth filling content and the ninth picture frame.
10. A method for transmitting pictures when transmitting files, comprising:
at a sending terminal:
when a process of transmitting a file to a receiving terminal is detected in the process of transmitting a picture to the receiving terminal, acquiring an eleventh picture frame currently transmitted to the receiving terminal;
clipping a fifth clipping region of the eleventh picture frame to generate a twelfth picture frame; the fifth cropping zone is determined or preset according to useful information of each zone of the eleventh picture frame;
transmitting the twelfth picture frame to the receiving terminal;
at a receiving terminal:
receiving a twelfth picture frame sent by the sending terminal;
reading locally pre-stored filling content, and generating a thirteenth picture frame for display according to the acquired position information of the fifth cropping area of the eleventh picture frame, the filling content and the twelfth picture frame; wherein the fill content conforms in shape and size to the fifth crop area.
11. The method for transmitting a picture in transmitting a file according to claim 10,
the filling content is a popup window with the same shape and size as the cropping zone of the eleventh picture frame, and the popup window displays at least one of the following contents: the name of the file being transferred, the progress of the transfer, the remaining transfer time.
12. An apparatus for transmitting a picture when transmitting a file, comprising:
the device comprises a first picture frame acquisition unit, a second picture frame acquisition unit and a file transmission unit, wherein the first picture frame acquisition unit is used for acquiring a first picture frame currently transmitted to a first terminal when a process of transmitting a file to the first terminal is detected in the process of transmitting a picture to the first terminal;
the picture cutting unit is used for cutting a preset first cutting area on the first picture frame to generate a second picture frame; the first cutting area is determined or preset according to the useful information of each area of the first picture frame;
the picture sending unit is used for sending the second picture frame to a first terminal so that the first terminal reads locally pre-stored first filling content after receiving the second picture frame, and a third picture frame for display is generated according to the acquired position information of the first cutting area of the first picture frame, the first filling content and the second picture frame; wherein the first filler content has a shape and size that is consistent with the first cropping zone.
13. An apparatus for transmitting a picture when transmitting a file, comprising:
a picture extracting unit for extracting a sixth picture frame currently received from the third terminal when the picture and the file are simultaneously received from the third terminal; wherein the sixth picture frame has a third cropping area cropped; the third cropping zone is determined or preset according to the useful information of each zone of the sixth picture frame;
the filling content reading unit is used for reading third filling content which is pre-stored locally;
a filling unit, configured to fill the third cropping area of the sixth image frame according to the acquired position information of the third cropping area and the third filling content, and generate a seventh image frame for display; wherein the third filler content has a shape and size that is consistent with the third cropping zone.
14. A terminal comprising a processor, a memory, and a computer program stored in the memory; wherein the computer program is executable by the processor to implement a method of transmitting a picture when transmitting a file according to any one of claims 1 to 9.
15. A computer-readable storage medium, comprising a stored computer program, wherein when the computer program runs, the computer-readable storage medium controls an apparatus to execute the method for transmitting pictures when transmitting files according to any one of claims 1 to 9.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710650436.9A CN107612881B (en) | 2017-08-01 | 2017-08-01 | Method, device, terminal and storage medium for transmitting picture during file transmission |
| PCT/CN2017/116634 WO2019024387A1 (en) | 2017-08-01 | 2017-12-15 | Method and apparatus for transmitting image during file transmission, terminal, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710650436.9A CN107612881B (en) | 2017-08-01 | 2017-08-01 | Method, device, terminal and storage medium for transmitting picture during file transmission |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107612881A CN107612881A (en) | 2018-01-19 |
| CN107612881B true CN107612881B (en) | 2020-07-28 |
Family
ID=61064137
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710650436.9A Active CN107612881B (en) | 2017-08-01 | 2017-08-01 | Method, device, terminal and storage medium for transmitting picture during file transmission |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107612881B (en) |
| WO (1) | WO2019024387A1 (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114245177B (en) * | 2021-12-17 | 2024-01-23 | 智道网联科技(北京)有限公司 | Smooth display method and device of high-precision map, electronic equipment and storage medium |
| CN114866446A (en) * | 2022-04-15 | 2022-08-05 | 西安广和通无线通信有限公司 | Data transmission rate testing method, system, electronic device and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101547183A (en) * | 2008-03-27 | 2009-09-30 | 田园 | Method for online watching of multimedia files |
| CN101645880A (en) * | 2008-08-06 | 2010-02-10 | 华为技术有限公司 | Method and device for forwarding data frame based on line bundle |
| CN102546768A (en) * | 2011-12-23 | 2012-07-04 | 深圳市同洲电子股份有限公司 | Content sharing method, device and system |
| JP5102552B2 (en) * | 2007-07-25 | 2012-12-19 | イーストマン コダック カンパニー | Image processing system, imaging device, and output device |
| CN103036980A (en) * | 2012-12-13 | 2013-04-10 | 北京奇虎科技有限公司 | Data transmission equipment and method used for remote service |
| CN103458220A (en) * | 2012-06-04 | 2013-12-18 | 联想(北京)有限公司 | Image processing method and electronic equipment |
| CN104954812A (en) * | 2014-03-27 | 2015-09-30 | 腾讯科技（深圳）有限公司 | Video synchronized playing method, device and system |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7428000B2 (en) * | 2003-06-26 | 2008-09-23 | Microsoft Corp. | System and method for distributed meetings |
| CN100463521C (en) * | 2004-10-26 | 2009-02-18 | 大竑企业股份有限公司 | Method for improving image and sound data imaging effect and transmission rate in Internet network |
| CN101309390B (en) * | 2007-05-17 | 2012-05-23 | 华为技术有限公司 | Visual communication system, apparatus and subtitle displaying method |
| CN102104766A (en) * | 2009-12-18 | 2011-06-22 | 深圳富泰宏精密工业有限公司 | Privacy protecting system and method in video call |
| CN102123213A (en) * | 2010-01-07 | 2011-07-13 | 彭凤琴 | Videophone multimedia intelligent communication system |
| CN102368247B (en) * | 2011-09-16 | 2015-03-18 | 杭州典能科技有限公司 | Method for executing SWF (Small Web Format) file on handheld terminal |
| CN102595096A (en) * | 2012-02-28 | 2012-07-18 | 律典(上海)信息技术有限公司 | Cross-platform conference system based on graphic image synchronization |
| CN103313120B (en) * | 2012-03-08 | 2018-07-17 | 深圳市腾讯计算机系统有限公司 | Show method, mobile terminal, high in the clouds and the system of picture |
-
2017
- 2017-08-01 CN CN201710650436.9A patent/CN107612881B/en active Active
- 2017-12-15 WO PCT/CN2017/116634 patent/WO2019024387A1/en active Application Filing
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5102552B2 (en) * | 2007-07-25 | 2012-12-19 | イーストマン コダック カンパニー | Image processing system, imaging device, and output device |
| CN101547183A (en) * | 2008-03-27 | 2009-09-30 | 田园 | Method for online watching of multimedia files |
| CN101645880A (en) * | 2008-08-06 | 2010-02-10 | 华为技术有限公司 | Method and device for forwarding data frame based on line bundle |
| CN102546768A (en) * | 2011-12-23 | 2012-07-04 | 深圳市同洲电子股份有限公司 | Content sharing method, device and system |
| CN103458220A (en) * | 2012-06-04 | 2013-12-18 | 联想(北京)有限公司 | Image processing method and electronic equipment |
| CN103036980A (en) * | 2012-12-13 | 2013-04-10 | 北京奇虎科技有限公司 | Data transmission equipment and method used for remote service |
| CN104954812A (en) * | 2014-03-27 | 2015-09-30 | 腾讯科技（深圳）有限公司 | Video synchronized playing method, device and system |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019024387A1 (en) | 2019-02-07 |
| CN107612881A (en) | 2018-01-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111190558B (en) | Screen projection control method and device, computer readable storage medium and computer equipment | |
| US9124766B2 (en) | Video conference apparatus, method, and storage medium | |
| US9973829B2 (en) | Method for video communications and terminal, server and system for video communications | |
| US20160328877A1 (en) | Method and apparatus for making personalized dynamic emoticon | |
| CN105045823B (en) | A kind of generation method and device of the mobile terminal demonstration document based on screenshot | |
| CN108173742B (en) | Image data processing method and device | |
| US9319468B2 (en) | Information processing apparatus and information processing method | |
| EP3068070A1 (en) | Method and device for initiating network conference | |
| CN111064863B (en) | Image data processing method and related device | |
| US10897435B2 (en) | Instant messaging method and system, and electronic apparatus | |
| US7880752B2 (en) | Method and apparatus for proportionally adjusting the size of images transmitted between mobile communications terminals | |
| CN114371896B (en) | Prompting method, device, equipment and medium based on document sharing | |
| KR101816625B1 (en) | Image display method and apparatus | |
| CN107612881B (en) | Method, device, terminal and storage medium for transmitting picture during file transmission | |
| CN112817671A (en) | Image processing method, device, equipment and computer readable storage medium | |
| CN105871682A (en) | Method and device for video call and terminal | |
| CN114428597A (en) | Multi-channel terminal screen projection control method and device, screen projector and storage medium | |
| CN111722764A (en) | Message input and display method and device, electronic equipment and readable storage medium | |
| EP2555127A2 (en) | Display apparatus for translating conversations | |
| CN106919376B (en) | Dynamic picture transmission method, server device and user device | |
| JP2011192008A (en) | Image processing system and image processing method | |
| CN111372009B (en) | Image processing method and processing equipment | |
| CN110941413B (en) | Display screen generation method and related device | |
| CN104753759A (en) | Method and device for displaying contact person information in instant messaging (IM) system | |
| CN108924182B (en) | Text information sending method and device in virtual reality scene |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |