CN107846634B - Audio and video file sharing method, device and system, storage medium and terminal equipment - Google Patents
Audio and video file sharing method, device and system, storage medium and terminal equipment Download PDFInfo
- Publication number
- CN107846634B CN107846634B CN201711016804.0A CN201711016804A CN107846634B CN 107846634 B CN107846634 B CN 107846634B CN 201711016804 A CN201711016804 A CN 201711016804A CN 107846634 B CN107846634 B CN 107846634B
- Authority
- CN
- China
- Prior art keywords
- file
- audio
- identification code
- video
- sharing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/176—Support for shared access to files; File sharing support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses an audio and video file sharing method, device and system, a computer readable storage medium and a terminal device, wherein the method comprises the following steps: when the mobile terminal is in a multi-person chat mode, analyzing a received file sharing instruction to obtain an identification code of a sending terminal and a file type of an audio/video file to be shared; the identification code of the sending terminal is the identification code of the sending terminal sharing the audio and video file; creating a corresponding playing control according to the file type, and generating a control identification code of the playing control according to the identification code of the sending end and the file type; when an audio and video frame of an audio and video file is received, a file identification code of the audio and video file is extracted from the audio and video frame, and the audio and video frame is sent to a playing control corresponding to a control identification code corresponding to the file identification code to be played. By adopting the technical scheme of the invention, the timeliness of audio and video file sharing can be improved, and the user experience is improved.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to an audio/video file sharing method, apparatus, and system, a computer-readable storage medium, and a terminal device.
Background
With the continuous development of economy and communication technology, video conferencing is used more and more widely as a multimedia communication method for holding a conference by using a communication network. Conference members in different places can hear the sound of the other party, see the image of the other party and see the real-time scene in the conference process through the video conference, so that the conference members can participate in the conference without arriving at the conference site, the interaction in different places is realized, the time is saved, and the working efficiency is effectively improved.
However, in the process of a video conference, when any conference member initiates audio/video file sharing, the prior art mostly transmits the shared audio/video file to other conference members in a file transmission manner, and the other conference members must receive the complete audio/video file and then can play the file, so that the audio/video file cannot be shared in time, and poor user experience is easily brought.
Disclosure of Invention
The technical problem to be solved by the embodiments of the present invention is to provide an audio and video file sharing method, device and system, a computer-readable storage medium, and a terminal device, which can improve the timeliness of audio and video file sharing and improve user experience.
In order to solve the technical problem, an embodiment of the present invention provides an audio and video file sharing method, including:
when the mobile terminal is in a multi-person chat mode, analyzing a received file sharing instruction to obtain an identification code of a sending terminal and a file type of an audio/video file to be shared; the identification code of the transmitting terminal is the identification code of the transmitting terminal sharing the audio and video file;
creating a corresponding playing control according to the file type, and generating a control identification code of the playing control according to the sending end identification code and the file type;
when an audio and video frame of the audio and video file is received, a file identification code of the audio and video file is extracted from the audio and video frame, and the audio and video frame is sent to the playing control corresponding to the control identification code corresponding to the file identification code to be played.
Further, the file type is represented by a file type identification code;
then, the creating a corresponding playing control according to the file type, and generating a control identification code of the playing control according to the sender identification code and the file type specifically include:
creating a corresponding playing control according to the file type identification code;
and setting a result obtained by adding the sending end identification code and the file type identification code as the control identification code of the playing control.
Further, the file identification code is generated by the server according to the sender identification code and the file type in the file sharing request when the server receives the file sharing request sent by the sender;
before the file identification code of the audio and video file is extracted from the audio and video frame and sent to the playing control corresponding to the control identification code corresponding to the file identification code for playing, the method further comprises the following steps:
generating a reference file identification code according to the sender identification code and the file type in the file sharing instruction;
the extracting of the file identification code of the audio and video file from the audio and video frame and the sending of the audio and video frame to the playing control corresponding to the control identification code corresponding to the file identification code specifically comprises:
extracting the file identification code of the audio and video file from the audio and video frame;
and when the file identification code is judged to be the same as the reference file identification code, sending the audio and video frame to the playing control corresponding to the control identification code corresponding to the reference file identification code for playing.
Further, the play control comprises a display window;
when the file identification code of the audio and video file is extracted from the audio and video frame and the audio and video frame is sent to the playing control corresponding to the control identification code corresponding to the file identification code for playing, the method further comprises the following steps:
and acquiring the user information of the sending end according to the identification code of the sending end, and sending the user information to a display window of the playing control for displaying.
Further, the file types include an audio file type and a video file type; and the audio and video file is transmitted in a data stream mode.
Further, the file sharing instruction is sent by the server when receiving the file sharing request sent by the sending end.
An embodiment of the present invention further provides an audio/video file sharing apparatus, including:
the sharing instruction analysis module is used for analyzing the received file sharing instruction when the mobile terminal is in a multi-person chat mode to obtain an identification code of a sending terminal and the file type of an audio and video file to be shared; the identification code of the transmitting terminal is the identification code of the transmitting terminal sharing the audio and video file;
the playing control creating module is used for creating a corresponding playing control according to the file type and generating a control identification code of the playing control according to the sending end identification code and the file type; and the number of the first and second groups,
and the file real-time sharing module is used for extracting and obtaining a file identification code of the audio and video file from the audio and video frame when receiving the audio and video frame of the audio and video file, and sending the audio and video frame to the playing control corresponding to the control identification code corresponding to the file identification code for playing.
The embodiment of the invention also provides an audio and video file sharing system, which comprises at least one sending end, a server end and at least one receiving end; wherein:
the server is used for distributing corresponding identification codes for each sending end, each receiving end and each file type; the server side sends a file sharing instruction to the receiving side when receiving a file sharing request sent by the sending side, and generates a corresponding file identification code according to the identification code of the sending side and the identification code of the file type in the file sharing request; the server is also used for receiving the audio and video files shared by the sending end and sequentially forwarding each audio and video frame of the audio and video files to the corresponding receiving end;
each sending end is used for sending the file sharing request to the server end; after receiving the file identification code returned by the server, the sending end identifies the audio and video file by adopting the file identification code and sends the audio and video file passing through the identification to the server for sharing;
each receiving end is used for executing the audio and video file sharing method.
An embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium includes a stored computer program; when the computer program runs, the computer program controls the device where the computer-readable storage medium is located to execute any one of the audio and video file sharing methods.
The embodiment of the invention also provides terminal equipment, which comprises at least one memory and at least one processor; wherein:
the memory includes at least one stored executable program;
the processor is used for executing the executable program, and when the executable program is executed, the processor realizes the audio and video file sharing method.
Compared with the prior art, the embodiment of the invention provides an audio and video file sharing method, an audio and video file sharing device, an audio and video file sharing system, a computer readable storage medium and a terminal device.
Drawings
Fig. 1 is a block diagram of an embodiment of an audio-video file sharing system provided in the present invention;
fig. 2 is a flowchart of a preferred embodiment of the audio-video file sharing method provided in the present invention;
fig. 3 is a schematic diagram of a display effect of a preferred embodiment of the audio and video file sharing method provided by the present invention;
fig. 4 is a block diagram of an embodiment of the audio-video file sharing apparatus provided in the present invention;
fig. 5 is a block diagram of a preferred embodiment of the terminal device provided by the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without any inventive step, are within the scope of the present invention.
The embodiment of the invention provides an audio and video file sharing system.
Referring to fig. 1, it is a block diagram of a preferred embodiment of an audio/video file sharing system provided by the present invention, and the structure includes at least one sending end 11, a service end 12, and at least one receiving end 13; wherein:
the server 12 is configured to allocate a corresponding identification code to each of the sender 11, the receiver 13, and each file type; the server 12 sends a file sharing instruction to the receiver 13 when receiving a file sharing request sent by the sender 11, and generates a corresponding file identification code according to the identification code of the sender 11 and the identification code of the file type in the file sharing request; the server 12 is further configured to receive the audio/video file shared by the sender 11 and sequentially forward each audio/video frame of the audio/video file to the corresponding receiver 13;
each sending end 11 is configured to send the file sharing request to the server 12; after receiving the file identification code returned by the server 12, the sending end 11 identifies the audio and video file by using the file identification code, and sends the identified audio and video file to the server 12 for sharing;
each of the receiving terminals 13 is configured to execute any one of the audio/video file sharing methods described above.
It should be noted that, in this embodiment, each time a new client is added to the audio/video file sharing system, the server in the system automatically configures a corresponding and unique client identifier code for the new client.
In the audio and video file sharing system, when the system is in a multi-user chat mode, one or more of the clients can initiate real-time audio and video file sharing, so that the audio and video files to be shared are transmitted to other clients and simultaneously played in the other clients in real time. In this embodiment, a client initiating audio and video file sharing is used as a sending end, and a client receiving the audio and video file sharing is used as a receiving end. Specifically, the audio and video file sharing process mainly comprises a sharing preparation phase and a sharing implementation phase.
In the sharing preparation stage, firstly, a sending end generates a corresponding file sharing request according to an identification code of the sending end and the file type of the audio/video file to be shared, and sends the file sharing request to a server end; after receiving the file sharing request, the server analyzes the file sharing request, obtains a sender identification code and a file type of an audio and video file to be shared, generates a corresponding file sharing instruction according to the sender identification code and the file type, and sends the file sharing instruction to a corresponding receiving end for receiving the audio and video file sharing; meanwhile, the server generates a corresponding file identification code according to the sending end identification code and the file type obtained by analysis, and returns the file identification code to the sending end; after receiving a file sharing instruction sent by a server, the receiving end analyzes the file sharing instruction to obtain a sending end identification code and a file type of an audio and video file to be shared; and then, the receiving terminal generates a corresponding playing control according to the file type obtained by analysis, and configures a corresponding control identification code for the playing control according to the file type and the sending terminal identification code obtained by analysis.
In the sharing implementation stage, the sending end configures the file identification code returned by the server end to the audio and video file to be shared, and sends the configured audio and video file to the server end frame by frame; the server side forwards the audio and video frames to a corresponding receiving end when receiving the audio and video frames sent by the sending end; and the receiving terminal analyzes the audio and video frame when receiving the audio and video frame forwarded by the server terminal, so as to obtain a file identification code in the audio and video frame, and sends the audio and video frame to a playing control corresponding to the control identification code corresponding to the file identification code for displaying.
According to the audio and video file sharing system provided by the embodiment of the invention, the unique corresponding playing control is allocated to the audio and video file to be shared in the multi-user chat mode, and when one frame of data of the audio and video file to be shared is received, the audio and video frame of data is sent to the playing control to be played, so that the real-time playing and sharing of the audio and video file in the multi-user chat process can be realized, the audio and video file can be played without waiting until the audio and video file is downloaded completely, the timeliness of the audio and video file sharing in the multi-user chat mode is improved, and the user experience is further improved.
The embodiment of the invention also provides an audio and video file sharing method.
Referring to fig. 2, it is a flowchart of a preferred embodiment of the audio/video file sharing method provided in the present invention, including steps S21 to S23, specifically:
s21, when the mobile terminal is in a multi-person chat mode, analyzing the received file sharing instruction to obtain the identification code of the sending terminal and the file type of the audio/video file to be shared; the identification code of the transmitting end is the identification code of the transmitting end sharing the audio and video file.
It should be noted that the embodiment of the present invention is executed by the receiving end in the audio/video file sharing system. The embodiment of the invention is suitable for a multi-person chat mode with multi-end interaction (such as two-person video chat, three-person or more-than-three video conference and the like).
In the embodiment, in a multi-user chat mode, a sending end initiates audio and video file sharing by sending a file sharing request to a server end; when receiving a file sharing request sent by a sending end, a server analyzes the file sharing request so as to obtain a sending end identification code and a file type of an audio and video file to be shared, and generates a corresponding file sharing instruction according to the sending end identification code and the file type; then, the server side sends the file sharing instruction to one or more receiving ends, so that each receiving end is ready for receiving audio and video file sharing; after receiving a file sharing instruction sent by a server, a receiving end analyzes and obtains the identification code of the sending end and the file type of the audio and video file to be shared from the file sharing instruction, and prepares for correspondingly receiving the audio and video file to be shared according to the identification code of the sending end and the file type.
S22, creating a corresponding playing control according to the file type, and generating a control identification code of the playing control according to the sender identification code and the file type.
In this embodiment, after the receiving end obtains the identification code of the transmitting end and the file type of the audio/video file to be shared by analysis, a preparation for correspondingly receiving the audio/video file to be shared is made according to the identification code of the transmitting end and the file type. Specifically, a corresponding playing control is created according to the file type to be used for playing the audio/video file to be shared, and then a control identification code of the playing control is generated according to the identification code of the transmitting terminal and the file type to be used for distinguishing the audio/video files from different transmitting terminals and different types.
In another preferred embodiment, the file type is represented by a file type identification code, and step S22 may further include sub-steps S2201 to S2202:
s2201, creating a corresponding playing control according to the file type identification code;
s2202, setting a result obtained by adding the sending end identification code and the file type identification code as the control identification code of the playing control.
In this embodiment, the file type is represented by a file type identifier, and the file type identifier is generated by the server and each client in advance. Specifically, a corresponding relation table of the file type information and the file type identification code is stored in the server; in the process of initiating audio and video file sharing, a sending end sends a file sharing request containing file type information of an audio and video file to be shared to the server end, so that the server end queries the corresponding relation table according to the file type information in the file sharing request, and a file type identification code corresponding to the audio and video file to be shared is determined; then, the server side sends a file sharing instruction containing the file type identification code to a receiving side; after receiving the file sharing instruction, the receiving end reads and obtains the identification code of the sending end and the identification code of the file type from the file sharing instruction, and configures a corresponding control identification code for the playing control according to the identification code of the file type and the identification code of the sending end after a corresponding playing control is established according to the identification code of the file type.
More preferably, the server configures a synchronization source identifier SSRC for each client as the client identifier code; the server and each client agree to use a positive integer n as a file type identification code, wherein different n values represent different file types.
In this embodiment, after obtaining the sending-end identification code SSRC and the file type identification code n of the audio/video file to be shared according to the received file sharing instruction, the receiving end creates a corresponding play control according to the file type identification code n, and sets the sum of the sending-end identification code SSRC and the file type identification code n as the control identification code of the play control, so that the control identification code of the play control is set to SSRC + n.
For example, assuming that a sender id SSRC of a certain sender is 5580, a file type id n of an audio file agreed between a server and each client is 1, and a file type id n of a video file is 2, when the sender initiates video file sharing, a receiver creates a corresponding play control for the video file to be shared, and configures a control id with a value of 5582 (because 5580+2 is 5582) for the play control.
And S23, when an audio/video frame of the audio/video file is received, extracting a file identification code of the audio/video file from the audio/video frame, and sending the audio/video frame to the playing control corresponding to the control identification code corresponding to the file identification code for playing.
In this embodiment, the sending end sends the audio and video file to be shared to the server end in a frame form. And each audio and video frame comprises a file identification code of the audio and video file to be shared. And the server forwards the audio and video frames to the corresponding receiving end when receiving the audio and video frames sent by the sending end. When the receiving end receives the audio and video frames forwarded by the server, the file identification code of the audio and video file to be shared is extracted from the audio and video frames, each local playing control is inquired according to the file identification code, whether the playing control with the playing identification code consistent with the file identification code exists or not is judged, if yes, the received audio and video frames are sent to the playing control to be played, and if not, the received audio and video frames are discarded, and/or corresponding error prompt information is generated.
In another preferred embodiment, the file identification code is generated by the server according to the sender identification code and the file type in the file sharing request when the server receives the file sharing request sent by the sender; before step S23 is executed, the method further includes:
and generating a reference file identification code according to the sender identification code and the file type in the file sharing instruction.
The above step S23 may further include sub-steps S2301 to S2302:
s2301, extracting the file identification code of the audio and video file from the audio and video frame;
and S2302, when the file identification code is judged to be the same as the reference file identification code, sending the audio and video frame to the playing control corresponding to the control identification code corresponding to the reference file identification code for playing.
In this embodiment, after receiving a file sharing instruction, a receiving end generates a corresponding reference file identification code according to a sender identification code and a file type identification code in the file sharing instruction, so as to verify a sender and a file type corresponding to an audio/video frame received at a later stage. Specifically, after receiving an audio/video frame, a receiving end extracts a corresponding file identification code from the audio/video frame, compares the file identification code with the reference file identification code, and determines whether the file identification code is consistent with the reference file identification code, if so, it indicates that a transmitting end transmitting the audio/video frame is a transmitting end initiating audio/video file sharing in the early stage, and the file type of the audio/video frame is a file type to be shared in the early stage, so that the audio/video frame is transmitted to a corresponding playing control for playing, and if not, it indicates that the transmitting end corresponding to the audio/video frame is wrong or the corresponding file type is wrong, so that the audio/video frame is discarded, and/or corresponding error prompt information is generated for a user to perform corresponding processing.
More preferably, the server configures a synchronization source identifier SSRC for each client as the client identifier code; the server and each client agree to use a positive integer n as a file type identification code, wherein different n values represent different file types.
In this embodiment, when receiving a file sharing request sent by a sender, a server generates a file identification code SSRC1 (where SSRC1 is SSRC + n) according to a sender identification code SSRC and a file type identification code n in the file sharing request, and returns the file identification code SSRC1 to the sender; after receiving a file sharing instruction sent by a server, a receiving end generates a reference file identification code SSRC2 according to a sending end identification code SSRC and a file type identification code n in the file sharing instruction (wherein SSRC2 is SSRC + n); in the file sharing stage, after the transmitting end configures the file identification code SSRC1 to an audio/video file to be shared, the audio/video frame of the audio/video file is transmitted to the receiving end through the service end, the receiving end extracts the file identification code SSRC1 from the received audio/video frame, compares the file identification code SSRC1 with the reference file identification code SSRC2, judges whether the audio/video frame is consistent with the reference file identification code SSRC2, if so, the audio/video frame is considered to be the audio/video frame which is transmitted by the transmitting end which initiates the audio/video sharing in advance and belongs to the file type to be shared, the audio/video frame is the audio/video frame in the audio/video file to be shared in advance, therefore, the audio/video frame is transmitted to the playing control corresponding to the control identification code which is consistent with the reference file identification code SSRC2 to play, if not, the audio/video frame is considered not to, therefore, the audio and video frames are discarded, and/or corresponding error prompt information is generated to be used for corresponding processing of a user.
In another preferred embodiment, the playing control includes a display window, and when the step S23 is executed, the method further includes:
and acquiring the user information of the sending end according to the identification code of the sending end, and sending the user information to a display window of the playing control for displaying.
In this embodiment, the display window of the play control is used to display the audio/video file received by the receiving end. After extracting the identification code of the sending end from the file sharing instruction, the receiving end acquires the user information of the sending end corresponding to the identification code of the sending end from the server according to the identification code of the sending end, and sends the user information to the display window for displaying.
In any of the above embodiments, the file types include an audio file type and a video file type; and the audio and video file is transmitted in a data stream mode.
In any of the above embodiments, the file sharing instruction is sent by the server when receiving the file sharing request sent by the sender.
In any of the above embodiments, the file type may be an audio file type, a video file type, a document file type, and the like. When the file type is an audio file type, the playing control created by the receiving end may be a music player or the like. When the file type is a video file type, the playing control created by the receiving end may be a video player or the like.
The audio and video file can be transmitted in a data stream form, and the file identification code is the identification code of the data stream allocated by the server for the audio and video file to be shared. It should be further explained that the data stream of the audio/video file and the data stream of the real-time video shot by the camera in the multi-person chat mode can be transmitted independently or can be combined into a whole for total data stream transmission.
According to the audio and video file sharing method provided by the embodiment of the invention, the unique corresponding playing control is allocated to the audio and video file to be shared in the multi-user chat mode, and when one frame of data of the audio and video file to be shared is received, the audio and video frame of data is sent to the playing control to be played, so that the real-time playing and sharing of the audio and video file in the multi-user chat process can be realized, and the audio and video file can be played without waiting until the audio and video file is downloaded completely, so that the timeliness of the audio and video file sharing in the multi-user chat mode is improved, and the user experience is further improved.
Fig. 3 is a schematic diagram of a display effect of a preferred embodiment of the audio/video file sharing method provided by the present invention. The following describes in detail a specific working process of the audio/video file sharing method provided by the embodiment of the present invention:
as shown in fig. 3(a), in a video conference, three clients are performing a video call, including a client a, a client B, and a client C, assuming that the client a is a sending terminal, the client B and the client C are receiving terminals, and the server configures a synchronization source identifier SSRC for each client as a client identifier, and the server and each client agree to use a positive integer n as a file type identifier.
A sending end A sends a file sharing request to a server end by clicking a button or dragging an audio/video file into a video conference window; when a server receives a file sharing request sent by a sender A, analyzing the file sharing request to obtain a sender identification code SSRC of the sender A and a file type identification code n of an audio/video file to be shared, generating a file identification code SSRC1(SSRC1 is SSRC + n) according to the sender identification code SSRC and the file type identification code n, and returning the file identification code SSRC1 to the sender A, wherein the sender identification code SSRC of the sender A is assumed to be 5590, the file type identification code n is assumed to be 2, and the file type is a video file, the file identification code SSRC1 is assumed to be 5592; meanwhile, the server generates a corresponding file sharing instruction according to the sending end identification code SSRC and the file type identification code n and sends the file sharing instruction to the receiving end B and the receiving end C, which is described below by taking the receiving end C as an example, and the receiving end B is the same as the receiving end B.
After receiving a file sharing instruction sent by a server, a receiving terminal C analyzes and obtains a sending terminal identification code SSRC of a sending terminal a which is 5590 and a file type identification code n of an audio/video file to be shared which is 2 from the file sharing instruction; because n is 2, the video file is represented, the playing control created by the receiving end C for the shared video file is a video player, and the control identification code of the video player is 5592; meanwhile, the receiving end C generates the reference file identification code SSRC2 according to the sender identification code SSRC and the file type identification code n (SSRC2 ═ SSRC + n), and then the reference file identification code SSRC2 is 5592.
The sending end A configures the file identification code SSRC1 returned by the server to the video file to be shared, and sends the data stream of the video file to the receiving end C through the server; the receiving terminal C extracts and obtains a file identification code SSRC1 ═ 5592 from the data stream, compares the file identification code SSRC1 ═ 5592 with a reference file identification code SSRC2, and sends the data stream to a video player with a control identification code 5592 for playing if the SSRC2 ═ 5592 is consistent with the SSRC 1; meanwhile, the receiving terminal C determines the user information of the transmitting terminal a according to the transmitting terminal identification code SSRC ═ 5590 of the transmitting terminal a obtained from the file sharing instruction, and sends the user information to the window of the video player for display. On the other hand, if the receiving end C cannot find the reference file identification code that is consistent with the file identification code SSRC 1-5592, the data stream is discarded, and/or corresponding error prompt information is generated for the user to perform corresponding processing.
As shown in fig. 3(b) and 3(c), there are two playing modes of the shared audio/video file: fig. 3(b) shows a manner in which the transmitting end a transmits a data stream of a shared audio/video file as an individual data stream, and the receiving end C creates an individual display window for the data stream to play the shared audio/video file, in which the shared audio/video file is added to the video conference as a client, and a picture of the audio/video file is displayed in a manner of displaying a video conference picture of the client; the mode shown in fig. 3(C) is that the transmitting end a merges the data stream of the shared audio/video file and the data stream of the video conference of the transmitting end a itself into one data stream to be transmitted, instead of being transmitted as a separate data stream, the receiving end C creates a sub-window in the video window of the receiving end C itself to play the shared audio/video file when receiving the data stream, and the shared audio/video file is displayed together with the video window of the receiving end C itself in the form of the sub-window.
When the shared audio/video file is played, the playing window is closed, and the video conference is restored to the state shown in fig. 3 (a).
Because the shared audio and video file is transmitted in the form of data stream, the receiving end does not need to download the complete audio and video file, but directly processes the data stream received each time to play and display, if the receiving end adopts the mode as shown in fig. 3(b), and has the data stream storage function, whether to store the file can be selected after the playing of the shared audio and video file is finished, and because all the data streams of the audio and video file are transmitted when the playing is finished, the operation of storing the file is finished locally, and the transmission of the file does not need to be waited again, therefore, the timeliness of the sharing of the audio and video file is improved, and the user experience is improved.
If the transmitting end performs operations such as playing position selection and the like when sharing the audio and video files, and skips a certain part of audio and video, the data of the audio and video files can be partially lost, and at the moment, the receiving end cannot receive the complete audio and video files, the function of storing the files is not meaningful, and from the perspective of user experience, the transmitting end needs to send reminding information before performing operations such as playing position selection and the like, so as to avoid the receiving end from selecting and storing the files.
The embodiment of the invention also provides an audio and video file sharing device, which can realize all the processes of the audio and video file sharing method in the embodiment.
Referring to fig. 4, it is a block diagram of a preferred embodiment of an audio-video file sharing apparatus provided in the present invention, including:
the sharing instruction analyzing module 31 is configured to analyze the received file sharing instruction when the mobile terminal is in the multi-user chat mode, and obtain a sending terminal identification code and a file type of an audio/video file to be shared; the identification code of the transmitting terminal is the identification code of the transmitting terminal sharing the audio and video file;
a playing control creating module 32, configured to create a corresponding playing control according to the file type, and generate a control identification code of the playing control according to the sender identification code and the file type; and the number of the first and second groups,
the file real-time sharing module 33 is configured to extract and obtain a file identification code of the audio/video file from the audio/video frame every time the audio/video frame of the audio/video file is received, and send the audio/video frame to the playing control corresponding to the control identification code corresponding to the file identification code for playing.
Specifically, if the file type is represented by a file type identification code, the playing control creating module 32 specifically is:
the control creating unit is used for creating the corresponding playing control according to the file type identification code; and the number of the first and second groups,
and the control identification code setting unit is used for setting a result obtained by adding the sending end identification code and the file type identification code as the control identification code of the playing control.
Specifically, the file identification code is generated by the server according to the sender identification code and the file type in the file sharing request when the server receives the file sharing request sent by the sender;
the audio and video file sharing device further comprises:
a reference file identification code generation module, configured to generate a reference file identification code according to the sender identification code and the file type in the file sharing instruction;
the file real-time sharing module 33 specifically includes:
the file identification code extracting unit is used for extracting and obtaining the file identification code of the audio and video file from the audio and video frame; and the number of the first and second groups,
and the file playing unit is used for sending the audio and video frames to the playing control corresponding to the control identification code corresponding to the reference file identification code for playing when the file identification code is judged to be the same as the reference file identification code. Specifically, the play control includes a display window;
the audio/video file sharing apparatus further includes:
and the user information display module is used for acquiring the user information of the sending end according to the identification code of the sending end and sending the user information to the display window of the playing control for display.
Specifically, the file type includes an audio file type and a video file type; and the audio and video file is transmitted in a data stream mode.
Specifically, the file sharing instruction is sent by the server when receiving the file sharing request sent by the sending end.
The audio and video file sharing device provided by the embodiment of the invention can realize real-time playing and sharing of the audio and video file in the multi-person chatting process by allocating the only corresponding playing control for the audio and video file to be shared in the multi-person chatting mode and sending the audio and video frame data to the playing control to be played when one frame of data of the audio and video file to be shared is received, and the audio and video frame data can be played without waiting until the audio and video file is completely downloaded, so that the timeliness of the audio and video file sharing in the multi-person chatting mode is improved, and the user experience is further improved.
An embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium includes a stored computer program; when the computer program runs, the computer program controls the device where the computer-readable storage medium is located to execute any one of the audio and video file sharing methods.
The embodiment of the invention also provides the terminal equipment.
Referring to fig. 5, it is a block diagram of a preferred embodiment of the terminal device provided in the present invention, which includes at least one memory 41 and at least one processor 42; wherein:
the memory 41 includes at least one executable program stored;
the processor 42 is configured to execute the executable program, and when the processor 42 executes the executable program, the audio/video file sharing method described in any one of the above is implemented.
It should be noted that fig. 5 only illustrates an example in which one memory and one processor in the terminal device are connected, in some specific embodiments, the terminal device may further include a plurality of memories and/or a plurality of processors, and the specific number and the connection mode of the memories and the processors may be set and adaptively adjusted according to actual needs.
To sum up, according to the audio/video file sharing method, device and system, the computer-readable storage medium and the terminal device provided by the embodiments of the present invention, by allocating the only corresponding play control to the audio/video file to be shared in the multi-user chat mode, and sending the audio/video frame data to the play control to play whenever a frame of data of the audio/video file to be shared is received, the real-time play and sharing of the audio/video file in the multi-user chat process can be realized, and the audio/video file can be played without waiting until the audio/video file is downloaded, so that the timeliness of the audio/video file sharing in the multi-user chat mode is improved, and further, the user experience is improved.
The above description is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, several modifications and variations can be made without departing from the technical principle of the present invention, and these modifications and variations should also be regarded as the protection scope of the present invention.
Claims (10)
1. An audio/video file sharing method is characterized by comprising the following steps:
when the mobile terminal is in a multi-person chat mode, analyzing a received file sharing instruction to obtain an identification code of a sending terminal and a file type of an audio/video file to be shared; the identification code of the transmitting terminal is the identification code of the transmitting terminal sharing the audio and video file;
creating a corresponding playing control according to the file type, and generating a control identification code of the playing control according to the sending end identification code and the file type;
when an audio and video frame of the audio and video file is received, extracting a file identification code of the audio and video file from the audio and video frame, and sending the audio and video frame to the playing control corresponding to the control identification code corresponding to the file identification code for playing; the file identification code is generated by a server according to the sender identification code and the file type in the file sharing request when the server receives the file sharing request sent by the sender.
2. The audio-video file sharing method of claim 1, wherein the file type is represented by a file type identification code;
then, the creating a corresponding playing control according to the file type, and generating a control identification code of the playing control according to the sender identification code and the file type specifically include:
creating a corresponding playing control according to the file type identification code;
and setting a result obtained by adding the sending end identification code and the file type identification code as the control identification code of the playing control.
3. The method for sharing audio/video files according to claim 1, wherein before the extracting the file identification code of the audio/video file from the audio/video frame and sending the audio/video frame to the playing control corresponding to the control identification code corresponding to the file identification code for playing, the method further comprises:
generating a reference file identification code according to the sender identification code and the file type in the file sharing instruction;
the extracting of the file identification code of the audio and video file from the audio and video frame and the sending of the audio and video frame to the playing control corresponding to the control identification code corresponding to the file identification code specifically comprises:
extracting the file identification code of the audio and video file from the audio and video frame;
and when the file identification code is judged to be the same as the reference file identification code, sending the audio and video frame to the playing control corresponding to the control identification code corresponding to the reference file identification code for playing.
4. The audio-video file sharing method of claim 1 wherein the play control comprises a display window;
when the file identification code of the audio and video file is extracted from the audio and video frame and the audio and video frame is sent to the playing control corresponding to the control identification code corresponding to the file identification code for playing, the method further comprises the following steps:
and acquiring the user information of the sending end according to the identification code of the sending end, and sending the user information to a display window of the playing control for displaying.
5. The audio-visual file sharing method according to any one of claims 1 to 4, wherein the file types include an audio file type and a video file type; and the audio and video file is transmitted in a data stream mode.
6. The audio-video file sharing method according to any one of claims 1 to 4, wherein the file sharing instruction is sent by a server when receiving a file sharing request sent by the sender.
7. An audio-video file sharing apparatus, comprising:
the sharing instruction analysis module is used for analyzing the received file sharing instruction when the mobile terminal is in a multi-person chat mode to obtain an identification code of a sending terminal and the file type of an audio and video file to be shared; the identification code of the transmitting terminal is the identification code of the transmitting terminal sharing the audio and video file;
the playing control creating module is used for creating a corresponding playing control according to the file type and generating a control identification code of the playing control according to the sending end identification code and the file type; and the number of the first and second groups,
the file real-time sharing module is used for extracting and obtaining a file identification code of the audio and video file from the audio and video frame when receiving the audio and video frame of the audio and video file, and sending the audio and video frame to the playing control corresponding to the control identification code corresponding to the file identification code for playing; the file identification code is generated by a server according to the sender identification code and the file type in the file sharing request when the server receives the file sharing request sent by the sender.
8. An audio and video file sharing system is characterized by comprising at least one sending end, a server end and at least one receiving end; wherein:
the server is used for distributing corresponding identification codes for each sending end, each receiving end and each file type; the server side sends a file sharing instruction to the receiving side when receiving a file sharing request sent by the sending side, and generates a corresponding file identification code according to the identification code of the sending side and the identification code of the file type in the file sharing request; the server is also used for receiving the audio and video files shared by the sending end and sequentially forwarding each audio and video frame of the audio and video files to the corresponding receiving end;
each sending end is used for sending the file sharing request to the server end; after receiving the file identification code returned by the server, the sending end identifies the audio and video file by adopting the file identification code and sends the audio and video file passing through the identification to the server for sharing;
each receiving end is used for executing the audio and video file sharing method as claimed in any one of claims 1 to 6.
9. A computer-readable storage medium, characterized in that the computer-readable storage medium comprises a stored computer program; wherein the computer program, when running, controls a device on which the computer-readable storage medium is located to perform the audio-video file sharing method according to any one of claims 1 to 6.
10. A terminal device comprising at least one memory and at least one processor; wherein:
the memory includes at least one stored executable program;
the processor is used for executing the executable program, and when the executable program is executed, the processor realizes the audio and video file sharing method according to any one of claims 1 to 6.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711016804.0A CN107846634B (en) | 2017-10-26 | 2017-10-26 | Audio and video file sharing method, device and system, storage medium and terminal equipment |
| PCT/CN2017/116314 WO2019080309A1 (en) | 2017-10-26 | 2017-12-15 | Audio and video file sharing method, device and system, storage medium and terminal device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711016804.0A CN107846634B (en) | 2017-10-26 | 2017-10-26 | Audio and video file sharing method, device and system, storage medium and terminal equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107846634A CN107846634A (en) | 2018-03-27 |
| CN107846634B true CN107846634B (en) | 2020-01-14 |
Family
ID=61662983
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711016804.0A Active CN107846634B (en) | 2017-10-26 | 2017-10-26 | Audio and video file sharing method, device and system, storage medium and terminal equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107846634B (en) |
| WO (1) | WO2019080309A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111049792B (en) * | 2019-10-08 | 2022-03-22 | 广州视源电子科技股份有限公司 | Audio transmission method and device, terminal equipment and storage medium |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006146804A (en) * | 2004-11-24 | 2006-06-08 | Nippon Telegr & Teleph Corp <Ntt> | Video content providing method, device, and program |
| CN102694989A (en) * | 2011-08-26 | 2012-09-26 | 新奥特（北京）视频技术有限公司 | Method and system for transmitting television program multimedia file |
| CN103237191B (en) * | 2013-04-16 | 2016-04-06 | 成都飞视美视频技术有限公司 | The method of synchronized push audio frequency and video in video conference |
| CN103744863A (en) * | 2013-12-13 | 2014-04-23 | 乐视致新电子科技（天津）有限公司 | Multimedia file playing method and electronic device |
| CN104602133B (en) * | 2014-11-21 | 2018-09-18 | 腾讯科技（北京）有限公司 | Multimedia file sharing method and terminal and server |
| CN106454497A (en) * | 2016-10-31 | 2017-02-22 | 乐视控股（北京）有限公司 | Method and device for screen-mirroring playing of video |
-
2017
- 2017-10-26 CN CN201711016804.0A patent/CN107846634B/en active Active
- 2017-12-15 WO PCT/CN2017/116314 patent/WO2019080309A1/en active Application Filing
Also Published As
| Publication number | Publication date |
|---|---|
| CN107846634A (en) | 2018-03-27 |
| WO2019080309A1 (en) | 2019-05-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108055496B (en) | Live broadcasting method and system for video conference | |
| CN111935443B (en) | Method and device for sharing instant messaging tool in real-time live broadcast of video conference | |
| CN110765744B (en) | Multi-user collaborative document editing method and system | |
| KR101243065B1 (en) | Conference terminal, conference server, conference system and data processing method | |
| CN112235121A (en) | Method, device, equipment and storage medium for realizing online conference | |
| US9954909B2 (en) | System and associated methodology for enhancing communication sessions between multiple users | |
| CN108933912A (en) | Method for establishing video call by using multiple mobile communication devices | |
| EP3962038A1 (en) | Spatially aware multimedia router system and method | |
| WO2021143043A1 (en) | Multi-person instant messaging method, system, apparatus and electronic device | |
| CN102185856A (en) | Team organizing video method, device and system used in team organizing game | |
| EP2924985A1 (en) | Low-bit-rate video conference system and method, sending end device, and receiving end device | |
| CN106792244A (en) | Net cast method and device | |
| CN113194335B (en) | Streaming media transmission method, transmission equipment and playing equipment | |
| US11431770B2 (en) | Method, system, apparatus, and electronic device for managing data streams in a multi-user instant messaging system | |
| CN107846634B (en) | Audio and video file sharing method, device and system, storage medium and terminal equipment | |
| CN109889922A (en) | Retransmission method, device, equipment and the storage medium of stream medium data | |
| CN111866440B (en) | Method, device and equipment for pushing video data and storage medium | |
| CN111857901B (en) | Data processing method, method for generating session background, electronic device and medium | |
| CN106162234A (en) | A kind of method and device sharing TV programme | |
| CN109525483A (en) | The generation method of mobile terminal and its interactive animation, computer readable storage medium | |
| CN113271474B (en) | Method, device, equipment and storage medium for testing streaming media server | |
| US8963989B2 (en) | Data distribution apparatus, data distribution method, and program | |
| CN114071170B (en) | Network live broadcast interaction method and device | |
| CN114979545A (en) | Multi-terminal call method, storage medium and electronic device | |
| CN107846399B (en) | Method for distributing and receiving multimedia content and system for processing multimedia content |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |