WO2019080309A1 - 音视频文件共享方法、装置及系统、存储介质、终端设备 - Google Patents

音视频文件共享方法、装置及系统、存储介质、终端设备

Info

Publication number
WO2019080309A1
WO2019080309A1 PCT/CN2017/116314 CN2017116314W WO2019080309A1 WO 2019080309 A1 WO2019080309 A1 WO 2019080309A1 CN 2017116314 W CN2017116314 W CN 2017116314W WO 2019080309 A1 WO2019080309 A1 WO 2019080309A1
Authority
WO
WIPO (PCT)
Prior art keywords
file
audio
identification code
video
identifier
Prior art date
Application number
PCT/CN2017/116314
Other languages
English (en)
French (fr)
Inventor
李逸然
Original Assignee
广州视源电子科技股份有限公司
广州视臻信息科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州视源电子科技股份有限公司, 广州视臻信息科技有限公司 filed Critical 广州视源电子科技股份有限公司
Publication of WO2019080309A1 publication Critical patent/WO2019080309A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/176Support for shared access to files; File sharing support
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems

Definitions

  • the present invention relates to the field of communications technologies, and in particular, to a method, device, and system for sharing audio and video files, a computer readable storage medium, and a terminal device.
  • video conferencing is becoming more and more widely used as a multimedia communication method for holding conferences using communication networks.
  • Conference members in different locations can hear the other party's voice through the video conference, and can also see the other party's image. You can also see the real-time scene during the conference so that the conference members can participate in the conference without having to arrive at the conference site. Interaction, saving time and effectively improving work efficiency.
  • the technical problem to be solved by the embodiments of the present invention is to provide an audio and video file sharing method, device and system, computer readable storage medium, and terminal device, which can improve the timeliness of audio and video file sharing and improve user experience.
  • an embodiment of the present invention provides a method for sharing audio and video files, including:
  • the received file sharing instruction is parsed to obtain the sender identification code and the file type of the audio and video file to be shared; wherein the sender identification code is the shared audio and video file.
  • the identification code of the sender is the shared audio and video file.
  • the corresponding control identifier is played in the play control corresponding to the control code.
  • file type is represented by a file type identification code
  • the result obtained by adding the sender identification code and the file type identification code is set as the control identification code of the play control.
  • the file identifier is generated by the server according to the sender identifier and the file type in the file sharing request when receiving the file sharing request sent by the server;
  • the playback in the playback control is specifically:
  • the audio and video frame is sent to the play control corresponding to the control identification code corresponding to the reference file identification code for playing.
  • the play control includes a display window
  • the file type includes an audio file type and a video file type; the audio and video files are transmitted in the form of a data stream.
  • the file sharing instruction is sent by the server when receiving the file sharing request sent by the sending end.
  • the embodiment of the invention further provides an audio and video file sharing device, comprising:
  • a shared instruction parsing module configured to parse the received file sharing instruction when the multi-person chat mode is obtained, to obtain a sender identification code and a file type of the audio and video file to be shared; wherein the sending end identification code is Sharing an identification code of a transmitting end of the audio and video file;
  • a play control creation module configured to create a corresponding play control according to the file type, and generate a control identifier of the play control according to the sender identifier and the file type;
  • a file real-time sharing module configured to extract a file identification code of the audio-video file from the audio-video frame, and send the audio-video frame to the audio and video frame of the audio-video file Playing in the play control corresponding to the control identifier corresponding to the file identifier.
  • the embodiment of the invention further provides an audio and video file sharing system, comprising at least one transmitting end, a server end and at least one receiving end; wherein:
  • the server is configured to allocate a corresponding identification code for each of the sending end, each of the receiving end, and each file type; the server sends a file when receiving a file sharing request sent by the sending end And sharing the instruction to the receiving end, and generating a corresponding file identification code according to the identifier of the sending end and the identifier of the file type in the file sharing request; the server is further configured to receive the sending end Sharing the audio and video file and sequentially forwarding each audio and video frame of the audio and video file to the corresponding receiving end;
  • Each of the sending ends is configured to send the file sharing request to the server; after receiving the file identification code returned by the server, the sending end uses the file identification code to Tone The video file is identified, and the audio and video files that are identified are sent to the server for sharing;
  • Each of the receiving ends is configured to perform the audio and video file sharing method according to any one of the above.
  • the embodiment of the present invention further provides a computer readable storage medium, the computer readable storage medium comprising a stored computer program; wherein the computer program controls the device where the computer readable storage medium is located to perform the above The audio and video file sharing method of any of the above.
  • An embodiment of the present invention further provides a terminal device, including at least one memory and at least one processor; wherein:
  • the memory includes at least one executable program stored
  • the processor is configured to execute the executable program, and the processor implements the audio and video file sharing method according to any one of the above items when the executable program is executed.
  • the embodiment of the present invention provides an audio and video file sharing method, device and system, computer readable storage medium, and terminal device, which are uniquely assigned to audio and video files to be shared in a multi-person chat mode.
  • Corresponding playback control and each time a frame of data of the audio and video file to be shared is received, the audio and video frame data is sent to the play control for playing, and the audio and video files in the multi-person chat process can be realized.
  • Real-time play sharing without waiting until the audio and video files are downloaded before playing, thereby improving the timeliness of audio and video file sharing in the multi-person chat mode, thereby improving the user experience.
  • FIG. 1 is a structural block diagram of a preferred embodiment of an audio and video file sharing system provided by the present invention
  • FIG. 2 is a flow chart of a preferred embodiment of an audio and video file sharing method provided by the present invention
  • FIG. 3 is a schematic diagram showing a display effect of a preferred embodiment of an audio and video file sharing method provided by the present invention
  • FIG. 4 is a structural block diagram of a preferred embodiment of an audio and video file sharing apparatus provided by the present invention.
  • FIG. 5 is a structural block diagram of a preferred embodiment of a terminal device provided by the present invention.
  • the embodiment of the invention provides an audio and video file sharing system.
  • FIG. 1 is a structural block diagram of a preferred embodiment of an audio and video file sharing system provided by the present invention, including at least one transmitting end 11, a server 12, and at least one receiving end 13; wherein:
  • the server 12 is configured to allocate a corresponding identification code for each of the sending end 11, each of the receiving end 13, and each file type; the server 12 receives the file sent by the sending end 11 Sending a file sharing instruction to the receiving end 13 when the request is shared, and generating a corresponding file identification code according to the identification code of the sending end 11 and the identification code of the file type in the file sharing request; 12 is further configured to receive the audio and video file shared by the sending end 11 and forward each audio and video frame of the audio and video file to the corresponding receiving end 13;
  • Each of the sending end 11 is configured to send the file sharing request to the server 12; after receiving the file identification code returned by the server 12, the sending end 11 adopts the file identifier.
  • the code identifies the audio and video file, and sends the audio and video file that is identified by the identifier to the server 12 for sharing;
  • Each of the receiving ends 13 is configured to perform the audio and video file sharing method described in any of the above.
  • the server in the system automatically configures the corresponding client for the new client. End identification code.
  • the clients when in the multi-person chat mode, one or more of the clients can initiate real-time audio and video file sharing, so that the audio and video files to be shared are transmitted to other clients simultaneously. , play in this other client in real time.
  • the client that initiates the sharing of the audio and video files is used as the transmitting end, and the client that receives the audio and video file sharing is used as the receiving end.
  • the audio and video file sharing process is mainly composed of a sharing preparation phase and a shared reality.
  • the line phase consists of.
  • the sending end generates a corresponding file sharing request according to the identity code of the own and the file type of the audio and video file to be shared, and sends the file sharing request to the server;
  • the server receives the After the file sharing request, the file sharing request is parsed, the sending end identification code and the file type of the audio and video file to be shared are obtained, and a corresponding file sharing instruction is generated according to the sending end identification code and the file type, and Sending the file sharing instruction to the corresponding receiving end that receives the audio and video file sharing; at the same time, the server generates a corresponding file identification code according to the obtained sending end identification code and the file type, and returns the file identification code.
  • the receiving end After receiving the file sharing instruction sent by the server, the receiving end parses the file sharing instruction, and obtains the sending end identification code and the file type of the audio and video file to be shared; subsequently, the receiving The end generates a corresponding play control according to the file type obtained by the parsing, and according to the Type analytical element obtained in the transmitting side and the configuration code corresponding control code for the playback control.
  • the sending end configures the file identification code returned by the server to the audio and video file to be shared, and sends the configured audio and video file to the server by frame by frame;
  • the server Receiving the audio and video frame sent by the sending end, forwarding the audio and video frame to the corresponding receiving end; the receiving end parsing the audio and video frame when receiving the audio and video frame forwarded by the server, thereby Obtaining a file identification code in the audio and video frame, and sending the audio and video frame to a play control corresponding to the control identifier corresponding to the file identification code.
  • the audio and video file sharing system provided by the embodiment of the present invention allocates a unique corresponding play control for the audio and video files to be shared in the multi-person chat mode, and receives a frame data of the audio and video file to be shared every time.
  • the real-time play sharing of the audio and video files in the multi-person chat process can be realized, without waiting for the audio and video files to be downloaded after being downloaded, thereby improving the number of The timeliness of audio and video file sharing in the chat mode, thereby improving the user experience.
  • the embodiment of the invention further provides an audio and video file sharing method.
  • FIG. 2 is a flowchart of a preferred embodiment of an audio and video file sharing method provided by the present invention, including steps S21 to S23, specifically:
  • the embodiment of the present invention is executed by the receiving end in the above audio and video file sharing system.
  • the embodiment of the invention is applicable to a multi-person interactive multi-person chat mode (such as video chat for two people, video conference for three or more people, etc.).
  • the sending end initiates the audio and video file sharing by sending the file sharing request to the server; when the server receives the file sharing request sent by the sending end, the server shares the file sharing request. Performing parsing to obtain a file identifier of the sender identification code and the audio and video file to be shared, and generating a corresponding file sharing instruction according to the sender identifier and the file type; subsequently, the server sends the file sharing instruction To one or more receiving ends, so that each receiving end is ready to accept audio and video file sharing; after receiving the file sharing instruction sent by the server, the receiving end parses and obtains the transmitting end identification code from the file sharing instruction. And the file type of the audio and video file to be shared, and according to the sender identification code and the file type, prepare the corresponding audio and video files to be shared.
  • the receiving end parses the file type of the sending end identification code and the audio and video file to be shared
  • the receiving end prepares the corresponding audio and video file to be shared according to the sending end identification code and the file type. .
  • a corresponding play control is created according to the file type for playing the audio and video file to be shared, and then the control identifier of the play control is generated according to the sender identifier and the file type, so as to distinguish Different audio and video files of different types and senders.
  • step S22 may further include sub-steps S2201 to S2202:
  • S2202 The result obtained by adding the sender identifier and the file type identifier is set to The control identifier of the play control.
  • the file type is represented by a file type identification code
  • the file type identification code is generated by the server and the client in advance.
  • the corresponding relationship table between the file type information and the file type identification code is stored in the server; the sending end shares the file type information of the audio and video file to be shared in the process of initiating the audio and video file sharing.
  • the server includes the The file sharing instruction of the file type identification code is sent to the receiving end; after receiving the file sharing instruction, the receiving end reads the sending end identification code and the file type identification code from the file sharing instruction, and according to the file After the type identifier is created, the corresponding control identifier is configured for the play control according to the file type identifier and the sender identifier.
  • the server configures the synchronization source identifier SSRC as a client identification code for each client; the server and each client agree to use a positive integer n as the file type identification code, wherein different n values represent different File type.
  • the receiving end after obtaining the sender identifier code SSRC and the file type identifier code n of the audio and video file to be shared according to the received file sharing instruction, the receiving end creates a corresponding play control according to the file type identifier code n. And setting the sum of the foregoing sender identifier code SSRC and the file type identifier code n as the control identifier of the play control, the control identifier of the play control is set to SSRC+n.
  • the transmission is performed.
  • the transmitting end sends the audio and video file to be shared to the server in the form of a frame.
  • the file identification code of the audio and video file to be shared is included in each audio and video frame.
  • Server at every When receiving the audio and video frame sent by the transmitting end, the audio and video frame is forwarded to the corresponding receiving end.
  • the receiving end extracts the file identification code of the audio and video file to be shared from the audio and video frame, and queries each local playback control according to the file identification code to determine whether The play control having the play identification code and the file identification code, if yes, sending the received audio and video frame to the play control, if not, discarding the received audio and video frame, and/or generating The corresponding error message.
  • the file identifier is generated by the server according to the sender identifier and the file type in the file sharing request when receiving the file sharing request sent by the server; Before the step S23 is performed, the method further includes:
  • step S23 may further include sub-steps S2301 to S2302:
  • the receiving end after receiving the file sharing instruction, the receiving end generates a corresponding reference file identification code according to the sending end identification code and the file type identification code in the file sharing instruction, for use in the later received audio and video.
  • the sender and file type corresponding to the frame are verified.
  • the receiving end extracts and obtains a corresponding file identification code from the audio and video frame, and compares the file identification code with the reference file identification code to determine whether the two are consistent.
  • the transmitting end of the audio and video frame is the transmitting end of the audio and video file sharing
  • the file type of the audio and video frame is the file type to be shared in the previous period
  • the server configures the synchronization source identifier SSRC as a client identifier for each client.
  • Code the server and each client agree to use a positive integer n as the file type identification code, wherein different n values represent different file types.
  • the audio and video frames are audio and video frames sent by the transmitting end that previously initiated the audio and video sharing and belong to the file type to be shared, and the audio and video frames are in advance.
  • the audio and video frames in the audio and video files to be shared are sent, so the audio and video frames are sent to the play control corresponding to the control identifier corresponding to the reference file identification code SSRC2, and if they are inconsistent, the audio and video are considered
  • the frame is not an audio and video frame in the audio and video file to be shared in advance, so the audio and video frames are discarded, and/or corresponding error prompt information is generated for the user to perform corresponding processing.
  • the play control includes a display window, and when executed in step S23, the method further includes:
  • the display window of the play control is used to display the audio and video files received by the receiving end.
  • the receiving end After receiving the identifier of the sender end from the file sharing instruction, the receiving end acquires the user information of the sender corresponding to the sender identifier according to the identifier of the sender, and sends the user information to the display window. Display.
  • the file type comprises an audio file type and a video file type; the audio and video files are transmitted in the form of a data stream.
  • the file sharing instruction is sent by the server when receiving the file sharing request sent by the sending end.
  • the file type may be an audio file type, a video file type, a document file type, or the like.
  • the playback control created by the receiving end may be a music player or the like.
  • the playback control created by the receiving end may be a video player or the like.
  • the audio and video file may be transmitted in the form of a data stream
  • the file identification code is an identification code of the data stream allocated by the server to the audio and video file to be shared.
  • the data stream of the audio and video file and the data stream of the real-time video captured by the camera in the multi-person chat mode may be transmitted independently of each other, or may be fused into one total data stream.
  • the audio and video file sharing method allocates a unique corresponding play control for the audio and video files to be shared in the multi-person chat mode, and receives a frame data of the audio and video file to be shared every time.
  • the real-time play sharing of the audio and video files in the multi-person chat process can be realized, without waiting for the audio and video files to be downloaded after being downloaded, thereby improving the number of The timeliness of audio and video file sharing in the chat mode, thereby improving the user experience.
  • FIG. 3 it is a schematic diagram showing a display effect of a preferred embodiment of the audio and video file sharing method provided by the present invention.
  • the specific working process of an audio and video file sharing method provided by the embodiment of the present invention is described in detail below:
  • FIG. 3(a) there are three clients in the video conference that are making video calls, including the A client, the B client, and the C client.
  • the A client is the sender, the B client, and the C client.
  • the server configures the synchronization source identifier SSRC as the client identification code for each client, the server and each client agree to use the positive integer n as the file type identification code.
  • the sending end A sends a file sharing request to the server by clicking a button or dragging the audio and video file into the video conference window; when receiving the file sharing request sent by the sending end A, the server parses the file sharing request to obtain the sending end.
  • the file type is video file.
  • the server generates a corresponding file sharing instruction according to the sender identification code SSRC and the file type identification code n and sends it to the receiving end B and the receiving end C.
  • the following takes the receiving end C as an example. For the description, the situation of the receiving end B is the same.
  • the sending end A configures the file identification code SSRC1 returned by the server to the video file to be shared, and sends the data stream of the video file to the receiving end C through the server; the receiving end C extracts the file identification code from the data stream.
  • the mode shown in FIG. 3(b) is that the sender A uses the data stream of the shared audio and video file as the data stream. A separate data stream is sent, and the receiving end C creates a separate display window for playing the shared audio and video file for the data stream.
  • the shared audio and video file is added as a client to the video conference to display
  • the video conference screen of the client displays the picture of the audio and video file
  • the mode shown in FIG. 3(c) is that the sender A combines the data stream of the shared audio and video file with the data stream of the video conference of the sender A itself into one way.
  • the data stream is sent, not sent as a separate data stream, and the receiving end C receives this.
  • a sub-window is created in the video window of the receiving end C itself for playing the shared audio and video file, and the shared audio and video file is displayed in the form of a sub-window together with the video window of the receiving end C itself.
  • the disadvantage of the method is that it sacrifices flexibility.
  • the shared audio and video files cannot be extracted separately, but the transmission bandwidth can be saved.
  • the display interface of the receiving end C does not need to be changed logically.
  • the receiving end Since the shared audio and video files are transmitted in the form of data streams, the receiving end does not need to download the complete audio and video files, but directly processes each received data stream to play the display, if the receiving end adopts FIG. 3 ( b) The method shown, and the receiving end has a data stream saving function, and after the shared audio and video file is played, it is also possible to select whether to save the file, and since all the data streams of the audio and video file have been transferred at the end of the playback, The operation of saving the file is done locally, without waiting for the file to be transmitted again, thus improving the timeliness of audio and video file sharing and improving the user experience.
  • the sender performs the operation of selecting the playback position when sharing the audio and video files, skipping a certain part of the audio and video, the data of the audio and video files will be partially missing. At this time, the receiving end will not be able to receive the complete Audio and video files, the above-mentioned function of saving files has no meaning. From the perspective of user experience, the sender needs to send reminder information before performing operations such as playing position selection, so as to avoid the receiving end selecting to save the file.
  • the embodiment of the present invention further provides an audio and video file sharing device, which can implement all the processes of the audio and video file sharing method in the foregoing embodiment.
  • FIG. 4 is a structural block diagram of a preferred embodiment of an audio and video file sharing apparatus provided by the present invention, including:
  • the shared instruction parsing module 31 is configured to parse the received file sharing instruction when the multi-person chat mode is obtained, and obtain a file identifier of the sender identification code and the audio and video file to be shared; wherein the sender identifier code An identification code for the sender of the audio and video file;
  • the play control creation module 32 is configured to create a corresponding play control according to the file type, and generate a control identifier of the play control according to the sender identifier and the file type;
  • a file real-time sharing module 33 configured to extract a file identification code of the audio-video file from the audio-video frame, and send the audio-video frame, when the audio-video frame of the audio-video file is received Playing in the play control corresponding to the control identifier corresponding to the file identification code.
  • the file type is represented by a file type identifier
  • the play control creation module 32 is specifically:
  • control creating unit configured to create a corresponding play control according to the file type identification code
  • the control identifier setting unit is configured to set a result obtained by adding the sender identifier and the file type identifier to the control identifier of the play control.
  • the file identifier is generated by the server according to the sender identification code and the file type in the file sharing request when receiving the file sharing request sent by the sending end;
  • the audio and video file sharing device further includes:
  • a reference file identifier generating module configured to generate a reference file identifier according to the sender identifier and the file type in the file sharing instruction
  • the file real-time sharing module 33 is specifically:
  • a file identification code extracting unit configured to extract, from the audio and video frames, the file identification code that obtains the audio and video file
  • a file playing unit configured to: when determining that the file identification code is the same as the reference file identification code, send the audio and video frame to a corresponding location of the control identification code corresponding to the reference file identification code Play in the playback control.
  • the play control includes a display window;
  • the audio and video file sharing device further includes:
  • the user information display module is configured to obtain user information of the sending end according to the sending end identification code, and send the user information to a display window of the play control.
  • the file type includes an audio file type and a video file type; the audio and video files are transmitted in the form of a data stream.
  • the file sharing instruction is sent by the server when receiving the file sharing request sent by the sending end.
  • the audio and video file sharing device allocates a unique corresponding play control for the audio and video files to be shared in the multi-person chat mode, and receives a frame data of the audio and video file to be shared every time.
  • the audio and video frame data is sent to the play control, the real-time play sharing of the audio and video files in the multi-person chat process can be realized, without waiting for the audio and video files to be downloaded after being downloaded, thereby improving the number of The timeliness of audio and video file sharing in the chat mode, thereby improving the user experience.
  • the embodiment of the present invention further provides a computer readable storage medium, the computer readable storage medium comprising a stored computer program; wherein the computer program controls the device where the computer readable storage medium is located to perform the above The audio and video file sharing method of any of the above.
  • the embodiment of the invention further provides a terminal device.
  • FIG. 5 is a structural block diagram of a preferred embodiment of a terminal device provided by the present invention, including at least one memory 41 and at least one processor 42; wherein:
  • the memory 41 includes at least one executable program stored
  • the processor 42 is configured to execute the executable program, and the processor 42 implements the audio and video file sharing method according to any one of the above items when executing the executable program.
  • FIG. 5 is only described by taking a memory of the terminal device and a processor as an example.
  • the terminal device may further include multiple memories and/or multiple The specific number and connection mode of the processor can be set and adapted according to actual conditions.
  • the audio and video file sharing method, apparatus, and system, computer readable storage medium, and terminal device provided by the embodiments of the present invention allocate a unique corresponding playback control for the audio and video files to be shared in the multi-person chat mode. And each time a frame of data of the audio and video file to be shared is received, the audio and video frame data is sent to the play control for playing, so that the real-time play sharing of the audio and video files in the multi-person chat process can be realized, and There is no need to wait until the audio and video files are downloaded before playing, thereby improving the timeliness of audio and video file sharing in the multi-person chat mode, thereby improving the user experience.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本发明公开了一种音视频文件共享方法、装置及系统、计算机可读存储介质、终端设备,所述方法包括以下步骤:当处于多人聊天模式时,对接收到的文件共享指令进行解析,获得发送端标识码和待共享的音视频文件的文件类型;其中,发送端标识码为共享音视频文件的发送端的标识码;根据文件类型创建相应的播放控件,并根据发送端标识码和文件类型生成播放控件的控件标识码;每当接收到音视频文件的音视频帧时,从音视频帧中提取获得音视频文件的文件标识码,并将音视频帧发送至与文件标识码相对应的控件标识码所对应的播放控件中播放。采用本发明的技术方案能够提高音视频文件共享的及时性,并提高用户体验。

Description

音视频文件共享方法、装置及系统、存储介质、终端设备 技术领域
本发明涉及通信技术领域,尤其涉及一种音视频文件共享方法、装置及系统、计算机可读存储介质、终端设备。
背景技术
随着经济以及通信技术的不断发展,视频会议作为一种利用通信网络召开会议的多媒体通信方式的应用越来越广泛。处于不同地点的会议成员通过视频会议既可以听到对方的声音,又可以看到对方的形象,还可以看到会议过程中的实时情景,使会议成员不必到达会议现场就可以参加会议,实现异地互动,节省时间,有效的提高了工作效率。
但是,在视频会议进行的过程中,当任意一个会议成员发起音视频文件共享时,现有技术大都通过文件传输的方式将共享的音视频文件传输给其他会议成员,其他会议成员必须在接收到完整的音视频文件之后才能播放,导致音视频文件不能及时实现共享,容易带来不好的用户体验。
发明内容
本发明实施例所要解决的技术问题在于,提供一种音视频文件共享方法、装置及系统、计算机可读存储介质、终端设备,能够提高音视频文件共享的及时性,并提高用户体验。
为了解决上述技术问题,本发明实施例提供了一种音视频文件共享方法,包括:
当处于多人聊天模式时,对接收到的文件共享指令进行解析,获得发送端标识码和待共享的音视频文件的文件类型;其中,所述发送端标识码为共享所述音视频文件的发送端的标识码;
根据所述文件类型创建相应的播放控件,并根据所述发送端标识码和所述文件类型生成所述播放控件的控件标识码;
每当接收到所述音视频文件的音视频帧时,从所述音视频帧中提取获得所述音视频文件的文件标识码,并将所述音视频帧发送至与所述文件标识码相对应的所述控件标识码所对应的所述播放控件中播放。
进一步地,所述文件类型采用文件类型标识码表示;
则所述根据所述文件类型创建相应的播放控件,并根据所述发送端标识码和所述文件类型生成所述播放控件的控件标识码具体为:
根据所述文件类型标识码创建相应的所述播放控件;
将所述发送端标识码和所述文件类型标识码相加得到的结果设置为所述播放控件的所述控件标识码。
进一步地,所述文件标识码由服务端在接收到所述发送端发送的文件共享请求时根据所述文件共享请求中的所述发送端标识码和所述文件类型生成;
在所述从所述音视频帧中提取获得所述音视频文件的文件标识码,并将所述音视频帧发送至与所述文件标识码相对应的所述控件标识码所对应的所述播放控件中播放之前,还包括:
根据所述文件共享指令中的所述发送端标识码和所述文件类型生成基准文件标识码;
则所述从所述音视频帧中提取获得所述音视频文件的文件标识码,并将所述音视频帧发送至与所述文件标识码相对应的所述控件标识码所对应的所述播放控件中播放具体为:
从所述音视频帧中提取获得所述音视频文件的所述文件标识码;
当判定所述文件标识码与所述基准文件标识码相同时,将所述音视频帧发送至与所述基准文件标识码相对应的所述控件标识码所对应的所述播放控件中播放。
进一步地,所述播放控件包括显示窗口;
则在所述从所述音视频帧中提取获得所述音视频文件的文件标识码,并将 所述音视频帧发送至与所述文件标识码相对应的所述控件标识码所对应的所述播放控件中播放的同时,还包括:
根据所述发送端标识码获得所述发送端的用户信息,并将所述用户信息发送至所述播放控件的显示窗口显示。
进一步地,所述文件类型包括音频文件类型和视频文件类型;所述音视频文件以数据流的形式传输。
进一步地,所述文件共享指令由服务端在接收到所述发送端发送的文件共享请求时发送。
本发明实施例还提供了一种音视频文件共享装置,包括:
共享指令解析模块,用于当处于多人聊天模式时,对接收到的文件共享指令进行解析,获得发送端标识码和待共享的音视频文件的文件类型;其中,所述发送端标识码为共享所述音视频文件的发送端的标识码;
播放控件创建模块,用于根据所述文件类型创建相应的播放控件,并根据所述发送端标识码和所述文件类型生成所述播放控件的控件标识码;以及,
文件实时共享模块,用于每当接收到所述音视频文件的音视频帧时,从所述音视频帧中提取获得所述音视频文件的文件标识码,并将所述音视频帧发送至与所述文件标识码相对应的所述控件标识码所对应的所述播放控件中播放。
本发明实施例还提供了一种音视频文件共享系统,包括至少一个发送端、服务端以及至少一个接收端;其中:
所述服务端用于为每个所述发送端、每个所述接收端和每个文件类型分配对应的标识码;所述服务端在接收到所述发送端发送的文件共享请求时发送文件共享指令至所述接收端,并根据所述文件共享请求中的所述发送端的标识码和所述文件类型的标识码生成对应的文件标识码;所述服务端还用于接收所述发送端共享的所述音视频文件并将所述音视频文件的每个音视频帧依次转发至对应的所述接收端;
每个所述发送端用于将所述文件共享请求发送至所述服务端;所述发送端在接收到所述服务端返回的所述文件标识码后,采用所述文件标识码对所述音 视频文件进行标识,并将经过所述标识的所述音视频文件发送至所述服务端中共享;
每个所述接收端用于执行上述任一项所述的音视频文件共享方法。
本发明实施例还提供了一种计算机可读存储介质,所述计算机可读存储介质包括存储的计算机程序;其中,所述计算机程序在运行时控制所述计算机可读存储介质所在的设备执行上述任一项所述的音视频文件共享方法。
本发明实施例还提供了一种终端设备,包括至少一个存储器以及至少一个处理器;其中:
所述存储器包括存储的至少一个可执行程序;
所述处理器用于执行所述可执行程序,所述处理器在执行所述可执行程序时实现上述任一项所述的音视频文件共享方法。
与现有技术相比,本发明实施例提供了一种音视频文件共享方法、装置及系统、计算机可读存储介质、终端设备,通过在多人聊天模式中为待共享的音视频文件分配唯一对应的播放控件,并在每当接收到待共享的音视频文件的一帧数据时,即将该音视频帧数据发送至该播放控件中播放,能够实现在多人聊天过程中的音视频文件的实时播放共享,而无需等待至音视频文件下载完毕之后才能播放,从而提高在多人聊天模式中的音视频文件共享的及时性,进而提高用户体验。
附图说明
图1是本发明提供的音视频文件共享系统的一个优选实施例的结构框图;
图2是本发明提供的音视频文件共享方法的一个优选实施例的流程图;
图3是本发明提供的音视频文件共享方法的一个优选实施例的显示效果示意图;
图4是本发明提供的音视频文件共享装置的一个优选实施例的结构框图;
图5是本发明提供的终端设备的一个优选实施例的结构框图。
具体实施方式
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本技术领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。
本发明实施例提供了一种音视频文件共享系统。
参见图1,是本发明提供的音视频文件共享系统的一个优选实施例的结构框图,包括至少一个发送端11、服务端12以及至少一个接收端13;其中:
所述服务端12用于为每个所述发送端11、每个所述接收端13和每个文件类型分配对应的标识码;所述服务端12在接收到所述发送端11发送的文件共享请求时发送文件共享指令至所述接收端13,并根据所述文件共享请求中的所述发送端11的标识码和所述文件类型的标识码生成对应的文件标识码;所述服务端12还用于接收所述发送端11共享的所述音视频文件并将所述音视频文件的每个音视频帧依次转发至对应的所述接收端13;
每个所述发送端11用于将所述文件共享请求发送至所述服务端12;所述发送端11在接收到所述服务端12返回的所述文件标识码后,采用所述文件标识码对所述音视频文件进行标识,并将经过所述标识的所述音视频文件发送至所述服务端12中共享;
每个所述接收端13用于执行上述任一项所述的音视频文件共享方法。
需要说明的是,在本实施例中,每当有新的客户端加入至上述音视频文件共享系统时,该系统中的服务端均会自动为该新的客户端配置相应的且唯一的客户端标识码。
在上述音视频文件共享系统中,当处于多人聊天模式时,其中的一个或者多个客户端可以发起实时的音视频文件共享,从而使得待共享的音视频文件在被传输至其他客户端的同时,实时地在该其他客户端中播放。在本实施例中,将发起音视频文件共享的客户端作为发送端,将接收该音视频文件共享的客户端作为接收端。具体地,该音视频文件共享过程主要由共享准备阶段和共享实 行阶段组成。
在上述共享准备阶段,首先,发送端根据自身的标识码和待共享的音视频文件的文件类型生成相应的文件共享请求,并将该文件共享请求发送至服务端;该服务端在接收到该文件共享请求之后,对该文件共享请求进行解析,获得其中的发送端标识码和待共享的音视频文件的文件类型,并根据该发送端标识码和该文件类型生成相应的文件共享指令,并将该文件共享指令发送至对应的接收该音视频文件共享的接收端;与此同时,服务端根据解析获得的发送端标识码和文件类型生成相应的文件标识码,并将该文件标识码返回至上述发送端;上述接收端在接收到服务端发送的文件共享指令之后,对该文件共享指令进行解析,获得其中的发送端标识码和待共享的音视频文件的文件类型;随后,该接收端根据解析获得的文件类型生成相应的播放控件,并根据该文件类型和解析获得的发送端标识码为该播放控件配置相应的控件标识码。
在上述共享实行阶段,发送端将上述服务端返回的文件标识码配置给待共享的音视频文件,并将经过配置的该音视频文件逐帧逐帧地发送至服务端;该服务端每当接收到上述发送端发送的音视频帧时,将该音视频帧转发至对应的接收端中;该接收端每当接收到服务端转发的音视频帧,则对该音视频帧进行解析,从而获得该音视频帧中的文件标识码,并将该音视频帧发送至与该文件标识码相对应的控件标识码所对应的播放控件中显示。
本发明实施例所提供的音视频文件共享系统,通过在多人聊天模式中为待共享的音视频文件分配唯一对应的播放控件,并在每当接收到待共享的音视频文件的一帧数据时,即将该音视频帧数据发送至该播放控件中播放,能够实现在多人聊天过程中的音视频文件的实时播放共享,而无需等待至音视频文件下载完毕之后才能播放,从而提高在多人聊天模式中的音视频文件共享的及时性,进而提高用户体验。
本发明实施例还提供了一种音视频文件共享方法。
参见图2,是本发明提供的音视频文件共享方法的一个优选实施例的流程图,包括步骤S21至S23,具体为:
S21、当处于多人聊天模式时,对接收到的文件共享指令进行解析,获得发送端标识码和待共享的音视频文件的文件类型;其中,所述发送端标识码为共享所述音视频文件的发送端的标识码。
需要说明的是,本发明实施例由上述音视频文件共享系统中的接收端执行。本发明实施例适用于多端交互的多人聊天模式(如两人的视频聊天、三人或者三人以上的视频会议等)。
在本实施例中,在多人聊天模式中,发送端通过发送文件共享请求至服务端的方式发起音视频文件共享;服务端在接收到该发送端发送的文件共享请求时,对该文件共享请求进行解析,从而获得其中的发送端标识码和待共享的音视频文件的文件类型,并根据该发送端标识码和该文件类型生成相应的文件共享指令;随后,服务端将该文件共享指令发送至一个或者多个接收端,以使得各个接收端做好接受音视频文件共享的准备;接收端在接收到服务端发送的文件共享指令之后,从该文件共享指令中解析获得上述发送端标识码和待共享的音视频文件的文件类型,并根据该发送端标识码和该文件类型做好相应的接收待共享音视频文件的准备。
S22、根据所述文件类型创建相应的播放控件,并根据所述发送端标识码和所述文件类型生成所述播放控件的控件标识码。
在本实施例中,接收端在解析获得上述发送端标识码和待共享的音视频文件的文件类型之后,根据该发送端标识码和该文件类型做好相应的接收待共享音视频文件的准备。具体地,首先根据该文件类型创建相应的播放控件,以用于播放该待共享的音视频文件,随后,根据该发送端标识码和文件类型生成播放控件的控件标识码,以用于区分来自不同的发送端的且类型不同的音视频文件。
在另一个优选实施例中,所述文件类型采用文件类型标识码表示,则步骤S22可以进一步包括子步骤S2201至S2202:
S2201、根据所述文件类型标识码创建相应的所述播放控件;
S2202、将所述发送端标识码和所述文件类型标识码相加得到的结果设置为 所述播放控件的所述控件标识码。
在本实施例中,文件类型采用文件类型标识码表示,该文件类型标识码由上述服务端与各个客户端事先约定生成。具体地,在上述服务端中保存有文件类型信息与文件类型标识码的对应关系表;发送端在发起音视频文件共享的过程中,将包含待共享的音视频文件的文件类型信息的文件共享请求发送至上述服务端,使得该服务端根据该文件共享请求中的文件类型信息查询上述对应关系表,从而确定待共享的音视频文件所对应的文件类型标识码;随后,服务端将包含该文件类型标识码的文件共享指令发送至接收端;该接收端在接收到该文件共享指令之后,从该文件共享指令中读取获得发送端标识码和上述文件类型标识码,并在根据该文件类型标识码创建相应的播放控件之后,根据该文件类型标识码和上述发送端标识码为该播放控件配置相应的控件标识码。
更优选地,服务端为各个客户端配置同步信源标识符SSRC作为客户端标识码;服务端与各个客户端之间约定以正整数n作为文件类型标识码,其中,不同的n值表示不同的文件类型。
在本实施例中,接收端在根据接收到的文件共享指令获得发送端标识码SSRC和待共享的音视频文件的文件类型标识码n后,根据该文件类型标识码n创建相应的播放控件,并将前述发送端标识码SSRC和该文件类型标识码n之和设置为该播放控件的控件标识码,则该播放控件的控件标识码被设置为SSRC+n。
例如,假设某一发送端的发送端标识码SSRC=5580,服务端与各个客户端之间约定音频文件的文件类型标识码n=1,视频文件的文件类型标识码n=2,则当该发送端发起视频文件共享时,接收端为该待共享的视频文件创建相应的播放控件,并为该播放控件配置值为5582(因5580+2=5582)的控件标识码。
S23、每当接收到所述音视频文件的音视频帧时,从所述音视频帧中提取获得所述音视频文件的文件标识码,并将所述音视频帧发送至与所述文件标识码相对应的所述控件标识码所对应的所述播放控件中播放。
在本实施例中,发送端将待共享的音视频文件以帧的形式发送至服务端。其中,各个音视频帧中包含该待共享的音视频文件的文件标识码。服务端在每 当接收到该发送端发送的音视频帧时,将该音视频帧转发给对应的接收端。接收端每当接收到服务端转发的音视频帧时,从该音视频帧中提取获得待共享的音视频文件的文件标识码,并根据该文件标识码查询本地的各个播放控件,判断其中是否具有播放标识码与该文件标识码相一致的播放控件,若是,则将接收到的音视频帧发送至该播放控件中播放,若否,则将接收到的音视频帧丢弃,并/或生成相应的错误提示信息。
在又一个优选实施例中,所述文件标识码由服务端在接收到所述发送端发送的文件共享请求时根据所述文件共享请求中的所述发送端标识码和所述文件类型生成;在步骤S23执行之前,还包括:
根据所述文件共享指令中的所述发送端标识码和所述文件类型生成基准文件标识码。
则上述步骤S23可以进一步包括子步骤S2301至S2302:
S2301、从所述音视频帧中提取获得所述音视频文件的所述文件标识码;
S2302、当判定所述文件标识码与所述基准文件标识码相同时,将所述音视频帧发送至与所述基准文件标识码相对应的所述控件标识码所对应的所述播放控件中播放。
在本实施例中,接收端在接收到文件共享指令之后,根据该文件共享指令中的发送端标识码和文件类型标识码生成相应的基准文件标识码,以用于对后期接收到的音视频帧所对应的发送端和文件类型进行验证。具体地,接收端在接收到一个音视频帧后,从该音视频帧中提取获得相应的文件标识码,并将该文件标识码与上述基准文件标识码进行比对,判断二者是否一致,若一致,则说明发送该音视频帧的发送端为前期发起音视频文件共享的发送端,且该音视频帧的文件类型为前期欲共享的文件类型,因此将该音视频帧发送至对应的播放控件中播放,若不一致,则说明该音视频帧所对应的发送端错误或者对应的文件类型错误,因此将该音视频帧丢弃,并/或生成相应的错误提示信息以供用户进行相应的处理。
更优选地,服务端为各个客户端配置同步信源标识符SSRC作为客户端标识 码;服务端与各个客户端之间约定以正整数n作为文件类型标识码,其中,不同的n值表示不同的文件类型。
在本实施例中,服务端在接收到发送端发送的文件共享请求时,根据该文件共享请求中的发送端标识码SSRC和文件类型标识码n生成文件标识码SSRC1(其中,SSRC1=SSRC+n),并将该文件标识码SSRC1返回至发送端;接收端在接收到服务端发送的文件共享指令之后,根据该文件共享指令中的发送端标识码SSRC和文件类型标识码n生成基准文件标识码SSRC2(其中,SSRC2=SSRC+n);在文件共享阶段,发送端将上述文件标识码SSRC1配置给待共享的音视频文件之后,将该音视频文件的音视频帧经由服务端发送至接收端,接收端从接收到的音视频帧中提取获得上述文件标识码SSRC1,并将该文件标识码SSRC1与上述基准文件标识码SSRC2相比较,判断二者是否一致,若一致,则认为该音视频帧为事先发起音视频共享的发送端发送的且属于欲共享的文件类型的音视频帧,该音视频帧为事先预定的欲共享的音视频文件中的音视频帧,因此将音视频帧发送至与该基准文件标识码SSRC2相一致的控件标识码所对应的播放控件中播放,若不一致,则认为该音视频帧不是事先预定的欲共享的音视频文件中的音视频帧,因此将该音视频帧丢弃,并/或生成相应的错误提示信息以供用户进行相应的处理。
在又一个优选实施例中,所述播放控件包括显示窗口,则在步骤S23执行的同时,还包括:
根据所述发送端标识码获得所述发送端的用户信息,并将所述用户信息发送至所述播放控件的显示窗口显示。
在本实施例中,播放控件的显示窗口用于显示接收端接收到的音视频文件。接收端在从文件共享指令中提取获得发送端标识码之后,根据该发送端标识码从服务端中获取该发送端标识码所对应的发送端的用户信息,并将该用户信息发送至显示窗口中进行显示。
在上述任一个实施例中,所述文件类型包括音频文件类型和视频文件类型;所述音视频文件以数据流的形式传输。
在上述任一个实施例中,所述文件共享指令由服务端在接收到所述发送端发送的文件共享请求时发送。
在上述任一个实施例中,文件类型可以为音频文件类型、视频文件类型、文档文件类型等。当文件类型为音频文件类型时,接收端所创建的播放控件可以为音乐播放器等。当文件类型为视频文件类型时,接收端所创建的播放控件可以为视频播放器等。
音视频文件可以以数据流的形式传输,则上述文件标识码为上述服务端为上述待共享的音视频文件分配的数据流的标识码。需要进一步说明的是,该音视频文件的数据流与多人聊天模式中的摄像头所拍摄的实时视频的数据流可以相互独立传输,也可以融合为一路总数据流传输。
本发明实施例所提供的音视频文件共享方法,通过在多人聊天模式中为待共享的音视频文件分配唯一对应的播放控件,并在每当接收到待共享的音视频文件的一帧数据时,即将该音视频帧数据发送至该播放控件中播放,能够实现在多人聊天过程中的音视频文件的实时播放共享,而无需等待至音视频文件下载完毕之后才能播放,从而提高在多人聊天模式中的音视频文件共享的及时性,进而提高用户体验。
参见图3,是本发明提供的音视频文件共享方法的一个优选实施例的显示效果示意图。下面对本发明实施例提供的一种音视频文件共享方法的具体工作过程进行详细描述:
如图3(a)所示,在视频会议中有三个客户端正在进行视频通话,包括A客户端、B客户端和C客户端,假设A客户端为发送端,B客户端和C客户端为接收端,并且服务端为各个客户端配置同步信源标识符SSRC作为客户端标识码,服务端与各个客户端之间约定以正整数n作为文件类型标识码。
发送端A通过点击按钮或将音视频文件拖入视频会议窗口向服务端发送文件共享请求;服务端在接收到发送端A发送的文件共享请求时,对该文件共享请求进行解析,获得发送端A的发送端标识码SSRC和待共享的音视频文件的文件类型标识码n,根据该发送端标识码SSRC和文件类型标识码n生成文件标识 码SSRC1(SSRC1=SSRC+n),并将该文件标识码SSRC1返回至发送端A,这里假设发送端A的发送端标识码SSRC=5590,文件类型标识码n=2,文件类型为视频文件,则文件标识码SSRC1=5592;同时,服务端根据该发送端标识码SSRC和文件类型标识码n生成相应的文件共享指令并发送至接收端B和接收端C,以下以接收端C为例进行说明,接收端B情况同理。
接收端C在接收到服务端发送的文件共享指令之后,从该文件共享指令中解析获得发送端A的发送端标识码SSRC=5590和待共享的音视频文件的文件类型标识码n=2;由于n=2,表示视频文件,接收端C为共享的视频文件创建的播放控件为视频播放器,并且该视频播放器的控件标识码为5592;同时,接收端C根据该发送端标识码SSRC和文件类型标识码n生成基准文件标识码SSRC2(SSRC2=SSRC+n),则基准文件标识码SSRC2=5592。
发送端A将服务端返回的文件标识码SSRC1配置给待共享的视频文件,并将该视频文件的数据流通过服务端发送至接收端C;接收端C从该数据流中提取获得文件标识码SSRC1=5592,将该文件标识码SSRC1=5592与基准文件标识码SSRC2相比较,此时SSRC2=5592,与SSRC1一致,则将该数据流发送至控件标识码为5592的视频播放器中播放;同时,接收端C根据从文件共享指令中获得的发送端A的发送端标识码SSRC=5590确定发送端A的用户信息,并将该用户信息发送至视频播放器的窗口进行显示。另一方面,如果接收端C找不到与文件标识码SSRC1=5592相一致的基准文件标识码,则将该数据流丢弃,并/或生成相应的错误提示信息以供用户进行相应的处理。
如图3(b)和图3(c)所示,是共享的音视频文件的两种播放方式:图3(b)所示的方式为发送端A将共享的音视频文件的数据流作为单独的一路数据流发送,接收端C为这路数据流创建一个单独的显示窗口用来播放共享的音视频文件,这种方式将共享的音视频文件作为客户端加入到视频会议中,以显示客户端的视频会议画面的方式显示音视频文件的画面;图3(c)所示的方式为发送端A将共享的音视频文件的数据流和发送端A本身的视频会议的数据流合并为一路数据流发送,而不作为单独的一路数据流发送,接收端C在接收到这 路数据流时会在接收端C本身的视频窗口中创建一个子窗口用来播放共享的音视频文件,共享的音视频文件以子窗口的形式与接收端C本身的视频窗口一起显示,这种方式的缺点在于牺牲了灵活性,共享的音视频文件无法被单独提取出来,但是可以节省传输带宽,接收端C的显示界面在逻辑上不需要做任何改变。
当共享的音视频文件播放结束后,关闭播放窗口,视频会议恢复到如图3(a)所示的状态。
由于共享的音视频文件是以数据流的形式传输,接收端不需要下载完整的音视频文件,而是直接对每次接收到的数据流进行处理以播放显示,如果接收端采用如图3(b)所示的方式,且接收端具有数据流保存功能,在共享的音视频文件播放结束后还可以选择是否保存文件,并且由于音视频文件的所有数据流已经在播放结束的时候传输完毕,保存文件的操作是在本地完成的,无需再次等待文件的传输,因此,提高了音视频文件共享的及时性并提高了用户体验。
如果发送端在共享音视频文件时进行过播放位置选择等操作,跳过了某一部分的音视频,音视频文件的数据就会出现部分缺失的情况,此时,接收端将无法接收到完整的音视频文件,上述保存文件的功能也就没有意义,从用户体验角度考虑,发送端在进行播放位置选择等操作前需要发送提醒信息,以避免接收端选择保存文件。
本发明实施例还提供了一种音视频文件共享装置,能够实现上述实施例中的音视频文件共享方法的所有流程。
参见图4,是本发明提供的音视频文件共享装置的一个优选实施例的结构框图,包括:
共享指令解析模块31,用于当处于多人聊天模式时,对接收到的文件共享指令进行解析,获得发送端标识码和待共享的音视频文件的文件类型;其中,所述发送端标识码为共享所述音视频文件的发送端的标识码;
播放控件创建模块32,用于根据所述文件类型创建相应的播放控件,并根据所述发送端标识码和所述文件类型生成所述播放控件的控件标识码;以及,
文件实时共享模块33,用于每当接收到所述音视频文件的音视频帧时,从所述音视频帧中提取获得所述音视频文件的文件标识码,并将所述音视频帧发送至与所述文件标识码相对应的所述控件标识码所对应的所述播放控件中播放。
具体的,所述文件类型采用文件类型标识码表示,则所述播放控件创建模块32具体为:
控件创建单元,用于根据所述文件类型标识码创建相应的所述播放控件;以及,
控件标识码设置单元,用于将所述发送端标识码和所述文件类型标识码相加得到的结果设置为所述播放控件的所述控件标识码。
具体的,所述文件标识码由服务端在接收到所述发送端发送的文件共享请求时根据所述文件共享请求中的所述发送端标识码和所述文件类型生成;
所述音视频文件共享装置还包括:
基准文件标识码生成模块,用于根据所述文件共享指令中的所述发送端标识码和所述文件类型生成基准文件标识码;
则所述文件实时共享模块33具体为:
文件标识码提取单元,用于从所述音视频帧中提取获得所述音视频文件的所述文件标识码;以及,
文件播放单元,用于当判定所述文件标识码与所述基准文件标识码相同时,将所述音视频帧发送至与所述基准文件标识码相对应的所述控件标识码所对应的所述播放控件中播放。具体的,所述播放控件包括显示窗口;
则所述音视频文件共享装置还包括:
用户信息显示模块,用于根据所述发送端标识码获得所述发送端的用户信息,并将所述用户信息发送至所述播放控件的显示窗口显示。
具体的,所述文件类型包括音频文件类型和视频文件类型;所述音视频文件以数据流的形式传输。
具体的,所述文件共享指令由服务端在接收到所述发送端发送的文件共享请求时发送。
本发明实施例所提供的音视频文件共享装置,通过在多人聊天模式中为待共享的音视频文件分配唯一对应的播放控件,并在每当接收到待共享的音视频文件的一帧数据时,即将该音视频帧数据发送至该播放控件中播放,能够实现在多人聊天过程中的音视频文件的实时播放共享,而无需等待至音视频文件下载完毕之后才能播放,从而提高在多人聊天模式中的音视频文件共享的及时性,进而提高用户体验。
本发明实施例还提供了一种计算机可读存储介质,所述计算机可读存储介质包括存储的计算机程序;其中,所述计算机程序在运行时控制所述计算机可读存储介质所在的设备执行上述任一项所述的音视频文件共享方法。
本发明实施例还提供了一种终端设备。
参见图5,是本发明提供的终端设备的一个优选实施例的结构框图,包括至少一个存储器41以及至少一个处理器42;其中:
所述存储器41包括存储的至少一个可执行程序;
所述处理器42用于执行所述可执行程序,所述处理器42在执行所述可执行程序时实现上述任一项所述的音视频文件共享方法。
需要说明的是,图5仅以该终端设备中的一个存储器和一个处理器相连接为例进行说明,在一些具体的实施例中,该终端设备中还可以包括多个存储器和/或多个处理器,其具体的数目及连接方式可根据实际情况需要进行设置和适应性调整。
综上,本发明实施例所提供的音视频文件共享方法、装置及系统、计算机可读存储介质、终端设备,通过在多人聊天模式中为待共享的音视频文件分配唯一对应的播放控件,并在每当接收到待共享的音视频文件的一帧数据时,即将该音视频帧数据发送至该播放控件中播放,能够实现在多人聊天过程中的音视频文件的实时播放共享,而无需等待至音视频文件下载完毕之后才能播放,从而提高在多人聊天模式中的音视频文件共享的及时性,进而提高用户体验。
以上所述仅是本发明的优选实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本发明技术原理的前提下,还可以做出若干改进和变 形,这些改进和变形也应视为本发明的保护范围。

Claims (10)

  1. 一种音视频文件共享方法,其特征在于,包括:
    当处于多人聊天模式时,对接收到的文件共享指令进行解析,获得发送端标识码和待共享的音视频文件的文件类型;其中,所述发送端标识码为共享所述音视频文件的发送端的标识码;
    根据所述文件类型创建相应的播放控件,并根据所述发送端标识码和所述文件类型生成所述播放控件的控件标识码;
    每当接收到所述音视频文件的音视频帧时,从所述音视频帧中提取获得所述音视频文件的文件标识码,并将所述音视频帧发送至与所述文件标识码相对应的所述控件标识码所对应的所述播放控件中播放。
  2. 如权利要求1所述的音视频文件共享方法,其特征在于,所述文件类型采用文件类型标识码表示;
    则所述根据所述文件类型创建相应的播放控件,并根据所述发送端标识码和所述文件类型生成所述播放控件的控件标识码具体为:
    根据所述文件类型标识码创建相应的所述播放控件;
    将所述发送端标识码和所述文件类型标识码相加得到的结果设置为所述播放控件的所述控件标识码。
  3. 如权利要求1所述的音视频文件共享方法,其特征在于,所述文件标识码由服务端在接收到所述发送端发送的文件共享请求时根据所述文件共享请求中的所述发送端标识码和所述文件类型生成;
    在所述从所述音视频帧中提取获得所述音视频文件的文件标识码,并将所述音视频帧发送至与所述文件标识码相对应的所述控件标识码所对应的所述播放控件中播放之前,还包括:
    根据所述文件共享指令中的所述发送端标识码和所述文件类型生成基准文 件标识码;
    则所述从所述音视频帧中提取获得所述音视频文件的文件标识码,并将所述音视频帧发送至与所述文件标识码相对应的所述控件标识码所对应的所述播放控件中播放具体为:
    从所述音视频帧中提取获得所述音视频文件的所述文件标识码;
    当判定所述文件标识码与所述基准文件标识码相同时,将所述音视频帧发送至与所述基准文件标识码相对应的所述控件标识码所对应的所述播放控件中播放。
  4. 如权利要求1所述的音视频文件共享方法,其特征在于,所述播放控件包括显示窗口;
    则在所述从所述音视频帧中提取获得所述音视频文件的文件标识码,并将所述音视频帧发送至与所述文件标识码相对应的所述控件标识码所对应的所述播放控件中播放的同时,还包括:
    根据所述发送端标识码获得所述发送端的用户信息,并将所述用户信息发送至所述播放控件的显示窗口显示。
  5. 如权利要求1至4中任一项所述的音视频文件共享方法,其特征在于,所述文件类型包括音频文件类型和视频文件类型;所述音视频文件以数据流的形式传输。
  6. 如权利要求1至4中任一项所述的音视频文件共享方法,其特征在于,所述文件共享指令由服务端在接收到所述发送端发送的文件共享请求时发送。
  7. 一种音视频文件共享装置,其特征在于,包括:
    共享指令解析模块,用于当处于多人聊天模式时,对接收到的文件共享指令进行解析,获得发送端标识码和待共享的音视频文件的文件类型;其中,所 述发送端标识码为共享所述音视频文件的发送端的标识码;
    播放控件创建模块,用于根据所述文件类型创建相应的播放控件,并根据所述发送端标识码和所述文件类型生成所述播放控件的控件标识码;以及,
    文件实时共享模块,用于每当接收到所述音视频文件的音视频帧时,从所述音视频帧中提取获得所述音视频文件的文件标识码,并将所述音视频帧发送至与所述文件标识码相对应的所述控件标识码所对应的所述播放控件中播放。
  8. 一种音视频文件共享系统,其特征在于,包括至少一个发送端、服务端以及至少一个接收端;其中:
    所述服务端用于为每个所述发送端、每个所述接收端和每个文件类型分配对应的标识码;所述服务端在接收到所述发送端发送的文件共享请求时发送文件共享指令至所述接收端,并根据所述文件共享请求中的所述发送端的标识码和所述文件类型的标识码生成对应的文件标识码;所述服务端还用于接收所述发送端共享的所述音视频文件并将所述音视频文件的每个音视频帧依次转发至对应的所述接收端;
    每个所述发送端用于将所述文件共享请求发送至所述服务端;所述发送端在接收到所述服务端返回的所述文件标识码后,采用所述文件标识码对所述音视频文件进行标识,并将经过所述标识的所述音视频文件发送至所述服务端中共享;
    每个所述接收端用于执行如权利要求1至6中任一项所述的音视频文件共享方法。
  9. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质包括存储的计算机程序;其中,所述计算机程序在运行时控制所述计算机可读存储介质所在的设备执行如权利要求1至6中任一项所述的音视频文件共享方法。
  10. 一种终端设备,其特征在于,包括至少一个存储器以及至少一个处理 器;其中:
    所述存储器包括存储的至少一个可执行程序;
    所述处理器用于执行所述可执行程序,所述处理器在执行所述可执行程序时实现如权利要求1至6中任一项所述的音视频文件共享方法。
PCT/CN2017/116314 2017-10-26 2017-12-15 音视频文件共享方法、装置及系统、存储介质、终端设备 WO2019080309A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201711016804.0A CN107846634B (zh) 2017-10-26 2017-10-26 音视频文件共享方法、装置及系统、存储介质、终端设备
CN201711016804.0 2017-10-26

Publications (1)

Publication Number Publication Date
WO2019080309A1 true WO2019080309A1 (zh) 2019-05-02

Family

ID=61662983

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/116314 WO2019080309A1 (zh) 2017-10-26 2017-12-15 音视频文件共享方法、装置及系统、存储介质、终端设备

Country Status (2)

Country Link
CN (1) CN107846634B (zh)
WO (1) WO2019080309A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111049792B (zh) * 2019-10-08 2022-03-22 广州视源电子科技股份有限公司 音频传输方法、装置、终端设备和存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006146804A (ja) * 2004-11-24 2006-06-08 Nippon Telegr & Teleph Corp <Ntt> 映像コンテンツ提供方法及び装置及びプログラム
CN102694989A (zh) * 2011-08-26 2012-09-26 新奥特(北京)视频技术有限公司 一种电视节目多媒体文件的传输方法及系统
CN103237191A (zh) * 2013-04-16 2013-08-07 成都飞视美视频技术有限公司 在视频会议中同步推送音视频的方法
CN103744863A (zh) * 2013-12-13 2014-04-23 乐视致新电子科技(天津)有限公司 一种多媒体文件播放方法和电子设备
CN104602133A (zh) * 2014-11-21 2015-05-06 腾讯科技(北京)有限公司 多媒体文件共享方法和终端及服务器
CN106454497A (zh) * 2016-10-31 2017-02-22 乐视控股(北京)有限公司 一种投屏播放视频的方法及装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006146804A (ja) * 2004-11-24 2006-06-08 Nippon Telegr & Teleph Corp <Ntt> 映像コンテンツ提供方法及び装置及びプログラム
CN102694989A (zh) * 2011-08-26 2012-09-26 新奥特(北京)视频技术有限公司 一种电视节目多媒体文件的传输方法及系统
CN103237191A (zh) * 2013-04-16 2013-08-07 成都飞视美视频技术有限公司 在视频会议中同步推送音视频的方法
CN103744863A (zh) * 2013-12-13 2014-04-23 乐视致新电子科技(天津)有限公司 一种多媒体文件播放方法和电子设备
CN104602133A (zh) * 2014-11-21 2015-05-06 腾讯科技(北京)有限公司 多媒体文件共享方法和终端及服务器
CN106454497A (zh) * 2016-10-31 2017-02-22 乐视控股(北京)有限公司 一种投屏播放视频的方法及装置

Also Published As

Publication number Publication date
CN107846634A (zh) 2018-03-27
CN107846634B (zh) 2020-01-14

Similar Documents

Publication Publication Date Title
JP5472882B2 (ja) 会議端末、会議サーバー、会議システム、およびデータ処理方法
WO2021057120A1 (zh) 数据传输方法、装置、以及计算机存储介质
CN111935443B (zh) 一种视频会议实时直播分享到即时通讯工具的方法和装置
US10715344B2 (en) Method of establishing a video call using multiple mobile communication devices
JP2007514235A (ja) イメージ共有機能を有するリアルタイムメッセージ通信のためのシステムおよび方法
TW201215142A (en) Unified communication based multi-screen video system
US10469627B2 (en) Rapid optimization of media stream bitrate
WO2016019775A1 (zh) 会议迁移的方法、装置及系统
US10778736B2 (en) On demand in-band signaling for conferences
WO2021143043A1 (zh) 多人即时通讯方法、系统、装置及电子设备
WO2016082577A1 (zh) 视频会议的处理方法及装置
CN111447391A (zh) 会议数据同步方法、装置、计算机设备及存储介质
WO2012163075A1 (zh) 一种视频会议的处理方法、装置和通信系统
WO2014161326A1 (zh) 视频通讯方法及装置
WO2015003532A1 (zh) 多媒体会议的建立方法、装置及系统
CN111246150A (zh) 视频会议的控制方法、系统、服务器和可读存储介质
JP4603551B2 (ja) リアルタイム制御プロトコル(rtcp)のメッセージへのセッション記述のメッセージの埋め込み
WO2016206471A1 (zh) 多媒体业务处理方法、系统及装置
US11431770B2 (en) Method, system, apparatus, and electronic device for managing data streams in a multi-user instant messaging system
CN110996039B (zh) 电子白板共享方法、系统和计算机可读存储介质
WO2019080309A1 (zh) 音视频文件共享方法、装置及系统、存储介质、终端设备
US9059860B2 (en) Techniques for announcing conference attendance changes in multiple languages
JP3973966B2 (ja) 多地点会議システム、多地点会議システムの端末装置、および多地点会議システムのデータミキシング処理装置
WO2018214614A1 (en) A method of establishing a video call using multiple mobile communications devices
CN110719431A (zh) 一种视频会议的文档处理方法、装置、系统及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17929633

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17929633

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 21/10/2020)

122 Ep: pct application non-entry in european phase

Ref document number: 17929633

Country of ref document: EP

Kind code of ref document: A1