CN110166801A - Processing method, device and the storage medium of media file - Google Patents

Processing method, device and the storage medium of media file Download PDF

Info

Publication number
CN110166801A
CN110166801A CN201910340609.6A CN201910340609A CN110166801A CN 110166801 A CN110166801 A CN 110166801A CN 201910340609 A CN201910340609 A CN 201910340609A CN 110166801 A CN110166801 A CN 110166801A
Authority
CN
China
Prior art keywords
data
media
media file
growth
file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910340609.6A
Other languages
Chinese (zh)
Other versions
CN110166801B (en
Inventor
高小猛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201910340609.6A priority Critical patent/CN110166801B/en
Publication of CN110166801A publication Critical patent/CN110166801A/en
Application granted granted Critical
Publication of CN110166801B publication Critical patent/CN110166801B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/251Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • H04N21/252Processing of multiple end-users' preferences to derive collaborative data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866Management of end-user data
    • H04N21/25891Management of end-user data being end-user preferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47202End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8106Monomedia components thereof involving special audio data, e.g. different tracks for different languages

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Computing Systems (AREA)
  • Computer Graphics (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the invention discloses a kind of processing method of media file, device and storage mediums, wherein method includes: the play instruction for receiving media file;Based on the play instruction, the media data of the media file is obtained;The growth data for showing form for extending the media file is obtained, and the configuration data that target extends is realized in the instruction of the corresponding growth data;Based on the configuration data, by merge the growth data show form and the media data show form in a manner of, show the media data and the growth data.In this way, make media data to show form more rich and varied, improve user experience.

Description

Processing method, device and the storage medium of media file
Technical field
The present invention relates to data processing technique more particularly to a kind of processing methods of media file, device and storage medium.
Background technique
With the development of multimedia technology, in online multimedia playing process, only online multimedia self information Single presentation, display form is single, can not adapt to the diversified demand that user shows information.
Summary of the invention
The embodiment of the present invention provides processing method, device and the storage medium of a kind of media file, being capable of extended medium text Show form in part playing process.
The technical solution of the embodiment of the present invention is achieved in that
The embodiment of the present invention provides a kind of processing method of media file, comprising:
Receive the play instruction of media file;
Based on the play instruction, the media data of the media file is obtained;
Obtain the growth data for showing form for extending the media file, and the finger of the corresponding growth data Show the configuration data for realizing target extension;
Based on the configuration data, to merge in the form of the showing of the growth data and the media data shows form Mode, show the media data and the growth data.
The embodiment of the present invention also provides a kind of processing unit of media file, and described device includes:
Receiving unit, for receiving the play instruction of media file;
Acquiring unit obtains the media data of the media file for being based on the play instruction;
And for obtaining the growth data for showing form for extending the media file, and the corresponding expansion The configuration data of target extension is realized in the instruction for opening up data;
Broadcast unit, for being based on the configuration data, to merge in the form of the showing of the growth data and the media The mode for showing form of data shows the media data and the growth data.
In above scheme, the acquiring unit is also used to obtain for prompting the key message of the media file to switch At least one of audio data, video data and image data.
In above scheme, the acquiring unit is also used to determine the file identification of the media file;
And send the growth data request for carrying the file identification;
And receive the growth data of the correspondence file identification of return.
In above scheme, the acquiring unit is also used in response to current user's logging state be to have logged in, obtains phase The user identifier answered;
And it is based on the user identifier, determine corresponding social network information;
And it is based on the social network information, obtain the growth data for being associated with the media file.
In above scheme, the acquiring unit is also used to obtain the user identifier of registered users, the registered users The client end of playing back of the corresponding media file;
And the user identifier based on the registered users, determine the associated growth data of the registered users;
And from the identified growth data, screening obtains the growth data for being associated with the media file.
In above scheme, the acquiring unit is also used in the playing process of the media file, receives corresponding institute State the form extended instruction of media file;
And in response to the form extended instruction, obtain the extension for showing form for extending the media file Data.
In above scheme, the acquiring unit is also used to obtain the historical behavior data of target user;
And the historical behavior data are based on, determine the user's portrait for indicating the interest classification of the target user;
And obtain the growth data of corresponding user's portrait.
In above scheme, the broadcast unit is also used to melt based on target extended mode indicated by the configuration data The growth data and the media data are closed, amalgamation media data are obtained;
By broadcast window, the amalgamation media data that show.
In above scheme, the broadcast unit is also used to show the media data by the first broadcast window;
And it is based on the configuration data, the growth data is showed by the second broadcast window, so that the spreading number According to show form and the form that shows of the media data blends.
The embodiment of the present invention also provides a kind of processing unit of media file, comprising:
Memory is configured to save the processing routine of media file;
Processor is configured to operation described program, wherein described program executes institute provided in an embodiment of the present invention when running State the processing method of media file.
The embodiment of the present invention also provides a kind of storage medium, is stored with executable program, and the executable program is processed When device executes, the processing method of the media file provided in an embodiment of the present invention is realized.
It is had the advantages that using the above embodiment of the present invention
By merge growth data show form and media data show form in a manner of, show media data and extension Data extend the broadcasting form of media file so that media data to show form more rich and varied, improve and use Family experience.
Detailed description of the invention
Fig. 1 is the configuration diagram of the processing system of media file provided in an embodiment of the present invention;
Fig. 2 is the hardware structural diagram of the processing unit of media file provided in an embodiment of the present invention;
Fig. 3 is the flow diagram of the processing method of media file provided in an embodiment of the present invention;
Fig. 4 is the flow diagram of the processing method of media file provided in an embodiment of the present invention;
Fig. 5 is the interface schematic diagram that user provided in an embodiment of the present invention triggers form extension;
Fig. 6 is the flow diagram of the processing method of media file provided in an embodiment of the present invention;
Fig. 7 is terminal provided in an embodiment of the present invention and the schematic diagram that server cooperative achievement media file is handled;
Fig. 8 is the schematic diagram of the audio enhancing provided in an embodiment of the present invention for realizing online film;
Fig. 9 is the software configuration schematic diagram of the processing unit of media file provided in an embodiment of the present invention.
Specific embodiment
The present invention is further described in detail below with reference to the accompanying drawings and embodiments.It should be appreciated that mentioned herein Embodiment is only used to explain the present invention, is not intended to limit the present invention.In addition, embodiment provided below is for implementing Section Example of the invention, rather than provide and implement whole embodiments of the invention, in the absence of conflict, the present invention is implemented Example record technical solution can mode in any combination implement.
It should be noted that in embodiments of the present invention, the terms "include", "comprise" or its any other variant are intended to Cover non-exclusive inclusion, so that including the method for a series of elements or device not only includes wanting of being expressly recited Element, but also including other elements that are not explicitly listed, or further include for implementation method or device intrinsic want Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including the element Method or device in there is also other relevant factor (such as the step in method or the unit in device, for example, Unit can be partial circuit, segment processor, subprogram or software etc.).
For example, the processing method of media file provided in an embodiment of the present invention contains a series of step, but this hair The processing method for the media file that bright embodiment provides is not limited to documented step, similarly, provided in an embodiment of the present invention The processing unit of media file includes a series of units, but device provided in an embodiment of the present invention is not limited to include defining The unit of record, the unit of required setting when can also include to obtain relevant information or being handled based on information.
In the following description, related term " first second " be only be the similar object of difference, do not represent needle To the particular sorted of object, it is possible to understand that specific sequence or successively can be interchanged in ground, " first second " in the case where permission Order, so that the embodiment of the present invention described herein can be implemented with the sequence other than illustrating or describing herein.
Before the present invention will be described in further detail, noun involved in the embodiment of the present invention and term are said Bright, noun involved in the embodiment of the present invention and term are suitable for following explanation.
1) user draws a portrait, and refers to the virtual representations of real user, a series of target user being built upon on attribute datas Model herein refers to the interest model of the stratification of the correspondence user gone out according to the historical behavior data abstraction of user, for referring to Show the interest classification of user.
2) media file, the matchmaker of retrievable various forms (such as video, audio, picture and text media format) in internet Video file, audio file, the article including picture and text form showed in body, such as client.
3) in response to the condition or state relied on for indicating performed operation, when the relied on condition of satisfaction Or when state, performed one or more operations be can be in real time, it is possible to have the delay of setting;Do not saying especially In the case where bright, there is no the limitations for executing sequencing for performed multiple operations.
Fig. 1 is an optional configuration diagram of the processing system of media file provided in an embodiment of the present invention, referring to Fig. 1 supports an exemplary application to realize, terminal (including terminal 400-1 and terminal 400-2) passes through the connection clothes of network 300 Business device 200, network 300 can be wide area network or local area network, or be combination, and Radio Link is used to realize data Transmission.
Terminal (terminal 400-1 and/or terminal 400-2), for receiving the play instruction of media file, is referred to based on broadcasting It enables, the media data of media file is requested to server 200;
And for requesting the growth data for showing form for extended medium file, and correspondence to server 200 The configuration data of target extension is realized in the instruction of growth data;
Server 200 returns to media data, growth data and configuration data for the request based on terminal;
In practical applications, server 200 both can be a server of the support various businesses being separately configured, and also may be used To be configured to a server cluster.
Terminal (terminal 400-1 and/or terminal 400-2) is also used to based on configuration data, to merge showing for growth data The mode for showing form of form and media data, shows media data and growth data.
In practical applications, terminal can be whole for various types of users such as smart phone, tablet computer, laptop End can also be wearable computing devices, personal digital assistant (PDA), desktop computer, cellular phone, media player, lead Any two or multiple in boat equipment, game machine, television set or these data processing equipments or other data processing equipments Combination.
In some embodiments, media play client is provided in terminal, and (such as video playing client, audio play visitor Family end), when user is based on media play client triggering playback of media files, the automatic expansion realized media file and show form Exhibition.
When media play client receives the play instruction of the media file of user's triggering, matchmaker is requested to server 200 The media data of body file, the growth data for showing form for extended medium file, and the instruction of corresponding growth data It realizes the configuration data of target extension, is based on configuration data, to merge in the form of the showing of growth data and media data shows The mode of form shows media data and growth data.
In some embodiments, in the playing process of media file, matchmaker is triggered when user is based on media play client When the form extended instruction of body file, realize that media file shows the extension of form.
When play instruction of the user based on media play client triggering media file, media play client is to service Device 200 requests the media data of media file, to play media file, in the playing process of media file, and media play visitor Family termination receives the form extended instruction of the media file of user's triggering, requests to server 200 for extended medium file Show the growth data of form, and the configuration data that target extends is realized in the instruction of corresponding growth data, is based on configuration data, By merge growth data show form and media data show form in a manner of, show media data and growth data.
Next the processing unit of media file provided in an embodiment of the present invention is illustrated.The embodiment of the present invention provides The processing unit of media file may be embodied as the mode of hardware or software and hardware combining, illustrate that the embodiment of the present invention mentions below The various exemplary implementations of the device of confession.
It elaborates below to the hardware configuration of the processing unit of the media file of the embodiment of the present invention, Fig. 2 is this hair The hardware structural diagram of the processing unit for the media file that bright embodiment provides, in actual implementation, the processing of media file Device may be disposed at terminal, such as be realized by terminal 400-1 in Fig. 1, and the processing unit of media file can also be set to server And in terminal, such as by 200 cooperative achievement of terminal 400-1 in Fig. 1 and server, it will be understood that Fig. 2 illustrate only media file Processing unit exemplary structure rather than entire infrastructure, can be implemented as needed Fig. 2 shows part-structure or all knot Structure.
Referring to fig. 2, the processing unit of media file provided in an embodiment of the present invention includes: at least one processor 201, deposits Reservoir 202, user interface 203 and at least one network interface 204.Various components in the processing unit 20 of media file pass through Bus system 205 is coupled.It is appreciated that bus system 205 is for realizing the connection communication between these components.Bus System 205 further includes power bus, control bus and status signal bus in addition in addition to including data/address bus.But in order to clear For the sake of explanation, various buses are all designated as bus system 205 in Fig. 2.
Wherein, user interface 203 may include display, keyboard, mouse, trace ball, click wheel, key, button, sense of touch Plate or touch screen etc..
It is appreciated that memory 202 can be volatile memory or nonvolatile memory, may also comprise volatibility and Both nonvolatile memories.
Memory 202 in the embodiment of the present invention is for storing various types of data to support the processing of media file to fill Set 20 operation.The example of these data includes: any executable finger for operating in the processing unit 20 of media file It enables, such as executable instruction realizes that the program of the processing method of the media file of the embodiment of the present invention may be embodied in executable finger In order.
The processing method for the media file that the embodiment of the present invention discloses can be applied in processor 201, or by handling Device 201 is realized.Processor 201 may be a kind of IC chip, the processing capacity with signal.During realization, matchmaker Each step of the processing method of body file can pass through the integrated logic circuit of the hardware in processor 201 or software form Instruction is completed.Above-mentioned processor 201 can be general processor, digital signal processor (DSP, Digital Signal Processor) either other programmable logic device, discrete gate or transistor logic, discrete hardware components etc..Place Reason device 201 may be implemented or execute disclosed each method, step and logic diagram in the embodiment of the present invention.General processor It can be microprocessor or any conventional processor etc..It the step of method in conjunction with disclosed in the embodiment of the present invention, can be with Be embodied directly in hardware decoding processor and execute completion, or in decoding processor hardware and software module combination executed At.Software module can be located in storage medium, which is located at memory 202, and processor 201 reads memory 202 In information, the step of completing the processing method of media file provided in an embodiment of the present invention in conjunction with its hardware.
Next the processing method of media file provided in an embodiment of the present invention is illustrated.Fig. 3 is implementation of the present invention The flow diagram of the processing method for the media file that example provides, in some embodiments, the processing method of the media file can Implemented by terminal, as implemented by the terminal 400-1 in Fig. 1, media play client is provided on terminal 400-1, in conjunction with Fig. 1 And Fig. 3, the processing method of media file provided in an embodiment of the present invention include:
Step 301: the play instruction of media play client reception media file.
In practical applications, media play client broadcasting for realizing media file (such as video file, audio file) It puts, is specifically as follows video playing client, audio client end of playing back etc..User is based on media play client triggering instruction matchmaker The play instruction (such as clicking operation) that body file plays, to realize the broadcasting to media file.
Step 302: being based on play instruction, obtain the media data of media file.
In some embodiments, the encapsulation format of media file be stream media format, i.e., media file need not completely download, Additional transcoding is not needed, can be played by decoding, such as FLV (Flash Video) file;In further embodiments, media The encapsulation format of file is non-stream media format, i.e., after media file needs complete downloading, can just be played by decoding, such as form Media video (WMV, Windows Media Video) file, MKV file format (MKV, MKV file format) file etc..
For different media file types, media data can be at least one of video data and audio data, In practical applications, media file further includes metadata, that is, describes the data of media data, carrying in metadata ensures media The media information that data are correctly decoded.
Step 303: obtaining the growth data for showing form for being used for extended medium file, and the finger of corresponding growth data Show the configuration data for realizing target extension.
In some embodiments, the extension that media file shows form can be the key content of prominent media file, such as The crucial plot of prominent (setting off by contrast) media file, as protruded the plot of making laughs (laughing at a little) in video, setting off touching plot in video by contrast (lacrimal point) etc.;In further embodiments, the extension that media file shows form can also be crucial letter in prompt media file The switching of breath, such as scene change, the prompt user rest, imitation performance of prompt video.
Growth data is illustrated.In some embodiments, growth data can be audio data, video data and figure At least one of sheet data.
Illustratively, growth data is audio data, which includes at least one of: true voice data, Synth Voice data, non-voice data;Wherein, true voice data are the true voice data of acquisition/recording, such as to Mr. Yu For a film, the sound of film spectators in movie theatre playing process is acquired, using the sound of spectators as being used for growth data; Synth Voice data are the virtual voice data of the analog subscriber sound of synthesis, such as simulation public figure's (such as film of synthesis Star) voice data;Non- voice data packet includes the animal sounds (such as mewing is barked) of acquisition, and virtually real by software Existing virtual acoustic, such as virtual applause, virtual laugh.
Illustratively, growth data is video data, and in practical applications, video data can be in prominent Video Key The perhaps animation data of prompt Video Key information switching, is made laughs as imitated in video (media file) using animated character representation Plot to protrude, laugh at a little or video data can also be performance with real people and real events for using real-life as creation material by video The record video data of object is such as set off by contrast in video (media file) by true environmental pollution video data and advocates environment guarantor The plot of shield.
The acquisition opportunity of growth data is illustrated.In some embodiments, after user triggers playback of media files, from The dynamic acquisition for realizing growth data, that is, media play client is while obtaining media data, to server request The configuration data of growth data and corresponding growth data;In further embodiments, the acquisition of growth data is triggered by user After execute, such as during playback of media files, user by clicking operation trigger form extended instruction, to indicate media play The configuration data of user end to server request growth data and corresponding growth data.
The acquisition modes of growth data are illustrated.In some embodiments, media play client can be by as follows Mode obtains growth data based on the file identification of media file: media play client determines the file identification of media file, The growth data for sending carrying file identification is requested to server, and receives the spreading number of the respective file mark of server return According to.By taking media file is video file as an example, media play client determines that video identifier (ID, IDentity) is sent and carries view The growth data of frequency ID is requested to server, and is received the growth data of correspondence video ID of server return and corresponded to extension The configuration data of data.In this way, growth data is corresponding with specific file identification (such as video ID), ensure that growth data with The relevance of currently playing media file improves user during playback of media files to the acceptance of growth data, improves The clicking rate of media file.
In further embodiments, media play client can also obtain spreading number based on user identifier in the following way According to: it is to have logged in response to current user's logging state, media play client obtains corresponding user identifier, is based on user Mark, determines corresponding social network information, is based on social network information, obtains the growth data of association media file.With matchmaker Body file is the user account of media play client acquisition currently logged on user for video file, based on user account, really The fixed associated good friend's account of the user account determines that the good friend of login user obtains the good friend based on determining good friend's account The growth data of the correspondence of the account relating video file;Still by taking media file is video file as an example, media play client The user account of currently logged on user is obtained, user account is based on, determines the user account of user account concern, is i.e. determination is stepped on Family user of interest is employed, the user account based on concern obtains user account of interest associated correspondence video text The growth data of part.In this way, the spreading number of growth data or of interest user of the growth data from currently logged on user good friend According to so that growth data improves viewing/listening experience of user, enhancing user for when showing form of extended medium file Viscosity.
In further embodiments, media play client can also obtain spreading number based on user identifier in the following way According to: media play client obtains the user identifier of registered users, and registered users correspond to the media play client, are based on The user identifier of registered users determines the associated growth data of registered users, from the associated growth data of registered users In, screening obtains the growth data for being associated with the media file.In this way, growth data has been infused in current media client end of playing back The growth data that volume user provides, improves interaction enthusiasm of the user based on media play client, and user experience is good.
In further embodiments, media play client can also be drawn a portrait based on user in the following way and obtain spreading number According to: media play client obtains the historical behavior data of target user, is based on historical behavior data, determines instruction target user Interest classification user's portrait, obtain the growth data of corresponding user's portrait.Here, target user can be media play visitor The user that family end currently logs in, is drawn a portrait by user, obtains growth data provided by the interested user of user (such as star), In this way, the interest-degree that enhancing user shows media file, improves the broadcasting rate of media file.
Step 304: configuration data is based on, to merge in the form of the showing of growth data and the side for showing form of media data Formula shows media data and growth data.
In some embodiments, what media play client can realize growth data in the following way shows form and matchmaker The fusion for showing form of volume data and media data and growth data show: media play client is based on configuration number According to indicated target extended mode, growth data and media data are merged, amalgamation media data are obtained, by broadcast window, The amalgamation media data showed.
Here, extended mode is illustrated.In some embodiments, extended mode may include at least one of: sound Frequency fusion, wicket fusion, barrage fusion;Wherein, it includes audio data that audio, which merges in corresponding growth data, by the audio number Audio fusion is carried out according to the audio data in media file;It includes video data that wicket, which merges in corresponding growth data, will The video data is played by way of wicket with media file synchronization;It includes text number that barrage, which merges in corresponding growth data, According to, by the lteral data during showing media data pass through barrage show.
In further embodiments, what media play client can also realize growth data in the following way shows form And the fusion for showing form of media data and showing for media data and growth data: media play client passes through the One broadcast window, shows media data, is based on configuration data, shows growth data by the second broadcast window, so that spreading number According to the form that shows for showing form and media data blend.Using growth data to include sound in audio data, media data Frequency data instance plays audio data and media data in growth data by two independent broadcast windows (two tracks) In audio data, realize the fusion of audio data.
Using the above embodiment of the present invention, to merge in the form of the showing of growth data and the side for showing form of media data Formula shows media data and growth data, is extended to the broadcasting form of media file, realizes in media file in key The prompt that key message switches in the protrusion or media file of appearance, simultaneously as the diversity of growth data type, so that matchmaker Volume data shows that form is more rich and varied, improves viewing and/or the listening experience of user.
Next by taking media file is video file (such as serial) as an example, to media file provided in an embodiment of the present invention Processing method be illustrated, Fig. 4 is the flow diagram of the processing method of media file provided in an embodiment of the present invention, one In a little embodiments, the processing method of the media file can be by terminal and server coordinated implementation, as passed through the terminal 400- in Fig. 1 1 and server 200 implement, be provided with media play client on terminal 400-1, in conjunction with Fig. 1 and Fig. 4, the embodiment of the present invention is mentioned The processing method of the media file of confession includes:
Step 401: media play client receives the play instruction of video file.
Step 402: being based on play instruction, send video data acquisition request to server.
In actual implementation, the play instruction that media play client is triggered based on user sends the view for carrying video ID Frequency data acquisition request is to server, to obtain the video data of the video file.
Step 403: receiving the video data for the video file that server returns.
Step 404: in the playing process of video file, receiving form extended instruction.
Fig. 5 is the interface schematic diagram that user provided in an embodiment of the present invention triggers form extension, referring to Fig. 5, when user's point When hitting the form expand presented in broadcast interface, the form extended instruction of the corresponding currently playing video file of triggering, with It indicates to carry out form extension to currently playing video file, growth data is merged on the basis of showing current video file Show form.
Step 405: being based on form extended instruction, send form extended requests to server.
Here, in actual implementation, the form extended instruction that media play client is triggered based on user sends and carries view The form extended requests of frequency ID are to server, to obtain the growth data extended in the form of the showing of the video file, and instruction Realize the configuration data of target extension.
Step 406: receiving the configuration data of growth data and corresponding growth data that server returns.
In some embodiments, growth data is audio data corresponding with video ID, in practical applications, audio number According to the sound for the particular persons that can be preparatory acquisition/recording, as specific user gathered in advance watch it is anti-during the video The sound (such as laugh, crying, comment) of feedback, the sound of animal prerecorded etc.;In practical applications, audio data may be used also Think the sound of the simulation particular persons of synthesis, such as sound of pre-synthesis simulation public figure (star).
Correspondingly, the configuration data of corresponding audio data is that instruction realizes that the data of audio fusion are matched in practical applications Setting data may include: that audio amalgamation mode (i.e. for obtaining the data coding mode of fused data), time of fusion (carry out The time of audio fusion), fusion volume (the corresponding volume of growth data and video data in the fused data that audio merges The corresponding volume of growth data volume corresponding with video data in the fused data that corresponding volume or audio merge Ratio) etc. information.
Step 407: being based on configuration data, growth data is merged with video data, obtains fused data.
In some embodiments, before being merged growth data with video data, media play client needs Growth data is sheared, so that the broadcasting starting point of growth data and the broadcasting starting point of video data align, i.e. spreading number According to broadcasting starting point it is consistent with the broadcasting starting point of video data.
In actual implementation, media play client is based on configuration data, by the audio in growth data and video data Data carry out audio fusion, such as carry out audio mixing, so that the sound of corresponding growth data exists as the background sound of sound in video.
Step 408: fused data is showed by broadcast window.
In actual implementation, while media play client carries out video display by video window, broadcast by audio It puts device and plays the fused data obtained after audio fusion, so that showing for growth data and showing for video file sound intermediate frequency data It blends.
By taking media file is video file (such as film) as an example, continue the place to media file provided in an embodiment of the present invention Reason method is illustrated, and Fig. 6 is the flow diagram of the processing method of media file provided in an embodiment of the present invention, in some realities Apply in example, the processing method of the media file can by terminal and server coordinated implementation, as by terminal 400-1 in Fig. 1 and Server 200 is implemented, and is provided with media play client on terminal 400-1, media play client includes acquiring unit and broadcasts Unit is put, server includes service module and memory module, and Fig. 7 is terminal provided in an embodiment of the present invention (front end) and server The schematic diagram of (backstage) cooperative achievement media file processing, in conjunction with Fig. 1, Fig. 6 and Fig. 7, media text provided in an embodiment of the present invention The processing method of part includes:
Step 501: media play client receives user's touching during carrying out film broadcasting, through acquiring unit The form extended instruction of hair.
In practical applications, form extended instruction passes through click for realizing the audio enhancing to played film, user Audio shown by current movie broadcast interface enhances button, and triggering control realizes that the form extension of the audio enhancing of film refers to It enables.
Step 502: in response to form extended instruction, acquiring unit sends the form extended requests for carrying film ID to service Device.
Step 503: server obtains film ID by service module analytical form extended instruction.
Step 504: service module is based on film ID, obtains spectators' sound text of the correspondence film ID stored in memory module Part.
Here, in practical applications, spectators' audio files of the corresponding film has been stored in advance in memory module, has such as stored During certain movie theatre plays the film, the spectators of acquisition watch the sound (such as laugh, crying) when film, spectators' sound File is corresponding with film ID, using film ID as search index, server is facilitated to be retrieved.Wherein, spectators' audio files In include spectators' voice data and instruction realize audio fusion configuration data.
In practical applications, service module can also obtain the subtitle file of corresponding film ID based on film ID.
Step 505: service module sends broadcast unit of spectators' audio files to media play client of acquisition.
Step 506: broadcast unit is based on spectators' audio files, and spectators' sound is carried out stereo process with movie soundtrack and is broadcast It puts.
Fig. 8 is that the schematic diagram of the audio enhancing provided in an embodiment of the present invention for realizing online film passes through use referring to Fig. 8 The form extended instruction of family triggering opens form and extends function, the audio enhancing of played film is realized, so that film is watched User can hear the Theater Sound with spectators' sound surround sound, promote movie theatre atmosphere when user watches film online, mention High user experience.
Continue to be illustrated the software realization of the processing unit of media file provided in an embodiment of the present invention.Fig. 9 is this The software configuration schematic diagram of the processing unit for the media file that inventive embodiments provide, it is provided in an embodiment of the present invention referring to Fig. 9 The processing unit 90 of media file includes:
Receiving unit 91, for receiving the play instruction of media file;
Acquiring unit 92 obtains the media data of the media file for being based on the play instruction;
And for obtaining the growth data for showing form for extending the media file, and the corresponding expansion The configuration data of target extension is realized in the instruction for opening up data;
Broadcast unit 93, for being based on the configuration data, to merge in the form of the showing of the growth data and the matchmaker The mode for showing form of volume data shows the media data and the growth data.
In some embodiments, the acquiring unit is also used to obtain the key content for protruding the media file At least one of audio data, video data and image data;
Wherein, the audio data includes at least one of: true voice data, Synth Voice data, non-voice number According to.
In some embodiments, the acquiring unit is also used to obtain the key message for prompting the media file At least one of audio data, video data and image data of switching.
In some embodiments, the acquiring unit is also used to determine the file identification of the media file;
And send the growth data request for carrying the file identification;
And receive the growth data of the correspondence file identification of return.
In some embodiments, the acquiring unit is also used in response to current user's logging state be to have logged in, obtain Take corresponding user identifier;
And it is based on the user identifier, determine corresponding social network information;
And it is based on the social network information, obtain the growth data for being associated with the media file.
In some embodiments, the acquiring unit is also used to obtain the user identifier of registered users, described registered User corresponds to the client end of playing back of the media file;
And the user identifier based on the registered users, determine the associated growth data of the registered users;
And from the identified growth data, screening obtains the growth data for being associated with the media file.
In some embodiments, the acquiring unit is also used in the playing process of the media file, is received pair Answer the form extended instruction of the media file;
And in response to the form extended instruction, obtain the extension for showing form for extending the media file Data.
In some embodiments, the acquiring unit is also used to obtain the historical behavior data of target user;
And the historical behavior data are based on, determine the user's portrait for indicating the interest classification of the target user;
And obtain the growth data of corresponding user's portrait.
In some embodiments, the broadcast unit is also used to based on target extension side indicated by the configuration data Formula merges the growth data and the media data, obtains amalgamation media data;
By broadcast window, the amalgamation media data that show.
In some embodiments, the broadcast unit is also used to show the media data by the first broadcast window;
And it is based on the configuration data, the growth data is showed by the second broadcast window, so that the spreading number According to show form and the form that shows of the media data blends.
Using the above embodiment of the present invention, have following advantageous effects:
1, by merge growth data show form and media data show form in a manner of, show media data and expansion Open up data, in this way, realize the extension of the broadcastings form to media file so that media data show form more enrich it is more Sample improves viewing and/or the listening experience of user;
2, acquired growth data has the key content of prominent media file or the function of prompt key message switching Can, in this way, making during showing media data and growth data, the key content of media file is protruded or matchmaker The switching of the key message of body file is prompted, and the keynote message for accurately holding media file is enabled a user to;
3, media play client is based on social network information, obtains the growth data of association media file, in this way, extension Data come from social networks, enhance user's viscosity;
4, from the associated growth data of registered users, screening obtains being associated with the media file media play client Growth data.In this way, improving interaction enthusiasm of the user based on media play client;
5, media play client draws a portrait to the acquisition of growth data based on user, in this way, enhancing user is to media file The interest-degree showed improves the broadcasting rate of media file.
The embodiment of the invention also provides a kind of processing unit of media file, described device includes:
Memory, for storing executable program;
Processor when for executing the executable program stored in the memory, is realized provided in an embodiment of the present invention The processing method of above-mentioned media file.
The embodiment of the invention also provides a kind of storage medium, it is stored with executable program, at the executable code When managing device execution, the processing method of above-mentioned media file provided in an embodiment of the present invention is realized.
It need to be noted that: above is referred to the descriptions of the processing unit of media file, are classes with above method description As, with method beneficial effect describe, do not repeat them here, in the processing unit of media file described in the embodiment of the present invention not The technical detail of disclosure please refers to the description of embodiment of the present invention method.
This can be accomplished by hardware associated with program instructions for all or part of the steps of embodiment, and program above-mentioned can be with It is stored in a computer readable storage medium, which when being executed, executes step including the steps of the foregoing method embodiments;And Storage medium above-mentioned includes: movable storage device, random access memory (RAM, Random Access Memory), read-only The various media that can store program code such as memory (ROM, Read-Only Memory), magnetic or disk.
If alternatively, the above-mentioned integrated unit of the present invention is realized in the form of software function module and as independent product When selling or using, it also can store in a computer readable storage medium.Based on this understanding, the present invention is implemented The technical solution of example substantially in other words can be embodied in the form of software products the part that the relevant technologies contribute, The computer software product is stored in a storage medium, including some instructions are used so that computer equipment (can be with It is personal computer, server or network equipment etc.) execute all or part of each embodiment the method for the present invention. And storage medium above-mentioned includes: that movable storage device, RAM, ROM, magnetic or disk etc. are various can store program code Medium.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain Lid is within protection scope of the present invention.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.

Claims (15)

1. a kind of processing method of media file, which is characterized in that the described method includes:
Receive the play instruction of media file;
Based on the play instruction, the media data of the media file is obtained;
Obtain the growth data for showing form for extending the media file, and the instruction reality of the corresponding growth data The configuration data of existing target extension;
Based on the configuration data, to merge in the form of the showing of the growth data and the side for showing form of the media data Formula shows the media data and the growth data.
2. the method as described in claim 1, which is characterized in that described obtain shows form for extend the media file Growth data, comprising:
Obtain in audio data, video data and image data for protruding the key content of the media file at least it One;
Wherein, the audio data includes at least one of: true voice data, Synth Voice data, non-voice data.
3. the method as described in claim 1, which is characterized in that described obtain shows form for extend the media file Growth data, comprising:
It obtains in audio data, video data and the image data for prompting the key message of the media file to switch at least One of.
4. the method as described in claim 1, which is characterized in that described obtain shows form for extend the media file Growth data, comprising:
Determine the file identification of the media file;
Send the growth data request for carrying the file identification;
Receive the growth data of the correspondence file identification returned.
5. the method as described in claim 1, which is characterized in that described obtain shows form for extend the media file Growth data, comprising:
It is to have logged in response to current user's logging state, obtains corresponding user identifier;
Based on the user identifier, corresponding social network information is determined;
Based on the social network information, the growth data for being associated with the media file is obtained.
6. the method as described in claim 1, which is characterized in that described obtain shows form for extend the media file Growth data, comprising:
The user identifier of registered users is obtained, the registered users correspond to the client end of playing back of the media file;
Based on the user identifier of the registered users, the associated growth data of the registered users is determined;
From the identified growth data, screening obtains the growth data for being associated with the media file.
7. the method as described in claim 1, which is characterized in that described obtain shows form for extend the media file Growth data, comprising:
Obtain the historical behavior data of target user;
Based on the historical behavior data, the user's portrait for indicating the interest classification of the target user is determined;
Obtain the growth data of corresponding user's portrait.
8. the method as described in claim 1, which is characterized in that described obtain shows form for extend the media file Growth data, comprising:
In the playing process of the media file, the form extended instruction of the corresponding media file is received;
In response to the form extended instruction, the growth data for showing form for extending the media file is obtained.
9. the method as described in claim 1, which is characterized in that it is described to be based on the configuration data, to merge the spreading number According to the mode for showing form for showing form and the media data, show the media data and the growth data, wrap It includes:
Based on target extended mode indicated by the configuration data, the growth data and the media data are merged, is obtained Amalgamation media data;
By broadcast window, the amalgamation media data that show.
10. the method as described in claim 1, which is characterized in that it is described to be based on the configuration data, to merge the spreading number According to the mode for showing form for showing form and the media data, show the media data and the growth data, wrap It includes:
By the first broadcast window, show the media data;
Based on the configuration data, the growth data is showed by the second broadcast window, so that the growth data shows Form and the form that shows of the media data blend.
11. a kind of processing unit of media file, which is characterized in that described device includes:
Receiving unit, for receiving the play instruction of media file;
Acquiring unit obtains the media data of the media file for being based on the play instruction;
And for obtaining the growth data for showing form for extending the media file, and the corresponding spreading number According to instruction realize target extension configuration data;
Broadcast unit, for being based on the configuration data, to merge in the form of the showing of the growth data and the media data The mode for showing form, show the media data and the growth data.
12. device as claimed in claim 11, which is characterized in that
The acquiring unit is also used to obtain audio data, the video data of the key content for protruding the media file And at least one of image data;
Wherein, the audio data includes at least one of: true voice data, Synth Voice data, non-voice data.
13. device as claimed in claim 11, which is characterized in that
The broadcast unit is also used to merge the growth data based on target extended mode indicated by the configuration data And the media data, obtain amalgamation media data;
By broadcast window, the amalgamation media data that show.
14. a kind of processing unit of media file, which is characterized in that described device includes:
Memory is configured to save the processing routine of media file;
Processor is configured to operation described program, wherein perform claim requires any one of 1 to 10 institute when described program is run The processing method for the media file stated.
15. a kind of storage medium, the storage medium includes the program of storage, wherein perform claim is wanted when described program is run The processing method of media file described in asking any one of 1 to 10.
CN201910340609.6A 2019-04-25 2019-04-25 Media file processing method and device and storage medium Active CN110166801B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910340609.6A CN110166801B (en) 2019-04-25 2019-04-25 Media file processing method and device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910340609.6A CN110166801B (en) 2019-04-25 2019-04-25 Media file processing method and device and storage medium

Publications (2)

Publication Number Publication Date
CN110166801A true CN110166801A (en) 2019-08-23
CN110166801B CN110166801B (en) 2022-12-20

Family

ID=67640223

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910340609.6A Active CN110166801B (en) 2019-04-25 2019-04-25 Media file processing method and device and storage medium

Country Status (1)

Country Link
CN (1) CN110166801B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114816608A (en) * 2021-01-29 2022-07-29 腾讯科技(深圳)有限公司 Media file playing method and device, electronic equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103517158A (en) * 2012-06-25 2014-01-15 华为技术有限公司 Method, device and system for generating videos capable of showing video notations
CN104683703A (en) * 2013-11-27 2015-06-03 腾讯科技(北京)有限公司 Video playing method and device
CN105828100A (en) * 2016-03-21 2016-08-03 乐视网信息技术(北京)股份有限公司 Audio and video files simultaneous playing method, device and system
CN107682713A (en) * 2017-04-11 2018-02-09 腾讯科技(北京)有限公司 media file playing method and device
CN107690084A (en) * 2017-04-11 2018-02-13 腾讯科技(北京)有限公司 The playing method and device of media file
CN109379636A (en) * 2018-09-20 2019-02-22 京东方科技集团股份有限公司 Barrage processing method, apparatus and system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103517158A (en) * 2012-06-25 2014-01-15 华为技术有限公司 Method, device and system for generating videos capable of showing video notations
CN104683703A (en) * 2013-11-27 2015-06-03 腾讯科技(北京)有限公司 Video playing method and device
CN105828100A (en) * 2016-03-21 2016-08-03 乐视网信息技术(北京)股份有限公司 Audio and video files simultaneous playing method, device and system
CN107682713A (en) * 2017-04-11 2018-02-09 腾讯科技(北京)有限公司 media file playing method and device
CN107690084A (en) * 2017-04-11 2018-02-13 腾讯科技(北京)有限公司 The playing method and device of media file
CN109379636A (en) * 2018-09-20 2019-02-22 京东方科技集团股份有限公司 Barrage processing method, apparatus and system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114816608A (en) * 2021-01-29 2022-07-29 腾讯科技(深圳)有限公司 Media file playing method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN110166801B (en) 2022-12-20

Similar Documents

Publication Publication Date Title
US11616818B2 (en) Distributed control of media content item during webcast
CN106210808B (en) Media information put-on method, terminal, server and system
US11417341B2 (en) Method and system for processing comment information
RU2417113C2 (en) Representation of flow video in, for example, video games or mobile devices
CN102866828B (en) A kind of terminal control method and equipment
CN109257611A (en) A kind of video broadcasting method, device, terminal device and server
CN102231851B (en) Scalable video insertion control
CN107562680A (en) Data processing method, device and terminal device
CN105915944A (en) Video sharing method and device
JP2009508441A (en) Apparatus and method for providing and presenting customized channel information
CN109275028A (en) Video acquiring method, device, terminal and medium
US20150106730A1 (en) Framework for screen content sharing system with generalized screen descriptions
CN109711899A (en) A kind of sending method of advertisement, device and computer readable storage medium
CN107659831A (en) Media data processing method, client and storage medium
CN113630630A (en) Method, device and equipment for processing dubbing information of video commentary
US11706496B2 (en) Echo bullet screen
CN110166801A (en) Processing method, device and the storage medium of media file
US11093120B1 (en) Systems and methods for generating and broadcasting digital trails of recorded media
CN113645472A (en) Interaction method and device based on playing object, electronic equipment and storage medium
CN108124188B (en) Audio-video system operation method
CN106340287A (en) Processing method of mobile phone song requesting
CN106888406A (en) A kind of time-based interaction content method for pushing and system
KR100481588B1 (en) A method for manufacuturing and displaying a real type 2d video information program including a video, a audio, a caption and a message information
CN107832366A (en) Video sharing method and device, terminal installation and computer-readable recording medium
CN108614656B (en) Information processing method, medium, device and computing equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant