WO2018157743A1 - Procédé de traitement de données multimédias, dispositif, système, et support de stockage - Google Patents

Procédé de traitement de données multimédias, dispositif, système, et support de stockage Download PDF

Info

Publication number
WO2018157743A1
WO2018157743A1 PCT/CN2018/076676 CN2018076676W WO2018157743A1 WO 2018157743 A1 WO2018157743 A1 WO 2018157743A1 CN 2018076676 W CN2018076676 W CN 2018076676W WO 2018157743 A1 WO2018157743 A1 WO 2018157743A1
Authority
WO
WIPO (PCT)
Prior art keywords
media data
processing
server
client
service
Prior art date
Application number
PCT/CN2018/076676
Other languages
English (en)
Chinese (zh)
Inventor
江庆海
Original Assignee
腾讯科技（深圳）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 腾讯科技（深圳）有限公司 filed Critical 腾讯科技（深圳）有限公司
Publication of WO2018157743A1 publication Critical patent/WO2018157743A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/51—Discovery or management thereof, e.g. service location protocol [SLP] or web services

Definitions

  • the present application relates to the field of Internet technologies, and in particular, to a media data processing method, apparatus, system, and storage medium.
  • ffmpeg is an open source computer program that can be used to record, convert digital audio, video, and convert it into a stream.
  • LGPL or GPL license It provides a complete solution for recording, converting, and streaming audio and video. It contains a very advanced audio/video codec library libavcodec.
  • Ffmpeg is widely used in various playback software.
  • the embodiment of the present application provides a media data processing method, which is applied to a data processing server.
  • the method includes: performing, for any client of the current service, processing: receiving first media data uploaded by the client; according to pre-configured The media data processing requirement corresponding to the current service, processing the first media data and obtaining the second media data; and storing the second media data on the network side and obtaining a link address of the second media data; Transmitting one or more of the obtained link addresses of the current service to the service server in response to a link address acquisition request from the service server, so that the service server provides the client to any client of the current service One or more of the link addresses available at the end.
  • the embodiment of the present application further provides a media data processing method, which is applied to a client, and the method includes: uploading, to a data processing server, the first media data generated by the current service, where the client is uploaded for any client of the current service.
  • the first media data the data processing server processes the first media data according to a pre-configured media data processing requirement corresponding to the current service, and obtains the second media data, and stores the second media data in a network.
  • the embodiment of the present application further provides a media data processing device, the device comprising a processor and a memory, the memory storing a computer readable instruction module configured to be executed by the processor; wherein the instruction module comprises: The upload processing module receives the first media data uploaded by any client of the current service; the data processing module processes the first media data and obtains the second media according to the pre-configured media data processing requirements corresponding to the current service.
  • the embodiment of the present application further provides a media data processing system, including: a service server, an upload server, a processing server, and an information providing server, where the information providing server is integrated in the processing server or independently configured; Uploading the server, receiving the first media data uploaded by any client of the current service, and providing the first media data to the processing server; the processing server, according to the pre-configured media data processing demand corresponding to the current service Processing the first media data and obtaining second media data; storing the second media data on a network side and obtaining a link address of the second media data, and saving the link address in the An information providing server that sends a link address acquisition request to the information providing server in response to a request for uploading the first media data from any client of the current service; the information providing server is responsive to The link address acquisition request of the service server, Obtaining current traffic link to one or more of said address to the service server; the service server is provided to the current client service according to any one or more of the links to one of the addresses available to the client.
  • the embodiment of the present application further provides a computer readable storage medium storing computer readable instructions, which may cause a processor to execute the methods of the embodiments.
  • FIG. 1A is a schematic structural diagram of a system according to an embodiment of the present application.
  • FIG. 1B is a schematic structural diagram of another system according to an embodiment of the present application.
  • FIG. 3 is a diagram of a media data processing system according to an embodiment of the present application.
  • FIG. 5 is a flowchart of a method according to another embodiment of the present application.
  • FIG. 6 is a message interaction diagram of a media data processing process in an embodiment of the present application.
  • Figure 7 is a structural diagram of a device according to an embodiment of the present application.
  • FIG. 8 is a structural diagram of a device according to another embodiment of the present application.
  • FIG. 9 is a structural diagram of a device according to an embodiment of the present application.
  • the user directly in the electronic device the product refers to an application or platform with audio and video processing functions, such as: dubbing software, media player or WeChat, or can display some kind of media interaction activities
  • the web page browser performs media data processing, such as audio and video processing.
  • media data processing such as audio and video processing.
  • the audio and video processing is performed by the dubbing software, and other functions of the dubbing software are performed during the processing. unavailable. It can be seen that the current media data processing and product coupling degree is high, media data processing will affect the use of other functions of the product, and the user waits for a long time, which makes the user experience less effective.
  • the module used for media data processing in this product is complex in design, so that the product is difficult to implement and the product testing time is longer, so that the development cost of the product will be higher.
  • the product may have a long processing time of the media data, and the long-term processing may bring potential risks, such as damage to the audio and video source files.
  • the product changes the audio and video requirements, such as improving the audio and video processing effect or increasing the audio and video processing functions (such as adding English subtitles in audio and video), the product is also difficult to quickly achieve audio and video processing requirements. Changes.
  • the product is a browser for displaying a web page, the product cannot implement complicated audio and video processing, and it is difficult to achieve the audio and video processing effect desired by the user.
  • the embodiment of the present application provides a media data processing method, which can be applied to the system architecture shown in FIG. 1A.
  • the system architecture includes a client 101 and a background 102.
  • the background 102 includes a service server 103 (which may be a website server or an application server), a data processing server 104, and a storage server 105.
  • the client 101 The backend 102 can communicate over the Internet 106.
  • the client 101 refers to the aforementioned product, and may be a browser for displaying a page of a media interactive activity (such as an interactive advertising event, the activity may be implemented in the form of a web page) or an application (APP) (such as a dubbing software, etc.).
  • APP application
  • the user using the client 101 can generate media data processing requirements such as transposition, background music, audio conversion, and clip playback of the video material.
  • data processing server 104 encapsulates these processing requirements into processing processes.
  • the processing requirements of media data of different types of clients 101 ie, processing requirements of different services
  • the service corresponds to a service identifier (such as a project ID).
  • Each service identifier corresponds to a processing process, and the name of the processing process can be associated with the service identifier (for example, the name of the processing process can include the project ID).
  • the media data processing process for a client 101 is as follows:
  • the data processing server 104 After the client 101 successfully uploads the media data to the data processing server 104, the data processing server 104 returns the ID of the media data to the client 101. After the predetermined time, the client 101 queries the data processing server 104 for the processing of the media data via the service server 103. If the data processing server 104 has processed the media data, the second media data is uploaded to the storage server 105 on the network side, and the link address (URL) of the second media data is obtained and returned to the service server 103. The second media data is media data after the media data is processed. The client 101 acquires the second media data from the storage server 105 based on the above URL acquired from the service server 103.
  • the media data processing method in the embodiment of the present application is also applicable to the system architecture shown in FIG. 1B.
  • the system architecture includes: a client 101 and a background 102, and the background 102 includes a service server 103.
  • the business server may be a web server or an application server, a data processing server 104, a storage server 105, and an information providing server 106, wherein the data processing server 104 includes an upload server 107, a processing server 108, and an authentication server 109, a client 101 and a background 102 can communicate over the Internet 110.
  • the user can generate media data processing requirements using the client 101, and in some instances, the processing server 108 encapsulates the above processing requirements into a processing process.
  • the media data processing process for a client 101 is as follows:
  • the media data includes an encrypted verification ticket
  • the verification server 109 responds to the upload of the client 101 before the client 101 uploads the media data.
  • the media data request returns a ticket to the client 101 as a credential for the user identity security.
  • the uploading server 107 returns the ID of the media data to the client 101.
  • the client 101 queries the processing server 108 via the service server 103 for the processing status of the media data. If the processing server 108 has processed the media data, it will The second media data is uploaded to the storage server 105 on the network side, and the link address (URL) of the second media data is obtained and returned to the service server 103.
  • the client 101 acquires the second media data from the storage server 105 based on the above URL acquired from the service server 103.
  • the above system architecture can be used to process media data generated in an ad interaction.
  • each user participating in the activity may upload media data to the upload server 107 through the client 101, wherein the media data includes an audio and video source file and a ticket returned from the verification server 109, and the processing server 108
  • the media data is subjected to audio and video processing.
  • the processing server 108 uploads the second media data to the storage server 105, and the storage server 105 returns the URL of the second media data to the processing server 108, and the processing server 108 saves the URL to Information providing server 106.
  • the service server 103 corresponding to the client 101 queries the information providing server 106 for the URL of the second media data, and returns the URL of the second media data to the client 101 according to the request of the client 101, for the user to directly use in the interactive advertising campaign. If the user can click on the URL, the created audio and video can be played.
  • the above system architecture can also be used to process media data generated during a live broadcast.
  • each user participating in the activity may upload media data to the upload server 107 through the client 101, wherein the media data includes an audio and video source file and a ticket returned from the verification server 109, and the processing server 108
  • the media data is subjected to audio and video editing and various function additions.
  • the processing server 108 uploads the second media data to the storage server 105, and the storage server 105 returns the URL of the second media data to the processing server 108, and the processing server 108
  • This URL is saved to the information providing server 106.
  • the service server 103 corresponding to the client 101 queries the information providing server 106 for the URL of the second media data, and returns the link address of the second media data to the client 101 according to the request of the client 101, for the user to play the live video.
  • the media data processing method proposed by the embodiment of the present application is applied to the data processing server 104. As shown in FIG. 2, the method includes the following steps:
  • Step 200 Perform any of the following steps 201-203 for any client of the current service:
  • Step 201 Receive first media data uploaded by the client.
  • the media data may be data such as audio and video, so that the first media data may be an audio and video source file.
  • the data processing server may receive and temporarily store the media data source file, and may be an upload server in the data processing server that temporarily stores the media data source file for the bypass processing server pair in the data processing server. Upload the media data source file stored by the server for processing.
  • Receiving the first media data further receiving the verification ticket corresponding to the first media data
  • the process of processing the first media data and obtaining the second media data is performed.
  • the ticket server in the data processing server in response to the upload source file request of the client of the current service, returns an encrypted verification ticket of the client as a credential for the user identity security to ensure uploading.
  • the server is not attacked by illegal users.
  • the client after receiving the ticket returned by the verification server, the client further uses a media data source file (such as an audio and video source file), the ticket, and user identification information (ie, a user ID registered in the corresponding application or activity, Data such as QQ number, micro-signal code and other instant messaging numbers are uploaded to the upload server.
  • the uploading server parses the ticket to verify whether the request of the client is legal, and if the request is legal, receiving data such as the media data source file.
  • the uploading server returns a file ID of the media data source file to the client, and the file ID may be part of the ticket data, and the ticket may be composed of, for example, a project ID, a user identification information, a file ID, and the sound.
  • the information such as the upload date of the video source file. If the request is not valid, the upload server requests the client to resend the upload source file request.
  • the client After receiving the file ID, the client sends the file ID to the service server.
  • the service server can be a web server or an application server, and the service server saves the file ID.
  • Step 202 Process the first media data and obtain second media data according to a pre-configured media data processing requirement corresponding to the current service.
  • the data processing server separately encapsulates the media data processing requirements of the plurality of services into a plurality of processing processes, and associates the plurality of processing processes with the service identifiers of the plurality of services.
  • the processing of the first media data includes: calling an associated processing process according to the service identifier carried by the first media data, to process the first media data by the processing process.
  • the service identifier used by the data processing server may be a project ID, so that each service corresponds to a project ID, and the name of the processing process and the project ID may be associated, for example, the name of the process includes the project ID.
  • the data processing server may adopt a powerful audio and video processing technology such as ffmpeg, and the data processing server adopts a multi-process mode, and invokes a corresponding processing process according to the item ID corresponding to the current service.
  • the first media data uploaded by the client received by the data processing server may carry the service identifier of the current service (eg, the audio and video source file carries the item ID).
  • the data processing server saves processing information such as processing status and file ID of the process in real time, and the processing information may be stored in a local cache or stored in a dedicated cache server or other storage system ( As in redis db).
  • the processing status can be divided into five types: 1. processing, 2, success, 3. parsing error (refers to protocol error for parsing audio and video processing request, such as requesting audio and video processing protocol parameters are incorrect), 4 Processing error (refers to audio and video processing failure, such as audio format failure caused by audio format mismatch), 5, upload storage server error.
  • Step 203 Store the second media data on the network side and obtain a link address of the second media data.
  • the data processing server uploads the second media data to a storage server, wherein the storage server stores the second media data and generates the link address; receiving the link address from the storage server .
  • the data processing server uploads the processed media data file, that is, the second media data, to the storage server, where the storage server may be a cloud storage server or a content distribution network (a CDN) server, the cloud storage server or CDN server returns a download address (URL) of the second media data to the data processing server, wherein the second media data is the media processed by the data processing server by the data processing server data.
  • the storage server may be a cloud storage server or a content distribution network (a CDN) server
  • the cloud storage server or CDN server returns a download address (URL) of the second media data to the data processing server, wherein the second media data is the media processed by the data processing server by the data processing server data.
  • the method further includes: when the processing of the first media data uploaded by a client fails, providing the processing status to the a service server to cause the service server to provide the processing status to the client.
  • Step 204 Send one or more of the obtained link addresses of the obtained current service to the service server in response to the link address acquisition request from the service server, so that the service server is to any client of the current service.
  • One or more of the link addresses available to the client are provided.
  • the providing the link address to the service server includes:
  • the service server learns that the product uploads the first media data successfully, it queries the bypass processing server in the data processing server for the first media data processing state after a predetermined time, and when the bypass processing server finishes processing, the second media data
  • the download address ie, the link address
  • the download address is returned to the service server.
  • the client may query the service server for the processing status of the audio and video source file after a predetermined time.
  • the link address of the corresponding audio and video file ie, the second media data
  • the link address can be returned to the service server, and the service server receives the received address.
  • Each link address and the file ID of the corresponding audio and video source file are saved.
  • the bypass processing server can also send the processing status of the audio and video source files (eg, 1, processing, 2, success, 3, parsing error, 4, processing error, 5, uploading storage server error, etc.) to the service server. .
  • the service server may provide the processing status of the audio and video source file uploaded by the client to the client, or provide the link address of the one or more second media data available to the client to the client.
  • the client obtains the second media data corresponding to the link address from the storage server by using any link address.
  • the link address of the one or more second media data available to a certain client may include at least one of the following: 1. uploading by another user who participates in the same interactive activity (such as an advertisement interaction activity) with the current user of the client. a link address of each second media data corresponding to each of the first media data, and a link address of each second media data corresponding to each of the first media data uploaded by the user of the current user of the client for a certain media content 3.
  • each second media data corresponding to each first media data uploaded by each user that is currently concerned by the client, and the first corresponding to each first media data uploaded by the friend of the current user of the client a link address of the second media data, a link address of each second media data corresponding to each first media data uploaded by all users of a certain media content, and the like.
  • each user participating in the activity may upload an audio and video source file through a respective client, and obtain a link of an audio and video file (ie, second media data) by the background processing.
  • the address, the link address corresponding to the audio and video files of each user generated in the advertisement interaction activity can be provided to the client of a certain user, so that the user can play the audio and video files of each user.
  • the client is a dubbing software
  • an audio/video source file (a dubbing work source file) uploaded by the current user of the client through the dubbing software is processed in the background to obtain a link address of a dubbed work and is published in
  • the clients of other users who pay attention to this user can access the link address of the dubbed work and play it, and can also send comments or multimedia interactions for the dubbed work, and then upload the respective audio and video source files (for The voice comment or audio and video interactive information published by the dubbed work) to the background
  • the background can process the link address of each audio and video file, and provide the link address of each audio and video file to the client that publishes the dubbed work.
  • the background address can also be provided to the clients of each user who pays attention to the dubbed work (ie, item 5 above).
  • the client is a dubbing software
  • an audio/video source file (a dubbing work source file) uploaded by the current user of the client through the dubbing software is processed in the background to obtain a link address of a dubbed work and is published in
  • the clients of other users who are concerned by the user can also upload their respective audio and video source files (the dubbing work source files) to the background, and the background can process the link addresses of the respective audio and video files, and the respective sounds.
  • the link address of the video file is provided to the client so that the user can access the dubbed work published by each other user of interest.
  • the user's client can obtain audio and video works or audio and video comments published by each friend.
  • the link address of the one or more second media data that is available to the client is not limited to the above five situations, and according to different media interaction functions provided by the current client page and the user's permission settings, The link address of the second media data available to the client may be different.
  • the service server may determine the link address of the second media data available in the current page of the client according to the business logic.
  • the data processing server since the data processing server is in the background, when the processing demand of the client for the media data is changed, only the processing process corresponding to the processing requirement needs to be adjusted in the background to implement the change quickly, without having to do the program to the client. Any changes, and the format conversion of media data and other processing will not occupy the processing resources of the user side, and can improve the performance of the entire system.
  • the processing process may be referred to as a bypass processing process of the client (such as a dubbing software, a media player, or a WeChat, etc.), and the processing process does not affect the normal operation of the client, thereby eliminating user use.
  • the client waits to improve the user experience.
  • the data processing server 104 may include an upload processing module, a data processing module, and an information providing module.
  • the modules may be integrated in the same server device or distributed in different server devices.
  • the upload processing module may be located in the upload server
  • the data processing module may be located in the data processing server
  • the information providing module may be located in a separate information providing server, or may be located on the same server (such as a data processing server) as the data processing module.
  • data processing server 104 can include an upload server, a processing server (integrated with a data processing module, and an information providing module).
  • data processing server 104 can include an upload server, a processing server, and an information providing server.
  • the system 300 includes a service server 301, an upload server 302, a processing server 303, and an information providing server 304, and the information providing server 304 is integrated in the processing server 303 or independently configured;
  • the uploading server 302 receives the first media data uploaded by any client of the current service, and provides the first media data to the processing server 303.
  • the processing server 303 is configured according to the pre-configured media corresponding to the current service.
  • the system 300 further includes: an authentication server 305; wherein the service server 301 further transmits a verification verification ticket to the verification server 305 in response to the request to upload the first media data
  • the verification server 305 sends a verification ticket to the service server 301 in response to the request for obtaining the verification ticket from the service server 301; the service server 301 further sends the verification ticket to the server
  • the uploading server 302 further receives the verification ticket corresponding to the first media data, and checks whether the first media data is legal according to the verification ticket; As a result, when the first media data is legal, the first media data is provided to the processing server 303.
  • the system 300 may include multiple sets of the upload server 302 and the processing server 303, wherein each group includes one of the upload server 302 and one of the processing servers 303, and the information providing server 304 Independently setting; the service server 301 further receives the first media data from the client, and selects one for the client, in response to a request for uploading the first media data from any client of the current service.
  • the uploading server and the processing server 303 the first media data is sent to the selected upload server 302; the uploading server 302 provides the first media data to the same group of the processing Server 303.
  • processing server 303 may be referred to as a bypass processing server, and information providing server 304 may be referred to as a processing information storage module.
  • the distributed processing process involves: N clients (client 1, client 2, ... client N), a storage server storing second media data, and processing information (including URLs and/or processing). Status) Unified storage processing information storage module.
  • the distributed processing platform further includes N groups of servers for media data processing, each group including an upload server and a bypass processing server, as shown in FIG. 4, which may include: an upload server 1 and a bypass processing server 1. uploading The server 2 and the bypass processing server 2, the upload server N, and the bypass processing server N. Because the embodiment of the present application mainly relates to distributed processing of media data, the service server and the verification server are not shown in the platform. In actual applications, the platform may also include one or more service servers and verification servers, where Any client may send a request to upload a media data source file to a service server corresponding to the current service, or obtain a ticket from the corresponding authentication server.
  • the client sends data such as a ticket, a media data source file, and a project ID to the corresponding service server
  • the service server selects an upload server and uploads data such as a ticket, a media data source file, and a project ID to the selected upload server.
  • the selection rule may be as follows: the IP address and the port number list of each upload server are configured in the service server, and when the service server receives the request from the client, the method modulates the total number of the project ID and the upload server. Select one of the upload servers.
  • the IP addresses are ⁇ "10.127.0.1", “10.127.0.2”, “10.127.0.3”, “10.127.0.4", "10.127.0.5” ⁇
  • the uploading server receiving the data notifies the corresponding bypass processing server to perform processing, and the notification carries the item ID, and the bypass processing server calls the item ID according to the item ID.
  • the corresponding processing process is processed, and the processed information is uniformly placed in the processing information storage module, so that the service server queries the processing state for use.
  • the bypass processing server successfully processes the media data source file
  • the second media data is uploaded to the storage server, and the storage server returns the link address (URL) (processing information) of the second media data to the bypass processing server.
  • the bypass processing server saves the URL to the processing information storage module.
  • the above processing technology solution can realize media data processing and product decoupling, and the data processing server processes asynchronously in the background, can process the processing requirements of the completed media data in a short time, and does not block during the processing. Other user actions, which makes the user experience better.
  • the solution can quickly realize the needs of various complex media data processing and improve the user experience.
  • an ad to enter an event page that is, a page that interacts with the user (the user can perform voice interactions or voice comments on the page)
  • an event page that is, a page that interacts with the user (the user can perform voice interactions or voice comments on the page)
  • media data such as video and audio material.
  • editing audio and video, adding background music, subtitles, cutting audio and video into a required length of time, etc. requires a large time cost, and must be After the audio and video is completed, it can be uploaded to the storage server for storage, so that it can be called directly when it is used next time.
  • the client selects an uploading server in the distributed processing platform (as shown in FIG.
  • the bypass processing server performs audio and video processing.
  • the bypass processing server uploads the second media data to the storage server, and the storage server returns the URL of the second media data to the bypass processing server, and the bypass processing server saves the URL to the processing information storage module.
  • the service server corresponding to the client queries the processing information storage module for the link address of the second media data, and returns the link address of the second media data to the client according to the request of the client, for the user to directly use in the interactive advertising campaign, such as Users can click on the URL to play the produced audio and video.
  • the process of interacting between the client and the distributed processing platform can be seen in FIG. 1B.
  • the interactive advertising campaign has a relatively short time from development to launch, and the demand changes more frequently, the above technical solution of the embodiment of the present application can quickly meet the requirements of development online, function update, and demand change.
  • the foregoing technical solutions of the embodiments of the present application may also be used in combination with an existing live broadcast platform or a live broadcast event. After the live broadcast, there is a need for the clip playback of the video material.
  • the embodiment of the present application uploads the video source file to the service server by providing a packaged distributed processing platform (as shown in FIG. 4), the live broadcast platform or the live broadcast event.
  • the service server selects an upload server in the distributed processing platform, and then the audio and video clips and various functions are added by the bypass processing server, and finally the storage server provides the URL of the processed audio and video file to the bypass processing server.
  • the road processing server saves the URL to the processing information storage module.
  • the service server corresponding to the client queries the processing information storage module for the URL of the second media data, and returns the URL of the second media data to the client according to the request of the client, for the user to play the live video.
  • the process of interacting between the client and the distributed processing platform can be seen in FIG. 1B.
  • the embodiment of the present application further provides a media data processing method, which can be applied to the client 101. As shown in FIG. 5, the method includes the following steps:
  • Step 501 Upload the first media data generated by the current service to the data processing server, where the data processing server is configured according to the pre-configured current service, for the first media data uploaded by any client of the current service.
  • the media data processing requirement processes the first media data and obtains the second media data, and stores the second media data on a network side and obtains a link address of the second media data.
  • Step 502 Send a link address obtaining request to the service server, where the service server determines, according to the link address obtaining request, one or more link addresses of the current service obtained by the data processing server for the client. Each of the linked addresses available.
  • Step 503 Receive, from the service server, each of the link addresses available to the client.
  • Step 504 Acquire the second media data from the network side according to the selected link address in response to the user selecting operation of any one of the received link addresses.
  • Step 505 Play the acquired second media data.
  • an upload request is sent to the service server; wherein the service server obtains an authentication ticket from the data processing server in response to the upload request; receiving the verification ticket from the service server; And the verification ticket is uploaded to the data processing server together with the first media data, so that the first media data is valid according to the verification ticket, and when the verification result is that the first media data is legal And performing the processing of processing the first media data and obtaining the second media data.
  • receiving a processing status from the service server wherein the processing status is used to indicate whether the data processing server performs the processing on the first media data uploaded by the client is successful; Processing status.
  • FIG. 6 is a diagram showing an interaction diagram of media data processing provided by an embodiment of the present application.
  • the client is a browser for displaying a webpage of a media interaction activity (such as a live event), such that the corresponding service server is a web server; the data processing server 104 is in the figure by a dotted line.
  • the server consists of a ticket server, an upload server, and a bypass processing server.
  • the media data may be audio and video data.
  • the media data processing includes the following steps:
  • Step 601 The bypass processing server encapsulates the audio and video processing requirements of the activity that the client can participate in into a processing process corresponding to the processing requirement, where each activity corresponds to one project ID, and each processing process may correspond to one project ID. save.
  • Step 602 The client sends a request for uploading an audio and video source file to the website server through the web page of the activity.
  • the user may generate audio and video processing requirements, for example, recording an audio and video and uploading the audio and video source files through the web page.
  • the client sends an audio and video source to the website server. Request for a file.
  • Step 603 After receiving the above request, the website server obtains, from the verification server, a ticket for verifying whether the user request is legal.
  • Step 604 Correspondingly, the verification server returns the ticket to the website server, and the website server returns it to the client.
  • Step 605 The client uploads data such as the ticket, the item ID, the audio and video source file, and the user identification information to the upload server.
  • the data may be first sent to the service server, and the service server selects the upload server, and then sends the data to the selected upload server.
  • the audio and video source file may include a voice interaction or a voice comment recorded by the user in an interactive advertising campaign, the voice needs to be processed, or the video recorded in the live event, the video needs to be edited and various functions. Add and so on.
  • Step 606 The uploading server parses the ticket. If the verification is legal, step 608 is performed; otherwise, step 607 is performed.
  • Step 607 The upload server feeds back the result of the upload failure to the client.
  • the client may resend the request for uploading the audio and video source file again, and continue to perform the above steps, that is, perform steps 601-606 again, or end the current process.
  • Step 608 The uploading server receives data such as audio and video source files uploaded by the client, and temporarily stores the audio and video source files locally for use by the bypass processing server.
  • Step 609 If the above data upload is successful, the upload server returns the file ID of the audio and video source file of the client.
  • Step 610 The client sends a request to save the file ID to the website server.
  • Step 611 The website server saves the file ID in response to the above request.
  • Step 612 The uploading server notifies the bypass processing server to process the audio and video source file, and the notification carries data such as an item ID, a file ID, and an audio and video source file.
  • Step 613 The bypass processing server calls the already packaged audio and video processing process according to the item ID, and performs audio and video processing, such as transposition, adding background music, audio conversion, or performing clip playback on the video material.
  • audio and video processing such as transposition, adding background music, audio conversion, or performing clip playback on the video material.
  • Step 614 The bypass processing server stores its processing information of the audio and video source file, such as the file ID and the processing status, into the local cache in real time for the client to query.
  • the bypass processing server uniformly stores the processing information to the processing information storage module when the distributed processing platform is used in the background.
  • Step 615 After the bypass processing server successfully processes the audio and video source files, the successfully processed audio and video files, that is, the second media data, are uploaded to a storage server, such as a cloud storage platform.
  • a storage server such as a cloud storage platform.
  • the bypass processing server does not successfully process the audio/video source file, the audio and video files cannot be uploaded to the storage server, and steps 615-624 are not performed.
  • Step 616 The storage server stores the audio and video files.
  • Step 617 The storage server returns a link address (URL) of the audio and video file to the bypass processing server.
  • URL link address
  • Step 618 The bypass processing server stores the URL in the local cache and saves it corresponding to the file ID and the item ID. Similarly, when the background uses a distributed processing platform, the bypass processing server saves the URL corresponding to the file ID and the item ID to the processing information storage module.
  • Step 619 After the web server learns that the audio and video source file is successfully uploaded, the web server queries the bypass processing server for the processing status of the audio and video source file and the URL of the audio and video file according to the file ID.
  • the website server queries the processing information storage module for the processing status of the audio and video source file and the URL of the audio and video file according to the file ID.
  • Step 620 When the processing status is 2, that is, "success", the URL is available, the bypass processing server returns the URL to the website server; when the processing status is other, the URL is not returned. Further, the bypass processing server can feed back the processing status to the website server. Among them, the file ID is returned to the web server at the same time when returning the URL and processing status.
  • Step 621 After obtaining the URL, the website server saves the file ID and its corresponding URL, and obtains a series of file IDs and URLs, that is, a file ID and a list of URL lists. Further, the item ID of the current service and the file ID and the URL list are correspondingly saved to distinguish the respective audio and video files generated in different services and their URLs.
  • Step 622 The client requests a URL from the website server, and the request may be sent to the website server after the client uploads the audio and video source file (such as automatically refreshing the current page every 10s), or may click the client for the user. Sent by the corresponding control (such as the user clicks the refresh button in the page).
  • Step 623 The website server responds to the client's link address acquisition request, and returns the client-related URL (such as all URLs of the current page) to the client.
  • client-related URL such as all URLs of the current page
  • Step 624 The client acquires the second media data from the storage server according to any of the foregoing URLs, and plays the second media data, so that the user can view the processed audio and video files.
  • the client may be displayed in the page.
  • the second media data may be acquired from the storage server according to the selected URL.
  • the embodiment of the present application further provides a media data processing apparatus, where the apparatus is applicable to a data processing server, where the data processing server may be a server cluster composed of several servers, or a cloud. Computing Service Center.
  • the device includes:
  • the upload processing module 701 receives the first media data uploaded by any client of the current service.
  • the data processing module 702 processes the first media data and obtains the second media data according to the pre-configured media data processing requirement corresponding to the current service; and stores the second media data on the network side and obtains the first The link address of the second media data, and saves the link address in the information providing module.
  • the information providing module 703 in response to the link address obtaining request from the service server, transmitting one or more of the obtained link addresses of the current service to the service server, so that the service server is to the current service. Any client provides one or more of the linked addresses.
  • the apparatus further includes: a verification module 704, responsive to a request from the service server to obtain a verification ticket, transmitting an authentication ticket to the service server; wherein the upload processing module receives the first Receiving, by the media data, the verification ticket corresponding to the first media data; verifying whether the first media data is legal according to the verification ticket; and when the verification result is that the first media data is legal, the data
  • the processing module performs the processing of processing the first media data and obtaining the second media data.
  • the data processing module 702 further pre-packages the media data processing requirements of the multiple services into multiple processing processes, and respectively associates the multiple processing processes with the service identifiers of the multiple services.
  • the processing of the first media data by the data processing module 702 includes: calling an associated processing process according to the service identifier carried by the first media data, to the first process by the processing process Media data is processed.
  • the upload processing module 701 further sends an identifier of the first media data to the client after receiving the first media data, so that the client An identifier of the media data is sent to the service server;
  • the information providing module 703 further saves the link address of the second media data obtained by the data processing module 702 and the identifier of the first media data;
  • the data processing module 702 further records a processing status in the information providing module after processing the first media data and obtaining the second media data, wherein the processing status indication is The processing is successful; wherein, the data processing module 702, when the processing is successful, storing the second media data on the network side and obtaining the link address; the information providing module 703, when the data processing And when the module fails to perform the processing on the first media data uploaded by any client, further providing the processing status to the service server, so that the service server provides the processing status to the client .
  • the apparatus includes a plurality of sets of upload processing modules 701 and a data processing module 702, wherein each set includes an upload processing module 701 and a data processing module 702.
  • the embodiment of the present application further provides a media data processing device, which can be applied to a client, where the client can be a mobile phone, a PAD (tablet), a laptop portable computer, a desktop computer, or the like.
  • the apparatus 800 includes:
  • the uploading module 801 is configured to upload the first media data generated by the current service to the data processing server, where the data processing server is configured according to the pre-configured current service for the first media data uploaded by any client of the current service.
  • the media data processing requirement processes the first media data and obtains second media data, and stores the second media data on a network side and obtains a link address of the second media data.
  • the first sending module 802 sends a link address obtaining request to the service server, where the service server determines, according to the link address obtaining request, one or more link addresses of the current service obtained by the data processing server Each of the linked addresses available to the client.
  • the first receiving module 803 receives, from the service server, each of the link addresses available to the client.
  • the obtaining module 804 is configured to acquire the second media data from the network side according to the selected link address in response to the user selecting a connection address of any one of the received link addresses.
  • the playing module 805 plays the acquired second media data.
  • the apparatus further includes: a second sending module 806, sending an upload request to the service server; wherein the service server acquires the verification ticket from the data processing server in response to the upload request; Module 807, receiving the verification ticket from the service server; the uploading module uploads the verification ticket together with the first media data to the data processing server to make it validate according to the verification ticket Whether the first media data is legal.
  • the process of processing the first media data and obtaining the second media data is performed.
  • the apparatus further includes: a third receiving module 808, receiving a processing status from the service server, wherein the processing status is used to indicate the first media data uploaded by the data processing server to the client Whether the processing is successful; and displaying the processing status.
  • a third receiving module 808 receiving a processing status from the service server, wherein the processing status is used to indicate the first media data uploaded by the data processing server to the client Whether the processing is successful; and displaying the processing status.
  • the devices and modules in the various embodiments of the present application may be integrated into one processing unit, or each module may exist physically separately, or two or more devices or modules may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • the media data processing apparatus described above can be executed in any computing device for media data processing and loaded into the memory of the computing device.
  • the computing device includes one or more processors (CPUs) 902, communication modules 904, memory 906, user interface 910, and a communication bus 908 for interconnecting these components.
  • the processor 902 can receive and transmit data through the communication module 904 to enable network communication and/or local communication.
  • User interface 910 includes one or more output devices 912 that include one or more speakers and/or one or more visual displays.
  • User interface 910 also includes one or more input devices 914 including, for example, a keyboard, a mouse, a voice command input unit or loudspeaker, a touch screen display, a touch sensitive tablet, a gesture capture camera or other input button or control, and the like.
  • the memory 906 can be a high speed random access memory such as DRAM, SRAM, DDRRAM, or other random access solid state storage device; or a non-volatile memory such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or Other non-volatile solid-state storage devices.
  • a high speed random access memory such as DRAM, SRAM, DDRRAM, or other random access solid state storage device
  • non-volatile memory such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or Other non-volatile solid-state storage devices.
  • the memory 906 stores a set of instructions executable by the processor 902, including:
  • Operating system 916 including programs for processing various basic system services and for performing hardware related tasks
  • the application 918 can include various applications for implementing media data processing, such an application being capable of implementing the processing flow in each of the above examples, such as the device 700 shown in FIG. 7 and/or the device shown in FIG. 800.
  • the apparatus 700 may include the modules 701-703 of the modules 701-704 shown in FIG. 7, the apparatus 700 may further include a module 704, and each of the modules 701-704 may be stored in the memory 906.
  • Machine executable instructions The processor 902 can implement the functions of the modules 701 to 704 described above by executing the machine executable instructions in the modules 701 to 704 in the memory 906.
  • device 800 can include modules 801-805 of modules 801-808 shown in FIG. 8, and device 800 can further include modules 806-808, and each module 801-808 can be in memory 906.
  • the processor 902 can implement the functions of the modules 801 to 808 described above by executing the machine executable instructions in the modules 801 to 808 in the memory 906.
  • each embodiment of the present application can be implemented by a data processing program executed by a data processing device such as a computer.
  • the data processing program constitutes an embodiment of the present application.
  • a data processing program that is usually stored in one storage medium is executed by directly reading the program out of the storage medium or by installing or copying the program to a storage device (such as a hard disk and/or a memory) of the data processing device. Therefore, such a storage medium also constitutes an embodiment of the present application.
  • the storage medium can use any type of recording method, such as paper storage medium (such as paper tape, etc.), magnetic storage medium (such as floppy disk, hard disk, flash memory, etc.), optical storage medium (such as CD-ROM, etc.), magneto-optical storage medium (such as MO, etc.).
  • paper storage medium such as paper tape, etc.
  • magnetic storage medium such as floppy disk, hard disk, flash memory, etc.
  • optical storage medium such as CD-ROM, etc.
  • magneto-optical storage medium Such as MO, etc.
  • the embodiment of the present application further provides a non-volatile storage medium in which a data processing program is stored, and the data processing program is used to execute any one of the foregoing methods of the present application.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

Les modes de réalisation de la présente invention concernent un procédé de traitement de données multimédias. Le procédé consiste à exécuter, pour l'un quelconque des clients d'un service actuel, le processus suivant consistant à : recevoir des premières données multimédias chargées vers l'amont par le client ; traiter les premières données multimédias selon des exigences de traitement de données multimédias préconfigurées correspondant au service actuel et obtenir des secondes données multimédias ; stocker les secondes données multimédias sur un côté réseau et obtenir une adresse de lien des secondes données multimédias ; et, en réponse à une demande d'acquisition d'adresse de lien émanant d'un serveur de service, envoyer la ou les adresses de lien obtenues du service actuel au serveur de service de sorte que le serveur de service fournisse une ou plusieurs des adresses de lien disponibles à l'un quelconque des clients du service actuel. Les modes de réalisation de la présente invention concernent également un dispositif correspondant et un système.
PCT/CN2018/076676 2017-02-28 2018-02-13 Procédé de traitement de données multimédias, dispositif, système, et support de stockage WO2018157743A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710111142.9A CN108512814B (zh) 2017-02-28 2017-02-28 媒体数据处理方法、装置和系统
CN201710111142.9 2017-02-28

Publications (1)

Publication Number Publication Date
WO2018157743A1 true WO2018157743A1 (fr) 2018-09-07

Family

ID=63370565

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/076676 WO2018157743A1 (fr) 2017-02-28 2018-02-13 Procédé de traitement de données multimédias, dispositif, système, et support de stockage

Country Status (2)

Country Link
CN (1) CN108512814B (fr)
WO (1) WO2018157743A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110489276A (zh) * 2019-07-25 2019-11-22 腾讯科技（深圳）有限公司 基于业务页面的验证服务的容灾方法和装置
CN114125017A (zh) * 2020-08-10 2022-03-01 腾讯科技（深圳）有限公司 媒体信息的显示方法和装置、存储介质及电子设备
CN114302249A (zh) * 2020-09-22 2022-04-08 华为云计算技术有限公司 一种传输链信息生成方法及装置
CN114466077A (zh) * 2022-01-25 2022-05-10 北京三快在线科技有限公司 一种多媒体数据处理系统及多媒体数据处理方法

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110830851B (zh) * 2019-10-30 2021-12-14 深圳点猫科技有限公司 一种视频文案的制作方法及装置
CN111343149B (zh) * 2020-02-05 2021-05-14 北京字节跳动网络技术有限公司 评论的方法、装置、电子设备及计算机可读介质
CN112883205B (zh) * 2021-02-09 2023-05-12 杭州网易云音乐科技有限公司 多媒体物料的入库方法、介质、装置和计算设备
CN113055443B (zh) * 2021-02-20 2023-07-04 北京奇艺世纪科技有限公司 一种资源数据部署方法、装置、设备和存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110125818A1 (en) * 2004-03-18 2011-05-26 Andrew Liebman Novel media file for multi-platform non-linear video editing systems
CN203206476U (zh) * 2013-05-06 2013-09-18 重庆昇通科技有限公司 基于双网络的数据内容生成及分享系统
CN104202411A (zh) * 2014-09-15 2014-12-10 中卓信（北京）科技有限公司 文件传输方法和服务器
CN105162893A (zh) * 2015-10-16 2015-12-16 珠海格力电器股份有限公司 视频文件的上传方法、上传系统、访问方法及访问系统
CN106330967A (zh) * 2016-10-24 2017-01-11 北京小米移动软件有限公司 直播数据处理方法及装置

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8301658B2 (en) * 2006-11-03 2012-10-30 Google Inc. Site directed management of audio components of uploaded video files
CN103647867B (zh) * 2013-12-06 2016-11-16 北京奇虎科技有限公司 一种留言方法和系统
CN105992017A (zh) * 2015-02-05 2016-10-05 天脉聚源（北京）科技有限公司 一种音视频文件播放方法和系统
CN105306887A (zh) * 2015-09-21 2016-02-03 北京奇虎科技有限公司 全景数据的分享方法及装置
CN106330769B (zh) * 2016-11-15 2022-03-08 腾讯科技（深圳）有限公司 一种业务处理方法及服务器

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110125818A1 (en) * 2004-03-18 2011-05-26 Andrew Liebman Novel media file for multi-platform non-linear video editing systems
CN203206476U (zh) * 2013-05-06 2013-09-18 重庆昇通科技有限公司 基于双网络的数据内容生成及分享系统
CN104202411A (zh) * 2014-09-15 2014-12-10 中卓信（北京）科技有限公司 文件传输方法和服务器
CN105162893A (zh) * 2015-10-16 2015-12-16 珠海格力电器股份有限公司 视频文件的上传方法、上传系统、访问方法及访问系统
CN106330967A (zh) * 2016-10-24 2017-01-11 北京小米移动软件有限公司 直播数据处理方法及装置

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110489276A (zh) * 2019-07-25 2019-11-22 腾讯科技（深圳）有限公司 基于业务页面的验证服务的容灾方法和装置
CN110489276B (zh) * 2019-07-25 2023-08-29 腾讯科技（深圳）有限公司 基于业务页面的验证服务的容灾方法和装置
CN114125017A (zh) * 2020-08-10 2022-03-01 腾讯科技（深圳）有限公司 媒体信息的显示方法和装置、存储介质及电子设备
CN114125017B (zh) * 2020-08-10 2024-04-09 腾讯科技（深圳）有限公司 媒体信息的显示方法和装置、存储介质及电子设备
CN114302249A (zh) * 2020-09-22 2022-04-08 华为云计算技术有限公司 一种传输链信息生成方法及装置
CN114466077A (zh) * 2022-01-25 2022-05-10 北京三快在线科技有限公司 一种多媒体数据处理系统及多媒体数据处理方法

Also Published As

Publication number Publication date
CN108512814B (zh) 2021-02-05
CN108512814A (zh) 2018-09-07

Similar Documents

Publication Publication Date Title
WO2018157743A1 (fr) Procédé de traitement de données multimédias, dispositif, système, et support de stockage
JP6084261B2 (ja) ウェブベースの音楽パートナーシステムおよびその方法
WO2019196628A1 (fr) Procédé permettant de pousser du contenu promotionnel, appareil et support d'informations
US10038962B2 (en) System and method for testing and certification of media devices for use within a connected media environment
CN108174248B (zh) 视频播放方法、视频播放控制方法、装置、及存储介质
CN107979632B (zh) 推送信息的处理方法、装置及系统
US20180315098A1 (en) Information processing method, server, and computer storage medium
US20140325391A1 (en) System and method for updating information in an instant messaging application
WO2021185302A1 (fr) Procédé de diffusion en continu en direct et de configuration basé sur des téléphones en nuage, et appareil et système associés
US20150177958A1 (en) Providing context information relating to media content that is being presented
WO2021218646A1 (fr) Procédé et appareil d'interaction et dispositif électronique
WO2015143854A1 (fr) Procédé d'acquisition et d'interaction de données, boîtier décodeur, serveur, et système multimédia
JP2015527647A (ja) 埋め込み可能なメディアアップロードオブジェクト
WO2018161953A1 (fr) Procédé, dispositif, système et support de stockage permettant de traiter un contenu promotionnel
CN105812845A (zh) 一种媒体资源推送方法、系统和基于Android系统的媒体播放器
US9755885B1 (en) Local rendering in lieu of streaming
CN112565877B (zh) 投屏方法、系统、电子设备及存储介质
TW201719443A (zh) 將與活動相關的資訊從源電子裝置轉遞至伴隨電子裝置
US11647243B2 (en) System and method for using an application on a mobile device to transfer internet media content
WO2022242461A1 (fr) Procédé et appareil de traitement d'un flux audio/vidéo en direct, client et serveur
US20140068006A1 (en) Method, apparatus and system for providing content
WO2016127888A1 (fr) Procédé et dispositif de téléchargement vers l'aval d'un fichier multimédia
CN105893496B (zh) 一种信息处理方法及装置、电子设备
WO2019196597A1 (fr) Procédé de traitement de données enregistrées et dispositif pertinent
KR102228375B1 (ko) 다수의 스트리밍 콘텐츠들을 재생하는 방법 및 시스템

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18760413

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18760413

Country of ref document: EP

Kind code of ref document: A1