WO2023029689A1 - 多媒体数据的共享方法、媒体共享服务器、终端、电子设备和计算机可读存储介质 - Google Patents

多媒体数据的共享方法、媒体共享服务器、终端、电子设备和计算机可读存储介质 Download PDF

Info

Publication number
WO2023029689A1
WO2023029689A1 PCT/CN2022/101121 CN2022101121W WO2023029689A1 WO 2023029689 A1 WO2023029689 A1 WO 2023029689A1 CN 2022101121 W CN2022101121 W CN 2022101121W WO 2023029689 A1 WO2023029689 A1 WO 2023029689A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
sharing
shared
multimedia data
multimedia
Prior art date
Application number
PCT/CN2022/101121
Other languages
English (en)
French (fr)
Inventor
鄢玉民
宋晨
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2023029689A1 publication Critical patent/WO2023029689A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80Responding to QoS
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/565Conversion or adaptation of application format or content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]

Definitions

  • the present application relates to the technical field of data processing, and specifically relates to a multimedia data sharing method, a media sharing server, a terminal, electronic equipment, and a computer-readable storage medium.
  • Different types of data platforms have differences in data collection, encoding, transmission, and decoding.
  • different multimedia data processing servers process multimedia data in different ways, and some multimedia data processing servers correspond to a single media output format, which cannot meet the individual needs of user terminals, resulting in low user experience; and, the existing multimedia data processing
  • the transmission system usually has a limited scope of application (for example, it is only applicable to a certain data platform).
  • An embodiment of the present application provides a method for sharing multimedia data, including: acquiring configuration information and sharing methods of multimedia data; processing the collected multimedia data according to the configuration information of multimedia data, and obtaining data to be shared that support multiple output formats ; and share the data to be shared according to the sharing method.
  • An embodiment of the present application provides a method for sharing multimedia data, including: generating configuration information of multimedia data; Process the data, obtain the data to be shared that supports multiple output formats, and share the data to be shared according to the sharing method.
  • An embodiment of the present application provides a media sharing server, including: an acquisition module configured to acquire configuration information and a sharing method of multimedia data; a processing module configured to process the collected multimedia data according to the configuration information of the multimedia data to obtain support The data to be shared in multiple output formats; and a sharing module configured to share the data to be shared according to the sharing method.
  • An embodiment of the present application provides a terminal, including: at least one application, the application including a generating module and a sending module; the generating module is configured to generate configuration information of multimedia data; the sending module is configured to send configuration information of multimedia data to a media sharing server, The media sharing server processes the collected multimedia data according to the configuration information of the multimedia data, obtains the data to be shared that supports multiple output formats, and shares the data to be shared according to the sharing method.
  • An embodiment of the present application provides an electronic device, including: one or more processors; and a memory, on which one or more computer programs are stored, when the one or more computer programs are processed by the one or more When executed by a processor, the one or more processors implement the method for sharing multimedia data in the embodiment of the present application.
  • An embodiment of the present application provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the method for sharing multimedia data in the embodiment of the present application is implemented.
  • FIG. 1 shows a schematic flowchart of a method for sharing multimedia data provided by an embodiment of the present application.
  • FIG. 2 shows a schematic flowchart of a method for sharing multimedia data provided by an embodiment of the present application.
  • FIG. 3 shows a schematic flowchart of a method for sharing multimedia data provided by an embodiment of the present application.
  • Fig. 4 shows a block diagram of the composition of the media sharing server provided by the embodiment of the present application.
  • FIG. 5 shows a block diagram of a terminal provided by an embodiment of the present application.
  • FIG. 6 shows a block diagram of a system for sharing multimedia data provided by an embodiment of the present application.
  • FIG. 7 shows a schematic flowchart of a working method of the multimedia data sharing system provided by the embodiment of the present application.
  • FIG. 8 shows a block diagram of a local platform sharing device provided by an embodiment of the present application.
  • FIG. 9 shows a block diagram of a connection relationship between a first terminal and a local media sharing server provided by an embodiment of the present application.
  • FIG. 10 shows a block diagram of a connection relationship between a first terminal and a local media sharing server provided by an embodiment of the present application.
  • FIG. 11 shows a block diagram of a connection relationship between a first terminal and a local media sharing server provided by an embodiment of the present application.
  • Fig. 12 shows a structural diagram of an exemplary hardware architecture of a computing device capable of implementing the multimedia data sharing method and apparatus according to the embodiments of the present application.
  • FIG. 1 shows a schematic flowchart of a method for sharing multimedia data provided by an embodiment of the present application.
  • the multimedia data sharing method can be applied to a media sharing server.
  • the multimedia data sharing method in the embodiment of the present application may include steps S101 to S103.
  • Step S101 acquiring configuration information and a sharing mode of multimedia data.
  • the configuration information of the multimedia data can reflect the requirement information of the terminal, that is, the format or type of the multimedia data that the terminal expects to acquire.
  • the sharing mode represents the transmission mode of the multimedia data between the terminal and the current media sharing server.
  • the media sharing server can provide suitable multimedia data for different terminals in a more targeted manner to meet the individual needs of different terminals .
  • step S102 the collected multimedia data is processed according to the configuration information of the multimedia data, and data to be shared supporting multiple output formats is obtained.
  • Multimedia data may be data collected by a data collection device, for example, image data and/or video data.
  • the data to be shared may include: data based on the Red Green Blue (Red Green Blue, RGB) color mode (i.e. RGB data) after processing the original image, YUV data, clipped video files after processing the original video data, and at least one of the video images.
  • Red Green Blue Red Green Blue
  • RGB Red Green Blue
  • RGB and YUV are color spaces used to represent colors. The two can be transformed into each other.
  • "Y” in YUV represents the brightness, that is, the grayscale value; while "U” and “V” represent the image color and saturation, which are used to specify the color of the pixel.
  • the RGB color mode is a color standard in the industry. It obtains a variety of colors by changing the three color channels of red (R), green (G), and blue (B) and superimposing them with each other. .
  • Step S103 sharing the data to be shared according to the sharing mode.
  • Sharing methods may include multiple transmission methods, or multiple data access methods.
  • the data to be shared is shared with multiple terminals or multiple network devices through multiple transmission methods or multiple data access methods, so that the data to be shared can be used by multiple users and the sharing range of the data to be shared can be expanded.
  • the multimedia data sharing method by acquiring the configuration information and sharing method of the multimedia data, the multimedia data required by the terminal and the sharing method of the multimedia data can be specified, and suitable multimedia data can be prepared for the terminal; Process the collected multimedia data according to the configuration information of the multimedia data, obtain the data to be shared that supports multiple output formats, avoid the problem of a single output format of the data, meet the individual needs of the terminal, and improve the user experience; and through A variety of sharing methods, sharing the data to be shared, and expanding the sharing scope of the data to be shared.
  • the embodiment of the present application also provides an implementation method.
  • the above-mentioned sharing method includes: sharing in the form of an interface; step S103 can be implemented in the following manner: obtaining the interface of the signaling interface and the data pipeline; and according to the signaling interface and the data pipeline interface to acquire and share the data to be shared.
  • the data pipe is a pipe determined according to the type of multimedia data
  • the signaling interface is an interface for transmitting configuration information of the data pipe.
  • the signaling interface it is possible to know the data type of the data to be shared that the data pipeline is suitable for transmission.
  • the data pipeline corresponding to the data type is used to transmit the data to be shared, which can improve The sharing efficiency of the data to be shared.
  • the interface may include: an application programming interface (Application Programming Interface, API), and/or, a high definition multimedia interface (High Definition Multimedia Interface, HDMI). Sharing the data to be shared through the API and/or HDMI can increase the speed of sharing the data to be shared, accelerate the speed at which the terminal obtains the data to be shared, and improve user experience.
  • API Application Programming Interface
  • HDMI High Definition Multimedia Interface
  • the acquiring and sharing the data to be shared according to the signaling interface and the interface of the data pipeline includes: acquiring the working status of the data pipeline and the interface identifier of the data pipeline according to the signaling interface; When the working status is enabled, the data to be shared is acquired and shared according to the interface identifier of the data pipeline.
  • the working state of the data pipeline includes: open state or closed state. When it is determined that the working state of the data pipeline is open, the data pipeline can be used to transmit the data to be shared; when it is determined that the working state of the data pipeline is closed, the data pipeline cannot transmit the data to be shared.
  • the interface identifier of the data pipe is related to the data type of the data to be shared that can be transmitted by the data pipe. For example, if the interface identifier of the data pipe is "A01", it means that the data pipe can transmit the data to be shared whose data type is "A”, and "01" represents the serial number of the data pipe.
  • the specific data pipeline used for the transmission of the data to be shared can be specified, so that the data to be shared of different data types can be shared through the corresponding data pipeline, and the data to be shared can be accelerated. Share speed.
  • the embodiment of the present application also provides an implementation method.
  • the above-mentioned sharing method also includes: sharing in the form of an internal network; step S103 can be implemented in the following manner: establish a data channel with at least one application; and use the data channel to communicate with the application Share the data to be shared.
  • the application is the data demander that has a communication connection with the current server.
  • the application may be an application program running on a terminal, or an application program running on other data usage devices.
  • the application can establish a socket-based communication connection with the current server.
  • the application sends a data request message through the socket, and the current server feeds back the data response message to the application through the socket, so as to realize the connection between the application and the current server. message interaction, and then complete the sharing of the data to be shared.
  • a data communication network is established between multiple applications and the current server.
  • the data channel is used to share the data to be shared, so that multiple applications can obtain the current server.
  • the data service expands the sharing scope of the data to be shared.
  • the embodiment of the present application also provides an implementation method, the above-mentioned sharing method also includes: sharing in the way of shared memory; step S103 can be implemented in the following way: perform data synchronization with the application; and when it is determined that the data synchronization is completed, According to the shared memory connected to the application, the data to be shared is shared with the application.
  • the application is the data demander that has a communication connection with the current server.
  • the shared memory may be a separate storage space opened in the storage space of the current server, and the shared memory is specially used for sharing data to be shared between the current server and the application.
  • the shared memory may also be an independent storage register, and both the application and the current server can access the storage register, so as to realize the sharing of data to be shared.
  • the embodiment of the present application also provides an implementation method.
  • the above-mentioned sharing method also includes: group sharing; step S103 can be implemented in the following manner: obtain the data demand information of the group in the group management device; demand information, select customized data corresponding to the group from the data to be shared; and send the customized data to the group management device, so that the group management device can share the customized data to multiple terminals in the group.
  • the group management device is configured to construct multiple groups, and multiple terminals in each group have the same data requirements.
  • multiple terminals with the same data requirements can obtain the data to be shared in real time through the group, thereby increasing the sharing speed of the data to be shared.
  • the grouping enables multiple terminals in different locations to obtain the data to be shared at the same time, which reduces the transmission delay of the data to be shared, not only ensures the accuracy of the data to be shared, but also improves the transmission speed of the data to be shared.
  • FIG. 2 shows a schematic flowchart of a method for sharing multimedia data provided by an embodiment of the present application.
  • the multimedia data sharing method can be applied to a media sharing server.
  • the multimedia data sharing method in the embodiment of the present application may include steps S201 to S205.
  • Step S201 acquiring configuration information and a sharing mode of multimedia data.
  • the configuration information of the multimedia data includes: an encoding method.
  • the encoding manner may include: at least one of predictive encoding, transform encoding, quantization encoding, sub-band encoding, and encoding based on a preset protocol.
  • the foregoing preset protocol may include: at least one of the H.261 protocol, the H.265 protocol, and the H.264 protocol.
  • Step S202 preprocessing the multimedia data to obtain preprocessed data.
  • Preprocessing the multimedia data can be to filter the original multimedia data to determine the data type of the multimedia data; it can also be to sort the original multimedia data to determine the order of the multimedia data; it can also be to the original Multimedia data audit to obtain complete and accurate multimedia data, etc.
  • the above methods of preprocessing multimedia data are only examples, and can be set according to actual needs. Other unexplained methods of preprocessing multimedia data are also within the scope of protection of this application, and will not be repeated here. repeat.
  • Step S203 Encode the preprocessed data according to the encoding method to generate encoded data.
  • the preprocessed data is coded, and data in different coding formats (that is, coded data) can be obtained. , so that the encoded data can adapt to the different needs of various terminals, so as to avoid the singleness of the data output format.
  • Predictive coding is based on the characteristics of a certain correlation between discrete signals, using one or more previous signals to predict the next signal; then, the difference between the actual value and the predicted value (that is, the prediction error) is encoded. The closer the predicted value is to the actual value, the smaller the forecast error. Under the condition of the same precision requirement, less bits can be used for encoding to achieve data compression.
  • Transform coding is to reduce the spatial correlation of image signals from the perspective of frequency domain, and can obtain similar effects to predictive coding in terms of reducing the bit rate.
  • Quantization refers to the process of approximating continuous values of a signal to a finite number of discrete values, or approximating a large number of possible discrete values to fewer discrete values. Quantization coding can achieve the effect of locating prominent objects in an image, so as to speed up image processing.
  • Subband Coding is a coding method based on the signal spectrum, which is to decompose the signal into different frequency band components to remove the signal correlation, and then sample, quantize and encode the components respectively to obtain a set of mutual uncorrelated codewords, and then combine these codewords together to form subband coding results. Because the quantization noise of different frequency bands is bound in this frequency band, it can prevent the signal in the frequency band with less energy from being covered up by the quantization noise in other frequency bands, and improve the accuracy of the data.
  • Step S204 generating data to be shared that supports multiple output formats according to the encoded data.
  • the data to be shared that supports multiple output formats may include: support for at least one of predictive encoded data, transform encoded data, quantized encoded data, subband encoded data, and encoded data based on a preset protocol A sort of.
  • the output format can be configured according to the format of the original image or original video data, so as to meet the individual requirements of the terminal.
  • Step S205 sharing the data to be shared according to the sharing mode.
  • Step S205 in the method for sharing multimedia data shown in FIG. 2 is the same as step S103 in the method for sharing multimedia data shown in FIG. 1 , and will not be repeated here.
  • the preprocessed data is obtained by preprocessing the multimedia data, so that the preprocessed data can meet the security requirements of the current server, while ensuring the accuracy of the preprocessed data; Encode the preprocessed data according to a variety of different encoding methods to generate encoded data, so that the encoded data can support more output formats and expand the sharing format of multimedia data; generate and support multiple outputs based on the encoded data
  • the data to be shared in the format can meet the individual needs of the terminal and improve the user experience of the terminal.
  • the data to be shared is shared with multiple terminals or multiple network devices through multiple transmission methods or multiple data access methods, so that the data to be shared can be used by multiple users and the sharing range of the data to be shared can be expanded.
  • the embodiment of the present application also provides an implementation manner.
  • the above configuration information of the multimedia data further includes: a scaling identifier, and the scaling identifier is used to indicate whether to perform scaling processing on the multimedia data.
  • Step S202 can be implemented in the following manner:
  • the scaling identifier is determined to indicate that the multimedia data is to be scaled, perform data scaling on the multimedia data according to a preset scaling algorithm to obtain scaled data; and generate preprocessed data according to the scaled data.
  • the preset scaling algorithm includes: at least one of smooth scaling, fast scaling, proportional scaling, and black border scaling.
  • Smooth scaling is to process the original image based on the frame rate or resolution of the original image so that the scaled data can transition smoothly and reduce image loss.
  • Fast zoom is to use the preset zoom speed to realize fast clipping of the original image.
  • Proportional scaling is a manner of reducing or enlarging multimedia data according to a preset ratio (for example, 50%), so that the scaled data can meet the requirements of the terminal.
  • Black border scaling is to add black borders at the boundary of multimedia data (for example, a character image, etc.) to ensure the integrity of the character image; or, use a preset frame with black editing to edit the original image
  • the scaling method for clipping Specific features of the image can be highlighted to obtain key information about the image.
  • Multi-dimensional preprocessing data can be obtained by scaling the multimedia data through various types of preset scaling algorithms, which facilitates subsequent data processing, and at the same time, expands the types of multimedia data.
  • the data to be shared includes: at least one of multimedia data, scaled data, and coded data.
  • the scaled data may include: data of various dimensions; the encoded data may include: data processed by various encoding algorithms; the multimedia data may be images or videos supporting different display formats.
  • the data format that the data to be shared can support is expanded, and the data to be shared is extended from multiple dimensions to avoid data output
  • the singleness of the format enables the data to be shared to support the personalized needs of the terminal and improve the user experience.
  • the embodiment of the present application also provides an implementation manner, before performing step S101 or step S201, further comprising: collecting multimedia data in a preset platform.
  • the preset platforms support many different types of operating systems.
  • the preset platform may support at least one of Windows system, Linux system, Android system and IOS system.
  • the multimedia data can be applied to a variety of different types of operating systems, and then the multimedia data is processed in a unified way to obtain data to be shared in multiple output formats, saving hardware costs , while improving the scope of application of multimedia data and expanding the sharing scope of data to be shared.
  • FIG. 3 shows a schematic flowchart of a method for sharing multimedia data provided by an embodiment of the present application.
  • the multimedia data sharing method can be applied to terminals.
  • the multimedia data sharing method in the embodiment of the present application may include steps S301 and S302.
  • Step S301 generating configuration information of multimedia data.
  • the multimedia data may include at least one of image data, video data and voice data.
  • the configuration information of the multimedia data can reflect the requirement information of the terminal, that is, the format or type of the multimedia data that the terminal expects to acquire.
  • the configuration information may include a coding method, and/or a scaling identifier.
  • the scaling flag is used to indicate whether to perform scaling processing on the multimedia data.
  • the generating the configuration information of the multimedia data includes: generating the configuration information of the multimedia data according to the attribute information of the multimedia data.
  • the attribute information of the multimedia data includes: at least one of image format information, resolution information, code rate information and frame rate information.
  • the image format information may include: at least one of an RGB format, a YUV format, and an image format based on a preset protocol (for example, image data based on the H.264 protocol, etc.).
  • a preset protocol for example, image data based on the H.264 protocol, etc.
  • the configuration information of multimedia data is generated through the attribute information of different dimensions of multimedia data, which can reflect the demand information of terminals for different types of multimedia data, so that the media sharing server can provide suitable multimedia data for the current terminal in a more targeted manner, satisfying The individual needs of the current terminal.
  • Step S302 sending the configuration information of the multimedia data to the media sharing server.
  • the media sharing server When the media sharing server obtains the configuration information of the multimedia data, it processes the collected multimedia data according to the configuration information of the multimedia data, obtains the data to be shared that supports multiple output formats, and shares the data to be shared according to the sharing method .
  • the sharing mode may be a data sharing mode determined according to the connection relationship between the current terminal and the media sharing server.
  • the current terminal can share multimedia data through interfaces; it can also share multimedia data through internal networking; it can also share multimedia data through shared memory and/or group sharing. shared.
  • the configuration information of the multimedia data is generated and sent to the media sharing server through attribute information of different dimensions of the multimedia data, so that the media sharing server can use the configuration information of the multimedia data Process the collected multimedia data to obtain data to be shared that supports multiple output formats to meet the individual needs of the current terminal; and based on a variety of different types of sharing methods, the media sharing server and the current terminal can be shared to be shared Further, the data can also enable the media sharing server to share the data to be shared with other terminal devices, which expands the scope of data sharing.
  • Fig. 4 shows a block diagram of the composition of the media sharing server provided by the embodiment of the present application.
  • the media sharing server 400 includes an acquisition module 401 , a processing module 402 and a sharing module 403 .
  • the acquisition module 401 is configured to obtain configuration information and sharing methods of the multimedia data;
  • the processing module 402 is configured to process the collected multimedia data according to the configuration information of the multimedia data, and obtain data to be shared that supports multiple output formats;
  • the sharing module 403 configures To share the data to be shared according to the sharing method.
  • the above-mentioned sharing method includes: sharing in the form of an interface; the sharing module 403 is specifically configured to: obtain the interface of the signaling interface and the data pipeline, the data pipeline is a pipeline determined according to the category of multimedia data, and the signaling interface uses The configuration information for transmitting the data pipeline; and according to the signaling interface and the interface of the data pipeline, acquire and share the data to be shared.
  • the acquiring and sharing the data to be shared according to the signaling interface and the interface of the data pipeline includes: acquiring the working status of the data pipeline and the interface identifier of the data pipeline according to the signaling interface; When the working status is enabled, the multimedia data is acquired and shared according to the interface identifier of the data pipeline.
  • the above sharing method also includes: sharing in an internal networking manner; the sharing module 403 is specifically configured to: establish a data channel with at least one application, and the application is a data demander that has a communication connection with the current server; And use the data channel to share the data to be shared with the application.
  • the above-mentioned sharing method also includes: sharing in the form of shared memory; the sharing module 403 is specifically configured to: perform data synchronization with an application, and the application is a data demander that has a communication connection with the current server; and when determining When the data synchronization is completed, the data to be shared is shared with the application according to the shared memory connected to the application.
  • the above-mentioned sharing method also includes: group sharing; the sharing module 403 is specifically configured to: acquire the data requirement information of the groups in the group management device, and the group management device is configured to construct multiple groups, each Multiple terminals in a group have the same data requirement; according to the data requirement information of the group, select customized data corresponding to the group from the data to be shared; and send the customized data to the group management device for the group The management device shares the customized data to a plurality of terminals in the group.
  • the configuration information of the above-mentioned multimedia data includes: an encoding method; the processing module 402 is specifically configured to: preprocess the multimedia data to obtain preprocessed data; encode the preprocessed data according to the encoding method to generate encoded data; and generating data to be shared that supports multiple output formats based on the encoded data.
  • the configuration information of the above-mentioned multimedia data further includes: a scaling identifier, which is used to indicate whether to perform scaling processing on the multimedia data; said preprocessing the multimedia data, and obtaining the pre-processed data includes: determining the scaling identifier In the case of performing scaling processing on multimedia data, performing data scaling on multimedia data according to a preset scaling algorithm to obtain scaled data; and generating preprocessed data according to the scaled data.
  • the preset scaling algorithm includes: at least one of smooth scaling, fast scaling, proportional scaling, and black border scaling.
  • the encoding manner includes: at least one of predictive encoding, transform encoding, quantization encoding, subband encoding, and encoding based on a preset protocol.
  • the data to be shared includes: at least one of multimedia data, scaled data, and coded data.
  • the media sharing server 400 further includes: a collection module configured to collect multimedia data in a preset platform; the preset platform supports multiple different types of operating systems.
  • the configuration information and the sharing mode of the multimedia data can be obtained by the acquisition module 401, the multimedia data required by the terminal and the sharing mode of the multimedia data can be clarified, and suitable multimedia data can be prepared for the terminal;
  • FIG. 5 shows a block diagram of a terminal provided by an embodiment of the present application.
  • the terminal 500 includes a generating module 501 and a sending module 502 .
  • the generating module 501 is configured to generate the configuration information of the multimedia data;
  • the sending module 502 is configured to send the configuration information of the multimedia data to the media sharing server, so that the media sharing server processes the collected multimedia data according to the configuration information of the multimedia data to obtain support Data to be shared in various output formats, and share the data to be shared according to the sharing method.
  • the generating module 501 is specifically configured to generate configuration information of multimedia data according to the attribute information of multimedia data; the attribute information of multimedia data includes: image format information, resolution information, code rate information, and frame rate information at least one.
  • the configuration information of the multimedia data is generated by the generation module 501 according to the attribute information of different dimensions of the multimedia data; the configuration information of the multimedia data is sent to the media sharing server by the sending module 502, so that the media The sharing server can process the collected multimedia data according to the configuration information of the multimedia data, and obtain the data to be shared that supports multiple output formats to meet the individual needs of the current terminal; and based on a variety of different types of sharing methods, the media The sharing server and the current terminal can share the data to be shared, and further, the media sharing server can share the data to be shared with other terminal devices, which expands the scope of data sharing.
  • FIG. 6 shows a block diagram of a system for sharing multimedia data provided by an embodiment of the present application.
  • the multimedia data sharing system includes the following devices: a media sharing server 610 , a first terminal 621 , a second terminal 622 , a group management system 630 and a common basic platform 640 .
  • the media sharing server 610 includes: a local media sharing server 611 and a network media sharing server 612 .
  • the local media sharing server 611 includes: scaling means 6111 , local platform sharing means 6112 , encoding means 6113 and local sharing unified interface module 6114 .
  • the network media sharing server 612 includes: a network platform sharing device 6121 and a network sharing unified interface module 6122 .
  • both the first terminal 621 and the second terminal 622 can include: a media player, an object storage device, and other devices connected in an interface manner (for example, with At least one of the devices connected to the HDMI interface, etc.).
  • a media player for example, with At least one of the devices connected to the HDMI interface, etc.
  • other types of terminals that are not described are also within the protection scope of the present application, and can be specifically set according to specific situations, and will not be repeated here.
  • the group management system 630 includes: a group management device 631 and a group forwarding device 632 .
  • the common basic platform 640 includes: multiple data collection devices (for example, local data collection device 6411 and external data collection device 6412, etc.) and a preset operating system 642, which supports multiple different types of operating systems (such as , support at least one of Windows system, Linux system, Android system and IOS system).
  • multiple data collection devices for example, local data collection device 6411 and external data collection device 6412, etc.
  • a preset operating system 642 which supports multiple different types of operating systems (such as , support at least one of Windows system, Linux system, Android system and IOS system).
  • the first terminal 621 or the second terminal 622 is configured to send the configuration information of multimedia data to the local media sharing server 610, so that the media sharing server 610 can share the unified interface module 6114 locally, or the network sharing unified interface module 6122 as a terminal Provides multimedia data.
  • the configuration information of the multimedia data may include: setting video image parameters (for example, at least one of video resolution, video type, video format, and encoding method).
  • the multimedia data may include: at least one of an original video image, a video image subjected to zoom processing, and a video image subjected to hybrid coding processing.
  • the multimedia data may include: original images (for example, RGB images, etc.) and data processed by using video codec technology (for example, based on protocol H.264 or protocol H.265, etc.).
  • the common basic platform 640 is configured to collect image data, transcode the image data, and the like.
  • the common basic platform 640 provides a unified interface to transmit RGB data or YUV data.
  • the general basic platform 640 internally interfaces with the preset operating system 642 and different image acquisition devices (for example, local data acquisition device 6411 and external data acquisition device 6412, etc.), and converts the collected special format data into general RGB data or YUV data.
  • YUV data is a video format data represented by luminance component (Y component) and chrominance component (U component and V component). According to the difference between the Y component, U component and V component, YUV data can include : at least one of data in YUV444 format, data in YUV422 format, and data in YUV420 format.
  • Different image acquisition devices have independent image acquisition interfaces, and the image acquisition devices all support multiple different data formats (for example, at least one of data in RGB24 format, data in YUV444 format and data in YUV420 format).
  • the scaling device 6111 is configured to scale the acquired image data to a predetermined size based on a plurality of different scaling algorithms (for example, at least one of smooth scaling, fast scaling, proportional scaling, and black-and-fill scaling) according to the requirements of the terminal.
  • Set the resolution data that is, the scaled data
  • share the scaled data with other devices in the network (for example, the first terminal 621 or the network media sharing server 612, etc.) through the local shared unified interface module 6114.
  • the local platform sharing device 6112 is configured to configure parameters for multimedia data, and perform services such as data classification and sharing.
  • the encoding means 6113 is configured to perform the scaled data input by the scaling means 6111 ( Or, the original data input by each data acquisition device in the common basic platform 640) is encoded to generate encoded data.
  • the encoding based on the preset protocol can be a hybrid encoding based on the Moving Picture Experts Group (MPEG), an encoding based on the H.261 protocol (or the H.265 protocol, or the H.264 protocol, etc.) At least one of the mixed encodings of the Joint Photographic Experts Group (JPEG).
  • MPEG Moving Picture Experts Group
  • H.261 protocol or the H.265 protocol, or the H.264 protocol, etc.
  • JPEG Joint Photographic Experts Group
  • the local shared unified interface module 6114 is configured to provide unified interface data to other devices in the network.
  • other devices in the network are provided with data to be shared through at least one of the following sharing methods:
  • a method based on shared memory a method based on disk file reading and writing, a method based on local device internal networking, and an interface-based method (for example, a module for sharing multimedia data based on API, or a module for sharing multimedia data based on HDMI) module, etc.)
  • the network platform sharing device 6121 is configured to encapsulate the data to be shared output by the local shared unified interface module 6114 to obtain the encapsulated data.
  • Transport Protocol, RTP Transport Protocol
  • the network sharing unified interface module 6122 includes signaling channels and media channels.
  • the signaling channel is used for exchanging data to be shared with external devices (for example, the group management system 630, or the second terminal 622, etc.).
  • the media channel is configured to pass the data to be shared through the socket (for example, establish a session connection based on the User Datagram Protocol (User Datagram Protocol, UDP) or based on the Transmission Control Protocol (Transmission Control Protocol, TCP) with the external device) Share to the group management system 630, or, the second terminal 622.
  • the data to be shared includes: at least one of original multimedia data, scaled data and coded data.
  • the group management system 630 is a basic system shared by multiple terminals.
  • the group management device 631 is configured to manage the communication link between the remote device (for example, the second terminal 622) and the group management device 631, and store the communication links corresponding to the terminals that need the same data to be shared in the same group , which facilitates real-time sharing of the data to be shared.
  • the group forwarding device 632 is configured to distribute customized data required by different groups to different types of group transmission channels, so that all terminals in the same group can share the data to be shared in the group in real time.
  • FIG. 7 shows a schematic flowchart of a working method of the multimedia data sharing system provided by the embodiment of the present application. As shown in FIG. 7 , the working method of the multimedia data sharing system includes steps S701 to S709.
  • Step S701 the first terminal 621 generates configuration information of the required multimedia data according to the attribute information of the required multimedia data, and sends the configuration information to the local shared unified interface module 6114 in the local media sharing server 611 .
  • the attribute information of the multimedia data includes: at least one of image format information, resolution information, code rate information and frame rate information.
  • the configuration information of the multimedia data may include a coding method, and/or a scaling identifier.
  • the scaling flag is used to indicate whether the multimedia data needs to be scaled.
  • Step S702 the local shared unified interface module 6114 in the local media sharing server 611 sends the configuration information of the multimedia data to the local platform sharing device 6112, so that the local platform sharing device 6112 saves the configuration information; and based on the configuration information, obtains the common The multimedia data collected by each image collection device in the basic platform 640 , and/or, obtain the scaled data processed by the scaling device 6111 .
  • the multimedia data may be image data collected by various image collection devices, or screen desktop images, and the like.
  • the scaled data is the data generated by scaling means 6111 using a preset scaling algorithm to scale the multimedia data collected by each image acquisition device in the common basic platform 640 .
  • the scaling means 6111 supports multiple different scaling algorithms, for example, at least one of smooth scaling, fast scaling, proportional scaling, and padding scaling.
  • Step S703 the local platform sharing device 6112 in the local media sharing server 611 outputs the scaled data to the encoding device 6113, so that the encoding device 6113 encodes the scaled data to generate encoded data;
  • the multimedia data configuration information in the first terminal 621 not only includes the encoding method, but also includes a scaling identifier, which indicates whether the multimedia data needs to be scaled;
  • the scaled data (for example, data based on the H.264 protocol); it is also necessary to obtain the scaled data input by the local platform sharing device 6112.
  • Step S704 the local sharing unified interface module 6114 shares the data to be shared with the first terminal 621 , or further transmits the data to be shared to the network media sharing server 612 .
  • the data to be shared may include: scaled data and coded data.
  • Step S705 the local platform sharing device 6112 in the local media sharing server 611 sends a stop collection message to the common basic platform 640, so that each data collection device in the common basic platform 640 stops collecting multimedia data, and at the same time, clears the cache to facilitate downloading The second multimedia data collection.
  • Step S706 the network platform sharing device 6121 in the network media sharing server 612 encapsulates the data to be shared, generates an RTP data packet or a data packet in a custom format, and sends the RTP data packet or a data packet in a custom format to the network media sharing
  • the network in the server 612 shares the unified interface module 6122 .
  • Step S707 the network sharing unified interface module 6122 in the network media sharing server 612 forwards the RTP data packet or the data packet in a self-defined format to the group management system 630 .
  • Step S708 the group management system 630 shares the data to be shared with the second terminal 622 .
  • the second terminal 622 may include: at least one of a terminal, an application program, a media player, an object storage device, and other devices connected in an interface manner.
  • Step S709 the second terminal 622 stores or plays the acquired data to be shared.
  • the acquired multimedia data is processed in different ways through the local media sharing server 611 (for example, scaling the multimedia data, or The scaled data is encoded, etc.), and the multimedia data is only processed once to obtain the data to be shared in a variety of different output formats (for example, at least one of the original multimedia data, the scaled data, and the encoded data) A) can avoid the problem of a single output format of data, meet the individual needs of the terminal, and improve the user experience; and, the common basic platform 640 can support multiple different types of operating systems, and can make different types of operating systems Use a unified data processing method to obtain data to be shared in multiple output formats, which saves hardware costs; through the group management system 630, data sharing with the network media sharing server 612 can be realized, and multiple users in different groups End users can share the data to be shared in the group in real time, realizing real-time data sharing across regions and expanding the sharing scope of the data to be shared.
  • the local media sharing server 611 for example, scaling the multimedia data, or The scaled data is encoded
  • the embodiment of the present application also provides an implementation manner.
  • the local platform sharing device 6112 in FIG. 6 may be implemented in the manner shown in FIG. 8 .
  • FIG. 8 shows a block diagram of a local platform sharing device provided by an embodiment of the present application.
  • the local platform sharing device 800 includes a configuration module 810 , a first data pipeline 821 , a second data pipeline 822 , . . . , an Nth data pipeline 82N.
  • N represents the number of data pipelines, and N is an integer greater than or equal to 1.
  • the configuration module 810 can control multiple data pipelines through the signaling interface 830, that is, the signaling in the signaling interface 830 is used to control the opening and closing of the pipeline switch of each data pipeline.
  • Each data pipe includes a pipe switch configured to control opening and closing of the data pipe.
  • the first data pipe 821 includes a first pipe switch 8211; the second data pipe 822 includes a second pipe switch 8221; ...; the Nth data pipe 82N includes an Nth pipe switch 82N1, and so on.
  • the upper module (for example, the local shared unified interface module 6114) inputs the configuration information into the configuration module 810; the configuration information can be set based on at least one of image format information, resolution information, code rate information and frame rate information information.
  • the configuration module 810 selects the target data pipeline (for example, the second data pipeline 822) according to the image format information, etc., and sends a signaling message indicating to open the second data pipeline 822 to the signaling interface 830, so as to open the second pipeline switch 8221. Enable the multimedia data uploaded by the bottom layer and matching the configuration information to be shared with multiple terminals through the second pipeline switch 8221.
  • the second data pipeline 822 determines the flow rate of the reported multimedia data according to the congestion state of the data pipeline, so as to avoid the data transmission congestion of the data pipeline.
  • the configuration module 810 When it is determined that the second data pipeline 822 has completed the sharing of multimedia data, the configuration module 810 will issue a closing command to the signaling interface 830 to close the second pipeline switch 8221 to facilitate subsequent data processing (for example, in response to the next terminal data sharing request, etc.).
  • the local platform sharing device 800 by adopting the mode of multiple data pipelines, the distinction of multiple different types of multimedia data is realized; the underlying devices (for example, multiple different data acquisition devices, or, The multimedia data uploaded by the scaling device (6111, etc.) can be sent to multiple different data pipelines according to the category of the multimedia data, which speeds up the sharing speed of the multimedia data.
  • FIG. 9 shows a block diagram of a connection relationship between a first terminal and a local media sharing server provided by an embodiment of the present application.
  • the local media sharing server 900 includes a local platform sharing device 910 , and the local platform sharing device 910 includes: a socket establishment module 911 , a configuration module 912 and a data pipeline 913 .
  • the socket establishment module 911 is configured to realize the communication connection between the first terminal 621 and the local platform sharing device 910, so that the first terminal 621 and the local media sharing server 911 can exchange messages based on sockets.
  • the socket establishing module 911 When it is determined that the socket establishing module 911 has successfully established the communication connection between the first terminal 621 and the local platform sharing device 910, the communication between the first terminal 621 and the local platform sharing device 910 can be exchanged through network messages In this manner, the first terminal 621 can update the configuration information of the multimedia data, and enable the first terminal 621 to directly obtain the multimedia data provided by the data pipeline 913 .
  • the socket establishment module 911 can also implement the establishment of communication connections with multiple terminals (or multiple applications), so that the local media sharing server 900 can serve multiple terminals (or multiple applications) at the same time. application) to provide multimedia data sharing services.
  • the compatibility of the sharing system of multimedia data is improved.
  • FIG. 10 shows a block diagram of a connection relationship between a first terminal and a local media sharing server provided by an embodiment of the present application.
  • the first terminal 621 is connected to the shared memory module 1020, and the shared memory module 1020 is also connected to the local media sharing server 1010 at the same time.
  • the configuration module 10111 and the data pipeline 10112 in the local platform sharing device 1011 implement sharing of multimedia data with the first terminal 621 through the shared memory module 1020 respectively.
  • the configuration module 10111 can directly obtain the multimedia data configuration information of the first terminal 621 by accessing the shared memory module 1020; the first terminal 621 can directly obtain multimedia data in the data channel 10112 by accessing the shared memory module 1020.
  • the sharing operation of multimedia data can be realized, and the sharing efficiency of multimedia data can be improved.
  • FIG. 11 shows a block diagram of a connection relationship between a first terminal and a local media sharing server provided by an embodiment of the present application.
  • the first terminal 621 includes a software development tool module 6211 ;
  • the local media sharing server 1100 includes a local platform sharing device 1110 , and the local platform sharing device 1110 includes a configuration module 1111 and a data pipeline 1112 .
  • the first terminal 621 directly performs message interaction with the configuration module 1111 and the data pipeline 1112 in the local media sharing server 1100 through the software development tool module 6211, so as to realize the control and sharing of multimedia data.
  • the software development tool module 6211 may be a module for sharing multimedia data based on a software development kit (Software Development Kit, SDK) interface, or a module for sharing multimedia data based on an API. It is a module for sharing multimedia data based on HDMI.
  • the function of the software development tool module 6211 above is only an example, and it can be set according to the actual situation. Other unexplained functions of the software development tool module 6211 are also protected by this application. Within the scope, it will not be repeated here.
  • the SDK may include: a collection of development tools for building application software for at least one of specific software packages, software frameworks, hardware platforms, and operating systems.
  • the application program in the first terminal 621 can be a multimedia data
  • a shared data interaction method is provided, which improves the sharing efficiency of multimedia data.
  • Fig. 12 shows a structural diagram of an exemplary hardware architecture of a computing device capable of implementing the multimedia data sharing method and apparatus according to the embodiments of the present application.
  • a computing device 1200 includes an input device 1201 , an input interface 1202 , a central processing unit 1203 , a memory 1204 , an output interface 1205 , and an output device 1206 .
  • the input interface 1202, the central processing unit 1203, the memory 1204, and the output interface 1205 are connected to each other through the bus 1207, and the input device 1201 and the output device 1206 are respectively connected to the bus 1207 through the input interface 1202 and the output interface 1205, and then communicate with other components of the computing device 1200. Component connections.
  • the input device 1201 receives input information from the outside, and transmits the input information to the central processing unit 1203 through the input interface 1202; the central processing unit 1203 processes the input information based on computer-executable instructions stored in the memory 1204 to generate output information, temporarily or permanently store the output information in the memory 1204, and then transmit the output information to the output device 1206 through the output interface 1205; the output device 1206 outputs the output information to the outside of the computing device 1200 for use by the user.
  • the computing device shown in FIG. 12 may be implemented as an electronic device that may include: a memory configured to store a computer program; and a processor configured to execute the computer program stored in the memory, To execute the above multimedia data sharing method.
  • the computing device shown in FIG. 12 can be implemented as a multimedia data sharing system, and the multimedia data sharing system can include: a memory configured to store a computer program; and a processor configured to run The computer program stored in the memory is used to execute the above multimedia data sharing method.
  • the embodiment of the present application also provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the above multimedia data sharing method is implemented.
  • Computer program instructions may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state setting data, or source code written in any combination of one or more programming languages or object code.
  • ISA instruction set architecture
  • Any logic flow block diagrams in the drawings of the present application may represent program steps, or may represent interconnected logic circuits, modules and functions, or may represent a combination of program steps and logic circuits, modules and functions.
  • Computer programs can be stored on memory.
  • the memory may be of any type suitable to the local technical environment and may be implemented using any suitable data storage technology, such as, but not limited to, read-only memory (ROM), random-access memory (RAM), optical memory devices and systems (digital versatile disc DVD or CD), etc.
  • Computer readable media may include non-transitory storage media.
  • the data processor can be of any type suitable for the local technical environment, such as but not limited to general purpose computer, special purpose computer, microprocessor, digital signal processor (DSP), application specific integrated circuit (ASIC), programmable logic device (FGPA) and processors based on multi-core processor architectures.
  • DSP digital signal processor
  • ASIC application specific integrated circuit
  • FGPA programmable logic device

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本申请提出一种多媒体数据的共享方法、一种媒体共享服务器、一种终端、一种电子设备和一种计算机可读存储介质。该多媒体数据的共享方法包括:获取多媒体数据的配置信息和共享方式(S101);依据多媒体数据的配置信息对采集到的多媒体数据进行处理,获得支持多种输出格式的待共享数据(S102);以及依据共享方式,共享待共享数据(S103)。

Description

多媒体数据的共享方法、媒体共享服务器、终端、电子设备和计算机可读存储介质
相关申请的交叉引用
本申请要求于2021年9月6日提交的中国专利申请NO.202111037892.9的优先权,该中国专利申请的内容通过引用的方式整体合并于此。
技术领域
本申请涉及数据处理技术领域,具体涉及多媒体数据的共享方法、媒体共享服务器、终端、电子设备和计算机可读存储介质。
背景技术
不同类型的数据平台对数据的采集、编码、传输和解码等各个环节都存在差异。例如,不同的多媒体数据处理服务器对多媒体数据的处理方式不同,一些多媒体数据处理服务器对应的媒体输出格式单一,无法适应用户终端的个性化需求,导致用户体验度低;并且,现有的多媒体数据传输系统通常适应范围有限(如只适用于某一种数据平台)。
公开内容
本申请实施例提供一种多媒体数据的共享方法,包括:获取多媒体数据的配置信息和共享方式;依据多媒体数据的配置信息对采集到的多媒体数据进行处理,获得支持多种输出格式的待共享数据;以及依据共享方式,共享待共享数据。
本申请实施例提供一种多媒体数据的共享方法,包括:生成多媒体数据的配置信息;以及发送多媒体数据的配置信息至媒体共享服务器,以使媒体共享服务器依据多媒体数据的配置信息对采集到的多 媒体数据进行处理,获得支持多种输出格式的待共享数据,并依据共享方式,共享待共享数据。
本申请实施例提供一种媒体共享服务器,包括:获取模块,配置为获取多媒体数据的配置信息和共享方式;处理模块,配置为依据多媒体数据的配置信息对采集到的多媒体数据进行处理,获得支持多种输出格式的待共享数据;以及共享模块,配置为依据共享方式,共享待共享数据。
本申请实施例提供一种终端,包括:至少一个应用,该应用包括生成模块和发送模块;生成模块配置为生成多媒体数据的配置信息;发送模块配置为发送多媒体数据的配置信息至媒体共享服务器,以使媒体共享服务器依据多媒体数据的配置信息对采集到的多媒体数据进行处理,获得支持多种输出格式的待共享数据,并依据共享方式,共享待共享数据。
本申请实施例提供一种电子设备,包括:一个或多个处理器;以及存储器,其上存储有一个或多个计算机程序,当所述一个或多个计算机程序被所述一个或多个处理器执行时,使得所述一个或多个处理器实现本申请实施例的多媒体数据的共享方法。
本申请实施例提供了一种计算机可读存储介质,该计算机可读存储介质存储有计算机程序,该计算机程序被处理器执行时实现本申请实施例的多媒体数据的共享方法。
关于本申请的以上实施例和其他方面以及其实现方式,在附图说明、具体实施方式和权利要求中提供更多说明。
附图说明
图1示出本申请实施例提供的一种多媒体数据的共享方法的流程示意图。
图2示出本申请实施例提供的一种多媒体数据的共享方法的流程示意图。
图3示出本申请实施例提供的一种多媒体数据的共享方法的流程示意图。
图4示出本申请实施例提供的媒体共享服务器的组成方框图。
图5示出本申请实施例提供的终端的组成方框图。
图6示出本申请实施例提供的多媒体数据的共享系统的组成方框图。
图7示出本申请实施例提供的多媒体数据的共享系统的工作方法的流程示意图。
图8示出本申请实施例提供的本地平台共享装置的组成方框图。
图9示出本申请实施例提供的第一终端与本地媒体共享服务器之间的一种连接关系方框图。
图10示出本申请实施例提供的第一终端与本地媒体共享服务器之间的一种连接关系方框图。
图11示出本申请实施例提供的第一终端与本地媒体共享服务器之间的一种连接关系方框图。
图12示出能够实现根据本申请实施例的多媒体数据的共享方法和装置的计算设备的示例性硬件架构的结构图。
具体实施方式
为使本申请的目的、技术方案和优点更加清楚明白,下文中将结合附图对本申请的实施例进行详细说明。需要说明的是,在不冲突的情况下,本申请中的实施例及实施例中的各特征可以相互任意组合。
图1示出本申请实施例提供的一种多媒体数据的共享方法的流程示意图。该多媒体数据的共享方法可应用于媒体共享服务器。如图1所示,本申请实施例中的多媒体数据的共享方法可以包括步骤S101至S103。
步骤S101,获取多媒体数据的配置信息和共享方式。
多媒体数据的配置信息能够反应终端的需求信息,即终端期望获取到的多媒体数据的格式或类型等。共享方式表征多媒体数据在终端与当前的媒体共享服务器之间的传输方式。
通过获取多媒体数据的配置信息,能够反应不同的终端对不同类型的多媒体数据的需求信息,使媒体共享服务器能够更具针对性地 为不同的终端提供合适的多媒体数据,满足不同终端的个性化需求。
步骤S102,依据多媒体数据的配置信息对采集到的多媒体数据进行处理,获得支持多种输出格式的待共享数据。
多媒体数据可以是通过数据采集设备采集到的数据,例如,图像数据和/或视频数据等。
通过多媒体数据的配置信息,对图像数据和/或视频数据进行处理,能够获得不同传输格式或不同显示格式的待共享数据。例如,该待共享数据可以包括:对原始图像处理后的基于红绿蓝(Red Green Blue,RGB)色彩模式的数据(即RGB数据)、YUV数据、对原始视频数据处理后的剪辑视频文件和视频图像中的至少一种。
需要说明的是,RGB和YUV都是色彩空间,用于表示颜色。两者可以相互转化。YUV中的“Y”表示明亮度,即灰阶值;而“U”和“V”表示的则是影像色彩及饱和度,用于指定像素的颜色。RGB色彩模式是工业界的一种颜色标准,是通过对红(R)、绿(G)、蓝(B)三个颜色通道的变化以及它们相互之间的叠加来得到各式各样的颜色。
步骤S103,依据共享方式,共享待共享数据。
共享方式可以包括多种传输方式,或多种数据访问方式。
通过多种传输方式或多种数据访问方式,将待共享数据与多个终端或多个网络设备进行共享,能够使待共享数据被多个用户使用,扩大待共享数据的共享范围。
在本申请实施例提供的多媒体数据的共享方法中,通过获取多媒体数据的配置信息和共享方式,可明确终端所需的多媒体数据、以及该多媒体数据的共享方式,为终端准备适合的多媒体数据;依据多媒体数据的配置信息对采集到的多媒体数据进行处理,获得支持多种输出格式的待共享数据,避免数据的输出格式单一的问题,满足终端的个性化需求,提升用户的使用体验;以及通过多种共享方式,共享待共享数据,扩大待共享数据的共享范围。
本申请实施例还提供了一种实现方式,上述的共享方式包括:以接口的方式共享;步骤S103可采用如下方式实现:获取信令接口和数据管道的接口;以及依据信令接口和数据管道的接口,获取并共 享待共享数据。
数据管道是依据多媒体数据的类别确定的管道,信令接口是用于传输数据管道的配置信息的接口。
通过信令接口,能够获知数据管道具体适合传输的待共享数据的数据类型,在待共享数据的数据类型确定的情况下,采用与该数据类型对应的数据管道,传输该待共享数据,能够提升待共享数据的分享效率。
例如,接口可以包括:应用编程接口(Application Programming Interface,API),和/或,高清晰度多媒体接口(High Definition Multimedia Interface,HDMI)。通过API和/或HDMI来分享待共享数据,可以提升待共享数据的分享速度,加快终端获取该待共享数据的速度,提升用户的使用体验。
在一些实施方式中,所述依据信令接口和数据管道的接口,获取并共享待共享数据包括:依据信令接口,获取数据管道的工作状态和数据管道的接口标识;以及在确定数据管道的工作状态为开启状态的情况下,依据数据管道的接口标识,获取并共享待共享数据。
数据管道的工作状态包括:开启状态或关闭状态。在确定数据管道的工作状态为开启状态的情况下,该数据管道可以用于传输待共享数据;在确定数据管道的工作状态为关闭状态的情况下,该数据管道不能传输待共享数据。
数据管道的接口标识与该数据管道能够传输的待共享数据的数据类型相关。例如,数据管道的接口标识为“A01”,则表示该数据管道可以传输数据类型为“A”的待共享数据,“01”表示数据管道的编号。
通过数据管道的工作状态和数据管道的接口标识,能够明确待共享数据进行传输具体所使用的数据管道,使不同数据类型的待共享数据都可以通过对应的数据管道进行共享,加快待共享数据的共享速度。
本申请实施例还提供了一种实现方式,上述的共享方式还包括:以内部组网的方式共享;步骤S103可采用如下方式实现:与至少一 个应用建立数据通道;以及使用数据通道,与应用共享待共享数据。
应用是与当前服务器之间存在通信连接的数据需求方。该应用可以是运行在终端上的应用程序,也可以是运行在其他数据使用设备上的应用程序。
例如,应用可以与当前服务器之间建立基于套接字的通信连接,应用通过套接字发送数据请求消息,当前服务器通过套接字将数据响应消息反馈至应用,以实现应用与当前服务器之间的消息交互,进而完成待共享数据的共享。
通过与至少一个应用建立数据通道,使多个应用与当前服务器之间建立数据通信网络,在该数据通信网络内,使用数据通道,实现待共享数据的共享,使多个应用都能够获得当前服务器的数据服务,扩展了待共享数据的共享范围。
本申请实施例还提供了一种实现方式,上述的共享方式还包括:以共享内存的方式共享;步骤S103可采用如下方式实现:与应用进行数据同步;以及在确定数据同步完成的情况下,依据与应用相连接的共享内存,与应用共享待共享数据。
应用是与当前服务器之间存在通信连接的数据需求方。共享内存可以是在当前服务器的存储空间中开辟出的单独的存储空间,该共享内存专门用于当前服务器与应用之间的待共享数据的共享。共享内存也可以是独立的存储寄存器,并且应用和当前服务器均能够访问该存储寄存器,以实现待共享数据的共享。
需要说明的是,应用和当前服务器只有先进行数据同步,才能使应用获取到的待共享数据与当前服务器发布的待共享数据保持一致,以避免待共享数据出现共享偏差,导致待共享数据的共享错误。
本申请实施例还提供了一种实现方式,上述的共享方式还包括:组群共享;步骤S103可采用如下方式实现:获取群组管理装置中的组群的数据需求信息;依据组群的数据需求信息,从待共享数据中选取与组群对应的定制数据;以及发送定制数据至群组管理装置,以供群组管理装置将定制数据共享给组群中的多个终端。
群组管理装置配置为构建多个组群,每个组群中的多个终端具 有相同的数据需求。
通过建立组群,使多个具有相同数据需求的终端能够通过组群实时获得待共享数据,提升待共享数据的分享速度。并且,组群能够使多个处于不同位置的终端同时获得待共享数据,减少了待共享数据的传输时延,不仅保证了待共享数据的准确性,还提升了待共享数据的传输速度。
图2示出本申请实施例提供的一种多媒体数据的共享方法的流程示意图。该多媒体数据的共享方法可应用于媒体共享服务器。如图2所示,本申请实施例中的多媒体数据的共享方法可以包括步骤S201至S205。
步骤S201,获取多媒体数据的配置信息和共享方式。
多媒体数据的配置信息包括:编码方式。该编码方式可以包括:预测编码、变换编码、量化编码、子带编码和基于预设协议的编码中的至少一种。
上述预设协议可以包括:H.261协议、H.265协议和H.264协议中的至少一种。
步骤S202,对多媒体数据进行预处理,获得预处理数据。
对多媒体数据进行预处理可以是对原始的多媒体数据进行数据筛选,以确定多媒体数据的数据类型;还可以是对原始的多媒体数据进行排序,以确定多媒体数据的先后顺序;还可以是对原始的多媒体数据进行审核,以获得完整准确的多媒体数据等。以上对于对多媒体数据进行预处理的方式仅是举例说明,可根据实际需求进行具体设定,其他未说明的对多媒体数据进行预处理的方式也在本申请的保护范围之内,在此不再赘述。
步骤S203,依据编码方式对预处理数据进行编码,生成编码后的数据。
基于预测编码、变换编码、量化编码、子带编码和基于预设协议的编码中的至少一种编码方式,对预处理数据进行编码,能够获得不同编码格式的数据(即,编码后的数据),使编码后的数据可以适应多种终端的不同需求,以避免数据输出格式的单一性。
预测编码是根据离散信号之间存在着一定关联性的特点,利用前面一个或多个信号预测下一个信号;然后,对实际值和预测值之间的差(即预测误差)进行编码。如果预测值越趋近于实际值,则预测误差越小。在同等精度要求的条件下,可以用较少的比特进行编码,以实现数据的压缩。
变换编码是从频域的角度减小图像信号的空间相关性,在降低数码率等方面,可以获得和预测编码相近的效果。
量化是指将信号的连续取值近似为有限多个离散值,或,将大量可能的离散取值近似为较少的离散值的过程。而量化编码,能够实现对图像中的突出的物体进行定位的效果,以加快图像处理。
子带编码(Subband Coding,SBC)是一种以信号频谱为依据的编码方法,即将信号分解成不同频带分量来去除信号相关性,再将分量分别进行取样、量化、编码,从而得到一组互不相关的码字,然后将这些码字合并在一起,形成子带编码结果。因不同频带的量化噪声都被束缚在本频带内,可以避免能量较小的频带内的信号被其它频段中的量化噪声所掩盖,提升数据的准确性。
步骤S204,依据编码后的数据生成支持多种输出格式的待共享数据。
支持多种输出格式的待共享数据可以包括:支持预测编码后的数据、变换编码后的数据、量化编码后的数据、子带编码后的数据和基于预设协议的编码后的数据中的至少一种。并且,输出格式可以根据原始图像或原始视频数据的格式进行配置,以适应终端的个性化需求。
步骤S205,依据共享方式,共享待共享数据。
图2所示的多媒体数据的共享方法中的步骤S205与图1所示的多媒体数据的共享方法中的步骤S103相同,在此不再赘述。
在本申请实施例提供的多媒体数据的共享方法中,通过对多媒体数据进行预处理,获得预处理数据,以使预处理数据能够符合当前服务器的安全性要求,同时保证预处理数据的准确性;依据多种不同的编码方式对预处理数据进行编码,生成编码后的数据,使编码后的 数据能够支持更多的输出格式,扩展多媒体数据的共享格式;依据编码后的数据生成支持多种输出格式的待共享数据,能够满足终端的个性化需求,提升终端的使用体验。通过多种传输方式或多种数据访问方式,将待共享数据与多个终端或多个网络设备进行共享,能够使待共享数据可以被多个用户使用,扩大待共享数据的共享范围。
本申请实施例还提供了一种实现方式,上述的多媒体数据的配置信息还包括:缩放标识,缩放标识用于表征是否对多媒体数据进行缩放处理。步骤S202可采用如下方式实现:
在确定缩放标识表征对多媒体数据进行缩放处理的情况下,依据预设缩放算法,对多媒体数据进行数据缩放,获得缩放后的数据;以及依据缩放后的数据生成预处理数据。
预设缩放算法包括:平滑缩放、快速缩放、等比缩放和补黑边缩放中的至少一种。
平滑缩放是基于原始图像的帧率或分辨率,对原始图像进行处理,以使缩放后的数据能够平滑过渡,减少图像的损失。快速缩放是采用预设缩放速度,实现对原始图像的快速剪辑。
等比缩放是将多媒体数据按照预设比例(例如,50%等)进行缩小或放大的方式,使缩放后的数据可以满足终端的需求。
补黑边缩放,是在多媒体数据(例如,某个人物图像等)的边界处添加黑边,以保证该人物图像的完整性;或,使用预设的带有黑色编辑的框图对原始的图像进行剪辑的缩放方法。可突出图像的特定特点,以实现对图像的关键信息的获取。
通过多种不同类型的预设缩放算法,对多媒体数据进行缩放,能够获得多个维度的预处理数据,方便后续的数据处理,同时,扩展多媒体数据的类型。
在一些实施方式中,待共享数据包括:多媒体数据、缩放后的数据和编码后的数据中的至少一种。
缩放后的数据可以包括:多种不同维度的数据;编码后的数据可以包括:多种编码算法处理后的数据;多媒体数据可以是支持不同显示格式的图像或视频。
通过使用多媒体数据、缩放后的数据和编码后的数据中的至少一种,来表征待共享数据,扩展了待共享数据能够支持的数据格式,从多个维度来扩展待共享数据,避免数据输出格式的单一性,使该待共享数据可以支持终端的个性化需求,提升用户的使用体验。
本申请实施例还提供了一种实现方式,在执行步骤S101或步骤S201之前,还包括:采集预设平台中的多媒体数据。
预设平台支持多种不同类型的操作系统。例如,预设平台可以支持Windows系统、Linux系统、Android系统和IOS系统中的至少一种。
通过采集预设平台中的多媒体数据,使该多媒体数据能够适用于多种不同类型的操作系统,进而对该多媒体数据进行统一的数据处理方式,获得多输出格式的待共享数据,节约了硬件成本,同时提升了多媒体数据的适用范围,扩展了待共享数据的共享范围。
图3示出本申请实施例提供的一种多媒体数据的共享方法的流程示意图。该多媒体数据的共享方法可应用于终端。如图3所示,本申请实施例中的多媒体数据的共享方法可以包括步骤S301和S302。
步骤S301,生成多媒体数据的配置信息。
多媒体数据可以包括:图像数据、视频数据和语音数据中的至少一种。
多媒体数据的配置信息能够反应终端的需求信息,即终端期望获取到的多媒体数据的格式或类型等。该配置信息可以包括编码方式,和/或,缩放标识。缩放标识用于表征是否对多媒体数据进行缩放处理。
在一些实施方式中,所述生成多媒体数据的配置信息包括:依据多媒体数据的属性信息,生成多媒体数据的配置信息。
多媒体数据的属性信息包括:图像格式信息、分辨率信息、码率信息和帧率信息中的至少一种。
例如,图像格式信息可以包括:RGB格式、YUV格式和基于预设协议的图像格式(例如,基于H.264协议的图像数据等)中的至少一种。
通过多媒体数据的不同维度的属性信息,生成多媒体数据的配置信息,能够反应终端对不同类型的多媒体数据的需求信息,使媒体共享服务器能够更具针对性地为当前终端提供合适的多媒体数据,满足当前终端的个性化需求。
步骤S302,发送多媒体数据的配置信息至媒体共享服务器。
媒体共享服务器在获得该多媒体数据的配置信息的情况下,依据多媒体数据的配置信息对采集到的多媒体数据进行处理,获得支持多种输出格式的待共享数据,并依据共享方式,共享待共享数据。
共享方式可以是依据当前终端与媒体共享服务器之间的连接关系确定的数据共享方式。例如,当前终端可以通过接口的方式进行多媒体数据的共享;也可以通过内部组网的方式进行多媒体数据的共享;还可以通过共享内存的方式共享和/或组群共享的方式,进行多媒体数据的共享。
在本申请实施例提供的多媒体数据的共享方法中,通过依据多媒体数据的不同维度的属性信息,生成并发送多媒体数据的配置信息至媒体共享服务器,以使媒体共享服务器能够依据多媒体数据的配置信息对采集到的多媒体数据进行处理,获得支持多种输出格式的待共享数据,以满足当前终端的个性化需求;并基于多种不同类型的共享方式,使媒体共享服务器与当前终端可以共享待共享数据,进一步地,也可以使媒体共享服务器将待共享数据分享给其他终端设备,扩展了数据共享的范围。
下面结合附图,详细介绍根据本申请实施例的媒体共享服务器。图4示出本申请实施例提供的媒体共享服务器的组成方框图。如图4所示,该媒体共享服务器400包括获取模块401、处理模块402及共享模块403。
获取模块401配置为获取多媒体数据的配置信息和共享方式;处理模块402配置为依据多媒体数据的配置信息对采集到的多媒体数据进行处理,获得支持多种输出格式的待共享数据;共享模块403配置为依据共享方式,共享待共享数据。
在一些实施方式中,上述共享方式包括:以接口的方式共享; 共享模块403具体配置为:获取信令接口和数据管道的接口,数据管道是依据多媒体数据的类别确定的管道,信令接口用于传输数据管道的配置信息;以及依据信令接口和数据管道的接口,获取并共享待共享数据。
在一些实施方式中,所述依据信令接口和数据管道的接口,获取并共享待共享数据包括:依据信令接口,获取数据管道的工作状态和数据管道的接口标识;以及在确定数据管道的工作状态为开启状态的情况下,依据数据管道的接口标识,获取并共享多媒体数据。
在一些实施方式中,上述共享方式还包括:以内部组网的方式共享;共享模块403具体配置为:与至少一个应用建立数据通道,应用是与当前服务器之间存在通信连接的数据需求方;以及使用数据通道,与应用共享待共享数据。
在一些实施方式中,上述共享方式还包括:以共享内存的方式共享;共享模块403具体配置为:与应用进行数据同步,应用是与当前服务器之间存在通信连接的数据需求方;以及在确定数据同步完成的情况下,依据与应用相连接的共享内存,与应用共享待共享数据。
在一些实施方式中,上述共享方式还包括:组群共享;共享模块403具体配置为:获取群组管理装置中的组群的数据需求信息,群组管理装置配置为构建多个组群,每个组群中的多个终端具有相同的数据需求;依据组群的数据需求信息,从待共享数据中选取与组群对应的定制数据;以及发送定制数据至群组管理装置,以供群组管理装置将定制数据共享给组群中的多个终端。
在一些实施方式中,上述多媒体数据的配置信息包括:编码方式;处理模块402具体配置为:对多媒体数据进行预处理,获得预处理数据;依据编码方式对预处理数据进行编码,生成编码后的数据;以及依据编码后的数据生成支持多种输出格式的待共享数据。
在一些实施方式中,上述多媒体数据的配置信息还包括:缩放标识,缩放标识用于表征是否对多媒体数据进行缩放处理;所述对多媒体数据进行预处理,获得预处理数据包括:在确定缩放标识表征对多媒体数据进行缩放处理的情况下,依据预设缩放算法,对多媒体数 据进行数据缩放,获得缩放后的数据;以及依据缩放后的数据生成预处理数据。
在一些实施方式中,预设缩放算法包括:平滑缩放、快速缩放、等比缩放和补黑边缩放中的至少一种。
在一些实施方式中,编码方式包括:预测编码、变换编码、量化编码、子带编码和基于预设协议的编码中的至少一种。
在一些实施方式中,待共享数据包括:多媒体数据、缩放后的数据和编码后的数据中的至少一种。
在一些实施方式中,媒体共享服务器400还包括:采集模块,配置为采集预设平台中的多媒体数据;预设平台支持多种不同类型的操作系统。
在本申请提供的媒体共享服务器400中,通过获取模块401获取多媒体数据的配置信息和共享方式,可明确终端所需的多媒体数据,以及该多媒体数据的共享方式,为终端准备适合的多媒体数据;使用处理模块402依据多媒体数据的配置信息对采集到的多媒体数据进行处理,获得支持多种输出格式的待共享数据,避免数据的输出格式单一的问题,满足终端的个性化需求,提升用户的使用体验;使用共享模块403通过多种共享方式,共享待共享数据,扩大待共享数据的共享范围。
图5示出本申请实施例提供的终端的组成方框图。如图5所示。该终端500包括生成模块501和发送模块502。生成模块501配置为生成多媒体数据的配置信息;发送模块502配置为发送多媒体数据的配置信息至媒体共享服务器,以使媒体共享服务器依据多媒体数据的配置信息对采集到的多媒体数据进行处理,获得支持多种输出格式的待共享数据,并依据共享方式,共享待共享数据。
在一些实施方式中,生成模块501具体配置为依据多媒体数据的属性信息,生成多媒体数据的配置信息;多媒体数据的属性信息包括:图像格式信息、分辨率信息、码率信息和帧率信息中的至少一种。
在本申请实施例提供的终端500中,通过生成模块501依据多媒体数据的不同维度的属性信息,生成多媒体数据的配置信息;使用 发送模块502发送多媒体数据的配置信息至媒体共享服务器,以使媒体共享服务器能够依据多媒体数据的配置信息对采集到的多媒体数据进行处理,获得支持多种输出格式的待共享数据,以满足当前终端的个性化需求;并基于多种不同类型的共享方式,使媒体共享服务器与当前终端可以共享待共享数据,进一步地,也可以使媒体共享服务器将待共享数据分享给其他终端设备,扩展了数据共享的范围。
需要明确的是,本申请并不局限于实施例中所描述并在图中示出的特定配置和处理。为了描述的方便和简洁,这里省略了对已知方法的详细描述,并且上述描述的系统、模块和单元的具体工作过程,可以参考前述的对应过程,在此不再赘述。
图6示出本申请实施例提供的多媒体数据的共享系统的组成方框图。如图6所示,该多媒体数据的共享系统包括如下设备:媒体共享服务器610、第一终端621、第二终端622、群组管理系统630和通用基础平台640。
媒体共享服务器610包括:本地媒体共享服务器611和网络媒体共享服务器612。本地媒体共享服务器611包括:缩放装置6111、本地平台共享装置6112、编码装置6113和本地共享统一接口模块6114。网络媒体共享服务器612包括:网络平台共享装置6121和网络共享统一接口模块6122。
第一终端621和第二终端622中都可以安装多个应用程序,第一终端621和第二终端622均可以包括:媒体播放器、对象存储设备和其他以接口方式连接的设备(例如,以HDMI接口相连接的设备等)中的至少一种。以上对于终端的类型仅是举例说明,其他未说明的终端的类型也在本申请的保护范围之内,可根据具体情况具体设定,在此不再赘述。
群组管理系统630包括:群组管理装置631和群组转发装置632。
通用基础平台640包括:多台数据采集设备(例如,本地数据采集设备6411和外部数据采集设备6412等)和预设操作系统642,该预设操作系统642支持多种不同类型的操作系统(例如,支持Windows系统、Linux系统、Android系统和IOS系统中的至少一种)。
第一终端621或第二终端622配置为通过发送多媒体数据的配置信息至本地媒体共享服务器610,以使媒体共享服务器610能够通过本地共享统一接口模块6114,或,网络共享统一接口模块6122为终端提供多媒体数据。
多媒体数据的配置信息可以包括:设置视频图像的参数(例如,视频分辨率、视频类型、视频格式和编码方式中的至少一种)。多媒体数据可以包括:原始视频图像、经过缩放处理的视频图像和经过混合编码处理的视频图像中的至少一种。例如,多媒体数据可以包括:原始图像(例如,RGB图像等)和采用视频编解码技术(例如,基于协议H.264或协议H.265协议等)进行处理后的数据。
通用基础平台640配置为采集图像数据,以及对图像数据进行转码等。通用基础平台640对外提供统一接口,传输RGB数据或YUV数据。通用基础平台640对内对接预设操作系统642、以及不同的图像采集设备(例如,本地数据采集设备6411和外部数据采集设备6412等),并将采集到的特殊格式数据转换为通用的RGB数据或YUV数据。
YUV数据是一种用亮度分量(Y分量)和色度分量(U分量和V分量)一起表示的视频格式的数据,根据Y分量、U分量和V分量之间比例的不同,YUV数据可以包括:YUV444格式的数据、YUV422格式的数据和YUV420格式的数据中的至少一种。
不同的图像采集设备都具有独立的图像采集接口,并且图像采集设备都支持多种不同的数据格式(例如,RGB24格式的数据、YUV444格式的数据和YUV420格式的数据中的至少一种)。
缩放装置6111配置为基于多种不同的缩放算法(例如,平滑缩放、快速缩放、等比缩放和补黑边缩放中的至少一种),根据终端的需求,将获取到的图像数据缩放成预设分辨率的数据(即缩放后的数据),并将该缩放后的数据通过本地共享统一接口模块6114共享给网络中的其他设备(例如,第一终端621或网络媒体共享服务器612等)。
本地平台共享装置6112配置为对多媒体数据进行参数的配置,以及数据的分类和共享等业务。
编码装置6113配置为基于多种不同的编码方式(例如,预测编码、变换编码、量化编码、子带编码和基于预设协议的编码中至少一种)对缩放装置6111输入的缩放后的数据(或,通用基础平台640中的各个数据采集设备输入的原始数据)进行编码,生成编码后的数据。基于预设协议的编码可以是基于动态图像专家组(Moving Picture Experts Group,MPEG)的混合编码、基于H.261协议(或H.265协议,或H.264协议等)的编码和图像专家联合小组(Joint Photographic Experts Group,JPEG)的混合编码中的至少一种。
本地共享统一接口模块6114配置为向网络中的其他设备提供统一的接口数据。例如,通过以下共享方式中的至少一种,来为网络中的其他设备提供待共享数据:
基于共享内存的方式、基于磁盘文件读写的方式、基于本地设备内部进行组网的方式和基于接口的方式(例如,基于API进行多媒体数据的共享的模块,或基于HDMI进行多媒体数据的共享的模块等)
网络平台共享装置6121配置为将本地共享统一接口模块6114输出的待共享数据进行封装,获得封装数据,该封装数据可以包括:自定义格式的数据包,或,基于实时数据传输协议(Real-time Transport Protocol,RTP)的数据包。
网络共享统一接口模块6122包括信令通道和媒体通道。信令通道用于与外部设备(例如,群组管理系统630,或,第二终端622等)进行待共享数据的交互。
媒体通道配置为将待共享数据通过套接字的方式(例如,与外部设备建立基于用户数据报协议(User Datagram Protocol,UDP)或,基于传输控制协议(Transmission Control Protocol,TCP)的会话连接)共享至群组管理系统630,或,第二终端622。待共享数据包括:原始的多媒体数据、缩放后的数据和编码后的数据中的至少一种。
群组管理系统630,是多个终端共享的基础系统。群组管理装置631配置为管理远程设备(例如,第二终端622)与群组管理装置631之间的通信链路,将需要相同待共享数据的终端对应的通信链路存储 在同一个群组中,便于待共享数据的实时共享。
群组转发装置632配置为将不同的群组所需的定制数据,分发至不同类型的群组传输通道中,以使同一群组中的所有终端可以实时共享该群组中的待共享数据。
图7示出本申请实施例提供的多媒体数据的共享系统的工作方法的流程示意图。如图7所示,该多媒体数据的共享系统的工作方法,包括步骤S701至S709。
步骤S701,第一终端621根据需求的多媒体数据的属性信息,生成需求的多媒体数据的配置信息,并发送该配置信息至本地媒体共享服务器611中的本地共享统一接口模块6114。
多媒体数据的属性信息包括:图像格式信息、分辨率信息、码率信息和帧率信息中的至少一种。多媒体数据的配置信息可以包括,编码方式,和/或,缩放标识。缩放标识用于表征是否需要对多媒体数据进行缩放处理。
步骤S702,本地媒体共享服务器611中的本地共享统一接口模块6114将多媒体数据的配置信息发送至本地平台共享装置6112,以使本地平台共享装置6112保存该配置信息;并基于该配置信息,获取通用基础平台640中的各个图像采集设备采集的多媒体数据,和/或,获取经过缩放装置6111处理后的缩放后的数据。
多媒体数据可以是通过各个图像采集设备采集到的图像数据、或屏幕桌面图像等。缩放后的数据是缩放装置6111使用预设缩放算法对通用基础平台640中的各个图像采集设备采集的多媒体数据进行缩放处理生成的数据。
缩放装置6111支持多种不同的缩放算法,例如,平滑缩放、快速缩放、等比缩放和补黑边缩放中的至少一种。
步骤S703,本地媒体共享服务器611中的本地平台共享装置6112将缩放后的数据输出至编码装置6113,以使编码装置6113对缩放后的数据进行编码,生成编码后的数据;并将该编码后的数据输出至本地共享统一接口模块6114。
例如,第一终端621中的多媒体数据配置信息不仅包括编码方 式,还包括缩放标识,该缩放标识表征是否需要对多媒体数据进行缩放处理;则本地共享统一接口模块6114需要获取编码装置6113输入的编码后的数据(例如,基于H.264协议的数据);还需要获取本地平台共享装置6112输入的缩放后的数据。
步骤S704,本地共享统一接口模块6114将待共享数据共享给第一终端621,或,将待共享数据进一步传递给网络媒体共享服务器612。
具体地,待共享数据可包括:缩放后的数据和编码后的数据。
步骤S705,本地媒体共享服务器611中的本地平台共享装置6112发送停止采集消息至通用基础平台640,以使通用基础平台640中的各个数据采集设备停止采集多媒体数据,同时,清空缓存,以方便下次的多媒体数据的采集。
步骤S706,网络媒体共享服务器612中的网络平台共享装置6121将待共享数据进行封装,生成RTP数据包或自定义格式的数据包后,发送RTP数据包或自定义格式的数据包至网络媒体共享服务器612中的网络共享统一接口模块6122。
步骤S707,网络媒体共享服务器612中的网络共享统一接口模块6122转发该RTP数据包或自定义格式的数据包至群组管理系统630。
步骤S708,群组管理系统630将待共享数据共享给第二终端622。
需要说明的是,第二终端622可以包括:终端、应用程序、媒体播放器、对象存储设备和其他以接口方式连接的设备中的至少一种。
步骤S709,第二终端622将获取到的待共享数据进行存储或播放。
在本申请实施例提供的多媒体的共享系统及多媒体数据共享系统的工作流程中,通过本地媒体共享服务器611对获取到的多媒体数据进行不同方式的处理(例如,对多媒体数据进行缩放处理,或将缩放后的数据进行编码处理等),仅对多媒体数据进行一次处理,即可获得多种不同输出格式的待共享数据(例如,原始的多媒体数据、缩放后的数据和编码后的数据中的至少一种),能够避免数据的输出格式单一的问题,满足终端的个性化需求,提升用户的使用体验;并且, 通用基础平台640可以支持多种不同类型的操作系统,能够使不同类型的操作系统使用统一的数据处理方式,获得多输出格式的待共享数据,节约了硬件成本;通过群组管理系统630能够实现与网络媒体共享服务器612之间的数据共享,并使不同群组中的多个终端用户能够实时共享本群组中的待共享数据,实现了跨地区的数据实时共享,扩展了待共享数据的共享范围。
本申请实施例还提供了一种实现方式,图6中的本地平台共享装置6112可以采用如图8所示的方式实现。
图8示出本申请实施例提供的本地平台共享装置的组成方框图。如图8所示,该本地平台共享装置800包括配置模块810、第一数据管道821、第二数据管道822、……、第N数据管道82N。N表示数据管道的数量,N为大于或等于1的整数。
具体地,配置模块810可通过信令接口830来实现对多个数据管道的控制,即信令接口830中的信令用于控制每个数据管道的管道开关的开启和闭合。
每个数据管道都包括一个管道开关,该管道开关配置为控制数据管道的开启和关闭。例如,第一数据管道821包括第一管道开关8211;第二数据管道822包括第二管道开关8221;……;第N数据管道82N包括第N管道开关82N1等。
例如,上层模块(例如,本地共享统一接口模块6114)将配置信息输入配置模块810;配置信息可以是基于图像格式信息、分辨率信息、码率信息和帧率信息中的至少一种进行设置的信息。
然后,配置模块810根据图像格式信息等,选择目标数据管道(例如,第二数据管道822),并发送指示开启第二数据管道822的信令消息至信令接口830,以开启第二管道开关8221,使底层上传的、与配置信息相匹配的多媒体数据,可以通过第二管道开关8221共享给多个终端。
第二数据管道822在进行多媒体数据的共享的过程中,会根据数据管道的拥塞状态,来确定上报的多媒体数据的流量,避免数据管道发送数据拥塞。
在确定第二数据管道822完成多媒体数据的共享的情况下,配置模块810会下发关闭指令至信令接口830,以关闭该第二管道开关8221,方便后续的数据处理(例如,响应下一个终端的数据共享请求等)。
在本申请实施例提供的本地平台共享装置800中,通过采用多数据管道的方式,实现对多种不同类型的多媒体数据的区分;使底层装置(例如,多种不同的数据采集设备,或,缩放装置6111等)上传的多媒体数据能够按照多媒体数据的类别,分别送入多个不同的数据管道中,加快了多媒体数据的共享速度。
图9示出本申请实施例提供的第一终端与本地媒体共享服务器之间的一种连接关系方框图。
如图9所示,本地媒体共享服务器900包括本地平台共享装置910,本地平台共享装置910包括:套接字建立模块911、配置模块912和数据管道913。
套接字建立模块911配置为实现第一终端621与本地平台共享装置910之间的通信连接,以使第一终端621与本地媒体共享服务器911之间能够基于套接字的方式进行消息交互。
在确定套接字建立模块911已成功建立第一终端621与本地平台共享装置910之间的通信连接的情况下,可使第一终端621与本地平台共享装置910之间能够通过网络消息交互的方式,实现第一终端621对多媒体数据的配置信息的更新,并使第一终端621可以直接获得数据管道913所提供的多媒体数据。
在一些实施方式中,套接字建立模块911还可以实现与多个终端(或多个应用)之间的通信连接的建立,从而使本地媒体共享服务器900可以同时为多个终端(或多个应用)提供多媒体数据的共享服务。以实现多媒体数据的多路并发,提升多媒体数据的共享系统的兼容性。
图10示出本申请实施例提供的第一终端与本地媒体共享服务器之间的一种连接关系方框图。
如图10所示,第一终端621与共享内存模块1020相连接,并 且,该共享内存模块1020同时还与本地媒体共享服务器1010相连接。
具体地,本地平台共享装置1011中的配置模块10111和数据管道10112分别通过共享内存模块1020实现与第一终端621之间的多媒体数据的共享。
例如,配置模块10111通过访问共享内存模块1020,可直接获得第一终端621对多媒体数据的配置信息;第一终端621通过访问共享内存模块1020能够直接获取数据通道10112中的多媒体数据。
需要说明的是,在使用共享内存模块1020之前,还需要在第一终端621和本地媒体共享服务器1010之间实现数据同步,以提升数据的可靠性。
通过第一终端621和本地媒体共享服务器1010共同读写同一共享内存模块1020,能够实现多媒体数据的共享操作,提升多媒体数据的共享效率。
图11示出本申请实施例提供的第一终端与本地媒体共享服务器之间的一种连接关系方框图。
如图11所示,第一终端621包括软件开发工具模块6211;本地媒体共享服务器1100包括本地平台共享装置1110,本地平台共享装置1110包括配置模块1111和数据管道1112。
具体地,第一终端621通过软件开发工具模块6211直接与本地媒体共享服务器1100中的配置模块1111和数据管道1112进行消息交互,以实现对多媒体数据的控制和共享。
需要说明的是,软件开发工具模块6211可以是基于软件开发工具包(Software Development Kit,SDK)接口的方式进行多媒体数据的共享的模块,也可以是基于API进行多媒体数据的共享的模块,还可以是基于HDMI进行多媒体数据的共享的模块,以上对于软件开发工具模块6211的功能仅是举例说明,可根据实际进行具体设定,其他未说明的软件开发工具模块6211的功能也在本申请的保护范围之内,在此不再赘述。
SDK可以包括:为特定的软件包、软件框架、硬件平台和操作系统中的至少一种建立应用软件时的开发工具的集合。
在本申请实施例提供的第一终端与本地媒体共享服务器之间的连接关系中,通过将软件开发工具模块6211集成到第一终端621中,能够使第一终端621中的应用程序为多媒体数据提供共享的数据交互方式,提升了多媒体数据的共享效率。
图12示出能够实现根据本申请实施例的多媒体数据的共享方法和装置的计算设备的示例性硬件架构的结构图。
如图12所示,计算设备1200包括输入设备1201、输入接口1202、中央处理器1203、存储器1204、输出接口1205、以及输出设备1206。输入接口1202、中央处理器1203、存储器1204、以及输出接口1205通过总线1207相互连接,输入设备1201和输出设备1206分别通过输入接口1202和输出接口1205与总线1207连接,进而与计算设备1200的其他组件连接。
具体地,输入设备1201接收来自外部的输入信息,并通过输入接口1202将输入信息传送到中央处理器1203;中央处理器1203基于存储器1204中存储的计算机可执行指令对输入信息进行处理以生成输出信息,将输出信息临时或者永久地存储在存储器1204中,然后通过输出接口1205将输出信息传送到输出设备1206;输出设备1206将输出信息输出到计算设备1200的外部,供用户使用。
在一些实施方式中,图12所示的计算设备可以被实现为一种电子设备,该电子设备可以包括:存储器,配置为存储计算机程序;以及处理器,配置为运行存储器中存储的计算机程序,以执行上述的多媒体数据的共享方法。
在一些实施方式中,图12所示的计算设备可以被实现为一种多媒体数据的共享系统,该多媒体数据的共享系统可以包括:存储器,配置为存储计算机程序;以及处理器,被配置为运行存储器中存储的计算机程序,以执行上述的多媒体数据的共享方法。
本申请实施例还提供了一种计算机可读存储介质,该计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时实现上述的多媒体数据的共享方法。
以上所述,仅为本申请的示例性实施例而已,并非用于限定本 申请的保护范围。一般来说,本申请的多种实施例可以在硬件或专用电路、软件、逻辑或其任何组合中实现。例如,一些方面可以被实现在硬件中,而其它方面可以被实现在可以被控制器、微处理器或其它计算装置执行的固件或软件中,尽管本申请不限于此。
本申请的实施例可以通过移动装置的数据处理器执行计算机程序指令来实现,例如在处理器实体中、或者通过硬件、或者通过软件和硬件的组合实现。计算机程序指令可以是汇编指令、指令集架构(ISA)指令、机器指令、机器相关指令、微代码、固件指令、状态设置数据、或者是以一种或多种编程语言的任意组合编写的源代码或目标代码。
本申请附图中的任何逻辑流程的框图可以表示程序步骤,或者可以表示相互连接的逻辑电路、模块和功能,或者可以表示程序步骤与逻辑电路、模块和功能的组合。计算机程序可以存储在存储器上。存储器可以具有任何适合于本地技术环境的类型并且可以使用任何适合的数据存储技术实现,例如但不限于只读存储器(ROM)、随机访问存储器(RAM)、光存储器装置和系统(数码多功能光碟DVD或CD光盘)等。计算机可读介质可以包括非瞬时性存储介质。数据处理器可以是任何适合于本地技术环境的类型,例如但不限于通用计算机、专用计算机、微处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、可编程逻辑器件(FGPA)以及基于多核处理器架构的处理器。
通过示范性和非限制性的示例,上文已提供了对本申请的示范实施例的详细描述。但结合附图和权利要求来考虑,对以上实施例的多种修改和调整对本领域技术人员来说是显而易见的,但不偏离本申请的范围。因此,本申请的恰当范围将根据权利要求确定。

Claims (18)

  1. 一种多媒体数据的共享方法,包括:
    获取多媒体数据的配置信息和共享方式;
    依据所述多媒体数据的配置信息对采集到的多媒体数据进行处理,获得支持多种输出格式的待共享数据;以及
    依据所述共享方式,共享所述待共享数据。
  2. 根据权利要求1所述的方法,其中,所述共享方式包括:以接口的方式共享;
    所述依据所述共享方式,共享所述待共享数据包括:
    获取信令接口和数据管道的接口,所述数据管道是依据所述多媒体数据的类别确定的管道,所述信令接口是用于传输所述数据管道的配置信息的接口;以及
    依据所述信令接口和所述数据管道的接口,获取并共享所述待共享数据。
  3. 根据权利要求2所述的方法,其中,所述依据所述信令接口和数据管道的接口,获取并共享所述待共享数据包括:
    依据所述信令接口,获取所述数据管道的工作状态和所述数据管道的接口标识;以及
    在确定所述数据管道的工作状态为开启状态的情况下,依据所述数据管道的接口标识,获取并共享所述待共享数据。
  4. 根据权利要求1所述的方法,其中,所述共享方式还包括:以内部组网的方式共享;
    所述依据所述共享方式,共享所述待共享数据包括:
    与至少一个应用建立数据通道,其中,所述应用是与当前服务器之间存在通信连接的数据需求方;以及
    使用所述数据通道,与所述应用共享所述待共享数据。
  5. 根据权利要求1所述的方法,其中,所述共享方式还包括:以共享内存的方式共享;
    所述依据所述共享方式,共享所述待共享数据包括:
    与应用进行数据同步,其中,所述应用是与当前服务器之间存在通信连接的数据需求方;以及
    在确定所述数据同步完成的情况下,依据与所述应用相连接的共享内存,与所述应用共享所述待共享数据。
  6. 根据权利要求1所述的方法,其中,所述共享方式还包括:组群共享;
    所述依据所述共享方式,共享所述待共享数据包括:
    获取群组管理装置中的组群的数据需求信息,所述群组管理装置配置为构建多个所述组群,每个所述组群中的多个终端具有相同的数据需求;
    依据所述组群的数据需求信息,从所述待共享数据中选取与所述组群对应的定制数据;以及
    发送所述定制数据至所述群组管理装置,以供所述群组管理装置将所述定制数据共享给所述组群中的多个所述终端。
  7. 根据权利要求1至6中任一项所述的方法,其中,所述多媒体数据的配置信息包括:编码方式;
    所述依据所述多媒体数据的配置信息对采集到的多媒体数据进行处理,获得支持多种输出格式的待共享数据包括:
    对所述多媒体数据进行预处理,获得预处理数据;
    依据所述编码方式对所述预处理数据进行编码,生成编码后的数据;以及
    依据所述编码后的数据生成所述支持多种输出格式的待共享数据。
  8. 根据权利要求7所述的方法,其中,所述多媒体数据的配置信息还包括:缩放标识,其中,所述缩放标识用于表征是否对所述多媒体数据进行缩放处理;
    所述对所述多媒体数据进行预处理,获得预处理数据包括:
    在确定所述缩放标识表征对所述多媒体数据进行缩放处理的情况下,依据预设缩放算法,对所述多媒体数据进行数据缩放,获得缩放后的数据;以及
    依据所述缩放后的数据生成所述预处理数据。
  9. 根据权利要求8所述的方法,其中,所述预设缩放算法包括:平滑缩放、快速缩放、等比缩放和补黑边缩放中的至少一种。
  10. 根据权利要求7所述的方法,其中,所述编码方式包括:预测编码、变换编码、量化编码、子带编码和基于预设协议的编码中的至少一种。
  11. 根据权利要求8所述的方法,其中,所述待共享数据包括:所述多媒体数据、所述缩放后的数据和所述编码后的数据中的至少一种。
  12. 根据权利要求1至6中任一项所述的方法,还包括:
    所述获取多媒体数据的配置信息和共享方式之前,采集预设平台中的所述多媒体数据;
    其中,所述预设平台支持多种不同类型的操作系统。
  13. 一种多媒体数据的共享方法,包括:
    生成多媒体数据的配置信息;以及
    发送所述多媒体数据的配置信息至媒体共享服务器,以使所述媒体共享服务器依据所述多媒体数据的配置信息对采集到的多媒体数据进行处理,获得支持多种输出格式的待共享数据,并依据共享方 式,共享所述待共享数据。
  14. 根据权利要求13所述的方法,其中,所述生成多媒体数据的配置信息包括:
    依据所述多媒体数据的属性信息,生成所述多媒体数据的配置信息;
    其中,所述多媒体数据的属性信息包括:图像格式信息、分辨率信息、码率信息和帧率信息中的至少一种。
  15. 一种媒体共享服务器,包括:
    获取模块,配置为获取多媒体数据的配置信息和共享方式;
    处理模块,配置为依据所述多媒体数据的配置信息对采集到的多媒体数据进行处理,获得支持多种输出格式的待共享数据;以及
    共享模块,配置为依据所述共享方式,共享所述待共享数据。
  16. 一种终端,包括:至少一个应用,所述应用,包括生成模块和发送模块;
    所述生成模块配置为生成多媒体数据的配置信息;以及
    所述发送模块配置为发送所述多媒体数据的配置信息至媒体共享服务器,以使所述媒体共享服务器依据所述多媒体数据的配置信息对采集到的多媒体数据进行处理,获得支持多种输出格式的待共享数据,并依据共享方式,共享所述待共享数据。
  17. 一种电子设备,包括:
    至少一个处理器;以及
    存储器,其上存储有至少一个计算机程序,当所述至少一个计算机程序被所述至少一个处理器执行时,使得所述至少一个处理器实现如权利要求1至14中任一项所述的多媒体数据的共享方法。
  18. 一种计算机可读存储介质,所述计算机可读存储介质存储 有计算机程序,所述计算机程序被处理器执行时实现如权利要求1至14中任一项所述的多媒体数据的共享方法。
PCT/CN2022/101121 2021-09-06 2022-06-24 多媒体数据的共享方法、媒体共享服务器、终端、电子设备和计算机可读存储介质 WO2023029689A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111037892.9A CN115776513A (zh) 2021-09-06 2021-09-06 多媒体数据的共享方法、服务器和终端
CN202111037892.9 2021-09-06

Publications (1)

Publication Number Publication Date
WO2023029689A1 true WO2023029689A1 (zh) 2023-03-09

Family

ID=85387235

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/101121 WO2023029689A1 (zh) 2021-09-06 2022-06-24 多媒体数据的共享方法、媒体共享服务器、终端、电子设备和计算机可读存储介质

Country Status (2)

Country Link
CN (1) CN115776513A (zh)
WO (1) WO2023029689A1 (zh)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102098553A (zh) * 2010-12-03 2011-06-15 中国联合网络通信集团有限公司 视频传输方法、系统及视频服务器
CN202009471U (zh) * 2011-04-18 2011-10-12 北京歌华有线数字媒体有限公司 基于dvb传输的流媒体边缘适配器装置
US20120304235A1 (en) * 2010-11-22 2012-11-29 Huawei Technologies Co., Ltd. Method and system for playing video file, and media resource server
CN103780611A (zh) * 2014-01-17 2014-05-07 Tcl集团股份有限公司 一种音乐分享方法及系统
CN105472368A (zh) * 2015-11-25 2016-04-06 深圳凯澳斯科技有限公司 一种面向集群终端的立体视频直播系统
CN111093094A (zh) * 2019-12-03 2020-05-01 深圳市万佳安物联科技股份有限公司 视频转码方法、装置、系统及电子设备及可读存储介质
CN112351133A (zh) * 2019-08-07 2021-02-09 华为技术有限公司 媒体数据的分享方法及终端

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120304235A1 (en) * 2010-11-22 2012-11-29 Huawei Technologies Co., Ltd. Method and system for playing video file, and media resource server
CN102098553A (zh) * 2010-12-03 2011-06-15 中国联合网络通信集团有限公司 视频传输方法、系统及视频服务器
CN202009471U (zh) * 2011-04-18 2011-10-12 北京歌华有线数字媒体有限公司 基于dvb传输的流媒体边缘适配器装置
CN103780611A (zh) * 2014-01-17 2014-05-07 Tcl集团股份有限公司 一种音乐分享方法及系统
CN105472368A (zh) * 2015-11-25 2016-04-06 深圳凯澳斯科技有限公司 一种面向集群终端的立体视频直播系统
CN112351133A (zh) * 2019-08-07 2021-02-09 华为技术有限公司 媒体数据的分享方法及终端
CN111093094A (zh) * 2019-12-03 2020-05-01 深圳市万佳安物联科技股份有限公司 视频转码方法、装置、系统及电子设备及可读存储介质

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ZHU JIN-JIN; HU YI-LIANG: "The Construction and Development for Remote Sharing and Transmission System of Media Data", CHINA CABLE TELEVISION, XI'AN JIAOTONG DAXUE, CN, no. 10, 2 January 2014 (2014-01-02), CN , pages 1183 - 1186, XP009544179, ISSN: 1007-7022 *

Also Published As

Publication number Publication date
CN115776513A (zh) 2023-03-10

Similar Documents

Publication Publication Date Title
US11012489B2 (en) Picture file processing method, picture file processing device, and storage medium
WO2018010662A1 (zh) 视频文件的转码方法,装置及存储介质
TW201729596A (zh) 包括有影像資料之影像單位之編碼/解碼方法及裝置,影像資料係由亮度道及至少一色訊道表示
WO2019210822A1 (zh) 视频编解码方法、装置、系统及存储介质
WO2021004176A1 (zh) 一种图像处理的方法及装置
CN108881916A (zh) 远程桌面的视频优化处理方法及装置
WO2020224551A1 (zh) 一种信息压缩/解压缩方法、装置及存储介质
KR20200081386A (ko) 제1 이미지로부터 제2 이미지를 생성하기 위한 방법 및 디바이스
WO2021057097A1 (zh) 图像渲染和编码方法及相关装置
JP6980054B2 (ja) 画像データを処理する方法および装置
CN109889521A (zh) 存储器、通信通道复用实现方法、装置和设备
JP2023179591A (ja) イントラ・サブ・パーティション・コーディング・モードのための方法及び装置
JP2024520151A (ja) 特徴データ符号化および復号方法および装置
CN114786040A (zh) 数据通信方法、系统、电子设备和存储介质
US20140313327A1 (en) Processing device, integrated circuit, processing method, and recording medium
WO2023029689A1 (zh) 多媒体数据的共享方法、媒体共享服务器、终端、电子设备和计算机可读存储介质
WO2023130896A1 (zh) 媒体数据的数据处理方法、装置、计算机设备及存储介质
WO2022206016A1 (zh) 一种数据分层传输方法、装置及系统
CN104333765A (zh) 一种视频直播流的处理方法及处理装置
CN113784143A (zh) 视频转码方法、装置、电子设备和计算机可读介质
WO2016107174A1 (zh) 多媒体文件数据的处理方法及系统、播放器和客户端
CN116095262B (zh) 用于处理视频信号源的移动处理设备、处理方法及系统
US10536501B2 (en) Automated compression of data
CN113727183B (zh) 直播推流方法、装置、设备、存储介质及计算机程序产品
WO2023231710A1 (zh) 一种图片的处理方法及相关设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22862830

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE