WO2024251049A1 - 媒体数据处理方法、装置、电子设备及可读存储介质 - Google Patents

媒体数据处理方法、装置、电子设备及可读存储介质 Download PDF

Info

Publication number
WO2024251049A1
WO2024251049A1 PCT/CN2024/096773 CN2024096773W WO2024251049A1 WO 2024251049 A1 WO2024251049 A1 WO 2024251049A1 CN 2024096773 W CN2024096773 W CN 2024096773W WO 2024251049 A1 WO2024251049 A1 WO 2024251049A1
Authority
WO
WIPO (PCT)
Prior art keywords
stream
file
gain data
gain
data stream
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2024/096773
Other languages
English (en)
French (fr)
Inventor
钟南军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to EP24818581.1A priority Critical patent/EP4727151A1/en
Publication of WO2024251049A1 publication Critical patent/WO2024251049A1/zh
Priority to US19/398,400 priority patent/US20260079817A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/741Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Prevention of errors by analysis, debugging or testing of software
    • G06F11/3604Analysis of software for verifying properties of programs
    • G06F11/3608Analysis of software for verifying properties of programs using formal methods, e.g. model checking, abstract interpretation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50Control of the SSIS exposure
    • H04N25/51Control of the gain

Definitions

  • the present application belongs to the field of data processing technology, and specifically relates to a media data processing method, device, electronic device and readable storage medium.
  • a storage gain map (Gainmap) is added to the image such as JPEG.
  • the Gainmap storage method in the related art has the problem of being inconvenient to find a specified Gainmap.
  • the purpose of the embodiments of the present application is to provide a media data processing method, device, electronic device and readable storage medium, which can quickly locate the position of the gain data stream and stream description information in the media data, thereby facilitating the search of the media data.
  • an embodiment of the present application provides a method for processing media data, the method comprising:
  • the first file includes: the first media data, the gain data stream, the stream description information, a first check code associated with the gain data stream, and a second check code associated with the stream description information;
  • the first check code is used to identify the associated gain data stream in the first file; and the second check code is used to identify the associated stream description information in the first file.
  • an embodiment of the present application provides a media data processing device, the device comprising:
  • An acquisition module used to acquire first media data and a gain data stream
  • a first determining module configured to determine stream description information of the gain data stream according to the gain data stream
  • a data processing module configured to generate a first file according to the first media data, the gain data stream and the stream description information, and store the first file, wherein the first file includes: data, the gain data stream, the stream description information, a first check code associated with the gain data stream, and a second check code associated with the stream description information;
  • the first check code is used to identify the associated gain data stream in the first file; and the second check code is used to identify the associated stream description information in the first file.
  • an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.
  • an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.
  • an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.
  • an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.
  • the stream description information of each gain data stream can be found from the first file based on the second check code, and the required target gain data stream can be selected according to the stream description information, and then the target gain data stream can be found in the first file based on the first check code associated with the target gain data stream. It is not necessary to decode, identify, and other operations on all the gain data streams in the first file, and it is possible to find and read the target gain data stream from the first file.
  • FIG1 is a flow chart of a method for processing media data provided by an embodiment of the present application.
  • FIG. 2 is a schematic diagram of the architecture of a JPEG file
  • FIG3 is one of the schematic diagrams of the architecture of the first file in an embodiment of the present application.
  • FIG4 is a second schematic diagram of the structure of the first file in an embodiment of the present application.
  • FIG5 is a third schematic diagram of the structure of the first file in an embodiment of the present application.
  • FIG6 is a schematic diagram of the architecture of extended information in an embodiment of the present application.
  • FIG7 is a schematic diagram of the structure of a media data processing device provided in an embodiment of the present application.
  • FIG8 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.
  • FIG. 9 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.
  • first, second, etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first”, “second”, etc. are generally of one type, and the number of objects is not limited.
  • the first object can be one or more.
  • “and/or” in the specification and claims represents at least one of the connected objects, and the character “/" generally indicates that the objects associated with each other are in an "or” relationship.
  • the high dynamic range photo display function can be understood as an extended display function of HDR.
  • the Android system there is a unified standard for storing gainmap in JPEG-R, that is, a gainmap is stored after the JPEG data.
  • a gainmap is stored after the JPEG data.
  • the data content in the JPEG file is decoded and identified to obtain the data content of the gainmap.
  • the ISO standardization organization is also developing standards related to gainmap.
  • a new storage standard is proposed to use a check code to identify a gain data stream, including: a data stream of a Gainmap or other type of gain data, and a stream description information of the gain data stream.
  • the respectively associated stream description information can be accurately located from the stored media file (i.e., the first file)
  • the required target gain data stream can be searched, and then based on the check code associated with the target gain data stream, the target gain data stream can be accurately located from the stored media file (i.e., the first file).
  • a media data processing method provided in an embodiment of the present application may include the following steps:
  • Step 101 Obtain first media data and gain data stream.
  • the first media data may be media data such as pictures, audio, and video.
  • the first media data is usually taken as a picture, such as a JPEG picture, and is not specifically limited here.
  • the first media data is a picture generated when a shooting operation is completed.
  • the schematic diagram of the architecture of the JPEG file corresponding to the picture may be as shown in FIG. 2 .
  • the gain data stream can be used to adjust the gain of the first media data.
  • the gain data stream can be a Gainmap stream.
  • the brightness gain in the JPEG picture can be adjusted based on the Gainmap stream to achieve a high dynamic range image display function.
  • gain data stream is related to the type of the first media data.
  • gain data streams related to pictures such as Gainmap stream and watermark stream can be used; for audio, gain data streams related to audio can be used; for video, gain data streams related to video can be used.
  • the gain data stream in the first file may be a Gainmap stream in RGBA format, a Gainmap stream in YUV format, or data obtained by encoding the Gainmap stream in YUV format.
  • the media data processing method provided in the embodiment of the present application can convert the Gainmap stream from RGBA format to YUV format, and then encode the Gainmap stream in YUV format into formats such as JPEG and PNG, and add it to the picture data content in the JPEG file, that is, after JPEG DATA; alternatively, the Gainmap stream in YUV format may not be encoded, but the Gainmap stream in YUV format may be added after JPEG DATA in the JPEG file; alternatively, the Gainmap stream in RGBA format may be directly added after JPEG DATA in the JPEG file.
  • the first media data is usually a picture
  • the gain data stream is a gain data stream related to the picture, such as a Gainmap stream and a watermark stream.
  • the type of the gain data stream and the type of the first media data are not limited herein.
  • the number of the gain data streams may be one or at least two.
  • the gain data stream includes Gainmap stream and other gain streams, wherein the other gain streams may be watermark streams and other streams different from the Gainmap stream.
  • the gain data stream includes at least two Gainmap streams of different sizes, such as a full-size Gainmap stream, a 1/2-size Gainmap stream, a 1/4-size Gainmap stream, etc.
  • Step 102 Determine stream description information of the gain data stream according to the gain data stream.
  • the stream description information may be used to describe the features of the gain data stream, for example, describing the purpose, encoding format, number of channels, etc. of the gain data stream. In this way, a gain data stream that meets the requirements may be searched based on the stream description information.
  • the flow description information includes at least one of the following:
  • the attribute information of the gain data stream is the attribute information of the gain data stream.
  • the target identifier is used to uniquely identify each gain data stream in the first file. For example, assuming that the gain data stream is a Gainmap stream, the target identifier is the key of the Gainmap stream.
  • the key can be pre-associated with the type, data format, etc. of the Gainmap steam.
  • the stream description information is shown in Table 2 below:
  • the first 4 bytes “0x0003" in Key: 0x00030001 are used to indicate that the type of the gain data stream is Gainmap stream, and the last 4 bytes “0x0001" are used to indicate the business type of the Gainmap stream, such as the specific purpose of the Gainmap stream.
  • the Key can be divided into two parts, one part is used to indicate the general type of the stream, and the other part is used to indicate the specific type of the stream in the general classification.
  • the size of the Gainmap stream data in Table 2 above may be the number of bits of the Gainmap stream data.
  • the module using the first file may indicate the module that needs to use the first file, such as the photo album application. Application, App or Camera App, etc.
  • the above-mentioned declaration subject may be the manufacturer of the electronic device that executes the media data processing method provided in the embodiment of the present application.
  • the attribute information of the gain data stream can be recorded.
  • the XDR2.0 parameter can indicate that the gain data stream is a Gainmap stream defined according to the rule XDR2.0, where XDR2.0 can be the definition rule of the parameters in the Gainmap stream, i.e., Extreme Dynamic Range (XDR) version 2.0.
  • XDR2.0 can be the definition rule of the parameters in the Gainmap stream, i.e., Extreme Dynamic Range (XDR) version 2.0.
  • Step 103 Generate a first file based on the first media data, the gain data stream and the stream description information, and store the first file, wherein the first file includes: the first media data, the gain data stream, the stream description information, a first check code associated with the gain data stream, and a second check code associated with the stream description information; wherein the first check code is used to identify the associated gain data stream in the first file; and the second check code is used to identify the associated stream description information in the first file.
  • the gain data stream, the stream description information, the first check code associated with the gain data stream, and the second check code associated with the stream description information can be added after the first media data to form a first file. In this way, since the encoding Stream of the Gainmap is saved at the end of the original image Jpeg, this will not affect the normal display of the original image.
  • the first check code is associated with the gain data stream, which can be achieved by adding a fixed first check code before each gain data stream.
  • the second check code is associated with the stream description information, which can be achieved by adding a fixed second check code before the stream description information of each gain data stream.
  • the first media data is picture data
  • the first check code is the string “Gainmapdata”
  • the second check code is the string “Gainmapinfo”
  • “Gainmapdata+gain data stream data content” can be added after the picture data content: JPG data
  • “Gainmapinfo+stream description information” can be added after “Gainmapdata+gain data stream data content”.
  • the stream description information of the gain data stream in the first file can be accurately located by identifying Gainmapinfo
  • the data content of the gain data stream in the first file can be accurately located by identifying Gainmapdata.
  • the number of the gain data streams may be one or at least two.
  • the first file further includes: N and a third check code associated with N, where N is a positive integer;
  • the value of N is the number of gain data streams in the first file, and the third check code is used to identify the associated N in the first file.
  • Gainmap Streams or other Streams can be written into an image file (taking Jpeg as an example) and combined into a method that does not affect the original file but can quickly obtain any required Stream.
  • the camera preview interface For example: open the camera preview interface, and then enter the mode that requires generating multiple gainmap streams. Or generate a gainmap stream and other streams, such as a watermark stream, and click the photo button to take a photo.
  • a gainmap stream and other streams such as a watermark stream
  • click the photo button to take a photo.
  • at least one gainmap is generated, wherein different gainmaps can be generated in different sizes, such as full size, 1/4 size or 1/16 size gainmap streams, and a watermark stream may be generated.
  • the photos taken, the gainmap streams of different sizes, and the watermark stream need to be packaged into the first file.
  • the initial value of N can be equal to 0, and each time a stream is generated, the value of N increases by 1, so that the value of N can change with the number of streams.
  • the number of gain data streams in the first file can be indicated by N, and the N can be accurately located from the first file through the third check code.
  • the method further includes:
  • the second media data is output.
  • the reading order of the first file may be from back to front, that is, the reading order is: the third check code, the value of N, N of the second check codes and their corresponding stream description information, N of the first check codes and their corresponding gain data streams, and the first media data.
  • the first media data may be read first, and then the third check code, the value of N, N second check codes and their corresponding stream description information, N first check codes and their corresponding gain data streams may be read in sequence, so as to search for and read the required target gain data stream according to the third check code, the second check code and the stream description information, and the first check code.
  • the third check code can be first identified from the first file, such as the string "streamcount” shown in FIG. 5, and then N is read according to the identified third check code; then, according to the value of N, it is determined that the number of gain data streams included in the first file is equal to N, and then the N second check codes can be searched for respectively, and the stream description information associated with each of the N check codes can be read from the first file, so as to find the required target gain data stream according to the N stream description information, and finally, the target gain data stream is found from the first file according to the first check code associated with the target gain data stream.
  • the same gain data stream and its stream description information may be stored in adjacent positions in the first file, so that when it is determined that the gain data stream described by the target stream description information is the required gain data stream, it may be determined that the gain data stream adjacent to the target stream description information is the target gain data stream.
  • the data contents of the three gain data streams and their first check codes and the corresponding stream description information and their second check codes are located in adjacent storage areas in the first file.
  • the storage order of the first check code, the data contents of the gain data stream, the second check code, and the stream description information is: first check code + data contents of the gain data stream -> second check code Verification code + flow description information.
  • the first file includes the following information arranged in sequence:
  • the first media data N first check codes and their corresponding gain data streams, N second check codes and their corresponding stream description information, the third check code and the associated N.
  • the method of outputting the second media data can be determined based on the data type of the second media data. For example, when the second media data is a picture, the picture can be displayed on a display screen; when the second media data is audio data, the audio can be played through a speaker.
  • the outputting of the second media data may be transmitting the processed second media data to other devices via wired transmission or air interface transmission, which will not be elaborated herein.
  • N gain data streams can be stored in sequence in a certain order, and then N stream description information can be stored after the N gain data streams in the same order. In this way, when it is determined that the gain data stream described by the i-th stream description information is the required gain data stream, it can be determined that the i-th gain data stream is the target gain data stream.
  • the target gain stream data is determined in accordance with the third check code, the value of N, N second check codes and their corresponding stream description information, N first check codes and their corresponding gain data streams in sequence.
  • the target gain stream data may be determined according to the third check code, the second check code, part or all of the stream description information, the first check code and the gain data stream.
  • determining the target gain stream data in sequence according to the third check code, the value of N, N second check codes and their corresponding stream description information, and N first check codes and their corresponding gain data streams includes:
  • the target gain data stream is read from the first file according to the first check code associated with the target gain data stream.
  • the target identifier is a key
  • the specific content of the key is shown in Table 2. It can be seen that the target gain data stream can be selected based on the key corresponding to the gain data stream one by one, and the gain data stream type, service type and other information described by the key.
  • the association relationship between the key and the information such as the gain data stream type and the service type can be pre-stored in the device that executes the media data processing method provided by the embodiment of the present application, so that when the key is identified, the information such as the gain data stream type and the service type reflected by the key can be obtained.
  • the encoding format of each stream can also be determined based on the correspondence between the 4-byte value and the tag in the key as shown in Table 1. In this way, the search for the gain data stream can be achieved by only searching for each key in the stream description information.
  • the stream description information of multiple streams shown in Table 3 below includes their respective keys.
  • the key of each stream can be divided into two parts.
  • One part (the first 4 bytes) is used to indicate the approximate type of the stream, such as Gainmap Stream, or initialized JPEG (initJpeg) Stream, or depth map (DepthMap) Stream, or each watermark frame on the JPEG image (perWatermarkBokehJpeg) Stream, or logo watermark (LogoWaterMark), or time watermark (TimeWaterMark), or horizontal time frame watermark (horizontalTimeFrameWaterMark).
  • the Stream used to implement the logo watermark can be found as the watermark data stream according to the key, and the pixel gain in the JPEG picture can be adjusted based on the Stream of the logo watermark to obtain the JPEG picture after the logo watermark is removed.
  • the target identifier in the stream description information needs to be identified to realize the gain data stream type corresponding to the target identifier information, thereby realizing the selection of the target gain data stream that meets the needs, which can improve the speed of finding the target gain data stream that meets the needs.
  • the first file further includes extended information, wherein the extended information includes at least one of the following:
  • a fifth verification code wherein the fifth verification information is used to verify the validity of the first file.
  • the extended information can be used as information for retaining the extension or setting information for storing meta data.
  • the extended information can specifically include at least one of the following metadata: average gain, maximum gain, minimum gain, etc. of the gain data stream.
  • the extended information may be in a form similar to the above-mentioned key:value form, that is, the correspondence between each extended information content and its respective first identifier is pre-stored, and the first identifier is inserted into the extended information.
  • the specific extended information content may be obtained according to the first identifier and the pre-stored correspondence between the first identifier and the extended information content.
  • compatibility with media data files of historical versions can be achieved, wherein the media data files of historical versions may be other frame structure media data files other than the frame structure of the first file stored in the media data processing method provided in the embodiment of the present application, such as a media data file that does not contain at least one of the first check code, the second check code, and the third check code.
  • the extended information includes, from back to front: fixed old version compatibility information, then a fixed fourth check code “cameralbum ⁇ ”, then the 4-byte length of the extended information, then the content of the extended information, and then a fixed fifth check code “XXXX”.
  • the fifth check code can be used to implement security verification of the first file.
  • the fourth check code "cameralbum ⁇ ” the content of the extended information can be read according to the length of the extended information.
  • the fifth check code "XXXX” it is determined that the first file is a file provided by a trusted object, thereby executing the reading of other contents after the extended information in the first file, such as: the third check code, the second check code, the stream description information, the first check code, the gain data stream, etc.; if the fifth check code "XXXX" is not identified, the reading of other contents after the extended information in the first file can be terminated.
  • the stream data and the stream description information in the first file can be identified based on the first check code and the second check code, which can simplify the difficulty of finding the stream;
  • the at least two streams in a media data when there are at least two streams in a media data, the at least two streams can be orderly managed, checked and searched and located, and the storage and transmission of Meta or Setting can be realized, which facilitates the expansion, transmission and management of pictures.
  • the media data processing method provided in the embodiment of the present application can be executed by a media data processing device.
  • the media data processing device provided in the embodiment of the present application is described by taking the media data processing device executing the media data processing method as an example.
  • a media data processing device 700 provided in an embodiment of the present application may include the following modules:
  • An acquisition module 701 is used to acquire first media data and a gain data stream
  • a first determining module 702 configured to determine stream description information of the gain data stream according to the gain data stream;
  • a data processing module 703 is configured to generate a first file according to the first media data, the gain data stream and the stream description information, and store the first file, wherein the first file includes: the first media data, the gain data stream, the stream description information, a first check code associated with the gain data stream, and a second check code associated with the stream description information;
  • the first check code is used to identify the associated gain data stream in the first file; and the second check code is used to identify the associated stream description information in the first file.
  • the flow description information includes at least one of the following:
  • the attribute information of the gain data stream is the attribute information of the gain data stream.
  • the first file further includes: N and a third check code associated with N, where N is a positive integer;
  • the value of N is the number of gain data streams in the first file, and the third check code is used to identify the associated N in the first file.
  • the first file includes the following information arranged in sequence:
  • the first media data N first check codes and their corresponding gain data streams, N second check codes and their corresponding stream description information, the third check code and the associated N.
  • the media data processing device 700 further includes:
  • a reading module used for reading the first file
  • a second determination module configured to determine target gain stream data according to the third check code, the value of N, N second check codes and the corresponding stream description information, and N first check codes and the corresponding gain data streams;
  • a gain adjustment module configured to adjust the gain of the first media data based on the target gain data stream to obtain second media data
  • An output module configured to output the second media data.
  • the second determining module includes:
  • a first reading unit configured to read the N from the first file according to the third verification code
  • a second reading unit used for reading N second verification codes from the first file
  • a third reading unit configured to read target identifiers in the stream description information respectively associated with the N second check codes from the first file
  • a selection unit configured to select a target gain data stream from the N gain data streams according to target identifiers of the N gain data streams
  • a fourth reading unit is configured to read the target gain data stream from the first file according to the first check code associated with the target gain data stream.
  • the first file further includes extended information, wherein the extended information includes at least one of the following:
  • a fifth verification code wherein the fifth verification information is used to verify the validity of the first file.
  • the media data processing device 700 provided in the embodiment of the present application can implement each step in the method embodiment shown in Figure 1, and can achieve the same or similar beneficial effects as the method embodiment shown in Figure 1. To avoid repetition, it will not be described here.
  • the media data processing device in the embodiment of the present application can be an electronic device or a component in the electronic device, such as an integrated circuit or a chip.
  • the electronic device can be a terminal or other devices other than a terminal.
  • the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR)/virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc.
  • NAS Network Attached Storage
  • PC personal computer
  • TV television
  • teller machine a self-service machine
  • the media data processing device in the embodiment of the present application may be a device having an operating system.
  • the operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
  • the media data processing device provided in the embodiment of the present application can implement each process implemented by the method embodiment shown in Figure 1, and will not be described again here to avoid repetition.
  • an embodiment of the present application also provides an electronic device 800, including a processor 801 and a memory 802, and the memory 802 stores a program or instruction that can be executed on the processor 801.
  • the program or instruction is executed by the processor 801
  • the various steps of the above-mentioned media data processing method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
  • the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
  • FIG. 9 is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.
  • the electronic device 900 includes but is not limited to: a radio frequency unit 901, a network module 902, an audio output unit 903, an input unit 904, a sensor 905, a display unit 906, a user input unit 907, an interface unit 908, a memory 909, and a processor 910 and other components.
  • the electronic device 900 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 910 through a power management system, so that the power management system can manage charging, discharging, and power consumption.
  • a power source such as a battery
  • the electronic device structure shown in FIG9 does not constitute a limitation on the electronic device, and the electronic device may include more or fewer components than shown, or combine certain components, or arrange components differently, which will not be described in detail here.
  • the input unit 904 is used to obtain the first media data and the gain data stream;
  • the processor 910 is configured to determine stream description information of the gain data stream according to the gain data stream;
  • the processor 910 is configured to generate a first file according to the first media data, the gain data stream, and the stream description information, and control the memory 909 to store the first file, wherein the first file includes: the first media data, the gain data stream, the stream description information, a first check code associated with the gain data stream, and a second check code associated with the stream description information;
  • the first check code is used to identify the associated gain data stream in the first file; and the second check code is used to identify the associated stream description information in the first file.
  • the flow description information includes at least one of the following:
  • the attribute information of the gain data stream is the attribute information of the gain data stream.
  • the first file further includes: N and a third check code associated with N, where N is a positive integer;
  • the value of N is the number of gain data streams in the first file, and the third check code is used to identify the associated N in the first file.
  • the first file includes the following information arranged in sequence:
  • the first media data N first check codes and their corresponding gain data streams, N second check codes and their corresponding stream description information, the third check code and the associated N.
  • the processor 910 controls the memory 909 to store the first file
  • the processor 910 is further configured to:
  • the audio output unit 903 or the display unit 906 and the interface unit 908 are controlled to output the second media data.
  • the determining of the target gain stream data according to the third check code, the value of N, N second check codes and respectively corresponding stream description information, N first check codes and respectively corresponding gain data streams performed by the processor 910 includes:
  • the target gain data stream is read from the first file according to the first check code associated with the target gain data stream.
  • the first file further includes extended information, wherein the extended information includes at least one of the following:
  • a fifth verification code wherein the fifth verification information is used to verify the validity of the first file.
  • the input unit 904 may include a graphics processing unit (GPU) 9041 and a microphone 9042, and the graphics processor 9041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode.
  • the display unit 906 may include a display panel 9061, and the display panel 9061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc.
  • the user input unit 907 includes a touch panel 9071 and at least one of other input devices 9072.
  • the touch panel 9071 is also called a touch screen.
  • the touch panel 9071 may include two parts: a touch detection device and a touch controller.
  • Other input devices 9072 may include, but are not limited to, a physical keyboard, function keys (such as a volume control key, a switch key, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.
  • the memory 909 can be used to store software programs and various data.
  • the memory 909 can mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area can store an operating system, an application program or instruction required for at least one function (such as a sound playback function, an image playback function, etc.).
  • the memory 909 can include a volatile memory or a non-volatile memory, or the memory 909 Both volatile and non-volatile memory can be included.
  • non-volatile memory can be read-only memory (Read-Only Memory, ROM), programmable read-only memory (Programmable ROM, PROM), erasable programmable read-only memory (Erasable PROM, EPROM), electrically erasable programmable read-only memory (Electrically EPROM, EEPROM) or flash memory.
  • ROM Read-Only Memory
  • PROM programmable read-only memory
  • Erasable PROM Erasable PROM
  • EPROM electrically erasable programmable read-only memory
  • EEPROM electrically erasable programmable read-only memory
  • Volatile memory can be random access memory (Random Access Memory, RAM), static random access memory (Static RAM, SRAM), dynamic random access memory (Dynamic RAM, DRAM), synchronous dynamic random access memory (Synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (Double Data Rate SDRAM, DDRSDRAM), enhanced synchronous dynamic random access memory (Enhanced SDRAM, ESDRAM), synchronous connection dynamic random access memory (Synch link DRAM, SLDRAM) and direct memory bus random access memory (Direct Rambus RAM, DRRAM).
  • RAM Random Access Memory
  • SRAM static random access memory
  • DRAM dynamic random access memory
  • DRAM synchronous dynamic random access memory
  • SDRAM double data rate synchronous dynamic random access memory
  • Double Data Rate SDRAM Double Data Rate SDRAM
  • DDRSDRAM double data rate synchronous dynamic random access memory
  • Enhanced SDRAM, ESDRAM enhanced synchronous dynamic random access memory
  • Synch link DRAM, SLDRAM synchronous connection dynamic random access memory
  • the processor 910 may include one or more processing units; optionally, the processor 910 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 910.
  • An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored.
  • a program or instruction is stored.
  • the program or instruction is executed by a processor, each process of the above-mentioned media data processing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
  • the processor is the processor in the electronic device described in the above embodiment.
  • the readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
  • An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned media data processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
  • the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
  • An embodiment of the present application provides a computer program product, which is stored in a storage medium.
  • the program product is executed by at least one processor to implement the various processes of the above-mentioned media data processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
  • the methods described herein may include performing functions in the order described or discussed, and may also include performing functions in a substantially simultaneous manner or in a reverse order depending on the functions involved. For example, the methods described may be performed in an order different from that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
  • the technical solution of the present application can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
  • a storage medium such as ROM/RAM, a disk, or an optical disk
  • a terminal which can be a mobile phone, a computer, a server, or a network device, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)
  • Television Signal Processing For Recording (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本申请公开了一种媒体数据处理方法、装置、电子设备及可读存储介质,属于信息处理技术领域。其中,方法包括:获取第一媒体数据和增益数据流;根据所述增益数据流,确定所述增益数据流的流描述信息;根据所述第一媒体数据、所述增益数据流和所述流描述信息生成第一文件,并存储所述第一文件,其中,所述第一文件包括:所述第一媒体数据、所述增益数据流、所述流描述信息、与所述增益数据流关联的第一校验码以及与所述流描述信息关联的第二校验码;其中,所述第一校验码用于在所述第一文件中标识关联的增益数据流;所述第二校验码用于在所述第一文件中标识关联的流描述信息。

Description

媒体数据处理方法、装置、电子设备及可读存储介质
本申请要求在2023年6月6日提交中国专利局、申请号为202310667267.5、名称为“媒体数据处理方法、装置、电子设备及可读存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请属于数据处理技术领域,具体涉及一种媒体数据处理方法、装置、电子设备及可读存储介质。
背景技术
在相关技术中,对于高动态范围(High Dynamic Range,HDR)的扩展显示功能,会在图片比如JPEG中添加存储增益映射(Gainmap)。
但是,由于不同的图片的Gainmap的尺寸不同,在存储Gainmap之后,若要查找指定的Gainmap,则需要对全部Gainmap进行解码、识别等操作,因此,相关技术中的Gainmap存储方法存在不便于查找指定Gainmap的问题。
发明内容
本申请实施例的目的是提供一种媒体数据处理方法、装置、电子设备及可读存储介质,能够快速定位媒体数据中增益数据流和流描述信息的位置,便于对该媒体数据进行查找。
第一方面,本申请实施例提供了一种媒体数据处理方法,该方法包括:
获取第一媒体数据和增益数据流;
根据所述增益数据流,确定所述增益数据流的流描述信息;
根据所述第一媒体数据、所述增益数据流和所述流描述信息生成第一文件,并存储所述第一文件,其中,所述第一文件包括:所述第一媒体数据、所述增益数据流、所述流描述信息、与所述增益数据流关联的第一校验码以及与所述流描述信息关联的第二校验码;
其中,所述第一校验码用于在所述第一文件中标识关联的增益数据流;所述第二校验码用于在所述第一文件中标识关联的流描述信息。
第二方面,本申请实施例提供了一种媒体数据处理装置,该装置包括:
获取模块,用于获取第一媒体数据和增益数据流;
第一确定模块,用于根据所述增益数据流,确定所述增益数据流的流描述信息;
数据处理模块,用于根据所述第一媒体数据、所述增益数据流和所述流描述信息生成第一文件,并存储所述第一文件,其中,所述第一文件包括:所述第一媒体 数据、所述增益数据流、所述流描述信息、与所述增益数据流关联的第一校验码以及与所述流描述信息关联的第二校验码;
其中,所述第一校验码用于在所述第一文件中标识关联的增益数据流;所述第二校验码用于在所述第一文件中标识关联的流描述信息。
第三方面,本申请实施例提供了一种电子设备,该电子设备包括处理器和存储器,所述存储器存储可在所述处理器上运行的程序或指令,所述程序或指令被所述处理器执行时实现如第一方面所述的方法的步骤。
第四方面,本申请实施例提供了一种可读存储介质,所述可读存储介质上存储程序或指令,所述程序或指令被处理器执行时实现如第一方面所述的方法的步骤。
第五方面,本申请实施例提供了一种芯片,所述芯片包括处理器和通信接口,所述通信接口和所述处理器耦合,所述处理器用于运行程序或指令,实现如第一方面所述的方法。
第六方面,本申请实施例提供一种计算机程序产品,该程序产品被存储在存储介质中,该程序产品被至少一个处理器执行以实现如第一方面所述的方法。
在本申请实施例中,通过在第一文件中添加与所述增益数据流关联的第一校验码以及与所述流描述信息关联的第二校验码,这样,在需要使用增益数据流对第一文件中的第一媒体数据进行增益调整的情况下,可以基于第二校验码从第一文件中找到各个增益数据流的流描述信息,并根据该流描述信息选择需要的目标增益数据流,然后基于目标增益数据流关联的第一校验码从而第一文件中找到该目标增益数据流,不需要对第一文件中的全部增益数据流进行解码、识别等操作,便可以实现从第一文件中查找并读取目标增益数据流。
附图说明
图1是本申请实施例提供的一种媒体数据处理方法的流程图;
图2是JPEG文件的架构示意图;
图3是本申请实施例中的第一文件的架构示意图之一;
图4是本申请实施例中的第一文件的架构示意图之二;
图5是本申请实施例中的第一文件的架构示意图之三;
图6是本申请实施例中扩展信息的架构示意图;
图7是本申请实施例提供的一种媒体数据处理装置的结构示意图;
图8是本申请实施例提供的一种电子设备的结构示意图;
图9是本申请实施例提供的一种电子设备的硬件结构示意图。
具体实施例
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚地 描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员获得的所有其他实施例,都属于本申请保护的范围。
本申请的说明书和权利要求书中的术语“第一”、“第二”等是用于区别类似的对象,而不用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施,且“第一”、“第二”等所区分的对象通常为一类,并不限定对象的个数,例如第一对象可以是一个,也可以是多个。此外,说明书以及权利要求中“和/或”表示所连接对象的至少其中之一,字符“/”,一般表示前后关联对象是一种“或”的关系。
高动态照片显示功能,可以理解为HDR的扩展显示功能,在安卓(Android)系统中,对于JPEG-R存储Gainmap有了统一的标准,即将一个Gainmap存储在JPEG数据之后,在读取Gainmap时,对JPEG文件中的数据内容进行解码和识别,从而得到该Gainmap的数据内容。此外,ISO标准化组织也在制定Gainmap相关的标准。
但是,以上相关技术中对于Gainmap的存储至少存在以下问题:
1)在图片比如JPEG文件中添加存储Gainmap时,由于Gainmap有大有小,在JPEG文件中存储Gainmap后,如何查找Gainmap和扩展Gainmap都存在诸多不便;
2)对Gainmap的尺寸大小没有统一的标准,从而不能够实现在同一JPEG文件中存在多个Gainmap,例如:若在同一JPEG文件中存在多个Gainmap,则无法划分该文件中不同的Gainmap。
而本申请实施例中,提出了一种新的存储标准,以使用校验码对增益数据流,包括:Gainmap或其他类型的增益数据的数据流(stream),以及增益数据流的流描述信息进行标识,这样,基于与流描述信息关联的校验码可以从存储的媒体文件(即第一文件)中准确的定位各自关联的流描述信息,然后基于该流描述信息可以查找需要的目标增益数据流,然后基于与该目标增益数据流关联的校验码可以从存储的媒体文件(即第一文件)中准确的定位该目标增益数据流。
下面结合附图,通过具体的实施例及其应用场景对本申请实施例提供的媒体数据处理方法、装置、电子设备及可读存储介质进行详细地说明。
请参阅图1,本申请实施例提供的一种媒体数据处理方法,可以包括以下步骤:
步骤101、获取第一媒体数据和增益数据流。
在一些实施方式中,第一媒体数据可以是图片、音频、视频等媒体数据,为了便于说明,本申请实施例中,通常以第一媒体数据是图片,如:JPEG图片为例进行举例说明,在此不构成具体限定。
例如:第一媒体数据是在完成拍摄操作时生成的一张图片,假设该图片为JPEG格式,则该图片对应的JPEG文件的架构示意图可以如图2所示。
其中,增益数据流可以用于对第一媒体数据进行增益调整,例如:在第一媒体数据是JPEG图片的情况下,增益数据流可以Gainmap stream,这样,基于该Gainmap stream可以调整JPEG图片中的亮度增益,以实现高动态范围的图片显示功能。
需要说明的是,增益数据流的类型与第一媒体数据的类型相关,例如:对于图片,可以采用Gainmap stream、水印stream等与图片相关的增益数据流;对于音频,可以采用与音频相关的增益数据流;对于视频,则可以采用与视频相关的增益数据流。
例如:在拍摄照片的过程中,在完成拍摄时,会生成一张图片,且生成以RGBA为格式的Gainmap stream。
其中,第一文件中的增益数据流,可以是RGBA格式的Gainmap stream,或YUV格式的Gainmap stream,或对YUV格式的Gainmap stream进行编码后的数据。
具体地,本申请实施例提供的媒体数据处理方法可以将Gainmap stream由RGBA格式转化为YUV格式,然后将YUV格式的Gainmap stream编码为JPEG及PNG等格式后,添加在JPEG文件中的图片数据内容,即JPEG DATA之后;或者,也可以不对YUV格式的Gainmap stream进行编码,而将YUV格式的Gainmap stream添加在JPEG文件中的JPEG DATA之后;或者,也可以直接将RGBA格式的Gainmap stream添加在JPEG文件中的JPEG DATA之后。
对于JPEG文件中的Gainmap stream的格式,可以如下表1所示:
表1
为了便于说明,本申请实施例中,以将JPEG格式的Gainmap stream添加在JPEG文件中的JPEG DATA之后为例进行举例说明,在此不构成具体限定。
需要说明的是,为了便于说明,本申请实施例中通常以第一媒体数据是图片,增益数据流是Gainmap stream、水印stream等与图片相关的增益数据流为例进行举例说明,在此不限定增益数据流的类型和第一媒体数据的类型。
一种实施方式中,增益数据流的数量可以是一个或至少两个。
例如:所述增益数据流包括Gainmap stream和其他增益stream,其中,其他增益stream可以是水印stream等与Gainmap stream不同的stream。
再例如:所述增益数据流包括至少两个不同尺寸的Gainmap stream,如全尺寸(Full size)的Gainmap stream、1/2size的Gainmap stream、1/4size的Gainmap stream等。
步骤102、根据所述增益数据流,确定所述增益数据流的流描述信息。
其中,流描述信息可以用于描述增益数据流的特征,例如:描述增益数据流的用途、编码格式、通道数量等。这样,基于流描述信息可以查找符合需求的增益数据流。
可选地,所述流描述信息包括以下至少一项:
所述增益数据流的目标标识;
所述增益数据流的类型;
所述增益数据流对应的业务;
所述增益数据流的尺寸;
使用所述第一文件的模块;
所述增益数据流的声明主体;
所述增益数据流的属性信息。
其中,目标标识用于在第一文件中唯一标识每一个增益数据流,例如:假设增益数据流是Gainmap stream,则目标标识为Gainmap stream的钥匙(key)。
可选地,key可以预先与Gainmap steam的类型、数据格式等关联。例如:如下表2所示的流描述信息:
表2
由上表2可知,Key:0x00030001中的前4字节“0x0003”用于指示增益数据流的类型为Gainmap stream,后4字节“0x0001”用指示Gainmap stream的业务类型,如该Gainmap stream的具体用途等信息。也就是说,Key可以划分为两个部分,一部分用于指示stream大致的类型,另一部分用于在该大致分类中指示stream的具体类型。
如上表2中的Gainmap stream data的尺寸,可以是Gainmap stream data的比特(bit)数。
使用所述第一文件的模块,可以指示需要使用第一文件的模块,如相册应用程 序(Application,App)或相机App等。
上述声明主体可以是执行本申请实施例提供的媒体数据处理方法的电子设备的生产者。
如上表2中的备注项中,可以记录增益数据流的属性信息,例如:XDR2.0参数,可以表示增益数据流为按照规则XDR2.0定义的Gainmap stream,其中,XDR2.0可以是Gainmap stream中参数的定义规则,即极端动态范围(Extreme Dynamic Range,XDR)2.0版。
步骤103、根据所述第一媒体数据、所述增益数据流和所述流描述信息生成第一文件,并存储所述第一文件,其中,所述第一文件包括:所述第一媒体数据、所述增益数据流、所述流描述信息、与所述增益数据流关联的第一校验码以及与所述流描述信息关联的第二校验码;其中,所述第一校验码用于在所述第一文件中标识关联的增益数据流;所述第二校验码用于在所述第一文件中标识关联的流描述信息。
一种实施方式中,可以将所述增益数据流、所述流描述信息、与所述增益数据流关联的第一校验码以及与所述流描述信息关联的第二校验码,添加在第一媒体数据之后,形成第一文件,这样,因为Gainmap的编码Stream保存在原图片Jpeg的末尾,这样将不影响原图片的正常显示。
一种实施方式中,第一校验码与所述增益数据流关联,可以通过在每一个增益数据流之前添加固定的第一校验码实现。
同理,第二校验码与所述流描述信息关联,可以通过在每一个增益数据流的流描述信息之前添加固定的第二校验码实现。
例如:如图3所示,假设第一媒体数据是图片数据,第一校验码是字符串“Gainmapdata”,第二校验码是字符串“Gainmapinfo”,则可以在图片数据内容:JPG data之后添加“Gainmapdata+增益数据流的数据内容”,然后在“Gainmapdata+增益数据流的数据内容”之后添加“Gainmapinfo+流描述信息”。这样,通过识别Gainmapinfo可以准确定位至第一文件中的增益数据流的流描述信息,通过识别Gainmapdata可以准确定位至第一文件中的增益数据流的数据内容。
作为一种可选的实施方式,所述增益数据流的数量可以是一个或至少两个。
可选地,所述第一文件还包括:N以及与所述N关联的第三校验码,N为正整数;
其中,所述N的取值为所述第一文件中的增益数据流的数量,所述第三校验码用于在所述第一文件中标识关联的所述N。
本实施方式中,可以将多个Gainmap Stream或者其他Stream写入一个图片文件(以Jpeg为例)中组合为一个不影响原文件但能快速获得任何一个需要的Stream的方法。
例如:打开相机拍照预览界面,然后进入需要生成多个Gainmap Stream的模式, 或者产生一个Gainmap Stream和其他的Stream,如水印Stream,点击拍照按钮进行拍照,这样,在产生拍摄照片的过程中,产生了至少一个Gainmap,其中,可以以不同的尺寸生成不同的Gainmap,比如Full Size、1/4Size或者1/16Size的Gainmap Stream等多个Gainmap Stream,并可能附带产生了水印Stream。此时,需要将拍摄得到的照片、不同尺寸的Gainmap Stream、水印Stream打包至第一文件中。
可选地,N的初始值可以等于0,且每当生成一个Stream,则N的取值增加1,这样,N的取值可以随Stream数量的变化而变化。
通过本实施方式,可以通过N指示第一文件中有多少个增益数据流,而通过第三校验码能够从第一文件中准确的定位所述N。
可选地,在所述存储所述第一文件之后,所述方法还包括:
读取所述第一文件;
根据所述第三校验码、所述N的取值、N个所述第二校验码和各自对应的流描述信息、N个所述第一校验码和各自对应的增益数据流,确定目标增益流数据;
基于所述目标增益数据流调整所述第一媒体数据的增益,得到第二媒体数据;
输出所述第二媒体数据。
一种实施方式中,上述第一文件的读取顺序可是由后往前,即读取顺序依次为:所述第三校验码、所述N的取值、N个所述第二校验码和各自对应的流描述信息、N个所述第一校验码和各自对应的增益数据流、所述第一媒体数据。
另一种实施方式中,可先读取第一媒体数据,然后依次读取所述第三校验码、所述N的取值、N个所述第二校验码和各自对应的流描述信息、N个所述第一校验码和各自对应的增益数据流,以根据第三校验码、第二校验码和流描述信息、第一校验码查找并读取需要的目标增益数据流。
例如:可以先从第一文件中识别第三校验码,如图5中所示字符串“streamcount”,进而根据识别到的第三校验码读取N;然后根据N的取值确定第一文件中包含的增益数据流的数量等于N,进而可以分别查找N个第二校验码,并从第一文件中读取N个校验码各自关联的流描述信息,从而根据N个流描述信息查找到需要的目标增益数据流,最终,根据目标增益数据流关联的第一校验码从第一文件中找到目标增益数据流。
一种实施方式中,同一个增益数据流与其流描述信息可以存储在第一文件中的相邻位置,这样,在确定目标流描述信息所描述的增益数据流是需要的增益数据流时,可以确定该目标流描述信息相邻的增益数据流是目标增益数据流。
例如:如图4所示,假设N等于3,则3个增益数据流的数据内容及其第一校验码与各自对应的流描述信息及其第二校验码位于第一文件内相邻的存储区域,此时,对于某一个具体的增益数据流而言,第一校验码、增益数据流的数据内容、第二校验码、流描述信息的存储顺序为:第一校验码+增益数据流的数据内容->第二校 验码+流描述信息。
另一种实施方式中,在N为大于1的整数的情况下,所述第一文件包括按顺序排列的以下信息:
所述第一媒体数据、N个所述第一校验码和各自对应的增益数据流、N个所述第二校验码和各自对应的流描述信息、所述第三校验码和关联的所述N。
一种实施方式中,输出所述第二媒体数据的方式可以依据所述第二媒体数据的数据类型确定,例如:在第二媒体数据为图片的情况下,可以通过显示屏显示该图片;在第二媒体数据为音频数据的情况下,可以通过扬声器播放该音频。
另一种实施方式中,所述输出所述第二媒体数据,可以是将处理后的第二媒体数据通过有线传输或空口传输的方式传输至其他设备,在此不作过多阐述。
本实施方式中,可以将N个增益数据流按照一定顺序依次存储,然后将N个流描述信息按照相同的顺序存储在N个增益数据流之后,这样,在确定第i个流描述信息所描述的增益数据流是需要的增益数据流时,可以确定第i个增益数据流是目标增益数据流。
例如:如图5所示,假设N等于3,先在JPG data之后插入3个第一校验码+增益数据流的数据内容,然后在3个第一校验码+增益数据流的数据内容之后插入3个第二校验码+流描述信息。
需要说明的是,上述依次根据所述第三校验码、所述N的取值、N个所述第二校验码和各自对应的流描述信息、N个所述第一校验码和各自对应的增益数据流,确定目标增益流数据,可以是根据第三校验码、第二校验码、流描述信息的部分或全部内容、第一校验码和增益数据流,来确定目标增益流数据。
例如:如果按照图4的方式将多个Stream保存在JPEG文件中,存在一个问题是当多个Stream存在时,如果要查找其中一个我们需要的Stream,就要对一个一个Stream分别进行查找,造成在缓存(buffer)中,读取指针需要不断的移动,并需要完全解析流描述信息中的全部内容,包括长度信息。而如图5所示存储架构中,仅需要依次读取全部流描述信息里面的key,然后基于key查找满足需要的Stream。由此可见,如图5所示存储架构较如图4所示存储架构而言,能够降低查找增益数据流的复杂程度。
在一些实施方式中,所述依次根据所述第三校验码、所述N的取值、N个所述第二校验码和各自对应的流描述信息、N个所述第一校验码和各自对应的增益数据流,确定目标增益流数据,包括:
根据所述第三校验码从所述第一文件中读取所述N;
从所述第一文件中读取N个第二校验码;
根据N个所述第二校验码从所述第一文件中读取各自关联的所述流描述信息中的目标标识;
根据N个所述增益数据流的目标标识,从N个所述增益数据流中,选择目标增益数据流;
根据所述目标增益数据流关联的所述第一校验码,从所述第一文件中读取所述目标增益数据流。
一种实施方式中,目标标识为key,该key的具体内容如表2所示,由此可见,基于与增益数据流一一对应的key,以及key所描述的增益数据流类型、业务类型等信息,可以选择目标增益数据流。
其中,key与增益数据流类型和业务类型等信息之间的关联关系可以预先存储在执行本申请实施例提供的媒体数据处理方法的设备中,这样,在识别到key的情况下,便可以获取该key所反映的增益数据流类型和业务类型等信息。例如:当需要从多个Stream中查找一个Stream时,鉴于每一种Stream都有各自的Key,每一种Stream编码的格式也能够基于如表1所示的Key中的4字节value与tag之间的对应关系确定。这样,只需要查找流描述信息中的每一个Key就可以实现增益数据流的查找。
例如:如下表3所示的多个Stream的流描述信息中包括各自的key,每个Stream的key可以划分为两部分,一部分(前4个字节)用于指示该Stream的大致类型,如是Gainmap Stream,或初始化JPEG(initJpeg)Stream,或深度图(DepthMap)Stream,或JPEG图片上的每个水印框(perWatermarkBokehJpeg)Stream,或标志水印(LogoWaterMark),或时间水印(TimeWaterMark),或水平时间帧水印(horizontalTimeFrameWaterMark)Stream,或耀斑人像后置数据(postdata)Stream,或文档参数(DocParams)Stream;另一部分(后4个字节)用于指示该Stream的具体分类,如full size gain map数据,或1/4size gain map,或普通图片为水印背景切割图、双摄图片为不带水印不带虚化图片,或双摄虚化深度图,或双摄虚化图片,虚化后水印处的切割背景图,或标志(logo)水印,时间地点水印,边框水印的时间地点水印,横屏位图(bitmap),或耀斑人像postdata,或超清文档矫正前的原图,或超清文档的参数:
表3

例如:假设第一媒体数据为JPEG图片,若需要去除该JPEG图片中的logo水印时,则可以根据key找到用于实现标志(logo)水印的Stream作为水印数据流,并基于该logo水印的Stream调整该JPEG图片中的像素增益,以得到去除logo水印后的JPEG图片。
本实施方式中,仅需要识别流描述信息中的目标标识,便可以实现基于目标标识信息所对应的增益数据流类型,从而实现满足需要的目标增益数据流的选择,能够提升查找满足需要的目标增益数据流的速度。
作为一种可选的实施方式,所述第一文件还包括拓展信息,其中,所述拓展信息包括以下至少一项:
与历史版本的兼容信息;
扩展信息;
所述扩展信息的长度;
与所述扩展信息关联的第四校验码,其中,所述第四校验码用于在所述第一文件中标识关联的所述扩展信息;
第五校验码,所述第五校验信息用于校验所述第一文件的有效性。
一种实施方式中,拓展信息(MediaExtendInfo)可以作为保留扩展的信息或者用于保存元(Meta)数据的设置(Setting)信息。例如:扩展信息具体可以包括以下元数据中的至少一项:增益数据流的平均增益、最大增益、最小增益等。
可选地,扩展信息的形式可以采用类似上述key:value的形式,即先预先存储每一种扩展信息内容与各自的第一标识之间的对应关系,并在拓展信息中插入第一标识,这样,可以根据该第一标识以及预先存储的第一标识与扩展信息内容之间的对应关系,获取具体的扩展信息内容。
一种实施方式中,通过在拓展信息中添加与历史版本的兼容信息,可以与历史版本的媒体数据文件兼容,其中,历史版本的媒体数据文件可以是,除了本申请实施例提供的媒体数据处理方法所存储的第一文件的框架结构之外的其他框架结构媒体数据文件,如不包含第一校验码、第二校验码和第三校验码中至少一项的媒体数据文件。
例如:如图6所示,拓展信息从后往前依次包括:固定的老版本兼容信息,然后是固定的第四校验码“cameralbum`”,然后就是4个字节的扩展信息的长度,然后就是扩展信息的内容,再就是固定的第五校验码“XXXX”。
其中,第五校验码可以用于实现对第一文件的安全性校验,例如:可以在识别到第四校验码“cameralbum`”的情况下,根据扩展信息的长度读取扩展信息的内容,然后,在识别到第五校验码“XXXX”的情况下,确定第一文件是受信任对象提供的文件,从而执行读取第一文件中位于拓展信息之后的其他内容,如:第三校验码、第二校验码、流描述信息、第一校验码、增益数据流等;若未识别到第五校验码“XXXX”,则可以终止对第一文件中位于拓展信息之后的其他内容的读取。
通过本申请实施例提供的媒体数据处理方法,一方面能够基于第一校验码和第二校验码对第一文件中的stream数据及其流描述信息进行标识,能够简化查找stream的难度;另一方面,在一个媒体数据存在至少两个stream的情况下,能够对至少两个stream进行有序管理、校验和查找定位,并实现Meta或者Setting的保存传输,方便了图片的扩展、传输和管理。
本申请实施例提供的媒体数据处理方法,执行主体可以为媒体数据处理装置。本申请实施例中以媒体数据处理装置执行媒体数据处理方法为例,说明本申请实施例提供的媒体数据处理装置。
如图7所示,本申请实施例提供的一种媒体数据处理装置700可以包括以下模块:
获取模块701,用于获取第一媒体数据和增益数据流;
第一确定模块702,用于根据所述增益数据流,确定所述增益数据流的流描述信息;
数据处理模块703,用于根据所述第一媒体数据、所述增益数据流和所述流描述信息生成第一文件,并存储所述第一文件,其中,所述第一文件包括:所述第一媒体数据、所述增益数据流、所述流描述信息、与所述增益数据流关联的第一校验码以及与所述流描述信息关联的第二校验码;
其中,所述第一校验码用于在所述第一文件中标识关联的增益数据流;所述第二校验码用于在所述第一文件中标识关联的流描述信息。
可选地,所述流描述信息包括以下至少一项:
所述增益数据流的目标标识;
所述增益数据流的类型;
所述增益数据流对应的业务;
所述增益数据流的尺寸;
使用所述第一文件的模块;
所述增益数据流的声明主体;
所述增益数据流的属性信息。
可选地,所述第一文件还包括:N以及与所述N关联的第三校验码,N为正整数;
其中,所述N的取值为所述第一文件中的增益数据流的数量,所述第三校验码用于在所述第一文件中标识关联的所述N。
可选地,在N为大于1的整数的情况下,所述第一文件包括按顺序排列的以下信息:
所述第一媒体数据、N个所述第一校验码和各自对应的增益数据流、N个所述第二校验码和各自对应的流描述信息、所述第三校验码和关联的所述N。
可选地,媒体数据处理装置700还包括:
读取模块,用于读取所述第一文件;
第二确定模块,用于根据所述第三校验码、所述N的取值、N个所述第二校验码和各自对应的流描述信息、N个所述第一校验码和各自对应的增益数据流,确定目标增益流数据;
增益调整模块,用于基于所述目标增益数据流调整所述第一媒体数据的增益,得到第二媒体数据;
输出模块,用于输出所述第二媒体数据。
可选地,所述第二确定模块,包括:
第一读取单元,用于根据所述第三校验码从所述第一文件中读取所述N;
第二读取单元,用于从所述第一文件中读取N个第二校验码;
第三读取单元,用于根据N个所述第二校验码从所述第一文件中读取各自关联的所述流描述信息中的目标标识;
选择单元,用于根据N个所述增益数据流的目标标识,从N个所述增益数据流中,选择目标增益数据流;
第四读取单元,用于根据所述目标增益数据流关联的所述第一校验码,从所述第一文件中读取所述目标增益数据流。
可选地,所述第一文件还包括拓展信息,其中,所述拓展信息包括以下至少一项:
与历史版本的兼容信息;
扩展信息;
所述扩展信息的长度;
与所述扩展信息关联的第四校验码,其中,所述第四校验码用于在所述第一文件中标识关联的所述扩展信息;
第五校验码,所述第五校验信息用于校验所述第一文件的有效性。
本申请实施例提供的媒体数据处理装置700,能够实现如图1所示方法实施例中的各个步骤,且能够取得与如图1所示方法实施例相同或相似的有益效果,为避免重复,在此不再赘述。
本申请实施例中的媒体数据处理装置可以是电子设备,也可以是电子设备中的部件,例如集成电路或芯片。该电子设备可以是终端,也可以为除终端之外的其他设备。示例性的,电子设备可以为手机、平板电脑、笔记本电脑、掌上电脑、车载电子设备、移动上网装置(Mobile Internet Device,MID)、增强现实(augmented reality,AR)/虚拟现实(virtual reality,VR)设备、机器人、可穿戴设备、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本或者个人数字助理(personal digital assistant,PDA)等,还可以为服务器、网络附属存储器(Network Attached Storage,NAS)、个人计算机(personal computer,PC)、电视机(television,TV)、柜员机或者自助机等,本申请实施例不作具体限定。
本申请实施例中的媒体数据处理装置可以为具有操作系统的装置。该操作系统可以为安卓(Android)操作系统,可以为ios操作系统,还可以为其他可能的操作系统,本申请实施例不作具体限定。
本申请实施例提供的媒体数据处理装置能够实现图1所示的方法实施例实现的各个过程,为避免重复,这里不再赘述。
可选地,如图8所示,本申请实施例还提供一种电子设备800,包括处理器801和存储器802,存储器802上存储有可在所述处理器801上运行的程序或指令,该程序或指令被处理器801执行时实现上述媒体数据处理方法实施例的各个步骤,且能达到相同的技术效果,为避免重复,这里不再赘述。
需要说明的是,本申请实施例中的电子设备包括上述所述的移动电子设备和非移动电子设备。
图9为实现本申请实施例的一种电子设备的硬件结构示意图。
该电子设备900包括但不限于:射频单元901、网络模块902、音频输出单元903、输入单元904、传感器905、显示单元906、用户输入单元907、接口单元908、存储器909、以及处理器910等部件。
本领域技术人员可以理解,电子设备900还可以包括给各个部件供电的电源(比如电池),电源可以通过电源管理系统与处理器910逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。图9中示出的电子设备结构并不构成对电子设备的限定,电子设备可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置,在此不再赘述。
其中,输入单元904,用于获取第一媒体数据和增益数据流;
处理器910,用于根据所述增益数据流,确定所述增益数据流的流描述信息;
处理器910,用于根据所述第一媒体数据、所述增益数据流和所述流描述信息生成第一文件,并控制存储器909存储所述第一文件,其中,所述第一文件包括:所述第一媒体数据、所述增益数据流、所述流描述信息、与所述增益数据流关联的第一校验码以及与所述流描述信息关联的第二校验码;
其中,所述第一校验码用于在所述第一文件中标识关联的增益数据流;所述第二校验码用于在所述第一文件中标识关联的流描述信息。
可选地,所述流描述信息包括以下至少一项:
所述增益数据流的目标标识;
所述增益数据流的类型;
所述增益数据流对应的业务;
所述增益数据流的尺寸;
使用所述第一文件的模块;
所述增益数据流的声明主体;
所述增益数据流的属性信息。
可选地,所述第一文件还包括:N和与所述N关联的第三校验码,N为正整数;
其中,所述N的取值为所述第一文件中的增益数据流的数量,所述第三校验码用于在所述第一文件中标识关联的所述N。
可选地,在N为大于1的整数的情况下,所述第一文件包括按顺序排列的以下信息:
所述第一媒体数据、N个所述第一校验码和各自对应的增益数据流、N个所述第二校验码和各自对应的流描述信息、所述第三校验码和关联的所述N。
可选地,在处理器910控制存储器909存储所述第一文件之后,处理器910,还用于:
读取所述第一文件;
根据所述第三校验码、所述N的取值、N个所述第二校验码和各自对应的流描述信息、N个所述第一校验码和各自对应的增益数据流,确定目标增益流数据;
基于所述目标增益数据流调整所述第一媒体数据的增益,得到第二媒体数据;
控制音频输出单元903或显示单元906和接口单元908输出所述第二媒体数据。
可选地,处理器910执行的所述根据所述第三校验码、所述N的取值、N个所述第二校验码和各自对应的流描述信息、N个所述第一校验码和各自对应的增益数据流,确定目标增益流数据,包括:
根据所述第三校验码从所述第一文件中读取所述N;
从所述第一文件中读取N个第二校验码;
根据N个所述第二校验码从所述第一文件中读取各自关联的所述流描述信息中的目标标识;
根据N个所述增益数据流的目标标识,从N个所述增益数据流中,选择目标增益数据流;
根据所述目标增益数据流关联的所述第一校验码,从所述第一文件中读取所述目标增益数据流。
可选地,所述第一文件还包括拓展信息,其中,所述拓展信息包括以下至少一项:
与历史版本的兼容信息;
扩展信息;
所述扩展信息的长度;
与所述扩展信息关联的第四校验码,其中,所述第四校验码用于在所述第一文件中标识关联的所述扩展信息;
第五校验码,所述第五校验信息用于校验所述第一文件的有效性。
应理解的是,本申请实施例中,输入单元904可以包括图形处理器(Graphics Processing Unit,GPU)9041和麦克风9042,图形处理器9041对在视频捕获模式或图像捕获模式中由图像捕获装置(如摄像头)获得的静态图片或视频的图像数据进行处理。显示单元906可包括显示面板9061,可以采用液晶显示器、有机发光二极管等形式来配置显示面板9061。用户输入单元907包括触控面板9071以及其他输入设备9072中的至少一种。触控面板9071,也称为触摸屏。触控面板9071可包括触摸检测装置和触摸控制器两个部分。其他输入设备9072可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆,在此不再赘述。
存储器909可用于存储软件程序以及各种数据。存储器909可主要包括存储程序或指令的第一存储区和存储数据的第二存储区,其中,第一存储区可存储操作系统、至少一个功能所需的应用程序或指令(比如声音播放功能、图像播放功能等)等。此外,存储器909可以包括易失性存储器或非易失性存储器,或者,存储器909 可以包括易失性和非易失性存储器两者。其中,非易失性存储器可以是只读存储器(Read-Only Memory,ROM)、可编程只读存储器(Programmable ROM,PROM)、可擦除可编程只读存储器(Erasable PROM,EPROM)、电可擦除可编程只读存储器(Electrically EPROM,EEPROM)或闪存。易失性存储器可以是随机存取存储器(Random Access Memory,RAM),静态随机存取存储器(Static RAM,SRAM)、动态随机存取存储器(Dynamic RAM,DRAM)、同步动态随机存取存储器(Synchronous DRAM,SDRAM)、双倍数据速率同步动态随机存取存储器(Double Data Rate SDRAM,DDRSDRAM)、增强型同步动态随机存取存储器(Enhanced SDRAM,ESDRAM)、同步连接动态随机存取存储器(Synch link DRAM,SLDRAM)和直接内存总线随机存取存储器(Direct Rambus RAM,DRRAM)。本申请实施例中的存储器909包括但不限于这些和任意其它适合类型的存储器。
处理器910可包括一个或多个处理单元;可选的,处理器910集成应用处理器和调制解调处理器,其中,应用处理器主要处理涉及操作系统、用户界面和应用程序等的操作,调制解调处理器主要处理无线通信信号,如基带处理器。可以理解的是,上述调制解调处理器也可以不集成到处理器910中。
本申请实施例还提供一种可读存储介质,所述可读存储介质上存储有程序或指令,该程序或指令被处理器执行时实现上述媒体数据处理方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。
其中,所述处理器为上述实施例中所述的电子设备中的处理器。所述可读存储介质,包括计算机可读存储介质,如计算机只读存储器ROM、随机存取存储器RAM、磁碟或者光盘等。
本申请实施例另提供了一种芯片,所述芯片包括处理器和通信接口,所述通信接口和所述处理器耦合,所述处理器用于运行程序或指令,实现上述媒体数据处理方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。
应理解,本申请实施例提到的芯片还可以称为系统级芯片、系统芯片、芯片系统或片上系统芯片等。
本申请实施例提供一种计算机程序产品,该程序产品被存储在存储介质中,该程序产品被至少一个处理器执行以实现如上述媒体数据处理方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。此外,需要指出的是,本申请实施方式中的方法和装置的范围不限按示 出或讨论的顺序来执行功能,还可包括根据所涉及的功能按基本同时的方式或按相反的顺序来执行功能,例如,可以按不同于所描述的次序来执行所描述的方法,并且还可以添加、省去、或组合各种步骤。另外,参照某些示例所描述的特征可在其他示例中被组合。
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以计算机软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端(可以是手机,计算机,服务器,或者网络设备等)执行本申请各个实施例所述的方法。
上面结合附图对本申请的实施例进行了描述,但是本申请并不局限于上述的具体实施方式,上述的具体实施方式仅仅是示意性的,而不是限制性的,本领域的普通技术人员在本申请的启示下,在不脱离本申请宗旨和权利要求所保护的范围情况下,还可做出很多形式,均属于本申请的保护之内。

Claims (17)

  1. 一种媒体数据处理方法,包括:
    获取第一媒体数据和增益数据流;
    根据所述增益数据流,确定所述增益数据流的流描述信息;
    根据所述第一媒体数据、所述增益数据流和所述流描述信息生成第一文件,并存储所述第一文件,其中,所述第一文件包括:所述第一媒体数据、所述增益数据流、所述流描述信息、与所述增益数据流关联的第一校验码以及与所述流描述信息关联的第二校验码;
    其中,所述第一校验码用于在所述第一文件中标识关联的增益数据流;所述第二校验码用于在所述第一文件中标识关联的流描述信息。
  2. 根据权利要求1所述的方法,其中,所述流描述信息包括以下至少一项:
    所述增益数据流的目标标识;
    所述增益数据流的类型;
    所述增益数据流对应的业务;
    所述增益数据流的尺寸;
    使用所述第一文件的模块;
    所述增益数据流的声明主体;
    所述增益数据流的属性信息。
  3. 根据权利要求1所述的方法,其中,所述第一文件还包括:N以及与所述N关联的第三校验码,N为正整数;
    其中,所述N的取值为所述第一文件中的增益数据流的数量,所述第三校验码用于在所述第一文件中标识关联的所述N。
  4. 根据权利要求3所述的方法,其中,在N为大于1的整数的情况下,所述第一文件包括按顺序排列的以下信息:
    所述第一媒体数据、N个所述第一校验码和各自对应的增益数据流、N个所述第二校验码和各自对应的流描述信息、所述第三校验码和关联的所述N。
  5. 根据权利要求4所述的方法,其中,在所述存储所述第一文件之后,所述方法还包括:
    读取所述第一文件;
    根据所述第三校验码、所述N的取值、N个所述第二校验码和各自对应的流描述信息、N个所述第一校验码和各自对应的增益数据流,确定目标增益流数据;
    基于所述目标增益数据流调整所述第一媒体数据的增益,得到第二媒体数据;
    输出所述第二媒体数据。
  6. 根据权利要求5所述的方法,其中,所述根据所述第三校验码、所述N的取 值、N个所述第二校验码和各自对应的流描述信息、N个所述第一校验码和各自对应的增益数据流,确定目标增益流数据,包括:
    根据所述第三校验码从所述第一文件中读取所述N;
    从所述第一文件中读取N个第二校验码;
    根据N个所述第二校验码从所述第一文件中读取各自关联的所述流描述信息中的目标标识;
    根据N个所述增益数据流的目标标识,从N个所述增益数据流中,选择目标增益数据流;
    根据所述目标增益数据流关联的所述第一校验码,从所述第一文件中读取所述目标增益数据流。
  7. 根据权利要求1至6中任一项所述的方法,其中,所述第一文件还包括拓展信息,其中,所述拓展信息包括以下至少一项:
    与历史版本的兼容信息;
    扩展信息;
    所述扩展信息的长度;
    与所述扩展信息关联的第四校验码,其中,所述第四校验码用于在所述第一文件中标识关联的所述扩展信息;
    第五校验码,所述第五校验信息用于校验所述第一文件的有效性。
  8. 一种媒体数据处理装置,包括:
    获取模块,用于获取第一媒体数据和增益数据流;
    第一确定模块,用于根据所述增益数据流,确定所述增益数据流的流描述信息;
    数据处理模块,用于根据所述第一媒体数据、所述增益数据流和所述流描述信息生成第一文件,并存储所述第一文件,其中,所述第一文件包括:所述第一媒体数据、所述增益数据流、所述流描述信息、与所述增益数据流关联的第一校验码以及与所述流描述信息关联的第二校验码;
    其中,所述第一校验码用于在所述第一文件中标识关联的增益数据流;所述第二校验码用于在所述第一文件中标识关联的流描述信息。
  9. 根据权利要求8所述的装置,其中,所述流描述信息包括以下至少一项:
    所述增益数据流的目标标识;
    所述增益数据流的类型;
    所述增益数据流对应的业务;
    所述增益数据流的尺寸;
    使用所述第一文件的模块;
    所述增益数据流的声明主体;
    所述增益数据流的属性信息。
  10. 根据权利要求8所述的装置,其中,所述第一文件还包括:N以及与所述N关联的第三校验码,N为正整数;
    其中,所述N的取值为所述第一文件中的增益数据流的数量,所述第三校验码用于在所述第一文件中标识关联的所述N。
  11. 根据权利要求10所述的装置,其中,在N为大于1的整数的情况下,所述第一文件包括按顺序排列的以下信息:
    所述第一媒体数据、N个所述第一校验码和各自关联的增益数据流、N个所述第二校验码和各自关联的流描述信息、所述第三校验码和关联的所述N。
  12. 根据权利要求11所述的装置,其中,还包括:
    读取模块,用于读取所述第一文件;
    第二确定模块,用于根据所述第三校验码、所述N的取值、N个所述第二校验码和各自对应的流描述信息、N个所述第一校验码和各自对应的增益数据流,确定目标增益流数据;
    增益调整模块,用于基于所述目标增益数据流调整所述第一媒体数据的增益,得到第二媒体数据;
    输出模块,用于输出所述第二媒体数据。
  13. 根据权利要求12所述的装置,其中,所述第二确定模块,包括:
    第一读取单元,用于根据所述第三校验码从所述第一文件中读取所述N;
    第二读取单元,用于从所述第一文件中读取N个第二校验码;
    第三读取单元,用于根据N个所述第二校验码从所述第一文件中读取各自关联的所述流描述信息中的目标标识;
    选择单元,用于根据N个所述增益数据流的目标标识,从N个所述增益数据流中,选择目标增益数据流;
    第四读取单元,用于根据所述目标增益数据流关联的所述第一校验码,从所述第一文件中读取所述目标增益数据流。
  14. 根据权利要求8至12中任一项所述的装置,其中,所述第一文件还包括拓展信息,其中,所述拓展信息包括以下至少一项:
    与历史版本的兼容信息;
    扩展信息;
    所述扩展信息的长度;
    与所述扩展信息关联的第四校验码,其中,所述第四校验码用于在所述第一文件中标识关联的所述扩展信息;
    第五校验码,所述第五校验信息用于校验所述第一文件的有效性。
  15. 一种电子设备,包括处理器和存储器,所述存储器存储可在所述处理器上运行的程序或指令,所述程序或指令被所述处理器执行时实现如权利要求1至7中任 一项所述的媒体数据处理方法的步骤。
  16. 一种可读存储介质,所述可读存储介质上存储程序或指令,所述程序或指令被处理器执行时实现如权利要求1至7中任一项所述的媒体数据处理方法的步骤。
  17. 一种芯片,所述芯片包括处理器和通信接口,所述通信接口和所述处理器耦合,所述处理器用于运行程序或指令,实现如权利要求1至7中任一项所述的方法。
PCT/CN2024/096773 2023-06-06 2024-05-31 媒体数据处理方法、装置、电子设备及可读存储介质 Ceased WO2024251049A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP24818581.1A EP4727151A1 (en) 2023-06-06 2024-05-31 Media data processing method and apparatus, electronic device, and readable storage medium
US19/398,400 US20260079817A1 (en) 2023-06-06 2025-11-24 Media data processing method and apparatus, electronic device, and readable storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202310667267.5A CN116647761B (zh) 2023-06-06 2023-06-06 媒体数据处理方法、装置、电子设备及可读存储介质
CN202310667267.5 2023-06-06

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US19/398,400 Continuation US20260079817A1 (en) 2023-06-06 2025-11-24 Media data processing method and apparatus, electronic device, and readable storage medium

Publications (1)

Publication Number Publication Date
WO2024251049A1 true WO2024251049A1 (zh) 2024-12-12

Family

ID=87639799

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2024/096773 Ceased WO2024251049A1 (zh) 2023-06-06 2024-05-31 媒体数据处理方法、装置、电子设备及可读存储介质

Country Status (4)

Country Link
US (1) US20260079817A1 (zh)
EP (1) EP4727151A1 (zh)
CN (1) CN116647761B (zh)
WO (1) WO2024251049A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116647761B (zh) * 2023-06-06 2025-09-02 维沃移动通信有限公司 媒体数据处理方法、装置、电子设备及可读存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011113627A (ja) * 2009-11-30 2011-06-09 Renesas Electronics Corp オーディオ利得同期方法、オーディオ利得同期装置
CN113891078A (zh) * 2021-11-08 2022-01-04 成都微光集电科技有限公司 图像处理装置及方法
CN114402572A (zh) * 2019-09-13 2022-04-26 六科股份有限公司 使用带内元数据作为访问参考指纹的基础,以促进与内容相关的动作
CN114554212A (zh) * 2021-12-31 2022-05-27 深圳市大疆创新科技有限公司 视频处理装置及方法、计算机存储介质
CN116647761A (zh) * 2023-06-06 2023-08-25 维沃移动通信有限公司 媒体数据处理方法、装置、电子设备及可读存储介质

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11715184B2 (en) * 2020-09-23 2023-08-01 Apple Inc. Backwards-compatible high dynamic range (HDR) images
CN113691816B (zh) * 2021-08-16 2024-08-27 维沃移动通信(杭州)有限公司 图像显示方法、装置、显示设备及存储介质
CN115914666B (zh) * 2022-11-28 2025-03-28 中国电信股份有限公司 用户识别方法、装置、电子设备及非易失性存储介质

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011113627A (ja) * 2009-11-30 2011-06-09 Renesas Electronics Corp オーディオ利得同期方法、オーディオ利得同期装置
CN114402572A (zh) * 2019-09-13 2022-04-26 六科股份有限公司 使用带内元数据作为访问参考指纹的基础,以促进与内容相关的动作
CN113891078A (zh) * 2021-11-08 2022-01-04 成都微光集电科技有限公司 图像处理装置及方法
CN114554212A (zh) * 2021-12-31 2022-05-27 深圳市大疆创新科技有限公司 视频处理装置及方法、计算机存储介质
CN116647761A (zh) * 2023-06-06 2023-08-25 维沃移动通信有限公司 媒体数据处理方法、装置、电子设备及可读存储介质

Also Published As

Publication number Publication date
US20260079817A1 (en) 2026-03-19
CN116647761A (zh) 2023-08-25
CN116647761B (zh) 2025-09-02
EP4727151A1 (en) 2026-04-15

Similar Documents

Publication Publication Date Title
EP2352120B1 (en) Network-based access to auxiliary data based on steganographic information
US7010144B1 (en) Associating data with images in imaging systems
US20150035999A1 (en) Method for sharing digital photos securely
CN112804459A (zh) 基于虚拟摄像头的图像展示方法、装置、存储介质及电子设备
TWI591575B (zh) 用於增進已擷取資料的方法及系統
US11190653B2 (en) Techniques for capturing an image within the context of a document
CN112929557A (zh) 一种拍摄方法、装置、终端及存储介质
US9973649B2 (en) Photographing apparatus, photographing system, photographing method, and recording medium recording photographing control program
US20150036020A1 (en) Method for sharing original photos along with final processed image
US20260079817A1 (en) Media data processing method and apparatus, electronic device, and readable storage medium
WO2024163777A1 (en) Systems and methods for imaging with a first camera to simulate a second camera
KR20150057736A (ko) 백업 정보를 디스플레이 하여 이미지 파일을 관리하는 장치 및 방법
WO2025195278A1 (zh) 图像处理方法、图像处理装置和电子设备
CN114726997B (zh) 图像存储及读取方法、装置、电子设备及存储介质
US20150112997A1 (en) Method for content control and electronic device thereof
US20040130636A1 (en) Electronic image intent attribute
CN110647500A (zh) 文件存储方法、装置、终端及计算机可读存储介质
KR20200114348A (ko) 증강현실의 공간맵을 이용한 콘텐츠 공유 장치 및 그 방법
TWI493491B (zh) 辨識社群網站相片真偽之系統、裝置與方法
CN110009646B (zh) 一种电子相册的生成方法、装置、电子设备及存储介质
KR102249865B1 (ko) 전자앨범 생성 시스템
US8224878B2 (en) Apparatus and method for managing content data using content data information in an information terminal
JP7771984B2 (ja) 情報処理装置および方法、並びに、プログラム
CN120529169A (zh) 数据处理方法、装置、电子设备及存储介质
US20140280258A1 (en) Methods and apparatus for exporting digital content using a profile

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24818581

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2024818581

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2024818581

Country of ref document: EP

Effective date: 20260107

ENP Entry into the national phase

Ref document number: 2024818581

Country of ref document: EP

Effective date: 20260107

ENP Entry into the national phase

Ref document number: 2024818581

Country of ref document: EP

Effective date: 20260107

ENP Entry into the national phase

Ref document number: 2024818581

Country of ref document: EP

Effective date: 20260107

WWP Wipo information: published in national office

Ref document number: 2024818581

Country of ref document: EP