WO2024251049A1 - 媒体数据处理方法、装置、电子设备及可读存储介质 - Google Patents
媒体数据处理方法、装置、电子设备及可读存储介质 Download PDFInfo
- Publication number
- WO2024251049A1 WO2024251049A1 PCT/CN2024/096773 CN2024096773W WO2024251049A1 WO 2024251049 A1 WO2024251049 A1 WO 2024251049A1 CN 2024096773 W CN2024096773 W CN 2024096773W WO 2024251049 A1 WO2024251049 A1 WO 2024251049A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- stream
- file
- gain data
- gain
- data stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/741—Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Prevention of errors by analysis, debugging or testing of software
- G06F11/3604—Analysis of software for verifying properties of programs
- G06F11/3608—Analysis of software for verifying properties of programs using formal methods, e.g. model checking, abstract interpretation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/51—Control of the gain
Definitions
- the present application belongs to the field of data processing technology, and specifically relates to a media data processing method, device, electronic device and readable storage medium.
- a storage gain map (Gainmap) is added to the image such as JPEG.
- the Gainmap storage method in the related art has the problem of being inconvenient to find a specified Gainmap.
- the purpose of the embodiments of the present application is to provide a media data processing method, device, electronic device and readable storage medium, which can quickly locate the position of the gain data stream and stream description information in the media data, thereby facilitating the search of the media data.
- an embodiment of the present application provides a method for processing media data, the method comprising:
- the first file includes: the first media data, the gain data stream, the stream description information, a first check code associated with the gain data stream, and a second check code associated with the stream description information;
- the first check code is used to identify the associated gain data stream in the first file; and the second check code is used to identify the associated stream description information in the first file.
- an embodiment of the present application provides a media data processing device, the device comprising:
- An acquisition module used to acquire first media data and a gain data stream
- a first determining module configured to determine stream description information of the gain data stream according to the gain data stream
- a data processing module configured to generate a first file according to the first media data, the gain data stream and the stream description information, and store the first file, wherein the first file includes: data, the gain data stream, the stream description information, a first check code associated with the gain data stream, and a second check code associated with the stream description information;
- the first check code is used to identify the associated gain data stream in the first file; and the second check code is used to identify the associated stream description information in the first file.
- an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.
- an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.
- an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.
- an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.
- the stream description information of each gain data stream can be found from the first file based on the second check code, and the required target gain data stream can be selected according to the stream description information, and then the target gain data stream can be found in the first file based on the first check code associated with the target gain data stream. It is not necessary to decode, identify, and other operations on all the gain data streams in the first file, and it is possible to find and read the target gain data stream from the first file.
- FIG1 is a flow chart of a method for processing media data provided by an embodiment of the present application.
- FIG. 2 is a schematic diagram of the architecture of a JPEG file
- FIG3 is one of the schematic diagrams of the architecture of the first file in an embodiment of the present application.
- FIG4 is a second schematic diagram of the structure of the first file in an embodiment of the present application.
- FIG5 is a third schematic diagram of the structure of the first file in an embodiment of the present application.
- FIG6 is a schematic diagram of the architecture of extended information in an embodiment of the present application.
- FIG7 is a schematic diagram of the structure of a media data processing device provided in an embodiment of the present application.
- FIG8 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.
- FIG. 9 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.
- first, second, etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first”, “second”, etc. are generally of one type, and the number of objects is not limited.
- the first object can be one or more.
- “and/or” in the specification and claims represents at least one of the connected objects, and the character “/" generally indicates that the objects associated with each other are in an "or” relationship.
- the high dynamic range photo display function can be understood as an extended display function of HDR.
- the Android system there is a unified standard for storing gainmap in JPEG-R, that is, a gainmap is stored after the JPEG data.
- a gainmap is stored after the JPEG data.
- the data content in the JPEG file is decoded and identified to obtain the data content of the gainmap.
- the ISO standardization organization is also developing standards related to gainmap.
- a new storage standard is proposed to use a check code to identify a gain data stream, including: a data stream of a Gainmap or other type of gain data, and a stream description information of the gain data stream.
- the respectively associated stream description information can be accurately located from the stored media file (i.e., the first file)
- the required target gain data stream can be searched, and then based on the check code associated with the target gain data stream, the target gain data stream can be accurately located from the stored media file (i.e., the first file).
- a media data processing method provided in an embodiment of the present application may include the following steps:
- Step 101 Obtain first media data and gain data stream.
- the first media data may be media data such as pictures, audio, and video.
- the first media data is usually taken as a picture, such as a JPEG picture, and is not specifically limited here.
- the first media data is a picture generated when a shooting operation is completed.
- the schematic diagram of the architecture of the JPEG file corresponding to the picture may be as shown in FIG. 2 .
- the gain data stream can be used to adjust the gain of the first media data.
- the gain data stream can be a Gainmap stream.
- the brightness gain in the JPEG picture can be adjusted based on the Gainmap stream to achieve a high dynamic range image display function.
- gain data stream is related to the type of the first media data.
- gain data streams related to pictures such as Gainmap stream and watermark stream can be used; for audio, gain data streams related to audio can be used; for video, gain data streams related to video can be used.
- the gain data stream in the first file may be a Gainmap stream in RGBA format, a Gainmap stream in YUV format, or data obtained by encoding the Gainmap stream in YUV format.
- the media data processing method provided in the embodiment of the present application can convert the Gainmap stream from RGBA format to YUV format, and then encode the Gainmap stream in YUV format into formats such as JPEG and PNG, and add it to the picture data content in the JPEG file, that is, after JPEG DATA; alternatively, the Gainmap stream in YUV format may not be encoded, but the Gainmap stream in YUV format may be added after JPEG DATA in the JPEG file; alternatively, the Gainmap stream in RGBA format may be directly added after JPEG DATA in the JPEG file.
- the first media data is usually a picture
- the gain data stream is a gain data stream related to the picture, such as a Gainmap stream and a watermark stream.
- the type of the gain data stream and the type of the first media data are not limited herein.
- the number of the gain data streams may be one or at least two.
- the gain data stream includes Gainmap stream and other gain streams, wherein the other gain streams may be watermark streams and other streams different from the Gainmap stream.
- the gain data stream includes at least two Gainmap streams of different sizes, such as a full-size Gainmap stream, a 1/2-size Gainmap stream, a 1/4-size Gainmap stream, etc.
- Step 102 Determine stream description information of the gain data stream according to the gain data stream.
- the stream description information may be used to describe the features of the gain data stream, for example, describing the purpose, encoding format, number of channels, etc. of the gain data stream. In this way, a gain data stream that meets the requirements may be searched based on the stream description information.
- the flow description information includes at least one of the following:
- the attribute information of the gain data stream is the attribute information of the gain data stream.
- the target identifier is used to uniquely identify each gain data stream in the first file. For example, assuming that the gain data stream is a Gainmap stream, the target identifier is the key of the Gainmap stream.
- the key can be pre-associated with the type, data format, etc. of the Gainmap steam.
- the stream description information is shown in Table 2 below:
- the first 4 bytes “0x0003" in Key: 0x00030001 are used to indicate that the type of the gain data stream is Gainmap stream, and the last 4 bytes “0x0001" are used to indicate the business type of the Gainmap stream, such as the specific purpose of the Gainmap stream.
- the Key can be divided into two parts, one part is used to indicate the general type of the stream, and the other part is used to indicate the specific type of the stream in the general classification.
- the size of the Gainmap stream data in Table 2 above may be the number of bits of the Gainmap stream data.
- the module using the first file may indicate the module that needs to use the first file, such as the photo album application. Application, App or Camera App, etc.
- the above-mentioned declaration subject may be the manufacturer of the electronic device that executes the media data processing method provided in the embodiment of the present application.
- the attribute information of the gain data stream can be recorded.
- the XDR2.0 parameter can indicate that the gain data stream is a Gainmap stream defined according to the rule XDR2.0, where XDR2.0 can be the definition rule of the parameters in the Gainmap stream, i.e., Extreme Dynamic Range (XDR) version 2.0.
- XDR2.0 can be the definition rule of the parameters in the Gainmap stream, i.e., Extreme Dynamic Range (XDR) version 2.0.
- Step 103 Generate a first file based on the first media data, the gain data stream and the stream description information, and store the first file, wherein the first file includes: the first media data, the gain data stream, the stream description information, a first check code associated with the gain data stream, and a second check code associated with the stream description information; wherein the first check code is used to identify the associated gain data stream in the first file; and the second check code is used to identify the associated stream description information in the first file.
- the gain data stream, the stream description information, the first check code associated with the gain data stream, and the second check code associated with the stream description information can be added after the first media data to form a first file. In this way, since the encoding Stream of the Gainmap is saved at the end of the original image Jpeg, this will not affect the normal display of the original image.
- the first check code is associated with the gain data stream, which can be achieved by adding a fixed first check code before each gain data stream.
- the second check code is associated with the stream description information, which can be achieved by adding a fixed second check code before the stream description information of each gain data stream.
- the first media data is picture data
- the first check code is the string “Gainmapdata”
- the second check code is the string “Gainmapinfo”
- “Gainmapdata+gain data stream data content” can be added after the picture data content: JPG data
- “Gainmapinfo+stream description information” can be added after “Gainmapdata+gain data stream data content”.
- the stream description information of the gain data stream in the first file can be accurately located by identifying Gainmapinfo
- the data content of the gain data stream in the first file can be accurately located by identifying Gainmapdata.
- the number of the gain data streams may be one or at least two.
- the first file further includes: N and a third check code associated with N, where N is a positive integer;
- the value of N is the number of gain data streams in the first file, and the third check code is used to identify the associated N in the first file.
- Gainmap Streams or other Streams can be written into an image file (taking Jpeg as an example) and combined into a method that does not affect the original file but can quickly obtain any required Stream.
- the camera preview interface For example: open the camera preview interface, and then enter the mode that requires generating multiple gainmap streams. Or generate a gainmap stream and other streams, such as a watermark stream, and click the photo button to take a photo.
- a gainmap stream and other streams such as a watermark stream
- click the photo button to take a photo.
- at least one gainmap is generated, wherein different gainmaps can be generated in different sizes, such as full size, 1/4 size or 1/16 size gainmap streams, and a watermark stream may be generated.
- the photos taken, the gainmap streams of different sizes, and the watermark stream need to be packaged into the first file.
- the initial value of N can be equal to 0, and each time a stream is generated, the value of N increases by 1, so that the value of N can change with the number of streams.
- the number of gain data streams in the first file can be indicated by N, and the N can be accurately located from the first file through the third check code.
- the method further includes:
- the second media data is output.
- the reading order of the first file may be from back to front, that is, the reading order is: the third check code, the value of N, N of the second check codes and their corresponding stream description information, N of the first check codes and their corresponding gain data streams, and the first media data.
- the first media data may be read first, and then the third check code, the value of N, N second check codes and their corresponding stream description information, N first check codes and their corresponding gain data streams may be read in sequence, so as to search for and read the required target gain data stream according to the third check code, the second check code and the stream description information, and the first check code.
- the third check code can be first identified from the first file, such as the string "streamcount” shown in FIG. 5, and then N is read according to the identified third check code; then, according to the value of N, it is determined that the number of gain data streams included in the first file is equal to N, and then the N second check codes can be searched for respectively, and the stream description information associated with each of the N check codes can be read from the first file, so as to find the required target gain data stream according to the N stream description information, and finally, the target gain data stream is found from the first file according to the first check code associated with the target gain data stream.
- the same gain data stream and its stream description information may be stored in adjacent positions in the first file, so that when it is determined that the gain data stream described by the target stream description information is the required gain data stream, it may be determined that the gain data stream adjacent to the target stream description information is the target gain data stream.
- the data contents of the three gain data streams and their first check codes and the corresponding stream description information and their second check codes are located in adjacent storage areas in the first file.
- the storage order of the first check code, the data contents of the gain data stream, the second check code, and the stream description information is: first check code + data contents of the gain data stream -> second check code Verification code + flow description information.
- the first file includes the following information arranged in sequence:
- the first media data N first check codes and their corresponding gain data streams, N second check codes and their corresponding stream description information, the third check code and the associated N.
- the method of outputting the second media data can be determined based on the data type of the second media data. For example, when the second media data is a picture, the picture can be displayed on a display screen; when the second media data is audio data, the audio can be played through a speaker.
- the outputting of the second media data may be transmitting the processed second media data to other devices via wired transmission or air interface transmission, which will not be elaborated herein.
- N gain data streams can be stored in sequence in a certain order, and then N stream description information can be stored after the N gain data streams in the same order. In this way, when it is determined that the gain data stream described by the i-th stream description information is the required gain data stream, it can be determined that the i-th gain data stream is the target gain data stream.
- the target gain stream data is determined in accordance with the third check code, the value of N, N second check codes and their corresponding stream description information, N first check codes and their corresponding gain data streams in sequence.
- the target gain stream data may be determined according to the third check code, the second check code, part or all of the stream description information, the first check code and the gain data stream.
- determining the target gain stream data in sequence according to the third check code, the value of N, N second check codes and their corresponding stream description information, and N first check codes and their corresponding gain data streams includes:
- the target gain data stream is read from the first file according to the first check code associated with the target gain data stream.
- the target identifier is a key
- the specific content of the key is shown in Table 2. It can be seen that the target gain data stream can be selected based on the key corresponding to the gain data stream one by one, and the gain data stream type, service type and other information described by the key.
- the association relationship between the key and the information such as the gain data stream type and the service type can be pre-stored in the device that executes the media data processing method provided by the embodiment of the present application, so that when the key is identified, the information such as the gain data stream type and the service type reflected by the key can be obtained.
- the encoding format of each stream can also be determined based on the correspondence between the 4-byte value and the tag in the key as shown in Table 1. In this way, the search for the gain data stream can be achieved by only searching for each key in the stream description information.
- the stream description information of multiple streams shown in Table 3 below includes their respective keys.
- the key of each stream can be divided into two parts.
- One part (the first 4 bytes) is used to indicate the approximate type of the stream, such as Gainmap Stream, or initialized JPEG (initJpeg) Stream, or depth map (DepthMap) Stream, or each watermark frame on the JPEG image (perWatermarkBokehJpeg) Stream, or logo watermark (LogoWaterMark), or time watermark (TimeWaterMark), or horizontal time frame watermark (horizontalTimeFrameWaterMark).
- the Stream used to implement the logo watermark can be found as the watermark data stream according to the key, and the pixel gain in the JPEG picture can be adjusted based on the Stream of the logo watermark to obtain the JPEG picture after the logo watermark is removed.
- the target identifier in the stream description information needs to be identified to realize the gain data stream type corresponding to the target identifier information, thereby realizing the selection of the target gain data stream that meets the needs, which can improve the speed of finding the target gain data stream that meets the needs.
- the first file further includes extended information, wherein the extended information includes at least one of the following:
- a fifth verification code wherein the fifth verification information is used to verify the validity of the first file.
- the extended information can be used as information for retaining the extension or setting information for storing meta data.
- the extended information can specifically include at least one of the following metadata: average gain, maximum gain, minimum gain, etc. of the gain data stream.
- the extended information may be in a form similar to the above-mentioned key:value form, that is, the correspondence between each extended information content and its respective first identifier is pre-stored, and the first identifier is inserted into the extended information.
- the specific extended information content may be obtained according to the first identifier and the pre-stored correspondence between the first identifier and the extended information content.
- compatibility with media data files of historical versions can be achieved, wherein the media data files of historical versions may be other frame structure media data files other than the frame structure of the first file stored in the media data processing method provided in the embodiment of the present application, such as a media data file that does not contain at least one of the first check code, the second check code, and the third check code.
- the extended information includes, from back to front: fixed old version compatibility information, then a fixed fourth check code “cameralbum ⁇ ”, then the 4-byte length of the extended information, then the content of the extended information, and then a fixed fifth check code “XXXX”.
- the fifth check code can be used to implement security verification of the first file.
- the fourth check code "cameralbum ⁇ ” the content of the extended information can be read according to the length of the extended information.
- the fifth check code "XXXX” it is determined that the first file is a file provided by a trusted object, thereby executing the reading of other contents after the extended information in the first file, such as: the third check code, the second check code, the stream description information, the first check code, the gain data stream, etc.; if the fifth check code "XXXX" is not identified, the reading of other contents after the extended information in the first file can be terminated.
- the stream data and the stream description information in the first file can be identified based on the first check code and the second check code, which can simplify the difficulty of finding the stream;
- the at least two streams in a media data when there are at least two streams in a media data, the at least two streams can be orderly managed, checked and searched and located, and the storage and transmission of Meta or Setting can be realized, which facilitates the expansion, transmission and management of pictures.
- the media data processing method provided in the embodiment of the present application can be executed by a media data processing device.
- the media data processing device provided in the embodiment of the present application is described by taking the media data processing device executing the media data processing method as an example.
- a media data processing device 700 provided in an embodiment of the present application may include the following modules:
- An acquisition module 701 is used to acquire first media data and a gain data stream
- a first determining module 702 configured to determine stream description information of the gain data stream according to the gain data stream;
- a data processing module 703 is configured to generate a first file according to the first media data, the gain data stream and the stream description information, and store the first file, wherein the first file includes: the first media data, the gain data stream, the stream description information, a first check code associated with the gain data stream, and a second check code associated with the stream description information;
- the first check code is used to identify the associated gain data stream in the first file; and the second check code is used to identify the associated stream description information in the first file.
- the flow description information includes at least one of the following:
- the attribute information of the gain data stream is the attribute information of the gain data stream.
- the first file further includes: N and a third check code associated with N, where N is a positive integer;
- the value of N is the number of gain data streams in the first file, and the third check code is used to identify the associated N in the first file.
- the first file includes the following information arranged in sequence:
- the first media data N first check codes and their corresponding gain data streams, N second check codes and their corresponding stream description information, the third check code and the associated N.
- the media data processing device 700 further includes:
- a reading module used for reading the first file
- a second determination module configured to determine target gain stream data according to the third check code, the value of N, N second check codes and the corresponding stream description information, and N first check codes and the corresponding gain data streams;
- a gain adjustment module configured to adjust the gain of the first media data based on the target gain data stream to obtain second media data
- An output module configured to output the second media data.
- the second determining module includes:
- a first reading unit configured to read the N from the first file according to the third verification code
- a second reading unit used for reading N second verification codes from the first file
- a third reading unit configured to read target identifiers in the stream description information respectively associated with the N second check codes from the first file
- a selection unit configured to select a target gain data stream from the N gain data streams according to target identifiers of the N gain data streams
- a fourth reading unit is configured to read the target gain data stream from the first file according to the first check code associated with the target gain data stream.
- the first file further includes extended information, wherein the extended information includes at least one of the following:
- a fifth verification code wherein the fifth verification information is used to verify the validity of the first file.
- the media data processing device 700 provided in the embodiment of the present application can implement each step in the method embodiment shown in Figure 1, and can achieve the same or similar beneficial effects as the method embodiment shown in Figure 1. To avoid repetition, it will not be described here.
- the media data processing device in the embodiment of the present application can be an electronic device or a component in the electronic device, such as an integrated circuit or a chip.
- the electronic device can be a terminal or other devices other than a terminal.
- the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR)/virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc.
- NAS Network Attached Storage
- PC personal computer
- TV television
- teller machine a self-service machine
- the media data processing device in the embodiment of the present application may be a device having an operating system.
- the operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
- the media data processing device provided in the embodiment of the present application can implement each process implemented by the method embodiment shown in Figure 1, and will not be described again here to avoid repetition.
- an embodiment of the present application also provides an electronic device 800, including a processor 801 and a memory 802, and the memory 802 stores a program or instruction that can be executed on the processor 801.
- the program or instruction is executed by the processor 801
- the various steps of the above-mentioned media data processing method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
- the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
- FIG. 9 is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.
- the electronic device 900 includes but is not limited to: a radio frequency unit 901, a network module 902, an audio output unit 903, an input unit 904, a sensor 905, a display unit 906, a user input unit 907, an interface unit 908, a memory 909, and a processor 910 and other components.
- the electronic device 900 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 910 through a power management system, so that the power management system can manage charging, discharging, and power consumption.
- a power source such as a battery
- the electronic device structure shown in FIG9 does not constitute a limitation on the electronic device, and the electronic device may include more or fewer components than shown, or combine certain components, or arrange components differently, which will not be described in detail here.
- the input unit 904 is used to obtain the first media data and the gain data stream;
- the processor 910 is configured to determine stream description information of the gain data stream according to the gain data stream;
- the processor 910 is configured to generate a first file according to the first media data, the gain data stream, and the stream description information, and control the memory 909 to store the first file, wherein the first file includes: the first media data, the gain data stream, the stream description information, a first check code associated with the gain data stream, and a second check code associated with the stream description information;
- the first check code is used to identify the associated gain data stream in the first file; and the second check code is used to identify the associated stream description information in the first file.
- the flow description information includes at least one of the following:
- the attribute information of the gain data stream is the attribute information of the gain data stream.
- the first file further includes: N and a third check code associated with N, where N is a positive integer;
- the value of N is the number of gain data streams in the first file, and the third check code is used to identify the associated N in the first file.
- the first file includes the following information arranged in sequence:
- the first media data N first check codes and their corresponding gain data streams, N second check codes and their corresponding stream description information, the third check code and the associated N.
- the processor 910 controls the memory 909 to store the first file
- the processor 910 is further configured to:
- the audio output unit 903 or the display unit 906 and the interface unit 908 are controlled to output the second media data.
- the determining of the target gain stream data according to the third check code, the value of N, N second check codes and respectively corresponding stream description information, N first check codes and respectively corresponding gain data streams performed by the processor 910 includes:
- the target gain data stream is read from the first file according to the first check code associated with the target gain data stream.
- the first file further includes extended information, wherein the extended information includes at least one of the following:
- a fifth verification code wherein the fifth verification information is used to verify the validity of the first file.
- the input unit 904 may include a graphics processing unit (GPU) 9041 and a microphone 9042, and the graphics processor 9041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode.
- the display unit 906 may include a display panel 9061, and the display panel 9061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc.
- the user input unit 907 includes a touch panel 9071 and at least one of other input devices 9072.
- the touch panel 9071 is also called a touch screen.
- the touch panel 9071 may include two parts: a touch detection device and a touch controller.
- Other input devices 9072 may include, but are not limited to, a physical keyboard, function keys (such as a volume control key, a switch key, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.
- the memory 909 can be used to store software programs and various data.
- the memory 909 can mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area can store an operating system, an application program or instruction required for at least one function (such as a sound playback function, an image playback function, etc.).
- the memory 909 can include a volatile memory or a non-volatile memory, or the memory 909 Both volatile and non-volatile memory can be included.
- non-volatile memory can be read-only memory (Read-Only Memory, ROM), programmable read-only memory (Programmable ROM, PROM), erasable programmable read-only memory (Erasable PROM, EPROM), electrically erasable programmable read-only memory (Electrically EPROM, EEPROM) or flash memory.
- ROM Read-Only Memory
- PROM programmable read-only memory
- Erasable PROM Erasable PROM
- EPROM electrically erasable programmable read-only memory
- EEPROM electrically erasable programmable read-only memory
- Volatile memory can be random access memory (Random Access Memory, RAM), static random access memory (Static RAM, SRAM), dynamic random access memory (Dynamic RAM, DRAM), synchronous dynamic random access memory (Synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (Double Data Rate SDRAM, DDRSDRAM), enhanced synchronous dynamic random access memory (Enhanced SDRAM, ESDRAM), synchronous connection dynamic random access memory (Synch link DRAM, SLDRAM) and direct memory bus random access memory (Direct Rambus RAM, DRRAM).
- RAM Random Access Memory
- SRAM static random access memory
- DRAM dynamic random access memory
- DRAM synchronous dynamic random access memory
- SDRAM double data rate synchronous dynamic random access memory
- Double Data Rate SDRAM Double Data Rate SDRAM
- DDRSDRAM double data rate synchronous dynamic random access memory
- Enhanced SDRAM, ESDRAM enhanced synchronous dynamic random access memory
- Synch link DRAM, SLDRAM synchronous connection dynamic random access memory
- the processor 910 may include one or more processing units; optionally, the processor 910 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 910.
- An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored.
- a program or instruction is stored.
- the program or instruction is executed by a processor, each process of the above-mentioned media data processing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
- the processor is the processor in the electronic device described in the above embodiment.
- the readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
- An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned media data processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
- the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
- An embodiment of the present application provides a computer program product, which is stored in a storage medium.
- the program product is executed by at least one processor to implement the various processes of the above-mentioned media data processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
- the methods described herein may include performing functions in the order described or discussed, and may also include performing functions in a substantially simultaneous manner or in a reverse order depending on the functions involved. For example, the methods described may be performed in an order different from that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
- the technical solution of the present application can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
- a storage medium such as ROM/RAM, a disk, or an optical disk
- a terminal which can be a mobile phone, a computer, a server, or a network device, etc.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
- Television Signal Processing For Recording (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims (17)
- 一种媒体数据处理方法,包括:获取第一媒体数据和增益数据流;根据所述增益数据流,确定所述增益数据流的流描述信息;根据所述第一媒体数据、所述增益数据流和所述流描述信息生成第一文件,并存储所述第一文件,其中,所述第一文件包括:所述第一媒体数据、所述增益数据流、所述流描述信息、与所述增益数据流关联的第一校验码以及与所述流描述信息关联的第二校验码;其中,所述第一校验码用于在所述第一文件中标识关联的增益数据流;所述第二校验码用于在所述第一文件中标识关联的流描述信息。
- 根据权利要求1所述的方法,其中,所述流描述信息包括以下至少一项:所述增益数据流的目标标识;所述增益数据流的类型;所述增益数据流对应的业务;所述增益数据流的尺寸;使用所述第一文件的模块;所述增益数据流的声明主体;所述增益数据流的属性信息。
- 根据权利要求1所述的方法,其中,所述第一文件还包括:N以及与所述N关联的第三校验码,N为正整数;其中,所述N的取值为所述第一文件中的增益数据流的数量,所述第三校验码用于在所述第一文件中标识关联的所述N。
- 根据权利要求3所述的方法,其中,在N为大于1的整数的情况下,所述第一文件包括按顺序排列的以下信息:所述第一媒体数据、N个所述第一校验码和各自对应的增益数据流、N个所述第二校验码和各自对应的流描述信息、所述第三校验码和关联的所述N。
- 根据权利要求4所述的方法,其中,在所述存储所述第一文件之后,所述方法还包括:读取所述第一文件;根据所述第三校验码、所述N的取值、N个所述第二校验码和各自对应的流描述信息、N个所述第一校验码和各自对应的增益数据流,确定目标增益流数据;基于所述目标增益数据流调整所述第一媒体数据的增益,得到第二媒体数据;输出所述第二媒体数据。
- 根据权利要求5所述的方法,其中,所述根据所述第三校验码、所述N的取 值、N个所述第二校验码和各自对应的流描述信息、N个所述第一校验码和各自对应的增益数据流,确定目标增益流数据,包括:根据所述第三校验码从所述第一文件中读取所述N;从所述第一文件中读取N个第二校验码;根据N个所述第二校验码从所述第一文件中读取各自关联的所述流描述信息中的目标标识;根据N个所述增益数据流的目标标识,从N个所述增益数据流中,选择目标增益数据流;根据所述目标增益数据流关联的所述第一校验码,从所述第一文件中读取所述目标增益数据流。
- 根据权利要求1至6中任一项所述的方法,其中,所述第一文件还包括拓展信息,其中,所述拓展信息包括以下至少一项:与历史版本的兼容信息;扩展信息;所述扩展信息的长度;与所述扩展信息关联的第四校验码,其中,所述第四校验码用于在所述第一文件中标识关联的所述扩展信息;第五校验码,所述第五校验信息用于校验所述第一文件的有效性。
- 一种媒体数据处理装置,包括:获取模块,用于获取第一媒体数据和增益数据流;第一确定模块,用于根据所述增益数据流,确定所述增益数据流的流描述信息;数据处理模块,用于根据所述第一媒体数据、所述增益数据流和所述流描述信息生成第一文件,并存储所述第一文件,其中,所述第一文件包括:所述第一媒体数据、所述增益数据流、所述流描述信息、与所述增益数据流关联的第一校验码以及与所述流描述信息关联的第二校验码;其中,所述第一校验码用于在所述第一文件中标识关联的增益数据流;所述第二校验码用于在所述第一文件中标识关联的流描述信息。
- 根据权利要求8所述的装置,其中,所述流描述信息包括以下至少一项:所述增益数据流的目标标识;所述增益数据流的类型;所述增益数据流对应的业务;所述增益数据流的尺寸;使用所述第一文件的模块;所述增益数据流的声明主体;所述增益数据流的属性信息。
- 根据权利要求8所述的装置,其中,所述第一文件还包括:N以及与所述N关联的第三校验码,N为正整数;其中,所述N的取值为所述第一文件中的增益数据流的数量,所述第三校验码用于在所述第一文件中标识关联的所述N。
- 根据权利要求10所述的装置,其中,在N为大于1的整数的情况下,所述第一文件包括按顺序排列的以下信息:所述第一媒体数据、N个所述第一校验码和各自关联的增益数据流、N个所述第二校验码和各自关联的流描述信息、所述第三校验码和关联的所述N。
- 根据权利要求11所述的装置,其中,还包括:读取模块,用于读取所述第一文件;第二确定模块,用于根据所述第三校验码、所述N的取值、N个所述第二校验码和各自对应的流描述信息、N个所述第一校验码和各自对应的增益数据流,确定目标增益流数据;增益调整模块,用于基于所述目标增益数据流调整所述第一媒体数据的增益,得到第二媒体数据;输出模块,用于输出所述第二媒体数据。
- 根据权利要求12所述的装置,其中,所述第二确定模块,包括:第一读取单元,用于根据所述第三校验码从所述第一文件中读取所述N;第二读取单元,用于从所述第一文件中读取N个第二校验码;第三读取单元,用于根据N个所述第二校验码从所述第一文件中读取各自关联的所述流描述信息中的目标标识;选择单元,用于根据N个所述增益数据流的目标标识,从N个所述增益数据流中,选择目标增益数据流;第四读取单元,用于根据所述目标增益数据流关联的所述第一校验码,从所述第一文件中读取所述目标增益数据流。
- 根据权利要求8至12中任一项所述的装置,其中,所述第一文件还包括拓展信息,其中,所述拓展信息包括以下至少一项:与历史版本的兼容信息;扩展信息;所述扩展信息的长度;与所述扩展信息关联的第四校验码,其中,所述第四校验码用于在所述第一文件中标识关联的所述扩展信息;第五校验码,所述第五校验信息用于校验所述第一文件的有效性。
- 一种电子设备,包括处理器和存储器,所述存储器存储可在所述处理器上运行的程序或指令,所述程序或指令被所述处理器执行时实现如权利要求1至7中任 一项所述的媒体数据处理方法的步骤。
- 一种可读存储介质,所述可读存储介质上存储程序或指令,所述程序或指令被处理器执行时实现如权利要求1至7中任一项所述的媒体数据处理方法的步骤。
- 一种芯片,所述芯片包括处理器和通信接口,所述通信接口和所述处理器耦合,所述处理器用于运行程序或指令,实现如权利要求1至7中任一项所述的方法。
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP24818581.1A EP4727151A1 (en) | 2023-06-06 | 2024-05-31 | Media data processing method and apparatus, electronic device, and readable storage medium |
| US19/398,400 US20260079817A1 (en) | 2023-06-06 | 2025-11-24 | Media data processing method and apparatus, electronic device, and readable storage medium |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310667267.5A CN116647761B (zh) | 2023-06-06 | 2023-06-06 | 媒体数据处理方法、装置、电子设备及可读存储介质 |
| CN202310667267.5 | 2023-06-06 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US19/398,400 Continuation US20260079817A1 (en) | 2023-06-06 | 2025-11-24 | Media data processing method and apparatus, electronic device, and readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024251049A1 true WO2024251049A1 (zh) | 2024-12-12 |
Family
ID=87639799
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2024/096773 Ceased WO2024251049A1 (zh) | 2023-06-06 | 2024-05-31 | 媒体数据处理方法、装置、电子设备及可读存储介质 |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US20260079817A1 (zh) |
| EP (1) | EP4727151A1 (zh) |
| CN (1) | CN116647761B (zh) |
| WO (1) | WO2024251049A1 (zh) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116647761B (zh) * | 2023-06-06 | 2025-09-02 | 维沃移动通信有限公司 | 媒体数据处理方法、装置、电子设备及可读存储介质 |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011113627A (ja) * | 2009-11-30 | 2011-06-09 | Renesas Electronics Corp | オーディオ利得同期方法、オーディオ利得同期装置 |
| CN113891078A (zh) * | 2021-11-08 | 2022-01-04 | 成都微光集电科技有限公司 | 图像处理装置及方法 |
| CN114402572A (zh) * | 2019-09-13 | 2022-04-26 | 六科股份有限公司 | 使用带内元数据作为访问参考指纹的基础,以促进与内容相关的动作 |
| CN114554212A (zh) * | 2021-12-31 | 2022-05-27 | 深圳市大疆创新科技有限公司 | 视频处理装置及方法、计算机存储介质 |
| CN116647761A (zh) * | 2023-06-06 | 2023-08-25 | 维沃移动通信有限公司 | 媒体数据处理方法、装置、电子设备及可读存储介质 |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11715184B2 (en) * | 2020-09-23 | 2023-08-01 | Apple Inc. | Backwards-compatible high dynamic range (HDR) images |
| CN113691816B (zh) * | 2021-08-16 | 2024-08-27 | 维沃移动通信(杭州)有限公司 | 图像显示方法、装置、显示设备及存储介质 |
| CN115914666B (zh) * | 2022-11-28 | 2025-03-28 | 中国电信股份有限公司 | 用户识别方法、装置、电子设备及非易失性存储介质 |
-
2023
- 2023-06-06 CN CN202310667267.5A patent/CN116647761B/zh active Active
-
2024
- 2024-05-31 EP EP24818581.1A patent/EP4727151A1/en active Pending
- 2024-05-31 WO PCT/CN2024/096773 patent/WO2024251049A1/zh not_active Ceased
-
2025
- 2025-11-24 US US19/398,400 patent/US20260079817A1/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011113627A (ja) * | 2009-11-30 | 2011-06-09 | Renesas Electronics Corp | オーディオ利得同期方法、オーディオ利得同期装置 |
| CN114402572A (zh) * | 2019-09-13 | 2022-04-26 | 六科股份有限公司 | 使用带内元数据作为访问参考指纹的基础,以促进与内容相关的动作 |
| CN113891078A (zh) * | 2021-11-08 | 2022-01-04 | 成都微光集电科技有限公司 | 图像处理装置及方法 |
| CN114554212A (zh) * | 2021-12-31 | 2022-05-27 | 深圳市大疆创新科技有限公司 | 视频处理装置及方法、计算机存储介质 |
| CN116647761A (zh) * | 2023-06-06 | 2023-08-25 | 维沃移动通信有限公司 | 媒体数据处理方法、装置、电子设备及可读存储介质 |
Also Published As
| Publication number | Publication date |
|---|---|
| US20260079817A1 (en) | 2026-03-19 |
| CN116647761A (zh) | 2023-08-25 |
| CN116647761B (zh) | 2025-09-02 |
| EP4727151A1 (en) | 2026-04-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2352120B1 (en) | Network-based access to auxiliary data based on steganographic information | |
| US7010144B1 (en) | Associating data with images in imaging systems | |
| US20150035999A1 (en) | Method for sharing digital photos securely | |
| CN112804459A (zh) | 基于虚拟摄像头的图像展示方法、装置、存储介质及电子设备 | |
| TWI591575B (zh) | 用於增進已擷取資料的方法及系統 | |
| US11190653B2 (en) | Techniques for capturing an image within the context of a document | |
| CN112929557A (zh) | 一种拍摄方法、装置、终端及存储介质 | |
| US9973649B2 (en) | Photographing apparatus, photographing system, photographing method, and recording medium recording photographing control program | |
| US20150036020A1 (en) | Method for sharing original photos along with final processed image | |
| US20260079817A1 (en) | Media data processing method and apparatus, electronic device, and readable storage medium | |
| WO2024163777A1 (en) | Systems and methods for imaging with a first camera to simulate a second camera | |
| KR20150057736A (ko) | 백업 정보를 디스플레이 하여 이미지 파일을 관리하는 장치 및 방법 | |
| WO2025195278A1 (zh) | 图像处理方法、图像处理装置和电子设备 | |
| CN114726997B (zh) | 图像存储及读取方法、装置、电子设备及存储介质 | |
| US20150112997A1 (en) | Method for content control and electronic device thereof | |
| US20040130636A1 (en) | Electronic image intent attribute | |
| CN110647500A (zh) | 文件存储方法、装置、终端及计算机可读存储介质 | |
| KR20200114348A (ko) | 증강현실의 공간맵을 이용한 콘텐츠 공유 장치 및 그 방법 | |
| TWI493491B (zh) | 辨識社群網站相片真偽之系統、裝置與方法 | |
| CN110009646B (zh) | 一种电子相册的生成方法、装置、电子设备及存储介质 | |
| KR102249865B1 (ko) | 전자앨범 생성 시스템 | |
| US8224878B2 (en) | Apparatus and method for managing content data using content data information in an information terminal | |
| JP7771984B2 (ja) | 情報処理装置および方法、並びに、プログラム | |
| CN120529169A (zh) | 数据处理方法、装置、电子设备及存储介质 | |
| US20140280258A1 (en) | Methods and apparatus for exporting digital content using a profile |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 24818581 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2024818581 Country of ref document: EP |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2024818581 Country of ref document: EP Effective date: 20260107 |
|
| ENP | Entry into the national phase |
Ref document number: 2024818581 Country of ref document: EP Effective date: 20260107 |
|
| ENP | Entry into the national phase |
Ref document number: 2024818581 Country of ref document: EP Effective date: 20260107 |
|
| ENP | Entry into the national phase |
Ref document number: 2024818581 Country of ref document: EP Effective date: 20260107 |
|
| WWP | Wipo information: published in national office |
Ref document number: 2024818581 Country of ref document: EP |