WO2023102934A1

WO2023102934A1 - Data processing method, intelligent terminal and storage medium

Info

Publication number: WO2023102934A1
Application number: PCT/CN2021/137245
Authority: WO
Inventors: 尚国强; 肖龙安; 蓝建梁
Original assignee: 深圳传音控股股份有限公司
Priority date: 2021-12-10
Filing date: 2021-12-10
Publication date: 2023-06-15

Abstract

Provided in the present application are a data processing method, an intelligent terminal and a storage medium. The method comprises: an intelligent terminal may acquire a photographing instruction, wherein the photographing instruction is used for instructing the intelligent terminal to photograph image data, and when the image data is photographed, an image information set of the image data may be correspondingly generated in the intelligent terminal, the image information set may be stored in a storage space corresponding to the image data, and when the intelligent terminal needs to transmit the image data, the image information set corresponding to the image data is transmitted synchronously; and the intelligent terminal may acquire a processing instruction for the image data, and when the intelligent terminal processes the image data, the intelligent terminal may acquire parameter information corresponding to an image and record the parameter information in the image information set. By means of the method in the present application, the access efficiency of image data is improved, and the processing efficiency of an intelligent terminal for the image data is improved.

Description

Data processing method, intelligent terminal and storage medium

technical field

The present application relates to the technical field of data processing, and in particular to a data processing method, an intelligent terminal and a storage medium.

Background technique

With the rapid development of electronic technology, many smart terminals have a shooting function. As people's requirements for photos or videos are getting higher and higher, more and more businesses are starting to carry out secondary development based on the image data captured by the camera to improve the imaging effect.

In some implementations, the lenses used by the smart terminal may come from different manufacturers. The lenses from different manufacturers may have different data formats and data contents. The smart terminal can realize the acquisition of image data and sensor data of different lenses by configuring different data interfaces for different lenses, so as to realize the secondary development of image data in the smart terminal.

In the process of conceiving and implementing the secondary development of the image data, the inventor found that for different lenses, the smart terminal needs to be configured with different data interfaces in order to connect image data and sensor data of different data formats and data content to the smart terminal. In the terminal, there is a problem of poor access efficiency.

The foregoing description is provided to provide general background information and does not necessarily constitute prior art.

technical solution

In view of the above technical problems, the present application provides a data processing method, an intelligent terminal and a storage medium, so that users can improve the access efficiency of photographed data, and more effectively complete the secondary development of photographed data.

In order to solve the above technical problems, the present application provides a data processing method that can be applied to smart terminals. The method includes:

Confirming or generating an image information set of image data in response to a shooting instruction;

According to the processing instruction of the image data, parameter information corresponding to the image data when the processing instruction is executed is recorded in the image information set.

Optionally, the image information set includes at least one stage of information, including at least one of the following features:

Each of the stage information corresponds to one of the processing instructions, and one of the processing instructions corresponds to at least one of the stage information;

Each of the stage information includes stage identification and/or information content;

Each of the information contents includes at least one key-value pair, and the key-value pair includes a keyword and parameter information corresponding to the keyword.

Optionally, the stage information also includes at least one of the following features:

The phase information also includes information length;

The phase information also includes reservation information;

The phase information also includes a start marker and/or an end marker.

Optionally, according to the processing instruction of the image data, recording parameter information corresponding to the image data when executing the processing instruction in the image information set includes at least one of the following:

When the processing instruction is a shooting instruction, acquire lens parameters and sensor parameters corresponding to the lens assembly that captures the image data, and store the lens parameters and sensor parameters in at least one of the stage information corresponding to the shooting instruction In the parameter information of the key-value pair;

When the processing instruction is a shooting instruction, acquiring shooting information when shooting the image data, and storing the shooting information in at least one key-value pair of stage information corresponding to the shooting instruction;

When the processing instruction is a storage instruction, obtain the format information of the image data, and store the format information in the parameter information of at least one key-value pair in the stage information corresponding to the storage instruction;

When the processing instruction is an image processing instruction of the image data, acquiring the image processing steps and image processing information, and storing the image processing steps and image processing information in the stage information corresponding to the image processing instruction In the parameter information of at least one key-value pair;

When the processing instruction is image semantic recognition, the semantic information of the image data is acquired, and the semantic information is stored in the parameter information of at least one key-value pair in the stage information corresponding to the image semantic recognition.

Optionally, when the smart terminal includes at least one lens assembly, the acquisition of lens parameters and sensor parameters corresponding to the lens assembly that captures the image data includes at least one of the following:

According to the shooting instruction, determine a lens assembly corresponding to the shooting instruction, where the lens assembly includes a lens and a sensor;

Obtaining lens parameters according to the lens;

According to the sensor, the sensor parameter is acquired.

Optionally, the lens parameters and sensor parameters include at least one item of lens information, sensor information, light intensity information, gain information, exposure information, aperture information, and acceleration information.

Optionally, the method includes at least one of the following:

The shooting information includes geographic location information and/or time information;

The format information includes at least one of length and width information, encoding format, frame type, and frame number of the image data;

The image processing steps and image processing information include at least one of cropping instructions, noise reduction instructions, scaling instructions, and stylization instructions.

Optionally, include at least one of the following:

The semantic information of the image data includes image category and/or target object information;

The image category includes at least one of landscapes, characters, animals, plants, and still lifes;

When the target object is a person, the target object information includes at least one of person location information, face location information, face identity information, number of people information, and person action information;

When the target object is an animal, the target object information includes at least one of animal location information, animal breed information, quantity information, and animal action information;

When the target object is a plant and/or still life, the target object information includes at least one of plant and/or still life position information, plant and/or still life variety information, and quantity information.

The present application also provides a data processing method, which can be applied to a smart terminal, and the method includes:

Obtain the parameter information of the image data;

determining a target data format from at least one data format corresponding to the image data according to the parameter information;

Writing the parameter information into the target data format.

Optionally, the at least one data format is used to record at least one of imaging parameter information when shooting image data, basic parameter information of image data, processing parameter information when image processing, and application parameter information when image application.

Optionally, the data format of the image data includes at least one field of tag serial number, tag name, tag subtable, and table data length.

Optionally, the label sub-table includes at least one field of keyword serial number, keyword, parameter information, and parameter length.

Optionally, when the image data is a photo, the parameter information includes at least one of image length, image width, encoding format, white balance, saturation, and sharpness.

Optionally, when the image data is video, the parameter information includes at least one of image frame number, I frame number, P frame number, B frame number, and image resolution.

The present application also provides an intelligent terminal, including: a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the steps of any one of the above data processing methods are implemented.

The present application also provides a computer-readable storage medium, the storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned data processing method are realized.

As mentioned above, the data processing method of the present application is applied to a smart terminal, and the smart terminal can acquire a shooting instruction. The photographing instruction is used to instruct the smart terminal to photograph image data. When the image data is captured, the image information set of the image data can be correspondingly generated in the smart terminal. The image information set may be stored in a storage space corresponding to the image data. When the smart terminal needs to transmit the image data, the image information set corresponding to the image data will be transmitted synchronously. The smart terminal can obtain the processing instruction of the image data. When the smart terminal processes the image data, the smart terminal can obtain the parameter information corresponding to the image, and record the parameter information in the image information set. Through the above method, the access efficiency of the image data is improved, and the processing efficiency of the image data by the smart terminal is improved.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description serve to explain the principles of the application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the accompanying drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, for those of ordinary skill in the art, the Under the premise, other drawings can also be obtained based on these drawings.

FIG. 1 is a schematic diagram of a hardware structure of an intelligent terminal implementing various embodiments of the present application;

FIG. 2 is a system architecture diagram of a communication network provided by an embodiment of the present application;

FIG. 3 is a schematic diagram of a hardware structure of a controller 140 provided in an embodiment of the present application;

FIG. 4 is a schematic diagram of a hardware structure of a network node 150 provided in an embodiment of the present application;

FIG. 5 is a schematic diagram of a hardware structure of a network node 160 provided in an embodiment of the present application;

FIG. 6 is a schematic diagram of a hardware structure of a controller 170 provided in an embodiment of the present application;

FIG. 7 is a schematic diagram of a hardware structure of a network node 180 provided in an embodiment of the present application;

Fig. 8 is a flowchart of a data processing method shown according to the first embodiment;

Fig. 9 is a flowchart of another data processing method shown according to the first embodiment;

Fig. 10 is a flow chart showing another data processing method according to the first embodiment.

The realization, functional features and advantages of the present application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. By means of the above drawings, specific embodiments of the present application have been shown, which will be described in more detail hereinafter. These drawings and text descriptions are not intended to limit the scope of the concept of the application in any way, but to illustrate the concept of the application for those skilled in the art by referring to specific embodiments.

Embodiment of this application

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present application as recited in the appended claims.

It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the statement "comprising a..." does not exclude the presence of other identical elements in the process, method, article, or device that includes the element. In addition, different implementations of the present application Components, features, and elements with the same name in the example may have the same meaning, or may have different meanings, and the specific meaning shall be determined based on the explanation in the specific embodiment or further combined with the context in the specific embodiment.

It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, the information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of this document, first information may also be called second information, and similarly, second information may also be called first information. Depending on the context, the word "if" as used herein may be interpreted as "at" or "when" or "in response to a determination". Furthermore, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It should be further understood that the terms "comprising", "comprising" indicate the presence of stated features, steps, operations, elements, components, items, species, and/or groups, but do not exclude one or more other features, steps, operations, The existence, occurrence or addition of an element, component, item, species, and/or group. The terms "or", "and/or", "comprising at least one of" and the like used in this application may be interpreted as inclusive, or mean any one or any combination. For example, "including at least one of the following: A, B, C" means "any of the following: A; B; C; A and B; A and C; B and C; A and B and C", another example, " A, B or C" or "A, B and/or C" means "any of the following: A; B; C; A and B; A and C; B and C; A and B and C". Exceptions to this definition will only arise when combinations of elements, functions, steps or operations are inherently mutually exclusive in some way.

It should be understood that although the various steps in the flow chart in the embodiment of the present application are displayed sequentially as indicated by the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some of the steps in the figure may include multiple sub-steps or multiple stages, these sub-steps or stages are not necessarily executed at the same time, but may be executed at different times, and the execution order is not necessarily sequential Instead, it may be performed alternately or alternately with at least a part of other steps or sub-steps or stages of other steps.

Depending on the context, the words "if", "if" as used herein may be interpreted as "at" or "when" or "in response to determining" or "in response to detecting". Similarly, depending on the context, the phrases "if determined" or "if detected (the stated condition or event)" could be interpreted as "when determined" or "in response to the determination" or "when detected (the stated condition or event) )" or "in response to detection of (a stated condition or event)".

It should be noted that, in this article, step codes such as S101 and S102 are used, the purpose of which is to express the corresponding content more clearly and concisely, and does not constitute a substantive limitation on the order. Those skilled in the art may, during specific implementation, S102 will be executed first, followed by S101, etc., but these should be within the protection scope of this application.

It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

In the following description, the use of suffixes such as 'module', 'part' or 'unit' for denoting elements is only for facilitating the description of the present application and has no specific meaning by itself. Therefore, 'module', 'part' or 'unit' may be mixedly used.

Smart terminals can be implemented in various forms. For example, the intelligent terminal described in this application may include such as mobile phone, tablet computer, notebook computer, palmtop computer, PDA (Personal Digital Assistant, personal digital assistant), PMP (Portable Media Player, portable media player), navigation device, Smart terminals such as wearable devices, smart bracelets, and pedometers, as well as fixed terminals such as digital TVs and desktop computers.

In the subsequent description, a smart terminal will be taken as an example, and those skilled in the art will understand that, in addition to elements specially used for mobile purposes, the configurations according to the embodiments of the present application can also be applied to fixed-type terminals.

Please refer to FIG. 1, which is a schematic diagram of the hardware structure of a smart terminal implementing various embodiments of the present application. The smart terminal 100 may include: an RF (Radio Frequency, radio frequency) unit 101, a WiFi module 102, an audio output unit 103, an /V (audio/video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111 and other components. Those skilled in the art can understand that the smart terminal structure shown in Figure 1 does not constitute a limitation on the smart terminal, and the smart terminal may include more or less components than shown in the figure, or combine certain components, or different components layout.

The following is a specific introduction to each component of the smart terminal in conjunction with Figure 1:

The radio frequency unit 101 can be used for sending and receiving information or receiving and sending signals during a call. Specifically, after receiving the downlink information of the base station, it is processed by the processor 110; in addition, the uplink data is sent to the base station. Generally, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with the network and other devices through wireless communication. The above wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication, Global System for Mobile Communications), GPRS (General Packet Radio Service, General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000 , Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access, Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access, Time Division Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution, frequency division duplex long-term evolution), TDD-LTE (Time Division Duplexing-Long Term Evolution, time-division duplex long-term evolution) and 5G, etc.

WiFi is a short-distance wireless transmission technology. Through the WiFi module 102, the smart terminal can help users send and receive emails, browse web pages, and access streaming media, etc., and it provides users with wireless broadband Internet access. Although Fig. 1 shows the WiFi module 102, it can be understood that it is not an essential component of the smart terminal, and can be completely omitted as required without changing the essence of the invention.

The audio output unit 103 can store the information received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 when the smart terminal 100 is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, or the like. The audio data is converted into an audio signal and output as sound. Moreover, the audio output unit 103 may also provide audio output related to specific functions performed by the smart terminal 100 (for example, call signal receiving sound, message receiving sound, etc.). The audio output unit 103 may include a speaker, a buzzer, and the like.

The A/V input unit 104 is used to receive audio or video signals. The A/V input unit 104 may include a GPU (Graphics Processing Unit, graphics processor) 1041 and a microphone 1042, and the graphics processor 1041 is used for still pictures obtained by an image capture device (such as a camera) in video capture mode or image capture mode Video image data is processed. The processed image frames may be displayed on the display unit 106 . The image frames processed by the graphics processor 1041 may be stored in the memory 109 (or other storage media) or sent via the radio frequency unit 101 or the WiFi module 102 . The microphone 1042 can receive sound (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, and the like operating modes, and can process such sound as audio data. The processed audio (voice) data can be converted into a format transmittable to a mobile communication base station via the radio frequency unit 101 for output in case of a phone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the process of receiving and transmitting audio signals.

The smart terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display when the smart terminal 100 moves to the ear. panel 1061 and/or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used for applications that recognize the posture of mobile phones (such as horizontal and vertical screen switching, related Games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tap), etc.; as for mobile phones, fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, Other sensors such as thermometers and infrared sensors will not be described in detail here.

The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in a form such as LCD (Liquid Crystal Display, liquid crystal display), OLED (Organic Light-Emitting Diode, organic light-emitting diode).

The user input unit 107 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the smart terminal. Optionally, the user input unit 107 may include a touch panel 1071 and other input devices 1072 . The touch panel 1071, also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 1071 or near the touch panel 1071). operation), and drive the corresponding connection device according to the preset program. The touch panel 1071 may include two parts, a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device and converts it into contact coordinates , and then sent to the processor 110, and can receive the command sent by the processor 110 and execute it. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071 , the user input unit 107 may also include other input devices 1072 . Optionally, other input devices 1072 may include, but are not limited to, one or more of physical keyboards, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, etc., which are not specifically described here. limited.

Optionally, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits to the processor 110 to determine the type of the touch event, and then the processor 110 determines the touch event according to the touch event. The corresponding visual output is provided on the display panel 1061 . Although in FIG. 1, the touch panel 1071 and the display panel 1061 are used as two independent components to realize the input and output functions of the smart terminal, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated. The implementation of the input and output functions of the smart terminal is not specifically limited here.

The interface unit 108 is used as an interface through which at least one external device can be connected with the smart terminal 100 . For example, an external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 108 can be used to receive input from an external device (for example, data information, power, etc.) transfer data between devices.

The memory 109 can be used to store software programs as well as various data. The memory 109 can mainly include a storage program area and a storage data area. Optionally, the storage program area can store an operating system, at least one function required application program (such as a sound playback function, an image playback function, etc.) etc.; the storage data area can be Store data (such as audio data, phone book, etc.) created according to the use of the mobile phone. In addition, the memory 109 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.

The processor 110 is the control center of the smart terminal, and uses various interfaces and lines to connect various parts of the whole smart terminal, by running or executing software programs and/or modules stored in the memory 109, and calling data stored in the memory 109 , execute various functions of the smart terminal and process data, so as to monitor the smart terminal as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly processes operating systems, user interfaces, and application programs, etc. The demodulation processor mainly handles wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 110 .

The smart terminal 100 can also include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 can be logically connected to the processor 110 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. and other functions.

Although not shown in FIG. 1 , the smart terminal 100 may also include a Bluetooth module, etc., which will not be repeated here.

In order to facilitate understanding of the embodiments of the present application, the following describes the communication network system on which the smart terminal of the present application is based.

Please refer to FIG. 2. FIG. 2 is a structure diagram of a communication network system provided by an embodiment of the present application. The communication network system is an LTE system of general mobile communication technology. ) 201, E-UTRAN (Evolved UMTS Terrestrial Radio Access Network, Evolved UMTS Terrestrial Radio Access Network) 202, EPC (Evolved Packet Core, Evolved Packet Core Network) 203 and the operator's IP service 204.

Optionally, the UE 201 may be the above-mentioned terminal 100, which will not be repeated here.

E-UTRAN 202 includes eNodeB 2021 and other eNodeB 2022 and so on. Optionally, the eNodeB 2021 can be connected to other eNodeB 2022 through a backhaul (for example, X2 interface), the eNodeB 2021 is connected to the EPC 203 , and the eNodeB 2021 can provide access from the UE 201 to the EPC 203 .

EPC203 may include MME (Mobility Management Entity, Mobility Management Entity) 2031, HSS (Home Subscriber Server, Home Subscriber Server) 2032, other MME2033, SGW (Serving Gate Way, Serving Gateway) 2034, PGW (PDN Gate Way, packet data Network Gateway) 2035 and PCRF (Policy and Charging Rules Function, Policy and Charging Functional Entity) 2036, etc. Optionally, MME2031 is a control node that processes signaling between UE201 and EPC203, and provides bearer and connection management. HSS2032 is used to provide some registers to manage functions such as home location register (not shown in the figure), and save some user-specific information about service features and data rates. All user data can be sent through SGW2034, PGW2035 can provide UE 201 IP address allocation and other functions, PCRF2036 is the policy and charging control policy decision point of service data flow and IP bearer resources, it is the policy and charging execution function A unit (not shown) selects and provides available policy and charging control decisions.

The IP service 204 may include Internet, Intranet, IMS (IP Multimedia Subsystem, IP Multimedia Subsystem) or other IP services.

Although the LTE system is used as an example above, those skilled in the art should know that this application is not only applicable to the LTE system, but also applicable to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA and future new wireless communication systems. The network system (such as 5G), etc., is not limited here.

FIG. 3 is a schematic diagram of a hardware structure of a controller 140 provided in the present application. The controller 140 includes: a memory 1401 and a processor 1402, the memory 1401 is used to store program instructions, and the processor 1402 is used to call the program instructions in the memory 1401 to execute the steps performed by the controller in the first method embodiment above, and its implementation principle and beneficial effects are similar, and will not be repeated here.

Optionally, the foregoing controller further includes a communication interface 1403 , and the communication interface 1403 may be connected to the processor 1402 through a bus 1404 . The processor 1402 can control the communication interface 1403 to implement the receiving and sending functions of the controller 140 .

FIG. 4 is a schematic diagram of a hardware structure of a network node 150 provided in the present application. The network node 150 includes: a memory 1501 and a processor 1502, the memory 1501 is used to store program instructions, and the processor 1502 is used to call the program instructions in the memory 1501 to execute the steps performed by the first node in the first method embodiment above, and its implementation principle and beneficial effects are similar, and will not be repeated here.

Optionally, the foregoing controller further includes a communication interface 1503 , and the communication interface 1503 may be connected to the processor 1502 through a bus 1504 . The processor 1502 can control the communication interface 1503 to realize the functions of receiving and sending of the network node 150 .

FIG. 5 is a schematic diagram of a hardware structure of a network node 160 provided in the present application. The network node 160 includes: a memory 1601 and a processor 1602, the memory 1601 is used to store program instructions, and the processor 1602 is used to call the program instructions in the memory 1601 to execute the steps performed by the intermediate node and the tail node in the first method embodiment above, The implementation principles and beneficial effects are similar, and will not be repeated here.

Optionally, the foregoing controller further includes a communication interface 1603 , and the communication interface 1603 may be connected to the processor 1602 through a bus 1604 . The processor 1602 can control the communication interface 1603 to realize the functions of receiving and sending of the network node 160 .

FIG. 6 is a schematic diagram of a hardware structure of a controller 170 provided in the present application. The controller 170 includes: a memory 1701 and a processor 1702, the memory 1701 is used to store program instructions, and the processor 1702 is used to call the program instructions in the memory 1701 to execute the steps performed by the controller in the second method embodiment above, and its implementation principle and beneficial effects are similar, and will not be repeated here.

FIG. 7 is a schematic diagram of a hardware structure of a network node 180 provided in the present application. The network node 180 includes: a memory 1801 and a processor 1802, the memory 1801 is used to store program instructions, and the processor 1802 is used to invoke the program instructions in the memory 1801 to execute the steps performed by the head node in the second method embodiment above, and its implementation principle and beneficial effects are similar, and will not be repeated here.

The above-mentioned integrated modules implemented in the form of software function modules can be stored in a computer-readable storage medium. The above-mentioned software function modules are stored in a storage medium, and include several instructions to enable a computer device (which may be a personal computer, server, or network device, etc.) or a processor (English: processor) to execute the methods of the various embodiments of the present application. partial steps.

In the above embodiments, all or part of them may be implemented by software, hardware, firmware or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present application will be generated in whole or in part. A computer can be a general purpose computer, special purpose computer, computer network, or other programmable device. Computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, computer instructions may be transmitted from a website site, computer, server or data center by wire (such as Coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server, a data center, etc. integrated with one or more available media. Available media may be magnetic media (eg, floppy disk, hard disk, magnetic tape), optical media (eg, DVD), or semiconductor media (eg, solid state disk, SSD), etc.

Based on the above hardware structure of the smart terminal and the communication network system, various embodiments of the present application are proposed.

first embodiment

Please refer to FIG. 8 . FIG. 8 is a flowchart of a data processing method provided by an embodiment of the present application. As shown in Figure 8, optionally, the smart terminal is the execution subject, and the method of this embodiment may include the following steps:

S101. Generate an image information set of image data in response to a shooting instruction.

In this embodiment, the smart terminal can obtain the shooting instruction. The smart terminal shoots image data according to the shooting instruction. The image data can be photos or videos. When a photo or a video is taken, the image information set of the image data can be correspondingly generated in the smart terminal. The image information set may be stored in a storage space corresponding to the image data. When the smart terminal needs to transmit the image data, the image information set corresponding to the image data will be transmitted synchronously.

In an example, the image information set includes at least one stage of information. Each stage of information corresponds to a processing instruction, and a processing instruction corresponds to at least one stage of information. For example, a photographing instruction may correspond to two phase information. Optionally, one stage information is used to store camera-related parameters, and the other stage information is used to store basic parameters of image data. Each stage information in the image information set may include two parts, stage identification and information content. Optionally, the stage identifier is used to uniquely identify a stage information. For example, the stage identifier for storing the stage information of the basic parameters of the image data may be label1, and the stage identifier for storing the stage information of the camera-related parameters may be label2. In one stage information, the information content includes at least one key-value pair. The key-value pair can be stored in the form of a <key, value> data pair, or the key-value pair can also be stored in the data format of key:value. Optionally, the keyword (key) in each key-value pair is fixed content. For example, the keyword may be resolution, encoding format, sensitivity, acceleration, etc. Optionally, the value of parameter information (value) corresponding to each keyword is determined according to the image data. For example, ISO 100, ISO 3200, ISO 25600, etc.

In an example, the stage information also includes information length. The information length is used to record the data length of the information content. Because the stage identification of each stage information in the image information set usually has a fixed format. For example, the stage identifiers of label1 and label2 are fixed to have 6 characters. In each stage information of the image information set, the lengths of the information content of different stage information are not the same. Therefore, the record of the information length can more conveniently write the information of this stage into the data stream, and obtain the information content of the information of this stage from the data stream.

In another example, the stage information further includes reservation information, and the reservation information is used to expand the key-value pairs in the information content. The reserved information may be a fixed length of free storage space. For a stage information, the number of key-value pairs is fixed. For example, the information content of the stage information for storing camera-related parameters may include 7 key-value pairs. The keywords in these key-value pairs correspond to lens information, sensor information, light intensity information, gain information, exposure information, aperture information and acceleration information. When the smart terminal needs to add a new keyword in the stage information for storing camera-related parameters, the key-value pair where the keyword is located can be stored in the reserved information.

In yet another example, the phase information further includes a start tag and/or an end tag. The start tag and end tag can be two formatted strings. For example, a start tag could be ! Begin! , the closing tag can be ! End! . When the smart terminal needs to write the phase information into the data stream, the smart terminal can first write the start marker before starting to write the phase information. And write the end mark after completing the writing of the phase information. When the smart terminal reads the data stream, it can determine that the piece of data is one-stage information through the start marker and the end marker. Optionally, different phase information may have different start tags and end tags. Alternatively, all phase information in the smart terminal may correspond to the same start marker and end marker.

In an example, the phase information may be stored in a table form in a storage space (such as a memory, such as a flash memory, or a hard disk, etc.). Alternatively, the information at this stage may be stored in a storage space (such as a memory, such as a flash memory, or a hard disk, etc.) in the form of a data structure. Alternatively, the information at this stage may also be stored in a storage space (such as a memory, such as a flash memory, or a hard disk, etc.) in the form of a file.

S102. According to the processing instruction of the image data, record the parameter information corresponding to the image data when executing the processing instruction in the image information set.

In this embodiment, the smart terminal can acquire the processing instruction of the image data, and when the smart terminal processes the image data, the smart terminal can acquire the parameter information corresponding to the image, and record the parameter information in the image information set. The parameter information may include parameter information of the image data before the smart terminal executes the processing instruction, and parameter information of the image data after the smart terminal executes the processing instruction.

In one example, when the processing instruction is a shooting instruction, obtain the lens parameters and sensor parameters corresponding to the lens assembly that shoots the image data, and store the lens parameters and sensor parameters in at least one key-value pair in the stage information corresponding to the shooting instruction in the parameter information.

In this example, when the smart terminal shoots image data, the smart terminal needs to generate a shooting instruction in the application program of the camera. The shooting instruction may include a lens assembly used when shooting the image data, lens parameters of the lens assembly, and sensor parameters. For example, when shooting close-up objects, the lens assembly can be a micro-focus lens; when shooting landscape pictures, the lens assembly can be a wide-angle lens. Optionally, the same lens assembly may have different lens parameters and sensor parameters when shooting different image data. For example, when taking indoor pictures, you can use a large aperture to ensure the brightness of the picture; when taking outdoor pictures, you can adjust the size of the aperture according to the weather conditions. Therefore, the shooting instruction acquired by the smart terminal should include information such as lens components, lens parameters, and sensor parameters. The smart terminal can write these information into the stage information corresponding to the shooting instruction. Each of these lens parameters and sensor parameters may correspond to a key-value pair in the information content of the stage information. The key-value pair may include keywords and parameter information. Optionally, the keywords correspond to those of the lens parameters and sensor parameters. Optionally, the parameter information corresponds to the parameter values of the lens parameters and sensor parameters in the shooting instruction.

Optionally, the specific steps for the smart terminal to obtain the lens parameters and sensor parameters of the shooting instruction may include:

Step 1. The smart terminal determines the lens assembly corresponding to the shooting instruction according to the shooting instruction. The lens assembly may include at least one lens and at least one sensor.

Step 2. The smart terminal determines the lens parameters corresponding to each lens according to at least one lens included in the lens assembly. And, the smart terminal determines the sensor parameters corresponding to each sensor according to at least one sensor included in the lens assembly.

In another example, when the processing instruction is a shooting instruction, shooting information when shooting image data is acquired, and the shooting information is stored in at least one key-value pair of stage information corresponding to the shooting instruction.

In this example, after the smart terminal obtains the shooting instruction, the smart terminal may obtain shooting information when shooting image data from other application programs in the smart terminal. And the shooting information is uniformly stored in the stage information corresponding to the shooting instruction. Optionally, the shooting information may specifically include at least one of the following: the smart terminal acquires geographic location information when the image data is shot from the GPS. The smart terminal obtains the time information when the image data is captured from the clock. The smart terminal obtains the event schedule information when the image data is captured from the calendar. The smart terminal may save the shooting information into the information content of the stage information corresponding to the shooting instruction. The information content may include multiple key-value pairs. A keyword in each key-value pair may correspond to a keyword in the shooting information. For example, geographic location information, time information, event schedule information, etc. The parameter information in each key-value pair corresponds to the actual parameter values of these keywords. For example, Beijing, October 20th, flag raising ceremony, etc. Optionally, the stage information corresponding to the stored shooting information in this embodiment is the same as the stage information corresponding to the stored lens parameters and sensor parameters in the previous embodiment, although both are correspondingly generated and completed when the smart terminal detects the shooting instruction and the data writing is completed, But for different stage information.

In another example, when the processing instruction is a storage instruction, the format information of the image data is obtained, and the format information is stored in the parameter information of at least one key-value pair in the stage information corresponding to the storage instruction.

In this example, when the smart terminal completes the shooting of the image data and needs to store the image data in the storage space of the smart terminal (such as memory, flash memory, or hard disk, etc.), the smart terminal can save the image data from the Get the format information of the image data in . The format information may include length and width information of the image data, encoding format, frame type, frame number, and the like. The information content of the phase information corresponding to the storage instruction in the smart terminal may include multiple key-value pairs. The keywords in each key-value pair may correspond to the keywords of the format information such as the above-mentioned length and width information, encoding format, frame type, and frame number. The parameter information in each key-value pair may correspond to the parameter value corresponding to the above-mentioned keyword.

In another example, when the processing instruction is an image processing instruction of image data, the image processing steps and image processing information are obtained, and the image processing steps and image processing information are stored in at least one key in the stage information corresponding to the image processing instruction In the parameter information of the value pair.

In this example, the smart terminal can further process the image data through image processing instructions. The image processing instruction may include one or more specific processing instructions. For example, cropping instructions, noise reduction instructions, scaling instructions, stylization instructions, etc. In the smart terminal, the user usually needs to determine the processing instructions to be executed for each processing through an interactive interface. Therefore, the smart terminal can acquire the processing instruction corresponding to the image processing instruction, and store the corresponding image processing steps and image processing information in the stage information corresponding to the image processing instruction according to the processing instruction.

When the smart terminal acquires the image processing instruction, the smart terminal can process the image data according to the image processing instruction, and sequentially record the image processing steps and image processing information during the processing. For example, when the smart terminal uses a cropping command to crop the image data, the smart terminal can record information such as the cropping command, the execution time of the cropping command, the resolution of the image before cropping, and the resolution of the image after cropping.

The information content of the stage information corresponding to the image processing instruction in the smart terminal may include multiple key-value pairs. The keywords in each key-value pair may correspond to the keywords of the image processing steps and graphics processing information such as the instruction name, instruction execution time, pre-execution resolution, and post-execution resolution. The parameter information in each key-value pair may correspond to the parameter value corresponding to the above-mentioned keyword.

In another example, when the processing instruction is image semantic recognition, the semantic information of the image data is acquired, and the semantic information is stored in the parameter information of at least one key-value pair in the stage information corresponding to the image semantic recognition.

In this example, the smart terminal can process image data through image semantic recognition to obtain semantic information in the image data. Through image semantic recognition, the smart terminal can determine the image category of the image data by identifying the target object in the image data. The image categories may include landscapes, people, animals, plants, still life, and the like. The smart terminal can also identify the information of the target object. For example, when the target object is a person, the target object information may include at least one item of person location information, face location information, face identity information, number of people information, and person action information. When the target object is an animal, the target object information includes at least one item of animal location information, animal breed information, animal quantity information, and animal action information. When the target object is a plant and/or a still life, the target object information includes at least one item of plant and/or still life position information, plant and/or still life variety information, and quantity information.

The information content of the phase information corresponding to the image semantic recognition in the smart terminal may include multiple key-value pairs. The keywords in each key-value pair may correspond to the above-mentioned keywords such as image category and target object location. The parameter information in each key-value pair may correspond to the parameter value corresponding to the above-mentioned keyword.

In the data processing method provided by the present application, the smart terminal can obtain the shooting instruction. The photographing instruction is used to instruct the smart terminal to photograph image data. When the image data is captured, the image information set of the image data can be correspondingly generated in the smart terminal. The image information set may be stored in a storage space corresponding to the image data. When the smart terminal needs to transmit the image data, the image information set corresponding to the image data will be transmitted synchronously. The smart terminal can obtain the processing instruction of the image data, and when the smart terminal processes the image data, the smart terminal can obtain the parameter information corresponding to the image, and record the parameter information in the image information set. In this application, through the collection of image information, the improvement of the corresponding information of the image data is realized, so that the information of the image data can be stored in a standardized manner, so that the information of the standardized image data can be directly used in the subsequent processing of the image data , to improve the processing efficiency of image data.

second embodiment

Please refer to FIG. 9 . FIG. 9 is a flowchart of a data processing method provided by an embodiment of the present application. On the basis of the embodiment shown in FIG. 8, as shown in FIG. 9, with the smart terminal as the execution subject, the method of this embodiment may include the following steps:

S201. The smart terminal controls the camera to capture image data.

In this embodiment, the smart terminal can obtain a shooting instruction from an application program such as a camera. The shooting instruction may include a lens assembly used when shooting the image data, lens parameters of the lens assembly, and sensor parameters. The smart terminal can control the corresponding lens components in the smart terminal according to the lens parameters and sensor parameters of the lens components, so as to realize the shooting of the image data.

After the smart terminal completes the shooting of the image data, in the general computational photography framework, the image data can also perform operations such as basic image processing, computational photography processing, and image application processing.

In the framework of computational photography, in order to improve the processing efficiency of image data, smart terminals can encapsulate each processing stage. The smart terminal can control the image data to complete the processing operations of each processing stage by calling the interface. When calling each interface, the smart terminal needs to input different data streams and output different data streams. These data streams are used to describe imagery data. In order to improve the uniformity and flexibility of image data representation in each processing stage, the smart terminal can predefine the format of the interface data information required in each interface. The predefinition of the format of the interface data information can ensure the universality of these interface data information. The data information can be reserved by presetting the information to improve flexibility.

For example, the format of the interface data information of each interface predefined by the smart terminal may be as shown in Table 1.

Table 1

字段field	字段的描述Description of the field	字段的类型type of field
标识信息Identification information	对应于一接口的接口数据信息Interface data information corresponding to an interface	integerinteger
信息长度message length	本段接口数据信息的整体长度The overall length of the interface data information in this section	integerinteger
信息内容information	影像数据的信息内容Information content of image data	字符串string
预留信息reserved information	为保证灵活性，给出预留信息To ensure flexibility, reserve information is given	the

In the smart terminal, different processing stages may correspond to different interfaces. Different interfaces may have different interface data information. The smart terminal can use the predefined interface data information format shown in Table 1 to describe the interface data information of each interface. In order to distinguish the interface data information of each interface, the smart terminal may use different identification information to distinguish different interfaces. For example, interface 1, interface 2, and interface 3 may have different identification information.

After the smart terminal completes the shooting of the image data, the smart terminal can generate the basic information description of the image data. The basic information description of the image data can be written into a storage space (such as a memory, such as a flash memory, or a hard disk, etc.) in the format of an interface data information. The identification information described by the basic information of the image data may be "data pipeline label 1" or "basic image info". The identification information is used to uniquely identify the basic information description of the image data. For different image data, the same identification information can be used to identify the basic information description of the image data. Or, for different image data, different identification information may be used to identify the basic information description of the image data. An interface data information usually includes one or more attribute parameters. Optionally, there is usually a correlation between one or more attribute parameters in one interface data information. For example, in addition to identification information and information length, an interface data information used to describe the basic information of the image data may include the length of the image data, the length and width information of the picture, the encoding format of the image, and the frame of the image. Type, frame number of the image and other information. After all the information is written into the interface data information in the format shown in Table 1, the smart terminal can transmit the interface data information between interfaces in the form of a data stream. In the subsequent processing operation, the smart terminal can directly obtain the interface data information whose identification information is "basic image info", so as to realize the rapid acquisition of the basic information of the image data, which greatly improves the acquisition efficiency of the basic information of the image data .

After the smart terminal completes the imaging of the image data, the smart terminal can write its imaging information into the storage space (such as memory, flash memory, or hard disk, etc.) according to the format of an interface data information according to the imaging process of the image data. . The interface data information of the imaging data may have different identification information from the interface data information of the basic information. For example, the identification information may be "data pipeline label 2". Various sensory data, optical data, etc. may be included in the imaging process of the image data. These imaging auxiliary data can be written into the information content of the interface data information whose identification information is "data pipeline label 2". The information content may specifically include basic data information of the image sensor, illumination information, gain information, acceleration sensor information, exposure information, geographic location information, time information, and the like. This information can be used to objectively describe the auxiliary data of the imaging.

In subsequent processing operations, the smart terminal may also store information generated in each processing operation of the image data in the format of the interface data information shown in Table 1 above according to actual needs. There may be data duplication in the interface data information generated in different processing operations, and the duplication of data will lead to redundancy, but it does not affect the actual use and realization of the format of the interface data information.

S202. The smart terminal uses the basic image processing unit to process the image data; and/or the smart terminal uses the computational photography processing unit to process the image data; and/or the smart terminal uses the image application processing unit to process the image data.

In this embodiment, the smart terminal may also transmit the impact data to a subsequent basic image processing unit after the image data is captured. The basic image processing unit is mainly used to perform some basic processing on the data of the optical device and its auxiliary parts. During this processing, the smart terminal can directly obtain the interface data information whose label information is "data pipeline label 2" from the data stream, and use the interface data information to execute the data processing in the basic image processing unit. After the image data has been processed in the basic image processing unit, the smart terminal can transfer the data to the computational photography processing unit. In the computational photography processing unit, the smart terminal can perform complex image processing on the impact data. And after the image processing is completed, the image data is transmitted to the image application processing unit, so as to realize operations such as presentation, storage, editing, sharing, etc. of the image data.

As the image data is transmitted successively in the smart terminal, the image data will be subjected to various processing operations. For example, the image data may be processed by a noise reduction algorithm, scaled, and compressed to form the final image data. The processing process of the image data is equivalent to the modification process of the original image. In the modification process, the interface data information whose label information is "data pipeline label 3" can be formed, and the label information is the interface of "data pipeline label 3". The modification process of the image data may be stored in the data information. For another example, after the image processing is completed, special processing can be performed on a special part of the image data to form some advanced information. The high-level information may be face information, image semantic information, and the like. Optionally, the face information may include the position of the face in the image, information about facial features, the angle of the face, and the like. These high-level information can be stored in the interface data information whose label information is "data pipeline label 4".

In the data processing method provided by the present application, the smart terminal can obtain shooting instructions from application programs such as cameras. The smart terminal can control the image data to complete the processing operations of each processing stage by calling the interface. When calling each interface, the smart terminal needs to input different data streams and output different data streams. These data streams are used to describe imagery data. In order to improve the uniformity and flexibility of image data representation in each processing stage, the smart terminal can predefine the format of the interface data information required in each interface. The predefinition of the format of the interface data information can ensure the universality of these interface data information. The data information can be reserved by presetting the information to improve flexibility. In this application, through the unified interface data information format, the information generated during the image data processing process is stored in a standardized manner, which improves the efficiency of data acquisition during the data processing process, improves the overall processing efficiency of image data, and improves user experience.

third embodiment

Please refer to FIG. 10 . FIG. 10 is a flowchart of another data processing method provided by the embodiment of the present application. As shown in Figure 10, with the smart terminal as the execution subject, the method of this embodiment may include the following steps:

S301. Acquire parameter information of image data.

In this embodiment, the smart terminal can acquire the parameter information of the image data in real time during the processing of the image data. The smart terminal can store these parameter information in the storage space corresponding to the image data. The data in the storage space corresponding to the image data will be converted into a data stream together with the image data when the image data is converted into a data stream for transmission. The image data can be photos or videos.

In an example, the storage space corresponding to the image data may include at least one data format (preferably, such as at least two data formats). One or more attribute parameters can be stored in each data format. When a data format includes at least one data parameter, the at least one data parameter usually has a certain relationship. For example, at least one data format is used to record at least one of imaging parameter information when shooting image data, basic parameter information of image data, processing parameter information during image processing, and application parameter information during image application; optionally, The at least two data formats are respectively used to record at least two items of imaging parameter information when shooting image data, basic parameter information of image data, processing parameter information during image processing, and application parameter information during image application.

In one example, a data format may include at least one field among tag serial number, tag name, tag subtable, and table data length. Each label sub-table may also include at least one field among keyword serial number, keyword, parameter information, and parameter length. When the image data is a photo, the keywords in a tag sub-table may include at least one item of image length, image width, encoding format, white balance, saturation, and sharpness. When the image data is video, the keywords in a tag subtable include at least one item of image frame number, I frame number, P frame number, B frame number, and image resolution.

S302. According to the parameter information, determine a target data format from at least one data format corresponding to the image data.

In this embodiment, after acquiring the parameter information, the smart terminal can determine the data format corresponding to the parameter information to be written according to the source of the parameter information. The smart terminal can determine that the data format is the target data format.

S303. Write the parameter information into the target data format.

In this embodiment, the smart terminal can obtain the tag subtable from the target data format. The smart terminal can determine the line where the parameter information needs to be written according to the keyword corresponding to the parameter information. The smart terminal can write the parameter information into the area corresponding to the "parameter information" field of the row.

In the data processing method provided by the present application, the smart terminal can obtain the parameter information of the image data in real time during the processing of the image data. After obtaining the parameter information, the smart terminal can determine the data format corresponding to the parameter information to be written according to the source of the parameter information. The smart terminal can determine the line where the parameter information needs to be written according to the keyword corresponding to the parameter information. The smart terminal can write the parameter information into the area corresponding to the "parameter information" field of the line. In this application, the smart terminal can complete the data format by filling the parameter information into the data format, thereby improving the acquisition efficiency of the parameter information when the smart terminal processes image data.

An embodiment of the present application also provides a smart terminal, the smart terminal includes a memory and a processor, and a computer program is stored in the memory, and when the computer program is executed by the processor, the steps of the data processing method in any of the above embodiments are implemented.

An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the data processing method in any of the foregoing embodiments are implemented.

The embodiments of the smart terminal and the computer-readable storage medium provided in this application may contain all the technical features of any of the embodiments of the above-mentioned data processing method. I won't repeat it here.

An embodiment of the present application further provides a computer program product, the computer program product includes computer program code, and when the computer program code is run on the computer, the computer is made to execute the methods in the above various possible implementation manners.

The embodiment of the present application also provides a chip, including a memory and a processor. The memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that the device installed with the chip executes the above various possible implementation modes. Methods.

It can be understood that the above scenario is only an example, and does not constitute a limitation on the application scenario of the technical solution provided by the embodiment of the present application, and the technical solution of the present application can also be applied to other scenarios. For example, those skilled in the art know that with the evolution of the system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

The serial numbers of the above embodiments of the present application are for description only, and do not represent the advantages and disadvantages of the embodiments.

The steps in the methods of the embodiments of the present application can be adjusted, combined and deleted according to actual needs.

Units in the device in the embodiment of the present application may be combined, divided and deleted according to actual needs.

In this application, descriptions of the same or similar terms, concepts, technical solutions and/or application scenarios are generally only described in detail when they appear for the first time, and when they appear repeatedly later, for the sake of brevity, they are generally not repeated. When understanding the technical solutions and other contents of the present application, for the same or similar term concepts, technical solutions and/or application scenario descriptions that are not described in detail later, you can refer to the previous relevant detailed descriptions.

In this application, the description of each embodiment has its own emphasis. For the parts that are not detailed or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

The various technical features of the technical solution of the present application can be combined arbitrarily. For the sake of concise description, all possible combinations of the various technical features in the above-mentioned embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, all It should be regarded as the scope described in this application.

Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence or in other words, the part that contributes to the prior art, and the computer software product is stored in one of the above storage media (such as ROM/RAM, magnetic CD, CD), including several instructions to make an intelligent terminal (which can be a mobile phone, computer, server, controlled terminal, or network device, etc.) execute the method of each embodiment of the present application.

In the above embodiments, all or part of them may be implemented by software, hardware, firmware or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present application will be generated in whole or in part. The computer can be a general purpose computer, special purpose computer, a computer network, or other programmable apparatus. Computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, e.g. Coaxial cable, optical fiber, digital subscriber line) or wireless (such as infrared, wireless, microwave, etc.) to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server, a data center, etc. integrated with one or more available media. The usable medium may be a magnetic medium (such as a floppy disk, a storage disk, or a magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid state disk (Solid State Disk, SSD)), etc.

The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structures or equivalent process transformations made by using the description of the application and the accompanying drawings are directly or indirectly used in other related technical fields. , are all included in the patent protection scope of the present application in the same way.

Claims

A data processing method, comprising the following steps:

S101: Confirm or generate an image information set of image data in response to a shooting instruction;

S102: According to the processing instruction of the image data, record parameter information corresponding to the image data when the processing instruction is executed in the image information set.
The method according to claim 1, wherein the image information set includes at least one stage of information, including at least one of the following features:

said phase information corresponds to a said processing instruction;

The stage information includes stage identification and/or information content;

The information content includes at least one key-value pair.
The method according to claim 2, wherein the stage information further includes at least one of the following features:

message length;

reserved information;

start tag and/or end tag.
The method according to any one of claims 1 to 3, wherein the step S102 includes at least one of the following:

When the processing instruction is a shooting instruction, acquire lens parameters and sensor parameters corresponding to the lens assembly that captures the image data, and store the lens parameters and sensor parameters in at least one of the stage information corresponding to the shooting instruction In the parameter information of the key-value pair;

When the processing instruction is a shooting instruction, acquiring shooting information when shooting the image data, and storing the shooting information in at least one key-value pair of stage information corresponding to the shooting instruction;

When the processing instruction is a storage instruction, obtain the format information of the image data, and store the format information in the parameter information of at least one key-value pair in the stage information corresponding to the storage instruction;

When the processing instruction is an image processing instruction of the image data, acquiring the image processing steps and image processing information, and storing the image processing steps and image processing information in the stage information corresponding to the image processing instruction In the parameter information of at least one key-value pair;

When the processing instruction is image semantic recognition, the semantic information of the image data is acquired, and the semantic information is stored in the parameter information of at least one key-value pair in the stage information corresponding to the image semantic recognition.
The method according to claim 4, wherein, when the smart terminal includes at least one lens assembly, said acquisition of lens parameters and sensor parameters corresponding to the lens assembly that captures the image data includes at least one of the following:

According to the shooting instruction, determine a lens assembly corresponding to the shooting instruction, where the lens assembly includes a lens and a sensor;

Obtaining lens parameters according to the lens;

According to the sensor, the sensor parameter is acquired.
The method according to claim 4, comprising at least one of the following:

The shooting information includes geographic location information and/or time information;

The format information includes at least one of length and width information, encoding format, frame type, and frame number of the image data;

The image processing steps and image processing information include at least one of cropping instructions, noise reduction instructions, scaling instructions, and stylization instructions.
A data processing method, including:

Obtain the parameter information of the image data;

determining a target data format from at least one data format corresponding to the image data according to the parameter information;

Writing the parameter information into the target data format.
The method according to claim 7, wherein the at least one data format is used to record imaging parameter information when shooting image data, basic parameter information of image data, processing parameter information during image processing, and application parameters during image application at least one of the information.
An intelligent terminal, comprising: a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the data processing method according to claim 1 is realized.
A computer-readable storage medium, wherein a computer program is stored on the storage medium, and when the computer program is executed by a processor, the data processing method according to claim 1 is realized.