WO2017206655A1

WO2017206655A1 - Image processing method, terminal, and computer storage medium

Info

Publication number: WO2017206655A1
Application number: PCT/CN2017/082935
Authority: WO
Inventors: 戴向东
Original assignee: 努比亚技术有限公司
Priority date: 2016-05-30
Filing date: 2017-05-03
Publication date: 2017-12-07
Also published as: CN105979235A

Abstract

An image processing method, comprising: obtaining RAW data of an image to be processed; calculating a key photographing parameter in the RAW data according to a preset strategy; writing the key photographing parameter and the RAW data into an RAW file according to a preset coding standard; opening the RAW file using a third-party application and generating a RAW image file; and performing image post-processing on the RAW image file. Also disclosed are a terminal and a computer storage medium.

Description

Image processing method, terminal and computer storage medium

The present application is filed on the basis of the Chinese Patent Application No. PCT Application No.

Technical field

The present invention relates to image processing technologies in the field of information processing, and in particular, to an image processing method, a terminal, and a computer storage medium.

Background technique

With the continuous development of electronic technology, the development of terminals with shooting functions, especially camera devices, is also advancing rapidly, so that users have higher and higher requirements on the image quality (for example, color realism) of the camera device.

In the current technology, for images taken by the imaging device due to temperature difference or illumination, etc., corresponding parameter adjustment (secondary processing) is required after imaging to make the image more realistic and the color more realistic.

However, with the current image processing method, since the imaged image loses the scene information in the image of the compressed jpg format, the image quality is deteriorated, and the imaged image is passed. When the secondary processing is performed, the adjustment of the color and the brightness may be caused by the deterioration of the image quality, resulting in a poor secondary adjustment effect.

Summary of the invention

The embodiments of the present invention are expected to provide an image processing method, a terminal, and a computer storage medium to solve the problem of poor image effect caused by the existing secondary image processing.

The technical solution of the embodiment of the present invention is implemented as follows:

An image processing method provided by an embodiment of the present invention includes:

Obtaining raw RAW data of the image to be processed;

Calculating key shooting parameters in the original RAW data according to a preset strategy;

Writing the key shooting parameters and the original RAW data into a RAW file according to a preset encoding specification;

Opening the RAW file with a third-party application to generate a RAW image file;

Image post processing is performed on the image file of the RAW.

A terminal provided by an embodiment of the present invention includes:

An obtaining unit configured to acquire raw RAW data of an image to be processed;

a calculating unit, configured to calculate a key shooting parameter in the original RAW data acquired by the acquiring unit according to a preset policy;

a writing unit configured to write the key shooting parameters calculated by the calculating unit and the original RAW data acquired by the acquiring unit into a RAW file according to a preset encoding specification;

a generating unit, configured to open the RAW file written by the writing unit by using a third-party application, to generate an RAW image file;

The processing unit is configured to perform image post-processing on the image file of the RAW generated by the generating unit.

The embodiment of the invention further provides a terminal, including:

a memory configured to store computer stored programs,

A processor, coupled to the memory, configured to perform the following operations by executing the computer program:

Obtaining raw RAW data of the image to be processed;

Image post processing is performed on the image file of the RAW.

A fourth aspect of the embodiments of the present invention further provides a computer storage medium, wherein the computer storage medium stores a computer program, and after the computer program is executed by the processor, the image processing method described above can be implemented.

Embodiments of the present invention provide an image processing method, a terminal, and a computer storage medium, by acquiring original RAW data of an image to be processed; calculating key shooting parameters in the original RAW data according to a preset strategy; and selecting key shooting parameters and original RAW The data is written into the RAW file according to the preset encoding specification; the third-party application is used to open the RAW file to generate the RAW image file; and the image processing of the RAW image file is post-processed. With the above technical implementation scheme, since the original RAW data is uniformly encoded, the third-party application can parse the RAW file, so that the RAW file can be subjected to development processing to obtain a RAW image file. On the one hand, the third-party application here processes the RAW image file, and the RAW image file retains the image information more completely than the processed image that has been processed once, so that the secondary processing can be reduced because of the loss. The problem of poor image effect caused by image information, on the other hand, relative to the processing of the processed image, it is possible to reduce that some parameters of the image have been processed once, and the processing that may occur when processing again is excessively displayed, thereby The problem of poor image processing caused by repeated processing of the same parameter is reduced, so that the image processing effect can be improved from at least these two aspects, and therefore, the third-party application can post-process the image without being worried about the image quality being reduced and more free. Adjusting the color and brightness of the image has achieved the best image processing effect, thus improving the image rendering effect of the image processing.

DRAWINGS

1 is a schematic structural diagram of hardware of an optional terminal for implementing various embodiments of the present invention;

2 is a communication system that the mobile terminal of the present invention can operate;

FIG. 3 is a flowchart of an image processing method according to an embodiment of the present invention;

4 is a schematic structural diagram of a pixel arrangement manner according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of CMOS photon sensing according to an embodiment of the present invention; FIG.

FIG. 6 is an image diagram of an exemplary original RAW data according to an embodiment of the present invention; FIG.

FIG. 7 is a schematic diagram of a data structure of a TIFF according to an embodiment of the present disclosure;

FIG. 8 is an exemplary RAW file data flow according to an embodiment of the present invention;

FIG. 9 is an image diagram of an exemplary third-party processed RAW file according to an embodiment of the present invention; FIG.

FIG. 10 is a schematic structural diagram 1 of a terminal according to an embodiment of the present disclosure;

FIG. 11 is a schematic structural diagram 2 of a terminal according to an embodiment of the present disclosure;

FIG. 12 is a schematic structural diagram 3 of a terminal according to an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is understood that the preferred embodiments described below are only used to illustrate and explain the present invention, and are not intended to limit this invention.

A mobile terminal embodying various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, the use of suffixes such as "module", "component" or "unit" for indicating an element is merely an explanation for facilitating the present invention, and does not have a specific meaning per se. Therefore, "module" and "component" can be used in combination.

It should be noted that the focus obtaining apparatus provided by the embodiment of the present invention may be a terminal, such as a computer or a mobile terminal, and the like, which can use a browser.

Among them, the mobile terminal can be implemented in various forms. For example, the terminals described in the present invention may include, for example, mobile phones, smart phones, notebook computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (PADs), portable multimedia players (PMPs), navigation devices, and the like. Mobile terminals and fixed terminals such as digital TVs, desktop computers, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, those skilled in the art will appreciate that in addition to being specifically used In addition to the components of the mobile purpose, the configuration according to an embodiment of the present invention can also be applied to a terminal of a fixed type.

FIG. 1 is a schematic diagram showing the hardware structure of an optional mobile terminal that implements various embodiments of the present invention.

The mobile terminal 1 may include a wireless communication unit 110, an audio/video (A/V) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190. and many more. Figure 1 illustrates a mobile terminal having various components, but it should be understood that not all illustrated components are required to be implemented. More or fewer components can be implemented instead. The elements of the mobile terminal will be described in detail below.

Wireless communication unit 110 typically includes one or more components that permit radio communication between mobile terminal 1 and a wireless communication system or network. For example, the wireless communication unit can include at least one of the mobile communication module 112, the wireless internet module 113, the short-range communication module 114, and the location information module 115.

The mobile communication module 112 transmits the radio signals to and/or receives radio signals from at least one of a base station (e.g., an access point, a Node B, etc.), an external terminal, and a server. Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received in accordance with text and/or multimedia messages.

The wireless internet module 113 supports wireless internet access of the mobile terminal. The module can be internally or externally coupled to the terminal. The wireless Internet access technologies involved in the module may include WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless Broadband), Wimax (Worldwide Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), etc. .

The short range communication module 114 is a module for supporting short range communication. Some examples of short-range communication technology include Bluetooth ^TM, a radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, etc. ^TM.

The location information module 115 is a module for checking or acquiring location information of the mobile terminal. A typical example of a location information module is a Global Positioning System (GPS) module. According to current technology, The GPS module calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information to accurately calculate three-dimensional current position information based on longitude, latitude, and altitude. Currently, the method for calculating position and time information uses three satellites and corrects the calculated position and time information errors by using another satellite. Further, the GPS module can calculate the speed information by continuously calculating the current position information in real time.

The A/V input unit 120 is for receiving an audio or video signal. The A/V input unit 120 may include a camera 121 that processes image data of still pictures or video obtained by an image capturing device in a video capturing mode or an image capturing mode. The processed image frame can be displayed on the display unit 151. The image frames processed by the camera 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 121 may be provided according to the configuration of the mobile terminal.

The user input unit 130 may generate key input data according to a command input by the user to control various operations of the mobile terminal. The user input unit 130 allows the user to input various types of information, and may include a keyboard, a pot, a touch pad (eg, a touch sensitive component that detects changes in resistance, pressure, capacitance, etc. due to contact), a scroll wheel , rocker, etc. In particular, when the touch panel is superimposed on the display unit 151 in the form of a layer, a touch screen can be formed.

The sensing unit 140 detects the current state of the mobile terminal 1 (eg, the open or closed state of the mobile terminal 1), the location of the mobile terminal 1, the presence or absence of contact (ie, touch input) by the user with the mobile terminal 1, and the mobile terminal. The orientation of 1, the acceleration or deceleration movement and direction of the mobile terminal 1, and the like, and generates a command or signal for controlling the operation of the mobile terminal 1. For example, when the mobile terminal 1 is implemented as a slide type mobile phone, the sensing unit 140 can sense whether the slide type phone is turned on or off. In addition, the sensing unit 140 can detect whether the power supply unit 190 provides power or whether the interface unit 170 is coupled to an external device. Sensing unit 140 may include proximity sensor 141 which will be described below in connection with a touch screen.

The interface unit 170 serves as a connection through which at least one external device is connected to the mobile terminal 1 mouth. For example, the external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, and an audio input/output. (I/O) port, video I/O port, headphone port, and more. The identification module may be stored to verify various information used by the user using the mobile terminal 1 and may include a User Identification Module (UIM), a Customer Identification Module (SIM), a Universal Customer Identification Module (USIM), and the like. In addition, the device having the identification module (hereinafter referred to as "identification device") may take the form of a smart card, and thus the identification device may be connected to the mobile terminal 1 via a port or other connection device. The interface unit 170 can be configured to receive input (eg, data information, power, etc.) from an external device and transmit the received input to one or more components within the mobile terminal 1 or can be used in the mobile terminal and external device Transfer data between.

In addition, when the mobile terminal 1 is connected to the external base, the interface unit 170 may function as a path through which power is supplied from the base to the mobile terminal 1 or may be used as a variety of command signals allowed to be input from the base to be transmitted to the mobile The path to the terminal. Various command signals or power input from the base can be used as signals for identifying whether the mobile terminal is accurately mounted on the base. Output unit 150 is configured to provide an output signal (eg, an audio signal, a video signal, an alarm signal, a vibration signal, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display unit 151 and the like.

The display unit 151 can display information processed in the mobile terminal 1. For example, when the mobile terminal 1 is in the phone call mode, the display unit 151 can display a user interface (UI) or a graphical user interface (GUI) related to a call or other communication (eg, text messaging, multimedia file download, etc.). When the mobile terminal 1 is in the video call mode or the image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or image and related functions, and the like.

Meanwhile, when the display unit 151 and the touch panel are superposed on each other in the form of a layer to form a touch screen, the display unit 151 can function as an input device and an output device. The display unit 151 may include liquid crystal At least one of a display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as a transparent display, and a typical transparent display may be, for example, a TOLED (Transparent Organic Light Emitting Diode) display or the like. According to a particular desired embodiment, the mobile terminal 1 may comprise two or more display units (or other display devices), for example, the mobile terminal may comprise an external display unit (not shown) and an internal display unit (not shown) . The touch screen can be used to detect touch input pressure as well as touch input position and touch input area.

The memory 160 may store a software program or the like for processing and control operations performed by the controller 180, or may temporarily store data (for example, a phone book, a message, a still image, a video, etc.) that has been output or is to be output. Moreover, the memory 160 can store data regarding vibrations and audio signals of various manners that are output when a touch is applied to the touch screen.

The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (eg, SD or DX memory, etc.), a random access memory (RAM), a static random access memory ( SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic memory, magnetic disk, optical disk, and the like. Moreover, the mobile terminal 1 can cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.

The controller 180 typically controls the overall operation of the mobile terminal. For example, the controller 180 performs the control and processing associated with voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 181 for reproducing (or playing back) multimedia data, which may be constructed within the controller 180 or may be configured to be separate from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.

The power supply unit 190 receives external power or internal power under the control of the controller 180 and provides Appropriate power required to operate the various components and components.

The various embodiments described herein can be implemented in a computer readable medium using, for example, computer software, hardware, or any combination thereof. For hardware implementations, the embodiments described herein may be through the use of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays ( An FPGA, a processor, a controller, a microcontroller, a microprocessor, at least one of the electronic units designed to perform the functions described herein, in some cases, such an embodiment may be at the controller 180 Implemented in the middle. For software implementations, implementations such as procedures or functions may be implemented with separate software modules that permit the execution of at least one function or operation. The software code can be implemented by a software application (or program) written in any suitable programming language, which can be stored in memory 160 and executed by controller 180.

So far, the mobile terminal has been described in terms of its function. Hereinafter, for the sake of brevity, a slide type mobile terminal among various types of mobile terminals such as a folding type, a bar type, a swing type, a slide type mobile terminal, and the like will be described as an example. Therefore, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.

The mobile terminal 1 as shown in FIG. 1 may be configured to operate using a communication system such as a wired and wireless communication system and a satellite-based communication system that transmits data via frames or packets.

A communication system in which a mobile terminal according to the present invention can be operated will now be described with reference to FIG.

Such communication systems may use different air interfaces and/or physical layers. For example, air interfaces used by communication systems include, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and Universal Mobile Telecommunications System (UMTS) (in particular, Long Term Evolution (LTE)). ), Global System for Mobile Communications (GSM), etc. As a non-limiting example, the following description relates to a CDMA communication system, but such teachings are equally applicable to other types of systems.

Referring to FIG. 2, a CDMA wireless communication system may include a plurality of mobile terminals 1, a plurality of base stations (BS) 270, a base station controller (BSC) 275, and a mobile switching center (MSC) 280. MSC 280 It is configured to interface with a public switched telephone network (PSTN) 290. The MSC 280 is also configured to interface with a BSC 275 that can be coupled to the BS 270 via a backhaul line. The backhaul line can be constructed in accordance with any of a number of well known interfaces including, for example, E1/T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. It will be appreciated that the system as shown in FIG. 2 may include multiple BSCs 2750.

Each BS 270 can serve one or more partitions (or regions), with each partition covered by a multi-directional antenna or an antenna pointing in a particular direction radially away from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS 270 can be configured to support multiple frequency allocations, and each frequency allocation has a particular frequency spectrum (eg, 1.25 MHz, 5 MHz, etc.).

The intersection of partitioning and frequency allocation can be referred to as a CDMA channel. BS 270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology. In such a case, the term "base station" can be used to generally mean a single BSC 275 and at least one BS 270. A base station can also be referred to as a "cell station." Alternatively, each partition of a particular BS 270 may be referred to as multiple cellular stations.

As shown in FIG. 2, a broadcast transmitter (BT) 295 transmits a broadcast signal to the mobile terminal 1 operating within the system. In FIG. 2, several Global Positioning System (GPS) satellites 300 are shown that help locate at least one of a plurality of mobile terminals 1.

In Figure 2, a plurality of satellites 300 are depicted, but it is understood that useful positioning information can be obtained using any number of satellites. The GPS module, which is the location information module 115 shown in Figure 1, is typically configured to cooperate with the satellite 300 to obtain the desired positioning information. Instead of GPS tracking technology or in addition to GPS tracking technology, other techniques that can track the location of the mobile terminal can be used. Additionally, at least one GPS satellite 300 can selectively or additionally process satellite DMB transmissions.

As a typical operation of a wireless communication system, the BS 270 receives reverse link signals from various mobile terminals 1. The mobile terminal 1 typically participates in calls, messaging, and other types of communications. Each reverse link signal received by a particular BS 270 is processed within a particular BS 270. The obtained data is forwarded to the relevant BSC 275. The BSC provides call resource allocation and coordinated mobility management functions including a soft handoff procedure between the BSs 270. The BSC 275 also routes the received data to the MSC 280, which provides additional routing services for interfacing with the PSTN 290. Similarly, PSTN 290 interfaces with MSC 280, which forms an interface with BSC 275, and BSC 275 controls BS 270 accordingly to transmit forward link signals to mobile terminal 1.

Based on the above-described mobile terminal hardware structure and communication system, various embodiments of the method of the present invention are proposed.

Embodiment 1

An image processing method provided by an embodiment of the present invention is as shown in FIG. 3, and the method may include:

S101. Acquire original RAW data of an image to be processed.

It should be noted that, in the process of image capturing using the terminal, the acquisition of the raw RAW data of the image to be processed by the terminal is realized by an image sensor provided in the terminal.

The image sensor may include a charge coupled device (CCD) image sensor and a Color Filter Array (CMOS) filter element of a complementary metal oxide semiconductor (CMOS) image sensor. Optionally, the image sensor is a two-dimensional matrix composed of photosensitive elements densely arranged in two directions, forming a Bayer mode RGB pixel dot arrangement, and the common ones are (a) and (b) shown in FIG. , (c), (d) Four Bayer patterns are arranged in such a way that each CCD corresponds to one pixel. Among them, R induces red light, G senses green light, B induces blue light, and in Bayer mode, G is twice as large as R and B (because human eyes are more sensitive to green).

It should be noted that each CCD or CMOS in the above two-dimensional matrix is only used to sense the energy of photons, and each CCD or CMOS generates a corresponding proportion of charges due to the intensity of incoming light, and each CCD or CMOS will Charge information is collected and amplified and stored, for example For example, the CMOS sensor photon shown in the CMOS photon sensing diagram shown in FIG. 5 finally stores the corresponding proportion of charge (the block shown in FIG. 5), and the RAW record is the charge value of each pixel position, which is not recorded. Any color information, that is: the original RAW data of the image to be processed is just a grayscale file.

Exemplarily, when the original RAW data is presented in the form of an image, there is no color for one grayscale image mode. In the image formed by the original RAW data as shown in FIG. 6, the image formed by the original RAW data can be seen as black and white. And there is also a mosaic phenomenon.

It should be noted that the operation of the terminal to process an image in the embodiment of the present invention may be understood as an image processing application in the terminal to process the image to be processed.

S102. Calculate key shooting parameters in the original RAW data according to a preset strategy.

After the terminal acquires the original RAW data of the image to be processed, the terminal stores the scene information of the image to be processed in the original RAW data, and the terminal calculates the key shooting parameters of the original RAW data according to the scene information and the preset strategy.

Optionally, the terminal calculates at least one of a white balance gain parameter and a color transformation matrix parameter of the original RAW data according to the preset policy.

Among them, white balance is a very important concept of image processing. The so-called white balance (English name is White Balance) is the restoration of white objects. When the user views the world in the naked eye, the feeling of the same color is basically the same under different light. For example, when the morning sun rises, look at a white object and feel it is white; Under the dim light of the night, the white object was seen and it was still white. This is because human beings have adapted to the color reduction of objects in different light rays during their growth from birth. However, as a photographing terminal or a terminal having a photographing function, such as a digital camera, there is no human eye adaptability. In different light, the digital camera will cause color reduction distortion of the digital camera due to the imbalance of the CCD output. Under normal circumstances, the user habitually thinks that the sunlight is white, the color temperature of the direct sunlight is about 5200K, and the color temperature of the incandescent lamp is about 3000K. Traditional phase When the machine's daylight film is taken, the incandescent light is yellowish and reddish because the color temperature is too low. Therefore, when the color temperature of the spot light is lower than the color temperature set by the camera, it tends to be yellowish and reddish. When the color temperature of the spot light is higher than the camera setting, it will be bluish.

In order to solve the white drift phenomenon caused by different color temperatures. Since white responds most to changes in color temperature, white is often used as the primary color of the adjustment. Typical white balance adjustments may include: automatic white balance, tungsten white balance, fluorescent white balance, indoor white balance, manual adjustment.

It should be noted that the preset policy may be an algorithm for calculating a gain parameter or a color transformation matrix of the white balance, and the implementation manner of the embodiment of the present invention is not limited.

Optionally, the key shooting parameters in the original RAW data may further include: a width, a height, a pixel number, a black level of the image to be processed, a rotation parameter of the image capturing camera corresponding to the RAW data, and the like, wherein the rotation The parameters may include: a rotation direction and a rotation angle, etc., and may be used for subsequent third-party applications to perform rotation correction on the image according to the rotation parameter. However, the white balance parameter and the color transformation matrix parameters are important (the white balance gain parameter is used to adjust the white balance parameter) because these two parameters affect the normal color resolution of the original RAW data. For the calculation of the above parameters, in the embodiment of the present invention, the color conversion matrix and the black level of each fixed sensor are fixed, and the white balance parameter is automatically calculated according to the scene.

It should be noted that after the terminal completes the automatic white balance adjustment or color conversion adjustment of the image, the key shooting parameters such as Rgain, Ggain, Bgain or color conversion matrix parameters required for the RAW data are written to the original RAW data. In, form a RAW file.

S103. Write key shooting parameters and original RAW data into the RAW file according to a preset encoding specification.

It should be noted that, because different image processing applications in the terminal have different parsing methods or encoding methods for files in the RAW format, the RAW file encoded by one image processing application may not be parsed by another image processing application. The terminal of the embodiment of the present invention performs the key shooting parameters and the original RAW data required for the RAW file according to the uniformly parsable encoding format. Encapsulation, that is, the terminal writes key shooting parameters and raw RAW data into a RAW file according to a preset encoding specification.

Optionally, the terminal writes the key shooting parameters and the original RAW data into the RAW file according to the Digital Negative (DNG) encoding specification.

It should be noted that DNG is mainly extended on the basis of the TIFF format, and the basic format of the encoding is basically defined in TIFF or TIFF/EP. Among them, the three keywords in the TIFF file format are: Image File Header (IFH); Image File Directory (IFD) and Directory Entry (DE). Figure 7 shows the data structure of TIFF. The following is based on the data structure of TIFF.

It should be noted that each image starts with an 8-byte IFH, which points to the first IFD. The IFD contains various information about the image and also contains a pointer to the actual image data.

Among them, (1), the composition of IFH

Byte 0-1: Byte order flag, value is II or MM. II indicates that the small byte is first, also known as little-endian. MM means that the big byte is in front and becomes big-endian again.

Byte 2-3: The flag of TIFF is generally 42, indicating that the image is in tiff format.

Byte 4-7: The offset of the first IFD. Can be anywhere, but must be at the boundary of a word, that is, it must be an integer multiple of 2.

(2), the composition of the IFD (0 represents the starting position of this IFD)

IFD is the most important data structure in the TIF diagram. It contains the most important information in a TIF file. A TIF map may have multiple IFDs. This means that there are multiple images in the file, and each IFD identifies the basics of one image. Attributes. The IFD structure contains three types of members. The Directory Entry Count indicates how many directory entries are in the structure. The next is the sequence of N linearly arranged DE sequences. The final is an offset that identifies the next file directory relative to The location at the beginning of the file, of course, if the TIF file contains only one image, then there is only one IFD, obviously, this offset is equal to 0;

Byte 0-1: Indicates how many DEs are included in this IFD, assuming the number is n

Byte 2-(n*12+1): n DE

Byte(n*12+2)-(n*12+5): The offset of the next IFD, if not set to 0.

(3), the composition of DE

A DE is an attribute of an image. For example, the size, resolution, compression of the image, the number of rows and columns of pixels, one pixel is represented by several bits (1 bit represents black and white, 8 bits represent 256 colors, etc.). The above white balance parameter is a value in the attribute, where: the tag member is the number of the attribute, and in the image file directory, it is arranged in ascending order. We can read these numbers and then look up the appropriate meaning in the official white paper on TIF format. Attributes are represented by data, and type is the type that represents the data. A total of 12 bytes per DE:

Byte 0-1: Unique identifier of this TAG

Byte 2-3: type data type.

Byte 4-7: The number of lenghts. The type and number can be used to determine the number of bytes that the data storing this TAG needs to occupy.

Byte 8-11: valueOffset is the offset of the variable value represented by the attribute identified by the tag relative to the beginning of the file. If the number of bytes occupied is less than 4, then the value is stored in the valueOffset, there is no need to point to another place. If there are more than 4, then the pointer to the actual data is stored here.

Therefore, exemplarily, according to the above TIFF file format, the terminal writes the original RAW data and the key shooting parameters into the RAW file according to the preset DNG encoding specification, and assumes that the RAW data is image data of one image to be processed, and key shooting parameters. As for 8, the data stream of the RAW file written by the terminal is as shown in FIG. Among them, since the RAW data is the image data of one image to be processed, there is only one IFD in FIG. 8, and the key shooting parameters are eight, and therefore, there are eight DEs in FIG.

It should be noted that the number of DEs can be set to N, that is, DE0, DE1, DE2, ... DEN. In the embodiment of the present invention, the number of DEs can be set according to actual needs. In addition, the eight DEs in FIG. 8 , that is, DE0, DE1, DE2, . . . , DE7 are only exemplified, and the number of DEs in the embodiment of the present invention is not specifically limited.

S104. Open a RAW file by using a third-party application to generate an RAW image file.

S105. Perform image post-processing on the image file of the RAW.

After the terminal writes the key shooting parameters and the original RAW data into the RAW file according to the preset encoding specification, when the user wants to use the third-party application on the terminal to process the image to be processed, the terminal can open the RAW file by using the third-party application. A RAW image file is generated to continue processing the RAW image file.

Optionally, the terminal parses the key shooting parameters in the RAW file by using a third-party application; in the third-party application, the original RAW data is adjusted according to the parsed key shooting parameters to generate a RAW image file. The third-party application herein may be any one of image processing applications, and in the present embodiment, the third-party application may be an application other than an image application running by a camera that forms the RAW data.

It should be noted that the third-party application in the embodiment of the present invention is a third-party image processing application in the terminal.

It should be noted that since the RAW file includes the original RAW data (ie, the image data of the image to be processed) and the key shooting parameters (including the parameters for characterizing the color), the terminal uses a third party to open the RAW file to generate a RAW image file. It is a bright, high-quality image that is larger than the original RAW image.

It can be understood that in different applications in one terminal, the original RAW data of the image captured by one image processing application can be used by another image processing application of different encoding modes, and the unused image of the RAW data in the same terminal is realized. Handling sharing in the application improves the efficiency and applicability of image processing.

Optionally, the image post-processing of the RAW image file by the terminal may be: the third party in the terminal or the terminal performs at least one of color, contrast, and brightness of the image file of the RAW.

Exemplarily, the effect of the image to be processed after the RAW file is opened by the terminal through a third-party application, such as a PS (Photoshop) application, is as shown in FIG. 9.

An image processing method provided by an embodiment of the present invention obtains original RAW data of an image to be processed; calculates key shooting parameters in the original RAW data according to a preset strategy; and records the key shooting parameters and the original RAW data according to a preset encoding The specification is written into the RAW file; the third-party application is used to open the RAW file to generate the RAW image file; and the image processing of the RAW image file is post-processed. With the above technical implementation scheme, since the original RAW data is uniformly encoded, the third-party application can parse the RAW file, so that the RAW file can be developed to obtain the RAW image file, since the RAW image file is directly generated and adopted in the third-party application. The image is post-processed as an object, and the degradation of the RAW file data is small. Therefore, when the third-party application performs post-processing on the image, the color and brightness of the image can be more freely adjusted without worrying about the degradation of the image quality. Good image processing effect, thus improving the image rendering effect of image processing.

Embodiment 2

As shown in FIG. 10, an embodiment of the present invention provides a terminal 1, which may include:

The obtaining unit 10 is configured to acquire raw RAW data of the image to be processed.

The calculating unit 11 is configured to calculate key shooting parameters in the original RAW data acquired by the acquiring unit 10 according to a preset policy.

The writing unit 12 is configured to write the key shooting parameters calculated by the calculating unit 11 and the original RAW data acquired by the obtaining unit 10 into a RAW file according to a preset encoding specification.

a generating unit 13 configured to open the writing unit 12 by using a third-party application RAW file, which generates RAW image files.

The processing unit 14 is configured to perform image post-processing on the image file of the RAW generated by the generating unit 13.

Optionally, the calculating unit 11 is configured to calculate at least one of a gain parameter and a color transformation matrix parameter of the white balance of the original RAW data acquired by the acquiring unit 10 according to a preset policy.

In some embodiments, the calculating unit 11 is further configured to calculate, according to a preset policy, a width, a height, a pixel number of bits, a black balance parameter, and a camera that forms the RAW data corresponding to the original RAW data. One or more of the rotation parameters.

Optionally, as shown in FIG. 11 , the terminal 1 further includes: a parsing unit 15 .

The parsing unit 15 is configured to parse key shooting parameters in the RAW file calculated by the calculating unit 11 by using the third-party application.

The generating unit 13 is configured to adjust, in the third-party application, the original written by the writing unit 12 according to the key shooting parameters parsed by the parsing unit 15 from the writing unit 12 RAW data, generating an image file of the RAW.

Optionally, the writing unit 12 is configured to write the key shooting parameters calculated by the calculating unit 11 and the original RAW data acquired by the acquiring unit 10 into a RAW file according to a DNG encoding specification.

Optionally, the processing unit 14 is configured to perform at least one of color, contrast, and brightness of the image on the image file of the RAW generated by the generating unit 13 .

Optionally, the terminal in the embodiment of the present invention may be an electronic device such as a mobile phone, a tablet, or a camera, which has a shooting function and an image processing function, and is not limited in the embodiment of the present invention.

As shown in FIG. 12, in an actual application, the above-mentioned obtaining unit 10, computing unit 11, writing unit 12, generating unit 13, processing unit 14, and parsing unit 15 may be implemented by a processor 16 located on the terminal 1, specifically for the center. Processor (CPU), microprocessor (MPU), digital signal Implemented by a processor (DSP) or a field programmable gate array (FPGA), etc., the terminal 1 may further include a storage medium 17, which may be connected to the processor 16 via a system bus 18, wherein the storage medium 17 is used for storage Program code may be executable, the program code including computer operating instructions, storage medium 17 may include high speed RAM memory, and may also include non-volatile memory, such as at least one disk memory.

A terminal provided by the embodiment of the present invention, the terminal acquires original RAW data of an image to be processed; calculates key shooting parameters in the original RAW data according to a preset strategy; and records the key shooting parameters and the original RAW data according to a preset encoding The specification is written into the RAW file; the third-party application is used to open the RAW file to generate the RAW image file; and the image processing of the RAW image file is post-processed. With the above technical implementation scheme, since the original RAW data is uniformly encoded, the third-party application can parse the RAW file, so that the RAW file can be developed and processed to obtain a RAW image file, which is directly generated and used in the third-party application of the terminal. The image file is used as an object for post-processing, and the degradation of the RAW file data is small. Therefore, when the third-party application performs post-processing on the image, the color and brightness of the image can be more freely adjusted without worrying about the degradation of the image quality. Achieve the best image processing effect, thereby improving the image rendering effect of image processing.

The embodiment of the invention further provides a terminal, which may be a mobile phone, a tablet computer, a dedicated camera or a storable memory, configured to store a computer storage program.

Obtaining raw RAW data of the image to be processed;

Image post processing is performed on the image file of the RAW.

Optionally, the processor is further configured to calculate at least one of a white balance gain parameter and a color transformation matrix parameter of the original RAW data according to a preset policy.

Optionally, the processor is further configured to

And calculating one or more of a width, a height, a pixel number of bits, a black balance parameter, and a rotation parameter of a camera that forms the RAW data corresponding to the original RAW data according to a preset strategy.

Optionally, the processor is configured to parse key shooting parameters in the RAW file by using the third-party application;

In the third-party application, adjusting the original RAW data according to the parsed key shooting parameters;

The image file of the RAW is generated based on the adjusted original RAW data.

Optionally, the processor is configured to write the key shooting parameters and the raw RAW data into a RAW file according to a digital news gathering DNG encoding specification.

Optionally, the processor is configured to perform at least one of color, contrast, and brightness of the image on the RAW image file.

The processor herein can be a central processing unit, a microprocessor, a digital signal processor, an application processor, or become one or more of an array.

The memory may be various memories such as a random access memory, a read only memory, a flash memory, and the like.

The processor and the memory may be connected by a bus, where the bus may include an integrated circuit (IIC) bus or a peripheral interconnect standard (PCI) bus.

The embodiment of the present invention provides a computer storage medium, where the computer storage medium stores a computer program, and after the computer program is executed by the processor, the image processing method provided by any one of the foregoing technical solutions can be implemented. The computer storage medium can be a random storage medium, a read-only storage medium, a flash memory or a mobile hard disk, or the like.

Optionally, the computer storage medium is a non-transitory storage medium.

The above is only the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. The modifications made in accordance with the principles of the present invention are understood to fall within the scope of the present invention.

Industrial applicability

According to the technical solution disclosed in the embodiment of the present invention, before the image processing, the RAW image file is generated based on the original RAW data and the key shooting parameters, and the RAW image file is post-processed, so that the image is processed relative to the already processed image. The processing of the file can reduce the problem of poor image processing caused by the post-processing caused by the change of the image caused by the original processing, and improve the image processing quality. The solution provided by the embodiment of the present invention can realize the above solution by setting a computer program in the processing device, and is industrially simple and widely used.

Claims

An image processing method comprising:

Obtaining raw RAW data of the image to be processed;

Calculating key shooting parameters in the original RAW data according to a preset strategy;

Writing the key shooting parameters and the original RAW data into a RAW file according to a preset encoding specification;

Opening the RAW file with a third-party application to generate a RAW image file;

Image post processing is performed on the image file of the RAW.
The method according to claim 1, wherein the calculating the key shooting parameters in the original RAW data according to a preset policy comprises:

At least one of a gain parameter and a color transformation matrix parameter of the white balance of the original RAW data is calculated according to a preset strategy.
The method of claim 2, wherein

The calculating the key shooting parameters in the original RAW data according to the preset policy further includes:

And calculating one or more of a width, a height, a pixel number of bits, a black balance parameter, and a rotation parameter of a camera that forms the RAW data corresponding to the original RAW data according to a preset strategy.
The method of claim 1, wherein the opening the RAW file by using a third-party application to generate an image file of the RAW comprises:

Parsing key shooting parameters in the RAW file with the third party application;

In the third-party application, adjusting the original RAW data according to the parsed key shooting parameters;

The image file of the RAW is generated based on the adjusted original RAW data.
The method of claim 1 wherein said key capture parameters and said The original RAW data is written into the RAW file according to the preset encoding specification, including:

The key shooting parameters and the raw RAW data are written into the RAW file according to the digital news gathering DNG encoding specification.
The method according to claim 1, wherein said performing image post-processing on said image file of said RAW comprises:

At least one of color, contrast, and brightness of the image is performed on the image file of the RAW.
A terminal comprising:

An obtaining unit configured to acquire raw RAW data of an image to be processed;

a calculating unit, configured to calculate a key shooting parameter in the original RAW data acquired by the acquiring unit according to a preset policy;

a writing unit configured to write the key shooting parameters calculated by the calculating unit and the original RAW data acquired by the acquiring unit into a RAW file according to a preset encoding specification;

a generating unit, configured to open the RAW file written by the writing unit by using a third-party application, to generate an RAW image file;

The processing unit is configured to perform image post-processing on the image file of the RAW generated by the generating unit.
The terminal according to claim 7, wherein

The calculating unit is configured to calculate at least one of a gain parameter and a color transformation matrix parameter of the white balance of the original RAW data acquired by the acquiring unit according to a preset policy.
The terminal according to claim 8, wherein

The calculating unit is configured to calculate, according to a preset policy, one or more of a width, a height, a pixel number, a black balance parameter, and a rotation parameter of a camera that forms the RAW data corresponding to the original RAW data. One.
The terminal according to claim 8, wherein the terminal further comprises: a parsing unit;

The parsing unit is configured to parse, by the third-party application, key shooting parameters in the RAW file calculated by the calculating unit;

The generating unit is configured to, in the third-party application, adjust the original RAW data written by the writing unit according to the key shooting parameter parsed by the parsing unit from the writing unit; The adjusted raw RAW data is generated to generate an image file of the RAW.
The terminal according to claim 8, wherein

The writing unit is configured to write the key shooting parameters calculated by the calculating unit and the original RAW data acquired by the acquiring unit into a RAW file according to a digital news gathering DNG encoding specification.
The terminal according to claim 7, wherein

The processing unit is configured to perform at least one of color, contrast, and brightness of the image on the image file of the RAW generated by the generating unit.
A terminal comprising:

a memory configured to store computer stored programs,

A processor, coupled to the memory, configured to perform the following operations by executing the computer program:

Obtaining raw RAW data of the image to be processed;

Calculating key shooting parameters in the original RAW data according to a preset strategy;

Writing the key shooting parameters and the original RAW data into a RAW file according to a preset encoding specification;

Opening the RAW file with a third-party application to generate a RAW image file;

Image post processing is performed on the image file of the RAW.
The terminal of claim 13 wherein:

The processor is further configured to calculate a white level of the original RAW data according to a preset policy At least one of a gain parameter and a color transformation matrix parameter.
The terminal according to claim 14, wherein

The processor is further configured to

And calculating one or more of a width, a height, a pixel number of bits, a black balance parameter, and a rotation parameter of a camera that forms the RAW data corresponding to the original RAW data according to a preset strategy.
The terminal according to claim 13, wherein the processor is configured to parse key shooting parameters in the RAW file by using the third party application;

In the third-party application, adjusting the original RAW data according to the parsed key shooting parameters;

The image file of the RAW is generated based on the adjusted original RAW data.
The terminal of claim 13, wherein the processor is configured to write the key capture parameters and the raw RAW data into a RAW file in accordance with a digital news gathering DNG encoding specification.
The terminal of claim 13, wherein the processor is configured to perform at least one of color, contrast, and brightness of the image on the RAW image file.
A computer storage medium storing a computer program, the computer program being executable by a processor, capable of implementing the method of any one of claims 1 to 6.
The computer storage medium of claim 19, the computer storage medium being a non-transitory storage medium.