JP2016096476A - Image processing device, image processing method and image processing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing device that can make inconspicuous the difference in hue between displays of different display devices.SOLUTION: An image processing device 101 has a first achieving part 13 for achieving a first reproduction characteristic as a color reproduction characteristic of a first display device, a second achieving part 13 for achieving a second reproduction characteristic as a color reproduction characteristic of a second display device different from the first display device, a storage part 11 for storing data of an image, and a correction part 13 for correcting the color of the image on the basis of the first reproduction characteristic and the second reproduction characteristic so that a display based on the first reproduction characteristic can be implemented in the second display device, and generating data of a corrected image.SELECTED DRAWING: Figure 5

Description

  The present disclosure relates to an image processing apparatus that performs color correction of a color image.

  In recent years, there are increasing opportunities to browse images taken with a digital camera on a display device such as a television. For example, an image captured by a camera can be transmitted to a television via HDMI (registered trademark) and displayed on the television (Patent Document 1).

JP 2008-187536 A

  However, conventionally, the color of the image when the captured image is displayed on the liquid crystal display on the back of the main body of the digital camera is the same as the color when the same image is displayed on a display device such as a television. The display may be different despite the video display based on the image data.

  The present disclosure provides an image processing device capable of making a difference in color at least inconspicuous when a certain image (still image and moving image) is displayed on different display devices.

  An image processing apparatus according to the present disclosure includes a first acquisition unit that acquires a first reproduction characteristic that is a color reproduction characteristic of a first display device, and a color reproduction characteristic of a second display device that is different from the first display device. A second acquisition unit that acquires the second reproduction characteristic, a storage unit that stores image data, and the first display characteristic and the second reproduction characteristic based on the first reproduction characteristic and the second reproduction characteristic. A correction unit that corrects the color of the image and generates corrected image data so that display with reproduction characteristics is realized.

  The image processing device according to the present disclosure makes at least inconspicuous a difference in color when a certain image (still image and moving image) is displayed on different display devices (first and second image display devices). Can do.

Schematic diagram explaining the difference in color when one image is displayed on a camera display and a television by the conventional technology 1 is a block diagram of an image processing and display system according to a first embodiment of the present invention. It is a block diagram which shows the structure of a camera (imaging device). It is a block diagram which shows the structure of a television (display apparatus). It is a figure which shows the sequence of the image processing and display of 1st Embodiment. 4 is a flowchart illustrating a flow of image color correction processing according to the first embodiment. It is a figure for demonstrating display reproduction characteristic data. It is a figure for demonstrating a display apparatus model database. The figure which shows the example of the conversion map H used by a color correction process It is a block diagram of the image processing and display system which concerns on the 2nd Embodiment of this invention. It is a block diagram which shows the structure of a server. It is a figure which shows the sequence of the image processing and display of 2nd Embodiment. It is a figure which shows the example of a color sample image. It is a flowchart which shows the flow of the image color correction process of 2nd Embodiment.

  Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed descriptions of already well-known matters and repeated descriptions for substantially the same configuration may be omitted. This is to avoid the following description from becoming unnecessarily redundant and to facilitate understanding by those skilled in the art.

  The inventor (s) provides the accompanying drawings and the following description in order for those skilled in the art to fully understand the present disclosure, and is intended to limit the subject matter described in the claims. Not what you want.

  FIG. 1A is a diagram showing a display DPL1a when a certain image is displayed on the display of the camera body and a display DPL2a when the same image (same image data) is displayed on the television. As shown in the figure, although the display is based on the same image data, if the display devices are different, the colors may be different between the two displays DPL1a and DPL2a. As described above, it is generally not desirable that the colors differ depending on the display device, and it is desirable that images be displayed with the same color.

  Therefore, the present disclosure provides two display devices for an image so that the difference in color between display of the image on one display device and display of the same image on another display device is at least inconspicuous. An image processing apparatus that performs image processing in consideration of reproduction characteristics (for example, gamma characteristics) is provided.

(Embodiment 1)
From here, Embodiment 1 is demonstrated using FIGS.

[1-1. Constitution]
[1-1-1. System configuration]
FIG. 2 is a block diagram illustrating a configuration of a system 100 for image processing and display according to Embodiment 1 of the present invention. The system 100 includes a camera 101 that captures a subject and generates image data, and a television 102 that is connected to the camera 101 so that data can be transmitted and received. The camera 101 includes a storage unit 11 that holds image data and various data that will be described later, and a display 12 that can display an image. The camera 101 has a function as an image processing apparatus according to the present embodiment.

  The camera 101 captures still images and moving images, and stores image data acquired by the imaging in the storage unit 11. The television 102 can receive the image data sent from the camera 101 and display a still image and a moving image based on the received image data.

[1-1-2. Camera configuration]
FIG. 3 is a block diagram illustrating the configuration of the camera 101. The camera 101 controls the entire camera and performs predetermined image processing on image data, a photographing unit 14 that captures images, a storage unit 11 that stores and holds various data, and an external device. It has the communication part 15 which performs data transmission / reception, and the display 12 which displays an image etc.

  The control unit 13 includes a CPU (Central Processing Unit) and its auxiliary circuit, controls each unit constituting the camera 101, and executes various processes according to programs and data stored in the storage unit 11. To do. Various processes include image processing on image data. The control unit (CPU) 13 can execute processing to be described later by executing a predetermined program.

  Note that the control unit 13 can also be implemented as a processor such as an application specific integrated circuit (ASIC), a programmable logic device such as a field-programmable gate array (FPGA), or a microcontroller.

  The imaging unit 14 includes an imaging device (CCD (Charge-Coupled Device) image sensor, CMOS (Complementary Metal-Oxide-Semiconductor) image sensor, etc.) and a peripheral circuit that processes signals output from the imaging device. Based on the 13 instructions, image (still image, moving image) data is generated and output.

  The storage unit 11 stores a program executed by the control unit (CPU) 13 and is used as a work area necessary for executing the program. The storage unit 11 is also used for holding image data. In addition, the storage unit 11 holds a display device model database db1 and display reproduction characteristic data dg. (The details will be described later.) The storage unit 11 is a storage device such as a RAM (Random Access Memory) or a ROM (Read Only Memory). Further, a semiconductor memory (memory card, SSD (Solid State Drive)), a hard disk, or the like can be used as a storage medium of an auxiliary storage device for assisting the storage area of the storage unit 11.

  The communication unit 15 is a communication interface that transmits and receives data to and from an external device (for example, a television). The communication unit 15 can be connected to a network such as the Internet or a LAN (Local Area Network) via a public wireless communication network, a wireless LAN, a LAN cable, or the like. In that case, the communication unit 15 can transmit and receive data to and from the television 103 via the Internet or a LAN.

  The display 12 is a liquid crystal display provided on the back surface of the main body of the camera 101. The display 12 can reproduce and display images (still images and moving images) held in the storage unit 11.

[1-1-3. Configuration of TV]
FIG. 4 is a block diagram illustrating a configuration of the television 102. The television 102 includes a control unit 23 that controls the entire television and performs processing on image data, a display unit 22 that displays images, and a communication unit 25 that performs data transmission and reception with external devices.

  The control unit 23 includes a CPU and its auxiliary circuit, controls each unit constituting the television 102, and executes various processes according to programs and data stored in a storage unit (not shown). Various types of processing include image data reproduction processing. The control unit (CPU) 23 can execute processing to be described later by executing a predetermined program.

  The configuration of the control unit 23 is not limited to the CPU and its peripheral auxiliary circuits. The control unit 23 can be implemented as a processor such as an application specific integrated circuit (ASIC), a programmable logic device such as a field-programmable gate array (FPGA), or a microcontroller. The configuration is not limited to the example described above.

  The display unit 22 is a liquid crystal display. The display unit 22 can reproduce and display images (still images, moving images).

  The communication unit 25 is an interface that performs data transmission / reception with an external device (for example, a camera). The communication unit 25 can be connected to a network such as the Internet or a LAN (Local Area Network) via a public wireless communication network, a wireless LAN, a LAN cable, or the like.

[1-2. Operation]
Next, the operation of the camera 101 that is the image processing apparatus according to the present embodiment will be described with reference to FIGS.

  The camera 101 can display an image held in the storage unit 11 on a television 102 connected so as to be capable of data communication, and performs color correction processing, which will be described later, on the image to be displayed at the time of display. The image data thus transmitted is transmitted to the television 102. By doing so, the image can be displayed on the television 102 with the same color as when displayed on the display 12 (FIG. 2) of the camera 101.

  FIG. 5 is a diagram showing a series of flows when an image held in the camera 101 is displayed on the television 102.

  The user instructs the camera 101 to display a desired image on the television 102 (step SQ1).

  Upon receiving the display instruction from the user (step SQ2), the camera 101 requests the television 102 to present information related to the specifications of the television 102 (step SQ3).

  Receiving the information presentation request, the television 102 transmits information related to its own specification to the camera 101 (step SQ4).

Here, details of the specification information transmitted from the television 102 to the camera 101 will be described. The specification information can include information on the following items.
・ Model identifier ・ Individual identifier ・ Setting identifier ・ Display resolution ・ Supported system format ・ Supported video codec ・ Supported audio codec ・ Supported video format

  The model identifier is information for identifying the model of the television 102. The model identifier may be information such as “AX-900”, “AS-650”, or the like such as the model name of the TV 102 that can identify the model of the TV 102.

  The individual identifier is information for individually identifying the television 102, and is information on a serial number, for example.

  The setting identifier is information related to the display setting of the television 102. The setting identifier is information that can determine the display setting currently set in the television 102, such as “Standard”, “Vivid”, “Cinema”, and the like.

  The display resolution is information related to the display resolution that the television 102 can handle. The display resolution is information indicating, for example, resolution “4K”, “FHD”, “HD”, “VGA”, and the like.

  The compatible system format is information regarding the system format of moving image data that can be supported by the television 102. The corresponding system format is information indicating, for example, the system formats “MP4”, “M2TS”, “MPG”, “FLV”, and the like.

  The compatible video codec is information regarding the video codec of moving image data that can be supported by the television 102. The corresponding video codec is, for example, information indicating the video codec “H263”, “H264”, “H265”, “VC1”, “VP8”, and the like.

  The compatible audio codec is information regarding the audio codec of moving image data that can be supported by the television 102. The compatible audio codec is, for example, information indicating the audio codec “MPEG1-Audio”, “MPEG2-AAC”, “MPEG4-AAC”, “MPEG4-AAC LC”, “AC-3”, and the like.

  The supported video format is information on the video format of moving image data that can be supported by the television. The compatible video format is, for example, information indicating a resolution capable of reproducing a moving image and a frame rate (FPS (Frames Per Second)) (such as “4K30P” and “FHD60P”).

  Returning to FIG. 5, the camera 101 receives information on the specification of the television 102 as described above from the television 102 (step SQ5). The camera 101 that has received the specification information of the television 102 performs color correction processing on the image data of the image to be displayed on the television 102 (step SQ6).

  The camera 101 transmits the color-corrected image data (still image or moving image) to the television 102 (step SQ7).

  The television set 102 that has received the color-corrected image data displays an image based on the image data (step SQ8).

  The user browses the image thus displayed on the television 102 (step SQ9).

  Here, the color correction processing performed by the camera 101 will be described in detail with reference to FIGS.

  FIG. 6 is a flowchart of color correction processing performed by the control unit 13 of the camera 101.

  The control unit 13 of the camera 101 acquires display reproduction characteristic data dg stored in the storage unit 11 (step S61). The display reproduction characteristic data dg is data indicating the color reproduction characteristic of the display 12 of the camera 101. The color reproduction characteristic is, for example, the gamma characteristic of the display 12.

  FIG. 7 shows an example of gamma characteristics ((a) to (c)) of the display 12 and an example ((d)) of display reproduction characteristic data dg held in the storage unit 11 of the camera 101.

  FIG. 7A is a diagram illustrating an example of the gamma characteristic Fr related to the red color of the display 12. In this figure, the horizontal axis is the pixel value (normalized by the maximum value) of the red component of the pixels constituting the image data, and the vertical axis is the output signal output to the red subpixel of the corresponding pixel of the display 12. Signal strength (normalized by the maximum value). In other words, the gamma characteristic is a mapping in which the pixel value is input and the signal strength of the output signal is output.

  Similarly, FIGS. 7B and 7C are diagrams illustrating examples of gamma characteristics Fg and Fb relating to green and blue of the display 12, respectively.

  FIG. 7D shows the gamma characteristics Fr, Fg, and Fb as a table of output values with respect to discrete input values. The camera 101 holds a table as shown in FIG. 7D in the storage unit 11 as display reproduction characteristic data dg of the display 12. In step S61, the control unit 13 reads and obtains the display reproduction characteristic data dg from the storage unit 11.

  Returning to FIG. 6, the control unit 13 of the camera 101 acquires data indicating the color reproduction characteristics of the television 102 by searching the display device model database db1 using the model identifier obtained from the television 102 as a key. (Step S62). The color reproduction characteristic is, for example, the gamma characteristic of the television 102.

  FIG. 8 is a diagram illustrating an example of the display device model database db1.

  In the example of this figure, the display device model database db1 is a database configured by two tables db1a and db1b related by the item “gamma characteristic”.

  The first table db1a holds information indicating a gamma characteristic pattern for each television model identified by the model identifier. Furthermore, different information may be held for each individual identifier for televisions identified by the same model identifier. For example, a television having the model identifier “AX900” may be further distinguished by an individual identifier. Thereby, it is possible to maintain the gamma characteristic for each individual having different firmware even in the same model. The television identified by the individual identifier “PA11085CX” has display settings distinguished by setting identifiers “standard”, “Vivid”, and “cinema”, and the gamma characteristics are “pattern A” and “pattern B”, respectively. , “Pattern C”. On the other hand, the television identified by the individual identifier “PA11234CX” has only two types of display settings.

  The second table db1b is a table that holds discrete gamma characteristic information for each gamma characteristic pattern.

  In step S62, the control unit 13 of the camera 101 searches the first table db1a based on the model identifier or the like previously acquired in step SQ5, and specifies the pattern of the gamma characteristic of the television 102. Then, the control unit 13 acquires the gamma characteristic data of the television 102 by searching the second table db1b based on the gamma characteristic pattern thus identified. It should be noted that the individual identifier and the setting identifier are not essential for obtaining the gamma characteristic data in this step. The control unit 13 may acquire gamma characteristic data based only on the model identifier. In such a case, when a plurality of gamma characteristic patterns are recorded in the table db1a for one TV model specified by one model identifier, the control unit 13 is recorded at the top of the plurality of gamma characteristics. The pattern may be specified as the pattern of the gamma characteristic of the television.

  Returning to FIG. 6, the control unit 13 of the camera 101 checks the type of image (still image or moving image) to be displayed on the television 102 (step S63). If the type of image to be displayed is a still image, the process proceeds to step S64. If the type of image to be displayed is a moving image, the process proceeds to step S65.

  In step S64, the control unit 13 of the camera 101 performs resizing conversion on the image data of the image to be displayed. The resizing conversion processing here is processing that optimizes the resolution of the image data for the resolution of the television 102. That is, the control unit 13 optimizes the resolution of the image data to be displayed to the resolution of the television 102 based on the display resolution information acquired in step SQ5.

  The control unit 13 performs a color correction process on the resized image data (step S65). The color correction processing here is such that when the image data is displayed on the television 102, the color tone is similar to the color when displayed on its own display 12 (FIG. 3). This process corrects the pixel value of the image data.

  Specifically, in step S <b> 65, the control unit 13 determines the gamma characteristics of the display 12 of the camera 101 and the television 102 for each of the three color (RGB) components of each pixel value of the image data of the image to be displayed on the television 102. The inverse mapping of the gamma characteristic and the combined mapping of the image are applied, and the output is processed as each color component of each corrected pixel value.

  For example, the pixel value x of an arbitrary pixel of the image data before correction (resized) is x = (xr, xg, xb) (xr is a red component, xg is a green component, and xb is a blue component). When the gamma characteristic of the display 12 of the camera 101 is Fr (x), Fg (x), and Fb (x) (x is the value of each color component of the pixel) for each of RGB, the image is displayed on the display of the camera 101. The color when displayed at 12 is determined by Fr (xr), Fg (xg), and Fb (xb). On the other hand, when the gamma characteristics of the television 102 are Gr (x), Gg (x), and Gb (x), when an image is displayed on the television 102 based on the same image data, the color is Gr ( xr), Gg (xg), and Gb (xb).

Therefore, in order to match the color when an image is displayed on the display 12 of the camera 101 and the color when the image is displayed on the television 102, for each pixel value x of the image data, (From F (x) = G (x) · H (x))
H (x) = G ⁻¹ (x) · F (x)
The conversion map H (x) defined by Here, G ⁻¹ is an inverse mapping of the map representing the gamma characteristic of the television 102, F is a mapping representing the gamma characteristic of the display 12 of the camera 101, and H is a mapping between the mapping F and the mapping G ⁻¹ . It is a composite map.

  FIG. 9 is a diagram illustrating gamma characteristic maps F and G and a conversion map H used for color correction, taking a red component as an example. FIG. 9A is an example of the red gamma characteristic Fr of the display 12 of the camera 101, and FIG. 9B is an example of the red gamma characteristic Gr of the television 102. At this time, the inverse mapping of the mapping G is as shown in FIG. 9C, and as a result, the color correction conversion mapping H is as shown in FIG. 9D.

  The control unit 13 of the camera 101 performs color correction conversion based on the reproduction characteristic (gamma characteristic) of the display 12 acquired in step S61 and the reproduction characteristic (gamma characteristic) of the television 102 acquired in step S62. A table of mapping H is created, and each pixel value of the image data of the image resized in step S64 is converted using the table to generate color-corrected image data.

  Returning to FIG. 6, when the image to be displayed is a moving image, the control unit 13 of the camera 101 performs the corresponding system format, the corresponding video codec, the corresponding audio codec, and the acquired image data of the moving image in step SQ5. Based on the information of the corresponding video format, the format of the image data is converted (including the resizing process), and then the color correction process similar to that in step S65 is performed on the image data of the format converted video. Color-corrected image data is generated.

[1-3. Effects, etc. FIG. 1B shows an example of the image display DPL2b displayed on the television in step SQ8. As described above, when the camera 101 as the image processing apparatus according to the present embodiment displays an image on the television 102, the color reproduction characteristics (for example, gamma characteristics) of the display 12 of the camera 101 and the color of the television 102 are displayed. In consideration of the reproduction characteristics (for example, gamma characteristics), color correction processing is performed on the image data output to the television 102. Therefore, the image processing apparatus according to the present embodiment can produce an effect that a difference in color is less likely to occur when one image is displayed on the display 12 or the television 102.

(Embodiment 2)
The second embodiment will be described below with reference to FIGS.

[2-1. Constitution]
[2-1-1. System configuration]
FIG. 10 is a block diagram showing a configuration of a system 200 for image processing and display according to Embodiment 2 of the present invention. The system 200 includes a camera 201 having a display 12 capable of displaying captured images, a server 203 connected to the camera 201 so as to be able to transmit and receive data, and a television 202 connected to the server 203 so as to be able to transmit and receive data. is there. The server 203 includes a storage unit 31 that can store image data captured by the camera 201 and various data. The server 203 has a function as an image processing apparatus according to the present embodiment.

[2-1-2. Server configuration]
FIG. 11 is a block diagram showing the configuration of the server 203. The server 203 controls the entire server and performs predetermined image processing on image data, a storage unit 31 that stores and holds various data, a communication unit 35 that transmits and receives data to and from external devices, Have

  The control unit 33 includes a CPU (Central Processing Unit) and its auxiliary circuit, controls each unit constituting the server 203, and executes various processes according to programs and data stored in the storage unit 31. To do. Various processes include image processing on image data. The control unit (CPU) 33 can execute processing to be described later by executing a predetermined program.

  Note that the configuration of the control unit 33 is not limited to the CPU and its peripheral auxiliary circuits. The control unit 33 can also be implemented as a processor such as an application specific integrated circuit (ASIC), a programmable logic device such as a field-programmable gate array (FPGA), or a microcontroller.

  The storage unit 31 stores a program executed by the control unit (CPU) 33 and is used as a work area necessary for executing the program. The storage unit 31 is also used for holding image data. In addition, the storage unit 31 holds an imaging device model database db2 described later. The storage unit 11 is, for example, a storage device such as a RAM (Random Access Memory) or a ROM (Read Only Memory). Further, a semiconductor memory (memory card, SSD (Solid State Drive)), a hard disk, or the like can be used as a storage medium of an auxiliary storage device for assisting the storage area of the storage unit 11.

  The communication unit 35 is a communication interface that transmits and receives data to and from external devices (eg, the camera 201 and the television 202). The communication unit 15 can be connected to a network such as the Internet or a LAN (Local Area Network) via a public wireless communication network, a wireless LAN, a LAN cable, or the like. In that case, the communication unit 35 can transmit and receive data to and from the camera 201 and the television 202 via the Internet or a LAN.

[2-1-3. Camera configuration]
The configuration of the camera 201 may be the same as that of the camera 101 (FIG. 3). However, the camera 201 does not have to hold the display device type database db1 and the display reproduction characteristic data dg described above.

[2-1-4. Configuration of TV]
The configuration of the television 202 may be the same as that of the television 102 (FIG. 4).

[2-2. Operation]
Next, the operation of the server 203 that is the image processing apparatus according to the present embodiment will be described with reference to FIGS.

  In the first embodiment, an example in which the camera 101 performs the color correction processing illustrated in FIG. 6 has been described. On the other hand, in this embodiment, an example in which the server 203 performs a color correction process (FIG. 14) described later is shown. That is, in this embodiment, the server 203 operates as an image processing apparatus. The server 203 according to the present embodiment receives image data from the camera 201, performs color correction processing (to be described later) on the received image data, and transmits the color corrected image to the television 202. The television 202 displays the color-corrected image sent from the server 203. By doing so, in the system 200, an image can be displayed on the television 202 with substantially the same color as that displayed on the display of the camera 201. The color correction process described later with reference to FIG. 14 is a process similar to the color correction process already described above with reference to FIG. However, this color correction processing includes processing different from the color correction processing shown in FIG. 6 in obtaining reproduction characteristics relating to the color display of the television 202. Although details will be described later, in the color correction processing illustrated in FIG. 14, the server 203 displays a color sample image on the television 202 and is based on the color sample image (“color sample captured image”) captured by the camera 201. Then, the reproduction characteristic of the television 202 is estimated, and the estimated reproduction characteristic is regarded as the reproduction characteristic of the television 202, and color correction processing is executed. Therefore, the server 203 according to the present embodiment does not have to hold a database corresponding to the display device type database db1 included in the camera 101 according to the previous embodiment.

  The server 203 holds a database related to the reproduction characteristics of the display of the camera 201. The server 203 obtains the reproduction characteristics (eg, gamma characteristics) of the camera 201 from the database, and obtains the reproduction characteristics (eg, gamma characteristics) of the television 202 by estimating based on the color sample photographed image. Then, color correction processing is performed on the image to be displayed on the television 202 based on both reproduction characteristics.

  FIG. 12 is a diagram showing a series of flows when an image captured by the camera 201 and held in the server 203 is displayed on the television 202.

  When the camera 201 captures an image, the camera 201 holds the image data obtained by the imaging in the storage unit in the camera 201, and the camera 201 transmits the image data to the server 203 as needed (step SQ101).

  The server 203 receives the image data sent from the camera 201 and saves the image data in the storage unit 31 (step SQ102).

  The processes relating to steps SQ101 and SQ102 are executed at any time. By doing so, the server 203 accumulates the image data (still image, moving image) generated by the camera 201 in the storage unit 31.

  Thereafter, the user instructs the camera 201 to display a desired image on the display device (television 202) (step SQ103).

  Upon receiving the display instruction from the user (step SQ104), the camera 201 transmits a request for displaying an image on the television 202 to the server 203, and an identifier (photographing device identifier) for identifying the camera 201 itself. ) Is transmitted to the server 203 (step SQ105). Here, the imaging device identifier transmitted from the camera 201 to the server 203 is information relating to the model name of the camera 201. The imaging device identifier may be information that can identify the model of the camera 201. Alternatively, information (individual identifier, display setting identifier) necessary to specify the color reproduction characteristics of the display of the camera 201 may be included.

  The server 203 receives from the camera 201 a request to display an image on the television 202 and a photographing device identifier (step SQ106). The imaging device identifier received here is used for acquisition of camera display reproduction characteristics of color correction processing described later (step S1171 in FIG. 14).

  The server 203 requests the television 202 to present information related to the specifications of the television 202 (step SQ107).

  Receiving the request, the television 202 transmits information regarding its own specification to the server 203 (step SQ108). Here, the specification information transmitted from the television 202 to the server 203 may be the same information as the specification information transmitted from the television 102 to the camera 101 in the first embodiment. That is, the specification information may include a model identifier (for the television 202), an individual identifier, a setting identifier, a display resolution, a supported system format, a supported video codec, a supported audio codec, a supported video format, and the like. The server 203 receives information related to the specifications of the television 202 from the television 202 (step SQ109).

  Next, the server 203 makes a request for causing the television 202 to display a color chart image (“color sample image”) as illustrated in FIG. 13 (step SQ110). For this reason, the image data of the color sample image cc is transmitted to the television 202 (step SQ111). A color chart cc shown in FIG. 13 is an example of a color sample image having a region painted in colors such as red, yellow, green, light blue, blue, and purple. The color sample image is not limited to the color chart cc as shown in FIG.

  Television 202 displays a color sample image (step SQ112).

  When the television 202 displays a color sample image, the user uses the camera 201 to capture the color sample image displayed on the television 202 (step SQ113). At this time, the camera 201 may display guide information for appropriately storing the color sample image in the frame so that the user can appropriately capture the color sample image.

  The camera 201 that has received the shooting operation by the user performs shooting of an image in which the color sample image is included in the frame (step SQ114).

  The photographed color sample image (“color sample photographed image”) is transmitted to the server 203 (step SQ115).

  The server 203 receives the image data of the color sample photograph image sent from the camera 201 (step SQ116).

  Next, the server 203 performs color correction processing on the image data of the image to be displayed on the television 202 (step SQ117).

  The server 203 transmits the color-corrected image data (still image or moving image) to the television 202 (step SQ118).

  The television 202 that has received the color-corrected image data displays an image based on the image data (step SQ119).

  The user browses the image thus displayed on the television 202 (step SQ120).

  Here, the color correction processing performed by the server 203 will be described in detail with reference to FIG.

  FIG. 14 is a flowchart of color correction processing performed by the control unit 33 of the server 203.

  The control unit 33 of the server 203 searches the imaging device model database db2 based on the imaging device identifier acquired in step SQ106, and acquires data indicating the color reproduction characteristics of the display of the camera 201 (step S1171). The color reproduction characteristic is, for example, the gamma characteristic of the display of the camera 201. Note that the imaging device model database db2 held by the server 203 may be a database related to imaging devices having the same data items as the display device model database db1 in the first embodiment. That is, the camera device model database db2 may be any database that can acquire the reproduction characteristics (eg, gamma characteristics) of the display of the camera 201 based on the camera device identifier.

Next, the control unit 33 of the server 203 estimates and acquires the color reproduction characteristics (eg, gamma characteristics) of the television 202 based on the color sample captured image acquired in step SQ116 (step S1172). More specifically, the server 203 estimates a color reproduction characteristic (eg, gamma characteristic) of the television 202 by comparing the color sample image and the color sample captured image. The color sample image is image data built in the server 203. The server 203 compares the pixel value of the predetermined area of the color sample image with the pixel value of the area in the color sample captured image corresponding to the predetermined area, thereby reproducing the reproduction characteristics (gamma characteristics, etc.) of the television 202. Is estimated. The pixel value of the pixel of the color sample image is y (y = (yr, yg, yb), yr: red pixel value, yg: green pixel value, yb: blue pixel value), and the color sample photographed image corresponding to the pixel. The pixel value of the pixel is z (z = (zr, zg, zb), zr: red pixel value, zg: green pixel value, zb: blue pixel value), and G is a mapping representing the gamma characteristic of the television 202. When
z = G (y)
And the inverse map G ⁻¹ of the map G is obtained from the relationship. For example, the pixel value yr of the color sample image is plotted on the vertical axis, the pixel value zr of the pixel of the color sample captured image corresponding to the pixel is plotted on the horizontal axis, an approximate curve of the plotted points is obtained, and this approximate curve is represented by G it can be calculated ^{G -1} by ^-1. Since the color sample photographed image is affected by the light environment around the place where the television 202 is installed, the reproduction characteristics (gamma characteristics, etc.) estimated in step S1172 are reproduction characteristics that take into account the influence of the light environment. Can be acquired.

  The control unit 33 of the server 203 checks the type of image (still image or moving image) to be displayed on the television 202 (step S1173). If the type of image to be displayed is a still image, the process proceeds to step S1174, and if the type of image to be displayed is a moving image, the process proceeds to step S1176.

  In step S1174, the control unit 33 of the server 203 performs resizing conversion on the image data of the image to be displayed. The resizing conversion processing here is processing for optimizing the resolution of the image data for the resolution of the television 202. That is, the control unit 33 optimizes the resolution of the image data to the resolution of the television 202 based on the display resolution information acquired in step SQ109.

  The control unit 33 performs color correction processing on the resized image data (step S1175). The color correction processing here is such that when the image data is displayed on the television 202, the color of the image data is the same as that when displayed on the display of the camera 201. This is a process of correcting the pixel value.

  The color correction process in step S1175 is the same process as the color correction process in step S65 (FIG. 6) in the first embodiment. Specifically, in step S <b> 1175, the control unit 33 displays the gamma characteristic of the display of the camera 201 acquired in step S <b> 1171 for each of the three color (RGB) components of each pixel value of the image data of the image to be displayed on the television 202. Then, a combined mapping of the inverse mapping of the gamma characteristic of the television 202 acquired by estimation in step S1172 is applied, and the output is processed as each color component of each pixel value after correction.

  On the other hand, when the image to be displayed is a moving image, the control unit 33 of the server 203 performs the corresponding system format, the corresponding video codec, the corresponding audio codec, and the corresponding video format acquired in step SQ109 for the moving image data. Based on this information, the format of the image data is converted (including the resizing process), and then the color correction processing similar to that in step S1175 is performed on the format-converted moving image image data. Generate data.

[2-3. Effect]
As described above, when the server 203 as the image processing apparatus according to the present embodiment displays an image on the television 202, the color reproduction characteristics (for example, gamma characteristics) of the display of the camera 201 and the colors of the television 202 are displayed. In consideration of reproduction characteristics (for example, gamma characteristics), color correction processing is performed on image data output to the television 202. Therefore, the image processing apparatus according to the present embodiment can produce an effect that, when one image is displayed on the display of the camera 201 or the television 202, a difference in color is less likely to occur. Further, the server 203 uses the reproduction characteristic (for example, gamma characteristic) data of the display device (television 202) based on the image (color sample photographing image) obtained by photographing the color sample image displayed on the television 202 with the camera 201. Can be obtained by estimation. For this reason, the server 203 does not need to hold the reproduction characteristic data of the display device. Therefore, the server 203 can generate an optimal color correction image corresponding to any display device (television or monitor display).

The camera 101 of the first embodiment is
A first acquisition unit (control unit 13) that acquires a first reproduction characteristic that is a color reproduction characteristic of the first display device (display 12 of the camera 101);
A second acquisition unit (control unit 13) that acquires a second reproduction characteristic that is a color reproduction characteristic of a second display device (television 102) different from the first display device;
A storage unit (storage unit 11) for storing image data;
Based on the first reproduction characteristic and the second reproduction characteristic, a corrected image is obtained by correcting the color of the image so that the display with the first reproduction characteristic is realized in the second display device. A correction unit (control unit 13) for generating the data of
Is an image processing apparatus.

The server 203 of the second embodiment
A first acquisition unit (control unit 33) that acquires a first reproduction characteristic that is a color reproduction characteristic of the first display device (display of the camera 201);
A second acquisition unit (control unit 33) that acquires a second reproduction characteristic that is a color reproduction characteristic of a second display device (television 202) different from the first display device;
A storage unit (storage unit 31) for storing image data;
Based on the first reproduction characteristic and the second reproduction characteristic, a corrected image is obtained by correcting the color of the image so that the display with the first reproduction characteristic is realized in the second display device. A correction unit (control unit 33) for generating the data of
Is an image processing apparatus.

Here, the reproduction characteristic may be a gamma characteristic. In this case, the correcting unit is a composite map (H: H = G ⁻ ) of the map (F) representing the first gamma characteristic and the inverse map (G ⁻¹ ) of the map (G) representing the second gamma characteristic. ^The corrected image data may be generated based on ¹ · F).

The image processing device (server 203) further includes a display instruction unit (control unit 33) that displays a predetermined color sample image on the second display device (television 202),
An image acquisition unit (control unit 33) that acquires an image obtained by capturing the color sample image displayed on the second display device;
The second acquisition unit (control unit 33) may obtain the second gamma characteristic based on the image acquired by the image acquisition unit.

The system of the second embodiment
An image display system (200) having an imaging device (camera 201) and a server (203),
The imaging device (201)
An imaging unit (14) that generates image data by imaging;
A first display device (12) for displaying an image;
A first communication unit (15) for transmitting image data to the server (203),
The server (203)
A second communication unit (35) for receiving image data from the imaging device (201);
A storage unit (31) for storing image data;
A first acquisition unit (33) for acquiring a first reproduction characteristic which is a color reproduction characteristic of the first display device (display of the camera 201);
A second acquisition unit (33) for acquiring a second reproduction characteristic which is a color reproduction characteristic of a second display device (television 202) different from the first display device;
Based on the first reproduction characteristic and the second reproduction characteristic, the color of the image is corrected so that the display with the first reproduction characteristic is realized in the second display device (202). A correction unit (33) for generating corrected image data;
And a third communication unit (15) for transmitting corrected image data to the second display device (202).

(Other embodiments)
As described above, Embodiments 1 and 2 have been described as examples of the technology disclosed in the present application. However, the technology in the present disclosure is not limited to this, and can also be applied to an embodiment in which changes, replacements, additions, omissions, and the like are appropriately performed. Moreover, it is also possible to combine each component demonstrated in the said Embodiment 1 and 2 into a new embodiment.

  Therefore, other embodiments will be exemplified below.

  In the first embodiment, the camera 101 is shown as an example of an image processing apparatus, and in the second embodiment, the server 203 is shown as an example of an image processing apparatus. However, the server may perform the color correction processing described in the first embodiment, and the camera may perform the color correction processing described in the second embodiment. The control unit of the camera 101 or the server 203 may realize the functions described above by executing a predetermined program. Further, the control unit of the camera 101 or the server 203 may be implemented by dedicated hardware (such as a dedicated IC chip).

  Further, the image processing apparatus is not limited to a camera or a server. A personal computer or a smartphone (smart device) may perform the image processing of the above embodiment.

  Further, the data of the color correction image obtained by the color correction processing described with reference to FIG. 6 or FIG. 14 need not be transmitted directly to the display device. The color-corrected image data may be once recorded on a storage medium (such as a blu-ray disc) and provided to a playback device connected to a display device.

  In the first and second embodiments, gamma characteristics are given as an example of color reproduction characteristics. However, the color reproduction characteristic is not limited to the gamma characteristic. The characteristics of color reproduction may include items such as brightness and white balance, but are not limited thereto.

  Further, in the first embodiment, when the display request is continuously made for the same display device, the steps S61 and S62 are omitted for the second and subsequent display requests, and the first display request is made. In addition, color correction processing may be performed based on the television reproduction characteristics acquired in steps S61 and S62. In the second embodiment, the display device whose color reproduction characteristics are estimated once is stored in the storage device of the server in the format shown in FIG. 8, and the next display request is made to the same display device. In such a case, steps SQ110 to SQ116 may be omitted, and instead, the color reproduction characteristics stored in the storage device may be used for the color correction processing in step SQ117.

  As described above, the embodiments have been described as examples of the technology in the present disclosure. For this purpose, the accompanying drawings and detailed description are provided.

  Accordingly, among the components described in the accompanying drawings and the detailed description, not only the components essential for solving the problem, but also the components not essential for solving the problem in order to illustrate the above technique. May also be included. Therefore, it should not be immediately recognized that these non-essential components are essential as those non-essential components are described in the accompanying drawings and detailed description.

  Moreover, since the above-mentioned embodiment is for demonstrating the technique in this indication, a various change, replacement, addition, abbreviation, etc. can be performed in a claim or its equivalent range.

  The present disclosure can be applied to an image processing apparatus. Specifically, the present disclosure is applicable to digital cameras, movie cameras, mobile phones with camera functions, smartphones, personal computers, server devices, and the like. The present disclosure can be applied in combination with the following display device, that is, a display device such as a display such as a personal computer, a projector, or a printer.

11: storage unit 12: display 13: control unit 14: imaging unit 15: communication unit 22: display unit 23: control unit 25: communication unit 31: storage unit 33: control unit 35: communication unit 101: camera 102: television 201 : Camera 202: Television 203: Server

Claims (9)

A first acquisition unit that acquires a first reproduction characteristic that is a color reproduction characteristic of the first display device;
A second acquisition unit that acquires a second reproduction characteristic that is a color reproduction characteristic of a second display device different from the first display device;
A storage unit for storing image data;
Based on the first reproduction characteristic and the second reproduction characteristic, a corrected image is obtained by correcting the color of the image so that the display with the first reproduction characteristic is realized in the second display device. And a correction unit that generates the data. The first reproduction characteristic is a first gamma characteristic that is a gamma characteristic of the first display device;
The image processing apparatus according to claim 1, wherein the second reproduction characteristic is a second gamma characteristic that is a gamma characteristic of the second display device.   The correction unit generates data of the corrected image based on a composite map of a map representing the first gamma characteristic and a reverse map of the map representing the second gamma characteristic. Item 3. The image processing apparatus according to Item 2. A display instruction unit for displaying a predetermined color sample image on the second display device;
An image acquisition unit that acquires an image obtained by capturing the color sample image displayed on the second display device;
The image processing apparatus according to claim 3, wherein the second acquisition unit obtains the second gamma characteristic based on the image acquired by the image acquisition unit. An imaging unit that images a subject and generates image data;
A storage unit for storing data of the image;
A first display device for displaying the image;
A first acquisition unit that acquires a first reproduction characteristic that is a color reproduction characteristic of the first display device;
A second acquisition unit that acquires a second reproduction characteristic that is a color reproduction characteristic of a second display device different from the first display device;
Based on the first reproduction characteristic and the second reproduction characteristic, a corrected image is obtained by correcting the color of the image so that the display with the first reproduction characteristic is realized in the second display device. A correction unit for generating the data of
A communication unit that transmits data of the corrected image. A communication unit for receiving image data;
A storage unit for storing data of the image;
A first acquisition unit that acquires a first reproduction characteristic that is a color reproduction characteristic of the first display device;
A second acquisition unit that acquires a second reproduction characteristic that is a color reproduction characteristic of a second display device different from the first display device;
Based on the first reproduction characteristic and the second reproduction characteristic, a corrected image is obtained by correcting the color of the image so that the display with the first reproduction characteristic is realized in the second display device. And a correction unit that generates the data. An image display system having an imaging device and a server,
The imaging device
An imaging unit that images a subject and generates image data;
A first display device for displaying the image;
A first communication unit that transmits the image data to the server,
The server
A second communication unit that receives data of the image from the imaging device;
A storage unit for storing data of the image;
A first acquisition unit that acquires a first reproduction characteristic that is a color reproduction characteristic of the first display device;
A second acquisition unit that acquires a second reproduction characteristic that is a color reproduction characteristic of a second display device different from the first display device;
Based on the first reproduction characteristic and the second reproduction characteristic, a corrected image is obtained by correcting the color of the image so that the display with the first reproduction characteristic is realized in the second display device. A correction unit for generating the data of
A third communication unit that transmits the corrected image data to the second display device. An image processing method in an image processing apparatus for performing color correction processing on an image held in a storage unit,
Obtaining a first reproduction characteristic which is a color reproduction characteristic of the first display device;
Obtaining a second reproduction characteristic which is a color reproduction characteristic of a second display device different from the first display device;
Based on the first reproduction characteristic and the second reproduction characteristic, the color of the image held in the storage unit is changed so that the display with the first reproduction characteristic is realized in the second display device. Correcting to generate corrected image data, and an image processing method. In the computer of the image processing apparatus that performs color correction processing on the image held in the storage unit,
Obtaining a first reproduction characteristic which is a color reproduction characteristic of the first display device;
Obtaining a second reproduction characteristic which is a color reproduction characteristic of a second display device different from the first image display device;
Based on the first reproduction characteristic and the second reproduction characteristic, the color of the image held in the storage unit is changed so that the display with the first reproduction characteristic is realized in the second display device. And a step of generating corrected image data by performing correction.