JP2014158102A - Imaging device and image processing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To cause an external apparatus to generate image data matching specifications of an imaging device.SOLUTION: An imaging device comprises: an imaging unit that captures a subject to output first captured image data; a display unit that displays an image based on the first captured image data with a predetermined display capability; and a communication unit that transmits the first captured image data and specification data related to specifications of the display unit including the display capability to an external apparatus.

Description

  The present invention relates to an imaging device and an image processing device.

  There is known a system that includes an imaging device and a server and performs image processing on the RAW image data output from the imaging device by the server (Patent Document 1). In the system of Patent Document 1, the imaging device outputs RAW image data, transmits the RAW image data to a server, the server performs image processing on the RAW image data, and the server performs image processing. Image data is transmitted to the imaging device.

JP 2012-95351 A

  In the conventional method, an external device such as a server that has received RAW image data from the imaging apparatus may generate image data that does not conform to the specifications of the imaging apparatus.

An imaging apparatus according to an aspect of the present invention includes an imaging unit that images a subject and outputs first captured image data, and a display unit that displays an image based on the first captured image data with a predetermined display capability. And a communication unit that transmits the first captured image data and the specification data relating to the specification of the display unit including display capability to an external device.
An image processing apparatus according to another aspect of the present invention performs image processing based on an input unit that inputs captured image data obtained by imaging a subject, a specification of an external output device that outputs captured image data, and captured image data. And an image processing unit for performing the above.

  According to the present invention, it is possible to cause an external device to generate image data that conforms to the specifications of the imaging apparatus.

1 is a block diagram of an image processing system. It is a figure used for description of the reduction process of an image. It is an example of the operation | movement sequence diagram of an image processing system. It is an example of the operation | movement sequence diagram of an image processing system.

  FIG. 1 is a block diagram of the image processing system 100. The image processing system 100 includes a server 10, an imaging device 31, and an output device 32. The server 10 is an image processing apparatus according to an embodiment of the present invention, and is installed outside the imaging apparatus 31. The server 10 can communicate with the imaging device 31 and the output device 32.

  The imaging device 31 is an electronic device having an imaging function for imaging a subject, and is, for example, a digital camera or a mobile terminal with a camera. The output device 32 is an electronic device that visually outputs image data such as printing, projection, and display. For example, the output device 32 includes a printer, a projector, a photo frame, a television, a head mounted display, a digital camera with a display, a mobile phone, a smartphone, a PC, and the like. In the following description, the output device 32 is assumed to be a printer, and is described as the printer 32.

  As shown in FIG. 1, the imaging device 31 includes a control unit 50, an imaging unit 51, a first display unit 52 a, a second display unit 52 b, a communication unit 53, a storage unit 54, an operation unit 55, and a GPS module 56. An image processing unit 57 and an image analysis unit 58 are provided. Although not shown in the block diagram of FIG. 1, a storage medium (for example, an SD card) capable of recording RAW image data captured by the imaging unit 51, JPEG (Joint Photographic Experts Group) image data, and thumbnail data is used. The imaging device 31 can be detachably provided.

  The control unit 50 includes a CPU and the like, and controls the entire imaging apparatus 31 by executing a program stored in the storage unit 54. The imaging unit 51 includes an imaging optical system, a diaphragm, a shutter, an imaging device, an A / D conversion circuit, and the like (all not shown), captures a subject image, and outputs RAW image data having a predetermined number of pixels. In the following description, it is assumed that the imaging unit 51 outputs RAW image data of 24 million pixels (6000 × 4000 pixels).

The first display unit 52a and the second display unit 52b are configured using a liquid crystal display or the like. The first display unit 52a and the second display unit 52b can display different screens and can use them simultaneously. Information relating to the specifications of the first display unit 52a and the second display unit 52b, for example, the total number of pixels, display area size, aspect ratio (aspect ratio) information, and the like are stored in the storage unit 54. In the following description, it is assumed that the first display unit 52a has a total number of pixels of 1920 × 1080 pixels, and the second display unit 52b has a total number of pixels of 640 × 480 pixels. Further, as shown in FIGS. 2A and 2B, it is assumed that the display area of the first display section 52a is larger than the display area of the second display section 52b. That is, in this embodiment, it can be said that the display capability of the first display unit 52a is superior to the display capability of the second display unit 52b. The first display unit 52a and the second display unit 52b may be arranged, for example, such that the first display unit 52a may be above the second display unit 52b, or may be arranged below the left or right side. Good.
In the present embodiment, the first display unit 52a and the second display unit 52b are provided, but a configuration in which one of them is omitted may be employed.
In addition, a touch panel that performs an operation on an image displayed on at least one of the first display unit 52a and the second display unit 52b may be provided.

  The communication unit 53 communicates with the server 10, and various wireless communications can be applied. For example, Wi-Fi (registered trademark) may be used. The communication unit 53 may directly connect to the server 10 or may communicate with the server 10 by connecting to the Internet via an access point.

  The storage unit 54 is configured by a memory such as a RAM or a ROM, and stores, for example, a program executed by the control unit 50, information on specifications of each unit of the imaging device 31, and the like. Hereinafter, the information regarding the specifications of each part of the imaging device 31 is referred to as specification data. The specification data includes information on the total number of pixels, display area, and aspect ratio of the first display unit 52a and the second display unit 52b described above.

  The operation unit 55 includes various operation buttons and switches. For example, a release switch, a power switch, a selection switch, and various modes such as a portrait mode, a landscape mode, a night view mode, and a sports mode can be set. Mode switch etc. are included. A GPS (Global Positioning System) module 56 receives radio waves output from GPS satellites, calculates the latitude, longitude, and altitude at which the imaging device 31 is located, and outputs the calculation results to the control unit 50.

  The image processing unit 57 performs various types of processing of the image data captured by the imaging unit 51, and performs image reduction processing for displaying a through image on the first display unit 52a or the second display unit 52b, and thumbnail images. The image processing such as processing for displaying the image is performed. Note that the image processing unit 57 may perform processing for generating a JPEG image having a data amount larger than that of the thumbnail image and smaller than that of the RAW image data. In the present embodiment, a thumbnail image (also referred to as a first reduced image) is displayed on the first display unit 52a, and a through image (also referred to as a second reduced image) is displayed on the second display unit 52b. The image analysis unit 58 performs various image analyzes on image data such as RAW image data output by the imaging unit 51. For example, the image analysis unit 58 performs subject extraction processing for extracting a main subject from a captured image, face recognition processing for recognizing a human face image included in the captured image, scene analysis processing for analyzing a scene such as a night view, and the like. .

  As illustrated in FIG. 1, the server 10 includes a control unit 70, an image processing unit 71, a communication unit 72, and a storage unit 73. The control unit 70 includes a CPU and the like, and performs overall control of the server 10 by executing a program stored in the storage unit 73.

  The image processing unit 71 performs image processing such as image reduction, color interpolation processing, gradation conversion processing, contour enhancement processing, white balance adjustment processing, and blurring processing. The image processing unit 71 has a plurality of modes, and executes these image processes in appropriate combinations for each mode. The mode of the image processing unit 71 includes, for example, standard mode, neutral mode, vivid mode, monochrome mode, portrait mode, landscape mode, watercolor style mode, and the like.

  The image processing unit 71 performs these image processes on the RAW image data to generate developed image data (also referred to as a third reduced image). Further, the image processing unit 71 generates a fourth reduced image obtained by reducing the developed image data to the thumbnail size. The developed image data includes, for example, image data such as Exif format, date and time when the subject is imaged, shutter speed, aperture value, photographing sensitivity, white balance, presence / absence of strobe, GPS information, and other accompanying data (metadata). Can be accompanied.

  The communication unit 72 communicates with the imaging device 31 and the printer 32 (for example, wireless communication or wired communication). The storage unit 73 stores a program executed by the control unit 70 and an image database 731. The image database 731 stores RAW image data and developed image data after image processing by the image processing unit 71.

  As shown in FIG. 1, the printer 32 includes a control unit 90, a printing unit 91, a communication unit 92, a storage unit 93, a display unit 94, and an operation unit 95. The control unit 90 includes a CPU and the like, and controls the entire printer 32 by executing a program stored in the storage unit 93.

  The printing unit 91 prints an image corresponding to the image data on a medium such as paper. The communication unit 92 communicates with the server 10 (for example, wireless communication or wired communication). The storage unit 93 includes a memory such as a RAM and a ROM, and stores a program executed by the control unit 90, image data printed by the printing unit 91, and information related to the specifications of the printing unit 91. The specifications of the printing unit 91 are information such as the resolution of the printing unit 91 and the control method of the printer, for example. Hereinafter, the information related to the specification of the printing unit 91 is referred to as output side specification data.

  The display unit 94 displays a menu screen of the printer 32 and the like. The operation unit 95 has various operation buttons and switches, and includes, for example, a power switch, a print start switch, a selection switch, and the like.

  The image reduction processing executed by the image processing unit 57 of the imaging device 31 will be described with reference to FIGS. 2 (a) and 2 (b). In the image reduction process, the image processing unit 57 of the imaging device 31 converts the RAW image data output from the imaging unit 51 into image data that is suitable for a display device such as the first display unit 52a or the second display unit 52b. to shrink.

  FIG. 2A is a diagram illustrating a state in which the reduced image 200 is displayed on the first display unit 52a. The reduced image 200 is an image obtained by the image processing unit 57 reducing the RAW image data output from the imaging unit 51 so as to be compatible with the first display unit 52a. Specifically, the reduced image 200 is a diagram in which the image processing unit 57 reduces the length and width of the 6000 × 4000 pixel RAW image data output from the imaging unit 51 to 0.27 times. Here, 0.27 times is the ratio of the number of pixels in the vertical direction (4000 pixels) of the RAW image data to the number of pixels in the vertical direction of the first display unit 52a (1080 pixels). When the image processing unit 57 multiplies the number of horizontal pixels (6000 pixels) of the RAW image data by 0.27, the number of horizontal pixels of the reduced image 200 is the number of horizontal pixels (1920 pixels) of the first display unit 52a. ), An image area 201 in which no image is displayed is arranged on the left and right sides of the reduced image 200.

  FIG. 2B is a diagram showing a state in which the reduced image 210 is displayed on the second display unit 52b. The reduced image 210 is an image obtained by reducing the RAW image data output from the imaging unit 51 by the image processing unit 57 so as to be compatible with the second display unit 52b. Specifically, the reduced image 210 is a diagram in which the image processing unit 57 reduces the vertical and horizontal dimensions of the 6000 × 4000 pixel RAW image data output from the imaging unit 51 to 0.107 times. Here, 0.107 times is the ratio of the number of pixels in the horizontal direction of the RAW image data (6000 pixels) to the number of pixels in the horizontal direction of the second display section 52b (640 pixels). When the image processing unit 57 multiplies the vertical pixel count (4000 pixels) of the RAW image data by 0.107, the vertical pixel count of the reduced image 200 is the vertical pixel count (1080 pixels) of the second display unit 52b. ), An image area 211 in which no image is displayed is arranged above and below the reduced image 200.

  Whether the vertical direction or the horizontal direction of the RAW image data is adapted to the display device is determined by the aspect ratio (aspect ratio) of the display device. When displaying on a display device that is longer than the RAW image data as in the first display unit 52a, the vertical direction of the RAW image data is adapted to the display device, and longer than the RAW image data as in the second display unit 52b. When displaying on the display device, the horizontal direction of the RAW image data is adapted to the display device.

  The image processing unit 71 of the server 10 also acquires specification data including the total number of pixels of the first display unit 52a and the second display unit 52b of the imaging device 31 from the imaging device 31, and then the image processing unit of the imaging device 31. The reduction process similar to 57 can be executed.

  FIG. 3 is an operation sequence diagram of the image processing system 100 executed by the imaging device 31 and the server 10. In the operation sequence diagram of FIG. 3, the sequence after the RAW image data is generated from the imaging unit 51 of the imaging device 31 is illustrated. Each operation of the imaging device 31 is executed under the control of the control unit 50 of the imaging device 31. Each operation of the server 10 is executed under the control of the control unit 70 of the server 10.

In step S <b> 200, the imaging device 31 transmits the generated RAW image data to the server 10. The server 10 receives the RAW image data and stores the RAW image data in the image database 731. Note that the control unit 50 of the imaging device 31 may delete the RAW image data stored in a storage medium (not shown) after transmitting the RAW image data to the server 10. In any case, by transmitting the RAW image data to the server 10, it becomes possible to perform output based on the RAW image data to various output devices via the server 10.
In step S <b> 201, the imaging device 31 inputs RAW image data to the image analysis unit 58 and performs image analysis, thereby acquiring information on the extraction result of the main subject, the recognition result of the face image, and the like.

In step S <b> 202, the imaging device 31 transmits to the server 10 information related to imaging conditions when RAW image data is generated, information related to the result of image analysis acquired in step S <b> 201, and specification data. Shooting conditions include, for example, shutter speed, aperture value, shooting sensitivity, white balance, presence / absence of strobe, GPS information, face recognition information, shooting mode, and the like, which are information registered as accompanying data of Exif format image data. is there.
Moreover, when it has a some display part like this embodiment, each specification of a some display part is contained in the specification data. Note that the imaging device 31 is determined to display an image generated by the server 10 on one display unit (for example, the second display unit 52b), or the display unit (first display unit 52a) with good display performance. When matching, the specification of any one display unit may be sent to the server 10. Note that the transmission of the specification data and the imaging conditions by the control unit 50 may be performed at the timing of step S200.

In step S203, the imaging device 31 inputs the RAW image data to the image processing unit 57, and generates a first reduced image that is a thumbnail image obtained by reducing the image data so as to fit the first display unit 52a.
In step S204, the imaging device 31 displays a first reduced image on the first display unit 52a, and displays a mode setting screen for setting the mode of the image processing unit 71 of the server 10 on the second display unit 52b. .

  The mode setting screen displays a list of modes of the image processing unit 71 of the server 10 such as an automatic mode, a standard mode, a neutral mode, a vivid mode, a monochrome mode, a portrait mode, a landscape mode, and a watercolor style mode. The user selects at least one of these modes displayed on the second display unit 52b while viewing the first reduced image displayed on the first display unit 52a. The automatic mode is a mode in which the control unit of the imaging device 31 or the server 10 selects an optimum mode from standard mode, neutral mode, vivid mode, monochrome mode, portrait mode, landscape mode, watercolor style mode, and the like. It is.

  In step S <b> 205, the imaging device 31 transmits information regarding the mode selected by the user to the server 10. Hereinafter, the information transmitted to the server 10 in step S205 is referred to as request information. The server 10 receives the request information.

  In step S206, the server 10 applies the image processing specified by the request information received in step S205 to the RAW image data received in step S200, and generates developed image data (third reduced image). . For example, when the watercolor style mode is selected as the request information, the server 10 applies the image processing in the watercolor style mode to the RAW image data and generates developed image data in the watercolor style. When the user has selected a plurality of modes, the developed image data is generated for each selected mode. The developed image data is generated as image data in Exif format, and the information regarding the shooting conditions received in step S202 is attached as accompanying data. The generated developed image data is stored in the image database 731 together with information on the mode.

  In step S207, the server 10 generates fourth reduced image data that is a thumbnail image of each developed image data based on the specification data received in step S202. In the present embodiment, if the fourth reduced image data is displayed on the first display unit 52a of the imaging device 31, the server 10 adapts each developed image data to the display performance of the first display unit 52a. The fourth reduced image data is generated. When the fourth reduced image data is displayed on the first display unit 52a and the second display unit 52b of the imaging device 31, the server 10 displays the display performance of each of the first display unit 52a and the second display unit 52b. Two types of fourth reduced images may be generated in accordance with the display, and the fourth reduced image may be generated according to the display performance of the first display unit 52a having excellent display performance.

In step S <b> 208, the server 10 transmits the developed image data and the fourth reduced image data to the imaging device 31. The imaging device 31 receives the developed image data and the fourth reduced image data, and stores them in a storage medium (not shown).
In step S209, the imaging device 31 displays, for example, a plurality of fourth reduced images on the second display unit 52b based on the fourth reduced image data received in step S208. The imaging device 31 displays the third reduced image on the first display unit 52a based on the developed image data corresponding to the fourth reduced image selected by touching the touch panel.

  If the user who has confirmed the third reduced image fails to obtain the image that the user has expected, the mode selection screen is displayed again on the second display unit 52b by performing a predetermined operation on the imaging device 31. Display. The user selects a mode again on the mode selection screen. Further, since the control unit 50 of the imaging device 31 stores the fourth reduced image data, which is the thumbnail image data generated by the server 10, in a storage medium (not shown), the thumbnail image data generated by the image processing unit 57 is used. Certain first reduced image data may be deleted.

  FIG. 4 is an operation sequence diagram of the image processing system 100 executed by the printer 32 and the server 10. In the operation sequence diagram of FIG. 4, a sequence after the printer 32 and the server 10 start communication is illustrated. Each operation of the printer 32 is executed under the control of the control unit 90 of the printer 32. Each operation of the server 10 is executed under the control of the control unit 70 of the server 10.

  In step S <b> 300, the printer 32 transmits, to the server 10, a command for requesting information transfer for the image data stored in the image database 731 of the storage unit 73 of the server 10. The server 10 receives the command.

  In step S301, the server 10 transmits information related to the image data stored in the image database 731 according to the command received in step S300. The server 10, for example, file names of RAW image data and developed image data stored in the image database 731, date / time information about the RAW image data, and information about the image processing mode used when generating the developed image data. Is transmitted to the printer 32.

  In step S302, the server 10 displays a list of information relating to the image data on the display unit 94 of the printer 32 based on the information relating to the image data stored in the image database 731 received in step S301. For example, file names of RAW image data and developed image data stored in the image database 731, date and time information about the RAW image data, and information about the mode used when generating the developed image data are displayed on the display unit 94. Listed.

  The operator of the printer 32 uses the operation unit 95 to select image data to be printed from the image data displayed as a list on the display unit 94. In step S <b> 303, the printer 32 transmits information regarding the selected image data and output side specification data regarding the specifications of the printing unit 91 to the server 10. The server 10 receives information related to the image data selected by the operator and output side specification data related to the specifications of the printing unit 91.

  In step S304, the server 10 converts the image data selected by the operator into a size and data format that can be printed by the printing unit 91 based on the output side specification data of the printing unit 91, and generates an output image. To do.

In step S305, the server 10 transmits the output image data generated in step S304 to the printer 32. The printer 32 receives the output image data.
In step S306, the printer 32 prints an image by the printing unit 91 based on the output image data received in step S305.

According to the embodiment described above, the following operational effects can be obtained.
Since the imaging device 31 transmits not only RAW image data but also specification data, the server 10 can generate image data that conforms to the specifications of the display unit 94 of the imaging device 31.

The embodiment described above can be implemented with the following modifications.
(Modification 1)
Data transmitted from the imaging device 31 to the server 10 may be JPEG data instead of RAW image data. In this case, the server 10 may generate the developed image data after converting the JPEG data into, for example, the luminance signal Y and YCbCr that expresses the color space using the two color difference signals. In this way, by making the image data transmitted from the imaging device 31 JPEG data, the amount of data to be transmitted is reduced compared to the RAW image data, so that the transmission time can be shortened and the transmission processing of the imaging device 31 is reduced. can do.
(Modification 2)
The first display unit 52a may be provided separately from the imaging device 31. For example, the first display unit 52a is a display unit of a mobile phone, a smartphone, a tablet terminal, a personal computer, a television, or the like. The through image may be visually recognized by the first display unit 52a that is separated by wireless communication or the like, or the image data (still image or moving image) generated by the server 10 may be visually recognized.
(Modification 3)
In step S202 of FIG. 3, the imaging device 31 includes information on the imaging conditions when the RAW image data is generated, information on the result of the image analysis acquired in step S201, the total number of pixels of the second display unit 52b, and the like. The specification data is sent to the server 10. However, the information that the imaging device 31 transmits to the server 10 in step S202 is not limited to these. For example, information related to the imaging environment such as the temperature around the imaging device 31, the sound around the imaging device 31, and the light source that illuminates the subject may be further transmitted to the server 10. In this case, the server 10 may create a warm image if the ambient temperature is high, or may create an image that seems to be cold if the ambient temperature is low. In addition, when the server determines that the party venue has many people from the sound, the server may create a flashy image with emphasized colors.

(Modification 4)
The imaging device 31 may have a continuous shooting function. When continuous shooting is performed using the imaging device 31, the sequence of FIG. 3 may be started after the continuous shooting is completed. When a plurality of raw image data are obtained by continuous shooting, all the raw image data and JPEG image data may be transmitted to the server 10 in step S200. For example, based on the result of the face recognition process. The selected image may be transmitted to the server 10.

(Modification 5)
The present embodiment can also be applied to an imaging apparatus that does not include a nonvolatile recording medium that records RAW image data and developed image data.

  The embodiments and modifications described above are merely examples, and the present invention is not limited to these contents as long as the features of the invention are not impaired. Further, the embodiments and modifications described above may be combined and executed as long as the features of the invention are not impaired.

10 server 31 imaging device 32 output device 51 imaging unit 52a first display unit 52b second display unit 53 communication unit 70 control unit 71 image processing unit 72 communication unit 73 storage unit 100 image processing system

Claims (9)

An imaging unit that images a subject and outputs first captured image data;
A display unit for displaying an image based on the first captured image data with a predetermined display capability;
A communication unit that transmits the first captured image data and specification data relating to the specification of the display unit including the display capability, to an external device;
An imaging apparatus comprising: The imaging device according to claim 1,
The said communication part transmits the accompanying data accompanying the said 1st captured image data to the said external apparatus, The imaging device characterized by the above-mentioned. The imaging device according to claim 1 or 2,
The image capturing apparatus, wherein the communication unit transmits request information regarding image processing to the external device. In the imaging device according to any one of claims 1 to 3,
An imaging apparatus comprising: a deletion unit that deletes the first captured image data after the communication unit transmits the first captured image data. In the imaging device according to any one of claims 1 to 4,
When the display unit has a plurality of display screens,
The said communication part transmits the specification of the display screen with the said high display capability among these display screens to the said external device, The imaging device characterized by the above-mentioned. An input unit for inputting captured image data obtained by imaging a subject;
An image processing unit that performs image processing based on specifications of an external output device that outputs the captured image data and the captured image data;
An image processing apparatus comprising: The image processing apparatus according to claim 6.
An image processing apparatus comprising: a transmission unit that transmits the captured image data image-processed by the image processing unit to the external output device. The image processing apparatus according to claim 6 or 7,
The image processing apparatus, wherein the input unit inputs request information related to image processing performed by the image processing unit. The image processing apparatus according to claim 8.
The external output device includes at least an imaging device including an imaging unit that images the subject and generates the captured image data, and a display unit,
The input unit acquires the captured image data, the specification data including at least the total number of pixels of the display unit, and the request information from the imaging device,
The image processing unit performs image processing according to the request information and the specification data on the captured image data,
The transmission unit transmits the captured image data after performing image processing according to the request information and the specification data to the imaging device.

Images