JP4868749B2 - Display control apparatus and display control method - Google Patents

Display control apparatus and display control method Download PDF

Info

Publication number
JP4868749B2
JP4868749B2 JP2005062858A JP2005062858A JP4868749B2 JP 4868749 B2 JP4868749 B2 JP 4868749B2 JP 2005062858 A JP2005062858 A JP 2005062858A JP 2005062858 A JP2005062858 A JP 2005062858A JP 4868749 B2 JP4868749 B2 JP 4868749B2
Authority
JP
Japan
Prior art keywords
image data
color
unit
color space
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2005062858A
Other languages
Japanese (ja)
Other versions
JP2005292814A (en
Inventor
晃 上野
義信 田中
哲也 豊田
Original Assignee
オリンパス株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to JP2004066034 priority Critical
Priority to JP2004066034 priority
Application filed by オリンパス株式会社 filed Critical オリンパス株式会社
Priority to JP2005062858A priority patent/JP4868749B2/en
Publication of JP2005292814A publication Critical patent/JP2005292814A/en
Application granted granted Critical
Publication of JP4868749B2 publication Critical patent/JP4868749B2/en
Application status is Active legal-status Critical
Anticipated expiration legal-status Critical

Links

Images

Description

  The present invention relates to a display control device and a display control method.

  It is known that a plurality of types of definitions currently exist in the RGB color space that expresses colors. For example, in a digital camera, Exif (Exchangeable image format for digital still cameras) is defined as a standard of a recording image file format. Here, an RGB color space called sRGB is adopted as a standard color space of an image. ing.

  On the other hand, mainly in the field of commercial printing, a color space called Adobe (registered trademark) RGB having a color space wider than sRGB is used as a substantial standard color space, and other color spaces are also used. The current situation is proactively proposed according to the application. In light of this situation, there is an increasing demand for digital cameras to handle color spaces other than sRGB depending on the application.

  However, when images based on RGB color spaces with different definitions are displayed on the same display device, the display colors are different because the definitions of RGB are different. For example, since a display device of a digital camera normally assumes that image data is sRGB, when the same color expressed in AdobeRGB is displayed as it is, as shown in FIG. 7 (point X), it is compared with sRGB. At first glance, it appears as a low-saturation color.

Therefore, when displaying image data expressed in different color spaces on the same display device, or when displaying them on different display devices even in the same color space, the image is displayed so as to have an appropriate display color. In general, data is displayed after being subjected to some color conversion. As such a method, various methods have been proposed as so-called color matching. For example, Japanese Patent Application Laid-Open No. 9-270927 is characterized by eliminating a hue shift between a color on a color monitor and a color on a color printer.
Japanese Patent Laid-Open No. 9-270927

  However, if a separate color conversion unit for color-converting image data is provided, there is a problem that the circuit scale and processing time increase.

  The present invention has been made paying attention to such a problem, and the object of the present invention is a simple configuration even when handling image data expressed by a plurality of different color spaces. An object of the present invention is to provide a display control device and a display control method capable of realizing appropriate color expression for each image.

  In order to achieve the above object, a first aspect of the present invention is a display control apparatus for displaying image data represented by a plurality of different color spaces, the color relating to the image data to be displayed. Based on the determination unit that determines spatial information, the gain switching unit that switches the gain of the image data to be displayed according to the determination result, and the gain switched by the gain switching unit, the image data And an amplification unit that amplifies an image signal related to at least the color difference generated based on the image signal.

  According to a second aspect of the present invention, there is provided a display control apparatus for displaying image data represented by a plurality of different color spaces, wherein the determination is made to determine information on the color space related to the image data to be displayed. A palette selecting unit that selects a desired color palette from a plurality of color palettes related to the display pattern according to the determination result, and a color palette related to the display pattern selected by the palette selecting unit. Based on the gain switched by the combining unit that generates the display image data by combining with the image data, the gain switching unit that switches the gain of the display image data according to the determination result, and the gain switching unit. And an amplifying unit for amplifying an image signal related to at least the color difference generated based on the display image data.

  According to a third aspect of the present invention, in the first or second aspect, the determination unit determines the type of color space based on information recorded in a header of an image file.

  According to a fourth aspect of the present invention, in the first or second aspect, the determination unit determines the type of color space based on an image file name to be displayed.

  According to a fifth aspect of the present invention, in the first or second aspect, the determination unit determines the type of color space based on file management information having association information of an image file to be displayed.

  According to a sixth aspect of the present invention, in the first or second aspect, the sixth aspect further includes an operation unit configured to set a color space, and the determination unit is provided in the color space set via the operation unit. A determination is made based on such information.

  According to a seventh aspect of the present invention, in the first or second aspect, information on the plurality of color spaces can be displayed on a display unit.

  According to an eighth aspect of the present invention, in any one of the first to fourth aspects, the gain in the gain switching unit is set as a fixed value in advance.

  According to a ninth aspect of the present invention, in the first or second aspect, the image data to be displayed is generated based on imaging data obtained by an imaging means.

  According to a tenth aspect of the present invention, in the first or second aspect, the image processing apparatus further includes an operation unit that instructs imaging of a subject, and the image data to be displayed is executed by an instruction from the operation unit. This is image data based on imaging data to be recorded, obtained by imaging.

  The eleventh aspect of the present invention, in the first or second aspect, further comprises reading means for reading image data to be reproduced from the recording medium, and based on the image data read by the reading means. The image data to be displayed is generated.

  According to a twelfth aspect of the present invention, in the second aspect, when the plurality of color palettes are combined with the display image data by the combining unit and then amplified by the amplifying unit. The display pattern is set to be displayed with saturation.

  The thirteenth aspect of the present invention corresponds to the second aspect, wherein the gain set by the gain switching unit corresponds to AdobeRGB in which the gain corresponding to sRGB and the gain corresponding to the gain corresponding to sRGB are larger. Including the gain.

  According to a fourteenth aspect of the present invention, there is provided a display control apparatus for displaying image data represented by a plurality of different color spaces, for determining color space information relating to image data to be displayed. Based on the image data based on the gain switching means for switching the gain of the image data to be displayed and the gain switched by the gain switching means according to the determination result And amplifying means for amplifying at least the image signal related to the color difference.

  According to a fifteenth aspect of the present invention, there is provided a display control apparatus for displaying image data represented by a plurality of different color spaces, in order to determine color space information relating to image data to be displayed. Determining means, a palette selecting means for selecting a desired color palette from a plurality of color palettes related to the display pattern according to the determination result, and a display pattern selected by the palette selecting means Synthesizing means for synthesizing the color palette to be generated with the image data to generate display image data, gain switching means for switching the gain of the display image data according to the determination result, and the gain switching Based on the gain switched by the means, an image signal related to at least the color difference generated based on the display image data is obtained. Comprising amplifying means for the width, the.

  According to a sixteenth aspect of the present invention, there is provided a display control method for displaying image data represented by a plurality of different color spaces, in which color space the image data is represented. And switching the gain when displaying the image data according to the determination result of the image data, and amplifying the image data using the gain switched according to the determination result of the image data. Are provided.

  According to a seventeenth aspect of the present invention, there is provided a display control method for displaying image data represented by a plurality of different color spaces, wherein the color space represents the image data. Selecting a color palette related to the display pattern from a plurality of color palettes based on the determination result of the image data; and the selected color palette related to the display pattern and the image data , Switching the gain when displaying the image data according to the determination result of the image data, and using the gain switched according to the determination result of the image data Amplifying the data.

According to an eighteenth aspect of the present invention, there is provided a display control method for displaying image data represented by a plurality of different color spaces, in which color space the image data is represented. Selecting image processing parameters related to color space processing when performing image processing based on the determination result of the image data, and image processing of the image data based on the selected image processing parameters And, based on the determination result of the image data, selecting a color palette related to the display pattern from a plurality of color palettes;
Switching the gain when displaying the image data according to the determination result of the image data, amplifying the image data using the gain switched according to the determination result of the image data, Displaying the amplified image data using the switched gain.

  According to the present invention, even when image data expressed by a plurality of different color spaces is handled, appropriate color expression can be realized for each image with a simple configuration.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is an overall block diagram of a digital camera to which the display control apparatus of the present invention is applied. An optical system 10 for capturing a subject image, an image sensor 11 comprising a CCD for converting the captured subject image into image data, which is an electrical signal, an image capturing circuit 12 for controlling the image capturing operation, and the captured image data An image processing circuit 13 for performing image processing such as color correction and gamma correction, a RAM 19 for temporarily storing captured image data, a ROM 20 for storing gain data described later, and a color palette described later. An interface (I / F) 21 that bridges between a ROM 18 for storing data and OSD (On Screen Display) data, and a removable recording medium 22 such as a memory card for recording captured image data A display processing circuit 14 that performs a predetermined display process on the image data, and displays the image data that has been subjected to the display process and information about the color space. A display device 15 and a release SW for instructing start and end of imaging are provided, and an operation unit 16 that can set, for example, an image file name to be displayed as information relating to the color space, and controls the above-described units. It is comprised from CPU17.

  FIG. 2 is a diagram showing a schematic configuration of the main block described in FIG. The RAM 19 stores an image file header 19-1 and image data 19-2. The ROM 20 stores an sRGB gain 20-1 and an AdobeRGB gain 20-2. These are preset as fixed values. Further, the ROM 18 includes a color palette 1 (18-1) and a color palette 2 (18-2) having different saturations as a plurality of color palettes related to the display pattern, and conditions for shooting and reproduction, for example. Stored is predetermined OSD data 18-3 representing text data of a menu display for selecting the menu item.

  The CPU 17 includes a setting determination unit 17-1 that determines the setting status of the operation unit 16, a color space determination unit 17-2 that determines a color space setting from the determined setting status and outputs color space information, and a color space. And a gain switching unit 17-3 for switching the gain of image data (imaging and reproduction) to be displayed based on the information. Here, the color space discriminating unit 17-2 uses the color space based on the information recorded in the header of the image file, the image file name to be displayed, or the file management information having the association information of the image file to be displayed. Determine the type.

  The display processing circuit 14 selects one of the color palette 1 (18-1) and the color palette 2 (18-2) based on the color space information from the color space determination unit 17-2. -1, color palette data indicating which color palette has been selected, OSD data 18-3, and image data 19-2 read from the RAM 19 as image data to be displayed are combined (MIX) 14-2 and an image signal amplifying unit 14-3 that amplifies an image signal related to at least the color difference of the output of the synthesizing unit 14-2 with an amplification factor according to the gain data from the gain switching unit 17-3. Prepare.

  3A shows a configuration example of the MIX unit 14-2 in FIG. 2, and FIG. 3B shows a configuration example of the image signal amplification unit 14-3.

  As shown in FIG. 3A, the OSD data input to the MIX unit 14-2 is displayed on the OSD data for display based on the color palette data input from the palette selecting unit 14-1 by the color palette 142-1. Is converted to The converted OSD data is input to the video signal generation unit 142-2 together with the image data, and is converted into a display signal including a luminance signal and a color difference signal.

  Further, the display signal input to the image signal amplification unit 14-3 is separated into the luminance signal Y and the color difference signal C in the separation unit 143-1 as shown in FIG. The color difference signal C is amplified based on the gain data input from the gain switching unit 17-3. Then, the amplified color difference signal C is combined again with the luminance signal Y in the combining unit 143-3 and output to the display device 15.

  4 and 5 are flowcharts for explaining the operation of the digital camera at the time of shooting. First, imaging control is performed for LiveView, which is a moving image to be displayed before shooting (step S1). Next, sRGB image processing parameters are set (step S2). However, it is fixed so that a predetermined parameter is set when LiveView is displayed. Next, image processing is performed by the image processing circuit 13 (step S3), and LiveView is displayed on the display device 15 (step S4). Next, it is determined whether or not the release SW of the operation unit 16 is ON (step S5). If NO, the process returns to step S1 and waits for the release SW to be turned ON. When the release SW is turned on, the determination in step S5 is YES, and control for capturing a still image is performed (step S6). Next, processing such as white balance (WB) is performed on the captured still image data in the image processing circuit 13 (step S7). Next, the setting discriminating unit 17-1 discriminates the setting status of the operation unit 16 (step S8), and the color space discriminating unit 17-2 discriminates the color space setting from the discriminated setting status and outputs the color space information. (Step S9).

  Next, the gain switching unit 17-3 determines whether the color space information is sRGB or AdobeRGB (step S10). If it is determined that the color space information is sRGB, sRGB image processing parameters are set ( Step S11-1). On the other hand, when it is determined in step S10 that the color space information is AdobeRGB, the image processing parameters for AdobeRGB are set (step S11-2). In steps S11-1 and S11-2, for example, a color conversion matrix and a gamma table corresponding to the color space are set in the image processing circuit 13. Next, image processing is performed on the still image data captured by the image processing circuit 13 (step S12), and the image processed image data is temporarily stored in the RAM 19 (step S13).

  Next, the display processing circuit 14 reads the image data 19-2 from the RAM 19, resizes it for display, and creates image data to be displayed (step S14). Next, the display processing circuit 14 reads the OSD data 18-3 from the ROM 18 and sets the OSD data 18-3 in the MIX 14-2 (step S15). Next, it is determined whether the color space information from the color space determination unit 17-2 is sRGB or AdobeRGB (step S16). If the color space information is sRGB, the palette selection unit 14-1 performs color selection. The palette 1 (18-1) is selected (step S17-1), and then the sRGB gain 20-1 is set in the gain switching unit 17-3 (step S18-1). If the color space information is AdobeRGB in step S16, color palette 2 (18-2) is selected in palette selecting unit 14-1 (step S17-2), and Adobe RGB is subsequently selected in gain switching unit 17-3. The gain for use 20-2 is set (step S18-2).

  The data capacity of the color pallet is very small compared to OSD data. Therefore, instead of storing a plurality of OSD data sets, a plurality of color palettes are stored, and the memory capacity can be reduced by controlling display colors by switching between palettes.

  Since AdobeRGB has a wider color space than sRGB, differences in R, G, and B for subjects of the same color are reduced. Therefore, when color conversion processing corresponding to the color space is not performed, Adobe RGB is displayed with lower saturation than sRGB. Therefore, here, by setting the AdobeRGB gain larger than the sRGB gain, it is possible to make the saturation of the display colors substantially the same in any color space image.

Next, RecView is displayed as a confirmation display of the captured image (step S19). Next, image file data is created by linking image data and header information (step S20). Next, the created image file data is recorded on the recording medium 22 (step S21).

FIG. 6 is a flowchart for explaining the operation of the digital camera during image reproduction. First, the image file data is read from the recording medium 22 and developed in the RAM 19 (step S30). Next, the image file data is resized for display and image data to be displayed is created (step S31). Next, OSD data is read from the ROM 18 and set (step S32). Next, the color space discriminating unit 17-2 discriminates the color space from the header of the image file data developed in the RAM 19, and outputs the color space information (step S33). Next, it is determined whether the color space information is sRGB or AdobeRGB (step S34). If it is sRGB, the palette selection unit 14-1 selects color palette 1 (35-1) (step S34). S35-1) Subsequently, the gain switching unit 17-3 sets the sRGB gain 20-1 (step S36-1). Also,
If the color space information is AdobeRGB in step S34, color palette 2 (18-2) is selected in palette selecting section 14-1 (step S35-2), and then gain for AdobeRGB is selected in gain switching section 17-3. 20-2 is set (step S36-2). Next, the reproduced image is displayed (step S37).

  In the present invention, the color difference of the image signal for display is amplified without color conversion of the image data itself, so that the image is displayed without the need for a special color conversion circuit, but the saturation of the image is made substantially equal. It becomes possible.

  According to the above-described embodiment, even when image data expressed by a plurality of different color spaces is handled, appropriate color expression can be realized for each image with a simple configuration.

1 is an overall block diagram of a digital camera to which a display control device of the present invention is applied. It is a figure which shows schematic structure of the main block demonstrated in FIG. (A) is a block diagram showing a configuration of a synthesis unit, and (B) is a block diagram showing a configuration of an image signal amplification unit. It is the front part of the flowchart for demonstrating operation | movement of the digital camera at the time of imaging | photography. It is a rear part of the flowchart for demonstrating operation | movement of the digital camera at the time of imaging | photography. It is a flowchart for demonstrating operation | movement of the digital camera at the time of image reproduction. It is a figure for demonstrating the problem of a prior art.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Optical system, 11 ... Imaging device, 12 ... Imaging circuit, 13 ... Image processing circuit, 14 ... Display processing circuit, 14-1 ... Palette selection part, 14-2 ... MIX (composition part), 14-3 ... Image Signal amplification unit, 15 ... display device, 16 ... operation unit, 17 ... CPU, 17-1 ... setting discrimination unit, 17-2 ... color space discrimination unit, 17-3 ... gain switching unit, 18 ... ROM, 18-1 Color palette 1, 18-2 Color palette 2, 18-3 OSD data, 19 RAM, 19-1 Image file header, 19-2 Image data, 20-1 Gain for sRGB, 20-2 ... AdobeRGB gain, 21 ... I / F, 22 ... recording medium.

Claims (12)

  1. A display control device for storing gain information corresponding to a plurality of color spaces and displaying image data represented by the plurality of different color spaces,
    A display pattern composed of OSD data, and a storage unit for storing a plurality of color palettes related to the display pattern;
    A discriminator for discriminating the type of the color space related to the image data based on the information related to the color space of the image data to be displayed ;
    A palette selecting unit that selects a color palette corresponding to a color space from a plurality of color palettes related to the display pattern based on the type of the color space determined by the determining unit ;
    An OSD data generation unit that generates OSD data obtained by converting the display pattern with the color palette selected by the palette selection unit;
    A synthesizing unit which generates a synthesized to display image data and the generated OSD data and the image data in the OSD data generator,
    A gain switching unit that switches a gain for amplifying the display image data combined by the combining unit according to the type of the color space determined by the determining unit ;
    Based on the gain switched by the gain switching unit, an amplification unit that amplifies an image signal related to at least the color difference generated based on the display image data;
    Display control device characterized by having a.
  2. The amplification unit further includes a separation unit that separates the display image data into a signal related to luminance and a signal related to color difference, and amplifies only the signal related to color difference separated by the separation unit based on the switched gain. Item 4. The display control device according to Item 1.
  3. The display control apparatus according to claim 1, wherein the OSD data includes text data for menu display of shooting and playback conditions.
  4. The gain that is switched by the gain switching unit is a gain that corresponds to a color space that represents a wide color space of the two color spaces, and is larger than a gain that corresponds to a narrow color space. The display control apparatus according to any one of the above.
  5.  The display control apparatus according to claim 1, wherein the determination unit determines the type of color space based on information recorded in a header of an image file.
  6.  The display control apparatus according to claim 1, wherein the determination unit determines the type of color space based on an image file name to be displayed.
  7.  The display control apparatus according to claim 1, wherein the determination unit determines the type of color space based on file management information including association information of an image file to be displayed.
  8. It further has an operation unit for setting a color space,
    The display control apparatus according to claim 1, wherein the determination unit performs determination based on information relating to a color space set via the operation unit.
  9. The display control apparatus according to claim 1, wherein the image data to be displayed is generated based on imaging data obtained by an imaging unit.
  10. An operation unit for instructing imaging of a subject;
    The image data to be displayed is image data based on imaging data to be recorded, obtained by imaging executed by an instruction from the operation unit. Display control device.
  11.  11. The image processing apparatus according to claim 1, further comprising a reading unit that reads image data to be reproduced from a recording medium, and generating the image data to be displayed based on the image data read by the reading unit. The display control device according to one.
  12. A display control method for storing gain information corresponding to a plurality of color spaces and displaying image data represented by the plurality of different color spaces,
    Storing a display pattern composed of OSD data and a plurality of color palettes related to the display pattern;
    Determining the type of the color space related to the image data based on the information related to the color space of the image data to be displayed ;
    Selecting a color palette corresponding to the color space from a plurality of color palettes related to the display pattern based on the determined color space type ;
    Generating OSD data obtained by converting the display pattern with the selected color palette;
    And generating a display image data by combining the OSD data and the image data the generated,
    Switching a gain for amplifying the combined display image data according to the type of the determined color space ;
    Amplifying an image signal related to at least a color difference generated based on the display image data based on the switched gain;
    Display control method characterized by having a.
JP2005062858A 2004-03-09 2005-03-07 Display control apparatus and display control method Active JP4868749B2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2004066034 2004-03-09
JP2004066034 2004-03-09
JP2005062858A JP4868749B2 (en) 2004-03-09 2005-03-07 Display control apparatus and display control method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2005062858A JP4868749B2 (en) 2004-03-09 2005-03-07 Display control apparatus and display control method

Publications (2)

Publication Number Publication Date
JP2005292814A JP2005292814A (en) 2005-10-20
JP4868749B2 true JP4868749B2 (en) 2012-02-01

Family

ID=35325744

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2005062858A Active JP4868749B2 (en) 2004-03-09 2005-03-07 Display control apparatus and display control method

Country Status (1)

Country Link
JP (1) JP4868749B2 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5014099B2 (en) * 2007-12-11 2012-08-29 キヤノン株式会社 Imaging apparatus and control method thereof
US20120249611A1 (en) * 2009-12-15 2012-10-04 Sharp Kabushiki Kaisha Electronic equipment
JP6379636B2 (en) * 2014-04-30 2018-08-29 ソニー株式会社 Information processing apparatus, information recording medium, image processing method, and program

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4217398B2 (en) * 2001-09-12 2009-01-28 キヤノン株式会社 Image data processing method, the image data processing apparatus, a storage medium, and program
JP4007052B2 (en) * 2002-05-07 2007-11-14 セイコーエプソン株式会社 Image processing control data updating apparatus
JP3977170B2 (en) * 2002-07-02 2007-09-19 キヤノン株式会社 Signal processing device and signal processing method and program, and storage medium

Also Published As

Publication number Publication date
JP2005292814A (en) 2005-10-20

Similar Documents

Publication Publication Date Title
US8358355B2 (en) Digital still camera and image correction method
JP4298253B2 (en) Image processing method and apparatus, and an imaging apparatus
US4914746A (en) Electronic digital still camera for separately storing component video signals in memory
US6421083B1 (en) Color imaging device and method
US7825962B2 (en) Image generation with integrating control data
JP4378258B2 (en) Image correction apparatus and control method thereof
JP4678188B2 (en) Image processing apparatus
US6839064B2 (en) Image file generation
JP3832089B2 (en) Digital camera and printing system
US7417671B2 (en) Image processing system capable of providing color correction
JP4338551B2 (en) Image reproducing method, an image reproducing apparatus and an image reproduction program
US7408571B2 (en) Digital camera and image data processing system
US20080013787A1 (en) Imaging apparatus, image processor, image filing method, image processing method and image processing program
KR20090125699A (en) Camera, storage medium having stored therein camera control program, and camera control method
JP2005210526A (en) Image processing apparatus, method, and program, image pickup device, and image data outputting method and program
JP3877544B2 (en) Digital camera
JP2001045407A (en) Image display device and picture photographing device
US7633523B2 (en) Image capturing device using correction information for preventing at least a part of correction process from being performed when image data is corrected at an external device
JP4840967B2 (en) Imaging apparatus, image processing method, program, and storage medium
US5990949A (en) Digital still camera which displays a gamma-corrected high-quality still image upon depression of a shutter release button but without displaying an unwanted image
US20050174590A1 (en) Image correction method, image correction apparatus, and image correction program
US20040109071A1 (en) Image capturing apparatus
JPH11191873A (en) Electronic camera
JP4525075B2 (en) Control of the image output using the image processing control data
JP2001223979A (en) Image photographing device and image processor

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20071228

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20101214

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20110214

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20111108

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20111115

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20141125

Year of fee payment: 3

S531 Written request for registration of change of domicile

Free format text: JAPANESE INTERMEDIATE CODE: R313531

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250