US9357825B2 - Nail printing device, print control method for nail printing device, and computer readable medium - Google Patents

Nail printing device, print control method for nail printing device, and computer readable medium Download PDF

Info

Publication number
US9357825B2
US9357825B2 US14/323,348 US201414323348A US9357825B2 US 9357825 B2 US9357825 B2 US 9357825B2 US 201414323348 A US201414323348 A US 201414323348A US 9357825 B2 US9357825 B2 US 9357825B2
Authority
US
United States
Prior art keywords
nail
contour
nail contour
section
adjusted
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US14/323,348
Other languages
English (en)
Other versions
US20150007841A1 (en
Inventor
Shuichi Yamasaki
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Casio Computer Co Ltd
Original Assignee
Casio Computer Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Casio Computer Co Ltd filed Critical Casio Computer Co Ltd
Assigned to CASIO COMPUTER CO., LTD reassignment CASIO COMPUTER CO., LTD ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: YAMASAKI, SHUICHI
Publication of US20150007841A1 publication Critical patent/US20150007841A1/en
Application granted granted Critical
Publication of US9357825B2 publication Critical patent/US9357825B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A45—HAND OR TRAVELLING ARTICLES
    • A45D—HAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
    • A45D29/00—Manicuring or pedicuring implements
    • A—HUMAN NECESSITIES
    • A45—HAND OR TRAVELLING ARTICLES
    • A45D—HAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
    • A45D29/00—Manicuring or pedicuring implements
    • A45D2029/005—Printing or stamping devices for applying images or ornaments to nails
    • A—HUMAN NECESSITIES
    • A45—HAND OR TRAVELLING ARTICLES
    • A45D—HAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
    • A45D34/00—Containers or accessories specially adapted for handling liquid toiletry or cosmetic substances, e.g. perfumes
    • A45D34/04—Appliances specially adapted for applying liquid, e.g. using roller or ball

Definitions

  • the present invention relates to a nail printing device, a print control method for the nail printing device, and a computer readable medium.
  • nail printing devices there has been a nail printing device that automatically recognizes nail contours (nail shapes) to set regions in which printing is to be performed.
  • the cuticle portions are difficult to be distinguishably recognized from nail portions in automatic recognition of nail contours executed in the nail printing device, even when a user does not want to execute printing on the cuticle portions.
  • each nail region cannot be extracted successfully.
  • the extracted region can be adjusted appropriately after automatic recognition.
  • Japanese Patent No. 3370345 discloses the technique that enables a user to move a setting position of a printing mask that sets a shape and position of a print target nail region, and/or to change the shape of the printing mask, by operating a joystick, after a nail on which printing is to be performed is set in a device.
  • the nail (finger) on which printing is to be performed is still set in the device when the nail region etc. is manually adjusted.
  • a user must try not to move his/her finger inserted in the nail printing device. This would impose a heavy burden on a user.
  • the present invention has advantages that a nail printing device capable of easily adjusting a recognition result of a nail contour so that it becomes a user-intended contour; a print control method for the nail printing device; and a computer readable medium can be provided.
  • a nail printing device including: a first nail contour recognizing section which recognizes, as a first nail contour, a nail contour from a first nail image obtained by photographing a nail of a specific finger/toe; a display section which displays the first nail contour on the basis of data of the first nail contour stored in a storage section; a recognition result adjusting section which performs an adjustment of the first nail contour, displayed in the display section, on the basis of an adjustment portion specified to the first nail contour and obtains an adjusted nail contour; a second nail contour recognizing section which recognizes, as a second nail contour, a nail contour from a second nail image obtained by photographing the nail of the specific finger/toe after the recognition result adjusting section performs the adjustment of the first nail contour, and reflects the adjustment performed to the first nail contour, in the second nail contour, and obtains an adjusted recognized nail contour; and a print control section to control a print head to perform printing in a region of the adjusted recognized nail contour.
  • a print control method for a nail printing device including the steps of: recognizing, as a first nail contour, a nail contour from a first nail image obtained by photographing a nail of a specific finger/toe; displaying the first nail contour in a display section on the basis of data of the first nail contour stored in a storage section; obtaining an adjusted nail contour by performing an adjustment of the first nail contour on the basis of an adjustment portion specified to the first nail contour displayed in the display section; recognizing, as a second nail contour, a nail contour from a second nail image obtained by photographing the nail of the specific finger/toe after the adjustment of the first nail contour is performed; obtaining an adjusted recognized nail contour by reflecting the adjustment performed to the first nail contour in the second nail contour; and controlling a print head to perform printing in a region of the adjusted recognized nail contour.
  • a computer readable medium storing a print control program for causing a computer of a nail printing device to execute the steps of: recognizing, as a first nail contour, a nail contour from a first nail image obtained by photographing a nail of a specific finger/toe; displaying the first nail contour in a display section on the basis of data of the first nail contour stored in a storage section; obtaining an adjusted nail contour by performing an adjustment of the first nail contour on the basis of an adjustment portion specified to the first nail contour displayed in the display section; recognizing, as a second nail contour, a nail contour from a second nail image obtained by photographing the nail of the specific finger/toe after the adjustment of the first nail contour is performed; obtaining an adjusted recognized nail contour by reflecting the adjustment performed to the first nail contour in the second nail contour; and controlling a print head to perform printing in a region of the adjusted recognized nail contour.
  • FIG. 1 is a perspective view conceptually illustrating a nail printing device according to this embodiment, a lid body of the nail printing device being opened;
  • FIG. 2 is a cross sectional view of a main part of the nail printing device illustrated in FIG. 1 ;
  • FIG. 3 is a main part block diagram illustrating a control configuration of the nail printing device according to the embodiment
  • FIG. 4 is a diagram illustrating an example of an adjustment mode table in FIG. 3 ;
  • FIGS. 5A and 5B are diagrams for explaining an automatic track judgment mode
  • FIGS. 6A to 6D are diagrams for explaining an automatic point mode
  • FIG. 7A is a diagram illustrating a way of handwriting an adjustment border by a user
  • FIG. 7B is a diagram illustrating an adjusted nail contour in the case of manual track mode A
  • FIG. 7C is a diagram illustrating an adjusted nail contour in the case of manual track mode B;
  • FIG. 8 is a flowchart illustrating a flow of an entire printing process according to the embodiment.
  • FIG. 9 is a flowchart illustrating a nail contour adjusting process in FIG. 8 ;
  • FIG. 10 is a flowchart illustrating a flow of an entire adjusted automatic nail contour recognizing process in FIG. 8 ;
  • FIG. 11 is a flowchart illustrating an adjusted automatic nail contour recognizing process according to Method 1 in FIG. 10 ;
  • FIG. 12 is a flowchart illustrating an adjusted automatic nail contour recognizing process according to Method 2 in FIG. 10 ;
  • FIG. 13 is a flowchart illustrating an adjusted automatic nail contour recognizing process according to Method 3 in FIG. 10 .
  • each fingernail of a hand is a print target and the nail printing device performs printing to the fingernail will be described.
  • a drawing object of the present invention is not limited to a fingernail of a hand.
  • Such printing object may be each of toenails.
  • FIG. 1 is a perspective view illustrating an appearance of the nail printing device according to this embodiment.
  • the nail printing device 1 is equipped with a case main body 2 and a lid body 4 .
  • the lid body 4 is rotatably connected with the case main body 2 through a hinge 3 provided at a rear end of an upper surface (top board) of the case main body 2 .
  • the lid body 4 can rotate with the hinge as a supporting point so that it changes from the state of being laid on the top board of the case main body 2 to the state of standing with respect to the top board of the case main body 2 (see FIG. 1 ) and vice versa.
  • the case main body 2 has an approximately elliptical shape in planar view seen from above.
  • an opening/closing plate 2 C is provided so that it can be raised and laid down.
  • the opening/closing plate 2 C is connected with the case main body 2 though a hinge (not illustrated) provided at a lower end of a front surface of the case main body 2 .
  • the opening/closing plate 2 C is provided in order to open and close the front surface of the case main body 2 .
  • the shapes/configurations of the case main body 2 and the lid body 4 are not limited to the examples illustrated herein.
  • an operation section 12 is provided in the upper surface (top board) of the case main body 2 .
  • the operation section 12 enables a user to perform various kinds of inputs.
  • a power switch button for turning on a power of the nail printing device 1 ; a stop switch button for stopping the operation of the nail printing device 1 ; a design selection button for selecting a design image(s) to be printed on a nail(s) T; a printing start button for instructing a print start; and an operation button 121 for performing other various inputs.
  • the operation section 12 includes a touch panel input section 122 (see FIG. 3 ) provided in an after-described display section 13 .
  • the display section 13 is provided in an approximately center part of the upper surface (top board) of the case main body 2 .
  • the display section 13 is composed of, for example, a Liquid Crystal Display (LCD), an organic electroluminescence display, or other plat displays, etc.
  • LCD Liquid Crystal Display
  • organic electroluminescence display or other plat displays, etc.
  • the display section 13 of the embodiment displays, for example, a nail image(s) (namely, an image of a print target finger U 1 including an image of the nail T) which is the image of the nail T of the print target finger U 1 ; a nail contour adjustment screen for adjusting a primary automatically-recognized nail contour L 1 which is recognized in an after-described primary automatic nail contour recognition; a design selection screen for selecting the design image to be printed on the nail T; a thumbnail image(s) for confirming the design; an instruction screen which displays various instructions; an announcement screen; a warning screen, and so on, as necessary.
  • a nail image(s) namely, an image of a print target finger U 1 including an image of the nail T
  • a nail contour adjustment screen for adjusting a primary automatically-recognized nail contour L 1 which is recognized in an after-described primary automatic nail contour recognition
  • a design selection screen for selecting the design image to be printed on the nail T
  • a thumbnail image(s) for confirming the design
  • the touch panel input section 122 (see FIG. 3 ) is integrally configured with the surface of the display section 13 of the embodiment.
  • the touch panel input section 122 is configured to enable various inputs by touch operations, namely, touching the surface of the display section 13 with a fingertip, a stylus pen 123 (see FIG. 5A and the like; hereinafter simply referred to as “pen 123 ”), or an input member such as a rod-like writing pen/pencil having a pointed top, and thereby operates as the operation section 12 .
  • the embodiment describes examples where touch operations are performed by using the pen 123 in FIG. 5A etc.
  • FIG. 2 is a sectional view of a main part of the nail printing device 1 .
  • the case main body 2 houses a device main body 10 of the nail printing device 1 .
  • the device main body 10 is formed in a box shape approximately, and includes a lower machine casing 11 A placed in a lower portion of the inside of the case main body 2 , and an upper machine casing 11 B placed above the lower machine casing 11 A and in an upper portion of the inside of the case main body 2 .
  • a print target finger fixing section 20 In these lower machine casing 11 A and upper machine casing 11 B, there are provided a print target finger fixing section 20 , a photographing section 30 , a printing section 40 , a control device 50 (see FIG. 3 ), and so on.
  • the print target finger fixing section 20 is provided in the lower machine casing 11 A.
  • the lower machine casing 11 A includes a print target finger/toe insertion section 20 A and a non-print target finger/toe insertion section 20 B, which constitute the print target finger fixing section 20 together.
  • the print target finger/toe insertion section 20 A and the non-print target finger/toe insertion section 20 B are separated from each other with a division wall 21 .
  • the print target finger/toe insertion section 20 A is a finger/toe insertion section into which a finger (herein after referred to as “print target finger U 1 ”) corresponding to the nail T to be subjected to printing is inserted.
  • the bottom surface (the upper surface of the division wall 21 in the embodiment) of the print target finger/toe insertion section 20 A functions as a finger placement section (print target finger placement section) on which the print target finger U 1 is placed.
  • Photographing, printing, etc. of the print target finger U 1 are performed while the print target finger U 1 is placed on a print target finger placement surface (the upper surface of the division wall 21 ) of the print target finger/toe insertion section 20 A as the finger placement section.
  • the embodiment describes an example where the print target fingers U 1 are inserted into the print target finger/toe insertion section 20 A one by one and then printing etc. is performed to each of the nails T.
  • the print target finger/toe insertion section 20 A is configured to have a certain size so that an adult user does not feel tight when inserting his/her thumb etc. into the print target finger/toe insertion section 20 A, in order to deal with various fingers.
  • the non-print target finger/toe insertion section 20 B is a finger/toe insertion section into which fingers (not illustrated; hereinafter “non-print target fingers”) other than the print target finger are inserted.
  • the print target finger U 1 is fixed in a stable condition by inserting the print target finger U 1 into the print target finger/toe insertion section 20 A, inserting the non-print target fingers into the non-print target finger/toe insertion section 20 B, and sandwiching the division wall 21 by the print target finger U 1 and the non-print target fingers.
  • the print target finger U 1 is a thumb
  • a user inserts the thumb (the print target finger U 1 ) into the print target finger/toe insertion section 20 A, and inserts the four fingers (index finger, middle finger, medicinal finger and little finger) other than the thumb into the non-print target finger/toe insertion section 20 B as the non-print target fingers.
  • the print target finger U 1 is fixed when the print target finger U 1 and non-print target fingers of the user hold the division wall 21 therebetween.
  • the division wall 21 preferably has a cross section, in a finger insertion direction, of a shape naturally fitting a base of the print target finger U 1 or each non-print target finger, such as a round shape, an elliptical shape and a polygon shape, in the finger-insertion-side end portion thereof, in order to minimize a burden on a base of each finger when the print target finger U 1 and the non-print target fingers strongly hold the division wall 21 therebetween.
  • the photographing section 30 is disposed in the upper machine casing 11 B.
  • a basal plate 15 is disposed on the upper machine casing 11 B, and a camera 32 as the photographing device is placed at the center of the lower surface of the basal plate 15 .
  • the camera 32 preferably has a resolution of approximately two million pixels or more.
  • the camera 32 takes a photograph of the nail T of the print target finger U 1 , which is being inserted into the print target finger/toe insertion section 20 A, to obtain a nail image (i.e. the image of the print target finger U 1 including the image of the nail T) which is an image of the nail T of the print target finger U 1 .
  • illuminating lumps 33 such as white LEDs are disposed so as to surround the camera 32 .
  • the illuminating lumps 33 illuminate the nail T of the print target finger U 1 when the camera 32 performs photographing.
  • the photographing section 30 is composed of the camera 32 and the illuminating lumps 33 .
  • the camera 32 as the photographing device performs photographing twice, namely, performs primary photographing and secondary photographing. Then a later-described nail contour recognizing section 512 automatically recognizes the contour (shape) of the nail T on the basis of the nail image (primary nail image) obtained by primary photographing and the nail image (secondary nail image) obtained by secondary photographing.
  • the image data of the nail image (primary nail image) obtained by primary photographing is stored in a later-described primary nail image memory 524 of a storage section 52 (see FIG. 3 ).
  • the image data of the nail image (secondary nail image) obtained by secondary photographing is stored in a later-described secondary nail image memory 528 of the storage section 52 (see FIG. 3 ).
  • the photographing section 30 is connected to a later-described photographing control section 511 of the control device 50 (see FIG. 3 ), and controlled by the photographing control section 511 .
  • the printing section 40 is mainly provided in the upper machine casing 11 B.
  • two guide rods 41 extend, parallel to each other, between both side plates of the upper machine basing 11 B, the ends of the guide rods 41 being fixed to the both side plates, respectively.
  • a main carriage 42 is slidably attached to the guide rods 41 .
  • two guide rods 44 extend parallel to each other.
  • a sub carriage 45 is slidably attached to the guide rods 44 .
  • a print head 46 is mounted on the lower surface of the sub carriage 45 .
  • the print head 46 of the embodiment is an ink jet type print head which produces micro-droplets of ink and directly sprays them on a printing object surface of a printing target to perform printing.
  • the recording type of the print head 46 is not limited to the ink jet type.
  • the printing section 40 is provided with the print head 46 adaptable for inks of, for example, yellow (Y), magenta (M) and cyan (C).
  • Y yellow
  • M magenta
  • C cyan
  • the print head 46 is provided with a nozzle array composed of a plurality of nozzles which eject inks of the respective colors.
  • the print head 46 included in the printing section 40 is not limited to the print head which ejects the inks of these three colors.
  • the printing section 40 may include a print head which also ejects an ink of another color(s).
  • the print head 46 prints the image (nail design) on the surface of the nail T of the print target finger U 1 .
  • the print head 46 performs printing to the nail T of the print target finger U 1 on the basis of nail information detected by the later-described nail contour recognizing section 512 .
  • ink cartridges 48 that supply the inks to the print head 36 is disposed.
  • the ink cartridges 48 are connected to the print head 46 , through not-illustrated ink supply tubes, to supply the inks to the print head 46 as necessary.
  • the main carriage 42 is connected to a motor 43 through a power transmitting section (not illustrated), and is configured to move in a right-left direction (a width direction of the nail printing device 1 ) in the nail printing device 1 along the guide rods 41 by forward/reverse rotations of the motor 43 .
  • the sub carriage 45 is connected to a motor 47 through a power transmitting section (not illustrated), and is configured to move in a front-back direction (a right-left direction in FIG. 2 ) in the nail printing device 1 along the guide rods 44 by forward/reverse rotations of the motor 47 .
  • the printing section 40 is composed of these guide rods 41 , main carriage 42 , motor 43 , guide rods 44 , sub carriage 45 , print head 46 , motor 47 , ink cartridges 48 , etc.
  • the motor 43 , print head 46 and motor 47 of the printing section 40 are connected to a later-described print control section 514 (see FIG. 3 ) of the control device 50 , and controlled by the print control section 514 .
  • the control device 50 is placed, for example, on the basal plate 15 disposed on the upper machine casing 11 B.
  • FIG. 3 is a main-part block diagram illustrating a control configuration of the control device 50 according to the embodiment.
  • control device 50 is a computer equipped with: a control section 51 composed of a not-illustrated Central Processing Unit (CPU) etc.; and the storage section 52 composed of a Read Only Memory (ROM), a Random Access Memory (RAM), etc.
  • CPU Central Processing Unit
  • storage section 52 composed of a Read Only Memory (ROM), a Random Access Memory (RAM), etc.
  • the storage section 52 includes a program memory 521 , a design data memory 522 , an adjustment mode table 523 , the primary nail image memory 524 , a primary automatically-recognized nail contour memory 525 , an adjusted nail contour memory 526 , a border branch point memory 527 , the secondary nail image memory 528 and an adjusted automatically-recognized nail contour memory 529 .
  • the program memory 521 stores various programs for operating the nail printing device 1 .
  • the program memory 521 stores various programs, for example, a nail contour recognition program for automatically recognizing the nail contour of the nail T, a nail contour adjustment program for performing nail contour adjusting process to adjust the automatically-recognized nail contour, an adjusted automatic nail contour recognition program for performing an adjusted automatic nail contour recognizing process to obtain an adjusted automatically-recognized nail contour in which the adjusted nail contour has been reflected, a print program for performing printing process, and so on.
  • the printing device 50 executes these programs as necessary to control each section of the nail printing device 1 .
  • the design data memory 522 stores image data of the nail designs to be printed on the nail T.
  • the image data of the nail designs stored in the design data memory 522 are, for example, rectangular data. Each piece of the image data of the nail designs has a larger size than a general size of the nail T in order to deal with various sizes of the nails T.
  • the adjustment mode table 523 stores mode numbers of nail contour adjustment modes (hereinafter simply referred to as “adjustment modes”), and a content of each of the adjustment modes (i.e. a content of a process in each of the adjustment modes) so that the mode numbers correspond to the adjustment modes, respectively.
  • FIG. 4 is a diagram illustrating an example of the adjustment mode table 523 .
  • each of the adjustment modes is simply referred to as “Mode”.
  • an automatic track judgment mode (Mode 1); an automatic point mode (Mode 2); a manual track mode A (Mode 3); a manual track mode B (Mode 4).
  • the content corresponding to the selected mode number is read out from the adjustment mode table 523 . Then a later-described recognition result adjusting section 513 performs the nail contour adjusting process according to the read-out content.
  • the primary nail image memory 524 stores the image data of the nail image (primary nail image) of the nail T of the print target finger U 1 of a user, the image data being obtained by the photographing section 30 in the primary photographing.
  • the secondary nail image memory 528 stores the image data of the nail image (secondary nail image) of the nail T of the print target finger U 1 of a user, the image data being obtained by the photographing section 30 in the secondary photographing.
  • the primary automatically-recognized nail contour memory 525 stores, when the nail contour recognizing section 512 automatically recognizes the contour (shape) of the nail T on the basis of the primary nail image (the primary automatic nail contour recognition), the primary automatically-recognized nail contour L 1 (see FIG. 5A , etc.) which is the result of the above automatic recognition.
  • the adjusted automatically-recognized nail contour memory 529 stores, when the nail contour recognizing section 512 reflects a later-described adjusted nail contour RL (see FIG. 5B , etc.) in the secondary nail image and automatically recognizes the contour (shape) of the nail T (secondary automatic nail contour recognition), an adjusted automatically-recognized nail contour (not illustrated) which is the result of the above automatic recognition.
  • the contour (shape) of the nail T is a border between a print target region and a region other than the print target region, for example, a border between the nail T and a fleshy part of the finger.
  • Each of the primary automatically-recognized nail contour L 1 and the adjusted automatically-recognized nail contour is obtained, for example, by representing positions (border line composed of an assembly of points) of a plurality of points constituting the automatically-recognized contour of the nail T with x-y coordinates or the like.
  • the adjusted nail contour memory 526 stores the adjusted nail contour RL after adjustment in the case that the nail contour adjusting process to adjust the primary automatically-recognized nail contour L 1 is performed depending on the adjustment mode.
  • the border branch point memory 527 stores border branch points DP.
  • the border branch points DP are points existing on the primary automatically-recognized nail contour L 1 , and are starting and end points of a portion to be adjusted, among the points constituting the adjusted nail contour RL.
  • the border branch points DP are points where the nail contour is divided into the primary automatically-recognized nail contour L 1 and the adjusted nail contour RL when adjustment is performed to the primary automatically-recognized nail contour L 1 that is the result of the automatic recognition (primary automatic nail contour recognition) of the contour (shape) of the nail T based on the primary nail image performed by the nail contour recognizing section 512 .
  • the border branch points DP exist as a set of: the point (the starting point of the portion to be adjusted) where the primary automatically-recognized nail contour L 1 and the adjusted nail contour RL are separated from each other; and the point (the end point of the portion to be adjusted) where these two contours join together.
  • FIG. 5 etc. illustrate the example where the number of the border branch points DP are two, namely, the number of sets of the border branch points DP is one (1).
  • the number of the border branch points DP is not limited to two and the number of sets of the border branch points DP is not limited to one (1).
  • each of the portions includes the starting and end points.
  • there are a plurality of sets of the border branch points DP namely, four or more border branch points DP.
  • the border branch point memory 527 stores x-y coordinates or the like representing the positions of the border branch points DP.
  • the starting and end points of each adjusted portion are correlated to each other as one (1) set and stored in the border branch point memory 527 .
  • the control section 51 includes, as viewed from the perspective of functionality, functional sections such as the photographing control section 511 , nail contour recognizing section 512 , the recognition result adjusting section 513 , the print control section 514 , a display control section 515 , etc.
  • photographing control section 511 The functions as these photographing control section 511 , nail contour recognizing section 512 , recognition result adjusting section 513 , print control section 514 and display control section 515 are implemented by the CPU of the control section 51 in cooperation with the programs stored in the ROM etc. of the storage section 52 .
  • control section 51 The functional sections contained in the control section 51 are not limited to those adopted above.
  • the photographing control section 511 controls the photographing section 30 so that the camera 32 takes the photograph of the print target finger U 1 of a user to obtain the nail image (i.e. the image of the print target finger U 1 including the image of the nail T).
  • the photographing control section 511 causes the photographing section 30 to perform first photographing (primary photographing) at the timing of setting of the print target finger U 1 of a user in the print target finger/toe insertion section 20 A.
  • the photographing control section 511 causes the photographing section 30 to perform second photographing (secondary photographing) at the timing of re-setting of the print target finger U 1 of the user in the print target finger/toe insertion section 20 A.
  • the primary photographing and the secondary photographing are preferably executed in a situation where photographing conditions such as illumination by the illuminating lumps 33 are same as each other as much as possible.
  • the image data of the nail images (primary nail images) obtained by the primary photographing are stored in the primary nail image memory 524
  • the image data of the nail images (secondary nail images) obtained by the secondary photographing are stored in the secondary nail image memory 528 .
  • the nail contour recognizing section 512 automatically recognizes the contour (hereinafter referred to as “nail contour” or “nail shape”) of the nail T of the print target finger U 1 on the basis of the nail image obtained by the camera 32 as the photographing device.
  • the nail contour recognizing section 512 functions as a first nail contour recognizing section which performs the primary automatic nail contour recognition (first nail contour automatic recognition) on the basis of the nail image (primary nail image) obtained by the primary photographing to obtain the primary automatically-recognized nail contour L 1 .
  • the nail contour recognizing section 512 detects the nail contour (nail shape) from the nail image (primary nail image) of the nail T of the print target finger U 1 , the nail image being obtained by the camera 32 , and obtains this nail contour as positional information represented by x-y coordinates or the like.
  • the nail contour recognizing section 512 automatically recognizes the nail contour (nail shape) on the basis of the color difference between the nail T and another portion of the finger from the nail image of the nail T of the print target finger U 1 obtained by the camera 32 .
  • the storage section 52 previously stores a detection threshold for executing the automatic recognition of the nail contour, and the nail contour recognizing section 512 obtains the primary automatically-recognized nail contour L 1 , for example, by detecting a border between points exceeding a predetermined detection threshold and points not exceeding the predetermined detection threshold, and executing smoothing process to smooth the border.
  • the method for detecting the nail contour (nail shape) by the nail contour recognizing section 512 is not limited to the example illustrated herein, and various methods for detecting the contour can be applied.
  • the primary automatically-recognized nail contour L 1 which is the result of the automatic recognition by the nail contour recognition section 512 , is stored in the primary automatically-recognized nail contour memory 525 of the storage section 52 .
  • the number of the border line to be detected by the nail contour recognizing section 512 is not limited to one (1), and a plurality of border lines (candidate nail contours) can be detected by changing the detection threshold from a previously-set value to a certain value. For example, a border between a finger and a root of the nail T, a border between a portion covered with a cuticle of the nail T and a portion without the cuticle, and so on can be detected.
  • the storage section 52 previously stores a general nail contour by default, and the border line nearest the general nail contour is set as the primary automatically-recognized nail contour L 1 .
  • the nail contour recognizing section 512 detects another border line(s) (e.g. border lines L 2 , L 3 illustrated in FIG. 5B ), as the candidate nail contours, in addition to the primary automatically-recognized nail contour L 1 , the border line set as the primary automatically-recognized nail contour L 1 and the another border line(s) (e.g. border lines L 2 , L 3 illustrated in FIG. 5B ) detected as the candidate nail contours are stored together in the primary automatically-recognized nail contour memory 525 .
  • another border line(s) e.g. border lines L 2 , L 3 illustrated in FIG. 5B
  • the plurality of border lines may be recognized in either cases of the primary automatic nail contour recognition and of the secondary automatic nail contour recognition.
  • the nail contour recognizing section 512 also functions as a second nail contour recognizing section which performs the secondary automatic nail contour recognition (second nail contour automatic recognition) to automatically re-recognize the nail contour (nail shape) on the basis of the nail image (secondary nail image) obtained by the secondary photographing, and sets the nail contour obtained by reflecting the contour (adjusted nail contour RL) adjusted by the later-described recognition result adjusting section 513 in the result of the secondary automatic nail contour recognition, as the adjusted automatically-recognized nail contour.
  • second nail contour automatic recognition secondary automatic nail contour recognition
  • Method 1 there are prepared three methods (Method 1, Method 2 and Method 3) as adjusted automatic nail contour recognizing processes for obtaining the adjusted automatically-recognized nail contour.
  • a user selects any one of the three methods that have been prepared.
  • the nail contour recognizing section 512 as the second nail contour recognizing section executes the adjusted automatic nail contour recognition according to the selected method.
  • the adjusted automatically-recognized nail contour which is the result of the automatic recognition by the nail contour recognizing section 512 , is stored in the adjusted automatically-recognized nail contour memory 529 of the storage section 52 .
  • the adjusted automatic nail contour recognizing process according to Method 1 is an adjusted automatic nail contour recognizing process to be executed in the case that Mode 1 or Mode 2 is selected as the adjustment mode in the nail contour adjusting process by the recognition result adjusting section 513 .
  • the nail contour recognizing section 512 automatically recognizes the nail contour (nail shape) based on the secondary nail image (secondary automatic nail contour recognition).
  • the plurality of candidate nail contours can be detected similarly to the case of the primary automatic nail contour recognition.
  • the automatic re-recognition is performed only to a region corresponding to the portion (i.e. adjusted nail contour RL) that has been adjusted by the recognition result adjusting section 513 in the nail contour adjusting process, the region being between the pair of border branch points DP.
  • the automatic recognition is performed to all of the adjusted portions.
  • the nail contour recognizing section 512 then reads out the primary automatically-recognized nail contour L 1 , the adjusted nail contour(s) RL and the border branch points DP from the storage section 52 , and performs superposition (i.e., e.g., matching process etc.) of the primary automatically-recognized nail contour L 1 , and the secondary automatically-recognized nail contour which is the result of the secondary automatic nail contour recognition.
  • superposition i.e., e.g., matching process etc.
  • the nail contour recognizing section 512 detects points (border branch points on the secondary automatically-recognized nail contour) on the secondary automatically-recognized nail contour which correspond to the border branch points DP on the primary automatically-recognized nail contour L 1 .
  • border adjustment is performed by reflecting the detected border in the secondary automatically-recognized nail contour.
  • a smoothing process is performed to smoothly connect the adjusted border portion and the unadjusted border portion (i.e. a portion left as the primary automatically-recognized nail contour L 1 ) to each other to produce the adjusted automatically-recognized nail shape.
  • the adjusted automatic nail contour recognizing process according to Method 2 is an adjusted automatic nail contour recognizing process to be executed in the case that Mode 1 or Mode 2 is selected as the adjustment mode in the nail contour adjusting process by the recognition result adjusting section 513 , similarly to the case of the adjusted automatic nail contour recognizing process according to Method 1.
  • the nail contour recognizing section 512 obtains the secondary nail image, and reads out the adjusted nail contour RL and the primary automatically-recognized nail contour L 1 from the storage section 52 .
  • the nail contour recognizing section 512 adjusts the detection threshold or the like so that the border becomes nearest the adjusted nail contour RL, and automatically recognizes the nail contour from the secondary nail image (secondary automatic nail contour recognition).
  • the nail contour recognizing section 512 automatically recognizes the nail contour.
  • the detection threshold is composed of RGB densities
  • the nail contour recognizing section 512 recognizes a border between a finger and a nail root part as the nail contour.
  • the value(s) of red (R) component(s) of the detection threshold is set to be low, the nail contour recognizing section 512 recognizes a border between a nail portion covered with a cuticle and a nail portion without a cuticle as the nail contour.
  • the nail contour recognizing section 512 is capable of detecting the plurality of border lines (e.g. the primary automatically-recognized nail contour L 1 and/or the border lines L 2 , L 3 ) as the nail contours by changing the detection threshold.
  • the nail contour recognizing section 512 performs automatic recognition so as to select the border line whose shape/size becomes nearest those of the adjusted nail contour RL among the plural border lines that may be recognized, by performing detection while varying the detection threshold or the like.
  • portion portion left as the primary automatically-recognized nail contour L 1
  • the border same as the primary automatically-recognized nail contour that has been recognized by the primary automatic nail contour recognition is automatically recognized. This recognition result becomes the adjusted automatically-recognized nail contour.
  • correction information such as an inclination deviation (angle deviation) and/or a size deviation (apparent size deviation due to a difference of distances from the camera 32 , image ratio deviation) between the print target finger U 1 at the time of obtaining the primary nail image and the print target finger U 1 at the time of obtaining the secondary nail image, on the basis of the primary nail image data obtained by the primary photographing and the secondary nail image data obtained by the secondary photographing, and to previously reflect the correction information in the adjusted nail contour RL.
  • correction information such as an inclination deviation (angle deviation) and/or a size deviation (apparent size deviation due to a difference of distances from the camera 32 , image ratio deviation)
  • the adjusted automatic nail contour recognizing process according to Method 3 is an adjusted automatic nail contour recognizing process to be executed in the case that Mode 3 or Mode 4 is selected as the adjustment mode in the nail contour adjusting process by the recognition result adjusting section 513 .
  • the nail contour recognizing section 512 obtains the secondary nail image, and reads out the adjusted nail contour(s) RL and the primary automatically-recognized nail contour L 1 from the storage section 52 .
  • the nail contour (nail shape) is automatically recognized based on the secondary nail image (the secondary automatic nail contour recognition).
  • the nail contour recognizing section 512 obtains the correction information such as the inclination deviation (angle deviation) and/or the size deviation (apparent size deviation due to a difference of distances from the camera 32 , image ratio deviation) between the print target finger U 1 at the time of obtaining the primary nail image and the print target finger U 1 at the time of obtaining the secondary nail image, from the primary automatically-recognized nail contour L 1 and the secondary automatically-recognized nail contour, and reflects the correction information in the adjusted nail contour RL.
  • the correction information such as the inclination deviation (angle deviation) and/or the size deviation (apparent size deviation due to a difference of distances from the camera 32 , image ratio deviation) between the print target finger U 1 at the time of obtaining the primary nail image and the print target finger U 1 at the time of obtaining the secondary nail image, from the primary automatically-recognized nail contour L 1 and the secondary automatically-recognized nail contour, and reflects the correction information in the adjusted nail contour RL.
  • the nail contour recognizing section 512 incorporates the adjusted nail contour RL after the correction into a corresponding portion in the secondary automatically-recognized nail contour to produce the adjusted automatically-recognized nail contour.
  • the nail contour recognizing section 512 is not limited to the one that detects only the contour (shape) of the nail T as the nail information.
  • the nail contour recognizing section 512 may detect other information such as a height (position in a vertical direction) of the nail T, a curvature (nail curvature) of the nail T, etc.
  • a plurality of nail images are obtained by photographing the nail T of the print target finger U 1 from among a plurality of different angles by using the camera 32 , and the height and/or the curvature of the nail T are detected based on the nail images.
  • the nail contour recognizing section 512 detects also the nail height/curvature, printing can be executed with consideration for the shape of the nail T in a height direction, and thereby printing can be executed with a higher degree of accuracy.
  • the recognition result adjusting section 513 has a plurality of adjustment modes (nail contour adjustment modes) for adjusting at least a part of the contour (nail contour) of the nail T.
  • the recognition result adjusting section 513 adjusts the nail contour (primary automatically-recognized nail contour L 1 ) that has been automatically recognized by the nail contour recognizing section 512 as the first nail contour recognizing section, on the basis of the selected adjustment mode.
  • the nail contour adjustment screen is displayed on the display screen of the touch panel input section 122 .
  • an image in which the primary automatically-recognized nail contour L 1 that has been recognized in the primary automatic nail contour recognition is distinguishably superposed on the nail image is displayed.
  • the primary automatically-recognized nail contour L 1 is drawn by a solid line, and a finger portion is drawn by two-dot chain lines.
  • the display screen of the touch panel input section 122 may display only the primary automatically-recognized nail contour L 1 , or alternatively may display other borderlines (border lines L 2 , L 3 in FIG. 5B etc.) that have been detected as the candidate nail contours together with the primary automatically-recognized nail contour L 1 .
  • the recognition result adjusting section 513 executes the nail contour adjusting process on the basis of the selected adjustment mode.
  • adjusted nail contour RL The nail contour after adjustment (hereinafter referred to as “adjusted nail contour RL”), which is the result of adjustment by the recognition result adjusting section 513 , is stored in the adjusted nail contour memory 526 .
  • the border branch points DP which are the starting and end points of the adjusted portion are stored in the border branch point memory 527 .
  • the automatic track judgment mode (Mode 1); the automatic point mode (Mode 2); the manual track mode A (Mode 3); and the manual track mode B (Mode 4), as the adjustment modes (see FIG. 4 ).
  • the recognition result adjusting section 513 refers to the adjustment mode table 523 to read out the content corresponding to the selected mode number, and performs the nail contour adjusting process according to the read-out content.
  • the recognition result adjusting section 513 performs the nail contour adjusting process according to the adjustment mode set by default as long as an instruction to change the adjustment mode is not especially input from the operation section 12 .
  • FIG. 5A and FIG. 5B are explanatory diagrams of the automatic track judgment mode (Mode 1).
  • a user traces the adjustment target portion of the primary automatically-recognized nail contour L 1 with the pen 123 , on the nail contour adjustment screen displayed in the touch panel input section 122 (the lines traced with the pen 123 are drawn by dash lines as “handwritten lines ML” in FIG. 5A and FIG. 5G ).
  • the recognition result adjusting section 513 set the starting and end points of the portion traced with the pen 123 as the border branch points DP, and among the border lines that have been detected as the candidate nail contours by the nail contour recognizing section 512 in the primary automatic nail contour recognition, selects the border line (border line L 2 in FIG. 5B ) nearest the adjustment line traced with the pen 123 as the adjusted nail contour.
  • the recognition result adjusting section 513 selects the border line (border line L 2 in FIG. 5B ) nearest the handwritten line (adjustment line) ML which a user traced with the pen 123 .
  • the recognition result adjusting section 513 selects the border line (border line L 2 in FIG. 5B ) nearest the handwritten line ML among the border lines which are not the primary automatically-recognized nail contour L 1 .
  • Whether or not the border line is close to the handwritten line ML may be also judged by previously preparing a threshold for defining a range that can be said as being close, and determining the border line located within the range of the threshold as the border line close to the handwritten line ML.
  • the display section 13 etc. may display that fact and/or an instruction screen prompting a user to re-execute the nail contour adjusting process.
  • the recognition result adjusting process 513 also smoothly connects the selected and adjusted border line and the unadjusted border portion (i.e. a portion left as the primary automatically-recognized nail contour L 1 ) to each other so that unnatural unevenness does not occur in the nail contour, and thereby the adjusted nail contour RL is produced.
  • FIGS. 6A to 6D are explanatory diagrams of the automatic point mode (Mode 2).
  • a user touches the starting point and the end point (i.e. border branch points DP) of the adjustment target portion of the primary automatically-recognized nail contour L 1 with the pen 123 on the nail contour adjustment screen displayed in the touch panel input section 122 .
  • the recognition result adjusting section 513 sets the border line, among the border lines (border lines L 2 , L 3 in FIG. 6B ) that have been detected as the candidate nail contours by the nail contour recognizing section 512 in the primary automatic nail contour recognition, which is nearest the line obtained by smoothly connecting the points input by touch operations, as the adjusted nail contour RL.
  • the border line L 3 which is the nearest border line with respect to the line (drawn by the dash line in FIG. 6B ) obtained by connecting these two points to each other is set as the adjusted nail contour RL.
  • the border line L 2 which is the nearest border line with respect to the line (drawn by the dash line in FIG. 6C ) obtained by connecting these three points to one another is set as the adjusted nail contour RL.
  • the border lines cannot be recognized successfully, and sometimes become discontinuous (e.g. portions enclosed with dash-line circles in FIG. 6C ).
  • an intended border line e.g. the border line L 2 in FIG. 6C
  • an intended border line cannot sometimes be obtained even when the recognition result adjusting section 513 connects the touched points.
  • the recognition result adjusting section 513 smoothly connects all of the points that has been touched by operation on the nail contour adjustment screen, and thereby the portions that have been difficult to be recognized by the nail contour recognizing section 512 can be compensated. This can cause the border line having a proper shape to be the adjusted nail contour RL.
  • adjusting the recognition result adjusting section 513 is not limited to setting the border line, among the border lines detected as the candidate nail contours by the nail contour recognizing section 512 in the primary automatic nail contour recognition, which is nearest the line obtained by connecting the touched points, as the adjusted nail contour RL.
  • the line itself which is obtained by connecting the touched points, can be set as the adjusted nail contour RL.
  • FIGS. 7A to 7C are explanatory diagrams of the manual track mode A (Mode 3) and the manual track mode B (Mode 4).
  • a user traces the adjustment target portion of the primary automatically-recognized nail contour L 1 with the pen 123 , on the nail contour adjustment screen displayed in the touch panel input section 122 .
  • the lines traced with the pen 123 are drawn by dash lines as “handwritten lines ML”.
  • the recognition result adjusting section 513 corrects the handwritten line ML so that an unnatural (human-induced) unevenness does not occur in the nail contour, to produce the after-adjustment border line (drawn by a chain line in FIG. 7B ).
  • the recognition result adjusting section 513 smoothly connects the after-adjustment border line and the unadjusted border portion (i.e. the portion left as the primary automatically-recognized nail contour L 1 ) to each other so that an unnatural unevenness does not occur in the nail contour, to produce the adjusted nail contour RL.
  • the recognition result adjusting section 513 directly (without adjustment) sets the handwritten line ML, that has been input through the touch operation by a user, as the adjusted nail contour RL.
  • the print control section 514 outputs print data based on the image data of the nail design(s) to the print head 46 of the printing section 40 , and controls the printing section 40 so that the print head 46 performs printing to the nail T according to the print data.
  • control section 51 incorporates the image data of the nail design selected by a user operation in the operation section 12 etc. into the adjusted automatically-recognized nail contour recognized by the nail contour recognizing section 512 (the second nail contour recognizing section), namely, performs fitting of the image data of the nail design to the adjusted automatically-recognized nail contour. Then the control section 51 creates print data whose print target region is within the region of the adjusted automatically-recognized nail contour.
  • the print control section 514 controls the print head 46 to execute printing according to the created print data.
  • the image data of the nail designs stored in the design data memory 522 are rectangular data each having a large size.
  • Each piece of print data is generated by properly reducing each piece of image data of the nail designs so that it fits the contour of the nail T.
  • the specific method of the incorporating process is not especially limited.
  • each piece of print data is generated by reducing each piece of image data of the nail designs so that it has a size which does not protrude from the region of the adjusted automatically-recognized nail contour, with a shorter length among horizontal and vertical lengths of the print target nail T as a reference, and incorporating the reduced image data into the region of the adjusted automatically-recognized nail contour.
  • the display control section 515 controls the display section 13 to display various kinds of display screens.
  • the display control section 515 controls the display section 13 to display, for example, the nail image(s) obtained by photographing the print target finger U 1 , the design selection screen for selecting the image (i.e. “nail design”) to be printed on the nail T, the thumbnail image(s) for confirming the design(s), the instruction screen for displaying various instructions, and so on.
  • the display control section 515 causes the display section 13 to display the primary automatically-recognized nail contour L 1 that has been automatically-recognized by the nail contour recognizing section 12 (the first nail contour recognizing section).
  • the display section 13 is equipped with the touch panel input section 122 integrally formed therewith, and the display screen on which the primary automatically-recognized nail contour L 1 is displayed functions as the nail contour adjustment screen on which touch operations with the pen 123 or the like are possible.
  • a user When executing printing by using the nail printing device 1 , first, a user turns on the power switch to activate the control device 50 .
  • the display control section 515 causes the display section 13 to display the design selection screen.
  • a user operates the operation button 121 etc. of the operation section 12 to select an intended nail design from among the plurality of nail designs displayed on the design selection screen.
  • a selection instruction signal is output from the operation section 12 , and one (1) nail design is selected (Step S 1 ).
  • the display control section 515 causes the display section 13 to display the instruction screen for instructing a user to set the print target finger U 1 (nail T) in the device (Step S 2 ).
  • a user inserts the print target finger U 1 into the print target finger/toe insertion section 20 A.
  • the photographing control section 511 controls the photographing section 30 to perform photographing (primary photographing) of the nail T of the print target finger U 1 to obtain the nail image (primary nail image) (Step S 3 ).
  • the display control section 515 causes the display section 13 to display, in real time, the image of the print target finger U 1 photographed by the photographing section 30 so that a user can recognize whether or not the print target finger U 1 is set in a predetermined position.
  • the nail contour recognizing section 512 (first nail contour recognizing section) automatically recognizes the nail contour from the nail image (Step S 4 ; primary automatic nail contour recognition).
  • the display control section 515 causes the display section 13 to display the primary automatically-recognized nail contour L 1 as the recognition result (Step S 5 ). At that time, the display control section 515 causes the display section 13 to display, while displaying the nail image of the print target finger U 1 photographed by the photographing section 30 in real time, the primary automatically-recognized nail contour L 1 so that it is superposed on the nail image.
  • the display control section 515 makes an inquiry to a user about whether or not the recognition result is appropriate (Step S 6 ). Specifically, for example, the display section 13 displays not-illustrated OK button and NO button, and judgment is made as to whether or not any one of the buttons is operated.
  • Step S 6 When the NO button is operated (Step S 6 ; No), the nail contour adjusting process according to the nail contour adjustment mode is performed (Step S 7 ).
  • a user When executing the nail contour adjusting process, a user draws his/her hand including the print target finger U 1 out of the nail printing device 1 .
  • a user executes the subsequent nail contour adjusting process in the state that the hand including the print target finger U 1 is not inserted into the nail printing device 1 .
  • Step S 7 the nail contour adjusting process (Step S 7 ) will be described with reference to FIG. 9 .
  • any one of the plural adjustment modes is selected to be set according to the instruction etc. input from the operation section 12 (Step S 21 ).
  • the adjustment mode is automatically set to be the mode set by default.
  • the recognition result adjusting section 513 reads out the primary automatically-recognized nail contour L 1 from the primary automatically-recognized nail contour memory (Step S 22 ).
  • the display section 13 then displays the nail contour adjustment screen for adjusting the primary automatically-recognized nail contour L 1 (Step S 23 ).
  • the nail contour adjustment screen displays the image in which the primary automatically-recognized nail contour L 1 that has been recognized in the primary automatic nail contour recognition is superposed on the nail image of the print target finger U 1 based on the image data read out from the primary nail image memory 524 .
  • the display screen displaying the primary automatically-recognized nail contour L 1 functions as the nail contour adjustment screen on which touch operations with the pen 123 etc. are possible.
  • a user performs the touch operations on the display screen so that the intended border line becomes the nail contour.
  • the recognition result correcting section 513 executes, on the basis of the results of the touch operations, the nail contour adjusting process according to the adjustment mode that has been selected and set (Step S 24 ).
  • control section 51 judges whether or not the nail contour adjusting process ends (Step S 25 ).
  • the adjusted nail contour RL as the adjustment result is stored (registered) in the adjusted nail contour memory 526 .
  • the border branch points DP are then stored (registered) in the border branch point memory 527 , and the process ends.
  • the processing returns to FIG. 8 , and the display control section 515 causes the display section 13 to display the instruction screen for instructing a user to set the print target finger U 1 (nail T) same as that of the above nail contour adjusting process in the device again (Step S 8 ).
  • the photographing control section 511 controls the photographing section 30 to execute re-photographing (secondary photographing) of the nail T of the print target finger U 1 to obtain the nail image (secondary nail image) (Step S 9 ).
  • the nail image recognizing section 512 (second nail contour recognizing section) performs the adjusted automatic nail contour recognizing process (Step S 10 ).
  • Step S 10 the adjusted automatic nail contour recognizing process
  • Step S 7 whether or not the nail contour adjusting process (Step S 7 ; see FIG. 9 ) has been executed according to the adjustment mode of Mode 1 or Mode 2 is judged (Step S 31 ).
  • Step S 31 When it is judged that the nail contour adjusting process has been executed according to the adjustment mode of Mode 1 or Mode 2 (Step S 31 ; YES), the adjusted automatic nail contour recognizing process is performed by Method 1 or Method 2 (Step S 32 ).
  • Method 1 whether the adjusted automatic nail contour recognizing process is performed by Method 1 or Method 2 may be set by default, or alternatively, may be freely set by a user.
  • Step S 33 the adjusted automatic nail contour recognizing process is performed by Method 3 (Step S 33 ).
  • the nail contour recognizing section 512 automatically recognizes the nail contour from the re-taken nail image (secondary automatic nail contour recognition) (Step S 41 ).
  • Step S 42 the primary automatically-recognized nail contour L 1 , the adjusted nail contour RL and the border branch points DP are read out from the storage section 52 (Step S 42 ).
  • the nail contour recognizing section 512 detects the points (border branch points on the secondary automatically-recognized nail contour) on the secondary automatically-recognized nail contour which correspond to the border branch points DP of the primary automatically-recognized nail contour L 1 (Step S 43 ).
  • the nail contour recognizing section 512 sets one pair of the border branch points as the objects of border adjustment (Step S 44 ).
  • the nail contour recognizing section 512 detects the border corresponding to the adjusted nail contour RL on the secondary recognized nail contour, based on the one pair of the border branch points that has been set (Step S 45 ).
  • the nail contour recognizing section 512 reflects the detected border in the secondary automatically-recognized nail contour, namely performs border adjustment (Step S 46 ).
  • the nail contour recognizing section 512 judges whether or not adjustment of the border between each pair of all the border branch points has been completed (Step S 47 ).
  • Step S 47 When there are two or more sets of border branch points and border adjustment has not partially been completed (Step S 47 ; NO), next pair of border branch points, for which border adjustment has not been completed, is set as the object of border adjustment (Step S 48 ).
  • Step S 45 to Step S 48 are repeated until adjustment of the border between each pair of all the border branch points has been completed.
  • Step S 47 When it is judged that adjustment of the border between each pair of all the border branch points has been completed (Step S 47 ; YES), smoothing process to smoothly connect the adjusted border portion and the unadjusted border portion (portion left as the primary automatically-recognized nail contour L 1 ) is performed so that the border does not become unnatural.
  • the nail contour after adjustment is then set as the adjusted automatically-recognized nail contour (Step S 49 ).
  • the nail contour recognizing section 512 obtains the re-taken (secondary-photographed) nail image (secondary nail image) (Step S 51 ).
  • the nail contour recognizing section 512 reads out the adjusted nail contour RL from the adjusted nail contour memory 526 (Step S 52 ).
  • the nail contour recognizing section 512 then reads out the primary automatically-recognized nail contour L 1 from the primary automatically-recognized nail contour memory 525 (Step S 53 ).
  • the nail contour recognizing section 512 obtains the correction information such as an inclination deviation (angle deviation) and/or a size deviation (apparent size deviation due to a difference of distances from the camera 32 , image ratio deviation) between the print target finger U 1 at the time of obtaining the primary nail image and the print target finger U 1 at the time of obtaining the secondary nail image, from the data of the primary nail image and the data of the secondary nail image, and reflects the obtained correction information in the adjusted nail contour RL to correct the adjusted nail contour RL.
  • the correction information such as an inclination deviation (angle deviation) and/or a size deviation (apparent size deviation due to a difference of distances from the camera 32 , image ratio deviation) between the print target finger U 1 at the time of obtaining the primary nail image and the print target finger U 1 at the time of obtaining the secondary nail image, from the data of the primary nail image and the data of the secondary nail image, and reflects the obtained correction information in the adjusted nail contour RL to correct the adjusted nail contour RL.
  • the nail contour recognizing section 512 automatically recognizes the nail contour from the re-taken nail image (secondary nail image) while varying the detection threshold etc. (secondary automatic nail contour recognition), and sets the detection threshold etc. so that the automatically-recognized nail contour has the shape nearest the adjusted nail contour RL after the correction.
  • the nail contour recognizing section 512 obtains the re-taken (secondary-photographed) nail image (secondary nail image) (Step S 61 ).
  • the nail contour recognizing section 512 reads out the adjusted nail contour RL from the adjusted nail contour memory 526 (Step S 62 )
  • the primary automatically-recognized nail contour L 1 is then read out from the primary automatically-recognized nail contour memory 525 (Step S 63 ).
  • the nail contour recognizing section 512 automatically recognizes the nail contour (nail shape) based on the secondary nail image (Step S 64 ; secondary automatic nail contour recognition).
  • the nail contour recognizing section 512 obtains the correction information such as an inclination deviation (angle deviation) and/or a size deviation (apparent size deviation due to a difference of distances from the camera 32 , image ratio deviation) between the print target finger U 1 at the time of obtaining the primary nail image and the print target finger U 1 at the time of obtaining the secondary nail image, from the primary automatically-recognized nail contour L 1 and the secondary automatically-recognized nail contour (Step S 65 ).
  • the correction information such as an inclination deviation (angle deviation) and/or a size deviation (apparent size deviation due to a difference of distances from the camera 32 , image ratio deviation) between the print target finger U 1 at the time of obtaining the primary nail image and the print target finger U 1 at the time of obtaining the secondary nail image, from the primary automatically-recognized nail contour L 1 and the secondary automatically-recognized nail contour (Step S 65 ).
  • the adjusted nail contour RL after the correction is incorporated into the corresponding portion in the secondary automatically-recognized nail contour.
  • the adjusted automatically-recognized nail contour is obtained (Step S 67 ).
  • the display control section 515 causes the display section 13 to display the adjusted automatically-recognized nail contour which is the recognition result (Step S 11 ).
  • Step S 12 an inquiry is made to a user about whether or not the recognition result is appropriate.
  • the display section 13 displays not-illustrated OK button and NO button, and judgment is made as to whether or not any one of the buttons is operated.
  • Step S 12 When the NO button is operated (Step S 12 ; NO), the processing returns to Step S 7 again, and the above processes are repeated.
  • the control section 51 executes fitting of the nail design selected in Step S 1 to the recognized nail contour (Step S 13 ).
  • the print head 46 prints the nail design on the nail T (Step S 14 ).
  • the nail contour recognizing section 512 as the first nail contour recognizing section automatically recognizes the contour of the nail T of the print target finger U 1 inserted into the print target finger/toe insertion section 20 A. Then, in the case that the primary automatically-recognized nail contour L 1 as the result of automatic recognition is different from the print range intended by a user, the recognition result is adjusted in the state that the hand including the print target finger U 1 is drawn out of the nail printing device 1 .
  • the print target finger U 1 is inserted into the print target finger/toe insertion section 20 A again, and automatic recognition of the contour of the nail T of the print target finger U 1 is performed.
  • the adjustment result thus obtained can be reflected in the nail contour in which printing is to be performed.
  • the plurality of adjustment modes for adjusting at least a part of the contour of the nail T and the adjustment mode can be selected from among them.
  • the adjusted nail contour RL can be reflected in the recognition result obtained by performing the secondary automatic nail contour recognition to produce the adjusted automatically-recognized nail contour which is to be the final print region.
  • the embodiment includes the mode in which the nail contour adjusted by handwriting of a user is directly set as the adjusted nail contour RL.
  • the portion that is not recognized as the border in the automatic recognition can be recognized as the nail contour, and thereby the print range according to the intention of a user can be set.
  • the nail contour recognizing section 512 as the secondary nail contour recognizing section sets, as the adjusted automatically-recognized nail contour, the contour corresponding to the adjusted nail contour RL in the result of the automatic re-recognition (secondary automatic nail contour recognition) of the nail contour.
  • the plurality of border lines are recognized in the automatic recognition
  • the above embodiment describes the case that there are provided four adjustment modes, Mode 1 to Mode 4, as the nail contour adjustment modes, but the number of the adjustment modes included in the nail print device 1 is not limited to four as long as the plural adjustment modes are provided.
  • nail printing device 1 does not need to include all of the adjustment modes illustrated in the embodiment.
  • nail printing device 1 may include a larger number of adjustment modes than that of the embodiment.
  • the nail printing device 1 does not need to include all of the three method, or alternatively, may include another method(s) in addition the three method illustrated above.
  • the method of automatic recognition (primary automatic nail contour recognition and secondary automatic nail contour recognition) of the nail contour by the nail contour recognizing section 512 is not limited those illustrated above.
  • the nail T into some characteristic portions such as a tip portion, a base portion, a right portion, a left portion, an edge portion and other portions, to preciously store a typical shape in each of the portions of the nail T in the storage section 52 etc., and to recognize the border line nearest the typical nail contour of each of the regions as the nail contour when automatically recognizing the nail contour.
  • the shape like the nail T can be recognized as the nail contour more certainly.
  • the range in which the secondary automatic nail contour recognition is performed is not limited to the example illustrated in the above embodiment.
  • the adjusted automatic nail contour recognizing process is executed by any of the methods, it is possible to perform the automatic re-recognition with respect to only the portion (portion between a pair of border branch points DP) that has been adjusted in the nail contour adjusting process in the secondary automatic nail contour recognition.
  • the automatic re-recognition can be performed with respect to not only the portion adjusted in the nail contour adjusting process, but the entire nail T.
  • the embodiment describes the case that the primary automatically-recognized nail contour L 1 is displayed while being superposed on the primary nail image on the nail contour adjustment screen for adjusting the nail contour.
  • the nail contour adjustment screen is not limited to the examples illustrated herein.
  • the display screen of the nail contour adjustment screen just has to perform displaying so that a user can understand which of regions in the nail T has been recognized as the print target nail contour (i.e. which of the regions the nail design is to be printed in).
  • the display screen may display only the primary automatically-recognized nail contour L 1 , or display all of the border lines that have been recognized as the candidate nail contours as the result of the primary automatic nail contour recognition.
  • the above embodiment describes the example that the nail printing device 1 is equipped with the touch panel input section 122 integrated into the display section 13 so that inputting for nail contour adjustment can be performed by direct touch operations using the pen 123 etc.
  • the inputting method for nail contour adjustment is not limited to the above.
  • inputting for nail contour adjustment can be performed by using a pointing device such as a mouse while looking at the display screen of the display section 13 .
  • a pointing device such as a mouse
  • the storage section 52 includes the border branch point memory 527 that stores the border branch points DP, it is not essential to provide the border branch point memory 527 .
  • the adjusted nail contour RL and the border branch points DP corresponding to the starting and end points of the adjustment portion in the adjusted nail contour RL in the adjusted nail contour memory 526 , so that the adjusted nail contour RL and the border branch points DP correspond to each other.
  • the storage section 52 of the control device 50 includes the program memory 521 , the design data memory 522 , the adjustment mode table 523 , etc.
  • the program memory 521 , the design data memory 522 , the adjustment mode table 523 , etc. do not always need to be included in the storage section 52 (ROM, RAM) of the control device 50 , and it is also possible to provide a separate storage section.
  • the above embodiment describes the example of the nail printing device 1 which sequentially performs printing while the fingers are inserted into the device one by one, but the present invention can also be applied to the device that can perform printing with respect to four fingers concurrently.

Landscapes

  • Image Analysis (AREA)
US14/323,348 2013-07-05 2014-07-03 Nail printing device, print control method for nail printing device, and computer readable medium Active 2034-08-07 US9357825B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2013-141669 2013-07-05
JP2013141669A JP6268771B2 (ja) 2013-07-05 2013-07-05 ネイルプリント装置、ネイルプリント装置の印刷方法及びプログラム

Publications (2)

Publication Number Publication Date
US20150007841A1 US20150007841A1 (en) 2015-01-08
US9357825B2 true US9357825B2 (en) 2016-06-07

Family

ID=52131978

Family Applications (1)

Application Number Title Priority Date Filing Date
US14/323,348 Active 2034-08-07 US9357825B2 (en) 2013-07-05 2014-07-03 Nail printing device, print control method for nail printing device, and computer readable medium

Country Status (3)

Country Link
US (1) US9357825B2 (enExample)
JP (1) JP6268771B2 (enExample)
CN (1) CN104272921B (enExample)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150374092A1 (en) * 2014-06-30 2015-12-31 Casio Computer Co., Ltd. Drawing apparatus and control method of drawing apparatus
US20160052295A1 (en) * 2013-08-07 2016-02-25 Nailae Technology Limited Printing system and method for applying a design to at least one fingernail/toenail surface
US20160088918A1 (en) * 2014-09-26 2016-03-31 Casio Computer Co., Ltd. Nail printing apparatus, a controlling method of the nail printing apparatus and a computer readable storage medium
US20170215550A1 (en) * 2013-08-23 2017-08-03 Preemadonna Inc. Apparatus for applying coating to nails
US10878231B2 (en) 2018-05-10 2020-12-29 International Business Machines Corporation Writing recognition using wearable pressure sensing device
US10939738B2 (en) * 2019-02-26 2021-03-09 Elementree Inc. Automatic nail polish application system and method
US11058204B2 (en) 2019-10-29 2021-07-13 NailPro, Inc. Automated total nail care systems, devices and methods
US11103041B2 (en) 2017-10-04 2021-08-31 Preemadonna Inc. Systems and methods of adaptive nail printing and collaborative beauty platform hosting
US11170250B2 (en) 2017-09-27 2021-11-09 Casio Computer Co., Ltd. Nail contour detecting device, nail contour detecting method and storage medium
US11265444B2 (en) * 2013-08-23 2022-03-01 Preemadonna Inc. Apparatus for applying coating to nails

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104382327A (zh) * 2014-12-03 2015-03-04 曹乃承 美甲装置和美甲、健康管理、信息推送方法
JP6428411B2 (ja) * 2015-03-18 2018-11-28 カシオ計算機株式会社 描画装置及び爪傾き検出方法
JP6428415B2 (ja) * 2015-03-20 2018-11-28 カシオ計算機株式会社 描画装置及び爪形状検出方法
JP6554889B2 (ja) * 2015-04-15 2019-08-07 ブラザー工業株式会社 印刷データ作成装置及び印刷データ作成プログラム
JP6596979B2 (ja) * 2015-06-30 2019-10-30 カシオ計算機株式会社 描画装置及び描画装置の描画方法
JP6493198B2 (ja) * 2015-12-22 2019-04-03 カシオ計算機株式会社 描画装置及び描画装置の描画方法
JP6651874B2 (ja) * 2016-02-02 2020-02-19 カシオ計算機株式会社 描画装置及び描画装置の描画制御方法
JP6790513B2 (ja) * 2016-07-05 2020-11-25 カシオ計算機株式会社 描画装置及び描画装置の描画方法
EP3577034B1 (en) 2017-01-31 2023-08-02 Nailomatic Ltd. Brush integrated capsule with film-forming polymer for nail polishing
CA3051531A1 (en) 2017-01-31 2018-08-09 Nailomatic Ltd. A nail polish kit for use by an automated nail polish application apparatus
US11515019B2 (en) * 2017-06-21 2022-11-29 H3Alth Technologies Inc. System and method for manufacturing custom nails
JP7022299B2 (ja) * 2017-06-29 2022-02-18 カシオ計算機株式会社 ネイルプリント装置及びネイルプリント装置の制御方法
JP7294469B2 (ja) * 2017-06-29 2023-06-20 カシオ計算機株式会社 ネイルプリント装置、ネイルプリント装置の制御方法及びプログラム
US10293601B2 (en) * 2017-07-11 2019-05-21 The Boeing Company Automated controls for contoured surface inkjet printing
CN108749342A (zh) * 2018-06-05 2018-11-06 北京玲珑百秀贸易有限公司 一种美甲打印装置及方法
CN109272519B (zh) * 2018-09-03 2021-06-01 先临三维科技股份有限公司 指甲轮廓的确定方法、装置、存储介质及处理器
JP7135687B2 (ja) * 2018-10-03 2022-09-13 カシオ計算機株式会社 ハンディプリンタ、塗布システム、塗布方法及びプログラム
US11270453B2 (en) 2018-11-30 2022-03-08 Funai Electric Co., Ltd. Region detection device
CN109572239B (zh) * 2019-01-14 2022-01-18 深圳市邻友通科技发展有限公司 一种美甲装置的打印方法、系统、美甲设备和介质
US11064784B2 (en) 2019-01-14 2021-07-20 Shenzhen Danya Technology Co., Ltd. Printing method and system of a nail printing apparatus, and a medium thereof
US12172453B2 (en) * 2019-01-22 2024-12-24 Nailomatic Ltd. Nail polish application and solidification apparatus
JP7524566B2 (ja) * 2020-03-19 2024-07-30 カシオ計算機株式会社 印刷装置、印刷制御方法及びプログラム
KR102497411B1 (ko) * 2020-10-16 2023-02-10 주식회사 네일25 네일아트 서비스 제공 방법 및 네일아트 서비스 제공 시스템
CN113170966A (zh) * 2021-04-16 2021-07-27 宋彦震 基于人工智能的自适应电动磨甲器控制方法

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5931166A (en) * 1998-12-22 1999-08-03 Weber; Paul J. Fingernail decorating
US6286517B1 (en) * 1998-12-22 2001-09-11 Pearl Technology Holdings, Llc Fingernail and toenail decoration using ink jets
US6336694B1 (en) * 1997-12-24 2002-01-08 Jit Ceremony Co., Ltd. Nail art method and device
US20110315027A1 (en) * 2010-06-25 2011-12-29 Casio Computer Co., Ltd. Nail printing apparatus
US20120113171A1 (en) * 2010-11-04 2012-05-10 Casio Computer Co., Ltd. Nail print apparatus and print controlling method
US20120274683A1 (en) * 2011-04-28 2012-11-01 Casio Computer Co., Ltd. Print apparatus and print control method
US20120287183A1 (en) * 2011-05-09 2012-11-15 Casio Computer Co., Ltd. Nail printing device and printing control method thereof
US9139021B2 (en) * 2012-12-17 2015-09-22 Casio Computer Co., Ltd. Nail print apparatus and print method thereof

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101407137A (zh) * 2007-10-10 2009-04-15 金宝电子工业股份有限公司 指甲彩绘机
CN201208813Y (zh) * 2008-01-25 2009-03-18 罗春晖 美甲喷绘机
JP2012152410A (ja) * 2011-01-27 2012-08-16 Casio Computer Co Ltd ネイルプリント装置
JP2013074923A (ja) * 2011-09-29 2013-04-25 Casio Computer Co Ltd ネイルプリント装置及び印刷制御方法
JP5724802B2 (ja) * 2011-09-29 2015-05-27 カシオ計算機株式会社 ネイルプリント装置および印刷制御方法
JP2013094184A (ja) * 2011-10-28 2013-05-20 Casio Computer Co Ltd ネイルプリント装置

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6336694B1 (en) * 1997-12-24 2002-01-08 Jit Ceremony Co., Ltd. Nail art method and device
JP3370345B2 (ja) 1997-12-24 2003-01-27 株式会社ジットセレモニー ネイルアート方法及び装置
US5931166A (en) * 1998-12-22 1999-08-03 Weber; Paul J. Fingernail decorating
US6286517B1 (en) * 1998-12-22 2001-09-11 Pearl Technology Holdings, Llc Fingernail and toenail decoration using ink jets
US20110315027A1 (en) * 2010-06-25 2011-12-29 Casio Computer Co., Ltd. Nail printing apparatus
US20120113171A1 (en) * 2010-11-04 2012-05-10 Casio Computer Co., Ltd. Nail print apparatus and print controlling method
US20120274683A1 (en) * 2011-04-28 2012-11-01 Casio Computer Co., Ltd. Print apparatus and print control method
US20120287183A1 (en) * 2011-05-09 2012-11-15 Casio Computer Co., Ltd. Nail printing device and printing control method thereof
US9139021B2 (en) * 2012-12-17 2015-09-22 Casio Computer Co., Ltd. Nail print apparatus and print method thereof

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9475308B2 (en) * 2013-08-07 2016-10-25 Nailae Technology Limited Printing system and method for applying a design to at least one fingernail/toenail surface
US20160052295A1 (en) * 2013-08-07 2016-02-25 Nailae Technology Limited Printing system and method for applying a design to at least one fingernail/toenail surface
US9889692B2 (en) 2013-08-07 2018-02-13 Nailae Technology Limited System for applying a design on at least one nail surface
US11265444B2 (en) * 2013-08-23 2022-03-01 Preemadonna Inc. Apparatus for applying coating to nails
US11290615B2 (en) * 2013-08-23 2022-03-29 Preemadonna Inc. Systems and methods to initiate and perform the painting of an area of interest on a finger
US20240314253A1 (en) * 2013-08-23 2024-09-19 Preemadonna Inc. Apparatus for applying coating to nails
US20170215550A1 (en) * 2013-08-23 2017-08-03 Preemadonna Inc. Apparatus for applying coating to nails
US20220256054A1 (en) * 2013-08-23 2022-08-11 Preemadonna Inc. Systems and methods to initiate and perform the painting of an area of interest on a finger
US10470546B2 (en) 2013-08-23 2019-11-12 Preemadonna Inc. Systems, methods and apparatuses for decorating nails
US10477937B2 (en) 2013-08-23 2019-11-19 Preemadonna Inc. Systems and apparatuses to apply a material to a nail
US10653225B2 (en) * 2013-08-23 2020-05-19 Preemadonna Inc. Apparatus for applying coating to nails
US20220150381A1 (en) * 2013-08-23 2022-05-12 Preemadonna Inc. Apparatus for applying coating to nails
US11082582B2 (en) * 2013-08-23 2021-08-03 Preemadonna Inc. Systems and methods to initiate and perform the painting of an area of interest on a finger
US10972631B2 (en) * 2013-08-23 2021-04-06 Preemadonna, Inc. Apparatus for applying coating to nails
US20150374092A1 (en) * 2014-06-30 2015-12-31 Casio Computer Co., Ltd. Drawing apparatus and control method of drawing apparatus
US9462869B2 (en) * 2014-06-30 2016-10-11 Casio Computer Co., Ltd Drawing apparatus and control method of drawing apparatus
US20160088918A1 (en) * 2014-09-26 2016-03-31 Casio Computer Co., Ltd. Nail printing apparatus, a controlling method of the nail printing apparatus and a computer readable storage medium
US9510658B2 (en) * 2014-09-26 2016-12-06 Casio Computer Co., Ltd. Nail printing apparatus, a controlling method of the nail printing apparatus and a computer readable storage medium
US11170250B2 (en) 2017-09-27 2021-11-09 Casio Computer Co., Ltd. Nail contour detecting device, nail contour detecting method and storage medium
US11103041B2 (en) 2017-10-04 2021-08-31 Preemadonna Inc. Systems and methods of adaptive nail printing and collaborative beauty platform hosting
US11717070B2 (en) 2017-10-04 2023-08-08 Preemadonna Inc. Systems and methods of adaptive nail printing and collaborative beauty platform hosting
US10878231B2 (en) 2018-05-10 2020-12-29 International Business Machines Corporation Writing recognition using wearable pressure sensing device
US10939738B2 (en) * 2019-02-26 2021-03-09 Elementree Inc. Automatic nail polish application system and method
US11058204B2 (en) 2019-10-29 2021-07-13 NailPro, Inc. Automated total nail care systems, devices and methods

Also Published As

Publication number Publication date
CN104272921A (zh) 2015-01-14
JP2015013002A (ja) 2015-01-22
JP6268771B2 (ja) 2018-01-31
US20150007841A1 (en) 2015-01-08
CN104272921B (zh) 2016-05-18

Similar Documents

Publication Publication Date Title
US9357825B2 (en) Nail printing device, print control method for nail printing device, and computer readable medium
US9302499B2 (en) Nail print apparatus and printing method thereof
US9603431B2 (en) Nail design device, nail printing apparatus, nail design method, and computer-readable recording medium storing nail design program
US10696067B2 (en) Nail printing apparatus and control method
US8919903B2 (en) Nail printing device including printing head that performs printing on fingernail, and printing control method
JP6439342B2 (ja) 爪情報検出装置、描画装置及び爪情報検出方法
JP5601103B2 (ja) ネイルプリント装置及び印刷制御方法
CN103040227B (zh) 颜色修正印刷装置和印刷控制方法
US12043041B2 (en) Printing device, printing method, and storage medium
US11559995B2 (en) Printer and printing method
JP5928264B2 (ja) ネイルプリント装置及び印刷制御方法
JP7392696B2 (ja) 輪郭検出装置、印刷装置、輪郭検出方法及びプログラム
JP7521346B2 (ja) 印刷装置、印刷装置の制御方法及び制御プログラム
JP7294469B2 (ja) ネイルプリント装置、ネイルプリント装置の制御方法及びプログラム
JP7342564B2 (ja) 印刷装置、印刷システム、印刷方法及びプログラム

Legal Events

Date Code Title Description
AS Assignment

Owner name: CASIO COMPUTER CO., LTD, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:YAMASAKI, SHUICHI;REEL/FRAME:033239/0727

Effective date: 20140625

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8