TWI543726B - Automatic coloring system and method thereof - Google Patents

Description

Automatic coloring system and method thereof

The present invention relates to a coloring technique, and more particularly to an automatic coloring system for coloring three-dimensional objects and a method thereof.

Amy is a human nature, so all major manufacturers in the market have launched a variety of skin care products and cosmetics for consumers to buy. However, if you want to be able to draw your own makeup that suits you, you need to practice makeup techniques repeatedly, and you need to purchase a variety of cosmetics and makeup tools to draw different eyebrows, various eye lines, eyelashes, eyeliner, face makeup, lip makeup. , repair capacity and various color changes, but with the proficiency of makeup technology and a wide variety of cosmetics, often the effect of makeup and the effect expected by consumers have a certain degree of difference.

With the continuous evolution of information technology, research has been proposed to simulate a makeup or skin care product. The user can use the simulation device for the makeup or skin care product to simulate the makeup effect on the screen before the purchase, instead of the field trial makeup product, for example, US Patent Publication No. 2005/0135675A1. However, the effect of simulating make-up on this screen still depends on artificial makeup techniques to paint it on the face. However, the real effect of artificial makeup by the user is not necessarily equivalent to the effect of the simulation on the screen.

In one embodiment, an automatic coloring system is used to color a solid object. The automatic coloring system includes an automatic coloring machine, and the automatic coloring machine includes a first connecting interface, a feeding module, a moving module, at least one coloring tool, and a control unit. The feed module has at least one pigment. The coloring tool is disposed on the mobile module, and the control unit is electrically connected to the first connection interface, the feeding module and the moving module.

The first connection interface is for receiving a coloring program in a wireless or wired manner. Wherein, the coloring program has a plurality of coloring instructions sorted according to respective generation orders. The control unit sequentially executes the coloring instruction in the coloring process, and according to the coloring instruction executed, controls the feeding module to select at least one pigment and controls the moving module to move a coloring tool to apply the selected pigment to the three-dimensional On the object.

In some embodiments, the automatic coloring system can further include an electronic device, and the electronic device includes a processing unit, a user interface, and a second connection interface. The processing unit is electrically connected to the user interface and the second connection interface. The processing unit is configured to receive an appearance image of the three-dimensional object, and generate a contour image by feature analysis of the appearance image. The user interface is configured to display the contour image, and sequentially output at least one editing instruction for the contour image, so that the processing unit obtains the coloring program in response to the editing instruction. The coloring program is then output to the first connection interface in a wireless or wired manner by the second connection interface.

In some embodiments, the automatic coloring system further includes an image capturing module, and the image capturing module is configured to capture an appearance image of the three-dimensional object. The electronic device, the automatic coloring machine and the image capturing module may be devices that can be separated from each other. Alternatively, the image capture module can be built into an electronic device or an automatic color machine.

In an embodiment, the automatic coloring method includes receiving an appearance image of a three-dimensional object; generating a contour image by characteristic analysis of the appearance image; displaying the contour image on a user interface; and sequentially outputting by using the user interface At least one editing instruction of the contour image; obtaining a coloring program in response to at least one editing instruction; and wirelessly Or output the obtained color program to an automatic color machine in a wired manner. Wherein, the coloring program has a plurality of coloring instructions sorted according to respective generation orders.

In some embodiments, the auto-coloring method may further include sequentially executing the coloring instructions in the coloring program. The executing step of each coloring instruction includes controlling the feeding module of the automatic coloring machine to select at least one pigment according to the executed coloring instruction, and controlling the movement of the moving color module of the automatic coloring machine according to the executed coloring instruction. A coloring tool applies the selected pigment to the solid object.

In some embodiments, each coloring instruction includes one or more of the trajectory information represented by a two-dimensional coordinate.

In some embodiments, the contour image can be a stereoscopic image.

In summary, the automatic coloring system and method thereof according to the present invention are used to color three-dimensional objects. Here, the coloring design flow is executed by the electronic device to obtain a coloring program corresponding to the three-dimensional object. Wherein, the coloring program has a plurality of coloring instructions sorted according to respective generation orders. The coloring process is output from the electronic device to the automatic color machine by a detachable electrical connection of the connection interface. Then, the coloring instruction in the coloring program is directly executed by the automatic coloring machine. In other words, the automatic coloring system and method thereof according to the present invention have a detachable color design flow (executed by an electronic device) and a practical color flow (executed by an automatic color machine) so that the user can be anytime, anywhere. Pre-design and exchange of colored patterns. Moreover, the automatic coloring system and method thereof according to the present invention can provide a coloring program to an automatic coloring machine directly by an external device, contributing to simplifying the structure of the automatic coloring machine. In some embodiments, the automatic color machine performs the actual color flow more accurately by directly providing the trajectory information represented by the three-dimensional coordinates. In some embodiments, the color design is achieved by directly rendering a stereoscopic image. The coloring action in the process is closer to the actual color flow.

In the following terms, "first", "second", "third" and the like, are used to distinguish the elements referred to, rather than to rank or limit the differences of the elements referred to, and are not used Limit the scope of the invention.

Referring to Figures 1 through 4, the automatic coloring system 10 includes an electronic device 11 and an automatic color machine 12. The electronic device 11 can output a coloring program corresponding to the colored pattern of the three-dimensional object 14 to the automatic coloring machine 12, and then the automatic coloring machine 12 colors the three-dimensional object 14 by performing a coloring process. The electronic device 11 can be a portable electronic device, or a device such as a personal computer that can execute an application or an equivalent device thereof. The portable electronic device can be a smart phone, a notebook computer, a tablet computer or an equivalent device thereof. The three-dimensional object 14 may be a human body, a specific part of the human body (for example, a face, an eye, a nail, etc.), or an article (for example, a mask, a water cup, etc.).

The automatic coloring system 10 further includes an image capturing module 13. The image capturing module 13 is configured to capture the appearance image Pf of the three-dimensional object 14 . In some embodiments, the electronic device 11, the auto color machine 12, and the image capturing module 13 (eg, a digital camera or a network camera, etc.) may be separate devices. The detachable image capturing module 13 is, for example, a digital camera or a network camera. Preferably, the image capturing module 13 is an image capturing device capable of color photography. In some embodiments, the image capture module 13 can be built into the electronic device 11 (as shown in FIG. 2) or the automatic color printer 12 (as shown in FIG. 4).

Referring to FIGS. 2 and 3, the electronic device 11 includes a processing unit 110, a user interface 120, a connection interface 130, and a storage unit 140.

Referring to FIG. 4, the automatic coloring machine 12 includes a control unit 210, a connection interface 230, a supply module 240, a movement module 250, and at least one coloring tool 260, 262.

For the sake of clarity, the connection interface 230 of the automatic color printer 12 will be referred to as a first connection interface 230, and the connection interface 130 of the electronic device 11 will be referred to as a second connection interface 130.

Referring to FIGS. 2 and 3, the processing unit 110 is electrically connected to the user interface 120, the second connection interface 130, and the storage unit 140. The second connection interface 130 is configured to be electrically connected to the first connection interface 230 of the automatic color printer 12 in a wireless manner or in a wired manner. The electrical connection of the wired mode may be a direct connection (for example, the first connection interface 230 and the second connection interface 130 are physical connectors of the male and female respectively or their equivalent devices) or indirect connection (for example: via A connecting line 15 or its equivalent, etc.).

In some embodiments, referring to FIG. 2, the electronic device 11 may have an image capturing module 13 built therein, and the image capturing module 13 is electrically connected to the processing unit 110, as shown in FIG. The appearance image Pf captured by the image capturing module 13 can be transmitted to the processing unit 110 or stored in the storage unit 140 in advance.

In some embodiments, referring to FIG. 3, the electronic device 11 may further include another connection interface 132. For clarity of description, the connection interface 132 will hereinafter be referred to as a third connection interface 132.

The third connection interface 132 is electrically connected to the processing unit 110. The image capturing module 13 on the outside of the electronic device 11 is connected to the third connection interface 132 in a wireless manner, in a direct connection manner or via a connection line, so that the image capturing module 13 is connected via the third connection. The face 132 is electrically connected to the processing unit 110 as shown in FIG. At this time, the appearance image Pf captured by the image capturing module 13 can be transmitted to the processing unit 110 via the third connection interface 132. The image capturing module 13 can be a Charge Coupled Device (CCD), a Complementary Metal Oxide Semiconductor (CMOS) component, or other equivalent components. Preferably, the image capturing module 13 is an image capturing device capable of color photography.

In some embodiments, the user interface 120 can be a touch screen, a combination of a touch screen and at least one physical button, a combination of a screen and an input component (eg, a keyboard, a mouse, a tablet, or a combination thereof) or the like. Effective device, etc.

In the automatic color machine 12, referring to FIG. 4, the control unit 210 is electrically connected to the first connection interface 230, the supply module 240, and the movement module 250. The coloring tools 260, 262 are disposed on the mobile module 250. The feed module 240 has at least one pigment.

Hereinafter, the structure of the automatic coloring machine 12 will be exemplarily described in detail with the human face makeup as an example. In other words, in this example, the three-dimensional object 14 is the face of the user.

Referring to FIG. 5, the automatic coloring machine 12 may further include a machine 202 and a face positioning module 220. The control unit 210, the face positioning module 220, and the mobile module 250 are disposed on the machine 202.

The face positioning module 220 is provided corresponding to the mobile module 250. The face positioning module 220 is provided on the user's head to ensure the position of the face.

The face positioning module 220 includes a lower jaw bracket 221 and an overhead positioning member 222. The lower jaw bracket 221 is for the user to place the lower jaw to support the user's head (face). The head positioning member 222 is disposed above the lower jaw bracket 221. Here, the head positioning member 222 is slightly inverted U-shaped, and the upper middle portion is matched with the forehead of the face in an arc shape. Department 223. In use, the user can abut his forehead against the abutment portion 223 of the overhead positioning member 222 and abut the face chin against the lower jaw bracket 221 to ensure the position of the user's face relative to the moving module 250. .

The mobile module 250 includes a moving block 251, a lifter 252, a horizontal track 253, and a telescopic table 254. The horizontal track 253 is spanned over the lifter 252, and adjustment by the lifter 252 enables the horizontal track 253 to move up and down in a first direction (eg, the Y-axis direction). The telescopic table 254 is slidably disposed on the horizontal rail 253, and the telescopic table 254 is movable left and right on the horizontal rail 253 in the second direction (for example, the X-axis direction in the drawing). The moving block 251 is disposed on the telescopic table 254, and the moving block 251 can move back and forth on the telescopic table 254 in the third direction (e.g., the Z-axis direction in the drawing). Moreover, the motor controlled by the control unit 210 drives the moving block 251, the lifter 252, and the telescopic table 254 to cause the moving block 251 to move in three dimensions for precise positioning.

In this embodiment, the feeding module 240 controls the discharging and applying operations through the control unit 210. The feeding module 240 is disposed on the moving block 251 of the moving module 250. Various coloring materials are stored in the feeding module 240. The discharge opening of the supply module 240 appropriately connects the respective coloring tools 260, 262 and supplies the corresponding pigments to the coloring tools 260, 262. The coloring tools 260, 262 can be different ways of nozzles, nozzles or coated writing instruments.

When the coloring tool 260 is a nozzle, the feeding module 240 may have a supply cup and an air pressure tube. Pigments are stored in the supply cup. The air pressure pipe is connected to the air compressor to supply air to the discharge port, and the paint in the supply cup can be sucked in and discharged from the discharge port.

When the coloring tool 262 is a coating pen, the feeding module 240 can be designed to have a rotating wheel, and various rotating ports are provided in the wheel for the pigment to be outputted outward. among them, The discharge port is arranged on the circumference of the runner, and the different pigments can be changed via the rotary runner.

The combination of such diversified supply modules 240 facilitates automatic coating using different coloring tools 260, 262 or pigments.

A control module 204 can be disposed on the machine 202. The control module 204 has a control unit 210 and a first connection interface 230.

The first connection interface 230 receives a coloring program from the electronic device 11 in a wireless manner or in a wired manner, and transmits the received coloring program to the control unit 210 to sequentially execute the respective coloring instructions in the coloring program. In other words, the coloring program has a plurality of coloring instructions that are sorted according to the respective generation order. Each of the coloring instructions may include one of the trajectory information represented by the two-dimensional coordinates or one of the trajectory information represented by the three-dimensional coordinates.

In some embodiments, when each of the coloring instructions includes the trajectory information of the three-dimensional coordinate representation, the control unit 210 controls the movement of the movement module 250 based on the trajectory information in the currently executed coloring instruction to cause the moving block 251 to move to the positioning. .

In some embodiments, the auto color machine 12 may further include a ranging device 270 when the respective coloring instructions include trajectory information of the two-dimensional coordinates. The distance measuring device 270 is mounted on the moving block 251 of the mobile module 250. The distance measuring device 270 measures the position of the third direction upward to provide a position signal and a calibration signal, thereby converting the two-dimensional plane image into a three-dimensional image operation to ensure that the coloring tools 260, 262 are in safe contact with the user's face or Keep a safe distance from the face of the user.

The control unit 210 controls the movement of the movement module 250 based on the trajectory information in the coloring command currently executed, so that the moving block 251 drives the coloring tool to apply the selected pigment to the user's face. And, depending on the type of coloring tool chosen The position signal obtained by the class and distance measuring device 270, the control unit 210 controls the moving distance of the moving module 250 relative to the face to move the coloring tool by the moving block 251 to a position or contact with the face of the user who is in safe contact with the user. The position where the user's face maintains a safe distance.

In some embodiments, the ranging device 270 can be a laser range finder, a microwave range finder, an infrared range finder, an image capture module, or other equivalent ranging device.

In some embodiments, the three-dimensional object 14 can also be the eye of the user.

Referring to FIG. 6, for the automatic coloring machine 12 dedicated to the eye, the face positioning module 220 described above can be implemented by the eyecup to provide the user with the eye module corresponding to the moving module 250 of the automatic coloring machine 12. .

In some embodiments, the second connection interface 130 can be a wireless transceiver module, a Universal Serial Bus (USB), or an External Serial Advanced Technology Attachment (e-SATA) connector. The third connection interface 132 can be a wireless transceiver module, a Universal Serial Bus (USB) or an External Serial Advanced Technology Attachment (e-SATA) connector.

Among them, the wireless transceiver module can adopt various existing wireless communication technologies, such as: Bluetooth technology, Wireless Fidelity (WiFi) technology, Near Field Communication (Near Field Communication) technology, and the like.

In some embodiments, the pigment may be any one of a three-phase material such as a powder, a foam, a gel, a liquid, a paste, or the like, or a combination thereof, such as a sequin, a mist, or other special means. Pigments such as base makeup materials, concealer materials, eyebrow color materials, cheek color materials, lip makeup materials, decorative makeup materials, basic care materials, various inks, dyeing of various colors Materials and the like can be arbitrarily formulated.

The operation of the automatic coloring system 10 is described in detail below. Referring to Figures 1 through 8, a color application is stored in the storage unit 140.

The processing unit 110 displays a color editing window 121 on the user interface 120 by executing the coloring application (step S21). The color edit window 121 includes an image preview bar 122 and a design function bar 124. The design function bar 124 has an edit option 125, a return option 126, a clear option 127, a completion option 128, and an archive option 129. The edit option 125 has a tool option 1251 and a color wheel option 1252 as shown in FIG.

In some embodiments, tool option 1251 and color wheel option 1252 can be located in the same layer menu as shown in Figures 9 and 10A. In some embodiments, tool option 1251 and color wheel option 1252 can be located in different layer menus, as shown in FIG. 10B. For example, referring to FIG. 10B, tool option 1251 has a plurality of tool images A1, A2, and each tool image A1, A2 is connected to a color wheel option 1252. Whenever a tool image A1 is selected, the color application provides a color wheel option 1252 linked to the tool image A1 for the user to select. The color wheel option 1252 has a plurality of color images C1, C2 for the user to select.

The processing unit 110 can receive the appearance image Pf of the three-dimensional object 14 from the image capturing module 13 , read the stored appearance image Pf from the storage unit 140 , or receive the appearance image Pf from an external electronic device or storage device (step S23). ). In some embodiments, the appearance image Pf can be a planar analog image, that is, a 2D image having a three-dimensional object 14 in the image. In some embodiments, the appearance image Pf may also be a stereoscopic image, that is, a 3D model having a three-dimensional object 14 in the image.

Then, the processing unit 110 performs feature analysis on the received appearance image Pf to generate a contour image Pp (step S25). In some embodiments, the processing unit 110 can also read the stored contour image Pp directly from the storage unit 140 or receive the contour image Pp from an external electronic device or storage device. For example, the user can use the file option 129 to select the outline image Pp to be displayed in the image preview field 122.

The processing unit 110 then displays the contour image Pp in the image preview field 122 on the user interface 120 (step S27).

At this time, the user can perform the coloring design of the contour image Pp by using the editing option 125.

In the process of color design, the user can use the tool option 1251 to select the coloring tool to be used (ie, a tool image A1/A2 in the pointing tool option), and use the color wheel option 1252 to select the desired one. The color used (ie, one color image C1/C2 in the selection color palette option), and then a coloring action (ie, movement) is performed on the contour image Pp in the image preview column 122 with the selected coloring tool and color. The mouse simulates the coloration of the contour image Pp to apply the selected color on the contour image Pp.

Each time the user performs a coloring operation, the user interface 120 outputs an editing command in response to the user's coloring operation (step S29), so that the coloring application (ie, the processing unit 110) generates a response in response to the editing command. Coloring instructions. The coloring instruction indicates a tool information of the coloring tool selected by the user, a color information indicating a color selected by the user, and track information indicating a moving track of the coloring action of the pen.

In some embodiments, the trajectory information is composed of a plurality of consecutive locating points. Here, the start of the coloring operation corresponds to the first positioning point and the end of the coloring operation. Corresponding to the last positioning point, the moving process of the coloring action sequentially corresponds to the second positioning point to the penultimate positioning point. Among them, each positioning point can be a piece of standard data.

After the user performs multiple coloring operations, the user can click the completion option 128 to cause the user interface 120 to output a confirmation command. At this time, the color application (ie, the processing unit 110) sorts the plurality of coloring instructions corresponding to the plurality of coloring operations in the order of generation in response to the confirmation command, thereby generating a coloring program (step S31), and outputting the generated The coloring program is externally or stored to the storage unit 140 (step S33). In other words, the coloring program has a plurality of coloring instructions, and the coloring instructions are sorted according to respective generation orders (ie, the order in which the user performs multiple coloring actions).

Moreover, the coloring application (ie, processing unit 110) can also obtain a rendered pattern Pc in the contour image Pp in the image preview bar 122 in response to the confirmation command. In some embodiments, the processing unit 110 may store the colored pattern Pc and its corresponding coloring program in the storage unit 140 to form a pattern database. In other words, the coloring application can be paired with a pattern library. The pattern database is stored in the storage unit 140. The pattern database has one or more post-plotted patterns Pc stored in advance, and each post-plotted pattern Pc has a corresponding coloring program Sp. Therefore, the user can directly select the post-painted pattern Pc to be used from the pattern database by using the file option 129 for the next use, and display it in the image preview column 122 for the user to confirm.

Here, although the user designs and designs the post-painted pattern Pc as an example, it is not limited thereto. That is, referring to FIG. 11, when the user captures the appearance image Pf of the pre-colored three-dimensional object 14 (for example, face, eye or article, etc.), the second connection can be The interface 130 transmits the appearance image Pf or the contour image Pp to another electronic device 11' in a wireless manner, in a wired manner, or in other remote transmission modes. The second connection interface 130 can also be a telecommunications module to transmit the appearance image Pf as a multimedia message (MMS).

The designer then performs the coloring design of the contour image Pp on the electronic device 11', that is, the above-described steps S25 to S31 or the above-described steps S27 to S31. After the design is completed, the colored pattern Pc and the corresponding coloring program Sp are transmitted back to the user's electronic device 11 by the second connection interface 130 in a wireless manner or in a wired manner (step S33).

In some embodiments, referring to FIG. 12, the edit option 125 may have a more template option 1253. The template option 1253 has a plurality of template patterns E1, E2. Here, each of the template patterns E1 and E2 is a pre-edited stored pattern Pc pre-edited in the pattern database. That is, each of the stencil patterns E1 and E2 has a corresponding coloring program Sp, and the coloring program Sp is also stored in advance in the pattern database.

In other words, each time the edited finished pattern Pc and its corresponding color program can also be selected as a template, it becomes an option in the template option 1253. When the edited finished pattern Pc and its corresponding color program are stored as a template, the colored pattern Pc can be used as a template pattern. In some embodiments, each of the stencil patterns E1, E2 is a post-pigment pattern Pc, but is not limited to being represented (displayed) by the contour image Pp of the three-dimensional object 14. In other words, each of the stencil patterns E1, E2 is the result of presenting a color design.

When the user clicks one of the template patterns E1 in the template option 1253, the result of the color design represented by the template pattern E1 is applied to the contour image of the three-dimensional object 14. Pp (i.e., the image displayed in the image preview field 122) is used to obtain the final post-painted pattern Pc. At this time, the user interface 120 outputs an editing instruction of the corresponding template pattern E1 in response to the user's selection manipulation, thereby causing the coloring application to read the coloring program Sp corresponding to the template pattern E1 from the pattern database in response to the editing instruction. (Step S31), and the read color program Sp is output when the user clicks the completion option 128 (step S33).

In some embodiments, the coloring process described above is produced in the form of a script. An example of a coloring program in the form of a script is as follows:

<Color interface = skin> (that is, the type of the three-dimensional object 14 to be colored)

<Color pigment == No. 1 spray> (ie, the type of pigment)

<Color of spray color = A> (ie, type of coloring tool)

<spray color = red> (ie, the color of the pigment)

<System positioning point X, Y ratio X>

<Drawing point X.Y>

<Drawing line X0.Y0 X1, Y1>

<Screen X0.Y0 X1, Y1>

<drawing picture name>

<drawing text text name>

In some embodiments, the contour image Pp displayed in the image preview field 122 can be a planar analog image. In other words, the 2D image of the solid object 14 is present in the contour image Pp.

In some embodiments, the contour image Pp displayed in the image preview column 122 can be a stereo analog image. In other words, the 3D having the three-dimensional object 14 in the contour image Pp model. The implementation of stereoscopic analog images is well known to those skilled in the art and will not be described here.

Therefore, when the user performs a coloring operation on the stereoscopic image, each coloring motion can correspondingly generate one of the trajectory information represented by the three-dimensional coordinates. In other words, each anchor point in the trajectory information is a three-dimensional coordinate data.

Referring to FIG. 13 , when the user actually performs facial makeup, the user can connect the electronic device 11 with the automatic color machine 12 , that is, electrically connect the first connection interface 230 of the automatic color printer 12 to the electronic device. The second connection interface 130 of 11 (step S41).

After the connection is completed, the user can control the electronic device 11 to cause the processing unit 110 to output a coloring program to the automatic color machine 12. In other words, the automatic color printer 12 receives the coloring program transmitted through the first connection interface 230 in a wireless or wired manner (for example, via the connection line 15 or by a physical connector, etc.) (step S43).

Then, the automatic coloring machine 12 applies makeup to the user's face based on the execution of the coloring program. Here, the control unit 210 of the automatic coloring machine 12 sequentially executes each coloring instruction in the coloring program.

The control unit 210 controls the feeding module 240 to select the pigment of the color information in the corresponding coloring instruction according to the executed coloring instruction (step S45), and controls the movement module 250 to select the corresponding one according to the executed coloring instruction. One of the tool information coloring tools in the color command (step S47). The execution order of step S45 and step S47 is not limited by the present invention, that is, step S45 and step S47 may be performed simultaneously, or step S45 may be performed after step S47 is performed, except that step S45 and step S47 are sequentially performed.

In step S45, the color specified by the color information may be provided by the feeding module 240. One of a variety of pigments. Furthermore, the color specified by the color information may not exist in the plurality of colors of the supply module 240. At this time, the feeding module 240 selects two or more pigments from a plurality of pigments according to the color specified by the color information to formulate the desired pigment (ie, the color specified by the color information). In other words, the automatic color machine 12 can have a storage unit and a color database is built in the storage unit. The color database has a variety of colors and their corresponding blending methods (for example: blending the required pigments and their proportions).

Then, the control unit 210 moves the moving module 250 according to the trajectory information in the executed coloring instruction, and applies the selected pigment to the user's face (the three-dimensional object 14) with the selected coloring tool ( Step S49).

In some embodiments, when the trajectory information is represented by a two-dimensional coordinate, the control unit 210 performs movement in the first direction and the second direction of the mobile module 250 according to each of the trajectory information to move to the corresponding The fixed point position. And, during the moving process of each positioning point or moving to the fixed point position, the control unit 210 receives the position signal from the ranging device 270 to control the movement of the mobile module 250 relative to the face (ie, the movement in the third direction), The coloring tool is positioned in a position where the pigment can be safely applied to the face of the user. Here, the first direction, the second direction, and the third direction are respectively the Y axis, the X axis, and the Z axis of the moving coordinate system of the moving module 250.

After executing a coloring instruction (ie, after completing a coloring operation), the control unit 210 continues to execute the next coloring instruction until all the coloring instructions are executed (step S51).

In some embodiments, the coloring application has a label conversion step such that the image coordinate system of the contour image Pp corresponds to the movement coordinates of the movement module 250. system.

In some embodiments, the coordinate system conversion step may utilize features or edges obtained in the feature analysis step (step S25) as corresponding points such that the image coordinate system of the contour image Pp corresponds to the moving coordinate system of the mobile module 250. That is, the contour image Pp is mapped to the position where the solid object 14 is actually positioned in the moving coordinate system of the moving module 250.

In some embodiments, the coordinate system conversion step can be implemented using a proportional object of known actual size.

When the user captures the appearance image Pf of the three-dimensional object 14 by using the image capturing module 13, the scale object is simultaneously placed into the mirror. In other words, the image capturing module 13 captures the image Pf of the image having the three-dimensional object 14 and the image of the proportional object. The scale between the image coordinate system of the contour image Pp and the moving coordinate system of the movement module 250 is calculated from the image size of the proportional object in the known actual size and appearance image Pf. The contour image Pp is then mapped to the position of the solid object 14 in the moving coordinate system of the mobile module 250 by using the feature or edge obtained in the feature analysis step (step S25) as the corresponding point and the calculated scale.

In some embodiments, the coordinate system conversion step can be implemented by using the imaging parameters of the image capture module 13 (eg, the focal length of the lens, the format of the image, etc.) and the specifications of the screen in the user interface 120. The color application can calculate the scale between the image size of the contour image Pp and the actual size of the corresponding three-dimensional object 14 according to the imaging parameters of the image capturing module 13 and the screen size of the user interface 120. The contour image Pp is then mapped to the position of the solid object 14 in the moving coordinate system of the mobile module 250 by using the feature or edge obtained in the feature analysis step (step S25) as the corresponding point and the calculated scale.

After the coordinate system conversion step is completed, the coloring action applied to the contour image Pp on the user interface 120 can cause the coloring application to generate corresponding trajectory information based on the moving coordinate system of the mobile module 250.

In some embodiments, the coloring application can be implemented by a computer program product such that when the computer (ie, the electronic device described above) is loaded into the coloring application and executed, the automated application can be performed in accordance with any embodiment of the present invention. Color method. In some embodiments, the computer program product can be a readable recording medium, and the color application is stored in a readable recording medium for loading by a computer. In some embodiments, the coloring application itself can be a computer program product and transmitted to the computer via wire or wireless.

In summary, the automatic coloring system and method thereof according to the present invention have a detachable color design flow (executed by an electronic device) and a practical color flow (executed by an automatic color machine) so that the user can access the user anytime, anywhere. Pre-designed and communicated after painting. Moreover, the automatic coloring system and method thereof according to the present invention can provide a coloring program to an automatic coloring machine directly by an external device, contributing to simplifying the structure of the automatic coloring machine. For example, the control unit of the automatic coloring machine does not require powerful processing functions, for example, it can be implemented by a microcontroller, or the automatic coloring machine does not need to set an image capturing module. In some embodiments, the automatic color machine performs the actual color flow more accurately by directly providing the trajectory information represented by the three-dimensional coordinates. In some embodiments, the coloring motion in the coloring design flow is closer to the actual color flow by directly rendering the stereoscopic image.

The present invention has been disclosed in the foregoing embodiments, and is not intended to limit the scope of the present invention. The scope of patent protection of the present invention is defined by the scope of the appended claims.

10‧‧‧Automatic coloring system

11‧‧‧Electronic devices

11’‧‧‧Electronic devices

12‧‧‧Automatic coloring machine

13‧‧‧Image capture module

14‧‧‧Three-dimensional objects

15‧‧‧Connecting line

110‧‧‧Processing unit

120‧‧‧User interface

121‧‧‧Color editing window

122‧‧‧Image preview bar

124‧‧‧Design function bar

125‧‧‧Editing options

1251‧‧‧Tool Options

1252‧‧‧Color wheel options

1253‧‧‧Template options

126‧‧‧ return options

127‧‧‧Clear option

128‧‧‧Completion options

129‧‧‧File Options

130‧‧‧Connection interface

132‧‧‧Connection interface

140‧‧‧ storage unit

202‧‧‧ machine

204‧‧‧Control Module

210‧‧‧Control unit

220‧‧‧Face positioning module

221‧‧‧ download bracket

222‧‧‧Top positioning parts

230‧‧‧Connection interface

240‧‧‧Feed module

250‧‧‧Mobile Module

251‧‧‧moving block

252‧‧‧ Lifter

253‧‧‧ horizontal orbit

254‧‧‧ Telescopic table

260‧‧‧Coloring tools

262‧‧‧Coloring tools

270‧‧‧Ranging device

A1‧‧‧Tool image

A2‧‧‧Tool image

C1‧‧‧ color image

C2‧‧‧ color image

E1‧‧‧ template pattern

E2‧‧‧ template pattern

Pc‧‧‧Digital pattern

Pf‧‧‧ Appearance image

Pp‧‧‧ contour image

Sp‧‧‧Coloring program

Fig. 1 is a schematic block diagram of an automatic coloring system according to a first embodiment of the present invention.

Fig. 2 is a schematic block diagram of an electronic device according to a first embodiment of the present invention.

Fig. 3 is a schematic block diagram of an electronic device according to a first embodiment of the present invention.

Figure 4 is a schematic block diagram of an automatic coloring machine in accordance with a first embodiment of the present invention.

Figure 5 is a schematic illustration of an automatic coloring system in accordance with a second embodiment of the present invention.

Figure 6 is a schematic view of an automatic coloring system in accordance with a third embodiment of the present invention.

Fig. 7 is a flow chart showing an automatic coloring method according to the first embodiment of the present invention.

Figure 8 is a schematic illustration of the user interface of an embodiment.

Figure 9 is a schematic illustration of the tool options of an embodiment.

Fig. 10A is a schematic view of the color wheel option of the first embodiment.

Figure 10B is a schematic illustration of the color wheel option of the second embodiment.

Figure 11 is a schematic view of an automatic coloring system in accordance with a fourth embodiment of the present invention.

Figure 12 is a schematic illustration of a template option of an embodiment.

Figure 13 is a flow chart showing an automatic coloring method according to a second embodiment of the present invention.

10‧‧‧Automatic coloring system

11‧‧‧Electronic devices

12‧‧‧Automatic coloring machine

13‧‧‧Image capture module

14‧‧‧Three-dimensional objects

Sp‧‧‧Coloring program

Pf‧‧‧ Appearance image

Claims (19)

An automatic coloring system for coloring a three-dimensional object, the automatic coloring system comprising: an automatic coloring machine comprising: a first connection interface for receiving a coloring program in a wireless or wired manner, wherein The coloring program has a plurality of coloring instructions; a feeding module having at least one pigment; a moving module; at least one coloring tool disposed on the moving module; and a control unit electrically connecting the The first connection interface, the feeding module and the moving module sequentially execute the coloring instructions in the coloring process, and control the feeding module to select the at least according to the coloring instruction executed One of a pigment and one of the at least one coloring tool for controlling the movement of the moving module to apply the selected pigment to the three-dimensional object; and an electronic device comprising: a processing unit for receiving the three-dimensional object An appearance image is generated by the feature analysis of the appearance image to generate a contour image; a user interface is electrically connected to the processing unit to display the contour image and output a plurality of editing instructions, wherein the editing Representing a plurality of coloring operations performed on the contour image, respectively, and the processing unit respectively generating the coloring instructions in response to the editing instructions, and sorting the execution orders of the coloring operations corresponding to the coloring instructions Generating the coloring program to generate the coloring program; A second connection interface is electrically connected to the processing unit to output the coloring program to the first connection interface in a wireless or wired manner. The automatic coloring system of claim 1, wherein each of the coloring instructions comprises one of two-dimensional coordinates indicating track information, and the control unit controls the movement of the moving module according to the track information. The automatic coloring system of claim 1, wherein each of the coloring instructions comprises one of three-dimensional coordinates indicating track information, and the control unit controls movement of the moving module according to the track information. The automatic coloring system of claim 1, further comprising: an image capturing module for capturing the appearance image of the three-dimensional object; wherein the electronic device further comprises: a third connection interface, electrical Connecting the second connection interface, wherein the image capture module is connected to the second connection interface in a wireless or wired manner, so that the processing unit receives the image capture mode from the second connection interface and the third connection interface. The appearance image of the group. The automatic coloring system of claim 1, wherein the automatic coloring machine further comprises: an image capturing module electrically connected to the first connection interface to capture the appearance image of the three-dimensional object and The first connection interface and the second connection interface are transmitted to the processing unit. The automatic coloring system of claim 1, wherein the electronic device further comprises: an image capturing module electrically connected to the processing unit to capture the appearance image of the three-dimensional object. An automatic coloring system according to any one of claims 4-6, wherein the processing unit And further performing coordinate conversion by using the image capturing parameter of the image capturing module and the display specification of the contour image in the user interface, so as to convert the coordinates of the contour image into coordinates for moving the moving module, thereby obtaining each A track information in the color command. The automatic coloring system of claim 1, wherein the contour image is a stereoscopic image. The automatic coloring system of claim 1, wherein the at least one editing instruction is plural and respectively corresponds to the coloring instructions. An automatic coloring method includes: receiving, by an electronic device, an appearance image of a three-dimensional object; using the electronic device to generate a contour image by characteristic analysis of the appearance image; displaying the contour image in a user of the electronic device a plurality of editing commands for the contour image are outputted through the user interface, wherein the editing commands respectively represent a plurality of coloring operations performed on the contour image; and generating a plurality of coloring commands in response to the editing commands; Using the electronic device to sort the coloring instructions in the execution order of the coloring operations corresponding to the coloring instructions to generate a coloring program, wherein the coloring program has the coloring instructions; wireless or wired Receiving the coloring program obtained from the output of the electronic device to an automatic coloring machine; receiving the coloring program by the automatic coloring machine; The coloring instructions in the coloring process are sequentially executed by the automatic coloring machine, wherein the performing step of each of the coloring instructions comprises: controlling a supply of the automatic coloring machine according to the executed coloring instruction The material module selects at least one pigment; and controls a moving module of the automatic color machine to move a coloring tool according to the coloring instruction executed to apply the selected pigment to the three-dimensional object. The automatic coloring method of claim 10, wherein each of the coloring instructions includes one of the trajectory information represented by a two-dimensional coordinate. The automatic coloring method of claim 10, wherein each of the coloring instructions includes one of the trajectory information represented by a three-dimensional coordinate. The automatic coloring method according to claim 11 or 12, further comprising: performing coordinate coordinate conversion by using the imaging parameter used in the contour image capturing and the display specification of the contour image in the user interface to The coordinates of the image are converted into coordinates of a moving module of the moving one automatic coloring machine, thereby obtaining the trajectory information of each coloring instruction. The automatic coloring method of claim 10, wherein each of the coloring instructions includes one of two-dimensional coordinates indicating trajectory information, and the controlling step of the moving module comprises: controlling movement of the moving module according to the trajectory information . The automatic coloring method of claim 10, wherein each of the coloring instructions includes one of three-dimensional coordinates indicating trajectory information, and the controlling step of the moving module comprises: controlling movement of the moving module according to the track information. The automatic coloring method of claim 10, further comprising: capturing the appearance image of the three-dimensional object. The automatic coloring method of claim 10, wherein the contour image is a stereo analog image. The automatic coloring method of claim 10, wherein the at least one editing instruction is plural and respectively corresponds to the coloring instructions. A computer program product, which is capable of implementing the automatic coloring method according to any one of claims 10-13 and 16-18, after the program is loaded and executed by a computer.