TWM523140U - System and server for manufacturing figurines - Google Patents

Abstract

A system for manufacturing figurines is disclosed. The system includes at least a communication device, a three-dimensional printer and a server. The communication device and the three-dimensional printer are communicated to the server respectively. The server receives at least two image data from the communication device. Each of the image data includes a real person image and the real person images are stereoscopic. The server generates a three-dimensional model data in accordance with the two image data. The three-dimensional printer prints out a figurine in accordance with the three-dimensional model data from the server. The present invention discloses a server for manufacturing figurines as well.

Description

System and server for making humanoid dolls

This creation is about a system and server for making humanoid dolls.

The humanoid doll, also known as the Figurines, is loved by many people because it has the look and shape of a specific character. The humanoid dolls are derived from physical products based on the image of European and American or Japanese cartoon characters, and a small number of original characters.

As the technology for making humanoid dolls is more sophisticated and more popular, it is also possible to customize the real dolls for real people. Since then, the doll culture has not only satisfied the collectors’ preference for the virtual characters, but also as a general person. Project a choice of emotion in the real world. Therefore, there is a growing demand for making commemorative or imaginative dolls, such as wedding anniversaries, real dolls, or real dolls wearing various role-playing costumes.

However, the current humanoid dolls and real people still have a lot of room for improvement, mainly because the production of humanoid dolls in the past is based on the general body, through the designer's carving skills to capture the charm and costume of real people. The details are based on the personal skills of the designer and the quality is not stable enough. In this process, even if the designer can use computer image assist to improve the similarity, but the quality of the finished product is ultimately limited by the performance of the designer, so that the lack of predictability, resulting in the delivery of the finished product, many clients because I am looking forward to a big gap and a dispute with the designer. In addition, the quality of the finished product is only after the production is completed. Even if the designer wants to improve the quality, the choice is only made once again, and the time and material cost are very considerable. Moreover, even in the case of designer works with very high similarity, the production time spent in the middle is as long as one to several months, which often makes the client feel anxious.

Therefore, how to solve the problem that the similarity of humanoid dolls is limited, the production process relies too much on manual techniques, and the average time and material cost are too high, there is a need to propose a solution.

The purpose of the present invention is to provide a system and server for making a humanoid doll, and the server receives at least two parallel images with parallax from the communication device through a communication connection between the communication device, the three-dimensional printing device and the server. The image data is used to generate the 3D model data and then transmitted to the 3D printing device for printing. Since the 3D model data is generated according to the real human image processing, it has a high degree of similarity with the real person, and the 3D printing can precisely control the characteristics. The resulting humanoid dolls are much more realistic than the traditional production methods. And because the 3D model data can be displayed, if there is a dissimilarity, a new 3D model can be regenerated, giving the customer or the operator the possibility of timely adjustment. In addition, because the data transmission is carried out through the network, it is easy to connect services at different locations and provide products to customers more quickly.

In the present creation, the human figure is not necessarily included in the whole body shape, but may be included in at least a part. Of course, in the present embodiment, the human shape preferably includes a head, and another implementation in the present creation. In the case, the human form includes the head, and the body shape and accessories. In different embodiments of the present creation, the humanoid doll may be a doll having the same or similar proportion to the face and body shape of the real person, but not limited thereto, and the proportions of other faces and body shapes may be changed but still can be seen with the charm of the real person. Similar dolls are also a type of humanoid doll, such as a big-headed doll with a slightly larger head proportion and a deliberately smaller body proportion.

To achieve the above object, a system for producing a humanoid doll according to the present invention includes at least one communication device, a three-dimensional printing device, and a server. The server is respectively connected to the communication device and the three-dimensional printing device. The server receives at least the image data from the communication device, and the image data each has a live image, and the difference between the live images is different. The server generates a three-dimensional model data according to the image data. The server transmits the 3D model data to the 3D printing device to print the humanoid doll.

In order to achieve the above object, a server for making a humanoid doll according to the present invention is respectively connected to a communication device and a three-dimensional printing device. The server includes a communication module and a processing module. The processing module is electrically connected to the communication module. The communication module receives at least the image data from the communication device, and the image data each has a live image, and the difference between the live images is different. The processing module generates a three-dimensional model data according to the image data. The communication module transmits the three-dimensional model data to the three-dimensional printing device to print the humanoid doll.

In one embodiment, at least the image data is obtained from a video material. In more detail, the communication module of the server receives a video data, and the processing module obtains at least the image data after capturing the video data.

In one embodiment, the film material includes a movie recorded during a time moving around the real person.

In one embodiment, the movie is recorded by a communication device. The communication device can be any device with camera or photography functions and communication functions, such as but not limited to smart phones, tablets, mobile digital assistants, cameras or cameras, wearable devices, notebook computers, photo booths or Big head sticker machine.

In an embodiment, different live images in the image data have horizontal parallax or vertical parallax.

1‧‧‧ system
2‧‧‧Communication device
3‧‧‧Server
4‧‧‧3D printing device
5‧‧‧Mobile platform
21‧‧‧Image capture unit
22‧‧‧ storage unit
31‧‧‧Communication module
32‧‧‧ storage module
33‧‧‧Processing module
51‧‧‧Fixed unit
52‧‧‧ Track
F1～F7‧‧‧Face feature points
IC1, IC2‧‧‧ icon
IM1, IM2‧‧‧ live images
L1～L6‧‧‧ contour
UI‧‧‧User interface

FIG. 1 is a schematic diagram of a system architecture of an embodiment of a system for creating a humanoid doll.
FIG. 2 is a schematic diagram of a display when a user operates a mobile device application (abbreviated as APP) on a communication device according to an embodiment of the present invention.
FIG. 3A is a schematic diagram showing the display of a real-time image by a communication device according to an embodiment of the present invention.
FIG. 3B is a schematic diagram showing the display of another live-action image by the communication device according to an embodiment of the present invention.
4A and 4B are schematic diagrams showing facial feature points and contour lines after being analyzed and labeled in FIGS. 3A and 3B, respectively.
FIG. 5 is a schematic diagram of a texture image generated by synthesizing a real person image in an embodiment of the present invention.
FIG. 6 is a schematic diagram of a three-dimensional printing model corresponding to a real person's head in an embodiment of the present invention.
FIG. 7 is a schematic diagram of a communication device mounted on a mobile platform according to another embodiment of the present invention.

Hereinafter, a system and a server for producing a humanoid doll according to a preferred embodiment of the present invention will be described with reference to the related drawings.

FIG. 1 is a schematic diagram of a system architecture of an embodiment of a system for creating a humanoid doll. As shown in FIG. 1, the system 1 of the present embodiment includes at least one communication device 2, a server 3, and a three-dimensional printing device 4. Preferably, system 1 can include a plurality of communication devices 2 simultaneously for operation by different users. If desired, the system 1 can also include a plurality of three-dimensional printing devices 4 to increase the speed of production, such as making a plurality of identical humanoid dolls at the same time, or separately making different parts of the same humanoid doll.

The communication device 2 can be any device having a photographing or photographing function and a communication function, such as but not limited to a smart phone, a tablet computer, a mobile digital assistant, a networked camera or video recorder, a wearable device, a notebook computer, and a photo camera. Photo booth or photo sticker machine. In the present embodiment, the communication device 2 is described by taking a smart phone as an example, and is connected to the server 3 via the Internet via wireless communication such as 3G, 4G or Wi-Fi.

The communication device 2 includes an image capturing unit 21 and a storage unit 22. The image capturing unit 21 can take photos or record video, and the storage unit 22 can store image data or video data generated after taking a picture or video.

The server 3 includes a communication module 31, a storage module 32, and a processing module 33. The communication module 31 and the storage module 32 are respectively connected to the processing module 33. In the following embodiments, the server 3 performs data calculation according to the program instructions by the processing module 33, and controls the communication module 31 to transmit and receive data, and stores the data required for processing from the storage module 32. . The communication module 31 can be, for example but not limited to, an Ethernet interface; the storage module 32 can be a single hard disk or multiple hard disks connected through a network; the processing module 33 can include one or more central processing (CPU). The server 3 uses the communication module 31 of the Ethernet interface to communicate with the three-dimensional printing device 4 through the network.

The three-dimensional printing apparatus 4 can read data in a format such as .STL or .OBJ, and produce a three-dimensional object by, for example, fused deposition molding. The data suitable for reading by the three-dimensional printing device 4 is converted from the three-dimensional printing model data, and the data format of the three-dimensional printing model may be, for example but not limited to, .skp, .dae or .3ds. Of course, the printing technique of the three-dimensional printing apparatus 4 is not limited to one of fused deposition molding, and others include photopolymerization techniques such as stereolithography, or selective thermal sintering techniques applied to thermoplastic particulate materials, or laser engraving techniques. The three-dimensional printing device 4 also has a communication module, such as an Ethernet interface or a Wi-Fi network interface, for communicating with the server 3, and receiving three-dimensional printing model data before or after conversion from the server 3. .

FIG. 2 is a schematic diagram of a display when a user operates a mobile device application (abbreviated as APP) on a communication device according to an embodiment of the present invention. Referring to FIG. 2, the user first downloads a dedicated APP. After the application is launched, the user can provide a user interface UI to guide the user through the steps required to make a humanoid doll. After the APP is activated, the icon (IC) IC1 is clicked, and the communication device 2 turns on the image capturing unit 21, for example, a camera module, for the user to prepare for shooting. Because the humanoid doll is made, the user takes the image capturing unit 21 to the real person to be photographed, usually the user himself. Of course, in other embodiments, the user may also perform shooting on other people to make a humanoid doll of another person. In this embodiment, the user interface UI also has a video IC2, which can also be used to obtain a live-action image, which is described in detail later.

FIG. 3A is a schematic diagram showing the display of a real-time image by a communication device according to an embodiment of the present invention. Please refer to FIG. 3A. Since the humanoid doll is similar to the real person, it is largely determined by the degree of similarity of the face. In this embodiment, the humanoid doll with a similar head is targeted, so the live image IM1 produced by the photograph is taken. Includes the front of the head to provide a better reference for subsequent 3D printing models. More preferably, the live-action IM1 has a neutral expression, that is, an expression that the eyes naturally open, the front of the eye, and the mouth of the mouth.

In the embodiment, the three-dimensional printing model is required to have at least two live images including the same features, and the two human images have parallax between them. FIG. 3B is a schematic diagram showing the display of another live-action image by the communication device according to an embodiment of the present invention. As shown in FIG. 3B, the live image IM2 produced by the photograph also includes the face part, and also has facial features such as eyes, eyebrows, nose and lips, but compared with the live image IM1, the live image IM2 has a horizontal direction of forty degrees. Parallax. And preferably, the parallax is a horizontal parallax (that is, there is no difference in the vertical angle, and the difference between the two images is only caused by the horizontal translation), and the stereoscopic effect is simulated by simulating binocular disparity. Of course, in other embodiments, the parallax may also be a vertical parallax, which may also produce a binocular parallax effect; in other embodiments, the parallax includes both horizontal and vertical parallax. In this embodiment, the parallax is generated by taking a second live image IM2 after the first object image IM1 is taken, and the subject (subject) is rotated forty degrees in the original position, because the communication device 2 It is a smart phone. If the mobile communication device 2 is used for shooting, it is easy to generate other error factors other than parallax, such as vertical movement or hand vibration, which affects the quality of the subsequent three-dimensional printing model.

The two live images IM1 and IM2 captured can be stored in the storage unit 22 of the communication device 2. When the user wants to proceed to the next step, the APP operation interface can be clicked, and the two live images IM1 and IM2 are sent to the server 3 as a piece of image data. The storage module 32 of the server 3 stores a software program for generating a stereoscopic model of a planar image based on the stereoscopic method.

Specifically, first, the processing module 33 executes the instruction of the software program, and the two live images IM1 and IM2 are overlapped by a picture pixel matching analysis technique. When the communication device 2 shoots, the APP limits the focal length. The spacing between the second shots can be calculated by the motion sensor, or according to the built-in limitation of the APP. Therefore, the processing module 33 can calculate the depth value of the image when the images overlap and the focal length and spacing are known. Then, the processing module 33 executes the instruction of the software program, and uses the motion estimation structure (SfM) technology to calculate the point cloud data from the two real-life images IM1 and IM2 and the generated depth values. ).

Thereafter, the processing module 33 registers the 3D morphable model to the point cloud data to obtain a three-dimensional geometric model that substantially conforms to the facial features of the human face. 4A and 4B are schematic diagrams showing the facial feature points F1 to F7 and the contour lines L1 to L6 after being analyzed and labeled in FIGS. 3A and 3B, respectively. Please refer to FIG. 4A and FIG. 4B at the same time. In detail, the registration process is first performed by the processing module 33 executing the software program command to analyze the point cloud data and the two live images IM1 and IM2, and obtain the point cloud data respectively. A plurality of facial feature points F1 to F7 in the live images IM1 and IM2. The facial feature points F1 to F7 preferably include a binocular corner, a two-sided corner, and a tip of the nose. In addition, in order to enhance the similarity, it is also possible to manually mark a plurality of sets of contour lines L1 to L6, such as a face shape, an eye shape, an eye circumference, and a lip contour. The processing module 33 uses the obtained facial feature points F1 to F7 and the contour lines L1 to L6 as deformation parameters, and corrects the corresponding facial feature points F1 to F7 and the contour lines L1 to L6 in the three-dimensional variable model to obtain a three-dimensional geometric model. . The position and number of the facial feature points F1 to F7 and the contour lines L1 to L6 are only used as an example and are not limited thereto.

FIG. 5 is a schematic diagram of a texture image generated by synthesizing a real person image in an embodiment of the present invention. Referring to FIG. 5, the processing unit 33 separately separates the faces of the live images IM1 and IM2 from the image data, and synthesizes them into a seamless texture image, and then according to the two live images IM1. The projection relationship between IM2 and the 3D geometric model maps the texture image to the 3D geometric model to obtain the data of the 3D printing model. FIG. 6 is a schematic diagram of a three-dimensional printing model corresponding to a real person's head in an embodiment of the present invention. The processing module 33 then stores the three-dimensional printing model in the three-dimensional printing model data in the storage module 32.

Generally, the humanoid doll that the user desires is a full body shape. Therefore, in this embodiment, in addition to obtaining the three-dimensional model data of the real person's head by the above manner, the user can input the height by using the APP operation interface. The weight and the measurements, and send a configuration data to the server 3. The storage module 32 of the server 3 stores a plurality of different three-dimensional figure data. After the server 3 receives the body shape setting data, the processing module 33 can select the most suitable three-dimensional figure data from the storage module 32. As another three-dimensional model material representing the body of a real person. Thereafter, the processing module 33 combines the head and the three-dimensional model data of the body to obtain the three-dimensional model data required for the humanoid doll.

In addition to the above methods, the whole body shape can also directly capture the whole body through shooting, and then directly process the whole body three-dimensional model data by the same method as the head. However, each subject has a large difference between the body shape and the two elements of the costume. It is not as good as the face, so more manual settings are needed in the process of identification, model correction and mapping. Preferably, a plurality of feature points and contour lines, such as shoulders, waist and limbs, as well as cuffs, necklines, and cuffs of the garment, are manually marked along the body contour and the garment contour for adjusting the standard model and Map texture images are used.

In this embodiment, the generated three-dimensional model data may be first transmitted back to the communication device 2 for the user to check whether the similarity is similar. If the dissimilarity is considered, the re-production may be performed to reduce the regret of the finished product and the expectation, and also reduce Time and material waste caused by discarded products because they are not similar.

The generated three-dimensional model data is sent by the processing module 33 to the communication module 31 to be sent to the three-dimensional printing device 4, and then the three-dimensional printing device 4 creates a humanoid doll based on the three-dimensional model data. Because of the use of 3D printing technology, it is far better in terms of precision and speed than the designer's hand.

In another embodiment of the present invention, after the user starts the APP, a video recording function can be performed. Then, the user takes the object as a center, and the communication device 2 rotates around the subject, for example, ninety degrees, and records a front side of the subject. The video material on the left or right side, or the film material from the forty-five degree angle of the left front of the subject to the forty-five degree angle of the right front. After the video material is processed by the APP, two live-action images can be extracted, and then the three-dimensional model data can be generated according to the same steps as the above embodiment. When performing the capture, the face recognition technology can be used to determine whether a face appears in the movie, and if so, the image is saved in the storage unit 22, and two live images are selected as one image data according to the clarity of the image. . Of course, the video material including the two live-action images can also be directly uploaded by the communication device 2, and then the two live-action images are taken out by the server 3.

In order to increase the similarity between the three-dimensional printing model and the real person, in order to improve the quality of the humanoid doll, the creation can preferably use two or more real human images to produce three-dimensional printing model data, and there is parallax between the real human images. The two or more live-action images may be from the user holding the communication device 2 to take multiple photos around the subject, or may take out a plurality of real-life images from a piece of video data recorded by the subject, and the present invention is not limited thereto.

FIG. 7 is a schematic diagram of a communication device mounted on a mobile platform according to another embodiment of the present invention. Referring to FIG. 7, in another embodiment of the present invention, the communication device 2 can be mounted on a mobile platform 5 having a fixing unit 51 and a track 52. The fixing unit 51 can be locked or held. The communication device 2 is fixed thereto and movable relative to the track 52. Therefore, the communication device 2 can perform surround shooting on the photographed real person through the mobile platform 5 to produce high-quality image data or video material. In another embodiment of the present invention, the communication device 2 itself has a mobile platform 5, and the image capturing module 21 is fixed on the mobile platform 5, so that the image capturing module 21 can easily perform surround shooting.

In another embodiment of the present invention, the communication device 2 is a photo booth or a photo sticker machine, which is disposed in a store, in a store, or on the side of a road, and can be operated by a user for payment. In this embodiment, the communication device 2 can have two hardware configurations: first, having an image capturing module 21 and a mobile platform; and second, an image capturing module 21 having a plurality of different shooting angles. Regardless of the above, the user can sit around the camera or take a video, or shoot at different angles, and then output the three-dimensional model data with the obtained live image.

The present invention further discloses a server for making a humanoid doll, which is respectively connected to a communication device and a three-dimensional printing device. The server includes a communication module and a processing module. The processing module is electrically connected to the communication module. The communication module receives at least the image data from the communication device, and the image data each has a live image, and the difference between the live images is different. The processing module generates a three-dimensional model data according to the image data. The communication module transmits the three-dimensional model data to the three-dimensional printing device to print the humanoid doll. However, the technical content and implementation details of the server are substantially the same as the technical content and implementation details of the foregoing system. For reference, the foregoing is not described herein.

In summary, the design of hand-made humanoid dolls is too dependent on the designer's own skills and is not too predictable, time-consuming, and risky, but the system and server for making humanoid dolls based on this creation, through communication. The device can obtain at least two live-action images, and the server processes the three-dimensional printing model data, and then uses the three-dimensional printing device to produce a humanoid doll, which can effectively improve the above problem. Especially when smart phones and tablets have been widely used, this creation can be easily executed on the devices through the APP and quickly deliver data through the Internet, so that the time for completing the humanoid dolls can be accelerated.

In addition, when implementing this creation, the communication device can also be two common fixed devices such as a photo booth or a big head sticker machine. Since the photo booth or the head sticker machine can be set in, for example, a playground or a sightseeing spot, the creation can quickly produce the characteristics of a humanoid doll with a high degree of similarity, and is matched with a specific costume or situation, and is very popular with consumers or tourists. The willingness to make a humanoid doll.

The above is intended to be illustrative only and not limiting. Any equivalent modifications or alterations to the spirit and scope of this creation shall be included in the scope of the appended patent application.

1‧‧‧ system

2‧‧‧Communication device

3‧‧‧Server

4‧‧‧3D printing device

21‧‧‧Image capture unit

22‧‧‧ storage unit

31‧‧‧Communication module

32‧‧‧ storage module

33‧‧‧Processing module

Claims (10)

A system for making humanoid dolls, including:
At least one communication device;
a three-dimensional printing device; and a server respectively connected to the communication device and the three-dimensional printing device,
The server receives at least the image data from the communication device, and the server includes:
a communication module, which receives at least two image data from the communication device, each of the image data has a real human image, and the live image has a parallax between them;
a processing module electrically connected to the communication module, controlling the communication module to transmit and receive the image data, performing data calculation according to the program instruction to generate a three-dimensional model data, and controlling the communication module Transmitting the three-dimensional model data to the three-dimensional printing device to print a humanoid doll; and a storage module communicatively coupled to the processing module, wherein the processing module can be stored from the storage module for processing data. The system of claim 1, wherein the image data is obtained from a video material. The system of claim 2, wherein the film material comprises a movie recorded during the time being moved around the real person. The system of claim 3, wherein the film is recorded by the communication device. The system of claim 1, wherein the different human images in the image data have horizontal parallax or vertical parallax. A server for making a humanoid doll is respectively connected to a communication device and a three-dimensional printing device, and the server includes:
a communication module, which receives at least two image data from the communication device, each of the image data has a real human image, and the live image has a parallax between them;
a processing module electrically connected to the communication module, controlling the communication module to transmit and receive the image data, performing data calculation according to the program instruction to generate a three-dimensional model data, and controlling the communication module Transmitting the three-dimensional model data to the three-dimensional printing device to print a humanoid doll; and a storage module communicatively coupled to the processing module, wherein the processing module can be stored from the storage module for processing data. The server of claim 6, wherein the communication module receives a video material, and the video material includes the video data. The server of claim 7, wherein the film material comprises a movie recorded during the time of moving around the real person. The server of claim 8, wherein the film is recorded by the communication device. The server of claim 6, wherein the different live images in the image data have horizontal parallax or vertical parallax.