JP2019043110A - Modeling object extraction control device, modeling control system, and modeling object extraction control program - Google Patents

Abstract

To perform molding based on the information about the emotion during molding in the virtual space for each user in the process of molding by sharing the virtual space with a plurality of people.SOLUTION: A biological information analysis unit 74 acquires the biological information of each user 24 from a virtual ceramic control device 16 managed by each user 24 and analyzes the biological information to extract feature points, and store the timeline information (feature point extraction time) (synchronization information). When the pottery work is completed, the timeline information (synchronization information) stored in a timeline information storage unit 78 for each user 24 is selected. When synchronization information is selected by a selection unit 80, three-dimensional molding information of a time coincident with the selected synchronization information (timeline information) is fetched from the virtual ceramic control device 16 and sent out to a three-dimensional molding control device 44. In addition, when the line of sight of any user 24 is concentrated on a specific part in virtual ceramic art, the specific part is regarded as a target of feature points, and three-dimensional molding may be made only for the specific part.SELECTED DRAWING: Figure 5

Description

  The present invention relates to a formation target extraction control device, a formation control system, and a formation target extraction control program.

  According to Patent Document 1, when a video of a mixed reality space viewed by a user wearing a head-mounted display device is displayed on another device and shared, another virtual image in the shared video is displayed. It is described that the object is specified easily and accurately on the display screen of the device.

  In Patent Document 2, a three-dimensional stereoscopic display of an object that protrudes to the operator side from the two-dimensional display screen is performed, and the operator contacts or intrudes the stereoscopic image using a simulated processing tool, It is described that the position or the like of this simulated processing tool is detected, and a portion is deformed by touching or entering a stereoscopically displayed image, and the image is corrected and displayed on the processed image.

  Patent Document 3 describes that an operator is appropriately presented with a sense of touch and a sense of force such as when a virtual object in a virtual space to be operation-controlled is held by a virtual hand.

  Patent Document 4 is a game system for executing a game using three-dimensional position information, and describes a pottery game program (in particular, refer to claim 14 of Patent Document 2).

JP, 2016-224810, A JP 10-020914 A JP, 2016-24707, A JP 2011-83461 A

  For example, in virtual pottery, although a virtual space can be shared and shaped by a plurality of people, it is not possible to trace back a shaped object that bothers you individually while modeling. Also, there is no information to identify the time to go back.

  The present invention is a modeling target extraction control device capable of modeling based on information on emotion during modeling in a virtual space for each user in the process of modeling by sharing a virtual space by a plurality of people, a modeling control system, The object is to obtain a shaping target extraction control program.

  The invention according to claim 1 is a period during which a modeling object is jointly modeled from a virtual modeling control device that constructs a three-dimensional virtual reality space that can be shared with other users via a communication network. It is a formation object extraction control device which has a form control means which extracts the image data of the specific three-dimensional object of each for every user, and provides it to the three-dimensional formation apparatus which each user manages.

  The invention according to claim 2 is a period during which a modeling object is jointly modeled from a virtual modeling control device that constructs a three-dimensional virtual reality space that can be shared with other users via a communication network. Acquisition means for acquiring biological information obtained from each user, and a characteristic time of the biological information acquired by the acquisition means, and extracting image data of a three-dimensional image of a virtual object at the extracted time Image data corresponding to the characteristic time for each user is read out from the control means that executes storing in the storage means as the original modeling candidate, and the image data stored in the storage means, and each use And a provision means for providing to a three-dimensional shaping apparatus managed by a person.

  In the invention according to a third aspect, in the invention according to the second aspect, the acquisition means acquires posture information of the user.

  In the invention according to a fourth aspect, in the invention according to the second or third aspect, the providing means selects and provides image data corresponding to a part of the shaped object stored in the storage means. Do.

  The invention according to claim 5 extracts and stores, in the invention according to claim 2, image data of a time designated by the user during modeling separately from the biological information.

The invention according to a sixth aspect is the invention according to any one of the first to fifth aspects, wherein the virtual shaping control device can be worn by the user, and the image of the shaped object is A display device for displaying a moving image which is deformed according to the movement of the image of the user's hand forming the shaped object, and a headset interface comprising biological information detection means for detecting biological information; A haptic sense presentation device for presenting haptic and tactile senses to the user's hand in accordance with a moving image displayed on the display device;
have.

  The invention according to a seventh aspect of the present invention jointly comprises a virtual modeling control device for constructing a three-dimensional virtual reality space that can be shared with other users via a communication network, and the virtual modeling control device jointly A modeling target extraction control device for extracting image data of a specific modeling object during a virtual modeling period, and a three-dimensional modeling apparatus for modeling a three-dimensional modeling object in response to provision of the extracted image data; It is a modeling control system which it has.

  In the invention according to claim 8, according to the invention according to claim 7, the shaping target extraction control device performs virtual shaping of a shaped object jointly from each user during virtual shaping from the virtual shaping control device. An acquisition means for acquiring biological information obtained from each user during a period of time, and a characteristic thing extracted in the biological information acquired by the acquisition means, and a modeled object being virtually shaped at the extracted time The image data corresponding to the characteristic time for each user is read out from the storage means for storing the image data of 3D as a three-dimensional modeling candidate, and the image data stored in the storage means, and each user Providing means for providing the three-dimensional modeling apparatus to be managed.

  In the invention according to claim 9, in the invention according to claim 8, separately from the biological information, image data of a time designated by the user during modeling is extracted and stored.

  The invention according to a tenth aspect is the invention according to any one of the seventh to the ninth aspects, wherein the virtual shaping control device can be worn by the user, and the image of the shaped object is A display device for displaying a moving image which is deformed according to the movement of the image of the user's hand forming the shaped object, and a headset interface comprising biological information detection means for detecting biological information; And a haptic display device for presenting haptics and haptics on the user's hand in accordance with the moving image displayed on the display device.

  The invention according to claim 11 is a shaping object extraction control program which causes a computer to be executed as the shaping object extraction control device according to any one of claims 1 to 6.

  According to the first aspect of the present invention, modeling can be performed based on information on emotions during modeling in the virtual space for each user in the process of modeling by sharing a virtual space among a plurality of people.

  According to the second aspect of the present invention, it is possible to model the individually selected shaped objects in the joint work process.

  According to the third aspect of the present invention, the line of sight of the user can be used to extract a characteristic time.

  According to the fourth aspect of the present invention, a part of the virtual ceramic object can be selected and shaped.

  According to the fifth aspect of the present invention, the shaper can desire the formation in the middle of virtual pottery by himself.

  According to the sixth aspect of the present invention, a virtual ceramic space can be established.

  According to the seventh aspect of the present invention, modeling can be performed based on information on emotion during modeling in the virtual space for each user in the process of modeling by sharing a virtual space among a plurality of people.

  According to the eighth aspect of the present invention, it is possible to model the individually selected shaped objects in the joint work process.

  According to the invention as set forth in claim 9, the shaper can desire the formation in the middle of the virtual ceramic work by himself.

  According to the invention of claim 10, a virtual ceramic space can be established.

  According to the eleventh aspect of the present invention, modeling can be performed based on the information on the emotion during virtual pottery of each user in the process of modeling by sharing a virtual space among a plurality of people.

It is a schematic diagram of a modeling system for performing virtual ceramics, including a modeling target extraction control device according to the present embodiment. It is the schematic which shows the structure of UI for ceramics based on this Embodiment. FIG. 21 is a front view of an image of a virtual ceramic space displayed on the display device of the headset worn by each user according to the present embodiment. (A)-(G) are the schematic of the three-dimensional shaping apparatus applicable to this Embodiment. A block diagram for user feature point extraction control and selection control of a three-dimensional object during a virtual ceramic work execution period based on the extracted feature points, which is executed in the formation target extraction control device according to the present embodiment It is. It is a timing chart which shows the relation between the deformation transition state of the three-dimensional structure and the biological information for each user along the timeline of the virtual ceramic art according to the present embodiment. A flowchart showing a flow of user feature point extraction control executed in the formation target extraction control device according to the present embodiment, and selection control of a three-dimensional object during a virtual ceramic work execution period based on the extracted feature points It is.

  FIG. 1 is a schematic view of a modeling system for performing virtual ceramic art including a modeling target extraction control device 10 according to the present embodiment.

  The object-to-be-modeled extraction control device 10 has a microcomputer 12, and the microcomputer 12 includes a CPU 12A, a RAM 12B, a ROM 12C, an input / output port 12D (I / O 12D), and a data bus or control bus connecting these. It has a bus 12E.

  A hard disk 14 as a large scale recording medium is connected to the I / O 12D. The hard disk 14 temporarily stores three-dimensional modeling information generated by the virtual ceramic-art control device 16 (described later).

  A program for forming object extraction control is recorded in the ROM 12C, and when the forming object extraction control device 10 is activated, the program is read from the ROM 12C and executed by the CPU 12A. It should be noted that the modeling target extraction control program may be recorded on the hard disk 14 or another recording medium other than the ROM 12C.

(UI for pottery)
Further, the I / O 12D is connected to the communication network 19 via the network I / F 17. Connected to the communication network 19 are a plurality of virtual ceramic art control devices 16 managed by a user 24 who shares a virtual ceramic virtual space. The virtual ceramic-art control devices 16 managed by the respective users 24 basically have the same configuration, and therefore, in the following, one virtual ceramic-art control system 16 will be described as an example. "Basically the same" means that the basic operation control (platform) is the same even if the appearance shape and the software version or edition are different, as long as the following operation control can be performed.

  A pottery UI 18 is connected to the virtual pottery controller 16. The pottery UI 18 includes a headset 20 and a force tactile presentation device 22. The pottery UI 18 has a function of transmitting force tactile sense according to the movement of the user's hand when performing so-called virtual pottery.

  FIG. 2 shows an example of wearing the ceramic UI 18 by the user 24.

  The headset 20 uses goggles 26 for transmitting information to the user 24 through vision, headphones 28 for transmitting information to the user 24 through hearing, and users of the goggles 26 and the headphones 28. And 24 a belt unit 30 for mounting on the head.

  The goggles 26 include a display device 26A, and under the control of the virtual ceramic control device 16, the display device 26A displays a ceramic virtual space.

  In addition, the headphone 28 includes a speaker 28A, and outputs the sound during the pottery work on the virtual space under the control of the virtual pottery controller 16.

  A biological information sensor 32 is attached to the belt unit 30. The biological information sensor 32 has a function of detecting biological information including the user's heart rate, blood pressure, body temperature, amount of sweating, locus information of the line of sight of the user 24, and the like. The living body information sensor 32 may be attached not only to a single one but also to a plurality of attachment points. The attachment position is not limited to the belt unit 30, and may be attached to an appropriate place of the user 24's body. The locus information of the line of sight is known, for example, in a drive simulator etc., and each user 24 is engaged in virtual ceramic work by synchronizing the line of sight of the user 24 with the coordinates of the image displayed on the display device 26A. It is possible to recognize where you are looking.

  In particular, in the present embodiment, since a plurality of users 24 deform a single virtual ceramic object, the user is not limited to looking at a portion being deformed by another person, and the user may be deformed next. You may see the part you want to For example, others may be looking at the grip (hand) while deforming the shape of the edge of the coffee cup.

  The signal detected by the biological information sensor 32 is sent to the modeling target extraction control device 10 via the virtual ceramic art control device 16 and analyzed, for example, to extract a feature point stimulated by the user. Is to be used as a factor of In addition, to receive stimulation means that the signal of the biological information is changed in the image displayed in the virtual space (the ceramic art process image performed in the virtual space), and the extraction of the feature point is It means that the change of the signal has exceeded a predetermined threshold.

  On the other hand, the force tactile sense presentation device 22 of the ceramic UI 18 is provided with a glove 34 as a support for mounting on the user's hand (here, both hands).

  A plurality of haptic presentation actuators 36 and a plurality of haptic presentation actuators 38 are attached to the glove 34. The tactile sense providing actuator 36 transmits the feel of touching the material (virtual clay) in the pottery work with virtual pottery to the hand of the user 24 under the control of the virtual pottery controller 16. Further, the force sense presentation actuator 38 transmits the degree of force when the material in the pottery work is deformed with virtual pottery to the hand of the user 24 under the control of the virtual pottery controller 16.

  Also, a plurality of motion captures 40 are attached to the glove 34 to detect the movement of the hand of the user 24, and the detection signal is sent to the virtual ceramic control device 16.

  The virtual ceramic-art control device 16 causes the display device 26A to display the hand image (virtual hand image) of the user 24 by synchronizing the movement of the hand of the user 24 with the virtual ceramic-art area image, thereby the user. 24 can experience virtual ceramic art through sight, hearing and touch (see FIG. 3). In the present embodiment, virtual ceramic art is experienced through sight, hearing, and touch, but it does not deny that other five senses (taste, smell) are taken in.

(3D modeling device)
As shown in FIG. 1, a three-dimensional modeling control device 44 is connected to the I / O 12 D via an I / F 42. A three-dimensional modeling apparatus 46 is connected to the three-dimensional modeling control apparatus 44. In the three-dimensional formation control device 44, the three-dimensional formation device 46 is controlled based on the three-dimensional formation information generated by the virtual ceramic object control device 16 to form a real three-dimensional object. Although FIG. 1 shows an example in which one (one type) three-dimensional modeling apparatus 46 is connected to the three-dimensional modeling control apparatus 44, a plurality (a plurality of types) of three-dimensional modeling apparatus 46 is shown. May be controlled collectively. For example, plural types of three-dimensional modeling devices 46 modeled by different modeling methods may be collectively managed, and the three-dimensional modeling device 46 suitable for the application may be selected to instruct modeling.

  Examples of the forming method include a binder injection method, a directional energy deposition method, a material extrusion method, a material injection method, a powder bed fusion bonding method, a sheet lamination method, a liquid tank photopolymerization method and the like.

FIGS. 4A to 4G show an example of the relationship between the type and function of the forming method and the material compatible with each forming method.
(1) Binder Injection Method As shown in FIG. 4 (A), the three-dimensional modeling apparatus 46A of the binder injection method is a method in which the liquid binder 50 is injected onto the powder bed 52 and selectively solidified. . Examples of materials include gypsum, ceramics, sand, calcium and plastics.
(2) Directional energy deposition method As shown in FIG. 4 (B), the three-dimensional modeling apparatus 46B of the directional energy deposition method generates heat by concentrating the beam 56 and the like while supplying the material 54. Is controlled to selectively melt and bond the material 54. Examples of materials include metals.
(3) Material Extrusion Method As shown in FIG. 4C, the material extrusion method three-dimensional modeling apparatus 46C is a method of extruding the flowable material 58 from the nozzle 60 and depositing and solidifying it at the same time. Examples of the material include ABS (acrylonitrile butadiene styrene resin), PLA (polylactic acid), nylon 12, PC (polycarbonate), and PPSF (polyphenylsulfone).
(4) Material Jet Method As shown in FIG. 4D, the material jet method three-dimensional modeling apparatus 46D is a method of jetting the droplets 62 of the material to selectively deposit and solidify. The three-dimensional formation device 46D is a formation method based on the representative inkjet method. Examples of materials include UV curable resins, fats, waxes and solders.
(5) Powder Bed Melt Bonding Method As shown in FIG. 4 (E), the powder bed melt bonding method three-dimensional shaping apparatus 46E selectively uses a thermal energy irradiated from a laser 66 to a region 64 where powder is spread. Is a method of melt bonding to Examples of materials include engineering plastics, nylon and metals.
(6) Sheet Laminating Method As shown in FIG. 4F, the sheet laminating method three-dimensional modeling apparatus 46F is a method in which a sheet-like material 68 is adhered. Examples of materials include paper, resin sheet, aluminum sheet wax and solder.
(7) Liquid Tank Photopolymerization System As shown in FIG. 4 (G), the liquid tank photopolymerization system three-dimensional modeling apparatus 46G selectively uses liquid photocurable resin 72 stored in the tank 70 by photopolymerization. It is a method of curing. UV curable resin is mentioned as an example of material.

  In addition, seven types of three-dimensional modeling apparatuses 46A-G from which the modeling method shown to said (1)-(7) differs are selectively owned by a modeling maker. Moreover, although the modeling method shown to said (1)-(7) was shown in FIG. 4, the three-dimensional modeling apparatus of the modeling method different from this (1)-(7) may be sufficient.

(Outline of FAV format)
The three-dimensional modeling information (modeling format data) for modeling the three-dimensional model is preferably voxel data stored in a fabricable voxel (FAV) format.

  In the FAV format, not only the external shape of the three-dimensional model data, but also various attributes such as the internal structure, the material to be used, and the bonding strength are held. Regardless of the appearance and inside of the three-dimensional model data, it is possible to design thoroughly and precisely, precisely and precisely to every corner as the designer thinks, ensuring that it can be stored as data.

  The FAV format is configured based on voxel data.

  A voxel is a three-dimensional pixel value. By arranging pixels which are two-dimensional pixel values in a plane, an object is formed by arranging voxels which are three-dimensional pixel values in a three-dimensional manner so as to form an image.

  That is, the FAV format is three-dimensional model data having the following conditions.

  (Condition 1) Information necessary for manufacturing, such as shape, material, color, bonding strength, etc. must be clearly defined at each three-dimensional position regardless of inside or outside of the three-dimensional model data.

  (Condition 2) Design (CAD), analysis (CAE), and inspection (CAT) of three-dimensional model data can be performed uniformly and bi-directionally without data conversion.

  Since the FAV format can carry information on materials, selection of a forming method becomes easy.

(Function of modeling target extraction control device 10)
FIG. 5 is a block diagram for feature point extraction control of the user 24 and selection control of a three-dimensional shaped object during virtual ceramic work execution period based on the extracted feature points, which is executed in the formation target extraction control device 10 It is shown. Note that each block in FIG. 5 is specialized for feature point extraction control and selection control of the formation target extraction control device 10 and is classified according to function, and in the case of limiting the hardware configuration of the formation target extraction control device 10 Absent.

  The living body information analysis unit 74 acquires the living body information of each user 24 from the virtual ceramics control device 16 managed by each user 24 and analyzes the living body information for each user 24 to obtain a feature point (characteristic Period of time).

  By analyzing the signal detected by the biological information sensor 32, for example, the user 24 extracts a feature point that has been stimulated.

  More specifically, when the biological information is the heart rate, the body temperature, and the amount of sweating, the time when any one exceeds the threshold is extracted as the feature point. Note that the feature point may be set on the condition that two or more factors exceed the threshold value.

  Here, when the biological information is the line of sight, the continuous stop time of the position where the line of sight is directed is extracted as the feature point when the threshold value is exceeded, and the shaping target is a partial area centered on the viewpoint It is also possible. That is, when the virtual ceramic art is a coffee cup and the viewpoint is the grip portion (handle), the grip portion (handle) may be regarded as the target of the feature point.

  The biometric information analysis unit 74 is connected to the timeline information taking-in unit 76 and the timeline information storage unit 78, and sends out the extraction signal when the feature point is extracted.

  The timeline information taking-in unit 76 acquires pottery work progress information (timeline information) at the time of receiving the extraction signal from the biological information analysis unit 74, and sends it to the timeline information storage unit 78.

  The timeline information storage unit 78 stores timeline information (feature point extraction timing) synchronized with the timing when the extraction signal is received from the biological information analysis unit 74. Hereinafter, timeline information stored in synchronization with the extracted feature points is referred to as synchronization information. The synchronization information is not limited to one, and a plurality of synchronization information may be stored in the timeline information storage unit 78 during the pottery work period.

  On the other hand, the virtual pottery controller 16 sends out pottery operation information (mainly, the start of pottery and the end of pottery, and three-dimensional modeling information) to the selection unit 80, and when the pottery operation is finished, timeline information storage The timeline information (synchronization information) stored in the unit 78 is selected. Although it is assumed that two or more pieces of synchronization information are selected (feature point A in FIG. 6 (A), feature point C, feature point C in FIG. 6 (B), feature point D, FIG. 6). (C) Feature point E, feature point F), and in the case of one synchronization information, the one synchronization information is to be selected.

  The selection by the selection unit 80 may be either automatic selection or manual selection. In the case of automatic selection, for example, the feature point having the largest peak value of biological information (see feature point A in FIG. 6A, feature point C in FIG. 6B, and feature point F in FIG. 6C). Choose In the case of manual selection, any one of the feature points in FIG. 6 may be selected, a feature point at the Nth time from the start time on the timeline, a feature point at the Nth peak value, etc. , You may enter the condition of selection (N is a positive integer).

  When synchronization information is selected by the selection unit 80, three-dimensional modeling information of a time that coincides with the selected synchronization information (timeline information) is taken in from the virtual ceramic art control device 16, and three-dimensional managed by each user 24 It is sent to the formation control device 44.

  The three-dimensional formation control device 44 controls the three-dimensional formation device 46 to execute three-dimensional formation.

  The operation of the present embodiment will be described below with reference to the flowchart of FIG.

  FIG. 7 is the feature point extraction control of the user 24 executed in the shaping target extraction control device 10 according to the present embodiment, and the selection of the three-dimensional shaped object during the virtual ceramic work execution period based on the extracted feature points. It is a flowchart which shows the flow of control.

  In step 100, the virtual ceramic-art control device 16 determines whether virtual ceramic-art has been started, and if a negative determination is made, this routine ends.

  If a positive determination is made in step 100, it is determined that virtual ceramic art has been started, and the process proceeds to step 102 to start timing of a common timeline for each user.

  In the virtual pottery, the user 24 wears the pottery UI 18.

  That is, the head set 20 is attached to the head of the user 24, and the glove 34 (force tactile sense presentation device 22) is attached to the hand of the user 24.

  A virtual space for pottery is displayed on the display device 26A of the headset 20 under the control of the virtual ceramic control device 16. The sound emitted in the virtual ceramic space is output from the speaker 28A.

  The tactile sense presentation actuator 36 of the force tactile sense presentation device 22 transmits, to the hand of the user 24, the touch of touching the material (virtual clay) in the pottery work with virtual ceramic art.

  Further, the force sense presentation actuator 38 of the force tactile sense presentation device 22 transmits to the hand of the user 24 the amount of force change when the material in the pottery work is deformed by virtual ceramics.

  The motion capture 40 attached to the glove 34 detects the movement of the hand of the user 24 and synchronizes the movement of the hand of the user 24 with the virtual ceramic section image and displays it on the display device 26A.

  As shown in FIG. 3, the virtual ceramic work space and the virtual hand image according to the movement of the user 24 are displayed on the display device 26A, so that the user 24 executes the virtual ceramic work with a sense of presence Is possible.

  Here, the biological information sensor 32 is attached to the belt unit 30 of the headset 20 of the present embodiment, and the biological information of the user 24 is appropriately detected during the virtual ceramic work period (during activation of the timeline).

  The biological information sensor 32 detects, for example, biological information including the user's heart rate, blood pressure, body temperature, amount of sweating, and gaze.

  As shown in FIG. 7, when timing of the timeline is started in step 102, the process proceeds to step 104, and the biological information of each user 24 detected by the biological information sensor 32 is fetched from the virtual ceramic control device 16, and then At step 106, the prestored threshold value is read out, and the process goes to step 108. In step 108, the captured biological information is compared with a threshold.

  In the next step 110, as a result of the comparison in step 108, it is determined whether or not it is a feature point. In the present embodiment, when the captured biological information exceeds the threshold value, it is regarded as the feature point.

  If an affirmative determination is made in step 110, it is determined that the feature point is present, the process proceeds to step 112, the current timeline information is stored as a feature point for each user 24 (synchronization information), and the process proceeds to step 114 . If a negative determination is made in step 110, it is determined that the feature point is not present, and the process proceeds to step 114.

  In step 114, it is determined whether or not the virtual ceramic work has been completed. If a negative determination is made, the process proceeds to step 104 to repeat the above-described steps in order to continue detection of the biological information.

  Also, if the determination in step 114 is affirmative, it is determined that the virtual ceramic work has been completed, and the process proceeds to step 116 to end the common time-line timing for each user 24 and then proceeds to step 118. And select a feature point (synchronization information).

  That is, the number of points (feature points) exceeding the threshold value in the biometric information is not limited to one, and a plurality of points may exist.

  For example, as shown in FIG. 6A, in the case of the user A, there exist feature points A and B whose biometric information exceeds a threshold. Further, as shown in FIG. 6B, in the case of the user B, there are a feature point C and a feature point D in which the biological information exceeds a threshold. Furthermore, as shown in FIG. 6C, in the case of the user C, there are feature points E and F where the biometric information exceeds the threshold.

  Therefore, the automatic selection by the selection unit 80 is, for example, the feature point with the largest peak value of biological information (feature point A in FIG. 6A, feature point C in FIG. 6B, and FIG. 6C). Feature point F) may be selected. Also, in the case of manual selection, among the feature points A to F in FIG. 6, the feature point of the Nth time from the start time on the timeline, the feature point of the peak value of the Nth size, etc. You may enter the condition of (N is a positive integer).

  In the next step 119, it is determined whether or not there is a region selection based on the sight line in the biological information.

  If a negative determination is made in step 119, it is determined that there is no area selection based on the line of sight, and the process proceeds to step 120.

  In the next step 120, three-dimensional modeling information of the time coincident with the synchronization information of each of the selected users 24 is captured, and then the process proceeds to step 122.

  In addition, when the determination result in step 119 is affirmative, it is determined that there is area selection based on the line of sight, and the process proceeds to step 121.

  The area selection based on the line of sight means that when the line of sight of any one of the users 24 is concentrated on a specific part in the virtual ceramic work, the specific part is regarded as a feature point. When a specific site is regarded as a feature point, three-dimensional modeling can be performed only for the specific site.

  For example, in the middle of virtual pottering with a plurality of users 24 for the purpose of a coffee cup, when one user 24 is interested in the portion of the grip (hand) and concentrates his gaze, The concentrated time is the feature point, and the grip portion (handle) is the object of modeling.

  Therefore, in step 121, it is time to coincide with the synchronization information of each of the selected users 24, and a part of the three-dimensional modeling information of the virtual ceramic object is fetched, and then the process proceeds to step 122.

  In step 122, the three-dimensional formation control device 44 is instructed to execute formation based on the three-dimensional formation information by the three-dimensional formation device 46, and this routine ends.

  In the present embodiment, the virtual modeling is virtual pottery, but it is not limited to the pottery. For example, processing operations of various materials such as metal and synthetic resin may be performed in the virtual reality space, and the three-dimensional object may be formed during the processing. The processing operations include virtual reality space for producing architectural models of houses and buildings, virtual reality space for producing design models at the design stage of vehicles, and virtual reality spaces for assembling and producing sculptures of plastic models, artificial flowers, etc. The feature points in the process of production may be extracted and shaped.

10 Modeling object extraction control device 12 microcomputer 12A CPU
12B RAM
12C ROM
12D input / output port (I / O)
12E Bus 14 Hard Disk 16 Virtual Ceramics Controller 17 Network I / F
18 Ceramics UI
Reference Signs List 19 communication network 20 headset 22 force tactile sense presentation device 24 user 26 goggles 28 headphone 30 belt unit 26A display device 28A speaker 32 biological information sensor 34 glove 36 tactile sense presentation actuator 38 force sense presentation actuator 40 motion capture 44 three dimensional Shape control device 46 Three-dimensional formation device 50 Binder 52 Powder bed 54 Material 56 Beam 58 Material 60 Nozzle 62 Droplet 64 Area 66 Laser 68 Material 70 Tank 72 Photocurable resin 74 Biological information analysis unit 76 Timeline information acquisition unit 78 timeline information storage unit 80 selection unit

Claims (11)

  Image data of a specific object during a period when the object is being virtually formed jointly from a virtual formation control device that constructs a three-dimensional virtual reality space that can be shared with other users via a communication network A shaping target extraction control device having shaping control means for extracting for each user and providing it to a three-dimensional shaping device managed by each user. A living body obtained from each user during a virtual modeling operation of a shaped object jointly from a virtual modeling control device that constructs a three-dimensional virtual reality space that can be shared with other users via a communication network Acquisition means for acquiring information;
A control unit that extracts characteristic time in the biological information acquired by the acquisition unit, and stores image data of a three-dimensional object which is virtually shaped at the extracted time as a three-dimensional formation candidate in the storage unit;
Providing means for reading out image data corresponding to a characteristic time for each user from the image data stored in the storage means, and providing the three-dimensional modeling apparatus managed by each user.
An object forming and extracting control device having:   The shaping target extraction control device according to claim 2, wherein the acquisition unit acquires posture information of the user.   The shaping target extraction control device according to claim 2 or 3, wherein the providing means selects and provides image data corresponding to a part of the shaped object stored in the storage means.   The shaping target extraction control device according to claim 2, wherein image data of a time designated by a user during modeling is extracted and stored separately from the biological information. The virtual modeling control device
A display device that can be worn by the user, and displays a moving image in which the image of the shaped object is deformed according to the movement of the image of the hand of the user who is shaping the shaped object; A headset interface comprising biometric information detection means for detecting information;
A haptic sense presentation device for presenting haptic and tactile senses to the user's hand in accordance with a moving image displayed on the display device;
The shaping | molding object extraction control apparatus in any one of the Claims 1-5 which have these. A virtual modeling control apparatus for constructing a three-dimensional virtual reality space that can be shared with other users via a communication network;
A modeling target extraction control device for extracting image data of a specific modeling object during a period of virtual modeling of a modeling object jointly from the virtual modeling control device;
A three-dimensional modeling apparatus for modeling a three-dimensional object in response to provision of the extracted image data;
Modeling control system having. The shaping target extraction control device is
An acquisition unit configured to acquire biological information obtained from each user from the user during the virtual modeling jointly from each user during virtual modeling from the virtual modeling control device;
Storage means for extracting a characteristic time in the biological information acquired by the acquisition means, and storing image data of a three-dimensional object being modeled at the extracted time as a three-dimensional formation candidate;
Providing means for reading out image data corresponding to a characteristic time for each user from the image data stored in the storage means, and providing the three-dimensional modeling apparatus managed by each user to the three-dimensional modeling device;
The shaping control system according to claim 7, comprising:   The formation control system according to claim 8, wherein image data of a time designated by a user during formation is extracted and stored separately from the biological information. The virtual modeling control device
A display device that can be worn by the user, and displays a moving image in which the image of the shaped object is deformed according to the movement of the image of the hand of the user who is shaping the shaped object; A headset interface comprising biometric information detection means for detecting information;
A haptic sense presentation device for presenting haptic and tactile senses to the user's hand in accordance with a moving image displayed on the display device;
The shaping control system according to any one of claims 7 to 9, comprising: A formation object extraction control program which makes a computer run as a formation object extraction control device according to any one of claims 1 to 6.