JP2001291119A - Device and method for controlling user interface and program providing medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a user interface controller capable of efficiently performing display and selection processing of a processing menu such as the deformation and coloring of an object displayed on a display. SOLUTION: In the case of displaying a processing selection menu such as deformation and coloring with respect to a three-dimensional work target object displayed on a display device, the displayed work target object is replaced with a three-dimensional menu display object to be displayed. The menu display object is displayed as a three-dimensional color space where, for instance, the respective set values of RGB values can be selected. A user selects a desired color by indicating the menu display object by using a working body such as a cursor. The menu display object can be applied not only to color selection but also to a deformation tool or another menu selecting picture that is conventionally used and displayed in a planar manner.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to a user interface control device, a user interface control method, and a program providing medium.
D. In an image processing system that displays a three-dimensional object on a display such as a personal computer and performs various processes such as deformation and coloring on the three-dimensional object, the menu selection of the process is easier for the user to understand and more user-friendly. The present invention relates to a user interface control device, a user interface control method, and a program providing medium having a configuration.

[0002]

2. Description of the Related Art In the field of computer graphics, various techniques have been developed for devices and methods for displaying a three-dimensional figure on a display and changing the orientation, shape, color, etc. of the displayed three-dimensional figure. Has been realized. As a method of displaying a three-dimensional object on a display, there is a method of inputting shape data of an object including depth data using, for example, a mouse, a two-dimensional tablet, or the like. Further, a method of acquiring data of an actual three-dimensional object by a three-dimensional digitizer or a three-dimensional scanner, acquiring display data based on the data, and displaying the acquired data on a display is also used. As a method of performing processing such as deformation of an object displayed on a display, a configuration using an input device including a glove-type manipulator is known.

Further, there has been developed a technique for deforming an object composed of three-dimensional polygons by a method imitating the deformation of clay. For example, a Play modeling tool displays a three-dimensional object and a cursor on a display, and specifies a location of the object to be deformed with the cursor. Then, the deformation can be executed by pressing the mouse button.

Processing for an object includes deformation, coloring, and the like, and further, various settings such as setting of a deformation mode and setting of a color to be colored are required. Such settings are generally made by menu selection using a GUI. In many cases, a configuration is used in which a selectable menu is displayed at a position out of the way of the screen, such as at the top or bottom of the screen or window, and the user selects various items from the menu shown at the corner of the screen. Alternatively, there is also a configuration in which a new window is opened on a work screen displaying objects, a menu is displayed in the new window, and a menu is selected from the menu. In such a method, the menu is displayed in a two-dimensional plane, and the menu is selected by moving the cursor two-dimensionally using a pointing device such as a mouse.

[0005]

However, in the conventional menu selection method as described above, a normal operation, that is, a place for performing various processing on an object (hereinafter referred to as a work space) and a place for displaying a menu. (Hereinafter referred to as a menu space) are displayed separately, so that the user must move the cursor and the viewpoint from the work space to the menu space in order to select a menu.

In particular, in recent years, input devices such as the above-described three-dimensional digitizer, three-dimensional scanner, and glove-type input device have been widely used due to advances in image processing technology for realizing virtual reality. In order for a user who has been working with the input device to make a menu selection, it is required to move the cursor to the menu space using another input device such as a mouse or a keyboard and make a selection. Therefore, the user has to perform a troublesome operation of having to change the input device.
Further, in a configuration in which menus are arranged two-dimensionally on a display screen of a display, there is a problem that as the number of menus increases, a menu space becomes wider, a work space becomes narrower, and the work becomes obstructive.

A user interface control device and a user interface control method according to the present invention solve the above-mentioned problems, and do not need to distinguish between a work space and a menu space on a display. It is an object of the present invention to provide a configuration capable of performing menu selection.

Further, the present invention provides a user interface control which can save the trouble of switching an input device used for work, for example, a three-dimensional position input device, to another input device, for example, a mouse, and selecting a menu. It is an object to provide an apparatus and a user interface control method.

Further, the present invention makes it possible to display a plurality of menus in a compact manner by using a configuration for displaying menus three-dimensionally. When a menu is selected or when the menu selection is released, the object on which the menu is displayed is displayed. It is an object of the present invention to provide a user interface control device and a user interface control method which are excellent in operability and can be continuously operated by replacing an object to be an original work target.

[0010]

SUMMARY OF THE INVENTION A first aspect of the present invention is as follows.
A user interface control device in a three-dimensional model processing device that displays an object on a display device based on position data in a three-dimensional space, and executes a process on a work target object that is a processing target displayed on the display device. And a menu mode for setting the mode of processing. In the process of switching from the work mode to the menu mode, the work target object displayed on the display device is displayed on the menu display object. A user interface control device having control means for executing a process of replacing with a user interface.

Further, in one embodiment of the user interface control device of the present invention, the control means is configured to three-dimensionally display the menu display object on the display device.

Further, in one embodiment of the user interface control device of the present invention, the control means three-dimensionally displays the menu display object on the display device,
According to another aspect of the present invention, a three-dimensional set value is selected according to an instruction of three-dimensional coordinates for the menu display object displayed on the display device.

Further, in one embodiment of the user interface control device of the present invention, the three-dimensional set value is:
It is characterized by being each value of RGB.

Further, in one embodiment of the user interface control device of the present invention, the control means replaces a menu display object displayed on a display device with a work target object in the process of switching from the menu mode to the work mode. It is characterized in that it is configured to execute processing.

Further, in one embodiment of the user interface control device of the present invention, the control means executes a process on the work target object and changes the work object displayed on the display device from the work mode to the menu mode. In the switching process, a configuration is provided in which a process of replacing the menu display object with a selection object for executing the selection process is performed.

Further, in one embodiment of the user interface control device of the present invention, the work object is a deformation processing tool for executing a deformation process on the work target object, and the control means is different from the menu display object. It is characterized in that a plurality of different deformation processing tools for executing the deformation processing are displayed.

Further, in one embodiment of the user interface control device of the present invention, the control means replaces a selection object displayed on a display device with a work object in the process of switching from the menu mode to the work mode. Is performed.

Furthermore, a second aspect of the present invention is a user interface control method in a three-dimensional model processing device for executing display of an object on a display device based on position data in a three-dimensional space. A mode switching step of executing a process of switching between two modes, a work mode for executing a process for the displayed work target object to be processed and a menu mode for setting a mode of the process; and changing from the work mode to the menu mode. And a display switching step of replacing a work target object displayed on the display device with a menu display object when executing the switching process.

Further, in one embodiment of the user interface control method of the present invention, in the display switching step, the menu display object is three-dimensionally displayed on the display device.

Further, in one embodiment of the user interface control method of the present invention, the menu display object is three-dimensionally displayed on the display device, and three-dimensional coordinates with respect to the menu display object displayed on the display device. (3), a three-dimensional set value selection is executed.

Further, in one embodiment of the user interface control method of the present invention, the three-dimensional set value is:
It is characterized by being each value of RGB.

Further, in one embodiment of the user interface control method of the present invention, in the display switching step, in the switching process from the menu mode to the work mode, the menu display object displayed on the display device is used as the work object. It is characterized by performing a replacement process.

Further, in one embodiment of the user interface control method of the present invention, in the display switching step, a process for the work object is executed, and the work object displayed on the display device is changed from the work mode to the menu mode. When executing the switching process, the process of replacing the menu display object with a selection object for executing the selection process is performed.

Further, in one embodiment of the user interface control method of the present invention, in the user interface control method, the work object is a deformation processing tool for executing a deformation process on the work target object;
A plurality of different deformation processing tools for executing different deformation processing are displayed as the menu display object.

Further, in one embodiment of the user interface control method of the present invention, in the user interface control method, in the process of switching from the menu mode to the work mode, the selection object displayed on the display device is used as the work object. A replacement process is performed.

According to a third aspect of the present invention, there is provided a three-dimensional modeling device for executing a process on a work object displayed on a display device, the display device displaying the work object and the work object on the display device; The work target object sensor and the work object tool sensor corresponding to each of the work target object and the work object are relatively moved within an action area where the three-dimensional position of each sensor can be obtained, and the work object object sensor and the work object tool sensor are changed in accordance with the change in the relative position. A data input unit for generating three-dimensional position data, and a work object and a display mode of the work object displayed on the display device are updated based on the three-dimensional position data of the sensor from the data input unit. A switching process between two modes, a work mode for executing a process on a target object and a menu mode for setting a mode of the process, is executed, and the work mode is switched. In switching process to the menu mode from the 3-dimensional modeling apparatus, characterized in that it comprises a control means for executing processing for replacing a work object displayed on the display device in the menu display object.

Further, in one embodiment of the three-dimensional modeling device of the present invention, the control means replaces the menu display object displayed on the display device with a work target object in the process of switching from the menu mode to the work mode. It is characterized in that it is configured to execute processing.

Further, according to a fourth aspect of the present invention, a user interface control process in a three-dimensional model processing device for displaying an object on a display device based on position data in a three-dimensional space is executed on a computer system. A program providing medium for providing a computer program to be executed, the computer program comprising: a work mode for executing a process on a work target object which is a process target displayed on the display device; and a menu for setting a mode of the process. A mode switching step of executing a switching process between two modes, i.e., a mode, and a display switching step of replacing a work target object displayed on a display device with a menu display object in the switching process from the work mode to the menu mode. Program providing medium characterized by having Located in.

The program providing medium according to the fourth aspect of the present invention is a medium for providing a computer program in a computer-readable format to a general-purpose computer system capable of executing various program codes. . The form of the medium is not particularly limited, such as a storage medium such as a CD, an FD, and an MO, and a transmission medium such as a network.

Such a program providing medium defines a structural or functional cooperative relationship between the computer program and the providing medium for realizing a predetermined computer program function on a computer system. Things. In other words, by installing the computer program into the computer system via the providing medium, a cooperative operation is exerted on the computer system, and the same operation and effect as the other aspects of the present invention can be obtained. You can do it.

Still other objects, features and advantages of the present invention are:
It will become apparent from the following more detailed description based on the embodiments of the present invention and the accompanying drawings.

[0032]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of a user interface control device and a user interface control method according to the present invention will be described with reference to the drawings.

[Apparatus Configuration] FIG. 1 shows a system configuration diagram of the present invention. In FIG. 1, a system includes a central processing unit (CPU) 101 for executing a processing program, a program memory 102 for storing a processing program, a data memory 103 for storing processing data, and image data created for visualizing a result. Frame memory 10 to store
4. An image display device 105 for displaying image data stored in the frame memory 104, an input device 106 such as a three-dimensional position sensor and a data glove, and a bus 107 for connecting each circuit and transmitting programs and data. ing.

A central processing unit (CPU) 101 extracts processing data from a data memory 103 storing input data or processing data from an input device 106 and generates display data in accordance with a processing program stored in a program memory 102. Execute the process. The generated display data is stored in the frame memory 104. Further, the image display device 105 displays the display data stored in the frame memory 104.

[Operation] Next, the processing of the three-dimensional model processing apparatus provided with the user interface control device of the present invention will be described. Here, an example in which the user interface control device of the present invention is applied to a three-dimensional modeling system using, for example, a plurality of three-dimensional sensors capable of measuring a position and a rotation angle in a three-dimensional space as input devices will be described.

The three-dimensional modeling system is shown in FIG.
Such a system. The system of FIG.
When the user moves the three-dimensional position / angle sensors 201 and 202 relatively in the action area, the relative position and the relative angle of the three-dimensional position / angle sensors 201 and 202 are changed, and the three-dimensional image displayed on the display device 203 is displayed. Position / angle sensor 20
The processing tool 205 corresponding to the three-dimensional position / angle sensor 202 is applied to the processing target object 204 corresponding to No. 1 to execute various processing, and various actions such as deformation and coloring are performed on the processing target object 204. It is a system to be executed.

Two three-dimensional position / angle sensors 201, 2
Reference numeral 02 denotes a three-dimensional position obtained by a magnetic sensor or the like. Further, processing functions such as deformation and coloring are set in the three-dimensional position / angle sensor 202 corresponding to the processing tool 205. 3D position / angle sensor 20 corresponding to object 204 to be processed
When the distance approaches 1 or less, the processing tool 205 displayed on the display device 203 enters the inside of the processing target object 204 and performs processing such as forming a concave portion in the processing target object 204. FIG. 3 shows a configuration block diagram for realizing such a three-dimensional modeling system.

FIG. 3 shows a data input unit 310 from the sensor.
FIG. 2 is a block diagram illustrating a configuration of a three-dimensional modeling system having the following. The example shown in FIG. 3 is an example in which a three-dimensional position / angle sensor is configured using a magnetic sensor. Magnetic source 31
The inside of the magnetic field generated from 1 is set as an action area, and an operation by the processing object tool 312 and the processing tool 313 is performed in the action area. A magnetic sensor is attached to each of the processing target object tool 312 and the processing tool 313, and the processing target object tool 312 and the processing tool 313 of the processing target object tool 312 and the processing tool 313 are set in an action area set in a magnetic field emitted from the magnetic source 311. The magnetic sensor outputs the magnetic displacement data to the dedicated interface 314. The dedicated interface 314 calculates position information and attitude information data of each tool based on these data. Note that a configuration may be employed in which a three-dimensional position is acquired using an ultrasonic sensor instead of a magnetic sensor.

A central processing unit (CPU) 301 executes projection conversion processing, display data generation processing, etc. based on input data according to a processing program stored in a program memory 302 based on position information from a data input unit 310. I do. The generated display data is stored in the frame memory 30.
4 is stored. Further, the image display device 305 displays the display data stored in the frame memory 304. Z
The buffer 306 is a memory for performing hidden surface processing, and stores values (Z values) in the depth direction of all pixels on the display screen. By referring to the value stored in the Z buffer 306, contextual data from a viewpoint of a plurality of objects existing at various positions in a three-dimensional space is acquired and displayed correctly regardless of the drawing order of each object. can do.

As described above, in the present system, the sensor is associated with the object in the virtual space displayed on the image display device 305, and the sensor is moved and rotated to display the object on the image display device 305. Objects in a virtual space can be moved and rotated. Also, the positional relationship between the two sensors, that is, 2
Depending on the positional relationship between the two objects, it is possible to deform the object to be worked, to combine this object with another object, or to add color. For example, a system is provided in which an object to be worked has a function like a pen, and when this object comes into contact with an object to be worked, a color can be applied.

Hereinafter, a three-dimensional object which can be operated in a virtual space, such as movement, rotation, etc., is referred to as a work object. Are displayed as menu display objects. A state in which operations such as movement, rotation, and deformation can be performed on the work target object is called a work mode, and a state in which a menu can be selected is called a menu mode.

FIG. 4 is a flowchart for explaining the processing of the three-dimensional modeling system to which the user interface control device of the present invention is applied, and FIG. 5 shows a specific processing example. Hereinafter, the processing will be described in detail with reference to the flowchart of FIG.

First, the state of the three-dimensional modeling system is initialized to a work mode (S401). In the work mode, the work object 5 is displayed on the screen as shown in FIG.
01 and the work object 502 are displayed. Next, the position / rotation angle and the like are input using the input device (S402), and the work target object and the work object are moved / rotated based on the input position / rotation angle and the like (S403). And 3
An object existing in the three-dimensional space is displayed on the display device (S4
04). By moving and rotating the three-dimensional sensor that can be operated by the user, the work target object and the work object in the virtual space can be similarly moved and rotated.

Next, it is determined whether the current state is the work mode (S405). If it is the work mode, it is determined whether or not the operation is a switching operation to a predetermined menu mode (S406). Here, the predetermined operation is, for example, pressing a menu button attached to an input device, moving a work target object to a designated place in a three-dimensional space, and clearly determining a difference from a normal operation. It is an operation that can be performed.

If the operation is a switching operation to the menu mode, the state is switched to the menu mode (S40).
7), as shown in FIG. 5B, the work target object 501 that has been working so far is changed to the menu display object 503 and displayed. Here, the work target object 501
Is executed. The menu display object 503 is, for example, as shown in FIG.
The cube is replaced with a cube having three axes of d, Green, and Blue (S408).

The user interface control device of the present invention deletes the work object 501 displayed on the display device in association with the sensor operated by the user, and performs processing for associating the menu display object 503 with the same sensor. Therefore, the user can move and rotate the menu display object 503 by moving and rotating the same three-dimensional sensor. Then, the user selects the menu display object 5
03 can be freely moved and rotated, and a menu can be selected using the work object 502. For example, (Red, Green,
The position of (0,0,0) on the (Blue) space is the work object 5
02, Red, Green, Blue
This means that 0 has been selected for each item. Since the user interface control device of the present invention is configured such that the position in the three-dimensional space is used as the input information,
Selection of three value items can be realized by one operation.

Then, the process returns to S402 and the same operation is repeated. If the operation is not the switching operation to the menu mode (No in S406), step S414.
In the processing in the work mode, for example, the work object 5
After performing processing such as coloring for 01, the process returns to S402 in the operation mode state and performs an operation on the operation target object 501.

If it is determined in S405 that the operation mode is not the work mode, it is determined whether a menu is selected (S409). When the menu is selected, processing is performed according to the selected menu (S410),
The mode is switched to the work mode (S412). If the menu has not been selected, it is determined whether or not the operation is for canceling the menu mode (S411). When the menu mode is canceled, the mode is switched to the work mode (S412). The process of releasing the menu mode is a process executed by a predetermined operation such as, for example, ending the selection of the menu shown in the menu mode or clicking a setting end button in the menu mode.

When the mode is switched to the work mode, as shown in FIG. 5C, the menu display object 503 is replaced with the original work object 501 (S413), and the operation using the work object 502 for the work object 501 is continued. It can be performed. Then, the process returns to S402 again and repeats the same operation. Note that the order of S409 and S411 may be reversed. When the menu mode is not canceled (No in S411), the process returns to S402 in the menu mode.

By such processing, the user can operate the same sensor on the same screen as that on which the work on the work target object 501 is being performed, without changing the sensor on which the work is being performed. As described above, the menu display object can be moved / rotated, and the menu can be selected.

Also, after the menu is selected or the menu mode is canceled, the menu display object is automatically replaced with the work object, so that the user can continue to make various selections and settings using the menu. The process can be continuously performed on the work target object without changing the operation target operated by the user or changing the viewpoint.

FIG. 6 is a block diagram for explaining the function of the control means for realizing display switching by mode switching processing. In FIG. 6, an input unit 601 is a three-dimensional data input device that functions as a work target object sensor or a menu display object sensor. The input unit 602 is a three-dimensional data input device that functions as a work object sensor.
The control unit 603 includes a mode setting unit 604, a 3D object display control unit 605,
6. Menu display object data 607, work object data 6
08. Note that the control means 603 includes the central processing unit 101, the program memory 10 in the configuration of FIG.
2. It corresponds to the data memory 103 and the frame memory 104.

The 3D object display control means 605
In the work mode, the input unit 601 and the input unit 602
, Receiving three-dimensional display parameters from the work object data 606 and the work object data 608 to generate display data of the work object and the work object and displaying them on the display means 609. . When the mode is switched from the work mode to the menu mode, the 3D object display control unit 605 stops acquiring the three-dimensional display parameters from the work object data 606 and outputs the three-dimensional display parameters from the menu display object data 607. The acquisition of parameters is started, and an object menu display object reflecting the three-dimensional data of the input means 601 is displayed on the display means. When the mode is switched from the menu mode to the work mode, the reverse process is executed.

[Modification] In the above-described example, as shown in FIG.
Although the form that displays colors that can be set in the dimensional space has been described,
For example, as shown in FIG. 7A, a configuration may be adopted in which a plurality of colors are limitedly displayed on the surface of the menu display object. In the case of the configuration of the menu display object 701 as shown in FIG. 7A, the user designates and selects the surface of the menu display object 701 with the work object 702. The user can select a desired color by changing the direction of the three-dimensional sensor corresponding to the menu display object 701 and designating a desired color with the sensor corresponding to the work object.

Further, as shown in FIG. 7B, by displaying a menu display object 703 in which a plurality of colors are changed in luminance, it is possible to express more options than in FIG. 7A. can do. In the example shown in FIG. 7B, the menu display object 703 has a spherical shape, and is configured so that the luminance at the lower portion is low and the luminance increases toward the upper portion. The work object 704 can indicate an arbitrary position.
As described above, the user interface control device of the present invention configures a three-dimensional menu and displays it on the display,
Since the three-dimensional menu is configured to freely rotate and change the posture, menu selection can be performed more efficiently than conventional menu selection on a two-dimensional plane. By making the menu display object a three-dimensional shape, the shape of the menu is not restricted, and a menu of any shape can be realized. The user can freely change the position and angle of the selectable menu and arrange it on the display. it can.

The menu display object having a three-dimensional configuration according to the present invention can be applied to other than the above-described color selection menu. FIG. 8 shows an example of the configuration. The menu display object 801 in FIG. 8 has various processing menus, such as “file open” and “file save”, which are conventionally arranged in a plane on a partial area of the display, and is fair around a three-dimensional cylindrical shape. Things. As described above, by conventionally aligning the menus, which are conventionally displayed in a single horizontal row in a plane, three-dimensionally, even when the number of menus is increased, the menus can be displayed more compactly and obstruct the work area. Absent.

FIG. 9 shows an example in which the user interface control device of the present invention is applied to a three-dimensional model deformation operation.
Shown in The processing in the three-dimensional model processing device of FIG. 9 will be described.

As shown in FIG. 9, various work objects having a columnar shape or a triangular prism shape are facilitated with respect to the work object 901. These work objects move on the display corresponding to the processing tools (sensors) that can be freely operated by the user as described above with reference to FIGS. When the work object 902 comes into contact with the work object 901 by a user operation on the tool, the work object 901 is deformed according to the shape of the work object 902. In this example,
The menu selection is a process of changing the shape of the work object 902 and changing the deformed shape, that is, a process of selecting one work object from a plurality of work objects as shown in FIG. 9B.

In FIG. 9A, a cylinder is used as the work object 902. Here, when changing the work object 902 to another shape, the user switches to the menu mode (FIG. 9B). In the menu mode, the work target object 901 that has been displayed as a sphere is replaced with a menu display object 903.

Here, as the menu display object 903, a plurality of selectable objects are displayed in a box. By displaying a selectable object as a three-dimensional object in this way, a more intuitive menu selection can be made as if the user were actually holding a work object. In the above example, only the process of replacing the work target object with the menu display object at the time of switching from the work mode to the menu mode is executed. However, in this example, it can be understood from FIGS. 9A and 9B. At the same time, the work object 902 is also replaced by the selection object 904.

As described above, when switching to the menu mode, not only the work object 901 is replaced with the menu display object 903, but also the work object 902 is changed to the selection object 90.
By replacing with 4, the user can execute the work process in the work mode and the menu selection process in the menu mode without changing the sensor that is the same operation target at all.

In the example of FIG. 9, it is assumed that a triangular prism is designated by the selection object 904 from the menu display object 903 and selected as a work object in the menu mode of FIG. 9B. By the selection processing, the menu display object 903 is replaced with the work target object 901 again, and the selection object 904 is replaced with the selected work object 902 as shown in FIG. 9C. In the work mode, a deformation operation can be performed on the work object 902 having the selected shape.

FIG. 10 is a block diagram for explaining the function of the control means for realizing display switching between a work object and a work object by mode switching processing. In FIG. 10, an input unit 1001 is a three-dimensional data input device that functions as a work target object sensor or a menu display object sensor. The input unit 1002 is a three-dimensional data input device that functions as a work object sensor or a selection object sensor. The control unit 1003 includes the mode setting unit 100
4, 3D object display control means 1005, work object data 1006, menu display object data 100
7, work object data 1008, selection object data 100
9 Note that the control means 1003 includes the central processing unit 101 and the program memory 10 in the configuration of FIG.
2. It corresponds to the data memory 103 and the frame memory 104.

3D object display control means 1005
Receives the three-dimensional data input from the input unit 1001 and the input unit 1002 in the work mode and receives the work object data 1006 and the work object data 1008 to 3
A parameter for dimensional display is acquired, display data of the work target object and the work object is generated, and displayed on the display unit 1010. When the mode is switched from the work mode to the menu mode, the 3D object display control unit 1005 stops acquiring the three-dimensional display parameters from the work object data 1006 and outputs the menu display object data 1007.
, The acquisition of the three-dimensional display parameters from the work object data 1008 is stopped, and the acquisition of the three-dimensional display parameters from the selection object data 1009 is started. An object menu display object reflecting the three-dimensional data of the input means 601 is displayed on the display means, and a selection object reflecting the three-dimensional data of the input means 602 is displayed. When the mode is switched from the menu mode to the work mode, the reverse process is executed.

FIG. 11 shows an example in which, by switching the work object using the menu display object described with reference to FIG. 9, a deformation process is performed on the work object 901 using the columnar and triangular work objects 902. I have. The user executes a process such as bringing the sensor corresponding to the work target object and the sensor corresponding to the columnar or triangular prism-shaped work object closer to each other, thereby executing the deformation process of the work target object 901 displayed on the display. be able to.

The present invention has been described in detail with reference to the specific embodiments. However, it is obvious that those skilled in the art can modify or substitute the embodiment without departing from the spirit of the present invention. That is, the present invention has been disclosed by way of example, and should not be construed as limiting. In order to determine the gist of the present invention, the claims described at the beginning should be considered.

[0067]

As described above, according to the user interface control device and the user interface control method of the present invention, when executing various processes such as deformation and coloring of an object, the user can select an operation target. Menus can be set and selected without switching or switching, and without moving the line of sight from the same display screen as the work area.
Menu selection becomes possible.

Further, according to the user interface control device and the user interface control method of the present invention,
The distinction between the work space and the menu space is eliminated, and the work and menu selection can be performed on the same screen. Further, the input device used for the work, for example, the three-dimensional position input device, etc., can be replaced with another input device, for example, a mouse, and the trouble of selecting a menu can be omitted. The method can be unified, and the burden on the user is reduced.

Further, a configuration in which a menu is displayed three-dimensionally enables a plurality of menus to be displayed in a compact manner, and a plurality of items can be simultaneously selected by using a position in a three-dimensional space as input information. It is possible. Also, the menu is displayed only when a predetermined operation is performed instead of always displaying the menu, and when the menu is selected or the menu selection is released, the object on which the menu is displayed becomes the target of the original work. Therefore, the work space or the menu space can be set large, and the operation by the user can be continuously performed, so that efficient work can be performed.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of a three-dimensional model processing device including a user interface control device of the present invention.

FIG. 2 is a diagram illustrating an outline of processing of a three-dimensional model processing apparatus including a user interface control device of the present invention.

FIG. 3 is a configuration diagram of a three-dimensional model processing device including a user interface control device of the present invention.

FIG. 4 is a processing flowchart of a three-dimensional model processing apparatus including a user interface control device of the present invention.

FIG. 5 is a diagram illustrating a specific example of a process of a three-dimensional model processing device including a user interface control device of the present invention.

FIG. 6 is a functional block diagram for executing a display switching process by mode switching in the user interface control device of the present invention.

FIG. 7 is a diagram showing an example of a menu display in the user interface control device of the present invention.

FIG. 8 is a diagram showing a menu display example in the user interface control device of the present invention.

FIG. 9 is a diagram illustrating a specific example of the processing of the three-dimensional model processing device including the user interface control device of the present invention.

FIG. 10 is a diagram illustrating an outline of processing of a three-dimensional model processing apparatus including a user interface control device of the present invention.

FIG. 11 is a diagram illustrating a specific example of the processing of the three-dimensional model processing device including the user interface control device of the present invention.

[Explanation of symbols]

 Reference Signs List 101 Central processing unit (CPU) 102 Program memory 103 Data memory 104 Frame memory 105 Image display device 106 Input device 107 Bus 201, 202 Three-dimensional position / angle sensor 203 Display device 204 Object to be processed 205 Processing tool 301 Central processing unit ( CPU) 302 Program memory 303 Data memory 304 Frame memory 305 Image display device 306 Z buffer 310 Data input unit 311 Magnetic source 312 Processing object tool 312 313 Processing tool 314 Interface 501 Work target object 502 Work object 503 Menu display object 601 and 602 Input means 603 Control means 604 Mode setting means 605 3 Object display control means 606 Work object data 607 Menu display Body data 608 Work object data 609 Display means 701 Work object 702 Work object 703 Menu display object 704 Selection object 801 Menu display object 901 Work object 902 Work object 903 Menu display object 904 Selection object 1001, 1002 Input means 1003 Control Means 1004 Mode setting means 1005 3 object display control means 1006 Work object data 1007 Menu display object data 1008 Work object data 1009 Selection object data 1010 Display means

 ──────────────────────────────────────────────────続 き Continued on the front page (72) Inventor Hiroyuki Shioya 1-14-10 Higashi-Gotanda, Shinagawa-ku, Tokyo Inside Sony Kihara Research Laboratories Co., Ltd. (72) Inventor Tetsuichi Kai 1-1-14 Higashi-Gotanda, Shinagawa-ku, Tokyo No. 10 F-term in Sony Kihara Laboratory (reference) 5B050 BA09 CA07 EA27 FA02 FA13 5B068 AA05 AA14 AA22 EE06 5E501 AA02 AC09 BA03 BA05 CA02 CB09 FB22 FB24 FB25 FB28

Claims (19)

[Claims] 1. A user interface control device in a three-dimensional model processing device for executing display of an object on a display device based on position data in a three-dimensional space, wherein the work target is a processing target displayed on the display device. A process for switching between two modes, a work mode for executing a process on an object and a menu mode for setting a mode of the process, is performed. In the process for switching from the work mode to the menu mode, a work target displayed on a display device is displayed. A user interface control device, comprising: control means for executing a process of replacing an object with a menu display object. 2. The user interface control device according to claim 1, wherein the control means is configured to three-dimensionally display the menu display object on the display device. 3. The control means displays the menu display object three-dimensionally on the display device, and sets three-dimensional coordinates by specifying three-dimensional coordinates for the menu display object displayed on the display device. The user interface control device according to claim 1, wherein the user interface control device is configured to execute a value selection. 4. The user interface control device according to claim 3, wherein the three-dimensional set values are RGB values. 5. The apparatus according to claim 1, wherein the control means executes a process of replacing a menu display object displayed on a display device with a work target object in the process of switching from the menu mode to the work mode. The user interface control device according to claim 1, wherein: 6. The control means executes processing for an object to be processed, and executes processing for selecting the object to be displayed on the display device in the process of switching from the operation mode to the menu mode. 2. The apparatus according to claim 1, further comprising a process of executing a process of replacing the object with a selection object to be performed.
3. The user interface control device according to claim 1. 7. The work object is a deformation processing tool that executes a deformation process on the work target object, and the control unit displays a plurality of different deformation processing tools that execute different deformation processes as the menu display object. The user interface control device according to claim 6, wherein 8. The system according to claim 1, wherein said control means executes a process of replacing a selection object displayed on a display device with a work object in the process of switching from the menu mode to the work mode. 7. The user interface control device according to 6. 9. A method for controlling a user interface in a three-dimensional model processing device for displaying an object on a display device based on position data in a three-dimensional space, wherein the work target is a processing target displayed on the display device. A mode switching step of executing a process of switching between two modes: a work mode for executing a process on an object and a menu mode for setting a mode of the process; and a display device for executing the process of switching from the work mode to the menu mode. A display switching step of replacing the work target object displayed in (1) with a menu display object. 10. The user interface control method according to claim 9, wherein in the display switching step, the menu display object is three-dimensionally displayed on the display device. 11. The user interface control method, wherein the menu display object is three-dimensionally displayed on the display device, and the menu display object is displayed on the display device in three-dimensional coordinates. 10. The user interface control method according to claim 9, wherein the setting value is selected. 12. The user interface control method according to claim 11, wherein the three-dimensional set values are RGB values. 13. The display switching step, wherein, in the process of switching from the menu mode to the work mode, a process of replacing a menu display object displayed on a display device with a work target object is performed. The user interface control method according to claim 9, wherein 14. In the display switching step, a process is performed on an object to be processed and a work object displayed on the display device is selected for the menu display object when the process of switching from the work mode to the menu mode is performed. 10. The user interface control method according to claim 9, wherein a process of replacing the object with a selection object for performing the process is performed. 15. The user interface control method, wherein the work object is a deformation processing tool that executes a deformation process on the work target object, and a plurality of different deformation processing tools that execute different deformation processes as the menu display object. 15. The user interface control method according to claim 14, wherein is displayed. 16. The user interface control method according to claim 14, wherein in the process of switching from the menu mode to the work mode, a process of replacing a selection object displayed on a display device with a work object is executed.
2. The user interface control method according to item 1. 17. A three-dimensional modeling device for executing a process on a work target object displayed on a display device, comprising: a display device for displaying the work target object and the work object on the display device; and each of the work target object and the work object. The relative movement of the work object sensor and the work object tool sensor corresponding to within the action area where the three-dimensional position of each sensor can be obtained,
A data input unit for generating three-dimensional position data according to the change in the relative position; a work target object and a display of the work object displayed on the display device based on the three-dimensional position data of the sensor from the data input unit In addition to updating the mode, a mode switching process is performed between a work mode for executing the process on the work target object and a menu mode for setting the mode of the process. A three-dimensional modeling apparatus comprising: a control unit that executes a process of replacing a work target object displayed on a display device with a menu display object. 18. The apparatus according to claim 18, wherein said control means executes a process of replacing a menu display object displayed on a display device with a work target object in said switching process from said menu mode to work mode. The three-dimensional modeling device according to claim 17, wherein: 19. A user interface control process in a three-dimensional model processing device for displaying an object on a display device based on position data in a three-dimensional space.
A program providing medium for providing a computer program to be executed on a system, the computer program comprising: a work mode for executing a process on a work target object to be processed displayed on the display device; A mode switching step of executing a process of switching between two modes, ie, a menu mode for setting a display mode, and a display switching for replacing a work object displayed on a display device with a menu display object in the process of switching from the work mode to the menu mode. A program providing medium, comprising: a step;