JP2000305760A - Program selection executing device and data selection executing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize an operation environment being familiar to a user who is unfamiliar to a personal computer by executing judgement based on information where it holds what is a program corresponding to a judged surface and deciding the program to be executed. SOLUTION: When a user inputs a selection control signal from a selection input means 115 in a state where a surface which displays the program desired to start an operation is turned forward, a selection surface judging means 116 obtains a counting value at that point of time from a counter means 114 as a counting information, the surface which is turned forward when the selection control signal is inputted is judged based on the information and the surface is outputted as selection surface information. Then a program deciding means 118 obtains the selection surface information, refers to surface-to-program correspondence information which is held in a correspondence list holding means 117 and outputs the program corresponding to the surface which is indicated by selection surface information as selection program information. A program executing means 119 executes the program which is specified by inputted selection program information.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a program selection and execution device for selecting and executing a program on a personal computer or the like, and a data selection and execution device for selecting and executing data on a personal computer. The present invention relates to a program selection and execution device and a data selection and execution device capable of realizing an easy and intuitive operation environment.

[0002]

2. Description of the Related Art In a conventional two-dimensional interface represented by Windows (registered trademark of Microsoft Corporation), selection and execution of programs and data are performed by
A method of selecting items displayed in parallel on a two-dimensional screen in a menu or the like with a pointing device such as a mouse is used. In this method, when the number of items to be selected increases, some items are not displayed in the display area. When the item to be selected is not displayed in the display area, the user performs an operation such as scrolling the display area to select the item. After displaying the item to be displayed in the display area, it is necessary to select the item with a pointing device such as a mouse.

[0003]

A program selection and execution device and a data selection and execution device using a menu display in a conventional two-dimensional interface can be easily operated by a user who is accustomed to operating a personal computer or the like. However, it is difficult for a user who is not used to operating a personal computer or the like to intuitively understand the operation.

The present invention has been made in order to solve the above-mentioned problems, and has been made in consideration of the above-mentioned problems. It is an object to provide a selection execution device.

[0005]

According to a first aspect of the present invention, there is provided a program selection and execution apparatus for selecting and executing a program, wherein a plurality of surfaces are fixed with respect to a center axis. A selection object for displaying on a display screen an image in which a selection object in which a texture indicating a program content is pasted on each of the surfaces of a three-dimensional rotator object arranged at intervals of 3 is arranged in a three-dimensional virtual space. For the display means and the object display means for selection,
Rotation display control means for providing a rotation display control signal for displaying an image in which the selection object rotates about the center axis in the three-dimensional virtual space as a center of rotation, and a selection in which a selection input for selecting a program is input Input means, and selection surface determination means for determining which of the plurality of surfaces constituting the three-dimensional rotator object faces the front on the display screen when a selection input is input from the selection input means, The correspondence holding means for holding information indicating the correspondence between a plurality of faces constituting the three-dimensional rotating object and the program, and the program associated with the face determined by the selected face determination means are described above. A program determining unit that determines based on the information held in the correspondence holding unit and determines a program to be executed, and a program determined by the program determining unit. It is obtained by a program executing means for lines.

According to a second aspect of the present invention, in the program selection and execution device according to the first aspect, the rotation display control means selects the rotation display control signal according to a rotation instruction input externally input. To the object display means.

According to a third aspect of the present invention, in the program selection execution device according to the first aspect, the rotation display control means stores information for rotating the selection object in a predetermined pattern. Means for providing the rotation display control signal to the selection object display means based on the information held in the holding means.

According to a fourth aspect of the present invention, in the program selection and execution apparatus according to the second aspect, the rotation display control means stores information for rotating the selection object in a predetermined pattern. Means for outputting the rotation display control signal to the selection object display means in response to the rotation instruction input when the rotation instruction input is externally input, and holding the rotation display control signal in the holding means when the rotation instruction input is not externally input. The rotation display control signal is provided to the object display means for selection based on the obtained information.

According to a fifth aspect of the present invention, there is provided the program selection and execution apparatus according to any one of the first to fourth aspects, wherein the selection object is rotated on a display screen by rotating the three-dimensional object. Among a plurality of surfaces constituting the display device, a counter means for counting the number of times a face facing the front is switched and outputting count information, wherein the selected face determination means displays a display screen based on the count information output by the counter. This is to determine the surface facing the front in the upper part.

According to a sixth aspect of the present invention, in the program selection and execution apparatus according to any one of the first to fourth aspects, the selected surface determining means includes the selection object display means and the selection object display means includes the selection object display means. This is to determine the surface facing the front on the display screen based on the depth information obtained when displaying the object on the screen.

Further, according to the present invention (claim 7), in the program selection execution device according to any one of claims 1 to 4, the selection plane determining means rotates the selection object from an initial state. This is to determine the surface facing the front on the display screen based on the rotation angle information indicating the angle.

According to the present invention (claim 8), in the program selection / execution device according to any one of claims 1 to 4, when the selected program has an execution display screen at the time of execution, the program is executed. A screen display switching means for switching the screen display so that the execution display screen is sometimes displayed.

According to a ninth aspect of the present invention, in the data selecting and executing apparatus for selecting and executing data, the three-dimensional rotator object in which a plurality of surfaces are arranged at regular intervals with respect to a central axis is provided. Selection object display means for displaying on a display screen an image in which a selection object in which a texture indicating data content is pasted on each surface in a three-dimensional virtual space, and selection object display means
Rotation display control means for providing a rotation display control signal for displaying an image in which the selection object rotates about the central axis in the three-dimensional virtual space as a center of rotation, and a selection in which a selection input for selecting data is input Input means, and selection surface determination means for determining which of the plurality of surfaces constituting the three-dimensional rotator object faces the front on the display screen when a selection input is input from the selection input means, What is the first correspondence holding means for holding information indicating the correspondence between the plurality of faces constituting the three-dimensional rotating object and the data, and what data is associated with the faces determined by the selected face determination means. Is determined based on the information held in the first correspondence holding means, and the correspondence between the data and a program for opening the data is shown. A second correspondence holding means for holding information, and a program to be executed to open the data determined by the data determination means should be determined based on the information held in the second correspondence holding means and executed. A program determining means for determining a program, and a program executing means for executing the program determined by the program determining means and opening the data determined by the data determining means.

The present invention (claim 10) provides claim 9
In the data selection execution device described above, the rotation display control means provides the rotation display control signal to the selection object display means in response to a rotation instruction input from outside.

[0015] The present invention (claim 11) provides claim 9
In the data selection execution device described above, the rotation display control unit includes a holding unit that holds information for rotating the selection object in a predetermined pattern, and the rotation display control unit performs the rotation based on the information held in the holding unit. The display control signal is given to the selection object display means.

The present invention (Claim 12) provides Claim 1
0, the rotation display control means includes a holding means for holding information for rotating the selection object in a predetermined pattern, and when a rotation instruction input is input from outside, the rotation display control means performs the rotation. The rotation display control signal is supplied to the selection object display means in response to the instruction input, and when the rotation instruction input is not input from the outside, the rotation display control signal is selected based on the information held in the holding means. To give.

The present invention (claim 13) provides claim 9
13. The data selection execution device according to claim 12, wherein the number of times the selection object rotates on the display screen to switch a front-facing surface among a plurality of surfaces constituting the three-dimensional rotating object. Counter means for counting and outputting count information, wherein the selected face determination means determines the face facing the front on the display screen based on the count information output by the counter.

The present invention (claim 14) provides claim 9
13. The data selection execution device according to claim 12, wherein the selection surface determination unit is configured to display on the display screen based on depth information obtained when the selection object display unit displays the selection object on a screen. This is to determine the surface facing the front.

The present invention (claim 15) provides claim 9
13. The data selection execution device according to claim 12, wherein the selection plane determination unit faces the front on a display screen based on rotation angle information indicating an angle at which the selection object has rotated from an initial state. This is to determine the surface that is present.

The present invention (claim 16) provides claim 9
16. The data selection execution device according to claim 15, wherein when a program to be executed has an execution display screen at the time of execution, screen display switching is performed such that the execution display screen is displayed at the time of program execution. Means.

The present invention (claim 17) provides claim 9
17. The data selection execution device according to claim 16, wherein the selection object display means reproduces the moving image data when the data associated with each surface of the three-dimensional rotating object is the moving image data. Is obtained by pasting the image obtained as a texture on the corresponding surface.

The present invention (claim 18) provides claim 1
7. The data selection execution device according to claim 7, wherein the selection object display means is a moving image associated with a surface facing the front of the plurality of surfaces constituting the three-dimensional rotating object on the display screen. The moving image obtained by reproducing the data is pasted as a texture, and the moving image data corresponding to the surface is displayed on the surface not facing the front on the display screen among the plurality of surfaces constituting the three-dimensional rotating object. A still image extracted from a moving image obtained by reproduction is pasted as a texture.

The present invention (claim 19) provides claim 9
20. The data selection execution device according to claim 18, wherein the data associated with each surface of the three-dimensional rotating object is audio data, moving image data, or moving image data accompanied by audio data. Data reproduction display means for reproducing and displaying associated data in conjunction with the display of the selection object, wherein the surface facing the front on the display screen by the rotation of the selection object is shifted from the first surface. When switching to the second surface adjacent to the first surface, the reproduction display of the data associated with the first surface is faded out, and the reproduction display of the data associated with the second surface is faded. Data reproduction display means for performing reproduction display so as to enter the data.

The present invention (claim 20) provides claim 9
20. The data selection execution device according to claim 18, wherein when the data associated with each surface of the three-dimensional rotating object is data including audio data, the data is also displayed together with the display of the selection object. Data reproduction display means for reproducing and displaying the data to be attached, wherein a surface facing the frontmost on the display screen is rotated from the first surface to the second surface adjacent to the first surface by rotation of the selection object.
When switching to the second plane, the reproduction sound source position of the data associated with the first plane and the reproduction sound source position of the data associated with the second plane are displayed on the display screen in the first and second positions. Data reproduction display means for performing reproduction display by moving the surface in accordance with the movement of the surface position is provided.

[0025]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiment 1 FIG. 1 is a block diagram showing a configuration of a program selection and execution device according to the first embodiment of the present invention. In FIG. 1, reference numeral 101 denotes a rotation instruction input unit that inputs an instruction for rotating a three-dimensional rotator object in a three-dimensional virtual space; 102, a parameter holding unit that holds parameters for rotating the three-dimensional rotator object;
Reference numeral 103 reads a parameter before change from the parameter storage unit 102 based on the rotation instruction control signal from the rotation instruction input unit 101, changes the parameter, records it as a parameter after change in the parameter storage unit 102, and outputs a counter control signal. It is a parameter changing means. In the first embodiment, the rotation instruction input unit 101, the parameter holding unit 102, and the parameter changing unit 103 function as a rotation display control unit. Reference numeral 104 denotes a three-dimensional model coordinate holding unit that holds coordinate information of an object forming a three-dimensional virtual space including a three-dimensional rotating object, and 105 reads parameter information from the parameter holding unit 102,
The coordinate conversion means 106 reads the three-dimensional model coordinates from the three-dimensional model coordinate holding means 104 and performs coordinate conversion, and outputs the converted model coordinates. Reference numeral 106 denotes the converted model coordinates and viewpoint coordinates output from the coordinate conversion means 105. Is a perspective transformation unit that performs perspective transformation on a display screen of a three-dimensional virtual space including a three-dimensional rotating object and outputs projection plane coordinates. A hidden surface processing unit 107 reads projection plane coordinates from the perspective transformation unit 106, excludes hidden and not displayed regions, extracts only displayed regions, and outputs depth information and raster information after hidden surface processing. Denotes a depth information holding unit that holds the depth information extracted by the hidden surface processing unit 107, and 109 denotes a texture holding unit that holds a texture to be attached to each surface. The texture to be attached to the three-dimensional rotating object in the present embodiment is an image for identifying a corresponding program, and uses a program name, an icon image corresponding to the program, and the like. Reference numeral 110 denotes a texture mapping unit that pastes a texture read from the texture holding unit 109 based on the depth information held by the depth information holding unit 108 with respect to the hidden surface processed raster information in which the depth information is considered by the hidden surface processing unit 107. Means. Reference numeral 111 denotes the depth information holding unit 108 in the frame information after texture mapping output by the texture mapping unit 110.
A rendering unit that renders all pixel information such as the color and brightness of each pixel based on the depth information held by the rendering unit 112; a frame buffer that retains frame information rendered by the rendering unit 111; Is a screen display means for outputting and displaying the frame information held at a predetermined timing.
In the first embodiment, the three-dimensional model coordinate holding unit 104 to the screen display unit 113 are configured to program the respective surfaces of the three-dimensional rotating object in which a plurality of surfaces are arranged at regular intervals with respect to the central axis. Functions as a selection object display means for displaying on a display screen an image in which a texture (selection object) indicating the contents of (1) is attached in a three-dimensional virtual space. Reference numeral 114 denotes counter means for increasing a counter by a counter control signal from the parameter changing means 103; 115, selection input means for determining and inputting a program to be selected by the user; 116, count information and selection input from the counter means 114. A selection surface determination unit for determining a selected surface based on the selection control signal from the unit; a correspondence relationship between each surface constituting the three-dimensional rotating object and a program (plane-program correspondence information); And a correspondence table holding means for holding a correspondence table indicating a correspondence relationship between each surface and a texture (surface-texture correspondence information). FIG. 3 is a diagram showing an example of the correspondence table held by the correspondence table holding means 117. Reference numeral 118 denotes a program determining unit that determines a program to be executed by referring to the correspondence information (surface-program correspondence information) read from the correspondence table holding unit 117 from the selected surface information output by the selected surface determination unit 116. Program determination means 118
Is a program executing means for executing a program based on the selected program information selected by the program.

Next, the operation of the program selection and execution device according to the first embodiment will be described. The program selection and execution device according to the first embodiment allocates a program to each surface of a three-dimensional rotating object arranged in a three-dimensional virtual space, rotates the surface, and performs a predetermined operation by the user. To start a program associated with the surface facing the front most with respect to the viewpoint.

In the program selection execution device according to the first embodiment, when the program selection operation mode starts, the initial coordinates of the three-dimensional rotating object held in the three-dimensional model coordinate holding means 104 in the three-dimensional virtual space are read. The perspective transformation means 106 performs perspective transformation to a display screen of a three-dimensional virtual space including the three-dimensional rotating object using the initial coordinates and the viewpoint coordinates, and outputs projection plane coordinates. That is, during the initial display operation in the program selection operation mode, the coordinate conversion means 105 outputs the coordinates of the initial coordinates read from the three-dimensional model coordinate holding means 104 to the perspective transformation means 106 without conversion. The hidden surface processing unit 107 reads the projection plane coordinates from the perspective transformation unit 106, excludes the hidden and undisplayed area, extracts only the displayed area, and outputs depth information and post-hidden processed raster information. The texture mapping unit 110 pastes the texture read from the texture holding unit 109 based on the depth information held by the depth information holding unit 108 on the hidden surface processed raster information in which the depth information is considered by the hidden surface processing unit 107. wear. Here, the correspondence between each surface of the three-dimensional rotator object and the texture is obtained by reading the correspondence information (plane-texture correspondence information) from the correspondence table holding means 117. The rendering unit 111 renders all pixel information such as the color and brightness of each pixel based on the depth information held by the depth information holding unit 108 in the frame information after texture mapping output by the texture mapping unit 110. The frame information drawn by the rendering means 111 is held in the frame buffer 112, and the screen display means 113 reads out the frame information held in the frame buffer 112 at a predetermined timing and displays the screen. Thereby, the screen of the initial state of the program selection operation mode is displayed.

FIG. 2 is a diagram showing an example of a three-dimensional rotating object placed in a three-dimensional virtual space in the program selection and execution device according to the first embodiment. In the present invention, a three-dimensional rotator object arranged in a three-dimensional virtual space is a three-dimensional object composed of a plurality of surfaces, each surface being arranged at a fixed interval with respect to a central axis. FIG. 2 shows that the three-dimensional rotating object has six surfaces, and the central axis of rotation is arranged in the horizontal direction in the three-dimensional virtual space.

When the user inputs a rotation instruction control signal from the rotation instruction input means 101 in a state where the screen of the initial state is displayed, the parameter changing means 103 outputs a parameter based on the rotation instruction control signal from the rotation instruction input means 101. A parameter before change (here, a parameter in an initial state) is read from the holding unit 102, the parameter is changed and recorded as a changed parameter in the parameter holding unit 102, and a counter control signal is output to the counter unit 114. The coordinate transforming means 105 is a parameter holding means 10
2 is read out, and the changed model coordinates obtained by converting the coordinates of the initial coordinates read out from the three-dimensional model coordinate holding means 104 using the changed parameters are output to the perspective transformation means 106. The perspective transformation unit 106 performs perspective transformation to a display screen of a three-dimensional virtual space including the three-dimensional rotating object using the changed model coordinates and viewpoint coordinates, and outputs projection plane coordinates. After this,
Hidden surface processing means 107, texture mapping means 11
0, rendering means 111, frame buffer 11
2, and the screen display means 113 performs the same processing as in the initial display operation of the program selection operation mode, and the screen after the rotation instruction control signal is input is displayed. For example, when the three-dimensional rotating object has the shape shown in FIG. 2, when the surface 1 is displayed with the front facing in the initial state, when the rotation instruction control signal in the forward direction is input, the three-dimensional rotating object shown in FIG. An image is displayed in which the image is rotated in the direction of the arrow and the surface 2 faces front. When a negative rotation instruction control signal is input, an image is displayed in which the image rotates in the opposite direction to the arrow in FIG. 2 and the surface 6 faces front. Is done.

Here, as the rotation instruction input means 101, the operation of the cursor key of the remote controller or the keyboard is associated with the rotation of the three-dimensional rotating object, or the movement of the mouse is associated with the rotation of the three-dimensional rotating object. What should I do? For example, if the three-dimensional rotating object is the one shown in FIG.
Correspond to the upward (the direction opposite to the arrow in FIG. 2) and downward (the direction of the arrow in FIG. 2) rotation of the three-dimensional rotating object, or the three-dimensional rotating object What is necessary is just to make it correspond to the upward and downward rotation of. In addition, if you use a mouse equipped with a rotary button called a wheel, such as a Microsoft IntelliMouse, you can rotate the wheel back and forth by 3 degrees.
What is necessary is just to make it correspond to the upward and downward rotation of the three-dimensional rotator object. If the operation is performed with a trackball, the front and rear rotation of the trackball may be made to correspond to the upward and downward rotations of the three-dimensional rotating object. In addition, if the operation is performed by an input means using voice recognition, a voice input of “up”, “do”, or similar voice input may be associated with upward and downward rotation of a three-dimensional rotating object. do it.

At the time of the rotation instruction control signal input operation, the counter means 114 performs the counting operation by the counter control signal output from the parameter changing means 103. Specifically, for example, when a rotation instruction control signal in the forward direction is input from the rotation instruction input unit 101, the parameter changing unit 103 outputs a counter control signal for incrementing the count value of the counter unit 114 by one, and the rotation instruction input unit 101 , The parameter changing means 103 outputs a counter control signal for decrementing the count value of the counter means 114 by one, and the counter means 114 receives this counter control signal and holds it by itself. Change the count value.

When the user inputs a selection control signal from the selection input unit 115 with the surface on which the program desired to be activated is displayed facing front, the selected surface determination unit 116
The count value at that time is acquired as the count information from the counter unit 114, and based on the count information, the face facing the front is determined when the selection control signal is input, and this face is output as the selected face information. For example, when the three-dimensional rotating object has the shape shown in FIG. 2, the selection surface determination unit 116 determines whether the initial state (the count value is “0”) or the remainder obtained by dividing the count value by 6 is “0”. If the face facing the front is determined to be face 1, the remainder obtained by dividing the count value by 6 is “1,” “2,” “3,” “4,”
If it is “5”, the faces facing the front are determined to be faces 2, 3, 4, 5, and 6, respectively, and the count value is set to 6
The remainder after dividing by "-1", "-2", "-3", "-
If it is "4" or "-5", the faces facing the front are determined to be faces 6, 5, 5, 4, and 2, respectively.

The program determining means 118 acquires the selected plane information from the selected plane determining means 116, and stores the correspondence table holding means 1
Referring to the plane-program correspondence information held in 17,
A program corresponding to the surface indicated by the selected surface information is output as selected program information. Program execution means 11
9 executes the program specified by the selected program information input from the program determining means 118.

As described above, in the program selecting and executing apparatus according to the first embodiment, the texture indicating the program content is attached to each surface of the three-dimensional rotating object arranged in the three-dimensional virtual space (selection object). ) Is displayed on the screen, and the user rotates the three-dimensional rotating object by giving an instruction by a predetermined operation, counts how many times the rotation instruction operation is repeated, and performs a predetermined selection operation by the user. Is performed, the surface facing the front of the user's viewpoint is determined from the count value, the program associated with that surface is selected with reference to the correspondence table, and the program is started. Because it was configured, 3
By using a three-dimensional rotating object in a three-dimensional virtual space, it is possible to associate the image of rolling a cylindrical rotating object in the real world, and an intuitive operating environment that is familiar to users who are not used to personal computers. Can be realized.

As an example of the three-dimensional rotating object arranged in the three-dimensional virtual space in the program selecting and executing apparatus according to the first embodiment, the three-dimensional rotating object has six surfaces, Although the central axis is shown as being arranged in the horizontal direction in the three-dimensional virtual space, the number of surfaces constituting the three-dimensional rotating object is not limited to six, but is two to five.
The number of screens or seven or more screens may be used, and the displayed rotator may be changed according to the number of programs to be supported. When the number of programs is larger than the number of surfaces of the rotating body, all the programs may be selectable by sequentially switching the program information to be attached to the surfaces at a predetermined timing. For example, only a specific program may be selected or displayed. Further, the center axis of rotation may be arranged in a vertical direction or an oblique direction in the three-dimensional virtual space.

Embodiment 2 FIG. 4 is a block diagram showing a configuration of the program selection and execution device according to the second embodiment of the present invention. 4, the same reference numerals as those in FIG. 1 denote the same or corresponding parts. A rotation 120 holds a rotation angle change pattern for sequentially changing parameters so as to rotate the three-dimensional rotating object in the three-dimensional virtual space, and sequentially outputs the changed parameters in response to a request from the coordinate conversion unit 121. This is an angle change pattern holding unit. In the second embodiment, the rotation angle change pattern holding means 120 functions as rotation display control means. The coordinate conversion means 121 receives the display end signal output from the screen display means 113, requests the rotation angle change pattern holding means 120 to output the changed parameter information, and responds to this request to output the rotation angle change pattern holding means 120. Performs coordinate conversion of the three-dimensional model coordinates using the changed parameter information output by the controller, outputs the converted model coordinates, and outputs a counter control signal to the counter means every time the coordinate conversion is performed.

Next, the operation of the program selection and execution apparatus according to the second embodiment will be described. The program selection and execution apparatus according to the second embodiment is configured to automatically rotate at a predetermined rotation angular velocity instead of inputting a rotation instruction by a user.

In the program selection execution device according to the second embodiment, when the program selection operation mode starts, the initial coordinates of the three-dimensional rotating object held in the three-dimensional model coordinate holding means 104 in the three-dimensional virtual space are read. The perspective transformation means 106 performs perspective transformation to a display screen of a three-dimensional virtual space including the three-dimensional rotating object using the initial coordinates and the viewpoint coordinates, and outputs projection plane coordinates. That is, during the initial display operation in the program selection operation mode, the coordinate conversion means 121 outputs the coordinates of the initial coordinates read from the three-dimensional model coordinate holding means 104 to the perspective transformation means 106 without conversion. The hidden surface processing unit 107 reads the projection plane coordinates from the perspective transformation unit 106, excludes the hidden and undisplayed area, extracts only the displayed area, and outputs depth information and post-hidden processed raster information. The texture mapping unit 110 pastes the texture read from the texture holding unit 109 based on the depth information held by the depth information holding unit 108 on the hidden surface processed raster information in which the depth information is considered by the hidden surface processing unit 107. wear. Here, the correspondence between each surface of the three-dimensional rotator object and the texture is obtained by reading the correspondence information (plane-texture correspondence information) from the correspondence table holding means 117. The rendering unit 111 renders all pixel information such as the color and brightness of each pixel based on the depth information held by the depth information holding unit 108 in the frame information after texture mapping output by the texture mapping unit 110. The frame information drawn by the rendering unit 111 is held in the frame buffer 112. The screen display means 113 reads out the frame information held in the frame buffer 112 at a predetermined timing and displays the screen (display of an image in an initial state of the program selection operation mode).
When the display operation is completed, a display end signal is output to the coordinate conversion means 121.

The coordinate conversion means 121 is a screen display means 113
When a display end signal is received from the controller, a request is made to the rotation angle change pattern holding means 120 to output a parameter.
The rotation angle change pattern holding unit 120 is a coordinate conversion unit 12.
In accordance with the rotation angle change pattern being held, the three-dimensional rotating object rotates from a state in which one surface faces the front to a state in which another adjacent surface faces the front, based on the rotation angle change pattern that is held. To output the changed parameters. The coordinate conversion means 121 is provided with a rotation angle change pattern holding means 12.
The modified model coordinates obtained by converting the initial coordinates read out from the three-dimensional model coordinate holding means 104 using the changed parameters are output to the perspective transformation means 106 in response to the changed parameters output by 0. , And outputs a counter control signal to the counter means 114. The counter 114 performs a counting operation based on the counter control signal output from the coordinate converter 121. The perspective transformation unit 106 performs perspective transformation to a display screen of a three-dimensional virtual space including the three-dimensional rotating object using the changed model coordinates and viewpoint coordinates, and outputs projection plane coordinates. After this,
Hidden surface processing means 107, texture mapping means 11
0, rendering means 111, frame buffer 11
2, and the screen display means 113 performs the same processing as in the display operation of the image in the initial state of the program selection operation mode, and the screen in which the three-dimensional rotating object is rotated by a predetermined angle from the initial state is displayed. For example, when the three-dimensional rotating object has the shape shown in FIG.
Is displayed facing the front, an image is displayed in which the image is rotated in the direction of the arrow in FIG. 2 and the surface 2 faces the front. When the image display operation is completed, the screen display means 113 sends a display end signal to the coordinate conversion means 121. This allows the coordinate transformation, perspective transformation, hidden surface processing, texture mapping,
The processes of rendering and screen display are repeated, and an image in which a three-dimensional rotator object on which a texture indicating a program content is pasted on each surface is automatically rotated is displayed on the screen.

When the user inputs a selection control signal from the selection input unit 115 with the surface on which the program desired to be activated is displayed facing the front, the selected surface determination unit 11
6, the operations of the program determining means 118 and the program executing means 119 are the same as those of the program selecting and executing apparatus according to the first embodiment. Then, the selection surface determination unit 116 acquires the count value at that time from the counter unit 114 as count information, and determines the surface facing front when the selection control signal is input based on the count information. Outputs the plane as selected plane information.
The program determining unit 118 acquires the selected plane information from the selected plane determining unit 116 and refers to the plane-program correspondence information held in the correspondence table holding unit 117 to determine a program corresponding to the plane indicated by the selected plane information. Output as selected program information. The program executing means 119 executes the program specified by the selected program information input from the program determining means 118.

As described above, in the program selecting and executing apparatus according to the second embodiment, the texture indicating the program contents is attached to each surface of the three-dimensional rotating object arranged in the three-dimensional virtual space (selection object). ) Is displayed on the screen, and the parameter is automatically changed so that the three-dimensional rotating object rotates from a state in which one surface is directed to the front to a state in which another adjacent surface is directed to the front. By repeating, the three-dimensional rotating object is automatically rotated on the screen, and how many times the parameter change is repeated is counted, and when the user performs a predetermined selection operation, the user From the count value, determine the surface facing the front of the viewpoint from the count value, select the program associated with that surface with reference to the correspondence table, and start the program. By using the three-dimensional rotating object in the three-dimensional virtual space, it is possible to associate the image of rolling a cylindrical rotating body in the real world, and it is easy for a user who is not used to a personal computer to be familiar with. An intuitive operation environment can be realized, and the three-dimensional rotating object automatically rotates, so that the user only has to pay attention to the selection of the program, and the operation can be further simplified.

In the above-described second embodiment, a pattern in which the rotation angle constantly changes at a constant rotation angle has been described. The rotation angle may be changed such that the rotation angle is changed after a certain period of time after stopping.

Also, means for manually instructing the rotation of the program selection and execution device according to the first embodiment (the rotation instruction input means 101, the parameter holding means 10).
2, parameter changing means 103).
Ordinarily, the rotation may be performed according to the operation of the user, and when the user has not operated for a predetermined time, a timer is started to measure a predetermined time, and when the user exceeds the operation, the rotation may be automatically started. In such a configuration, after the automatic rotation is further started, the rotation may be stopped according to the operation of the user, and the program may be selected.

Embodiment 3 FIG. FIG. 5 is a block diagram showing the configuration of the program selection and execution device according to the third embodiment of the present invention. 5, the same reference numerals as those in FIG. 1 denote the same or corresponding parts. Reference numeral 122 denotes a depth information holding unit that holds the depth information extracted by the hidden surface processing unit 107.
123 is based on the depth information from the depth information holding unit 122 and the selection control signal from the selection input unit 115,
This is a selected surface determination unit that determines the selected surface.

Next, the operation of the program selection and execution apparatus according to the third embodiment will be described. In the program selection and execution device according to the first embodiment, the surface to be selected (the surface facing front) is determined by counting the number of rotation instructions. However, the program selection and execution device according to the third embodiment determines , Instead of the rotation instruction count value,
Based on the depth information obtained at the time of the hidden surface processing, the surface facing the front with respect to the user's viewpoint is determined.

In the program selection and execution device according to the third embodiment, the display of the screen in the initial state of the program selection operation mode and the operation by inputting the rotation instruction control signal are completely the same as those in the first embodiment. The description is omitted because it is the same.

In the program selection and execution device according to the third embodiment, when the user inputs a selection control signal from the selection input means 115 in a state where the surface on which the program desired to be activated is displayed faces forward, the selection surface determination means 116
Obtains the depth information at that time from the depth information holding means 122, determines a face facing front when a selection control signal is input based on the depth information, and outputs this face as selected face information. . For example, when the three-dimensional rotating object has the shape shown in FIG.
No. 6 determines that the surface located closest to the front in the depth information is the surface facing the front most.

The program determining means 118 obtains the selected plane information from the selected plane determining means 123 and stores the correspondence table holding means 1
Referring to the plane-program correspondence information held in 17,
A program corresponding to the surface indicated by the selected surface information is output as selected program information. Program execution means 11
9 executes the program specified by the selected program information input from the program determining means 118.

As described above, in the program selecting and executing apparatus according to the third embodiment, the texture indicating the program contents is attached to each surface of the three-dimensional rotating object arranged in the three-dimensional virtual space (selection object). ) Is displayed on the screen, and the user rotates the three-dimensional rotating object by giving an instruction according to a predetermined operation. Since the surface facing the most front is determined based on the depth information obtained at the time of hidden surface processing, the program associated with that surface is selected with reference to the correspondence table and the program is started, By using a three-dimensional rotating object in a three-dimensional virtual space, it is possible to associate an image of rolling a cylindrical rotating object in the real world, and is not used to a personal computer. It is possible to realize a familiar easy intuitive operation environment to use person.

In the third embodiment, the selection object is rotated as rotation display control means for supplying a rotation display control signal for displaying an image which rotates in the three-dimensional virtual space around the center axis as the center of rotation. Instruction input means 10
1, parameter holding means 102, parameter changing means 1
03, that is, a device for manually inputting a rotation instruction, but a rotation angle change pattern holding means is provided as in the program selection and execution device according to the second embodiment so that rotation display control is automatically performed. Needless to say, this is acceptable.

Embodiment 4 FIG. FIG. 6 is a block diagram showing a configuration of a program selection and execution device according to the fourth embodiment of the present invention. 6, the same reference numerals as those in FIG. 1 denote the same or corresponding parts. Reference numeral 124 reads a parameter before change from the parameter holding unit 102 based on the rotation instruction control signal from the rotation instruction input unit 101, changes the parameter, records it as a parameter after change in the parameter holding unit 102, and outputs rotation angle information. It is a parameter changing means.
125 is rotation angle information from the parameter changing means 124,
The selection control signal from the selection input means 115 and the rotation angle-
This is a selected plane determination unit that determines the selected plane based on the rotation angle-plane correspondence information from the plane correspondence holding unit 126.

Next, the operation of the program selection and execution apparatus according to the fourth embodiment will be described. In the program selection and execution device according to the first embodiment, the surface to be selected (the surface facing front) is determined by counting the number of rotation instructions. , Instead of the rotation instruction count value,
Based on the correspondence between the rotation angle and the plane index, the plane that faces the front with respect to the user's viewpoint is determined.

In the program selection and execution device according to the fourth embodiment, the display operation of the screen in the initial state of the program selection operation mode is completely the same as that of the program selection and execution device according to the first embodiment, and therefore the description is omitted. .

When the user inputs a rotation instruction control signal from the rotation instruction input unit 101 in a state where the screen of the initial state is displayed, the parameter changing unit 124 sets the parameter based on the rotation instruction control signal from the rotation instruction input unit 101. A parameter before change (here, a parameter in an initial state) is read from the holding unit 102, the parameter is changed, and the changed parameter is recorded in the parameter holding unit 102 as a changed parameter. Here, in the program selection and execution device according to the first embodiment, the parameter changing unit outputs the counter control signal to the counter unit 114. However, in the program selection and execution device according to the fourth embodiment, the parameter changing unit is The rotation angle information indicating how many times the three-dimensional rotator object has rotated from the initial state is output to the selection plane determination unit 125. Thereafter, the coordinate conversion means 105, the perspective transformation means 106, the hidden surface processing means 107, the texture mapping means 110, the rendering means 111, the frame buffer 112, and the screen display means 113 are the same as in the program selection and execution device according to the first embodiment. Process,
The screen after the input of the rotation instruction control signal is displayed.

In the program selection and execution apparatus according to the fourth embodiment, when the user inputs a selection control signal from selection input means 115 with the surface on which the program desired to be activated is displayed facing front, the selected surface determination means 125
Obtains the rotation angle information at that time from the parameter changing unit 124, refers to the rotation angle-plane correspondence information held in the rotation angle-plane correspondence holding unit 126, and turns the front when the selection control signal is input. The facing surface is determined, and this surface is output as selected surface information.

FIG. 7 is a diagram for explaining an example of a method for determining a face facing front in the program selection and execution apparatus according to the fourth embodiment. FIG. 7 shows an example of determination when the three-dimensional rotator object has the shape shown in FIG. 2, and the three-dimensional rotator object is viewed from the rotation axis direction. In the program selection and execution device according to the fourth embodiment, for example, as shown in FIG. The angle formed by the perpendicular to the reference line and the reference line is detected as the rotation angle, and the surface facing the front is determined with reference to the correspondence information between the rotation angle and the surface. The parameter changing unit 124 detects a rotation angle that is an angle formed by a perpendicular to the plane 1 from the rotation axis and the reference line, and outputs the detected rotation angle to the selection plane determination unit 125 as rotation angle information. The three-dimensional rotator object shown in FIG. 2 is a hexahedron, and when a certain surface is turned 60 degrees from the front, the next surface turns to the front. Then, when it is rotated 360 degrees from the initial state, it makes one rotation and becomes the initial state (rotation angle 0 degree). In this case, the rotation angle-plane correspondence information held in the rotation angle-plane correspondence holding unit 126 is:
Any information may be used as long as the information is such that the rotation angles from 0 to 360 degrees are equally divided into six ranges of 60 degrees, and surfaces 1 to 6 are associated with the respective ranges. Specifically, FIG.
(b) As shown in FIG.
When the angle is 30 degrees or more and less than 360 degrees (0 degree), the face 1 is rotated at a rotation angle of 3 degrees.
The surface 2 is set at a rotation angle of 90 degrees or more and 15 degrees or more when the rotation angle is 0 degrees or more and less than 90 degrees.
If the rotation angle is less than 0 degrees, the surface 3 is set. If the rotation angle is 150 degrees or more and less than 210 degrees, the surface 4 is set. If the rotation angle is 210 degrees or more and less than 270 degrees, the surface 5 is set.
For the rotation angle of 270 degrees or more and less than 330 degrees, the information corresponding to the surface 6 may be used.

The program determining means 118 acquires the selected plane information from the selected plane determining means 123, and
Referring to the plane-program correspondence information held in 17,
A program corresponding to the surface indicated by the selected surface information is output as selected program information. Program execution means 11
9 executes the program specified by the selected program information input from the program determining means 118.

As described above, in the program selecting and executing apparatus according to the fourth embodiment, the texture indicating the program contents is attached to each surface of the three-dimensional rotating object arranged in the three-dimensional virtual space (selection object). ) Is displayed on the screen, and the user rotates the three-dimensional rotating object by giving an instruction according to a predetermined operation. When a predetermined selection operation is performed by the user, the three-dimensional rotating object is moved to the viewpoint of the user. The surface facing the front is determined based on rotation angle information indicating how many times the three-dimensional rotating object has rotated from the initial state,
Since the configuration is such that the program associated with the surface is selected with reference to the correspondence table and the program is started, the three-dimensional rotating object in the three-dimensional virtual space is used, so that the cylindrical rotating object in the real world is used. It is possible to remind the user of the image of rolling, and an intuitive operation environment that is easy to be used by a user who is not used to a personal computer can be realized.

In the fourth embodiment, the selection object is rotated as rotation display control means for providing a rotation display control signal for displaying an image which rotates around the central axis in the three-dimensional virtual space. Instruction input means 10
1, parameter holding means 102, parameter changing means 1
24, that is, one in which the rotation instruction is input manually, but the rotation angle change pattern holding means is provided as in the program selection and execution device according to the second embodiment so that the rotation display control is automatically performed. Needless to say, this is acceptable.

Embodiment 5 FIG. FIG. 8 is a block diagram showing a configuration of a program selection and execution device according to the fifth embodiment of the present invention. 8, the same reference numerals as those in FIG. 1 denote the same or corresponding parts. 127 is a program execution means for executing a program based on the selected program information selected by the program determination means 118. In the fifth embodiment, the program execution screen information is changed to the screen display switching means 1
28. The screen display switching means 128 receives the program execution screen information output by the program execution means 127, and switches or combines with the frame information from the frame buffer 112 and outputs it to the screen display means 113.

Next, the operation of the program selection and execution device according to the fifth embodiment will be described. The program selection and execution device according to the fifth embodiment is configured such that, when the program has a display screen at the time of execution, when the program is selected,
The display of the program execution screen is displayed by switching the display of the three-dimensional virtual space.

In the program selection and execution device according to the fifth embodiment, the display of the screen in the initial state of the program selection operation mode and the operation by inputting the rotation instruction control signal are completely the same as those of the program selection and execution device according to the first embodiment. The description is omitted because it is the same.

In the program selection and execution device according to the fifth embodiment, when the user inputs a selection control signal from selection input means 115 with the surface on which the program desired to be activated is displayed facing front, the selected surface determination means 116
Obtains the count value at that time from the counter means 114 as count information, determines a face facing forward when a selection control signal is input based on the count information, and outputs this face as selected face information. I do. The program determining unit 118 acquires the selected plane information from the selected plane determining unit 116 and refers to the plane-program correspondence information held in the correspondence table holding unit 117 to determine a program corresponding to the plane indicated by the selected plane information. Output as selected program information. The program executing means 127 executes the program specified by the selected program information input from the program determining means 118. At this time, the program executing means 127 outputs the execution screen information of the program to the screen display switching means 128. Screen display switching means 1
Reference numeral 28 receives program execution screen information output by the program execution means 127, switches the frame information from the frame buffer 112, and outputs it to the screen display means 113.

As described above, in the program selecting and executing apparatus according to the fifth embodiment, the textures representing the program contents are pasted on the respective surfaces of the three-dimensional rotating object arranged in the three-dimensional virtual space on the screen. The three-dimensional rotator object is rotated by displaying and displaying a user's instruction by a predetermined operation. When a predetermined selection operation is performed by the user, the three-dimensional rotator is turned to the front with respect to the viewpoint of the user. Is determined, the program associated with the surface is selected with reference to the correspondence table to start the program, and when the program has a display screen at the time of execution, when the program is selected, 3 Since the program execution screen is displayed instead of the three-dimensional virtual space, by using the three-dimensional rotating object in the three-dimensional virtual space,
It is possible to associate the image of rolling a cylindrical rotating body in the real world, and the execution screen of the selected program is displayed. It is possible to realize an intuitive operation environment that is easy to be familiar with.

In the fifth embodiment, when the program execution screen is displayed, the program execution screen is displayed in full screen instead of the three-dimensional virtual space. However, the display is switched to full screen display. Instead, a two-dimensional rectangular area (window) may be separately created on the screen on which the three-dimensional virtual space is displayed, and displayed together with the three-dimensional virtual space.

As a display switching method, a rectangular object on which a program execution screen is pasted as a texture is generated, and a position corresponding to the full screen display is displayed from the display of the surface of the three-dimensional rotating object at the time of selection. Up to this point, the screen display may be switched by interpolating the middle and displaying an animation.

In the fifth embodiment, the selection object is rotated as rotation display control means for supplying a rotation display control signal for displaying an image which rotates in the three-dimensional virtual space around the center axis as the center of rotation. Instruction input means 10
1, parameter holding means 102, parameter changing means 1
03, that is, a device for manually inputting a rotation instruction, but a rotation angle change pattern holding means is provided as in the program selection and execution device according to the second embodiment so that rotation display control is automatically performed. Needless to say, this is acceptable.

In the fifth embodiment, the selection surface determining means 116 determines the surface facing the front on the display screen based on the count information output from the counter 114. A configuration in which the front facing surface is determined on the display screen based on the depth information as in the program selection and execution device according to Embodiment 3, or a display screen based on rotation angle information as in the program selection and execution device according to Embodiment 4. It goes without saying that a configuration may be adopted in which the surface facing the front is determined above.

Embodiment 6 FIG. FIG. 9 is a block diagram showing a configuration of a data selection execution device according to the sixth embodiment of the present invention. 9, reference numeral 101 denotes a rotation instruction input unit for inputting an instruction for rotating a three-dimensional rotating object in a three-dimensional virtual space; 102, a parameter holding unit for holding parameters for rotating the three-dimensional rotating object; Is based on a rotation instruction control signal from the rotation instruction input means 101,
This is a parameter changing unit that reads a parameter before change from the parameter holding unit 102, changes the parameter, records it as a parameter after change in the parameter holding unit 102, and outputs a counter control signal. Reference numeral 104 denotes a three-dimensional model coordinate holding unit that holds coordinate information of an object forming a three-dimensional virtual space including a three-dimensional rotating object, and 105 reads parameter information from the parameter holding unit 102,
The coordinate conversion means 106 reads the three-dimensional model coordinates from the three-dimensional model coordinate holding means 104 and performs coordinate conversion, and outputs the converted model coordinates. Reference numeral 106 denotes the converted model coordinates and viewpoint coordinates output from the coordinate conversion means 105. Is a perspective transformation unit that performs perspective transformation on a display screen of a three-dimensional virtual space including a three-dimensional rotating object and outputs projection plane coordinates. A hidden surface processing unit 107 reads projection plane coordinates from the perspective transformation unit 106, excludes hidden and not displayed regions, extracts only displayed regions, and outputs depth information and raster information after hidden surface processing. Denotes a depth information holding unit that holds the depth information extracted by the hidden surface processing unit 107, and 109 denotes a texture holding unit that holds a texture to be attached to each surface. In the sixth embodiment, 3
The texture to be attached to the three-dimensional rotator object is an image for identifying that it is corresponding data, for example,
If it is music data, an image that displays the name of the data, such as the name of the song or the name of the performer or creator, or an image of the performer or creator obtained by searching a separately provided database,
Alternatively, an image using an icon image corresponding to data, such as an image reminiscent of music, may be used.If the image data is a moving image, an image using an image of the first part or a representative part of the data may be used. good. Reference numeral 110 denotes a texture holding unit 109 based on the depth information held by the depth information holding unit 108 with respect to the raster information after hidden surface processing in which the depth information is considered by the hidden surface processing unit 107.
This is a texture mapping means for pasting the texture read from the. A rendering unit 111 renders all pixel information such as the color and brightness of each pixel based on the texture mapped frame information output by the texture mapping unit 110 and the depth information held by the depth information holding unit 108. Reference numeral denotes a frame buffer for holding the frame information drawn by the rendering unit 111, and reference numeral 113 denotes a screen display unit for outputting and displaying the frame information held in the frame buffer 112 at a predetermined timing. Reference numeral 114 denotes counter means for increasing a counter by a counter control signal from the parameter changing means 103; 115, selection input means for determining and inputting a program to be selected by the user; 116, count information and selection input from the counter means 114. Means 1
Selection surface determination means 129 for determining the selected surface based on the selection control signal from the control unit 15 and a surface (data-correspondence information) between each surface constituting the three-dimensional rotating object and the data, It is a correspondence table holding means for holding a correspondence table indicating the correspondence between data and programs (data-program correspondence information) and the correspondence between surfaces and textures (surface-texture correspondence information). FIG. 10 is a diagram showing an example of the correspondence table held by the correspondence table holding means 129. Reference numeral 130 refers to the correspondence information (surface-data correspondence information) read from the correspondence table holding unit 129 from the selected surface information output by the selected surface determination unit 116, determines the selected data, and outputs the selected data information. A data determining unit 131 determines a program to be executed by referring to correspondence information (data-program correspondence information) read from the correspondence table holding unit 129 from the selected data information output by the data determining unit 130. , 132 are the program determining means 1
This is a program executing means for executing a program based on the selected program information selected by 31.

Next, the operation of the data selection execution device according to the sixth embodiment will be described. The data selection execution device according to the sixth embodiment assigns and rotates application data such as word processors and spreadsheets and multimedia data such as video and music to each surface of a three-dimensional rotating object arranged in a three-dimensional virtual space. That, when a predetermined operation is performed by a user, activates a program for processing data associated with a surface facing the front of the user's viewpoint and opens the selected data. It is.

In the data selection execution device according to the sixth embodiment, when the data selection operation mode starts, the initial coordinates of the three-dimensional rotating object held in the three-dimensional model coordinate holding means 104 in the three-dimensional virtual space are read. Issued
Using the initial coordinates and the viewpoint coordinates, the perspective transformation unit 106 performs perspective transformation to a display screen of a three-dimensional virtual space including the three-dimensional rotating object, and outputs projection plane coordinates. That is, during the initial display operation of the program selection operation mode,
The coordinate conversion means 105 is a three-dimensional model coordinate holding means 10
Then, the coordinates of the initial coordinates read from step 4 are output to the perspective transformation means 106 without conversion. Hidden surface processing means 107
Reads the projection plane coordinates from the perspective transformation means 106, excludes the hidden and undisplayed areas, extracts only the displayed areas, and outputs depth information and raster information after hidden surface processing. The texture mapping unit 110 uses the texture holding unit 109 based on the depth information held by the depth information holding unit 108 for the hidden surface processed raster information in which the depth information is considered by the hidden surface processing unit 107.
Paste the texture read from. Here, the correspondence between each surface of the three-dimensional rotating object and the texture is obtained by reading the correspondence information (surface-texture correspondence information) from the correspondence table holding means 129. Rendering means 1
Reference numeral 11 renders all pixel information such as the color and brightness of each pixel on the basis of the depth information held by the depth information holding unit 108 in the frame information after texture mapping output by the texture mapping unit 110. The frame information drawn by the rendering unit 111 is held in the frame buffer 112 and is displayed on the screen display unit 113.
Reads the frame information held in the frame buffer 112 at a predetermined timing and displays the screen. Thereby, the screen of the initial state of the data selection operation mode is displayed.

When the user inputs a rotation instruction control signal from the rotation instruction input means 101 in a state where the screen of the initial state is displayed, the parameter changing means 103 changes the parameter based on the rotation instruction control signal from the rotation instruction input means 101. A parameter before change (here, a parameter in an initial state) is read from the holding unit 102, the parameter is changed and recorded as a changed parameter in the parameter holding unit 102, and a counter control signal is output to the counter unit 114. The coordinate transforming means 105 is a parameter holding means 10
2 is read out, and the changed model coordinates obtained by converting the coordinates of the initial coordinates read out from the three-dimensional model coordinate holding means 104 using the changed parameters are output to the perspective transformation means 106. The perspective transformation unit 106 performs perspective transformation to a display screen of a three-dimensional virtual space including the three-dimensional rotating object using the changed model coordinates and viewpoint coordinates, and outputs projection plane coordinates. After this,
Hidden surface processing means 107, texture mapping means 11
0, rendering means 111, frame buffer 11
2 and the screen display means 113 perform the same processing as in the initial display operation of the data selection operation mode, and the screen after the input of the rotation instruction control signal is displayed. For example, when the three-dimensional rotating object has the shape shown in FIG. 2, when the surface 1 is displayed with the front facing in the initial state, when the rotation instruction control signal in the forward direction is input, the three-dimensional rotating object shown in FIG. An image is displayed in which the image is rotated in the direction of the arrow and the surface 2 faces front. When a negative rotation instruction control signal is input, an image is displayed in which the image rotates in the opposite direction to the arrow in FIG. 2 and the surface 6 faces front. Is done.

As with the first embodiment, the rotation instruction input means 101 may correspond to the operation of the cursor keys of the remote controller or the keyboard, the movement of the mouse, etc., in association with the rotation of the three-dimensional rotator.

At the time of the rotation instruction control signal input operation, the counter means 114 performs the counting operation by the counter control signal output from the parameter changing means 103. Specifically, for example, when a rotation instruction control signal in the forward direction is input from the rotation instruction input unit 101, the parameter changing unit 103 outputs a counter control signal for incrementing the count value of the counter unit 114 by one, and the rotation instruction input unit 101 , The parameter changing means 103 outputs a counter control signal for decrementing the count value of the counter means 114 by one, and the counter means 114 receives this counter control signal and holds it by itself. Change the count value.

When the user inputs a selection control signal from the selection input means 115 with the surface on which the data desired to be processed is displayed facing front, the selected surface determination means 116 Is obtained as count information, and based on the count information, when a selection control signal is input, a face facing the front is determined, and this face is output as selected face information.

The data determining means 130 acquires the selected plane information from the selected plane determining means 116, and stores the correspondence table holding means 129.
The data corresponding to the surface indicated by the selected surface information is output as the selected data information with reference to the surface-data correspondence information held in. The program deciding means 131 acquires the selected data information from the data deciding means 130 and selects a program for processing the data indicated by the selected data information with reference to the data-program correspondence information held in the correspondence table holding means 129. Output as program information.

The program executing means 132 executes the program specified by the selected program information input from the program determining means 131.

As described above, in the data selection execution device according to the sixth embodiment, a texture indicating the data content is pasted on each surface of the three-dimensional rotating object placed in the three-dimensional virtual space on the screen. When a predetermined selection operation is performed by displaying and counting how many times the rotation instruction operation has been repeated while rotating the three-dimensional rotating object by the user giving an instruction by a predetermined operation, In addition, a program that determines the surface facing the front of the user from the viewpoint from the count value, selects data associated with the surface with reference to a correspondence table, and processes the selected data Is started and the selected data is opened, so that by using the three-dimensional rotating object in the three-dimensional virtual space, the image of rolling the cylindrical rotating body in the real world is reminiscent. It is possible, it is possible to realize a easy and intuitive operating environment familiar to the use who are not familiar with the personal computer.

In the above embodiment, three images (textures) for identifying corresponding data are used.
It is displayed only by pasting on the surface of the three-dimensional rotator object, but on the surface of the three-dimensional rotator object, a texture that displays information such as data names and characters is pasted,
As for the surface facing the front among the surfaces of the three-dimensional rotator object, an icon image or a texture created using a still image extracted from a moving image is displayed on the display screen 200 as shown in FIG. It may be displayed together with the three-dimensional rotator object.

Further, in the sixth embodiment, the selection object is rotated as a rotation display control means for providing a rotation display control signal for displaying an image which rotates in the three-dimensional virtual space around the center axis as the center of rotation. Instruction input means 10
1, parameter holding means 102, parameter changing means 1
03, that is, the one in which the rotation instruction is input manually, but the rotation angle change pattern holding means may be provided as in the second embodiment, and the rotation display control may be automatically performed. Needless to say.

In the sixth embodiment, the selection surface determining means 116 determines the surface facing the front on the display screen based on the count information output from the counter 114. A configuration in which the front facing surface on the display screen is determined based on depth information as in Embodiment 3, or a front facing surface on the display screen is determined based on rotation angle information as in Embodiment 4. Needless to say, the configuration may be good.

Embodiment 7 FIG. FIG. 12 is a block diagram showing a configuration of a data selection execution device according to the seventh embodiment of the present invention. 12, the same reference numerals as those in FIG. 9 denote the same or corresponding parts. Reference numeral 134 denotes a program for activating a program indicated by the selected program information output by the program deciding means 131, reproducing the moving image data indicated by the selected data information outputted by the data deciding means 130, and outputting the moving image data to the texture holding means 135. Means.

In the data selection execution device according to the seventh embodiment, when the candidate data to be selected is a moving image, the moving image data is pasted on a corresponding surface as a texture, and further, a surface facing the front. Performs moving image display,
For a surface that is not facing the front, a certain screen in the moving image is pasted as a still image. This allows the user to easily determine which of the faces that can be selected at a certain point in time, based on whether the image pasted on the face is moving.

Next, the operation of the data selection execution device according to the seventh embodiment will be described. In the data selection execution device according to the sixth embodiment, when candidate data to be selected is a moving image, the moving image data is pasted as a texture on a corresponding surface.

In the data selection execution device according to the seventh embodiment, when the data selection operation mode starts, the initial coordinates of the three-dimensional rotating object held in the three-dimensional model coordinate holding means 104 in the three-dimensional virtual space are read. Issued
Using the initial coordinates and the viewpoint coordinates, the perspective transformation unit 106 performs perspective transformation to a display screen of a three-dimensional virtual space including the three-dimensional rotating object, and outputs projection plane coordinates. That is, during the initial display operation of the program selection operation mode,
The coordinate conversion means 105 is a three-dimensional model coordinate holding means 10
Then, the coordinates of the initial coordinates read from step 4 are output to the perspective transformation means 106 without conversion. Hidden surface processing means 107
Reads the projection plane coordinates from the perspective transformation means 106, excludes the hidden and undisplayed areas, extracts only the displayed areas, and outputs depth information and raster information after hidden surface processing. The texture mapping unit 110 uses the texture holding unit 135 based on the depth information held by the depth information holding unit 108 for the raster information after hidden surface processing in which the depth information is considered by the hidden surface processing unit 107.
Paste the texture read from.

Here, in the seventh embodiment, the moving image reproducing means 134 converts the surface-data held in the correspondence table holding means 129 for all data whose contents should be displayed on each surface of the three-dimensional rotating object. This information is reproduced by referring to the correspondence information and the data-program correspondence information, and for a surface not facing the front, a certain screen among the moving images of each data is output to the texture holding means 135 as a still image, With respect to the surface facing, the moving image is output to the texture holding unit 135 while the data is continuously reproduced. For example, when the three-dimensional rotating object has the shape shown in FIG. 2, in the initial display state, the moving image reproducing unit 134 displays a certain screen of the moving images of the respective data on the surfaces 2 to 6 as a still image. And outputs the moving image to the texture holding unit 135 while continuously reproducing the data on the surface 1.

The correspondence between each surface of the three-dimensional rotator object and the texture is obtained from the correspondence table holding means 129 using the correspondence information (surface-
(Corresponding to texture information). The rendering means 111 includes the texture mapping means 11
0 to the frame information after texture mapping output by
Based on the depth information held by the depth information holding unit 108, all pixel information such as the color and brightness of each pixel is drawn. The frame information drawn by the rendering means 111 is held in the frame buffer 112, and the screen display means 113 reads out the frame information held in the frame buffer 112 at a predetermined timing and displays the screen. Thereby, the screen of the initial state of the data selection operation mode is displayed.

When the user inputs a rotation instruction control signal from the rotation instruction input means 101 in a state where the screen of the initial state is displayed, the parameter changing means 103 outputs a parameter based on the rotation instruction control signal from the rotation instruction input means 101. A parameter before change (here, a parameter in an initial state) is read from the holding unit 102, the parameter is changed and recorded as a changed parameter in the parameter holding unit 102, and a counter control signal is output to the counter unit 114. The coordinate transforming means 105 is a parameter holding means 10
2 is read out, and the changed model coordinates obtained by converting the coordinates of the initial coordinates read out from the three-dimensional model coordinate holding means 104 using the changed parameters are output to the perspective transformation means 106. The perspective transformation unit 106 performs perspective transformation to a display screen of a three-dimensional virtual space including the three-dimensional rotating object using the changed model coordinates and viewpoint coordinates, and outputs projection plane coordinates. After this,
Hidden surface processing means 107, texture mapping means 11
0, rendering means 111, frame buffer 11
2 and the screen display means 113 perform the same processing as in the initial display operation of the data selection operation mode, and the screen after the input of the rotation instruction control signal is displayed. For example, when the three-dimensional rotating object has the shape shown in FIG. 2, when the surface 1 is displayed with the front facing in the initial state, when the rotation instruction control signal in the forward direction is input, the three-dimensional rotating object shown in FIG. An image is displayed in which the image is rotated in the direction of the arrow and the surface 2 faces front. When a negative rotation instruction control signal is input, an image is displayed in which the image rotates in the opposite direction to the arrow in FIG. 2 and the surface 6 faces front. Is done. here,
When the surface 2 faces the front, the moving image reproducing unit 134 sets the texture holding unit 135 as a still image with a certain screen among the moving images of each data for the surfaces 1 and 3 to 6.
, And for the surface 2, the data is continuously reproduced and the moving image is output to the texture holding unit 135. When the surface 6 faces the front, the moving image reproducing means 134
Outputs a certain screen of the moving image of each data as a still image for the surfaces 1 to 5 to the texture holding unit 135, and continuously reproduces the data for the surface 6 to transfer the moving image to the texture holding unit 135. Output.

As for the rotation instruction input means 101, as in the first embodiment, the operation of the cursor keys on the remote controller or the keyboard, the movement of the mouse, etc. may be associated with the rotation of the three-dimensional rotator.

At the time of the rotation instruction control signal input operation, the counter means 114 performs a counting operation by the counter control signal output from the parameter changing means 103. Specifically, for example, when a rotation instruction control signal in the forward direction is input from the rotation instruction input unit 101, the parameter changing unit 103 outputs a counter control signal for incrementing the count value of the counter unit 114 by one, and the rotation instruction input unit 101 , The parameter changing means 103 outputs a counter control signal for decrementing the count value of the counter means 114 by one, and the counter means 114 receives this counter control signal and holds it by itself. Change the count value.

When the user inputs a selection control signal from the selection input means 115 in a state where the surface on which the data desired to be processed is displayed faces forward (a state in which a moving image is displayed), the selection surface determination means 116 The count value at that time is acquired as the count information from the means 114, and based on the count information, the face facing the front is determined when the selection control signal is input, and this face is output as the selected face information.

The data determining means 130 acquires the selected plane information from the selected plane determining means 116, and stores the correspondence table holding means 129.
The data corresponding to the surface indicated by the selected surface information is output as the selected data information with reference to the surface-data correspondence information held in. The program deciding means 131 acquires the selected data information from the data deciding means 130 and selects a program for processing the data indicated by the selected data information with reference to the data-program correspondence information held in the correspondence table holding means 129. Output as program information.

The moving image reproducing means 134 executes the program specified by the selected program information input from the program determining means 131, and reproduces the selected data.

As described above, in the data selection execution device according to the seventh embodiment, data corresponding to each surface of the three-dimensional rotating object arranged in the three-dimensional virtual space is stored in the surface facing the front on the display screen. The texture of the reproduced moving image is displayed on the screen on which the texture of the still image of the corresponding data is pasted on the surface other than the surface facing the front on the display screen, and the user instructs by a predetermined operation By rotating the three-dimensional rotator object and counting how many times the rotation instruction operation is repeated, when a predetermined selection operation is performed by the user, the user is most likely to face the viewpoint of the user. Is determined from the count value, the data associated with the surface is selected with reference to the correspondence table, and a program for processing the selected data is started to open the selected data. By using a three-dimensional rotating object in a three-dimensional virtual space, it is possible to associate an image of rolling a cylindrical rotating body in the real world, and which surface can be selected at a certain time This can be easily determined based on whether the image pasted on the surface is moving, and an intuitive operation environment that can be easily used by a user unfamiliar with a personal computer can be realized.

In the seventh embodiment, the selection object is rotated as rotation display control means for supplying a rotation display control signal for displaying an image which rotates in the three-dimensional virtual space around the center axis as the center of rotation. Instruction input means 10
1, parameter holding means 102, parameter changing means 1
03, that is, the one in which the rotation instruction is input manually, but the rotation angle change pattern holding means may be provided as in the second embodiment, and the rotation display control may be automatically performed. Needless to say.

In the seventh embodiment, the selection surface determining means 116 determines the surface facing the front on the display screen based on the count information output from the counter 114. A configuration in which the front facing surface on the display screen is determined based on depth information as in Embodiment 3, or a front facing surface on the display screen is determined based on rotation angle information as in Embodiment 4. Needless to say, the configuration may be good.

Embodiment 8 FIG. FIG. 13 is a block diagram showing a configuration of a data selection execution device according to the eighth embodiment of the present invention. 13, the same reference numerals as those in FIG. 9 denote the same or corresponding parts. 136 receives the selection surface information indicating the currently selectable surface (the surface determined to be facing the front) from the selection surface determination means 116, and the next selection is possible by rotating the three-dimensional rotating object. Judge what the surface is,
Next selection surface determination means 137 for outputting the next selection surface information indicating the surface which can be selected next, and 137 is the selection surface determination means 11
6, the data corresponding to the currently selectable surface is determined by referring to the correspondence information (surface-data correspondence information) read from the correspondence table holding unit 129, and the first data is output. The data determination means 138 is based on the selected data information output from the first data determination means 137.
A first program determining means for determining a program to be executed with reference to the correspondence information (data-program correspondence information) read from the correspondence table holding means 129 is a selection program output by the first program determining means 138 A data reproducing unit that starts a program indicated by the information, reproduces the data indicated by the selected data information output by the first data determining unit 137, and outputs the reproduced data 1. 1
Numeral 40 receives the next selection surface information from the next selection surface determination unit 136, and determines the data corresponding to the next selectable surface with reference to the correspondence information (surface-data correspondence information) read from the correspondence table holding unit 129. A second data determining means for outputting next selected data information;
From the next selection data information output by the
9 to determine the program to be executed with reference to the correspondence information (data-program correspondence information)
142 activates the program indicated by the selected program information output by the second program determining means 141, and reproduces the data indicated by the next selected data information output by the second data determining means 140 to reproduce the reproduced data. 2
Is the next data reproducing means. A mixing unit 143 receives the reproduction data 1 and the reproduction data 2 and creates and outputs mixed data in accordance with the rotation of the three-dimensional rotator object. A mixing unit 144 displays the mixed data from the mixing unit as an image or a sound. Data output means.

Next, the operation of the data selection execution device according to the eighth embodiment will be described. The data selection execution device according to the eighth embodiment is configured such that when the selection target data is data that changes with time, such as audio / music data or moving image data, or audio / music data attached to the moving image data, When switching from the data corresponding to the surface facing to to the data of the next surface, the volume,
Switching is performed between fade-in and fade-out based on the pattern of the mixing ratio of the luminance levels.

In the data selection execution device according to the eighth embodiment, when the data selection operation mode starts, the initial coordinates of the three-dimensional rotating object held in the three-dimensional model coordinate holding means 104 in the three-dimensional virtual space are read. Issued
Using the initial coordinates and the viewpoint coordinates, the perspective transformation unit 106 performs perspective transformation to a display screen of a three-dimensional virtual space including the three-dimensional rotating object, and outputs projection plane coordinates. That is, during the initial display operation of the program selection operation mode,
The coordinate conversion means 105 is a three-dimensional model coordinate holding means 10
Then, the coordinates of the initial coordinates read from step 4 are output to the perspective transformation means 106 without conversion. Hidden surface processing means 107
Reads the projection plane coordinates from the perspective transformation means 106, excludes the hidden and undisplayed areas, extracts only the displayed areas, and outputs depth information and raster information after hidden surface processing. The texture mapping unit 110 uses the texture holding unit 135 based on the depth information held by the depth information holding unit 108 for the raster information after hidden surface processing in which the depth information is considered by the hidden surface processing unit 107.
Paste the texture read from. The correspondence between each surface of the three-dimensional rotating object and the texture is obtained by reading the correspondence information (surface-texture correspondence information) from the correspondence table holding unit 129. The rendering means 111 adds depth information holding means 108 to the frame information after texture mapping output from the texture mapping means 110.
Based on the depth information held by, all pixel information such as the color and brightness of each pixel is drawn. The frame information drawn by the rendering means 111 is held in the frame buffer 112, and the screen display means 113 reads out the frame information held in the frame buffer 112 at a predetermined timing and displays the screen. This allows
The screen of the initial state of the data selection operation mode is displayed.

Here, in the eighth embodiment, the data reproducing unit 139 and the next data reproducing unit 142
The data corresponding to the front-facing surface and the data corresponding to the next front-facing surface among the surfaces constituting the two-dimensional rotator object are reproduced and output to the mixing means 143. For example, when the three-dimensional rotating object has the shape shown in FIG. 2, in the initial display state, the data reproducing unit 139 stores data corresponding to the surface 1 and the next data reproducing unit 142 stores data corresponding to the surface 2. Reproduction and mixing means 143
Output to In the initial display state, the mixing means 143 outputs a composite signal having a mixing ratio that maximizes the reproduction signal of the data corresponding to the surface 1 and minimizes the reproduction signal of the data corresponding to the surface 2. That is, in the initial display state, the surface 1
Only the reproduced signal of the data corresponding to
4 and the data output means 144 displays the reproduced signal as an image or sound. As a method of displaying images,
For example, as shown in FIG. 11, the image is displayed on the display screen 200 together with the three-dimensional rotating object.

When the user inputs a rotation instruction control signal from the rotation instruction input means 101 in a state where the screen of the initial state is displayed, the parameter changing means 103 outputs a parameter based on the rotation instruction control signal from the rotation instruction input means 101. A parameter before change (here, a parameter in an initial state) is read from the holding unit 102, the parameter is changed and recorded as a changed parameter in the parameter holding unit 102, and a counter control signal is output to the counter unit 114.

As in the first embodiment, the rotation instruction input means 101 may correspond to the operation of the cursor keys of the remote controller or the keyboard, the movement of the mouse, etc., in association with the rotation of the three-dimensional rotating object.

The coordinate conversion means 105 reads the changed parameters recorded in the parameter holding means 102, and
The changed model coordinates obtained by converting the coordinates of the initial coordinates read from the dimensional model coordinate holding unit 104 using the changed parameters are output to the perspective transformation unit 106. The perspective transformation unit 106 performs perspective transformation to a display screen of a three-dimensional virtual space including the three-dimensional rotating object using the changed model coordinates and viewpoint coordinates, and outputs projection plane coordinates. Thereafter, the hidden surface processing means 107, the texture mapping means 110, the rendering means 111, the frame buffer 1
12 and the screen display means 113 perform the same processing as in the initial display operation of the data selection operation mode, and the screen after the rotation instruction control signal is input is displayed.

For example, in the case where the three-dimensional rotating object has the shape shown in FIG. 2, as shown in FIG. 14A, in the initial state (time t0), the surface 1 is displayed facing the front. In response to the input of the rotation instruction control signal, an image in which the surface 2 faces front at time t1 is displayed. At this time, in the eighth embodiment, in the initial display state, the mixing means 143 sets the maximum reproduction signal of the data corresponding to the surface 1 and the minimum of the reproduction signal of the data corresponding to the surface 2 in the initial display state. Is output to the surface 1 so as to output a composite signal having a mixing ratio that minimizes the reproduced signal of the data corresponding to the surface 1 and maximizes the reproduced signal of the data corresponding to the surface 2 at time t1. The mixing ratio of the reproduction signal of the corresponding data is gradually decreased, and the mixing ratio of the reproduction signal of the data corresponding to the surface 2 is gradually increased. As a result, as shown in FIG. 14B, the display of the reproduced signal of the data corresponding to the surface 1 and the display of the reproduced signal of the data corresponding to the surface 2 are switched by cross-fading. When the display output of the reproduced signal of the data corresponding to the surface 1 becomes 0, the data reproducing unit 139 switches the data to be reproduced from the data corresponding to the surface 1 to the data corresponding to the surface 2, and the next data reproducing unit 142 reproduces. The data is switched from data corresponding to surface 2 to data corresponding to surface 3. Then, the mixing unit 143 displays the reproduction signal of the data corresponding to the surface 2 and the surface 3 in accordance with the display of the image in which the state where the surface 2 faces front is switched to the state where the surface 3 faces front. The composite signal is output so that the display of the data reproduction signal is switched by cross-fading. By repeating such an operation, the display screen is displayed with the texture indicating the data content attached to each surface of the three-dimensional rotating object (the object for selection), and is associated with the front-facing surface. Auxiliary display can be performed without interruption of the music data or moving image data.

When the user inputs a selection control signal from the selection input means 115 with the surface on which the data desired to be processed faces front, the selection surface determination means 116 outputs the selection surface output at that time. A selection display signal indicating that the surface indicated by the information is actually selected is output. First data determining means 137, first program determining means 138
Transmits a selection display signal to the data reproducing means 139.
The data reproducing unit 139 that has received the selection display signal reproduces the selected data from the beginning by using the currently executing program, and outputs the reproduced data to the mixing unit 143 together with the selection display signal. Mixing means 1
43 receives the selection display signal, stops mixing the reproduction data 1 and the reproduction data 2, and outputs the reproduction data 1 and the selection display signal to the data output means 144. Data output means 14
4 receives the selection display signal, switches the screen display from the screen on which the selection object is displayed to the screen for data display, and displays the reproduction data 1.

As described above, in the data selection execution device according to the sixth embodiment, a texture indicating the data content is pasted on each surface of the three-dimensional rotating object placed in the three-dimensional virtual space on the screen. Display, music data and moving image data associated with the surface facing the front are auxiliary displayed without interruption, and when a predetermined selection operation is performed by the user, the front is most viewed from the viewpoint of the user. Since the data associated with the facing surface is played back, 3
By using a three-dimensional rotating object in a three-dimensional virtual space, it is possible to associate the image of rolling a cylindrical rotating object in the real world, and an intuitive operating environment that is familiar to users who are not used to personal computers. In addition, since the music data and the moving image data that are auxiliary displayed together with the selection object are not interrupted, it is possible to realize a data selection execution device that allows the user to select data comfortably.

In the eighth embodiment, the display of the reproduction signal of the data associated with the selected plane and the display of the reproduction signal of the data associated with the next selected plane are switched by cross-fade. As shown in FIG. 14 (c), after the display of the reproduction signal of the data associated with the selected surface is faded out, the display of the reproduction signal of the data associated with the next selected surface is faded in. Good. In this case, since it is not necessary to reproduce two data at the same time, there is no need to double the data determining means, the program determining means, and the data reproducing device.

In the eighth embodiment, the selection object rotates as a rotation display control means for providing a rotation display control signal for displaying an image which rotates in the three-dimensional virtual space around the center axis as the center of rotation. Instruction input means 10
1, parameter holding means 102, parameter changing means 1
03, that is, the one in which the rotation instruction is input manually, but the rotation angle change pattern holding means may be provided as in the second embodiment, and the rotation display control may be automatically performed. Needless to say.

In the eighth embodiment, the selection surface determination means 116 determines the surface facing the front on the display screen based on the count information output from the counter 114. A configuration in which the front facing surface on the display screen is determined based on depth information as in Embodiment 3, or a front facing surface on the display screen is determined based on rotation angle information as in Embodiment 4. Needless to say, the configuration may be good.

In recent years, ordinary sound has been developed by applying signal processing technology and output from a speaker in consideration of a sound source position in a three-dimensional space, so that sound can be heard from above or from the right. A so-called three-dimensional sound in which sound moves to the left, that is, a so-called three-dimensional sound, has been put to practical use. In the data selection execution device according to the eighth embodiment, a three-dimensional rotator is The playback sound source position of the audio data corresponding to the surface of the object may be moved in accordance with the rotation of the three-dimensional rotator object. By listening to the playback sound in which the sound source position moves, the user can It is easy to recognize which plane is currently selectable.

FIG. 15 is a diagram for explaining the operation of switching the reproduction sound display when the three-dimensional sound technology is applied in the data selection execution device according to the eighth embodiment. This shows how a three-dimensional rotating object appears on the display screen. In this example, the number of surfaces constituting the three-dimensional rotator object is six, the central axis of rotation is arranged in the vertical direction in the three-dimensional virtual space, and the three-dimensional rotator object is
When viewed from the direction of the central axis of rotation (see the lower part of FIG. 15), a case where the motor is rotated in the opposite direction to the clock is shown.
As shown in the figure, at the time point (initial state) in FIG.
The sound source position of the audio data (corresponding to the reproduction data 1 in FIG. 13) corresponding to the surface 1 is at the center of the screen, and the sound source position of the audio data (corresponding to the reproduction data 2 in FIG. 13) corresponding to the surface 2 is The audio is displayed as if it were in the space on the left side of the screen. Then, in accordance with the rotation of the three-dimensional rotator object, the sound source position of the audio data corresponding to the surface 1 moves to the space on the right side toward the screen as shown in FIG. The sound source position in the sound display is controlled so that the sound source position of the corresponding sound data is directed toward the center of the screen, and the time point shown in FIG. 15C (surface 2 faces front)
Thus, the sound is displayed such that the sound source position of the sound data corresponding to the surface 2 is at the center of the screen, and the sound source position of the sound data corresponding to the surface 1 is in the space on the right side of the screen. In this way, by reproducing and displaying the audio data corresponding to each surface of the three-dimensional rotator object so that the sound source position moves in accordance with the rotation of the three-dimensional rotator object, the user can select any audio data. It can be easily recognized by a three-dimensional sound whether or not it is in a state. As a method of determining the sound source position in the audio display control, as shown in FIG. 16, a sound source of audio data corresponding to the surface is located at a predetermined distance on an extension of a straight line connecting the rotation axis and the center of the surface. An arrangement method is conceivable, but other methods may be used. For example, as shown in FIG. 17, a position parallel to the display screen from a position at a predetermined distance on an extension of a straight line connecting the rotation axis and the center of the surface. The sound source of the audio data corresponding to the plane may be arranged by projecting on a straight line.

[0112]

As described above, according to the present invention (claim 1), in a program selecting and executing apparatus for selecting and executing a program, a plurality of surfaces are arranged at a constant interval with respect to a central axis. Selection object display means for displaying, on a display screen, an image in which a selection object in which a texture indicating a program content is pasted on each surface of the three-dimensional rotator object in a three-dimensional virtual space, and a selection object Rotation display control means for providing a display means with a rotation display control signal for displaying an image in which the selection object rotates about the central axis in the three-dimensional virtual space as a center of rotation, and a selection input for selecting a program Input means for inputting a three-dimensional object, and which of a plurality of surfaces constituting the three-dimensional rotating object are displayed when a selection input is input from the selection input means. A selection surface determination unit that determines whether the user is facing the front on the screen, a correspondence holding unit that holds information indicating a correspondence between a plurality of surfaces constituting the three-dimensional rotating object and the program, and a selection surface determination unit Determine what the program associated with the surface determined by the means is based on the information held in the correspondence holding means,
Since the system includes the program deciding means for deciding a program to be executed and the program executing means for executing the program decided by the program deciding means, a real object can be realized by using a three-dimensional rotating object in a three-dimensional virtual space. It is possible to associate the image of rolling a cylindrical rotating body in the world, which has the effect of realizing an intuitive operation environment that is easy to be used by users who are not used to personal computers.

Further, according to the present invention (claim 9), in the data selection execution device for selecting and executing data, a three-dimensional rotating object in which a plurality of surfaces are arranged at a constant interval with respect to the central axis. A selection object display means for displaying, on a display screen, an image in which a selection object in which a texture indicating data content is pasted on each of the surfaces is arranged in a three-dimensional virtual space; A rotation display control means for supplying a rotation display control signal for displaying an image in which the selection object rotates about the center axis in the three-dimensional virtual space as a center of rotation, and a selection input for selecting data. Selection input means,
Selection surface determination means for determining which of the plurality of surfaces constituting the three-dimensional rotating object is facing the front on the display screen when a selection input is input from the selection input means; A first correspondence holding unit for holding information indicating a correspondence between a plurality of surfaces constituting the body object and the data; and a method for determining what data is associated with the surface determined by the selected surface determination unit. A data determining unit that determines based on the information held in the first correspondence holding unit and determines data to be opened, and a second correspondence that holds information indicating a correspondence between the data and a program that opens the data. The holding unit and a program executed to open the data determined by the data determining unit are determined based on the information held in the second correspondence holding unit, and a program to be executed is determined. A program deciding means and a program executing means for executing the program decided by the program deciding means and opening the data decided by the data deciding means. Therefore, by using the three-dimensional rotating object in the three-dimensional virtual space, In addition, it is possible to associate the image of rolling a cylindrical rotating body in the real world, and it is possible to realize an intuitive operation environment that is easy to be used by a user who is not used to a personal computer.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a program selection and execution device according to a first embodiment of the present invention.

FIG. 2 is a diagram showing an example of a three-dimensional rotating object arranged in a three-dimensional virtual space in the program selection execution device and the data selection execution device according to the present invention.

FIG. 3 is a diagram showing an example of a correspondence table held by a correspondence table holding unit of the program selection execution device according to the present invention.

FIG. 4 is a block diagram showing a configuration of a program selection and execution device according to a second embodiment of the present invention.

FIG. 5 is a block diagram showing a configuration of a program selection and execution device according to a third embodiment of the present invention.

FIG. 6 is a block diagram showing a configuration of a program selection and execution device according to a fourth embodiment of the present invention.

FIG. 7 is a diagram for explaining frontal determination in a program selection and execution device according to a fourth embodiment of the present invention.

FIG. 8 is a block diagram showing a configuration of a program selection and execution device according to a fifth embodiment of the present invention.

FIG. 9 is a block diagram showing a configuration of a data selection execution device according to a sixth embodiment of the present invention.

FIG. 10 is a diagram showing an example of a correspondence table held by a correspondence table holding unit of the data selection execution device according to the present invention.

FIG. 11 is a diagram showing a screen display example of the data selection execution device according to the present invention.

FIG. 12 is a block diagram showing a configuration of a data selection execution device according to a seventh embodiment of the present invention.

FIG. 13 is a block diagram showing a configuration of a data selection execution device according to an eighth embodiment of the present invention.

FIG. 14 is a diagram for explaining an operation of the data selection execution device according to the eighth embodiment of the present invention.

FIG. 15 is a diagram illustrating an operation of the data selection execution device according to the eighth embodiment of the present invention.

FIG. 16 is a diagram illustrating an operation of the data selection execution device according to the eighth embodiment of the present invention.

FIG. 17 is a diagram illustrating an operation of the data selection execution device according to the eighth embodiment of the present invention.

[Explanation of symbols]

 101 rotation instruction input unit 102 parameter holding unit 103, 124 parameter changing unit 104 three-dimensional model coordinate holding unit 105, 121 coordinate conversion unit 106 perspective conversion unit 107 hidden surface processing unit 108, 122 depth information holding unit 109 texture holding unit 110, 135 Texture mapping means 111 Rendering means 112 Frame buffer 113 Screen display means 114 Counter means 115 Selection input means 116, 123, 125 Selection surface determination means 117, 129 Correspondence table holding means 118, 131 Program determination means 119, 127, 132 Program execution means 120 rotation angle change pattern holding means 126 rotation angle-plane correspondence holding means 128 screen display switching means 130 data decision means 134 moving image reproduction means 136 next selection Selection surface determining means 137 First data determining means 138 First program determining means 139 Data reproducing means 140 Second data determining means 141 Second program determining means 142 Next data reproducing means 143 Mixing means 144 Data output means

Continuation of the front page (72) Inventor Yoshihisa Nishikori 1006 Kazuma Kadoma, Kadoma City, Osaka Prefecture F-term in Matsushita Electric Industrial Co., Ltd. 5B076 AB17 5E501 AA02 AC15 BA05 EB01 EB05 FA14 FA27 FA43 FB24

Claims (20)

[Claims] 1. A selection object in which a texture indicating a program content is pasted on each surface of a three-dimensional rotating object in which a plurality of surfaces are arranged at regular intervals with respect to a central axis. Object display means for displaying an image arranged in the display screen on the display screen, and an image in which the object for selection is rotated about the central axis in the three-dimensional virtual space with respect to the object display means for selection. A rotation display control means for providing a rotation display control signal for display, a selection input means for inputting a selection input for selecting a program, and a three-dimensional rotating object when a selection input is input from the selection input means Selecting surface determining means for determining which surface of the plurality of surfaces faces the front on the display screen; and a plurality of surfaces constituting the three-dimensional rotating object. A correspondence relationship holding unit that holds information indicating a correspondence relationship between the program and the program, and a program associated with the surface determined by the selected surface determination unit based on the information held in the correspondence relationship holding unit. A program selection and execution device, comprising: a program determination means for determining and determining a program to be executed; and a program execution means for executing the program determined by the program determination means. 2. The program selection execution device according to claim 1, wherein the rotation display control means supplies the rotation display control signal to the selection object display means in response to a rotation instruction input externally input. A program selection and execution device characterized by the above-mentioned. 3. The program selection execution device according to claim 1, wherein the rotation display control means includes a holding means for holding information for rotating the selection object in a predetermined pattern, and the holding means holds the information. The rotation display control signal to the object display means for selection based on the obtained information. 4. The program selection execution device according to claim 2, wherein the rotation display control means includes a holding means for holding information for rotating the selection object in a predetermined pattern. When a rotation instruction input is input from the controller, the rotation display control signal is supplied to the selection object display means in accordance with the rotation instruction input, and when the rotation instruction input is not input from the outside, based on the information held in the holding means, A program selection executing device for providing the rotation display control signal to a selection object display means. 5. The program selection execution device according to claim 1, wherein the selection object is rotated on a display screen to form a three-dimensional rotating object. Counter means for counting the number of times that the surface facing is switched and outputting count information, wherein the selected surface determination means determines the surface facing front on the display screen based on the count information output by the counter. A program selection and execution device for determining. 6. The program selection execution device according to claim 1, wherein the selection surface determination unit determines the depth required when the selection object display unit displays the selection object on a screen. A program selection / execution device for determining a surface facing forward on a display screen based on information. 7. The program selection execution device according to claim 1, wherein said selection plane determination means is based on rotation angle information indicating an angle of rotation of said selection object from an initial state. A program selection and execution device for determining a surface facing forward on a display screen. 8. The program selection and execution device according to claim 1, wherein when the selected program has an execution display screen at the time of execution, the execution display screen is displayed at the time of execution of the program. And a screen display switching means for switching the screen display. 9. A selection object in which a texture indicating data content is pasted on each of the surfaces of a three-dimensional rotating object in which a plurality of surfaces are arranged at regular intervals with respect to a central axis is provided in a three-dimensional virtual space. Object display means for displaying an image arranged in the display screen on the display screen, and an image in which the object for selection is rotated about the central axis in the three-dimensional virtual space with respect to the object display means for selection. A rotation display control means for providing a rotation display control signal for displaying, a selection input means for inputting a selection input for selecting data, and a three-dimensional rotating object when a selection input is input from the selection input means Selected surface determining means for determining which of the plurality of surfaces faces the front on the display screen; and a plurality of surfaces and data constituting the three-dimensional rotator object. A first correspondence holding unit that holds information indicating a correspondence relationship with the data; and a first correspondence holding unit that stores data associated with the surface determined by the selected surface determination unit. Data determination means for making a determination based on the information and determining data to be opened, second correspondence holding means for holding information indicating the correspondence between the data and a program for opening the data, and data determination means A program to be executed for opening data is determined based on the information held in the second correspondence holding means, and a program determining means for determining a program to be executed; and executing the program determined by the program determining means. And a program executing means for opening the data determined by the data determining means. 10. The data selection execution device according to claim 9, wherein the rotation display control means supplies the rotation display control signal to the selection object display means in response to an externally input rotation instruction input. A data selection execution device, characterized in that: 11. The data selection execution device according to claim 9, wherein the rotation display control means includes a holding means for holding information for rotating the selection object in a predetermined pattern, and the holding means holds the information. The rotation display control signal to the selection object display means based on the obtained information. 12. The data selection execution device according to claim 10, wherein the rotation display control means includes holding means for holding information for rotating the selection object in a predetermined pattern, and receives a rotation instruction input from outside. Is input to the selection object display means in response to the rotation instruction input, and when no rotation instruction input is input from outside, the rotation display control signal is provided based on the information held in the holding means. A data selection execution device for providing a signal to a selection object display means. 13. The data selection execution device according to claim 9, wherein the selection object rotates on a display screen to form a three-dimensional rotating object. Counter means for counting the number of times that the surface facing is switched and outputting count information, wherein the selected surface determination means determines the surface facing front on the display screen based on the count information output by the counter. A data selection execution device for determining. 14. The data selection execution device according to claim 9, wherein the selection plane determination unit determines the depth required when the selection object display unit displays the selection object on a screen. A data selection execution device, which determines a surface facing forward on a display screen based on information. 15. The data selection execution device according to claim 9, wherein said selection plane determination means is based on rotation angle information indicating an angle of rotation of said selection object from an initial state. A data selection execution device, which determines a surface facing the front on a display screen. 16. The data selection execution device according to claim 9, wherein, when the program to be executed has an execution display screen at the time of execution, the execution display screen is displayed at the time of program execution. And a screen display switching means for switching the screen display. 17. The data selection execution device according to claim 9, wherein the selection object display means is moving image data, wherein the data associated with each surface of the three-dimensional rotating object is moving image data. A data selection execution device, wherein an image obtained by reproducing moving image data is pasted on a corresponding surface as a texture. 18. The data selection execution device according to claim 17, wherein said selection object display means includes a plurality of surfaces constituting a three-dimensional rotating object, the surface facing the front of the display screen. A moving image obtained by reproducing moving image data associated with a surface is pasted as a texture, and a surface that is not facing the front on the display screen among a plurality of surfaces constituting the three-dimensional rotating object is attached to the surface. A data selection execution device, wherein a still image extracted from a moving image obtained by reproducing associated moving image data is pasted as a texture. 19. The data selection execution device according to claim 9, wherein the data associated with each surface of the three-dimensional rotating object includes audio data, moving image data, or audio data. When the data is moving image data, the data reproduction display means reproduces and displays the associated data in conjunction with the display of the selection object. The data reproduction display means is turned to the front on the display screen by rotating the selection object. When the current plane is switched from the first plane to the second plane adjacent to the first plane, the reproduction display of the data associated with the first plane is faded out, and the reproduction display of the data associated with the first plane is faded. A data selection execution device, comprising: data reproduction display means for performing a reproduction display so as to fade in a reproduction display of data to be attached. 20. The data selection execution device according to claim 9, wherein the data associated with each surface of the three-dimensional rotating object is data including voice data, Data reproduction display means for reproducing and displaying the associated data in conjunction with the display of the object, wherein the surface facing the front on the display screen is rotated from the first surface to the second surface by rotating the selection object. When switching to the second surface adjacent to the first surface, the reproduction sound source position of the data associated with the first surface and the reproduction sound source position of the data associated with the second surface are displayed on the display screen. And a data reproduction / display means for reproducing and displaying the data in accordance with the movement of the positions of the first and second surfaces in the data selection execution device.