JPH1021363A - Method and device for supporting evaluation - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an evaluation supporting device for reducing a time and labor required for developing a new product. SOLUTION: When a prototype model 1 is operated like a key operation is executed to a remote controller within the visual field angle of a CCD camera 21 in a state in which evaluation supporting spectacles 2 equipped with the CCD camera 21 and a display 22 is mounted, a touch panel 11 detects the operating position, and supplies a position detection signal P3 to a picture processing circuit 4. Also, first and second receivers 31 and 32 respectively detect the position and attitude of the prototype 1 and an observer head part, and supplies first and second detection signals P1 and P2 to the picture processing circuit 4. On the other hand, the CCD camera 21 supplies a sight in front of the observer to the picture processing circuit 4 as image pickup data D. The picture processing circuit 4 operates a picture processing to the image pickup data D based on the first and second detection signals P1 and P2, and the position detecting signal P3 in order to prepare synthetic image data E, and supplies it to a video display device 22.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION The present invention relates to a prototype model formed in the same outer shape as a new product to be evaluated in a process of developing a new product such as an electronic component, an electronic device, a daily necessity, and a stationery. The present invention relates to an evaluation support method and an evaluation support apparatus for supporting evaluation of the appearance and function of an evaluation object using three-dimensional graphics data of the object.

[0002]

2. Description of the Related Art Generally, in the development of a new product, first, a prototype is manufactured, and the appearance and function of the prototype are evaluated. As a result of the evaluation, if the appearance and function are satisfactory, production of a new product is started based on the prototype. On the other hand, if the appearance and function are not satisfactory, the prototype is modified or changed to produce a new prototype, and the new prototype is evaluated again for appearance and function. In this manner, the production and evaluation of the prototype are repeated, and the production of a new product is started based on the prototype having the appearance and function that can be finally obtained.

[0003]

However, in the conventional appearance and function evaluation, a prototype having the same appearance and function as the actual product must be manufactured, so that not only takes a long time to manufacture the prototype, but also the above-described process takes place. As described above, it is necessary to repeat the production of the prototype, so that there is a problem that development of a new product requires a long time and a great deal of labor. An object of the present invention is to provide an evaluation support method and an evaluation support device that can reduce the time and labor required for developing a new product.

[0004]

According to the present invention, there is provided an evaluation support method comprising the steps of: converting image data representing a prototype model from image data obtained by photographing the prototype model of the evaluation object by imaging means; The image data is replaced with the image data representing the appearance, and the synthesized image data obtained thereby is supplied to the image display means to display an image for evaluating the appearance of the evaluation object.

[0005] In the evaluation support method, the image display means displays an image of a virtual evaluation object having a color and a pattern corresponding to the image data on the surface of the prototype model. Here, when the prototype model is photographed from various directions by the imaging means, the image of the evaluation object displayed on the image display means changes its posture according to the direction. Thereby, the observer can observe the virtual evaluation object from various directions, and can evaluate the appearance.

In the evaluation support method according to the present invention, of the imaging data obtained by photographing the prototype model of the object to be evaluated by the imaging means, image data representing the prototype model is displayed together with the appearance of the object to be evaluated. The image data is replaced with image data that changes according to the operation on the prototype model, and the synthesized video data obtained by the replacement is supplied to the video display means, and a video for evaluating the function of the evaluation target is projected.

[0007] In this evaluation support method, as in the above-described evaluation support method, the image display means displays an image of a virtual evaluation object having a posture corresponding to the shooting direction with respect to the prototype model of the imaging means. Here, while observing the virtual evaluation object by the image display means, based on the image, performing a series of operations necessary for realizing one operation of the evaluation object on the prototype model, The image of the virtual evaluation object displayed on the image display means changes according to each operation. Thus, it is possible to evaluate the function of the operation procedure and the like for the evaluation object.

[0008] Specifically, the image display means includes a pair of glasses for evaluation support to be worn by an observer who is to evaluate the object to be evaluated.
It is attached to face the observer's eye. Further, specifically, the imaging unit is attached to the evaluation support glasses to be worn by the observer who is to evaluate the evaluation object, and is attached to the front of the observer.

In this specific configuration, when the observer wears the glasses for evaluation support, the imaging means photographs the scene ahead of the observer's head, and the photographed scene is displayed on the image display means. Here, since the imaging direction of the imaging unit changes according to the position and orientation of the observer's head, the image displayed on the image display unit changes according to these changes.
Thereby, the observer can observe the scene in front of the head as if he / she were looking with the naked eye with the image display device.

[0010] An evaluation support apparatus according to the present invention includes a prototype model formed in the same outer shape as an object to be evaluated and having a surface colored in a specific color; A head-mounted unit to be mounted, first detection means for detecting the position and orientation of the prototype model, second detection means for detecting the position and orientation of the observer's head, and an image to be observed by the observer. And an image processing circuit to be created.

[0011] The head-mounted unit is provided with an imaging device attached to the front of the observer's head and a video image to be displayed by the image processing circuit. A display device.

The image processing circuit includes: an image creating means for creating three-dimensional appearance image data representing an appearance of the evaluation object based on the three-dimensional graphics data of the evaluation object; a first detecting means; (2) an arithmetic processing unit for deriving a relative relationship between the position and orientation of the prototype model with respect to the position and orientation of the observer's head based on a detection signal obtained from the detection unit, and an appearance image based on the derived relative relationship Image conversion means for converting the three-dimensional appearance image data obtained from the data creation means into two-dimensional appearance image data representing an evaluation object viewed from the position of the observer's head, and one screen obtained from the imaging device Image data having a specific color is replaced with two-dimensional appearance image data at a position corresponding to each of the image data, thereby creating composite video data; And it comprises a chroma key composition unit for supplying to the shown device.

The above-mentioned evaluation support apparatus is mainly used when evaluating the appearance of an object to be evaluated. The observer who should evaluate the evaluation target wears the head-mounted unit on the head. The imaging device attached to the head mounted unit captures a scene in front of the observer's head, and the captured scene is displayed on a video display device. Here, the imaging direction of the imaging device changes according to the position and orientation of the observer's head, so that the observer can observe the scene in front of the head with the video display device as if he / she were looking with the naked eye. You can do it.

In the evaluation support apparatus of the present invention, a prototype model having the same outer shape as the object to be evaluated and a simple configuration having a specific color on the surface is created in advance. Here, the prototype model is colored, for example, in a specific color. When the observer holds the prototype model within the viewing angle of the imaging device, the imaging device photographs the prototype model and the background from the position of the observer's head, and the imaging data is supplied to the image processing circuit. The following processing is performed.

In the image processing circuit, the evaluation object 3
The three-dimensional graphics data is created in advance, and the image creating means creates three-dimensional appearance image data composed of, for example, RGB data based on the three-dimensional graphics data. The arithmetic processing unit derives a relative relationship between the position and orientation of the prototype model with respect to the position and orientation of the observer's head based on both detection signals from the first detection unit and the second detection unit. Here, the relative relationship is represented by, for example, a coordinate conversion matrix for converting a three-dimensional coordinate system on the prototype model into a three-dimensional coordinate system on the head mounted unit.

The created three-dimensional appearance image data is supplied to image conversion means, and based on the derived relative relationship, three-dimensional appearance image data of the evaluation object viewed from the position of the observer's head. After the coordinate conversion, the three-dimensional appearance image data is converted into two-dimensional appearance image data of the evaluation target viewed from the position of the observer's head. Where 2
The image of the evaluation object represented by the two-dimensional appearance image data has the same posture as the image of the prototype model obtained from the imaging device. Then, the chroma key synthesizing unit replaces the imaging data having the specific color among the imaging data obtained from the imaging device with the two-dimensional appearance image data. As a result, synthesized video data in which only the imaging data of the prototype model is replaced with the appearance image data of the evaluation target is obtained.

By supplying the created composite video data to the video display device, the video display device provides a virtual evaluation object in which colors and patterns corresponding to the appearance image data are applied to the surface of the prototype model. Will be displayed. Here, if the posture of the prototype model held in the hand or the posture of the observer's head is changed, according to these changes in posture,
The image of the evaluation object displayed on the image display device also changes its posture. Thereby, the observer can observe the virtual evaluation object from various directions, and can evaluate the appearance.

Further, the evaluation support apparatus according to the present invention is an evaluation support apparatus for an evaluation object provided with a key operation section and a display section, and a display is performed in response to a key operation, and has the same outer shape as the evaluation object. A prototype model formed on a surface and colored in a specific color, a head-mounted unit mounted on the head of an observer to be evaluated for the evaluation object, and a position and orientation for detecting the position and orientation of the prototype model This is an evaluation support device including: one detection unit; a second detection unit that detects the position and posture of the head of the observer; and an image processing circuit that creates a video to be observed by the observer.

In the prototype model, operation position detecting means is provided in an area corresponding to the key operation section of the object to be evaluated, and the head-mounted unit includes an imaging device mounted forward from the observer's head. , Installed facing the eyes of the observer,
A video display device for displaying a video created by the image processing circuit.

The image processing circuit generates an operation signal based on the position detection signal from the operation position detection means, and associates an operation on the prototype model with a key operation on the evaluation object to generate an operation signal based on the key operation. Means, a display control function executing means for executing a display control function according to the key operation based on the generated operation signal, and an evaluation object based on display control data obtained from the display control function executing means. A first image creating means for creating display image data to be displayed on the display unit; and a third image creating means for creating three-dimensional appearance image data representing the appearance of the evaluation object based on the three-dimensional graphics data of the evaluation object. (2) the position of the prototype model with respect to the position and orientation of the observer's head based on the detection signals obtained from the two image creation means and the first and second detection means; A calculation processing means for deriving a relative relationship between the forces, and a display corresponding to the key operation is performed on the display unit based on the derived relative relationship from the created appearance image data and display image data, and observation is performed. Image processing means for creating two-dimensional composite image data representing an evaluation target visible from the position of the head of the user, and imaging data having the specific color among imaging data for one screen obtained from the imaging device Is replaced with two-dimensional composite image data at a position corresponding to each piece of imaging data to generate composite video data and supply the same to a video display device.

The above-mentioned evaluation support apparatus is mainly used when evaluating the function of an evaluation object. In the evaluation support apparatus, a prototype model having a simple configuration having the same outer shape as the evaluation object and having a specific color on the surface is prepared in advance. Further, the prototype model is provided with an operation position detecting means in an area corresponding to the key operation unit of the evaluation object. In the evaluation support device, when the observer holds the prototype model within the viewing angle of the imaging device, the image display device performs virtual evaluation of the same posture as the prototype model similarly to the evaluation support device. The image of the object is projected. The image includes an image of the key operation unit, and the observer can operate the prototype model based on the image so as to perform a key operation on the key operation unit of the evaluation target.

When the observer operates the prototype model based on the image of the key operation unit while observing the image of the virtual object to be evaluated on the image display device, the position of the operation is determined by the operation position detecting means. Is detected by The operation signal creation means associates an operation on the prototype model with a key operation on the evaluation target based on the position signal from the operation position detection means, and creates an operation signal based on the key operation.

The display control function executing means executes a display control function according to a key operation on the evaluation object based on the operation signal, and the first image creating means controls the display control obtained from the display function executing means. Display image data is created based on the data. Further, in the image processing circuit of the evaluation support apparatus, three-dimensional graphics data representing the evaluation object is created in advance, and the second image creation means includes:
Based on the three-dimensional graphics data, for example, RG
Three-dimensional appearance image data composed of B data is created.

The appearance image data and the display image data thus created are supplied to the image processing means, and a display corresponding to the key operation is displayed on the display unit based on the relative relation derived by the arithmetic processing means. Then, two-dimensional composite image data representing the evaluation target that is viewed from the position of the observer's head and is viewed is created. In the method of creating the composite image data, first, of the three-dimensional appearance image data created by the second image creation means, the appearance image data of the display unit of the evaluation object is replaced with the display image data at the corresponding position. . As a result, three-dimensional composite image data of the evaluation object displayed on the display unit in accordance with the key operation is created. Then, based on the relative relationship derived by the arithmetic processing means, the three-dimensional combined image data is subjected to coordinate transformation into three-dimensional combined image data of the evaluation target visible from the position of the observer's head, and then obtained by coordinate transformation. The obtained three-dimensional composite image data is converted into two-dimensional composite image data of the evaluation target that can be seen from the position of the observer's head. Here, the video of the evaluation target represented by the two-dimensional composite image data is
It will have the same attitude as the image of the prototype model obtained from the imaging device.

In another method of creating the composite image data, first, the display image data and the appearance image data respectively created by the first image creating means and the second image processing means are derived by the arithmetic processing means. Based on the relative relationship, the coordinates are converted into display image data and appearance image data of the evaluation target viewed from the position of the observer's head. Next, the display image data and the appearance image data obtained by the coordinate transformation are compared with the evaluation object 2 viewed from the position of the observer's head.
It is converted into dimensional display image data and appearance image data.
Then, of the two-dimensional appearance image data, the appearance image data of the display section of the evaluation object is replaced with the two-dimensional display image data at the corresponding position. As a result, two-dimensional composite image data of the evaluation object displayed on the display unit in accordance with the key operation is created.

The two-dimensional synthesized image data created in this way is supplied to the chroma key synthesizing means, where it is subjected to the same chroma key synthesizing processing as that of the above-mentioned evaluation support apparatus, and synthetic video data is created. By supplying the created composite video data to the video display device, the video display device is provided with a color and a pattern corresponding to the appearance image data on the surface of the prototype model, and a display corresponding to the display image data. An image of the virtual evaluation object that has been performed is displayed.

Here, when the observer performs a series of operations on the prototype model necessary for realizing a certain operation on the evaluation object, the virtual evaluation object displayed on the video display device is displayed. Will change according to each operation. Thereby, the observer can evaluate the function of the key operation procedure and the key arrangement for the evaluation object.

[0028]

According to the evaluation support apparatus of the present invention, it is possible to evaluate the appearance and function of the evaluation object using a prototype model having a simple configuration in which only the outer shape is formed in the same manner as the evaluation object. Therefore, there is no need to produce a prototype identical to the actual product as in the related art. Needless to say, only by rewriting the three-dimensional graphics data, various appearances of the evaluation object can be virtually realized, and the appearance can be evaluated. Also, by simply changing the correspondence between the operation on the prototype model by the operation signal creating means and the key operation on the evaluation object, and the display control function by the display control function executing means, various operations of the evaluation object are virtually realized. And evaluate the function.
Therefore, there is no need to repeat the production of a prototype as in the conventional case, and the time and labor required for developing a new product can be significantly reduced as compared with the conventional case.

[0029]

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram showing an embodiment of the present invention applied to an evaluation support apparatus for a remote controller (hereinafter referred to as a remote controller) of a video tape recorder having operation keys and a display panel. Will be explained. As shown in FIG. 1, the evaluation support apparatus of the present embodiment has a prototype model (1) formed in the same outer shape as the remote controller and having a blue-colored surface, and an observer who is to evaluate the remote controller. Evaluation support glasses (2), an image processing circuit (4) composed of a microcomputer or the like, and an image processing circuit
And a magnetic field generator (3) controlled by (4).

The prototype model (1) is provided with a touch panel (11) for detecting an operation position in an area corresponding to operation keys of a remote controller, and a first receiver (31) at a lower portion. The first receiver (31) functions as a three-dimensional position sensor together with the magnetic field generator (3), and detects the position and orientation of the prototype model (1) based on the magnetic field generator (3). The evaluation support glasses (2) are provided with a CCD camera (21) so that when the observer wears the evaluation support glasses (2), the photographing direction is directed to the front of the observer. A display (22) is attached to face the eye. A second receiver (32) is attached to one end of the vine of the glasses for evaluation support (2), and the second receiver (32) works together with the magnetic field generator (3) as a three-dimensional position sensor. And detects the position and orientation of the observer's head with respect to the magnetic field generator (3).

When the observer wears the glasses for evaluation support (2) and holds the prototype model (1) within the viewing angle of the CCD camera (21), the CCD camera (21) (1) and a scene in front of the observer including the observer's hand is photographed, and the image data D is supplied to the image processing circuit (4). Also, the first
The receiver (31) receives the magnetic signal from the magnetic field generator (3) and creates a first detection signal P1 representing the position and orientation of the prototype model (1). On the other hand, the second receiver (32) receives the magnetic signal from the magnetic field generator (3) and creates a second detection signal P2 representing the position and posture of the observer's head. Both detection signals P1 and P2 are supplied to the image processing circuit (4). The image processing circuit (4) performs synthesized image data E by performing image processing described later on the imaged data D based on the two detection signals P1 and P2, and supplies the synthesized image data E to the image display device (22).

FIG. 3 shows the configuration of the main part of the image processing circuit (4). In the image processing circuit (4), three-dimensional computer graphics data representing the shape of the remote controller is created in advance and stored in the CG data storage memory (44). The appearance image data creation circuit (45) reads out the computer graphics data from the CG data storage memory (44) and creates three-dimensional appearance image data A as shown in FIG. 6A based on the data. Here, the appearance image data A is composed of RGB data at each pixel position, and includes three-dimensional coordinate information and color information. The created appearance image data A is supplied to the synthesizing circuit (46) as shown in FIG. Here, when the prototype model (1) is not operated, since the display image data B is not supplied from the display image data creation circuit (43), the appearance image data A is directly converted into three-dimensional composite image data C as the conversion circuit (47). ).

The first and second detection signals P1 and P2 from the first receiver (31) and the second receiver (32) are supplied to a coordinate transformation matrix creation circuit (48). Coordinate transformation matrix creation circuit (48)
Represents three-dimensional combined image data C obtained from the combining circuit (46).
Is converted into a three-dimensional composite image data of the remote controller that can be seen from the position of the observer's head.

Here, the coordinate conversion matrix and the principle of the coordinate conversion using the coordinate conversion matrix will be specifically described with reference to FIG. As shown, the reference coordinate system (Xo, Yo, Zo) on the magnetic field generator (3), the prototype model center coordinate system (X ', Y', Z ') on the prototype model (1), evaluation support glasses (2)
The eyeglass center coordinate system (X, Y, Z) for evaluation support is respectively set above. Here, a coordinate transformation matrix for transforming the reference coordinate system (Xo, Yo, Zo) into the prototype model center coordinate system (X ', Y', Z ') is M1, and the reference coordinate system (Xo, Yo, Zo).
Let M2 be a coordinate conversion matrix for converting into the evaluation support glasses center coordinate system (X, Y, Z).

Prototype model center coordinate system (X ', Y', Z ')
Is converted into the evaluation support glasses center coordinate system (X, Y, Z) by first converting the prototype model center coordinate system (X ′, Y ′, Z ′) to the reference coordinates by the inverse matrix M1 ⁻¹ of the conversion matrix M1. System (Xo, Y
o, Zo), and then convert to the reference coordinate system using the transformation matrix M2.
(Xo, Yo, Zo) is converted to the eyeglass center coordinate system (X,
(Y, Z). Accordingly, the prototype model center coordinate system (X ', Y', Z ')
Is converted to the evaluation support glasses center coordinate system (X, Y, Z) by the following equation (1).

(Equation 1) Here, W and W 'are constants required for convenience in the matrix expression.

The first receiver (31) and the second receiver
From (32), a three-dimensional coordinate value in the reference coordinate system (Xo, Yo, Zo) and a rotation angle around the three axes are obtained as the first and second detection signals P1 and P2, respectively. Therefore, the coordinate transformation matrix creating circuit (48) firstly converts the reference model coordinate system (Xo, Yo, Zo) from the reference model coordinate system (Xo, Yo, Zo) based on the two detection signals P1 and P2 into ', Z') and a reference coordinate system (Xo, Yo,
A coordinate conversion matrix M2 from Zo) to the glasses center coordinate system (X, Y, Z) for evaluation support is calculated.

(Equation 2) Here, t1 and t2 are parallel rows of three rows and one column, respectively, and are prototype models obtained from both detection signals P1 and P2.
It is determined by the three-dimensional coordinate value representing the position of (1) and the three-dimensional coordinate value representing the position of the observer's head. Also, R1
Are the three-by-three rotation matrix on the Xo axis, the three-by-three rotation matrix on the Yo axis, and the three-by-three rotation matrix on the Zo axis obtained from the rotation angle representing the attitude of the prototype model (1). It is calculated by multiplying. Similarly, R2 is a 3-by-3 rotation matrix for the Xo axis obtained from the rotation angle representing the posture of the observer's head, and 3 for the Yo axis.
It is calculated by multiplying a rotation matrix of 3 rows and a rotation matrix of 3 rows and 3 columns with respect to the Zo axis. Then, the coordinate transformation matrix creation circuit (48) generates a coordinate transformation matrix M1,
Based on M2, the prototype model center coordinate system (X ', Y',
A coordinate transformation matrix (M2 · M1 ⁻¹ ) for transforming Z ′) into the evaluation support glasses center coordinate system (X, Y, Z) is calculated.

The coordinate transformation matrix (M
2 · M1 ⁻¹ ) is supplied to a conversion circuit (47), as shown in FIG.
The three-dimensional combined image data C obtained in 6) is converted into three-dimensional combined image data of the remote controller that can be seen from the position of the observer's head. Here, the conversion circuit (47) associates the three-dimensional coordinate system of the three-dimensional composite image data C obtained from the synthesis circuit (46) with the prototype model center coordinate system, and converts the three-dimensional composite image in the prototype model center coordinate system. After creating data (X ', Y', Z '), the three-dimensional composite image data (X', Y ', Z')
Is multiplied by a coordinate transformation matrix (M2 · M1 ⁻¹ ) to obtain three-dimensional composite image data (X ′, Y ′, Z ′) of the remote controller that can be viewed from the position of the observer's head. X, Y, Z).

Next, the conversion circuit (47) converts the three-dimensional composite image data (X, Y, Z) into two-dimensional composite image data C '.
(X, Y). Here, in the data conversion from three-dimensional to two-dimensional, for example, when the Z-axis is taken in the forward direction of the observer, the X coordinate value and the Y coordinate value of the three-dimensional composite image data (X, Y, Z) are calculated. By dividing by the Z coordinate value, two coordinate values (X /
Z, Y / Z) and ignoring the Z coordinate value. As a result, two-dimensional composite image data C '(X, Y) having a perspective can be obtained.

The two-dimensional composite image data C '(X, Y) obtained in this way is supplied to a zoom ratio adjusting circuit (51). The zoom ratio adjustment circuit (51) is used to enlarge or reduce an image formed by the two-dimensional composite image data C '(X, Y) to an appropriate size according to the specifications of the CCD camera (21). Is set in advance, and the zoom ratio adjustment circuit (51) multiplies the two-dimensional composite image data C ′ (X, Y) by the zoom ratio, and obtains the resulting two-dimensional composite image data. C "(X, Y) is supplied to the chroma key synthesizing circuit (5).

On the other hand, the image data D (Xc, Yc) obtained from the CCD camera (21) is supplied to a viewing angle adjusting circuit (52). Here, the imaging data D (Xc, Yc) is at each pixel position.
It is composed of RGB data at (Xc, Yc) and includes two-dimensional coordinate information and color information for each pixel. The viewing angle adjusting circuit (52) multiplies the imaging data D (Xc, Yc) by a constant corresponding to the human viewing angle to create imaging data D '(Xc, Yc) as shown in FIG. I do. The created image data D '(Xc, Yc) is supplied to the chroma key synthesizing circuit (5) as shown in FIG.

The chroma key synthesizing circuit (5) converts the coordinate system of the image data D '(Xc, Yc) into two-dimensional synthetic image data C ".
After matching the coordinate system of (X, Y), the imaging data D '(X, Y) of the blue pixel area in the imaging data D' (X, Y) for one screen is displayed on the same coordinates. Is replaced with the two-dimensional synthesized image data C ″ (X, Y).
Only the imaging data D '(X, Y) of (1) is replaced by two-dimensional composite image data C "(X, Y) of a remote controller created by computer graphics, as shown in FIG. 6 (c). The composite video data E (X, Y) is obtained, and the composite video data E (X, Y) created in this manner is obtained.
Is supplied to the display (22) as shown in FIG. 3 and is displayed as an image.

FIG. 4 shows a series of procedures of the image processing. First, in step S1, the first receiver (31)
After detecting the position and orientation of the prototype model (1), the position and orientation of the observer's head are detected by the second receiver (32) in step S2. Next, in step S3, based on the detection results in steps S1 and S2, coordinate transformation matrices M1 and M2 expressed by the above equation 2 are created, and then the prototype coordinate system is moved from the prototype model center coordinate system to the evaluation support glasses center coordinate system. (M2 · M1 ⁻¹ ) is created.

Subsequently, in step S4, three-dimensional appearance image data A representing the appearance of the remote controller is created. In step S5, based on the presence or absence of the position detection signal P3 from the touch panel (11), the prototype model (1) is created. ) Is determined. Here, if the operation is not performed on the prototype model (1), it is determined as NO, and step S
The process proceeds to step S10, where the three-dimensional appearance image data A is set as the three-dimensional composite image data C, and then the process proceeds to step S11.

In step S11, the conversion circuit (47) converts the coordinates of the three-dimensional composite image data C into three-dimensional composite image data of the remote controller that can be viewed from the position of the observer's head. The composite image data is converted into two-dimensional composite image data C '.

Subsequently, in step S13, the two-dimensional composite image data C 'is multiplied by the zoom ratio to generate two-dimensional composite image data C ". In step S14, the composite video data E is obtained by chroma key combination. Create step S
For the specific procedure of chromakey synthesis in 14,
It will be described later. Then, after supplying the composite video data E to the display (22) in step S15, it is determined in step S16 whether or not to terminate the evaluation procedure. If NO, the process returns to step S1, and the same image processing is performed. repeat. On the other hand, in the case of YES, the procedure ends.

FIG. 5 shows a specific procedure of chroma key synthesis in step S14 of the above procedure. Here, X_IMG_SIZE and Y_IMG_SIZE are the sizes of the images formed by the two-dimensional composite image data C ″ (X, Y), respectively. First, in step S20, the imaging data D ′ (X
c, Yc) is defined as the two-dimensional composite image data C ″ (X, Y)
Are made to coincide with the coordinate system of X and Y in step S21.
Is initialized to 1. Next, in step S22, it is determined whether or not the image data D '(X, Y) represents blue. If NO, the process proceeds to step S23 to synthesize the image data D' (X, Y). This is set as video data E (X, Y). On the other hand, in the case of YES, the process shifts to step S24 to set the two-dimensional composite image data C ″ (X, Y) as the composite video data E (X, Y).

Subsequently, after counting up X in step S25, in step S26, X becomes its maximum value X_
It is determined whether it is equal to or smaller than IMG_SIZE, and in the case of YES, the process returns to step S22 to repeat the replacement of the imaging data D ′ (X, Y) and the two-dimensional composite image data C ″ (X, Y).
Thereafter, when it is determined NO in step S26,
In step S27, X is initialized to 1 and Y is counted up. Next, in step S28, it is determined whether or not Y is equal to or less than the maximum value Y_IMG_SIZE. If YES, the process returns to step S22 to return the imaging data D '(X, Y) and the two-dimensional composite image data C "(X, Y) is repeated.
When it is determined, the procedure is terminated. by this,
On the display (22), an image of a virtual remote controller in which a color and a pattern corresponding to the appearance image data A are given on the surface of the prototype model (1) is projected.

Then, the observer observes the image of the virtual remote controller on the display (22), and
When the same operation as the key operation at the time of recording reservation is performed for (1), the touch panel (11) detects the operation position and creates a position detection signal P3.
Is supplied to the image processing circuit (4) as shown in FIG. The image processing circuit (4) performs image processing (described later) on the imaging data D based on the first and second detection signals P1, P2 and the position detection signal P3 to create composite video data E, and displays the video display device ( twenty two)
Supply to

The position detection signal P3 is input to an operation signal generation circuit (41) of the image processing circuit (4) as shown in FIG. The operation signal generation circuit (41) determines which operation key of the remote controller corresponds to the operation position on the prototype model (1) based on the position detection signal P3, and generates an operation signal based on the key operation on the remote controller. create. The created operation signal is supplied to the display control function execution circuit (42).

The display control function execution circuit (42) executes a display control function according to the key operation based on the operation signal to create display control data. The created display control data is supplied to the display image data creation circuit (43), and in response, the display image data creation circuit (43) creates the display image data B to be displayed on the display panel of the remote controller. . For example, as shown in FIG. 7 (a), display image data B "recording end" is generated, and the display image data B is supplied to the synthesizing circuit (46) as shown in FIG.

The display image data B created by the display image data creation circuit (43) is supplied to the synthesizing circuit (46), and FIG. 7A created by the appearance image data creation circuit (45). Is supplied as shown in FIG. The synthesizing circuit (46) replaces the appearance image data A on the display panel of the remote controller with the display image data B on the same coordinates among the appearance image data A. As a result, three-dimensional composite image data C of the remote controller on which "recording end" is displayed on the display panel is obtained. The composite image data C created in this way is supplied to the conversion circuit (47).

The conversion circuit (47) and the zoom ratio adjustment circuit (51) operate in the same manner as when the operation is not performed on the prototype model (1), and the chroma key synthesis circuit (5) includes:
The display panel displays "recording end", and supplies two-dimensional composite image data C "(X, Y) of the remote controller, which can be viewed from the position of the observer's head. Is supplied with imaging data D '(Xc, Yc) as shown in FIG. 7B obtained from the viewing angle adjusting circuit (52).

The chroma key synthesizing circuit 5 does not perform an operation on the prototype model 1 based on the image data D '(Xc, Yc) and the two-dimensional synthesized image data C "(X, Y). Perform the same chromakey synthesis as in the original model
Only the imaging data D '(X, Y) of (1) is replaced with two-dimensional composite image data C "(X, Y) of a remote controller created by computer graphics, and the composite data as shown in FIG. The video data E (X, Y) is created, and the synthesized video data E (X, Y) thus created is supplied to the display (22) as shown in FIG.

In the image processing procedure shown in FIG. 4, when an operation is performed on the prototype model (1), step S
It is determined YES at 5 and the process moves to step S6.
In step S6, the operation on the prototype model (1) is associated with the key operation on the remote controller, and an operation signal based on the key operation is created. Next, in step S7, after executing the display control function corresponding to the key operation, step S7 is executed.
In step 8, display image data B to be displayed on the display panel of the remote controller is created. Then, in step S9, the appearance image data A and the display image data B are combined to create three-dimensional combined image data C, and the process proceeds to step S11. Hereinafter, the same procedure as when no operation is performed on the prototype model (1) is executed, and when YES is determined in step S16, the procedure is terminated. Thereby, on the display (22), a color and a pattern corresponding to the appearance image data A are applied to the surface of the prototype model (1) and a display corresponding to the display image data B is performed. The video will be projected.

Here, when the observer performs a certain operation on the remote controller, for example, a series of operations necessary for realizing the recording reservation, on the prototype model, the display is displayed.
The image on the display panel of the virtual remote controller displayed in (22) changes according to each operation. by this,
The observer can evaluate the key operation procedure and the key arrangement function of the remote controller.

According to the evaluation support apparatus of this embodiment, a prototype model having a simple configuration in which only the outer shape is formed in the same manner as the remote controller
Since the function of the remote controller can be evaluated using (1), there is no need to produce a prototype identical to the actual product as in the related art. Prototype model (1) by operation signal creation circuit (41)
Correspondence between the operation on the remote control and the key operation on the remote
By simply rewriting the computer program that defines the display control function by the display control function execution circuit (42), various operations of the remote controller can be virtually realized, and the function can be evaluated. Therefore, there is no need to repeat the production of a prototype as in the conventional case, and the time and labor required for developing a new product can be significantly reduced as compared with the conventional case. Also, by simply rewriting the three-dimensional computer graphics data in the CG data storage memory (44), various appearances of the remote controller can be virtually realized, and the evaluation of the appearance can be performed at the same time.

The description of the above embodiments is for the purpose of describing the present invention, and should not be construed as limiting the invention described in the claims or reducing the scope thereof.
In addition, the configuration of each part of the present invention is not limited to the above-described embodiment, and it goes without saying that various modifications can be made within the technical scope described in the claims.

In the above embodiment, the present invention is applied to the evaluation support apparatus for a remote control having an operation key and a display panel to perform both the appearance and the function evaluation. It is also possible to perform only the appearance evaluation by implementing the evaluation support apparatus. In this case, the touch panel (11), the operation signal creation circuit (41), the display control function execution circuit (42), the display image data creation circuit (43), and the synthesis circuit
(46) can be omitted.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating an overall configuration of an evaluation support device according to the present invention.

FIG. 2 is a diagram illustrating the principle of coordinate conversion in an image processing circuit.

FIG. 3 is a block diagram illustrating a configuration of a main part of the image processing circuit.

FIG. 4 is a flowchart illustrating a procedure of image processing by an image processing circuit.

FIG. 5 is a flowchart illustrating a procedure of chroma key synthesis in the image processing circuit.

FIG. 6 is a perspective view illustrating a state of image synthesis when no operation is performed on a prototype model.

FIG. 7 is a perspective view illustrating a state of image synthesis when an operation is performed on a prototype model.

[Explanation of symbols]

 (1) prototype model (11) touch panel (2) glasses for evaluation support (21) CCD camera (22) display (3) magnetic field generator (31) first receiver (32) second receiver (4) image processing circuit

Claims (6)

[Claims] 1. An image data representing a prototype model of image data obtained by photographing a prototype model of an object to be evaluated by an image capturing means, is replaced with image data representing an appearance of the object to be evaluated, and a composite obtained by the replacement is obtained. An evaluation support method characterized by supplying video data to video display means and projecting a video for evaluating the appearance of an evaluation object. 2. Among image data obtained by photographing a prototype model of an object to be evaluated by an imaging means, image data representing a prototype model is changed according to an operation on the prototype model while representing an appearance of the object to be evaluated. An evaluation support method characterized by replacing image data, supplying synthesized image data obtained by the replacement to image data, and projecting an image for evaluating a function of an evaluation object. 3. The image display means is attached to evaluation support glasses to be worn by an observer who is to evaluate the object to be evaluated, facing the eye of the observer.
Evaluation support method described in. 4. The imaging device according to claim 1, wherein the imaging unit is attached to the evaluation support glasses to be worn by an observer who is to evaluate the object to be evaluated, in a forward direction of the observer. Evaluation support method described. 5. A prototype model formed in the same outer shape as the object to be evaluated and having a surface colored in a specific color, and a head-mounted unit to be mounted on the head of an observer who is to evaluate the object to be evaluated. And a first for detecting the position and orientation of the prototype model
An evaluation support apparatus comprising: a detection unit; a second detection unit configured to detect a position and a posture of an observer's head; and an image processing circuit configured to create a video to be observed by the observer. The unit includes an imaging device mounted forward from the observer's head, and a video display device that is installed to face the observer's eyes and displays an image created by the image processing circuit.
The image processing circuit, based on the three-dimensional graphics data of the evaluation object,
An image creating means for creating three-dimensional appearance image data representing the appearance of the evaluation object; and a prototype for the position and orientation of the observer's head based on detection signals obtained from the first detection means and the second detection means. An arithmetic processing unit for deriving a relative relationship between the position and the posture of the model; and three-dimensional appearance image data obtained from the appearance image data creating unit on the basis of the derived relative relationship, which can be viewed from the position of the observer's head. Image conversion means for converting into two-dimensional appearance image data representing an evaluation object;
An evaluation support apparatus comprising: chromakey synthesizing means for generating synthesized video data by replacing the imaging data having the specific color with two-dimensional appearance image data at a position corresponding to each imaging data and supplying the synthesized video data to a video display device . 6. An evaluation support apparatus for an evaluation object, which includes a key operation unit and a display unit and is displayed according to a key operation, wherein the evaluation object is formed in the same outer shape as the evaluation object and has a specific surface. A prototype model that is colored in color, a head-mounted unit that is mounted on the head of the observer whose evaluation target is to be evaluated, first detection means that detects the position and orientation of the prototype model, A second detection means for detecting the position and orientation of the part, and an image processing circuit for creating an image to be observed by the observer. Position detecting means is installed,
The head-mounted unit includes an imaging device mounted forward from the observer's head, a video display device installed to face the observer's eyes, and for displaying an image created by the image processing circuit. With
An image processing circuit configured to generate an operation signal based on the key operation by associating an operation on the prototype model with a key operation on the evaluation target based on the position detection signal from the operation position detection unit; Display control function executing means for executing a display control function according to the key operation based on the operation signal, and displaying on a display section of the evaluation object based on display control data obtained from the display control function executing means. A first image creating means for creating display image data to be created, and three-dimensional graphics data of the evaluation object,
A second image creating means for creating three-dimensional appearance image data representing the appearance of the evaluation object; and a position and orientation of the observer's head based on detection signals obtained from the first detection means and the second detection means. An arithmetic processing unit for deriving a relative relationship between the position and orientation of the prototype model with respect to, and based on the derived relative relationship from the created appearance image data and display image data, the display unit responds to the key operation. Image processing means for creating two-dimensional combined image data representing an evaluation target that is displayed and is viewed from the position of the observer's head; and one image data of one screen obtained from the imaging device,
An evaluation support apparatus comprising: a chroma key synthesizing unit that generates synthesized video data by replacing the imaging data having the specific color with two-dimensional synthesized image data at a position corresponding to each imaging data and supplies the synthesized video data to a video display device .