JPH1091057A - Technical consultation assistance system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain a technical consultation assistance system in which smooth consultations in which misunderstantings are hardly generated can be realized by defining authrity for every user to operations which are expected to be executed in a three dimensional working space. SOLUTION: This system is provided with operation authority storage means 7 defining the authrity of operations of respective users in the three dimensional shared working space and operation authority judging means 8 judging whether operation functions to be executed by a user are usable or not or what kinds of operation functions are to be selected among usable operation functions based on information stored in operation authrity storage means 7. A network 9 connects plural nodes 1, 2 of users of the technical consultation assistance system. As a result, the authority of operations of respective users in the three dimensional shared working space are defined and whether respective users may perform arbitrary operations or not can be judged based on the definitions. Thus, it can be prevented that a customer who does not have a knowledge about objectives and a customer who does not have an operation authority perform erroneous operations.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a system in which a customer and a technician at remote locations realize a three-dimensional shared work space on a computer terminal connected by a network, and become an object of consultation in the space. The present invention relates to a technical consultation support system for sharing a three-dimensional image, operating a target, accessing explanatory information of the target, and consulting by voice conversation while reproducing a sound generated by the target.

[0002]

2. Description of the Related Art A system in which a plurality of users realize a three-dimensional solid model in a virtual space on a terminal such as a personal computer connected to a network owned by an individual is disclosed in, for example, JP-A-8-87489. There are techniques indicated. FIG. 52 is a diagram showing a configuration example of a conventional cyberspace system disclosed in JP-A-8-87489. In this example, an arbitrary number (two in this example) of servers 36 are shown. Have a corresponding storage device 37, and are configured to be able to provide a virtual reality space via a broadband communication network 38 using an optical fiber. Further, an arbitrary number (three in this example) of user terminals 39 are provided, and the server 36 provides a virtual reality space and a predetermined service (information) using the same from the server 36 via the broadband communication network 38. It is configured to be able to receive.

Further, in this example, an arbitrary number (two in this example) of service provider terminals 40 are provided, and the service provider terminals 40 use a broadband communication network 38. , The virtual reality space is provided via the server 36, and the user terminal 39
It is configured to be able to provide a predetermined service.

FIG. 53 specifically shows a configuration example of the user terminal 39 disclosed in Japanese Patent Application Laid-Open No. 8-87489. In the figure, a user terminal 39 is a CPU 4
The CPU 41 executes various processes according to a program stored in the ROM 42. RA
M43 stores data and programs necessary for the CPU 41 to execute various processes as appropriate, and the communication device 44 transmits and receives data to and from the server 36 via the broadband communication network 38. It is configured.

The display device 45 includes a CRT, an LCD, and the like, and can display a CG (computer graphic) three-dimensional image or a three-dimensional image photographed by a normal video camera or the like. The microphone 46 is used when outputting an audio signal to the server 36. The speaker 47 outputs an audio signal when the audio signal is transmitted from the server 36, and the input device 48 is operated when performing various inputs.

[0006] The keyboard 49 of the input device 48 is operated when inputting predetermined characters and symbols, and the mouse 50 is operated when specifying a predetermined position. on the other hand,
The viewpoint input device 51 is for inputting a viewpoint of a corresponding character of the user terminal 39.
The viewpoint of the character can be moved up, down, left, and right, and a predetermined image can be zoomed. Further, the movement input device 52 is for performing an input for moving the character in a forward, backward, left, or right direction at a predetermined speed.

[0007] The interface 53 constitutes a data interface to the display device 45, mouse 50, speaker 47, and input device 48.

Next, the operation will be described. The service provider terminal 40 controls a part of the virtual reality space provided by the server 36. In other words, the service provider purchases a part of the provided virtual reality space from the administrator of the server 36. This purchase is performed in the real space. That is, when an administrator of the server 36 receives an application for purchasing a virtual reality space from a predetermined service provider,
Allocate a part of the virtual reality space to the service provider.

[0009] For example, it is assumed that the owner (service provider) of the service provider terminal 40 rents a room of a predetermined building in the virtual reality space, and sets up an electronics store there. The service provider provides the server administrator with products to be displayed at the appliance store, for example, materials of television. The server administrator generates a stereoscopic image of the television using computer graphics based on the material. Then, the stereoscopic image is arranged at a predetermined position in the electronic store. As a result, an image of the virtual reality space is completed.

Now, it is assumed that the character C of the user terminal 39 has entered this electronic store. At this time, for example, an image as shown in FIG. 54 is displayed on the display device 45 of the user terminal 39 in accordance with the position and the viewpoint of the character C. Two televisions 54 are arranged in the space of the electronics store, and a counter 55 is arranged diagonally forward right of the television 54. When the character F of the service provider terminal is located behind the counter 55, FIG.
The character F is displayed as shown in FIG.

By operating the movement input device 52 of the user terminal 39 to move the character C around the television 54, an image corresponding to the position and the viewpoint is displayed on the display device 45. Thereby, the user can observe the television 54 in the same manner as when observing an actual television.

Also, as shown in FIG.
A cursor 56 used when designating a predetermined image from the user terminal 39 is displayed on the image viewed from the user. In the user terminal 39, when the cursor 56 is moved and clicked on an image on the television 54, for example, the server 3
From 6, more detailed explanation information of the television 54 (provided information)
Can be provided. The image at this time may be a three-dimensional image or a planar two-dimensional image.

A software technology for displaying a virtual space by three-dimensional graphics is disclosed in Japanese Patent Application Laid-Open No. 8-874.
No. 89 is used. This typical thing is M
OpenGL (document Microsoft Systems Journal, which is a library for application programs for developing software for three-dimensional graphics on Windows of Microsoft Corporation)
l No. 34 p. 12-26 (1994.12),
No. 35 p. 95-110 (1995.2), N
o. 36 p. 156-173 (1995.4)
ASCII). In the three-dimensional virtual space, information such as coordinates, shapes, viewpoints, and light sources of vertices of the three-dimensional model is created as data, and the three-dimensional display of the virtual space is displayed on a personal computer window screen using the OpenGL library function. Can be done on top.

Recently, VRML (Virtual R)
A language for constructing data for displaying a three-dimensional model in a virtual space, called "ealing Modeling Language", is in the spotlight. Software that reads a file written in this language and displays a three-dimensional virtual space is called a VRML browser. This VRM
The L browser can also be developed using a library such as OpenGL. To realize the embodiment of the present invention, it is necessary to create a program using a programming library for displaying such a three-dimensional virtual space. Do not touch.

[0015]

Since the conventional system is configured as described above, a customer and a technician at remote locations share a stereoscopic image to be consulted and operate the object. Or access to more detailed explanation information of the object (such as a three-dimensional model display catalog of the components that make up the object), or one-to-one individual forms and training while reproducing the sound generated by the object There are the following problems when applied to a technical consultation support system that provides consultation in a meeting form, a group guidance form, an in-store explanation form at an exhibition, a tour tour form, and the like.

Problem 1: A customer who has no knowledge of an object during a consultation, or a customer who wants to limit the operations that can be performed, performs an erroneous operation or information that is not related to the description. There was a possibility that the consultation would not proceed smoothly because of the access to the system and the generation of sound.

Problem 2: Permission to execute a certain operation according to the customer's knowledge of the object, contract, qualification, class level, etc., and individual consultation, workshop, group guidance, in-store explanation, etc. Could not be given dynamically.

Problem 3: When a technician wants a customer to look at an object from the same viewpoint as the technician when giving a technical explanation to the customer, the technician looks at the contents of the description of the technician to see where. If an object representing a technician is displayed, make sure that the customer is conscious of looking for the object and looking in the same direction as the object. did not become.

Problem 4: A customer who has no knowledge of an object may not be able to grasp where the viewpoint has moved when the viewpoint of looking at the object changes suddenly. On the other hand, if it is expected that the technician knows what part of the object is being described, it may be better to shift the viewpoint directly to that part.
It has not been possible to set and control whether to switch such viewpoints continuously or directly according to the situation.

Problem 5: Since it is not possible to register a simulation operation to be dynamically executed at the time of explanation, individual movements (assembly of assembly) when explaining operations such as mounting and assembling mechanical parts or repeating physical and chemical experiments are repeated. Technicians had to carry out the installation of screws and mounting of parts for each operation. In addition, when such a series of operations is complicated, there is a risk that an incorrect operation may be performed if a customer performs the operation. Further, when recording and reproducing the above series of operations in the form of video data of a two-dimensional image, the recording data cannot be processed by a method of adding a different operation during the reproduction. .

Problem 6: The object to be consulted is a building such as a house or a building, and when guiding the customer through the building,
Since the customer did not know the inside of the building, there was a high possibility that the customer would go in the wrong direction without receiving the instructions of the technician.

Problem 7: When giving an explanation to a customer, in order to have the technician determine what he / she is looking at, he or she must make a prediction from the description or find an object representing the technician. Therefore, it was necessary to predict from the direction in which the object was facing, and it was not possible for the technician to directly visually recognize the part being viewed.

Problem 8: When explaining some parts of all parts while looking at the whole object, the customer visually indicates which part of the object corresponds to which part of the object. I couldn't do that. In the case of the pointer instruction, it is indicated by a point, and it is difficult to specify the area. Therefore, it is necessary to keep moving the pointer during the explanation.

Problem 9: There is a case where it is impossible for a customer to accurately hear only a sound to be explained because a surrounding sound unrelated to the explanation is heard.

Problem 10: Since a sound unrelated to the explanation is heard, the customer may not be able to accurately hear only a plurality of specific sounds to be explained.

Problem 11: When ordering the components constituting the object one by one without moving the viewpoint while looking at the entire object, the color of the pointer is the object even if the target component is indicated by the pointer. Because they have the same color as the parts, it was sometimes difficult to tell where they were pointing.

Problem 12: In some cases, it is difficult to determine whether the pointer displayed on the screen is a customer's pointer or a technician's pointer. Further, the object itself may be difficult to see because the pointer is displayed.
Also, when giving explanations to a plurality of customers, even if each customer has a difference in the level of qualifications, roles in dealing and consultation, etc., it is not possible to recognize each pointer.

Problem 13: When performing an operation such as lifting an object or fixing a screw, the pointer always has a two-dimensional constant shape (such as an arrow) even if the object is displayed in three dimensions. However, there is a problem that it is not possible to actually feel what kind of work operation is being performed.

The present invention has been made in order to solve the above-described problems, and by defining the authority for each user for operations that can be performed in a three-dimensional space, it is possible to prevent misunderstandings. The purpose is to obtain a technical consultation support system capable of realizing consultations.

[0030]

The technical consultation support system according to the first invention is characterized in that a customer and a technician at remote locations operate a three-dimensional shared work space on a computer terminal connected via a network. In a technical consultation support system in which a consultation is performed while operating a target by sharing a three-dimensional image serving as a target of the consultation in the space, the target in the three-dimensional shared work space or explanation information about the target is stored. Object data storage means, display means for displaying a three-dimensional shared work space using data stored in the object data storage means, and audio data of the user and sound data stored in the object data storage means. Sound output means to output the sound situation in the 3D shared work space by using it, necessary for input sound from the user and operation of the object User input means for receiving an operation request, communication management means for transmitting / receiving information to / from another node sharing the three-dimensional shared work space, and information input from the input means and information sent from the communication management means Management means for performing addition or change processing on the three-dimensional workspace, operation right storage means for defining the authority of each user's operation in the three-dimensional shared space, and operation right storage means Operation authority determining means for determining whether or not an operation function executed by a user can be used, or an operation function that can be selected by the user, based on the present information.

According to a second aspect of the present invention, in the technical consultation support system according to the first aspect of the present invention, a technician dynamically activates a customer's customer in the three-dimensional shared space as needed during operation of the system. An operation authority setting means for changing the operation authority or adding a new operation authority is provided.

According to a third aspect, in the technical consultation support system according to the first aspect, there is provided a viewpoint control means for controlling the viewpoint of the customer from the same viewpoint as the technician.

According to a fourth aspect of the present invention, in the technical consultation support system according to the third aspect, the viewpoint control means changes the smoothness when shifting the customer's viewpoint from the customer's own viewpoint to the engineer's viewpoint. It can be set by a technician according to the condition.

According to a fifth aspect, in the technical consultation support system according to the first aspect, a simulation operation recording means for recording a sequence of operations on a plurality of objects performed by a technician in advance on an object as one simulation operation. It is provided with.

According to a sixth aspect, in the technical consultation support system according to the first aspect, when an object corresponds to a building and a customer is guided to the building, a predetermined range within a predetermined range is set. And a warning range generating means for generating warning information when the customer tries to enter an erroneous area.

According to a seventh aspect of the present invention, in the technical consultation support system according to the first aspect of the present invention, a spotlight is applied to a point of view pointed by a technician, or a fog effect is applied to a point other than a point of interest to blur the field of view. This is provided with a viewpoint comprehension means for causing the user to see.

According to an eighth aspect of the present invention, in the technical consultation support system according to the first aspect of the present invention, there is provided a light-and-shade setting in which a part of an object is light-and-dark expressed in a plurality of levels in accordance with the degree of attention required of a customer. Means.

According to a ninth aspect, in the technical consultation support system according to the first aspect, only the sound of the specified sound source can be heard and sound field control means for cutting off the sound of the other sound sources is provided. It is.

According to a tenth aspect, in the technical consultation support system according to the first aspect, there is provided a sound setting means for setting a sound by setting a plurality of levels in a stepwise manner in accordance with the degree of attention required of the customer. It was done.

According to an eleventh aspect of the present invention, in the technical consultation support system according to the first aspect, when the object is composed of a plurality of parts, the color of the part designated by the technician is changed and blinks. Display, solid display,
The apparatus is provided with a pointer location indicating means capable of displaying a wire frame or a pattern.

According to a twelfth aspect, in the technical consultation support system according to the first aspect, a pointer display control means for displaying only a pointer for a specific person or changing a pointer display method for each user is provided. Things.

According to a thirteenth aspect, in the technical consultation support system according to the first aspect, a mouse pointer operation tool display means for displaying a mouse pointer as an operation tool by displaying a three-dimensional model in accordance with the content of the operation is provided. It was done.

[0043]

BEST MODE FOR CARRYING OUT THE INVENTION

Embodiment 1 FIG. FIG. 1 shows a first embodiment of the present invention.
This will be described with reference to FIGS. FIG. 1 is a configuration diagram of a technical consultation support system according to the first embodiment.
Reference numeral 1 denotes an object data storage unit for storing an object in the three-dimensional shared workspace and more detailed explanation information thereof.
Is a display means such as a display for displaying a three-dimensional shared work space using data stored in the object data storage means 1, and 3 is a voice of a user of the technical consultation support system or stored in the object data storage means 1. A sound output unit such as a speaker that outputs sound conditions in the three-dimensional shared work space using sound data. Reference numeral 4 denotes a microphone for inputting a user's voice, and a mouse or keyboard for receiving a request for the user to move the object, access more detailed explanation information of the object, or reproduce a sound generated by the object. 5 is a communication management means for transmitting / receiving information to / from another node sharing the three-dimensional shared work space, and 6 is input information input from the user input means 4 or transmitted from the communication management means 5. This is an operation management unit that performs appropriate processing such as adding or changing the three-dimensional shared work space based on the received information. Further, reference numeral 7 denotes an operation authority storage unit that defines the operation authority of each user in the three-dimensional shared work space, and 8 denotes an operation function executed by the user based on information stored in the operation authority storage unit 7. An operation authority judging unit 9 for judging whether or not the operation is possible or selecting an operation function usable by the user, and a network 9 for connecting a plurality of user nodes of the technical consultation support system.

In the system according to the present embodiment, it is assumed that the machine configuration using a plurality of terminals is not a client server configuration but a configuration in which data in the same three-dimensional shared work space is stored in all terminals. Therefore, the operation information at each terminal is managed by the communication management means 5 and the operation management means 6 so that the storage contents of the object data storage means 1 are consistent among all terminals.

FIG. 2 is an example of the operation authority table 10 managed by the operation authority storage means 7. For example, when technical consultation about a car is conducted between a technician and a customer, operations on the car that can be performed on the screen include operations such as opening and closing a door, activating a wiper, moving a seat, and tires and seats. Access to catalog data, reproduction of horn and engine sounds, etc. are specified.

The operation authority table 10 defines whether each user can execute or refer to these operations. Here, the operation reference refers to whether the user can see the result of the operation performed by another user on his or her own screen, or if the operation is a reproduction of a sound, can hear the sound. . In the operation authority table 10, "Y" is described when there is an execution or reference authority, and "N" is described when there is no such authority. In the operation authority table 10 shown in FIG. 2, for example, for an operation of generating a horn sound, the technician has the execution right and the reference right, but the customer has only the reference right.

FIG. 3 is a diagram showing a use image of the technical consultation support system in the present embodiment. In FIG. 3, one technician 11 and two customers, and a customer A12 and a customer B13, are performing technical consultation on an automobile. Three users view images of a virtual shared work space surrounding a car from the screen of a terminal owned by each user from their respective viewpoints. Technician 11 sees two customers facing the whole car, while customer A1
2 is looking at the door portion, and customer B13 is looking at the tire portion.

Here, for example, when the technician 11 performs an operation of opening the door of the car, the state of the car with the door opened is displayed on the screen of the technician 11. An open door is also displayed on the screen of the customer A12. Technician 11
For example, when a detailed explanation about a tire is given, when an access operation to detailed explanation information about a tire is performed, the information is displayed on a screen of each user. This information is, for example, information on the three-dimensional model, price, material, manufacturer, etc. of the tire, and is displayed on the screen of each user in a form as shown in FIG.

When the technician 11 wants to hear the sound of the horn, the sound of the horn is reproduced when the technician 11 performs an operation to sound the horn. At this time, this sound is heard not only by the technician 11 but also by the customers A12 and B12 within the range where the horn sound can be heard. However, even if the customer A12 or the customer B13 wants to sound a horn, if the operation authority table 10 defines that the user is not authorized to sound the horn, the operation cannot be executed.

Each operation such as opening a door, accessing detailed explanation information of a tire, and sounding a horn is performed by inputting a specific key from a keyboard, or by taking a portion of the door on the screen, the tire, or the like. It is realized by clicking the part, the horn part with the mouse at hand.

Next, the operation will be described. FIG. 5 shows a processing flow of the technical consultation support system when executing the operation defined in the operation authority table. First, in step S101, the technical consultation support system is activated. Next, in step S102, the operation management unit 6 displays the three-dimensional model of the consultation target on the display unit 2 based on the information stored in the object data storage unit 1. I do.

When the object is a car, the car is composed of a plurality of objects such as a car body, tires, windows, doors, engines, seats inside the car, and steering wheels. In addition, the sound of the horn and the sound of the engine are also treated as one object. The object data storage means 1 stores the three-dimensional shape data of the object (sound data in the case of a sound object) for each object constituting the target object in the position and direction of the object in the three-dimensional shared work space. It is managed with data such as. As a management method, for example, there is a method in which fields such as a shape, a color, a position, and a direction are provided in an object, and respective data are set in the fields.

The object data storage means 1
More detailed descriptive information about the object, such as catalog data for the object, is also stored. This can be managed, for example, by providing a field called an anchor in the object and setting a data name of more detailed description information of the object in the field.

In step S102, when the three-dimensional model of the consultation target is displayed on the display unit 2 based on the information stored in the object data storage unit 1, the operation management unit 6 proceeds to step S103. An event message of an operation request from a user passed through the user input means 4 or an operation request sent from another node through the communication management means 5 is received.

The operation management means 6 manages a correspondence table between input identifiers such as key numbers and the type of mouse operation clicked and operation contents. FIG. 6 is an example of a correspondence table 14 between inputs and operation contents managed by the operation management means 6. The operation management means 6 determines in step S104 whether or not the received request is a request for operating an object constituting an object in the three-dimensional shared work space, based on the correspondence table 14 between the input and the operation content. I do.

In the case of a request to operate the object, in step S105, the received request is a request from the user passed through the user input means 4, or an event sent from another node through the communication management means 5. Determine if it is a message. Step S104
, The passed input is a correspondence table 14 between the input and the operation content.
If not, the process returns to step S103. Step S10
In step S106, if the request is input by the user in step S5, the operation authority determination unit 8 refers to the operation authority table 10 managed by the operation authority storage unit 7 to execute the requested operation. Checks whether the requestor has authority.

If it is determined in step S107 that the user has the right to execute the requested operation, the operation management unit operates six objects in step S108. That is, an addition or change is made to the three-dimensional work space of the local node according to the requested operation. For example, in the case of an operation of moving a car seat, the value of the field of the position of the object managed by the object data storage unit 1 is changed, and the object is displayed again on the display unit 2. The objects may collide with each other due to the movement of the objects. However, here, it is assumed that the objects can be freely moved even if they collide with other objects.

In the case of an operation for accessing more detailed information on tires, for example, the data of the corresponding information is extracted from the object data storage means 1 and displayed on the display means 2. Further, for example, in the case of an operation for sounding a horn, the sound data of the horn is taken out from the object data storage means 1, and how much the sound of the horn is attenuated is calculated from the distance between the horn and the position where the user is located, and the volume of the sound data is calculated. Find the value.
Then, the sound data is mixed and processed by the sound output means 3.
Output to

Next, in order to notify another node that the three-dimensional shared work space has been changed, step S109 is performed.
Then, the communication management means 5 sends an event message of the performed operation to the communication management means 5 of another node via the network 9. This event message also sends some data with the operation along with the operation name. For example, in the case of an operation of moving a seat, data of the position of the movement destination is sent together with the operation name of moving the seat. Then, the process returns to step S103. Also, in step S107,
If there is no right to execute the operation, the process returns to step S103.

In step S105, if the request is an operation request event message sent from another node through the communication management means 5 (this event means that the object is operated at another node and the three-dimensional shared This event indicates that the workspace has changed.)
In step S110, the operation name is extracted from the event message, and the operation authority determination unit 8 refers to the operation authority table 10 managed by the operation authority storage unit 7 to determine whether the operation authority is authorized to refer to the operation. Find out.

If the user has the reference right to the operation sent as the event message in step S111, the user operates the object in step S112 similarly to step S108, and places the object in the three-dimensional workspace of the local node according to the content of the operation. After giving an addition or change, step S103
Return to Also, if there is no reference right in step S111, the process returns to step S103. This process is repeated until the technical consultation support system ends.

In the present embodiment, the operation authority table 10 of FIG. 2 manages information on whether or not operation is possible. However, for operations for accessing data, data to be accessed is classified according to customer level. It is possible to manage multiple levels of operation authority, such as distinguishing between simple and detailed ones, and for sound generation operations, changing the accuracy of the generated sound data by level. is there.

Embodiment 2 A second embodiment of the present invention will be described with reference to FIGS. In this embodiment, the technician dynamically changes
It is possible to change the authority of a customer's operation in the shared dimension space or add a new operation authority.

FIG. 7 is a block diagram of a technical consultation support system according to the second embodiment. In the figure, reference numeral 15 denotes an operation authority which is dynamically managed by the operation authority storage means 7 as needed during system startup. An operation authority setting unit that can change the contents of the table 10. The same components as those of the system shown in FIG.
A duplicate description is omitted.

Next, the operation will be described. FIG. 8 shows a processing flow of the technical consultation support system when dynamically setting the operation authority during the activation of the system.

First, in step S201, the technical consultation support system is started. In step S202, the operation management unit 6 receives the event message of the authority setting request from the user passed through the user input unit 4 or the authority setting request sent from another node through the communication management unit 5.

Next, in step S203, it is determined whether the received request is a request from the user passed through the user input means 4 or an event message sent from another node through the communication management means 5. .

If the request is input by the user, in step S204, the operation authority determination unit 8 determines whether the operation authority table 1
By referring to 0, it is determined whether or not there is an execution right for setting the authority. Here, when the system is started, the technician has set both the execution right and the reference right in the operation right table 10 for the operation of setting the right, the execution right is not set for the customer, and only the reference right is set. It is assumed that is set.

If there is an execution right in step S204, a screen for setting authority is displayed on the display means 2 in step S205. FIG. 9 shows an authority setting screen, which is an operation authority table 10 managed by the operation authority storage 7.
Along with changing permissions, adding permissions for new operations,
Buttons for confirming the settings and canceling the settings are displayed.

When the setting button on the authority setting screen is selected by the user, the operation authority setting means 15 updates the operation authority table 10 managed by the operation authority storage means 7 in step S206. Next, step S207
, The communication management means 5 sends an event message of the authority setting request to the communication management means 5 of another node via the network 9. At that time, the set operation name,
The data including the user name to which the authority is set and the data of the set authority are transferred. Then, the process returns to step S202. If there is no authority to set in step S204, the process returns to step S202.

If it is determined in step S203 that the request is an event message of an authority setting request sent from another node through the communication management means 5, the process proceeds to step S203.
At 208, the operation authority setting unit 15 extracts the set operation name, the set user name, and the authority data from the event message, and updates the operation authority table 10 managed by the operation authority storage unit 7. I do. Then, the process returns to step S202. This process is repeated until the technical consultation support system ends.

Embodiment 3 A third embodiment of the present invention will be described with reference to FIGS. In the present embodiment, the technician can switch the viewpoint of the customer to the same viewpoint as the technician, whereby the screen of the three-dimensional shared work space displayed on the customer side is always the same as the screen of the technician. It is like that. FIG. 10 is a configuration diagram of a technical consultation support system according to the third embodiment. In the figure, reference numeral 16 denotes a technician dynamically changing the viewpoint of a customer to the same viewpoint as the technician as needed during the activation of the system. This is a viewpoint control means for controlling. The same components as those shown in FIG. 1 are denoted by the same reference numerals, and the description thereof will not be repeated.

The viewpoint control means of the node manages the following four variables relating to the viewpoint. (1) WHOV: Indicates the viewpoint from which the user is watching. (For example, a user ID is entered as a value.) (2) CURPV... Indicates the current viewpoint position and direction of WHOV. (3) MYPV: Indicates the position and direction of the user's unique viewpoint. (4) COV: Indicates another user when the viewpoint of another user is switched to the viewpoint of the user. (For example, a user ID is entered as a value.)

Next, the operation will be described. FIG.
FIG. 9 shows a processing flow of the technical consultation support system when a viewpoint is moved or a user's viewpoint is dynamically switched to another user's viewpoint during activation of the system. First, in step S301, the technical consultation support system is activated. At this time, the operation authority table 10 managed by the operation authority storage means 7 is set so that only the technician has the execution right to change the viewpoint of the customer as shown in FIG. It is assumed that

In step S302, the viewpoint control means 16 determines the variables WHOV and CO managed by the viewpoint control means 16.
V to the ID of the user of the local node, CURPV and M
The values of the current viewpoint position and direction are entered in YPV. In step S303, the operation management unit 6 receives an event message of a viewpoint operation request from the user passed through the user input unit 4 or a viewpoint operation request sent from another node through the communication management unit 5.

Next, in step S 304, it is determined whether the received request is a request from the user passed through the user input means 4 or an event message sent from another node through the communication management means 5. .

If the request is a user input, it is determined in step S305 whether the request is a request to move the viewpoint or a request to change the viewpoint of another user. If the request is to move the viewpoint, it is checked in step S306 whether the variable WHOV managed by the viewpoint control unit 16 is the ID of the user of the local node. If the ID is the ID of the user of the local node, in step S307, the value of the requested destination position and direction is entered in the variable CURPV managed by the viewpoint control unit 16.

Then, in step S308, the variable CURP
The viewpoint is moved to the position and direction indicated by V. Since the viewpoint is stored as one object in the object data storage unit 1, the value of the field of the position and direction of the viewpoint object is changed to the value of the variable CURPV. Then, an image of the three-dimensional shared work space viewed from the changed viewpoint is displayed on the display unit 2. Next, in step S309, it is checked whether or not the variable COV managed by the viewpoint control unit 16 includes the ID of a user of another node. If the ID of the user of another node is included (if there is a user controlled to the same viewpoint as the technician's viewpoint), step S
At 310, the communication management means 5 sends an event message of the viewpoint movement to the communication management means 5 of the node corresponding to the COV via the network 9. This event message is sent together with the operation name of viewpoint movement, including data on the position and direction of the destination. Then, the process returns to step S303.

If the value of WHOV is not the ID of the user of the local node in step S306, and
If it is determined in step 309 that the COV does not include the user ID of another node, the process returns to step S303.

If it is determined in step S305 that the request is for changing the viewpoint, the flow advances to step S311. The request from the user to change the viewpoint includes who (FRO)
Indicate who (TOV) perspective to change from MV) perspective 2
Data is included. In step S311, the operation authority determination unit 8 refers to the operation authority table 10 managed by the operation authority storage unit 7 to determine whether there is an execution right to change the FROMV viewpoint to the TOV viewpoint. If there is an authority to change, step S3
At 12, it is checked whether the TOV is a technician ID. If the ID is a technician ID, the communication management unit 5 sends a message of a viewpoint change event to the communication management unit 5 of another node via the network 9 in step S313. At this time, the value of the variable CURPV is entered into FROMV, TOV, and data NEWPVV indicating the position and orientation of the viewpoint to be changed, and these data are sent as an event message together with an event name of viewpoint change. Next, step S314
In step S3, the value of TOV is added to the value of variable COV.
Return to 03.

In step S312, the TOV is the ID of the engineer.
Otherwise (in the case of a request to return the customer's point of view from the technician's point of view to the customer's own point of view), in step S315, the communication management unit 5 sends the message of the viewpoint change event via the network 9 to the node corresponding to the TOV. It is sent to the communication management means 5. At that time, F with the event name of viewpoint change
Sends ROMV and TOV data. Next, step S31
In step 6, the value of TOV is removed from the variable COV, and the process returns to step S303.

If it is determined in step S304 that the request is an event message for a viewpoint operation request sent from another node through the communication management unit 5, the process proceeds to step S304.
At 317, whether the request is a request to move the viewpoint,
It is determined whether the request is to change the viewpoint of another user.
If the request is to move the viewpoint, step S318
The data of the position and direction of the movement destination is extracted from the event message received in step (1), and is entered into the variable CURPV managed by the viewpoint control means 16. And step S31
At 9, the viewpoint is moved to the position and direction indicated by the variable CURPV, and the process returns to step S303.

If it is determined in step S317 that the request is for changing the viewpoint, the flow advances to step S320. The event message for changing the viewpoint includes two data indicating who (TOV) viewpoint to change from (FROMV) viewpoint. In the case of an event message that changes to a technician's viewpoint, data (NEWPVV) indicating the position and direction of the viewpoint to be further changed is also included. In step S320, it is checked whether the value of the data TOV included in the transmitted event message is the ID of the engineer. If the ID is a technician ID, in step S321,
It is checked whether the value of the variable WHOV managed by the viewpoint control unit 16 is the ID of the user of the local node.

If it is the ID of the user of the local node (when the viewpoint of the customer who is the user of the local node is changed to the viewpoint of the technician), in step S322,
The variable MEPV managed by the viewpoint control means 16 has a variable C
Enter the value of URPV. That is, the current position and direction of the viewpoint are stored as the user's own viewpoint before the change. Next, in step S323, the value of the data NEWPV included in the event message sent to the variable CURPV is entered. Next, in step S324, the ID of the engineer is entered in the variable WHOV managed by the viewpoint control means 16. Then, in step S325, the position and direction of the viewpoint object are set to the value of the variable CURPV, and an image of the three-dimensional shared work space viewed from the viewpoint of the technician is displayed on the display unit 2, and thereafter, the process returns to step S303. Also, in step S312, when the WHOV is not the ID of the user of the local node (when the viewpoint of the customer who is already the user of the local node is the viewpoint of the technician), the process returns to step S303.

If the TOV is not the technician ID in step S320 (in the case of a request to return the customer's viewpoint from the technician's viewpoint to the customer's own viewpoint), step S32
At 6, it is checked whether the variable WHOV is the ID of the engineer. If the ID is the technician's ID (when the customer's viewpoint is returned from the technician's viewpoint to the customer's own viewpoint), step S
At 327, the value of the variable MYPV is entered into the variable CURPV.
That is, the stored position and direction of the customer's own viewpoint are extracted. Next, in step S328, the variable WHOV
, The ID of the user (customer) of the local node is entered, and in step S329, the position and direction of the viewpoint object are set to the value of the variable CURPV, and the three-dimensional shared workspace viewed from the viewpoint of the user (customer) of the local node itself. After displaying the image on the display unit 2, the process returns to step S303.

In step S326, WHOV
Is not the ID of the technician (when the viewpoint of the customer who is the user of the local node is the viewpoint of the customer), the process returns to step S303. This process is repeated until the technical consultation support system ends.

Embodiment 4 A fourth embodiment of the present invention will be described with reference to FIGS. In the present embodiment, when the technician shifts the customer's viewpoint from the customer's own viewpoint to the technician's viewpoint, various types of transition methods such as abrupt transition or a smooth transition are determined according to the situation. It can be set. This is because in the third embodiment, when the user makes a request for changing the viewpoint, the smoothness or the smooth transition when changing from the viewpoint before the change to the viewpoint after the change is designated by specifying the smoothness. Realize.

FIG. 13 shows the positions and directions of the viewpoint FPOV before the change and the viewpoint TPOV after the change, and the arrows indicate the directions of the viewpoint. When changing the viewpoint from the FPOV position to the TPOV position, a plurality of intermediate points between the FPOV and the TPOV are set as viewpoints, and the three-dimensional shared work space viewed from the viewpoint is displayed on the display means.
For the user watching the screen, the viewpoint appears to shift smoothly. The direction is also FPOV
When the angle is changed little by little instead of suddenly changing from the direction of the TPOV to the direction of the TPOV, it is felt that the viewpoint shifts smoothly.

Assuming that the distance between the position of the FPOV and the position of the TPOV is L, for the same distance L, the viewpoint moves more smoothly as the number of intermediate points set as the viewpoint increases. If the distance L is short, the number of intermediate points set as viewpoints to obtain the same smoothness may be small. That is, smoothness is determined by the distance L and the number of intermediate points set as viewpoints. Conversely, the parameter SMOOT is used to indicate the smoothness at the time of shifting the viewpoint from the user.
When H is designated, the number of intermediate points NUMMV to be set as the viewpoint is determined by L and the value of SMOOTH, and is obtained by a certain function F (L, SMOOTH). It is assumed that the user can request, for example, five-step numerical values from 1 to 5 as the value of the parameter SMOOTH indicating the smoothness.
Here, it is assumed that as the numerical value is larger, the transition is smoother, and as the numerical value is smaller, the transition is more rapid.

Next, the operation will be described. FIG.
This shows a processing flow when the viewpoint control means 16 changes the viewpoint to another user's viewpoint and shifts with the specified smoothness. First, in step S401, the viewpoint position FPOV before the change and the viewpoint position T after the change are set.
The distance L between the FPOV and the TPOV is obtained from the POV. Next, in step S402, F is calculated from L and the value of the parameter SMOOTH indicating the smoothness specified by the user.
(L, SMOOTH) is calculated, and the number NUMMV of the intermediate point between the FPOV and the TPOV to be set as the viewpoint is obtained. Next, in step S403, the coordinates of NUMMV intermediate points are obtained from the FPOV position and the TPOV position. Next, in step S404, the direction of each viewpoint to be set at the NUMMV intermediate points is determined from the direction of the FPOV and the direction of the TPOV. Finally, in step S405, the image of the three-dimensional shared work space viewed from each viewpoint is displayed on the display unit 2 while setting the viewpoint to each intermediate point.

Embodiment 5 A fifth embodiment of the present invention will be described with reference to FIGS. In the present embodiment, a sequence of a plurality of operations performed by a technician on an object in advance (such as mounting or assembling mechanical parts or a physical experiment or a chemical experiment in a science experiment) is recorded as one simulation operation. After the recording, the simulation operation can be reproduced.

For example, it is assumed that the operation of jacking up performed when replacing a tire includes the following four operations. (A) Take out the jack. (B) Place the jack near the tire. (Move the jack close to the tire.) (C) Turn the jack and raise it to the position where the jack is applied. (D) Turn the jack handle and jack up until the tire is separated from the ground. If these four operations are included in the correspondence table 14 between the input and the operation content managed by the operation management means 6, the simulation operation called jack-up is recorded and reproduced by continuously executing the four operations. it can.

FIG. 15 is a diagram showing the configuration of a technical consultation support system according to the fifth embodiment. In FIG. 15, reference numeral 17 denotes a sequence of a plurality of operations performed by a technician on an object in advance as one simulation operation. This is a simulation operation recording means. The same components as those shown in FIG. 1 are denoted by the same reference numerals, and redundant description will be omitted.

Next, the operation will be described. FIG.
3 shows a processing flow of the technical consultation support system of the present embodiment when a sequence of a plurality of operations performed on an object during the activation of the system is recorded as one simulation operation. First, in step S501, the technical consultation support system is activated. In step S502, the operation management unit 6 receives a simulation operation record request from the user passed through the user input unit 4 or a simulation operation record request event message sent from another node through the communication management unit 5.

Next, in step S 503, it is determined whether the received request is a request from the user passed through the user input unit 4 or an event message sent from another node through the communication management unit 5. .

If the request is input by the user, in step S 504, the operation authority determination unit 8 determines whether the operation authority table 1 is managed by the operation authority storage unit 7.
By referring to 0, it is determined whether or not there is an execution right to record the simulation operation. Here, when the system is started, the technician has set both the execution right and the reference right in the operation right table 10 for the operation of recording the simulation operation, and the execution right is not set for the customer. It is assumed that only rights are set.

If it is determined in step S504 that the user has the authority to record, an input from the user is accepted in step S505. Here, the user inputs an input when requesting execution of each operation constituting the simulation (mouse click, input of a specific key from a keyboard, or the like), or information indicating the end of recording of the simulation. In step S506, it is determined whether the received input is a request to end recording. If it is not a recording end request, it is an input for executing a certain operation constituting the simulation. Therefore, the input is stored in step S507, and the process returns to step S505.

If it is determined in step S506 that the recording has been requested, the flow advances to step S508 to receive an input key for executing a simulation to be recorded. This input key can be designated by the user selecting a desired key. When the user inputs an input key for executing the simulation operation, in step S509, the key and the input key for executing each operation constituting the simulation operation stored in step S507 are assigned to the simulation operation authority. The information is registered in the simulation operation table managed by the recording unit 17.

FIG. 17 shows simulation operation recording means 1.
7 is an example of a simulation operation table 18 managed by the computer 7; In FIG. 17, for example, if the key 3 is an input key for executing the above-described simulation of jack-up, an input key A for executing an operation of taking out the jack and a jack are displayed in the column of input arrangement. Key B to execute the operation of putting the tire near the tire, input key C to execute the operation of turning the jack to the position where the jack is applied, and turning the jack handle to jack up until the tire is separated from the ground. The input key D for executing the operation is registered.

Next, in step S510, the communication management means 5 sends a message of the simulation operation recording event to the communication management means 5 of another node via the network 9. At this time, the event message is sent together with the event name of the simulation operation record and the data of the sequence of the execution input keys of the simulation operation to be recorded and the execution input keys of each operation constituting the simulation operation. Then, the process returns to step S502. In step S504, even if there is no authority to record,
It returns to step S502.

On the other hand, if the request is an event message of a simulation operation recording request sent from another node through the communication management means 5 in step S503, the simulation operation recording means 17 converts the event message from the event message in step S511. Take out the data of the simulation execution input key and the execution input key of each operation constituting the simulation operation,
It is registered in the simulation operation table 18 managed by the simulation operation recording means 17. Then, the process returns to step S502. This process is repeated until the technical consultation support system ends.

After a certain simulation operation has been recorded in this way, if the execution key of the simulation is input by the user, the simulation operation recording means 17 refers to the simulation operation table 18 to execute the simulation operation. Is sent to the operation management means 6. Operation management means 6
Each operation is executed by referring to the correspondence table between the input and the operation content managed by the computer, and the recorded simulation operation is reproduced. Further, a function of interrupting the reproduction during the reproduction is provided so that execution of a new operation can be input from the interrupted state. Accordingly, when the simulation operation is recorded and reproduced in a form such as video data of a two-dimensional image, it is possible to change the operation to another operation from a halfway point of the recording.

In this embodiment, one unit of the simulation operation is assigned to a specific key specified by the user.
It is also possible to employ an input interface which is registered as a menu list and called for each operation name.

Embodiment 6 FIG. A sixth embodiment of the present invention will be described with reference to FIGS. In the present embodiment, when the object is a building such as a house or a building, and when guiding the customer through the building, the moving range of the customer is limited so that the customer can only go to a specific range. When a customer attempts to enter the area, a warning sound is sounded, a warning light flashes, information indicating a warning is displayed, and the like, and a warning can be issued.

FIG. 18 is a block diagram of a technical consultation support system according to the sixth embodiment. In the figure, reference numeral 19 denotes a moving range restricting means for limiting a moving range of a user, and 20 denotes a case where a user enters an incorrect area. It is a warning generating means for sounding a warning sound, blinking a warning light, and displaying information indicating a warning when a warning is issued. The same components as those shown in FIG. 1 are denoted by the same reference numerals, and redundant description will be omitted.

FIG. 19 shows an example of the moving authority table 21 managed by the moving range restricting means 19. Movement authority table 2
An object corresponding to a boundary between a movable area and a non-movable area is specified in the field of the first object. FIG.
In the example, "Y" indicates that the user has the authority to move to the area ahead of the object, and "N" indicates that the object cannot be moved.

FIG. 20 shows an example of the warning method table 22 managed by the warning generating means 20. When a user who is prohibited from moving contacts the object specified in the object column of the warning method table 22, the user performs an operation indicated in the warning operation content column to issue a warning. In FIG. 20, for example, when a user who is prohibited from moving to Room 1 attempts to move to Room 1, a warning sound is generated.

For example, assume that a customer A who is receiving an explanation of the inside of a building is looking at a screen having entrances to three rooms (Room) as shown in FIG. The double circle mark on the screen indicates the viewpoint of the customer A. When the operation of moving forward from the state of FIG. 21 is performed, the customer A can move to Room 2 according to the definition of the movement authority table 21 of FIG. 19, and the screen inside Room 2 as shown in FIG. Is projected.

On the other hand, when an operation of moving forward on the screen as shown in FIG. 23 is performed, the moving authority table 21 in FIG.
Since the customer A cannot move to Room 3, the screen remains in the state shown in FIG. 24, and cannot proceed further. When an operation of moving forward from the state of FIG. 24 is performed, a warning sound is emitted from the sound output unit 3 according to the definition of the warning method table 22 of FIG.

Next, the operation will be described. FIG.
FIG. 3 shows a processing flow of the technical consultation support system in the present embodiment when a restriction is imposed on a user's movement range. First, in step S601, the technical consultation support system is activated. Next, in step S602,
An avatar representing the user himself is placed in the shared workspace. This is done by creating an object called an avatar.

Next, in step S603, a request to move the user is received from the user, and in step S604
Then, the movement range restricting means 19 checks whether the avatar object comes into contact with another object due to the movement of the user. If contact is made in step S605, step S6
At 06, it is checked whether the contacting object is specified in the movement authority table 21. If it is specified in the move authority table 21, it is checked in step S607 whether the user has authority to move.

If the avatar can be moved, the avatar is moved in step S608, and the process returns to step S603. If it is not possible to move in step S607, the warning generating means 20 checks the warning method table 22 in step S609, and executes a warning generating operation according to the method defined in the warning method table 22 in step S610. And step S60
Return to 3.

If the user object does not touch any object in step S605, or
The object contacting at 606 is the moving authority table 21
If not, the avatar is moved in step S611. Then, the process returns to step S603. This process is repeated until the technical consultation support system ends.

An example in which a technician guides a building in a tour format when giving a technical description of the building will be described. FIG.
6 shows an image of the use. Unlike the previous example in which each customer sets a door where entry and exit are prohibited, conditions for checking are set so that each distance between the technician and the customer is kept constant.

FIG. 27 shows an example of the movable area condition table 23 managed by the movement range restricting means 19. The setting example of the movable area condition table 23 in FIG.
When on the floor, the customer must be within a 10-meter radius of the technician and when on the second floor, customer A must be within a 20-meter radius of the technician and customer B must be within 10 meters. Means “∞” in the movable area condition table 23 means that there is no condition for moving and that the user can freely act. Accordingly, in the setting example of FIG. 27, the customer can freely act on the third floor. Here, the method of designating a room that is not allowed to enter as in the precedent is effective.

FIG. 28 shows a processing flow of the technical consultation support system when the distance between the technician and the customer is restricted in the sixth embodiment. First, when the technical consultation support system is activated in step S621, an avatar representing the user is placed in the shared work space in step S622.

Next, in step S623, a request to move the user is received from the user. Step S62
In step 4, the movement range restricting means 19 checks the value specified in the movable area condition table 23. If the value is not “$”, it is checked in step S625 whether the distance between the user who requested the movement and the technician is within the value of the movable area condition table 23.

If the distance between the user and the technician is within the value of the movable area condition table 23, step S62.
In 6, the user's avatar is moved, and the process returns to step S623. If the distance between the user and the technician exceeds the value in the movable area condition table 23 in step S625, the warning generation unit 20 checks the warning method table 22 in step S629, and checks the warning method table 22 in step S628. Perform an alerting operation in a defined manner. Then, the process returns to step S623.

If the value of the movable area condition table 23 is “$” in step S624, step S629
To move the user's avatar, and the process returns to step S623. This process is repeated until the technical consultation support system ends.

Embodiment 7 FIG. A seventh embodiment of the present invention will be described with reference to FIGS. In this embodiment, the technician dynamically shines a spotlight on the target portion of the technician's viewpoint in the three-dimensional shared work space as needed during the start-up of the system, and fog (fog) in a place other than the place of interest. An effect can be applied to blur the field of view, or the amount of light emitted from the light source to the surroundings can be reduced to darken the periphery of the point of interest. As a form in which a technician puts a spotlight on a place where the customer wants to pay attention, an example in which a technician holds a spotlight in a hand as shown in FIG. 29 or a number of spotlights as shown in FIG. There are examples that are prepared separately.

FIG. 31 is a block diagram of a technical consultation support system according to the seventh embodiment. In FIG. 31, reference numeral 24 denotes a user's viewpoint in the three-dimensional shared work space dynamically as needed during the activation of the system. Spot light on the target area, apply a fog effect to the area other than the area you want to pay attention to blur the view, or reduce the amount of light that the light source hits the surrounding area and darken the periphery of the area of interest It is a way to grasp the viewpoint. The same components as those shown in FIG. 1 are denoted by the same reference numerals, and redundant description will be omitted. The viewpoint grasping unit manages the position and direction of the viewpoint of the user of the local node.

Next, the operation will be described. FIG.
It shows a processing flow of the technical consultation support system in the present embodiment in which a target portion of a user's viewpoint is spotlighted to grasp the target portion. First, step S7
At 01, a technical consultation support system is activated. In step S702, an event of a viewpoint grasp (or release) request from the user passed through the user input unit 4 by the operation management unit 6 and a viewpoint grasp (or release) request sent from another node through the communication management unit 5 Receive a message.

Next, in step S703, it is determined whether the received request is a request from the user passed through the user input means 4 or an event message sent from another node through the communication management means 5. .

If the request is input by the user, in step S704, the operation authority determination unit 8 determines whether the operation authority table 1
By referring to 0, it is determined whether or not the user has the right to execute the operation for grasping the viewpoint. Here, when the system is started, the technician has set both the execution right and the reference right in the operation right table 10 for the operation of grasping the viewpoint, the customer has no execution right, and only the reference right is set. It is assumed that is set.

If there is an execution right in step S704, it is determined in step S705 whether the request is a viewpoint grasp request or a viewpoint grasp release request. In the case of a viewpoint grasp request, in step S706, the viewpoint grasping unit 24 extracts an object called a spotlight from the object data storage unit 1, and sets the position and direction data values of the viewpoint in the position and direction fields. In step S707, the spotlight object is displayed on the display unit 2
To be displayed.

Next, in step S708, the communication management means 5 sends the event message of the viewpoint comprehension request to the network 9
To the communication management means 5 of another node via that time,
The event message is sent together with the event name of the viewpoint comprehension request and data on the position and direction of the spotlight display. Then, the process returns to step S702.

On the other hand, in step S705, in the case of a viewpoint grasp release request, it is checked in step S709 whether a spotlight is displayed. If it is displayed, the display is deleted in step S710. Then, in step S711, the communication management unit 5 sends an event message of a viewpoint grasp release request to the communication management unit 5 of another node via the network 9, and then returns to step S702.
If the spotlight is not displayed in step S709, the process returns to step S702.

In step S703, if the request is an event message of a viewpoint grasp (or release) request sent from another node through the communication management means 5, in step S712, the request is a viewpoint grasp request or a viewpoint grasp release request. Determine if there is. In the case of a viewpoint grasp request,
In step S713, the viewpoint grasping unit 24 extracts an object called a spotlight from the object data storage unit 1, and sets the value of the field of the position and direction to the data of the display position and direction of the spotlight included in the event message.

Then, in step S714, after displaying the spotlight object on the display means 2, the process proceeds to step S714.
Return to 702. In step S712, in the case of a viewpoint grasp release request, it is checked in step S715 whether a spotlight is displayed. If so,
In step S716, the display is deleted, and step S702 is performed.
Return to In step S715, if no spotlight is displayed, the process returns to step S702.
This process is repeated until the technical consultation support system ends.

In the above embodiment, a spotlight is displayed as a method of grasping the viewpoint. However, a method of blurring a portion other than the viewpoint using a fogging function other than the position and direction of the viewpoint may be used. A programming library for displaying a three-dimensional virtual space has a function called fogging, such as OpenGL, which makes an image of a distant object as fog-like in order to express depth.

Embodiment 8 FIG. An eighth embodiment of the present invention will be described with reference to FIGS. In the present embodiment, the technician dynamically pays attention as needed during the start-up of the system, for example, by brightening a portion of an object that the customer wants to pay the most attention to, and darkening a portion that the user does not want to pay attention to. Depending on the degree of demand, it is possible to set light and dark by adding a plurality of levels that are stepwise to light and dark.

FIG. 33 is a diagram showing the configuration of a technical consultation support system according to the eighth embodiment. In the figure, reference numeral 25 denotes a plurality of objects in the three-dimensional shared work space which are dynamically added as needed during system startup. This is a light / dark setting means for leveling the light / dark in steps and setting the light / dark. The same components as those shown in FIG. 1 are denoted by the same reference numerals, and redundant description will be omitted.

FIG. 34 shows an example of the light / dark level table 26 managed by the light / dark setting means 25. In the light / dark level table 26, a light / dark level is defined for each object constituting the object.

The level can be specified, for example, in three stages of 1 to 3, and the larger the numerical value, the stronger the brightness. Normally, all objects are displayed at level 2 brightness,
When a technician requests a light / dark setting, each object is displayed with the brightness defined in the light / dark level table 26.

Next, the operation will be described. FIG.
In the present embodiment, there is shown a processing flow of the technical consultation support system when dynamically increasing or decreasing the brightness of each object during activation of the system. First, step S801
, A technical consultation support system is activated. Next, in step S802, all objects are displayed at level 2 brightness. This is realized by displaying each object with an object called a spotlight. To display all objects with the same brightness, the same value is set in the field of the light source intensity of the spotlight object attached to each object.

Next, in step S 803, the operation management means 6 sends a light / dark setting change request from the user passed through the user input means 4 or a light / dark setting change request event message sent from another node through the communication management means 5. To receive.

Next, in step S804, it is determined whether the received request is a request from the user passed through the user input unit 4 or an event message sent from another node through the communication management unit 5. .

If the request is input by the user, in step S 805, the operation authority determination unit 8 determines whether the operation authority table 1 is managed by the operation authority storage unit 7.
By referring to 0, it is determined whether or not there is an execution right to change the setting of light and dark. Here, at the time of starting the system, the technician has set both the execution right and the reference right for the operation of changing the light / dark setting in the operation right table 10, and the customer has no execution right, but only the reference right. It is assumed that is set.

If there is an execution right in step S805, it is determined in step S806 whether the request is a request to set the brightness or a request to cancel the set brightness. In the case of a request to set light and dark, in step S807, the light and dark setting means 25 checks the light and dark levels of all designated objects with reference to the light and dark level table 26, and when the level is 1, the light source intensity of the spotlight object is determined. Is changed to a small value. When the level is 2, the value is not changed. When the level is 3, the value is changed to a large value. Then, in step S808, each object is displayed again on the display unit 2.

Next, in step S 809, the communication management means 5 sends an event message of a light / dark setting request to the communication management means 5 of another node via the network 9. Then, the process returns to step S803. On the other hand, step S80
In step S6, if the request to release the set brightness is made, the light source intensities of all the objects are changed to the level 2 brightness in step S810, and all the objects are displayed again on the display means 2 in step S811. Then, in step S812, the communication management unit 5 sends an event message of the light / dark setting release request to the communication management unit 5 of another node via the network 9, and returns to step S803.

If the user does not have the right to change the brightness in step S805, the process returns to step S803. In step S804, the request is sent to the communication management unit 5
If the event message is a light / dark setting change request event message sent from another node through
At 3, it is determined whether the request is a request for setting the brightness or a request for canceling the set brightness.

If the request is to set light / dark, step S8
At 14, the light / dark setting means 25 checks the light / dark levels of all designated objects with reference to the light / dark level table 26, and changes the light source intensity of each object. Then, after each object is displayed again on the display unit 2 in step S815, the process returns to step S803.

If it is determined in step S813 that the set lightness / darkness release request has been issued, all objects are set to level 2 brightness in step S816.
At 7, the display is re-displayed on the display means 2 and the process returns to step S803.
This process is repeated until the technical consultation support system ends.

Embodiment 9 FIG. A ninth embodiment of the present invention will be described with reference to FIGS. In the present embodiment, the engineer can dynamically generate only the sound of a specific sound source in the three-dimensional shared work space as needed during the activation of the system, and can cut off the sound of other sound sources.
For example, when a technician listens to a specific sound generated by pressing a button while being guided by a technician in a factory, the specific sound is better because the technician always hears the noise while it is being generated. May not be heard. At this time, if all the sounds (such as factory noises) that are always generated without the user performing the operation for generating a sound are cut off, only the specific sound is heard when the operation for generating the sound is performed. Will be.

FIG. 36 is a block diagram of a technical consultation support system according to the ninth embodiment. In the figure, reference numeral 27 designates a specific sound source dynamically in the three-dimensional shared work space as needed during system startup. This is a sound field control unit that can generate only the sound of (1) and cut off the sound of other sound sources. The same components as those shown in FIG. 1 are denoted by the same reference numerals, and redundant description will be omitted.

Next, the operation will be described. FIG.
FIG. 4 shows a processing flow of the technical consultation support system in the present embodiment when cutting off the sound of other sound sources in order to generate only the sound of a specific sound source. FIG. First, in step S901, the technical consultation support system is activated. In step S902, the operation management unit 6 requests a sound field cutoff (or release) from the user passed through the user input unit 4, and a sound field cutoff (or release) request sent from another node through the communication management unit 5. Receive an event message.

Next, in step S903, it is determined whether the received request is a request from the user passed through the user input means 4 or an event message sent from another node through the communication management means 5. .

If the request is input by the user, in step S 904, the operation authority determination unit 8 determines whether or not the operation authority table 1 managed by the operation authority storage unit 7.
By referring to 0, it is determined whether or not the user has the right to execute the operation of shutting off the sound field. Here, at the time of starting the system, the technician has set both the execution right and the reference right for the operation of shutting off the sound field in the operation right table 10.
It is assumed that the execution right is not set for the customer and only the reference right is set.

If the execution right is found in step S904, it is determined whether the request received in step S905 is a sound field cutoff request or a sound field cutoff release request. In the case of a sound field cutoff request, in step S906, an object that always generates a sound is taken out of the object data storage unit 1 even if the user does not perform an operation of generating a sound.
Set the value of the volume of those sounds to zero.

Next, in step S907, the communication management means 5 sends the event message of the sound field cutoff request to the network 9
, And then returns to step S902.

In the case of a sound field cutoff release request in step S905, an object which always generates a sound even though the user has not performed an operation for generating a sound is extracted from the object data storage means 1 in step S908. The sound volume values are returned to the original values before the interruption. Next, in step S909, after the communication management unit 5 sends the event message of the sound field cutoff release request to the communication management unit 5 of another node via the network 9,
It returns to step S902. Also, if there is no authority to cut off the sound field in step S904, step S90
Return to 2.

On the other hand, in step S903, if the request is a sound field cutoff (or release) request event message sent from another node through the communication management means 5, in step S910, the sound field cutoff request or the sound It is determined whether or not the request is a field shutdown release request. If the request is a sound field cutoff request, the object data storage unit 1 in step S911
From, take out an object that is always generating a sound even though the user has not performed an operation to generate a sound,
After setting the values of those sound volumes to zero, the process returns to step S902. In step S910, in the case of a sound field cutoff release request, in step S912, objects that always generate a sound are extracted from the object data storage unit 1 even if the user does not perform an operation of generating a sound, and the sound of those objects is output. The volume value is returned to the original value before the interruption, and the process returns to step S902. This process is repeated until the technical consultation support system ends.

Embodiment 10 FIG. The tenth embodiment of the present invention will be described with reference to FIGS. 38 to 40. The present embodiment will be described in detail. Depending on the degree to which the user wants to hear, the sound can be given a plurality of levels, and the sounds can be set, such as making the sound the loudest and reducing the sounds that the user does not want to hear.

FIG. 38 is a block diagram of the technical consultation support system according to the tenth embodiment. In the figure, reference numeral 28 designates an object which dynamically generates a sound in the three-dimensional shared work space as needed during system startup. Sound setting means for setting a plurality of levels of sound in stages and setting those sounds. The same components as those shown in FIG. 1 are denoted by the same reference numerals, and redundant description will be omitted.

FIG. 39 shows an example of the sound level table 29 managed by the sound setting means 28. In the sound level table 29, a sound level is defined for each object that generates sound.

The level can be specified, for example, in three stages of 1 to 3, and the larger the numerical value, the louder the sound. Normally, sound is generated at the level 2 level for all objects. However, when a technician requests sound setting, sound is generated from each object at the size defined in the sound level table 29.

Next, the operation will be described. FIG.
In the present embodiment, a processing flow of the technical consultation support system in a case where a sound level is dynamically assigned to each object during the activation of the system is shown. First, in step S1001, the technical consultation support system is activated. Next, in step S1002, sounds are generated by setting the volume values of sounds of all objects that generate sounds to the level 2 level.

Next, in step S1003, the operation management means 6 sends an event message of a sound setting change request from the user passed through the user input means 4 or a sound setting change request sent from another node through the communication management means 5. To receive.

In step S1004, it is determined whether the received request is a request from the user passed through the user input means 4 or an event message sent from another node through the communication management means 5. .

If the request is input by the user, in step S1005, the operation authority determination means 8 operates the operation authority table 1 managed by the operation authority storage means 7.
By referring to 0, it is determined whether or not there is an execution right to change the sound setting. Here, when the system is started, the technician has set both the execution right and the reference right in the operation right table 10 for the operation of changing the sound setting.
It is assumed that the execution right is not set for the customer and only the reference right is set.

If there is an execution right in step S1005, it is determined in step S1006 whether the request is a request to set a sound or a request to cancel the set sound. In the case of a request to set sound, in step S1007, the sound setting unit 28 checks the sound levels of all designated objects with reference to the sound level table 29. If the level is 1, the sound volume value of the object is set. Is changed to a small value. When the level is 2, the value is not changed. When the level is 3, the value is changed to a large value. In step S1008, sounds of these objects are generated.

Next, in step S1009, the communication management means 5 sends the event message of the sound setting request to the communication management means 5 of another node via the network 9, and then returns to step S1003. In step S1006, in the case of a request to release the set sound, the volume value of the sound of the object specified in the sound level table 29 is changed to the level 2 in step S1010, and in step S1011 these objects are Generate a sound. In step S1012, the event message of the sound setting release request is transmitted to the communication management unit 5.
Is the communication management means 5 of another node via the network 9
After that, the process returns to step S1003.

In step S1005, if the user does not have the authority to set the sound change, the process proceeds to step S1003.
Return to On the other hand, in step S1004, if the request is an event message of a sound setting change request sent from another node through the communication management unit 5, in step S1013, the request is a request for setting a sound or a request for setting the sound. Determine whether it is a request to cancel.

If the request is for setting sound, step S1
In step 014, the sound setting unit 28 checks the sound levels of all the designated objects with reference to the sound level table 29, and changes the volume values of the objects. In step S1015, the sound of these objects is generated.

If it is determined in step S1013 that there is a request to cancel the set sound, the volume value of the sound of the object specified in the sound level table 29 is changed to the level 2 in step S1016. Next, sounds of these objects are generated in step S1017, and the process returns to step S1003. This process is repeated until the technical consultation support system ends.

Embodiment 11 FIG. An eleventh embodiment of the present invention will be described with reference to FIGS. In the present embodiment, when the object is composed of a plurality of parts,
If necessary, the part indicated by the technician's pointer can be displayed by changing the color, blinking, changing from solid display to wireframe display or vice versa, or changing the pattern (texture). It is made possible.

FIG. 41 is a block diagram of a technical consultation support system according to the eleventh embodiment. In the figure, reference numeral 30 denotes a color change or blinking display of a part indicated by a pointer as needed during system startup. Pointer indication means for changing the display from the solid display to the wire frame display or vice versa, or changing the pattern (texture). The same components as those shown in FIG. 1 are denoted by the same reference numerals, and redundant description will be omitted.

The pointer location indication means 30 manages a pointer location indication method table 31. FIG. 42 is an example of the pointer location indication method table 31. When the technician requests the pointer location, when the technician's pointer enters the object 1 on the screen, the color of the object 1 changes to red. When the pointer moves to the position of the object 2, the object 1 returns to the normal color and the object 2
Is displayed in metal. In the case of the object 3, the texture 1 is displayed with the pattern of the texture 1 attached thereto.

Next, the operation will be described. FIG.
FIG. 9 shows a processing flow of the technical consultation support system in a case where the display of a location pointed by a pointer dynamically changes during system startup in the present embodiment.

First, in step S1101, the technical consultation support system is activated. At this time, the pointers of all users are displayed on the screen. Step S1102
Then, the pointer location indicating means 30 sets NOPOINT to the value of the variable MODE indicating whether or not the mode indicates the object pointed by the pointer.

In step S1103, the operation management means 6 requests the pointer location (or release) from the user passed through the user input means 4 and the pointer location indication (or cancellation) sent from another node through the communication management means 5. Release) Accepts a request event message or an event where a technician pointer enters or exits the object.

In step S1104, it is determined whether a request for indicating a pointer location has been received. In the case of the pointer location indication request, it is determined whether the request received in step S1105 is a request from the user passed through the user input unit 4 or an event message sent from another node through the communication management unit 5. to decide.

If the request is input by the user, in step S1106, the operation authority determination unit 8 determines whether the operation authority table 1
By referring to 0, it is determined whether or not there is an execution right to change the indication of the pointer. Here, at the time of starting the system, the technician has set both the execution right and the reference right for the operation of changing the pointer position indication in the operation right table 10, and the customer has not set the execution right. It is assumed that only is set.

If the execution right is found in step S1106, the value of the variable MODE is set to P in step S1107.
OINT. Next, in step S1108, the communication management means 5 sends an event message of the pointer location indication request to the communication management means 5 of another node via the network 9, and then returns to step S1103. Also, if there is no execution right in step S1106, the process returns to step S1103.

If it is determined in step S1105 that the request is an event message of a pointer location indication request sent from another node through the communication management means 5,
In step S1109, the value of the variable MODE is
After setting to NT, the process returns to step S1103. If the request is not a pointer location indication request in step S1104, it is checked in step S1110 whether the request is a pointer location indication release request.

In the case of the pointer position indication release request, the request received in step S1111 is a request from the user passed through the user input means 4, or an event message sent from another node through the communication management means 5. Is determined. If the request is input by the user, in step S1112, the operation authority determining unit 8 refers to the operation authority table 10 managed by the operation authority storage unit 7 to execute the change of the indication of the pointer position. Determine if there is.

If there is an execution right in step S1112, it is checked in step S1113 if there is any specially displayed object. If there is an object of special display, the object is returned to the normal display in step S1114. If there is no special display object, the process advances to step S1115. Next, in step S1115, the value of the variable MODE is set to NOPOINT. Next, in step S1116, the communication management unit 5 transmits the pointer message
And then returns to step S1103. Also, if there is no execution right in step S1112, the process returns to step S1103.

In step S1111, if the request is an event message of a pointer location indication release request sent from another node through the communication management means 5, it is checked in step S1117 whether there is any special display object. If there is an object of special display, the object is returned to the normal display in step S1118. If there is no special display object, the process advances to step S1119. Next, in step S1119, the variable MO
After setting the value of DE to NOPOINT, step S1
Return to 103.

If the request is not a pointer location indication release request in step S1110, the variable MO
Check whether the value of DE is POINT. Variable MODE
Is POINT, it is checked in step S1121 whether the event is an event where the pointer of the technician has entered the object. If the event indicates that the engineer's pointer has entered the object, it is checked in step S1122 whether the object is in the pointer location indication method table 31.

If the object is in the pointer location indicating method table 31, the object is displayed by the display method of the pointer location indicating method table 31 in step S1123. For example, in the case of a color change display, the color field of the object is changed and the object is displayed again.
In the case of the texture display, the data name of the specified texture is set in the texture field of the object, the object is displayed again, and the process returns to step S1103.

If it is not found in the pointer location method table 31 in step S1122, the process returns to step S1103. If it is not the event that the pointer of the engineer has entered the object in step S1121, step S112
In step 4, it is checked whether the technician's pointer is an event that has left the object.

If the technician's pointer is an event that has left the object, the object is displayed in a normal display method in step S1125, and the process proceeds to step S110.
Return to 3. If it is determined in step S1124 that the technician's pointer is not an event that has exited the object, or if the variable MODE is not POINT in step S1120, the process returns to step S1103. This process is repeated until the technical consultation support system ends.

Embodiment 12 FIG. A twelfth embodiment of the present invention will be described with reference to FIGS. In the present embodiment, a technician can display only a pointer of a specific person as needed during the activation of the system, or can change the display method of the pointer by the user.

FIG. 44 is a block diagram of a technical consultation support system according to the twelfth embodiment. In the figure, reference numeral 32 denotes a display of only a specific person's pointer as needed during the start-up of the system, or a display of a pointer by a user. Pointer display control means for changing the display method. The same components as those shown in FIG. 1 are denoted by the same reference numerals, and redundant description will be omitted.

The pointer display control means 32 manages a pointer table 33 for storing a display method of each user. FIG. 45 shows an example of the pointer table 33. In the pointer column, a bitmap of the pointer of each user is stored. The column of the pointer of the customer A is "none", which means that the pointer of the customer A is not displayed.

Next, the operation will be described. FIG.
FIG. 39 shows a processing flow of the technical consultation support system in Embodiment 12 when changing the display method of each user's pointer. First, in step S1201, the technical consultation support system is activated. Step S1202
, The pointer display control means 32 refers to the pointer table 33, and displays the pointers of all the users sharing the three-dimensional shared work space on the display means 2 using the bitmap data specified in the table.

In step S 1203, the operation management means 6 receives a pointer display change request from the user passed through the user input means 4 or a pointer display change request event message sent from another node through the communication management means 5. . Next, step S1204
, It is determined whether the received request is a request from the user passed through the user input unit 4 or an event message sent from another node through the communication management unit 5.

If the request has been input by the user, in step S1205, the operation authority judging means 8
Refers to the operation authority table 10 managed by the operation authority storage means 7 to determine whether or not there is an execution right to change the display of the pointer. Here, when the system is started, the technician has set both the execution right and the reference right in the operation right table 10 for the operation of changing the pointer display, and the customer does not have the execution right. It is assumed that only is set. Step S1
If there is an execution right in 205, step S12
At 06, a pointer change setting screen is displayed so that a user who changes the pointer and a bitmap of the pointer to be changed can be input. FIG. 47 is an example of a pointer change setting screen. The contents of the pointer table 33 are displayed, and pointer bitmap candidates that can be set next to the contents are displayed as a list.

The technician first selects the column of the user whose pointer is to be changed by clicking the mouse, and then selects the pointer to be changed from the pointer list, and presses the "change" button at the upper right. Then, the pointer table 33 on the screen is displayed as changed. FIG. 48 shows a pointer change setting screen after the pointer of the customer B has been changed from “X” to “O”. Here, when the user presses the “setting” button on the right side, the pointer display control unit 3 in S1207
2 rewrites the contents of the pointer table 33 to the same contents as those displayed on the screen.

Next, in step S1208, the pointer display control means 32 refers to the pointer table 33 and redisplays each user's pointer in the bitmap designated by the pointer table 33.

Next, in step S1209, the communication management means 5 sends an event message of the pointer display change request to the communication management means 5 of another node via the network 9, and then returns to step S1203. At this time, the event message includes the event name of the pointer display change request, the user name of the pointer changed, and the pointer data after the change.

If the execution right for changing the pointer display is not found in step S1205, the process proceeds to step S120.
Return to 3. On the other hand, if the request is an event message of a pointer display change request sent from another node through the communication management means 5 in step S1204, the pointer display control means 32 changes the pointer from the event message in step S1210. The contents of the pointer table 33 are updated by extracting the user name and the changed pointer data.

Next, in step S1211, the pointer of each user is displayed again with reference to the pointer table 33, and the process returns to step S1203. This process is repeated until the technical consultation support system ends.

Embodiment 13 FIG. A thirteenth embodiment of the present invention will be described with reference to FIGS. In the present embodiment, a mouse pointer is displayed as an operation tool for displaying a three-dimensional model according to the content of an operation.
FIG. 49 is a configuration diagram of a technical consultation support system according to the thirteenth embodiment. Reference numeral 34 denotes a pointer operation tool display unit that displays a mouse pointer as an operation tool for displaying a three-dimensional model according to the contents of an operation. The same components as those shown in FIG. 1 are denoted by the same reference numerals, and redundant description will be omitted.

The pointer operation tool display means 34 manages an operation tool table 35 which is a correspondence table between operations and pointer display data names when the operations are executed. FIG. 50 is an example of the operation tool table 35. In FIG. 50, "jack" is a three-dimensional model data name of a jack handlebar for an automobile, "gauge" is a three-dimensional model data name of an oil level gauge, "
"hand" is the name of the three-dimensional model data of the human hand. (These data are managed by the object data storage unit 1.)

A pointer is displayed as a jack handle bar when an operation of jacking up is performed in the three-dimensional shared work space, an oil level gauge is provided for an operation for checking engine oil, and a 3 is provided for an operation for opening and closing a door. It will be displayed as a human hand on the dimensional model display.

Next, the operation will be described. FIG.
3 shows a processing flow of the technical consultation support system in the present embodiment when a mouse pointer is displayed as an operation tool for displaying a three-dimensional model. First, step S1
In 301, the technical consultation support system is activated, and in step S1302, the pointer of the user of the local node is displayed. At this time, for example, the pointer is displayed as a bitmap of a two-dimensional arrow.

In step S1303, the operation management means 6 operates an object from the user through the user input means 4 (for example, mounting of a tire, opening and closing of a door, etc.).
Accept the request. Next, in step S1304, it is checked whether the requested operation is in the operation column of the operation tool table 35 managed by the pointer operation tool display unit 34.

If the requested operation is in the operation tool table 35, the pointer is erased by displaying the pointer in a blank bitmap in step S1305. Next, in step S1306, the operation is executed, and at the same time, the column of the data name of the operation tool corresponding to the operation is checked, and the data of the data name is received from the object data storage unit 1 and displayed at the position of the pointer.

In step S1307, it is determined whether the operation has been completed. If the operation has been completed, the display of the operation tool is turned off in step S1308. Then, in step S1309, the pointer is displayed by a conventional display method (for example, a bit map of a two-dimensional arrow is displayed), and the process returns to step S1303. If the operation has not ended in step S1307, the process stands by until the operation ends. Step S1304
If the operation requested in is not in the operation tool table 35, the operation is executed without changing the pointer display method in step S1310, and the process returns to step S1303. This process is repeated until the technical consultation support system ends.

[0201]

According to the first aspect, the authority of each user's operation in the three-dimensional shared work space is defined, and whether or not each user may perform an arbitrary operation based on the definition is determined. The ability to make judgments prevents customers who do not have knowledge of the object or those who do not have operation authority from making mistakes, accessing information unrelated to explanations, or generating sounds. There is an effect that can be.

According to the second aspect of the present invention, a technician can dynamically set the authority of each user for the operation of the customer in the three-dimensional shared work space as needed during the activation of the system. Therefore, there is an effect that a customer who has no knowledge of the object or a customer who cannot operate because of lack of operation authority can execute the operation after the explanation.

According to the third aspect of the present invention, the technician can control the customer's viewpoint to the same viewpoint as the technician if necessary. This has the effect of eliminating the need for the customer to look for the location in anticipation and when an object indicating a technician is displayed, and for the customer to be conscious of looking for the object and looking in the same direction as the object. is there.

According to the fourth invention, when the viewpoint of the customer is shifted from the viewpoint of the customer to the viewpoint of the technician, various types of transition methods such as abrupt transition or smooth transition are used. Can be set by the technician according to the condition, so that even a customer who does not have knowledge of the target object can understand which part of the target object the viewpoint has shifted to.

According to the fifth aspect of the present invention, a sequence of a plurality of operations performed by a technician on an object can be recorded as one simulation operation. In such a case, there is an effect that the recorded simulation can be easily seen only by reproducing the recorded simulation without realizing each operation. In addition, when recording and reproducing the simulation operation in a form such as video data of a two-dimensional image, there is an effect that a change to another operation can be performed from a halfway point of recording.

According to the sixth aspect, the object is a building such as a house or a building, and when guiding the customer through the building, the customer is required to go only to a specific area. To limit the movement range of the building, and to be able to sound a warning sound, flash a warning light, and display information indicating a warning when a customer attempts to enter an area outside the range, There is an effect that a customer who does not know the inside can be prevented from going in the wrong direction.

According to the seventh aspect of the present invention, a spotlight is illuminated on a target portion of a technician's point of view, a fog effect is applied to a place other than a point of interest to blur the field of view, Is reduced so that the periphery of the attention place can be darkened, so that there is an effect that the customer can directly and visually recognize the part itself that the technician is looking at.

According to the eighth aspect, the specific portion of the object that the customer wants to pay the most attention to is brightest, and the portion that the customer does not want to pay attention to is darkened. Since multiple levels can be set and their brightness can be set, when explaining some parts of all parts while looking at the whole object, those parts There is an effect that it is possible to visually indicate to the customer whether a part corresponds to a part.

According to the ninth aspect, only the sound of a specific sound source can be heard and the sound of the other sound sources can be cut off. Therefore, only the sound to be explained can be accurately heard by the customer. There is an effect that you can get it.

[0210] According to the tenth aspect of the present invention, furthermore, the generation sound of an object that the customer wants to hear most is maximized, and the sound that the user does not want to hear is reduced. And the sounds can be set, so that the customer can accurately hear only the sounds of a plurality of specific sound sources.

According to the eleventh aspect, when the object is composed of a plurality of parts, the color of the part at the location pointed by the pointer by the technician can be changed or flashed, if necessary.
Since the display can be changed from solid display to wireframe display or vice versa, or pattern (texture) can be changed and displayed, it is possible to view parts of the object without moving the viewpoint while viewing the entire object. When the descriptions are made one by one, there is an effect that the customer can correctly grasp the location pointed by the technician.

According to the twelfth aspect, only the pointer of a specific person can be displayed as required, or the display method of the pointer can be changed by the user, so that the pointer displayed on the screen can be displayed. Is a customer pointer or a technician pointer. In addition, by displaying only the pointer of the customer who is asking the question, the content of the question can be easily understood. In addition, when giving an explanation to a plurality of customers, the operations of the customers can be grasped for each customer at each level such as the qualification of each customer and the role at the time of transaction or consultation, and the operation can be easily recognized.
Further, there is an effect that it is possible to prevent the target object itself from being difficult to see because the pointer is displayed.

According to the thirteenth aspect, the mouse pointer can be displayed as an operation tool displaying a three-dimensional model according to the content of the operation. Therefore, when an operation such as lifting an object or fixing a screw is performed. This has the effect of providing a sense of realism that the user is actually operating.

[Brief description of the drawings]

FIG. 1 is a configuration diagram illustrating a technical consultation support system according to a first embodiment.

FIG. 2 is an explanatory diagram showing an operation authority table in an operation authority storage unit.

FIG. 3 is a diagram showing a use image of the technical consultation support system.

FIG. 4 is a diagram showing a screen on which detailed information is displayed.

FIG. 5 is a flowchart illustrating an operation of the technical consultation support system according to the first embodiment.

FIG. 6 is an explanatory diagram showing a correspondence table between inputs in the operation management means and operation contents.

FIG. 7 is a configuration diagram illustrating a technical consultation support system according to a second embodiment.

FIG. 8 is a flowchart illustrating an operation of the technical consultation support system according to the second embodiment.

FIG. 9 is a diagram showing a screen for setting operation authority.

FIG. 10 is a configuration diagram illustrating a technical consultation support system according to a third embodiment.

FIG. 11 is a flowchart illustrating an operation of the technical consultation support system according to the third embodiment.

FIG. 12 is an explanatory diagram showing an operation authority table in an operation authority storage unit.

FIG. 13 is an explanatory diagram showing a viewpoint before a change and a viewpoint after a change.

FIG. 14 is a flowchart illustrating an operation of the technical consultation support system according to the fourth embodiment.

FIG. 15 is a configuration diagram illustrating a technical consultation support system according to a fifth embodiment.

FIG. 16 is a flowchart illustrating an operation of the technical consultation support system according to the fifth embodiment.

FIG. 17 is an explanatory diagram showing a simulation operation table in a simulation operation recording unit.

FIG. 18 is a configuration diagram illustrating a technical consultation support system according to a sixth embodiment.

FIG. 19 is an explanatory diagram showing a movement authority table in the movement range restriction means.

FIG. 20 is an explanatory diagram showing a warning method table in a warning generating unit.

FIG. 21 is a diagram showing a screen on which an entrance to a room is displayed.

FIG. 22 is a diagram showing a screen on which the inside of a room is displayed.

FIG. 23 is a diagram showing a screen on which an entrance to a room is displayed.

FIG. 24 is a diagram showing a screen when movement to a certain room is restricted.

FIG. 25 is a flowchart showing the operation of the technical consultation support system according to the sixth embodiment.

FIG. 26 is a diagram showing a screen on which a technician guides a building.

FIG. 27 is a diagram showing a movable area condition table in the movable range restricting means.

FIG. 28 is a flowchart showing the operation of the technical consultation support system according to the sixth embodiment.

FIG. 29 is a diagram showing a state where a technician holds a spotlight in his hand.

FIG. 30 is a diagram showing a state where a plurality of spotlights are fixedly prepared.

FIG. 31 is a configuration diagram illustrating a technical consultation support system according to a seventh embodiment.

FIG. 32 is a flowchart showing the operation of the technical consultation support system according to the seventh embodiment.

FIG. 33 is a configuration diagram illustrating a technical consultation support system according to an eighth embodiment.

FIG. 34 is an explanatory diagram showing a light-dark level table in the light-dark setting means.

FIG. 35 is a flowchart showing the operation of the technical consultation support system according to the eighth embodiment.

FIG. 36 is a configuration diagram illustrating a technical consultation support system according to a ninth embodiment.

FIG. 37 is a flowchart showing the operation of the technical consultation support system according to the ninth embodiment.

FIG. 38 is a configuration diagram illustrating a technical consultation support system according to a tenth embodiment.

FIG. 39 is an explanatory diagram showing a sound level table in a sound setting unit.

FIG. 40 is a flowchart showing the operation of the technical consultation support system according to the tenth embodiment.

FIG. 41 is a configuration diagram illustrating a technical consultation support system according to an eleventh embodiment.

FIG. 42 is an explanatory diagram showing a pointer location indication method table in the pointer location indication means.

FIG. 43 is a flowchart showing the operation of the technical consultation support system according to the eleventh embodiment.

FIG. 44 is a configuration diagram illustrating a technical consultation support system according to a twelfth embodiment.

FIG. 45 is an explanatory diagram showing a pointer table in the pointer display control means.

FIG. 46 is a flowchart showing the operation of the technical consultation support system according to the twelfth embodiment.

FIG. 47 is a diagram showing a pointer change setting screen.

FIG. 48 is a diagram showing a screen for pointer change setting.

FIG. 49 is a configuration diagram illustrating a technical consultation support system according to a thirteenth embodiment.

FIG. 50 is an explanatory diagram showing an operation tool table in the pointer operation tool display means.

FIG. 51 is a flowchart showing the operation of the technical consultation support system in the thirteenth embodiment.

FIG. 52 is a diagram illustrating a configuration example of a conventional cyberspace system.

FIG. 53 is a configuration diagram of a user terminal of a conventional cyberspace system.

FIG. 54 is a diagram illustrating a field of view from a character C in a conventional cyberspace system.

[Explanation of symbols]

1 object data storage means, 2 display means, 3
Sound output means, 4 user input means, 5 communication management means, 6 operation management means, 7 operation authority storage means, 8 operation authority determination means, 9 network, 10 operation authority table, 11 technicians, 12 customers A, 13 customers B ,
14 Correspondence table of input and operation contents, 15 Operation authority setting means, 16 View point control means, 17 Simulation operation recording means, 18 Simulation operation table, 19
Moving range restricting means, 20 warning generating means, 21 moving authority table, 22 warning method table, 23 movable area condition table, 24 viewpoint grasping means, 25 light / dark setting means, 26 light / dark level table, 27 sound field controlling means, 28 sound Setting means, 29 sound level table, 30 pointer location indication means, 31 pointer location indication method table, 32 pointer display control means, 33
Pointer table, 34 pointer operation tool display means,
35 Operation tool table.

Claims (13)

[Claims] 1. A remote customer and technician operate a three-dimensional shared work space on a computer terminal connected by a network, and share a three-dimensional image to be consulted in the space. In a technical consultation support system for providing consultation while operating an object, an object data storage means for storing an object in a three-dimensional shared work space or explanation information about the object, and an object data storage means Display means for displaying a three-dimensional shared work space using data, and sound for outputting a sound situation in the three-dimensional shared work space using a user's voice and sound data stored in an object data storage means Output means, user input means for receiving an input voice from a user and an operation request necessary for operating an object, and three-dimensional sharing work Communication management means for transmitting and receiving information to and from other nodes sharing the same, and adding or changing processing to the three-dimensional workspace based on information input from the input means or information sent from the communication management means. Operation management means for performing the operation, operation authority storage means for defining the authority of each user's operation in the three-dimensional shared space, and use of operation functions executed by the user based on information stored in the operation authority storage means A technical consultation support system, comprising: operation authority determination means for determining whether or not an operation function can be selected by a user. 2. A technician dynamically changes the operation authority of the customer in the three-dimensional shared space or adds a new operation authority to the operation authority storage means as needed during system startup. 2. The technical consultation support system according to claim 1, further comprising an operation authority setting unit configured as described above. 3. The technical consultation support system according to claim 1, further comprising viewpoint control means for controlling the viewpoint of the customer from the same viewpoint as the technician. 4. The technician according to claim 4, wherein the viewpoint control means is capable of setting the smoothness when shifting the customer's viewpoint from the customer's own viewpoint to the technician's viewpoint in accordance with the state of the shifting method. The technical consultation support system according to claim 3, wherein 5. The technical consultation according to claim 1, further comprising simulation operation recording means for recording, as one simulation operation, a sequence of operations on a plurality of objects performed by a technician on an object in advance. Support system. 6. A moving range that limits a moving range of a customer so that he / she can only act within a predetermined range when guiding the customer into the building when the object corresponds to a building. 2. The technical consultation support system according to claim 1, further comprising: restriction means; and warning generation means for generating warning information when a customer tries to enter an incorrect area. 7. A viewpoint grasping means for irradiating a spotlight on a viewpoint point which a technician is paying attention to or applying a fog effect to a part other than a part to be noticed to blur the field of view. Item 1. The technical consultation support system according to Item 1. 8. The apparatus according to claim 1, further comprising a light / dark setting means for displaying a part of the target object in a plurality of levels in accordance with the degree of attention required by the customer. Technical consultation support system. 9. The technical consultation support system according to claim 1, wherein only the sound of the specified sound source is heard, and sound field control means for cutting off the sound of the other sound sources is provided. 10. According to a degree of attention required for a customer,
2. The technical consultation support system according to claim 1, further comprising sound setting means for setting sound with a plurality of levels in stages. 11. In a case where an object is composed of a plurality of parts, for a part designated by a technician with a pointer, color change, blinking display, solid display, wire frame display, or pattern display is performed. 2. The technical consultation support system according to claim 1, further comprising a pointer location indicating means that is enabled. 12. The technical consultation support system according to claim 1, further comprising pointer display control means for displaying only a pointer for a specific person, or changing a pointer display method for each user. 13. The technical consultation support system according to claim 1, further comprising mouse pointer operation tool display means for displaying a mouse pointer as an operation tool based on a three-dimensional model display in accordance with the contents of the operation. .