JP7470578B2 - Work Support System - Google Patents

Description

The present invention relates to a work support system, and in particular to a work support system that provides work support by projecting work information onto a work object using an information projection device.

Conventionally, on vehicle production lines, a work support system is used to support workers as they assemble vehicle components by displaying the tools and work procedures to be used for the assembly work on a display installed at the work site. By providing such work support, the occurrence of work errors by workers is reduced.

However, when using a display to assist with work, the worker's gaze is focused on the work object while working, and during that time the worker is unable to check the work information displayed on the display, which means that inexperienced workers do not have the time to check the work information. In addition, experienced workers may perform the work by following the procedures they have memorized without looking at the work information, which raises concerns about mistakes due to assumptions or misunderstandings.

To solve these problems, in recent years, work support systems have been developed that use projection devices such as projectors to project work information onto the work object itself, instead of displaying it on a display.

For example, Patent Document 1 discloses a work support system that includes a projector that projects an image onto a work object, an imaging device that captures an image of the work object, and a control device that switches the image projected by the projector based on image data acquired by the imaging device. The projector projects work information related to a predetermined work process onto the work object. The control device determines whether the work process is complete based on the image data acquired by the imaging device, and if it determines that the work process is complete, causes the projector to project work information related to the next work process.

In this work assistance system, a projector projects work information onto the work object itself, allowing the worker to receive work assistance without taking their eyes off the work object, improving work efficiency while preventing mistakes.

JP 2019-101603 A

Improving work efficiency depends not only on the support of work information, but also on the environment of the work site where the work is carried out. For example, if the lighting in the room where the work site is being carried out is too bright and the work information projected onto the work object is difficult to see, optimal work support will not be received, and work efficiency will decrease.

In such cases, in order to improve the work environment, the worker must move from the work area and operate a device to adjust the work environment. For example, to adjust the illuminance of a lighting device, the worker must move to an operating switch mounted on the wall and adjust the illuminance, which is time-consuming.

The present invention has been made in consideration of the above problems, and aims to provide a work support system that is capable of projecting work information onto a work object and enables a worker to change the work environment without moving from the work area.

In order to achieve the above object, the work support system of the present invention includes an information projection device that projects work information related to a predetermined work process onto a work object, an imaging device that can image the work object and the worker, and a control device that switches the work information projected by the information projection device to work information for the next work process based on the imaging data acquired by the imaging device, and is characterized in that the work support system further includes a work environment adjustment device that can adjust a predetermined environment at the work site, and when the control device determines, based on the imaging data acquired by the imaging device, that the worker has performed a predetermined action that has been set in advance, it activates the work environment adjustment device to change the work environment.

According to this configuration, work information can be projected onto the work object using the information projection device, and the projected work information can be switched to work information for the next work process based on the image data of the work object and the worker acquired by the imaging device. Furthermore, without adding a new information acquisition device, the work environment adjustment device can be operated based on the motion information of the worker contained in the image data acquired by the imaging device to change the work environment. This allows the worker to perform a predetermined motion in the work area without moving from the work area, thereby activating the work environment adjustment device to adjust the work environment to be optimal.

The present invention is also characterized in that in the work support system, the work environment adjustment device includes a lighting device capable of adjusting the illuminance of the work site, and the control device changes the illuminance of the lighting device when it is determined based on the imaging data that the worker has performed a predetermined action related to the lighting device.

According to this configuration, a worker can change the illuminance of the lighting device and adjust it to an appropriate level for the work by performing a specific action related to the lighting device in the work area. As a result, for example, if the lighting at the work site is too bright and the work information projected onto the work object is difficult to see, the illuminance can be changed to dim the lighting while viewing the work information projected onto the work object in the work area.

The present invention is also characterized in that in the work support system, the work environment adjustment device includes a workbench lifting device capable of adjusting the height of the workbench on which the work object is placed, and the control device operates the workbench lifting device to change the height of the workbench when it determines that the worker has performed a predetermined action related to the workbench lifting device.

According to this configuration, the worker can operate the workbench lifting device and change the height of the workbench by performing a specified action related to the workbench lifting device at the work position. As a result, for example, if the height of the workbench is too high or too low for the worker and it is difficult to work, the height of the workbench can be changed to a height that makes work easier while checking the relative positional relationship between the worker himself/herself and the work object in the work area.

The present invention is also characterized in that in the work support system, when the control device determines that a worker has performed a predetermined action related to the information projection device based on the imaging data acquired by the imaging device, it rewinds and reprojects the work information of the work process being projected by the information projection device.

With this configuration, the work information of the work process projected onto the work object can be rewound and the work information can be projected again from the rewound position. For example, if an inexperienced worker has difficulty with a task and misses the projected work information, the work information can be rewound and reprojected.

The work support system of the present invention makes it possible to project work information onto the work object, allowing the worker to change the work environment without moving from the work area.

1 is a schematic explanatory diagram of a work support system according to an embodiment of the present invention; FIG. 1 is a block diagram showing a configuration of a work support system. 1A is a schematic diagram of a work object placed on a workbench as viewed from above, illustrating a work switching operation. FIG. FIG. 11 is a schematic diagram showing an object to be worked on placed on a workbench as viewed from above, illustrating an operation for increasing the height of the workbench. FIG. 11 is a schematic diagram of a work object placed on a workbench as viewed from above, illustrating an operation for reducing the illuminance of a lighting device. 4 is a flowchart illustrating a control process of the working environment adjusting device executed by the control device. 10 is a flowchart illustrating a control process of the information projection device executed by the control device.

Fig. 1 is a schematic diagram of a work assistance system 10 according to an embodiment of the present invention, and Fig. 2 is a block diagram showing the configuration of the work assistance system 10. The work assistance system 10 is a system that provides work information to a worker 4 who performs work on a work object, and performs work assistance. In the example shown in Fig. 1, an engine component 1 that constitutes an engine to be mounted on a vehicle is shown as an example of a work object.

The work support system 10 of this embodiment includes an information projection device 20 capable of projecting work information onto the engine component 1, an imaging device 12 capable of imaging the engine component 1 and the worker 4, a work environment adjustment device 16 capable of adjusting a predetermined environment at the work site, and a control device 50 electrically connected to these devices. In this embodiment, the work environment adjustment device 16 has a lighting device 30 capable of adjusting the illuminance at the work site, and a work table lifting device 40 capable of adjusting the height of the work table 42 on which the engine component 1 is placed. The control device 50 controls the entire work support system 10. As shown in FIG. 2, the control device 50 includes an input interface 51, a memory unit 52, a work situation grasping unit 55, a worker operation judgment unit 56, a projection information control unit 57 that controls the information projected by the information projection device 20, and a work environment control unit 58 that controls the operation of the work environment adjustment device 16.

The information projection device 20 has a function of projecting electronic information (such as text information or image information) sent from the control device 50 as an image onto an object. For example, a DLP (Digital Light Processing) projector or a liquid crystal projector can be used as the information projection device 20. The work assistance system 10 uses the information projection device 20 and the control device 50 to project work information such as tools used when assembling the engine and the procedure for the assembly work onto the surface 1a of the engine component 1, which is a three-dimensional object, using so-called projection mapping technology that not only projects images onto a flat screen but also projects images onto a curved surface or the surface of a three-dimensional object.

In the example shown in FIG. 1, one projector is used as the information projection device 20, but the number of projectors may be two or more. In FIG. 1, the information projection area 22 of the information projection device 20 is indicated by a two-dot chain line. As indicated by dots in FIG. 1, the information projection device 20 can also project information onto only a portion 24 of the information projection area 22, making it possible to clearly indicate the work location to the worker 4.

The imaging device 12 is capable of capturing images, and for example, a camera capable of capturing video can be used. In this embodiment, a stereo camera that simultaneously captures images of the area to be captured from two different directions is used as the imaging device 12, and this stereo camera makes it possible to measure the distance to the object. The imaging device 12 is installed at a position in the work site where it can capture an image of the engine component 1, which is the object of work, and the worker 4 performing work on the engine component 1.

The imaging device 12 needs to be installed in a position where it can at least image the hand movements of the worker 4 performing the work, but it may also be installed in a position where it can image the engine component 1 and the surrounding work area so that it can image the entire body of the worker 4 while working. In this embodiment, as shown in FIG. 1, the information projection area 22 of the information projection device 20 is installed so as to be included in the imaging range of the imaging device 12.

The lighting device 30 has a light-emitting unit that emits light, and is installed in a position where the light-emitting unit can illuminate the work area (for example, on the ceiling above the workbench 42).

The workbench lifting device 40 includes a workbench 42 on which the engine component 1 is placed, and a lifting mechanism 44 installed below the workbench 42. The lifting mechanism 44 can include, for example, a support member that supports the workbench 42 from below so that it can move up and down, and a motor that operates the support member.

The control device 50 is a calculator including a microcomputer, and is configured with an information processing unit such as a central processing unit (CPU) or an application specific integrated circuit (ASIC), and a storage unit such as a RAM or ROM. The control device 50 functions as various function realization units (e.g., a control unit, an arithmetic unit, a processing unit, etc.) by the central processing unit reading and executing programs recorded in the storage unit.

The input interface 51 of the control device 50 is, for example, a keyboard, a mouse, a touch panel, etc., which allows information to be input to the control device 50. Information input via the input interface 51 can be stored in the memory unit 52.

The memory unit 52 of the control device 50 stores programs for executing various processes, and also stores data related to the work information projected by the information projection device 20. In this embodiment, the data related to the work information stores information related to the multiple work processes carried out in the engine assembly work, parts and tools used in each work process, work procedures, etc.

In addition, the memory unit 52 stores information regarding the movements of the worker (hereinafter also simply referred to as "worker movement information"). The worker movement information includes worker movement information used for controlling the information projection device 20 (hereinafter also referred to as "first worker movement information") and worker movement information used for controlling the work environment adjustment device 16 (hereinafter also referred to as "second worker movement information"). Each piece of worker movement information is set and registered in advance in the memory unit 52 by a user who uses the work support system 10.

The first worker action information includes information on a predetermined action (hereinafter also referred to as a "task switching action") for switching the work information projected by the information projection device 20 to work information for the next work process, and information on a predetermined action (hereinafter also referred to as a "rewinding action") for rewinding and reprojecting the work information of the work process projected by the information projection device 20. In this embodiment, as shown in FIG. 3, a pointing action with one hand 5 is set as the work switching action, and when the pointing action is repeated a predetermined number of times (e.g., three times) at the same work location (e.g., the area indicated by the reference symbol 24), the work information of the next work process is projected. The rewinding action can be, for example, an action of moving the pointing hand 5 from the right side to the left side across the engine component 1.

The second worker operation information includes operation information used to control the workbench lifting device 40 and operation information used to control the lighting device 30.

The operation information used for controlling the workbench lifting device 40 includes information on a predetermined operation for raising the workbench 42 (hereinafter also referred to as the "first operation related to the workbench lifting device 40"), a predetermined operation for lowering the workbench 42 (hereinafter also referred to as the "second operation related to the workbench lifting device 40"), and a predetermined operation for stopping the lifting movement of the workbench 42 (i.e., terminating the lifting movement control) (hereinafter also referred to as the "third operation related to the workbench lifting device 40"). The first operation related to the workbench lifting device 40 can be, for example, as shown in FIG. 4, an operation of moving both hands 5, 6 from bottom to top a predetermined number of times (e.g., three times) with both hands 5, 6 open and palms facing up. The second operation related to the workbench lifting device 40 can be, for example, an operation of moving both hands 5, 6 from top to bottom a predetermined number of times (e.g., three times) with both hands 5, 6 open and palms facing up. The third action of the workbench lifting device 40 can be, for example, the action of closing both open hands 5, 6.

The operation information used for controlling the lighting device 30 includes information on a predetermined operation for lowering the illuminance (hereinafter also referred to as the "first operation related to the lighting device 30"), a predetermined operation for increasing the illuminance (hereinafter also referred to as the "second operation related to the lighting device 30"), and a predetermined operation for stopping the illuminance change (i.e., terminating the illuminance change control) (hereinafter also referred to as the "third operation related to the lighting device 30"). As the first operation related to the lighting device 30, for example, as shown in FIG. 5, with one hand 5 open and the back of the hand facing up, the hand 5 can be waving from side to side a predetermined number of times (e.g. three times). As the second operation related to the lighting device 30, for example, with one hand 5 open and the palm facing up, the hand 5 can be waving from side to side a predetermined number of times (e.g. three times). As the third operation related to the lighting device 30, for example, the movement of closing the open hand 5 can be repeated a predetermined number of times (e.g. three times).

In the control device 50, the work status grasping unit 55 performs a process of grasping the work status for the work object based on the imaging data acquired from the imaging device 12. For example, the work status grasping unit 55 grasps which of the multiple work processes performed on the engine component 1 is being performed, whether the work process projected onto the engine component 1 has been completed, etc. from information included in the imaging data (information on the work process projected onto the engine component 1, information on the results of the work performed on the engine component 1, etc.), and determines whether the work process performed on the engine component 1 has been completed based on the grasped information.

The worker movement determination unit 56 determines whether the worker 4 has performed a predetermined movement (i.e., the first, second, and third movements) related to the information projection device 20 that has been set in advance, based on the worker movement information stored in the memory unit 52 and the imaging data acquired from the imaging device 12, and also determines whether the worker 4 has performed a predetermined movement (i.e., the first, second, and third movements) related to the work environment adjustment device 16 that has been set in advance. For example, the worker movement determination unit 56 can extract information related to the movement of the worker 4 from the imaging data captured by the imaging device 12, and compare the extracted information with the worker movement information stored in the memory unit 52 to determine whether the worker 4 has performed a predetermined movement that has been set in advance.

The projection information control unit 57 controls the work information projected by the information projection device 20 based on the work status grasped by the work status grasp unit 55 and the judgment result of the worker operation judgment unit 56. In this embodiment, when the work status grasp unit 55 judges that the work process projected by the information projection device 20 is completed, the projection information control unit 57 causes the information projection device 20 to project work information related to the next work process. In addition, when a plurality of tasks (e.g., work process A, work process B, and work process C) are performed consecutively on the same work location (e.g., the area indicated by reference numeral 24 in FIG. 1 and FIG. 3), when the worker operation judgment unit 56 judges that the worker 4 has performed a work switching operation, the projection information control unit 57 switches the work information related to the work process A that was initially projected to the work information related to the next work process B. Thereafter, when the work status grasp unit 55 grasps that the work has progressed and the worker operation judgment unit 56 judges that the worker 4 has performed a work switching operation, the projection information control unit 57 switches to the work information related to the next work process C.

When the worker operation determination unit 56 determines that the worker 4 has performed a rewinding operation, the projection information control unit 57 rewinds the work information of the work process projected by the information projection device 20 and reprojects it from the rewinding position. The rewinding position can be, for example, the point in time when the worker 4 stops a specified rewinding operation.

The work environment control unit 58 controls the operation of the work environment adjustment device 16 based on the results of the judgment of the worker 4's movements by the worker movement judgment unit 56.

Next, the control process of the work environment adjustment device 16 executed by the control device 50 in the work support system 10 will be described with reference to FIG. 6. In the following description, the control process of the lighting device 30 will be described as an example of the work environment adjustment device 16.

When the work assistance system 10 is activated, the worker action determination unit 56 of the control device 50 determines whether the worker 4 has performed a predetermined action (i.e., a first or second action related to the lighting device 30) that has been previously set and registered in the memory unit 52, based on the imaging data acquired from the imaging device 12 (step S21).

When it is determined that the worker 4 has performed a predetermined action (step S21: Yes), the work environment control unit 58 performs illuminance change control of the lighting device 30 (step S22). Specifically, when the worker action determination unit 56 determines that a first action related to the lighting device 30 has been performed, the work environment control unit 58 controls the lighting device 30 to lower the illuminance. When the worker action determination unit 56 determines that a second action related to the lighting device 30 has been performed, the work environment control unit 58 controls the lighting device 30 to increase the illuminance. The illuminance change control continues until the worker 4 performs a predetermined control end action (step S23: No).

If the worker operation determination unit 56 determines that the worker 4 has performed a predetermined control termination operation (i.e., a third operation related to the lighting device 30) during the illuminance change control (step S23: Yes), the work environment control unit 58 ends the illuminance change control (step S24) and returns processing.

In the above-described control process, the work environment control unit 58 ends the illuminance change control upon receiving a control end action by the worker 4. Alternatively, the control end action may be unnecessary and the work environment control unit 58 may automatically end the illuminance change control. For example, when the worker action determination unit 56 determines that the worker 4 has performed the first action (or the second action) once, the work environment control unit 58 may end the control by increasing (or decreasing) the illuminance level of the lighting device 30 by one level from the current level. In this way, the work environment control unit 58 can eliminate the determination in step S23 by increasing (or decreasing) the illuminance level depending on the number of times the worker 4 has performed the first action (or the second action).

The control process of the workbench lifting device 40 can also be performed according to the flow shown in FIG. 6. That is, when it is determined in step S21 that the first or second operation related to the workbench lifting device 40 has been performed, the work environment control unit 58 performs lifting movement control to operate the lifting mechanism 44 and raise or lower the workbench 42 (step S22). During the lifting movement control, when the worker operation determination unit 56 determines that the worker 4 has performed a third operation related to the workbench lifting device 40 (step S23: Yes), the work environment control unit 58 ends the lifting movement control (step S24) and returns the process. This lifting movement control can also be set to raise (or lower) the height level of the workbench 42 depending on the number of times the first operation (or second operation) has been performed, thereby eliminating the determination in step S23.

As described above, in the work support system 10 of this embodiment, the lighting device 30 and the workbench lifting device 40 can be operated to change the work environment based on the motion information of the worker 4 contained in the imaging data acquired by the imaging device 12. This allows the worker 4 to perform a predetermined motion in the work area without moving from the work area, thereby adjusting the illuminance with the lighting device 30 and adjusting the height of the workbench 42 with the workbench lifting device 40.

In addition, in this work support system 10, the work environment can be changed based on the imaging data acquired for controlling the information projection device 20, so there is no need to add a new information acquisition device for controlling the work environment adjustment device 16, and the configuration of the work support system 10 can be simplified.

Next, the control process of the information projection device 20 executed by the control device 50 in the work assistance system 10 will be described with reference to FIG. 7.

First, when the work operation assurance system 10 is started, the work status grasping unit 55 of the control device 50 grasps the engine component 1 placed on the work table 42 from the imaging data acquired by the imaging device 12. The projection information control unit 57 receives the information grasped by the work status grasping unit 55 and starts the control process of the information projection device 20.

When the control process is started, the projection information control unit 57 extracts information about the work to be performed on the engine component 1 from the memory unit 52, and causes the information projection device 20 to project work information about the first work process to be performed on the engine component 1 onto the engine component 1 (step S31). When the work information is projected, the projection information control unit 57 starts control to change the projected work information based on the work status and the determination of the completion of the work process grasped by the work status grasping unit 55, and the movement of the worker 4 determined by the work movement judgment unit 56.

In the next step S32, the worker operation determination unit 56 determines whether or not the worker 4 has performed a predetermined rewinding operation based on the imaging data acquired from the imaging device 12. If a rewinding operation has not been performed (step S32: No), the work status understanding unit 55 understands the work status and determines whether or not the work of the currently projected work process has been completed (step S34).

If it is determined in step S32 that the worker 4 has performed a rewinding operation (step S32: Yes), the projection information control unit 57 rewinds the work information of the work process projected by the information projection device 20 and reprojects it from the rewind position (step S33). After that, the work status grasping unit 55 grasps the work status and determines whether the work of the currently projected work process has been completed (step S34).

As shown in FIG. 3, when multiple work processes are performed on a portion of an area 24, the work status is grasped by the work status grasping unit 55, and the worker operation judgment unit 56 judges whether or not the worker 4 has performed a predetermined work switching operation. If a work switching operation has been performed, the work status grasping unit 55 judges that the work of the currently projected work process has been completed.

When it is determined in step S34 that the work is complete, the projection information control unit 57 determines whether or not there is a next work process from the data stored in the memory unit 52 (step S35), and if there is a next work process (step S35: No), it causes the information projection device 20 to project the work information of the next work process onto the engine component 1 (step S36). After that, the process returns to step 32 and continues the subsequent processing.

If it is determined in step S35 that there is no next work process (step S35: Yes), the projection information control unit 57 ends the information projection process for the engine component 1.

In this way, in the work support system 10 of this embodiment, work information can be projected onto the engine component 1, which is the work target, using the information projection device 20, and the projected work information can be switched to work information for the next work process based on the imaging data acquired by the imaging device 12.

Furthermore, the projected work information can be rewound and reprojected based on information about the actions of the worker 4 contained in the imaging data. In this way, having the information rewind function allows the worker to reproject the work information after the assembly work to verify whether the work performed was appropriate or to review the work. Also, for example, if an inexperienced worker 4 has difficulty with the work and misses the projected work information, the work information can be rewound and reprojected.

The present invention is not limited to the above-described embodiment, and various modifications are possible without departing from the spirit of the invention.

For example, the work environment adjustment device 16 may be configured to include an air conditioner capable of adjusting the temperature at the work site.

1 Engine components (work objects)
4 Worker 10 Work support system 12 Imaging device 20 Information projection device 30 Lighting device 40 Workbench lifting device 42 Workbench 50 Control device

Claims (4)

an information projection device that projects work information related to a predetermined work process onto a work target;
an imaging device capable of imaging the work object and the worker;
a control device that switches the work information projected by the information projection device to work information of a next work process based on the imaging data acquired by the imaging device,
A work environment adjustment device is provided that can adjust the environment of the work site.
The control device, when it is determined that a worker has performed a predetermined action based on the imaging data acquired by the imaging device, activates the work environment adjustment device to change the work environment. The work environment adjusting device includes a lighting device capable of adjusting illuminance of a work site,
2. The work support system according to claim 1, wherein the control device changes an illuminance of the lighting device when it is determined based on the imaging data that the worker has performed a predetermined action related to the lighting device. The work environment adjusting device includes a workbench lifting device capable of adjusting the height of a workbench on which the work object is placed,
The work support system described in claim 1 or 2, characterized in that the control device operates the worktable lifting device to change the height of the worktable when it determines that a worker has performed a predetermined action related to the worktable lifting device. The work support system according to any one of claims 1 to 3, characterized in that the control device rewinds and reprojects the work information of the work process projected by the information projection device when it is determined that the worker has performed a predetermined action related to the information projection device based on the imaging data acquired by the imaging device.

Images