JP5304451B2 - Image recording apparatus, image generating apparatus, image processing system, and program - Google Patents

Description

  The present invention relates to an image recording apparatus, an image generation apparatus, an image processing system, and a program.

  In computer graphics, an image representing the surface of the object is mapped as a texture on the surface of the object whose shape is defined by a polygon or the like. For example, the following Patent Document 1 describes a technique for mapping a captured image obtained by capturing an object with a camera to each polygon constituting a three-dimensional model. Japanese Patent Application Laid-Open No. 2004-228561 describes a technique for rendering an image captured by a camera on a three-dimensional model and matching an image captured by the camera with a graphic display based on the three-dimensional model.

Japanese Patent Laying-Open No. 2005-63041 JP 2003-271993 A

  One of the objects of the present invention is to provide an image recording apparatus, an image generation apparatus, and an image processing capable of recording a captured image corresponding to each assembly state in accordance with a change in the assembly state of a machine configured by assembling a plurality of components. It is to provide a system and a program.

  In order to achieve the above object, the invention of the image recording apparatus according to claim 1 associates an imaging condition for capturing an image of the assembled state for each assembled state in which at least a part of a plurality of parts constituting the machine is assembled. Means for referring to the stored imaging condition information, identification means for identifying the assembly state of the machine at one or a plurality of points in the process of producing the machine, and association with the assembly state identified by the identification means Recording means for recording a captured image obtained by capturing the assembled machine based on the imaging condition stored in the imaging condition information.

  According to a second aspect of the present invention, in the image recording apparatus according to the first aspect, the imaging condition information is stored in association with an imaging condition for imaging the operation for each of one or more operations of the machine. When the machine performs an operation, the recording unit records a moving image obtained by imaging the operation based on an imaging condition stored in the imaging condition information in association with the operation.

  Further, the invention according to claim 3 further includes means for detecting a part assembled to the machine at each time of the process of producing the machine in the image recording apparatus according to claim 1 or 2, The identifying means identifies an assembly state of the machine based on the detected component.

  According to a fourth aspect of the present invention, in the image recording apparatus according to any one of the first to third aspects, the recording unit picks up an image of the assembled machine identified by the identifying unit from at least three directions. An image is recorded.

  Further, the invention of the image generation apparatus according to claim 5 records a captured image obtained by imaging the machine in each assembled state in accordance with an imaging condition associated with each assembled state in which at least a part of a plurality of parts constituting the machine is assembled. Means for referring to the recorded information, acquisition means for acquiring a captured image recorded in the recording information in association with a given assembly state of the machine, and 2 representing the shape of the machine in the given assembly state And means for generating an image in which the captured image obtained by the obtaining means is drawn on the surface of a three-dimensional or three-dimensional model.

  According to a sixth aspect of the present invention, there is provided the image generating apparatus according to the fifth aspect, wherein the image generating means does not record a captured image associated with the given assembly state in the recording information. In addition, an image corresponding to the given assembly state is generated based on the captured image recorded in the recording information.

  The invention of the image processing system according to claim 7 is the imaging condition information stored in association with the imaging condition for imaging the assembly state for each assembly state in which at least a part of a plurality of parts constituting the machine is assembled. Stored in the imaging condition information in association with the assembling state identified by the identifying means, the identifying means for identifying the assembling state of the machine at one or a plurality of time points in the assembling process of the machine. Recording means for recording a captured image obtained by imaging the machine in the assembled state based on the imaging conditions, and acquisition means for acquiring a captured image recorded by the recording means in association with a given assembly state of the machine; Captured image acquired by the acquisition means on the surface of a two-dimensional or three-dimensional model representing the shape of the machine in the given assembled state It means for generating an image drawn to characterized in that it comprises a.

  The invention of the program according to claim 8 refers to imaging condition information stored in association with imaging conditions for imaging the assembly state for each assembly state in which at least some of a plurality of parts constituting the machine are assembled. Means for identifying the assembly state of the machine at one or a plurality of points in the assembly step of the machine, and imaging stored in the imaging condition information in association with the assembly state identified by the identification unit It is a program for causing a computer to function as recording means for recording a captured image obtained by capturing the machine in the assembled state based on conditions.

  According to a ninth aspect of the present invention, there is provided a program for recording a captured image obtained by capturing an image of a machine in each assembled state in accordance with an imaging condition associated with each assembled state in which at least a part of a plurality of parts constituting the machine is assembled. Means for referring to information; acquisition means for acquiring a captured image recorded in the recorded information in association with a given assembly state of the machine; two-dimensional representing the shape of the machine in the given assembly state; It is a program for causing a computer to function as a means for generating an image in which a captured image acquired by the acquisition means is drawn on the surface of a three-dimensional model.

  According to invention of Claim 1 and 8, according to the change of the assembly | attachment state of the machine which assembles | assembles and comprises a some component, the captured image corresponding to each assembly state can be recorded.

  According to the second aspect of the present invention, it is possible to record a captured image obtained by capturing an actual operation of the machine in parallel with the production process of the machine.

  According to the third aspect of the present invention, it is possible to record a captured image corresponding to a mechanically recognized assembly state of the machine.

  According to the invention described in claim 4, it is possible to record a captured image to be drawn on each surface of the three-dimensional object.

  According to the fifth and ninth aspects of the present invention, it is possible to draw a captured image obtained by capturing an actual machine in the assembled state on the surface of the two-dimensional or three-dimensional model corresponding to the given assembled state of the machine.

  According to the sixth aspect of the present invention, it is possible to generate an image to be drawn on the surface of a two-dimensional or three-dimensional model corresponding to an assembly state that is not recorded.

  According to the seventh aspect of the present invention, along with a change in the assembly state of a machine configured by assembling a plurality of parts, a captured image corresponding to each assembly state is recorded, and corresponding to a given assembly state of the machine On the surface of the two-dimensional or three-dimensional model, it is possible to draw a picked-up image obtained by picking up an image of a real machine recorded about the assembled state.

1 is a configuration diagram of an image processing system. It is a figure which shows the example of 1 structure of the imaging device and RFID reader | reader provided in the production line. It is detail drawing of an example of 1 composition of an imaging device and an RFID reader provided in a production line. It is a figure which shows an example of process management data. It is a figure which shows an example of imaging condition data. It is a functional block diagram of an image recording device. It is a figure which shows an example of assembly | attachment log | history data. It is a figure which shows an example of captured image data. It is a functional block diagram of an image processing apparatus. It is a figure explaining the production | generation process of an unrecorded texture image. It is a figure which shows an example of the display image of a machine object. It is a figure which shows an example of a moving image. It is a flowchart of an image recording process. It is a flowchart of an image generation process.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments (hereinafter referred to as embodiments) for carrying out the invention will be described with reference to the drawings.

  FIG. 1 shows a configuration diagram of an image processing system 1 according to the present embodiment. As shown in FIG. 1, an image processing system 1 includes an imaging device 3 and an RFID (radio frequency identification) reader 5, a database 7, an image recording device 10, and an image installed in one or more work areas of a production line. A processing device 20 is included. In the production line described above, a process of producing a machine such as a copying machine or an image forming apparatus configured by assembling a plurality of parts is performed. In the present embodiment, image recording processing in which the image recording apparatus 10 records in the database 7 image information (including still images and / or moving images) obtained by capturing images of machines in various assembled states on the production line by the imaging device 3. Image information recorded in the database 7 with respect to a three-dimensional object (hereinafter referred to as a machine object) corresponding to the machine arranged in a virtual space shared by the client apparatuses 30 connected to the image processing apparatus 20 The image reproduction processing such as texture mapping and moving image reproduction performed based on the above is executed. Hereinafter, details of each device included in the image processing system 1 will be described.

  2A and 2B show one configuration example of the imaging device 3 and the RFID reader 5 provided in the production line 2. As shown in FIG. 2A, the production line 2 is provided with one or a plurality of work areas (spots), and the work to be performed is determined in each work area. For example, the work areas A, B, C The parts are assembled to the machine by moving the machine to be produced in this order. In the present embodiment, the imaging device 3 and the RFID reader 5 are provided in each work area, and images obtained by imaging the assembly state of the machine working in each work area are sequentially recorded.

  FIG. 2B shows a detailed view of a configuration example of the imaging device 3 and the RFID reader 5 in each work area of the production line 2. As shown in FIG. 2B, the work area includes a turntable 4 on which a machine to be produced is placed, three image pickup devices 3 that pick up images of the machine on the turntable 4 from three directions, and an RFID tag on the turntable 4. An RFID reader 5 provided at a position for reading is installed. In the present embodiment, an RFID tag is pasted on a component to be assembled, and the pasted RFID tag is read by the RFID reader 5, so that a component assembled in the machine or a newly added component We will acquire the information. The imaging device 3, the RFID reader 5, and the turntable 4 are connected to an image recording device 10, which will be described later, wirelessly or by wire. The imaging device 3 controls the imaging direction, the imaging magnification, etc. 4, the rotation angle and the like are controlled by the image recording apparatus 10.

  The database 7 stores data used for processing in the image processing system 1 and stores recording data recorded by the image recording apparatus 10. In this embodiment, the database 7 is configured as a relational database, but other forms such as an XML database may be used. The database 7 according to the present embodiment includes a process management information storage unit 7A, an imaging condition storage unit 7B, a captured image storage unit 7C, and an assembly history storage unit 7D, and stores data related to processing by the image recording apparatus 10. ing.

  The process management information storage unit 7A stores process management data that defines work for each process performed on the production line 2 and imaging conditions for imaging a machine related to the work.

  FIG. 3 shows an example of process management data according to the present embodiment. As shown in FIG. 3, the process management data is configured as a table storing a spot ID, a machine ID, a parts list, and an imaging condition ID in association with a process ID for identifying a process. The spot ID is information for identifying a place where the main process is performed in the production line 2, and the machine ID is information for identifying a machine that is a target of the main process. Also, the parts list is list information of parts that are targets of work such as attachment in this process, and the imaging condition ID identifies imaging conditions when imaging the machine in which the parts are assembled in this process. Information. The details of the imaging conditions are stored in an imaging condition storage unit 7B described later.

  FIG. 4 shows an example of imaging condition data stored in the imaging condition storage unit 7B. As shown in FIG. 4, the imaging condition data is associated with an imaging condition ID for identifying an imaging condition, and settings for shooting a still image (still image shooting setting) and settings for moving image shooting (moving image). Image capture setting) and a table storing the rotation angle of the turntable 4. The still image shooting setting and the moving image shooting setting are the zooming factor, the region of interest (ROI), and the like for the imaging device 3 that performs the imaging operation among the plurality of imaging devices 3 and the imaging device 3 that performs the imaging operation. This is information for setting parameters. The region of interest represents a region including the target image in the captured image. For example, when the region of interest is a rectangular region and the origin is at the upper left of the captured image, the X axis is in the right direction, and the Y axis is in the lower direction, the ROI (X, Y, W, H) represents setting a rectangular area of W from the coordinates (X, Y) to the horizontal (right) and H (vertical) to the space of interest. In addition, moving image shooting is performed when an operation designated in the moving image shooting setting (for example, “copy start”) is executed.

  The assembly history storage unit 7D stores a history of component assembly operations performed during the production process on the production line 2, and details of data stored in the assembly history storage unit 7D will be described later.

  The captured image storage unit 7C stores image data (still image or / and moving image) captured according to the imaging conditions stored in the imaging condition storage unit 7B during the production process in the production line 2. Details of the data stored in the image storage unit 7C will be described later.

  FIG. 5 shows a functional block diagram of the image recording apparatus 10 according to the present embodiment. As shown in FIG. 5, the image recording apparatus 10 includes a component information acquisition unit 40, an imaging condition acquisition unit 42, a captured image acquisition unit 44, and a recording unit 46. The functions of the above-described units are such that a computer having a control unit such as a CPU, a storage unit such as a memory, and an input / output unit that transmits and receives data to and from an external device reads a program stored in a computer-readable information storage medium. It may be realized by executing. The program may be supplied to the image recording apparatus 10 that is a computer by an information storage medium, or may be supplied via data communication means such as the Internet.

  The component information acquisition unit 40 acquires component information read by the RFID reader 5 installed in the production line 2. In this embodiment, when each RFID reader 5 installed in the production line 2 reads the component information, the read component information is transferred to the image recording apparatus 10 by wired or wireless communication.

  Based on the component information acquired by the component information acquisition unit 40, the imaging condition acquisition unit 42 acquires an imaging condition for imaging the machine in the assembled state identified by the component information. In the present embodiment, the history of component information acquired by the component information acquisition unit 40 is managed, and a newly added component is identified based on the difference between the component information held as the history and the latest component information. The imaging conditions stored in the process management data corresponding to the process of assembling the new part are acquired. Specifically, the imaging condition acquisition unit 42 stores the process management data stored in the database 7 based on the spot ID where the RFID reader 5 that acquired the component information is installed, the machine ID to be produced, and the component list to be assembled. The corresponding imaging condition ID is searched from the list. And the imaging condition acquisition part 42 acquires the data of the imaging condition regarding the searched imaging condition ID from the data stored in the imaging condition storage part 7B.

  The captured image acquisition unit 44 acquires a captured image of the machine imaged by the imaging device 3 based on the imaging condition acquired by the imaging condition acquisition unit 42. In the present embodiment, the captured image acquisition unit 44 rotates the turntable 4 according to the imaging conditions acquired by the imaging condition acquisition unit 42, and sets the magnification and the imaging direction specified in the imaging conditions to each of the imaging devices 3. Set to capture a still image. Still image capturing may be performed simultaneously by a plurality of image capturing apparatuses 3 or one by one.

  The captured image acquisition unit 44 acquires a moving image while detecting the start of a moving image capturing target operation (for example, “copy start”) as follows. That is, when a start signal of an operation to be a moving image is input, the captured image acquisition unit 44 causes the imaging device 3 to start capturing a moving image based on the start signal, and an end signal of the operation is received. Continue to capture moving images until input. For example, when the machine is a copying machine and the operation to be imaged is a copy operation, when a signal indicating that the copy operation is started is input to the image recording apparatus 10, the image recording apparatus 10 Imaging of the copy process is started, and when the copy process ends, the imaging ends.

  The recording unit 46 records history data of assembly work performed on the production line 2 and captured image data (including still images and / or moving images) acquired by the captured image acquisition unit 44 in the database 7. is there. In the present embodiment, the recording unit 46 stores assembly work history data in the assembly history storage unit 7D, and stores the captured image data acquired by the captured image acquisition unit 44 in the captured image storage unit 7C.

  FIG. 6 shows an example of assembly history data stored in the assembly history storage unit 7D. As shown in FIG. 6, the assembly history data is configured as a table storing a machine ID to be produced and an imaging record ID for identifying an imaging record in association with the process ID.

  FIG. 7 shows an example of captured image data stored in the captured image storage unit 7C. The captured image data is configured as a table in which the file names of still image data and moving image data are stored in association with the imaging record ID. The file entity data may be stored in the captured image storage unit 7C.

  Next, as an example of a method of using the image data recorded by the image recording apparatus 10, the recorded still image data is mapped as a texture image to a three-dimensional machine object provided in the virtual space, and recorded. An example in which the moving image data is reproduced according to the operation performed by the machine object will be described. In the present embodiment, the database 7 includes a virtual space data storage unit 7E and a modeling data storage unit 7F, and constructs the above virtual space.

  The virtual space data storage unit 7E includes objects (including machine objects and production line objects) arranged in the virtual space, and avatars (positions in the virtual space) whose positions and actions are controlled in response to input from the client device 30. The coordinate position, attribute information, operation information, etc. of the object corresponding to the person are stored.

  The modeling data storage unit 7F stores modeling data that defines the three-dimensional shape of an object arranged in the virtual space. The modeling data may be data in which the object shape is composed of a plurality of polygons. If the object is composed of a plurality of parts, the modeling data may be held for each part.

  FIG. 8 shows a functional block diagram of the image processing apparatus 20 having an image generation function for generating the above-described virtual space view. As illustrated in FIG. 8, the image processing apparatus 20 includes a communication unit 50, a virtual space control unit 52, a recorded image acquisition unit 54, a texture image generation unit 56, and a display image generation unit 58. The functions of the above-described units are such that a computer having a control unit such as a CPU, a storage unit such as a memory, and an input / output unit that transmits and receives data to and from an external device reads a program stored in a computer-readable information storage medium. It may be realized by executing. The program may be supplied to the image processing apparatus 20 that is a computer by an information storage medium, or may be supplied via data communication means such as the Internet.

  The communication unit 50 includes a network interface, and performs data communication with an information processing apparatus such as the client apparatus 30 via the network interface.

  The virtual space control unit 52 constructs a virtual space based on the data stored in the virtual space data storage unit 7E, and in the virtual space based on an input from each client device 30 connected via the communication unit 50. These objects (machine objects, avatars, etc.) are controlled. In the present embodiment, an example will be described in which the same environment as that of the production line 2 described above is constructed in a virtual space, and the production of the machine described above is reproduced in the production line 2 of the virtual space.

  The recorded image acquisition unit 54 acquires an image recorded in the database 7 regarding the machine object based on the state of the machine object arranged in the virtual space controlled by the virtual space control unit 52. Specifically, the recorded image acquisition unit 54 may acquire still image data and moving image data recorded in the database 7 by the following processing.

  First, the recorded image acquisition unit 54 identifies a process in the production line 2 of the machine object based on the arrangement position of the machine object corresponding to the target machine arranged in the virtual space. The recorded image acquisition unit 54 acquires the captured image stored in the captured image storage unit 7C in association with the identified process.

  Next, when the recorded image acquisition unit 54 detects that the machine object performs a predetermined motion by operating the machine object placed in the virtual space, the detected image is detected. It is assumed that moving image data recorded in the database 7 in association with the operation is acquired.

  When the avatar operates the machine object arranged in the virtual space and the machine object changes to a state where no image is recorded on the actual machine, the texture image generation unit 56 A texture image (unrecorded texture image) to be mapped to an object is generated. Hereinafter, the process by the texture image generation part 56 is demonstrated concretely.

FIG. 9 shows a diagram for explaining an unrecorded texture image generation process. As shown in FIG. 9, in the production line 2, assembly is performed in the order of the state S ₀ , the state S ₀₁ , the state S ₀₁₂ , and the state S ₀₁₂₃ , and recorded image data exists for each of these states. . Note that state S ₀ is a state in which no component is assembled, state S ₀₁ is a state in which component P 1 is assembled, state S ₀₁₂ is a state in which component P 2 is assembled in state S ₀₁ , and state S ₀₁₂₃ is a state and a state where part P3 is assembled to S _012. In contrast, in the virtual space, the result of decomposition operation the machine object corresponding to the state S ₀₁₂₃ has been performed, when the parts P1 and P3 is ready S ₀₁₃ assembled, this state S ₀₁₃ is The captured image is not recorded. In contrast, the texture image generating unit 56 of the real-mentioned processes (recording pass), as shown in FIG. 9, to set the actual state S ₀₁ closest to state S ₀₁₃ to start, were imaged S ₀₁ The texture image corresponding to the state S ₀₁₃ is generated by superimposing the ROI of the photograph taken in the process of assembling the part P3 on the image by superposition. Similarly, the texture image generation unit 56 may generate a texture image based on a captured image captured for the recorded assembly state for other assembly states that are not recorded during the production process.

  The display image generation unit 58 maps the image acquired by the recorded image acquisition unit 54 or the image generated by the texture image generation unit 56 as a texture on the machine object arranged in the virtual space, A machine object rendering process based on the imaging position and the imaging direction for every 30 is performed to generate a display image to be displayed as a view of the virtual space. Texture mapping may be performed by mapping a texture image captured from the imaging direction corresponding to each visible surface to each vertex of the three visible surfaces of the three-dimensional machine object. It should be noted that the positional relationship between the subject and the imaging device 3 may be retained at the time of shooting, and the retained positional relationship information may be used during texture mapping or rendering. The display image generated by the display image generation unit 58 is transmitted to each client device 30 via the communication unit 50 and displayed on the display device connected to the client device 30.

  FIG. 10A shows an example of a display image of a machine object generated by the display image generation unit 58 in accordance with a change in the assembly state of the machine object. As shown in FIG. 10A, when the assembly state changes, the texture image corresponding to the changed assembly state is mapped to the machine object, and a display image corresponding to the assembly state is generated.

  FIG. 10B shows an example of a moving image displayed when a predetermined motion is instructed to the machine object in the virtual space. As shown in FIG. 10B, for example, when a machine object copy start button is pressed by an avatar in a virtual space, a moving image corresponding to the copy start operation is acquired from the database 7, and the acquired moving image is the machine object. It is good also as reproducing | regenerating by superimposing on. The virtual space control unit 52 may detect that the copy start button has been pressed based on an input from the client device 30.

  Next, each of the image recording process and the virtual space image generation process performed in the image processing system 1 according to the present embodiment will be described with reference to the flowcharts shown in FIGS. 11 and 12.

  FIG. 11 shows a flowchart of the image recording process. As shown in FIG. 11, the image recording apparatus 10 acquires component information detected by the RFID reader 5 (S101), and extracts newly added component information based on the history of the acquired component information. (S102). Next, the image recording apparatus 10 captures an assembly condition when the above-described component information is added based on the extracted component information, the spot ID where the RFID reader 5 is installed, and the machine ID of the production target. Is acquired (S103). The image recording device 10 adjusts the turntable 4 and the imaging device 3 according to the acquired imaging condition (S104), and if there is a “still image” in the imaging instruction (S105: Y), the still image is displayed on the imaging device 3. Imaging is performed all at once (S106), and a captured image of the machine is acquired. Further, if “moving image” is included in the imaging instruction (S107: Y), the image recording apparatus 10 waits for the timing at which the machine performs the target operation, and when the target operation is performed (S108: Y), the imaging apparatus In step S109, a moving image is captured all at once (S109), and a moving image capturing the target operation of the machine is acquired. The image recording apparatus 10 records the still image or moving image acquired in S106 and S109 in the database 7 (S110), and ends the recording process. The image recording process described above may be performed every time the component information received from the RFID reader 5 is updated.

  Next, the virtual space image generation processing will be described. FIG. 12 shows a flowchart of the virtual space image generation processing. As shown in FIG. 12, the image processing apparatus 20 receives input of operation information for operating the avatar arranged in the virtual space from the connected client apparatus 30 (S201), and the machine arranged in the virtual space by the operation. When the assembly state of the object has changed (S202: Y), a texture image corresponding to the assembly state after the change is acquired (S203), and the acquired texture image is mapped to the machine object (S204).

  Next, when the machine object executes any one of the predetermined operations by the received operation (S205: Y), the image processing apparatus 20 acquires a moving image in which the operation is recorded by the actual machine. (S206), and the acquired moving image is reproduced (S207). Further, when the assembly state of the machine object is not changed by the above operation (S202: N), and when the machine object does not execute any of the predetermined operations (S205: N), the texture image update or the moving image is performed. The process ends without reproducing the image. The image generation process described above may be performed every time operation information is received from the client device 30.

  Further, the present invention is not limited to the above embodiment. For example, in recording the still image and moving image of each assembled state in a real machine, in the above embodiment, it is recorded along with the production process of the machine. It doesn't matter. In the above embodiment, the assembly state of the machine is identified based on the component information detected by the RFID reader 5, but the assembly state of the machine is identified based on a change in the weight of the assembly target machine. It is good.

  Further, in the above-described embodiment, the example in which the texture image is mapped to the three-dimensional machine object arranged in the virtual space when using the recorded image data has been described. However, the image data recorded in the two-dimensional object is mapped. It doesn't matter. Furthermore, in the above embodiment, when a machine object is operated in accordance with the motion of an avatar arranged in the virtual space, a live-action moving image in which the motion is recorded is reproduced. May be operated, the real space and the virtual space may be linked by, for example, reproducing the corresponding moving image on the virtual space side in conjunction with the operation.

  DESCRIPTION OF SYMBOLS 1 Image processing system 2 Production line 3 Imaging device 4 Turntable 5 RFID reader 7 Database 7A Process management information storage part 7B Imaging condition storage part 7C Captured image storage part 7D Assembly history storage part 7E Virtual space data storage unit, 7F modeling data storage unit, 10 image recording device, 20 image processing device, 30 client device, 40 component information acquisition unit, 42 imaging condition acquisition unit, 44 captured image acquisition unit, 46 recording unit, 50 communication Unit, 52 virtual space control unit, 54 recorded image acquisition unit, 56 texture image generation unit, 58 display image generation unit.

Claims (5)

Means for referring to imaging condition information stored in association with imaging conditions for imaging the assembly state for each assembly state in which at least a part of a plurality of parts constituting the machine is assembled;
Identification means for identifying the assembly state of the machine at each of one or more points in the process of producing the machine;
Recording means for recording a captured image obtained by capturing the machine in the assembly state based on the imaging condition stored in the imaging condition information in association with the assembly state identified by the identification unit;
In the case where a captured image is not recorded by the recording means in association with a specified given assembling state, the recording is performed for the first assembling state in which some parts to be assembled in the given assembling state are assembled. The other one extracted from the second captured image associated with the second assembled state in which some other parts assembled in the given assembled state are assembled to the first captured image recorded by the means. Texture image generation means for generating a texture image corresponding to the given assembly state by superimposing images of parts of the part;
Display image generation means for generating a display image by mapping the generated texture image on the surface of a two-dimensional or three-dimensional model representing the shape of the machine in the given assembly state;
An image processing system comprising: The imaging condition information is stored in association with imaging conditions for imaging the operation for each of one or more operations of the machine,
The said recording means records the moving image which image | photographed the said operation | movement based on the imaging condition stored in the said imaging condition information linked | related with the said operation | movement when the said machine performs an operation | movement. The image processing system described in 1. Means for detecting parts assembled to the machine at each point in the process of producing the machine;
The image processing system according to claim 1, wherein the identification unit identifies an assembly state of the machine based on the detected component. The image processing system according to any one of claims 1 to 3, wherein the recording unit records a captured image obtained by capturing the assembled machine identified by the identifying unit from at least three directions. Means for referring to imaging condition information stored in association with imaging conditions for imaging the assembly state for each assembly state in which at least a part of a plurality of parts constituting the machine is assembled;
Identifying means for identifying the assembly state of the machine at each of one or more points in the assembly process of the machine;
Recording means for recording a captured image obtained by capturing the machine in the assembly state based on the imaging condition stored in the imaging condition information in association with the assembly state identified by the identification unit ;
In the case where a captured image is not recorded by the recording means in association with a specified given assembling state, the recording is performed for the first assembling state in which some parts to be assembled in the given assembling state are assembled. The other one extracted from the second captured image associated with the second assembled state in which some other parts assembled in the given assembled state are assembled to the first captured image recorded by the means. Texture image generation means for generating a texture image corresponding to the given assembly state by superimposing images of parts of the part;
A program for causing a computer to function as display image generation means for generating a display image by mapping the generated texture image on the surface of a two-dimensional or three-dimensional model representing the shape of the machine in the given assembly state .

Images