JP5152581B2 - Image data processing apparatus and method, program, and recording medium - Google Patents

Description

  The present invention relates to an image data processing apparatus and method for extracting and displaying parts assembled in a predetermined region of a device from a three-dimensional model of the device, a program, and a recording medium thereof.

  In recent years, the use of a three-dimensional model created using CAD (Computer Aided Design) or CG (Computer Graphics) has been rapidly expanding due to improvement in computer performance and progress in graphic processing technology. In the manufacturing industry that manufactures industrial products, the use of in-house products designed with a three-dimensional model in the maintenance service department, which is a downstream process, has become widespread. In the maintenance service department of the manufacturing industry, parts maintained in a product may be specified for product maintenance, and the assembly state and shape of the specified part may be confirmed on a three-dimensional model.

  For example, in Patent Document 1, in a three-dimensional model such as an industrial product, a part attached to a specific region of a product is identified while grasping an image of a product in a state where parts constituting the model are attached. Therefore, by creating the information for extracting the parts assembled in the area, and the two-dimensional image of the extracted parts and the two-dimensional image when the parts are assembled to the product, An image processing apparatus and method have been disclosed for enabling parts to be identified by light processing compared to the case of using three-dimensional shape data, and for sufficiently withstanding practical use even on a computer having low processing performance.

  However, in the case of the apparatus and method disclosed in Patent Document 1, if the number of gaze directions to be given is large, there is a problem that the number of created two-dimensional images increases and the data size increases. For this reason, for example, when a parts catalog of a product created by this method is distributed to many users via a network, it takes time to download the parts catalog, resulting in a reduction in work efficiency and a high level of network performance. Gives a load.

  Therefore, as a method for solving this, it is conceivable to significantly reduce the data size by limiting the line-of-sight direction to one. However, among the parts assembled in the product, the part positioned in the foreground in the line-of-sight direction is easy to see, but the part assembled in the distance may be difficult to identify. If a plurality of line-of-sight directions are prepared, the parts can be easily identified by looking from the front side. However, by limiting the line-of-sight direction to one part, some parts are difficult to identify.

JP 2008-146131 A

  The present invention has been made to solve such a problem, and its object is to identify parts that are difficult to identify when extracting and displaying parts assembled in a predetermined region of a three-dimensional model of equipment. Is to reduce as much as possible.

The present invention relates to a model data for managing three-dimensional model information including part shape information representing a part shape of each part constituting the device and whole shape information representing an assembled state of each part for a three-dimensional model of the device. A line of sight in which as many parts as possible are located in front of the plurality of line-of-sight direction candidates based on the management means, the plurality of line-of-sight direction candidates input by the user, and the three-dimensional model information Gaze direction selection processing means for selecting a direction as the optimum gaze direction, and the plurality of gaze direction candidates are from a three-axis evaluation coordinate system and a plane constituted by the two axes of the evaluation coordinate system. And an azimuth angle with respect to a straight line passing through the origin of the evaluation coordinate system on the plane, and the line-of-sight direction selection processing means sets the center position of each part to the plane. Means for shadowing, means for counting the number of projection points existing in the direction of the azimuth angle across a straight line that passes through the origin of the evaluation coordinate system and is orthogonal to the direction of the azimuth angle, and the count value is the largest. An image data processing apparatus comprising means for setting a combination of the azimuth angle and the elevation angle as an optimum line-of-sight direction .
Further, the present invention manages, for a three-dimensional model of equipment, three-dimensional model information including part shape information representing the part shape of each part constituting the equipment and overall shape information representing an assembled state of each part. An image data processing method executed by an image data processing apparatus having model data management means, wherein the line-of-sight direction selection processing means is based on a plurality of line-of-sight direction candidates inputted by a user and the three-dimensional model information. Selecting a line-of-sight direction in which as many parts as possible are located in front of the plurality of line-of-sight direction candidates as an optimal line-of-sight direction, and a data creation processing unit including the three-dimensional model information and the optimal line-of-sight with direction, and creating an image of the part from the viewing direction, and having a plurality of gaze directions of the candidates, triaxial Selected from the evaluation coordinate system, the elevation angle from the plane constituted by the two axes of the evaluation coordinate system, and the azimuth angle with respect to a straight line passing through the origin of the evaluation coordinate system on the plane, and selected as the optimal viewing direction The step of projecting the center position of each part onto the plane and the projection point existing in the direction of the azimuth angle with a straight line passing through the origin of the evaluation coordinate system and orthogonal to the direction of the azimuth angle as a boundary And a step of setting the combination of the azimuth angle and the elevation angle at which the counted value is the largest to the optimum line-of-sight direction .

  ADVANTAGE OF THE INVENTION According to this invention, when extracting and displaying the parts assembled | attached to the predetermined | prescribed area | region of the three-dimensional model of an apparatus, the part which is difficult to identify can be reduced as much as possible.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a diagram showing a configuration of an image data processing apparatus according to an embodiment of the present invention.
This image data processing apparatus constitutes a CPU 1 for executing various data processes, a work area of the CPU 1, a memory 2 in which various programs and data are stored, and a user operation to this data processing apparatus. An input / output device 3 for inputting / outputting data and an external input / output device 4 for inputting / outputting data to / from an external device (not shown) are included. The CPU 1, the memory 2, the input / output device 3, and the external input / output device 4 are connected via a bus 5, and exchange various data via the bus 5.

  This image data processing apparatus has a parts catalog creation function. FIG. 2 shows functional blocks of the parts catalog creation function. This parts catalog creation function is realized by the CPU 1 operating according to a program stored in the memory 2. The memory for storing the program may be any of a semiconductor medium (for example, ROM, nonvolatile memory card, etc.), an optical recording medium (for example, DVD, MO, MD, CD, etc.), a magnetic recording medium (for example, flexible disk), and the like.

  In FIG. 2, the catalog creation unit 20 creates part catalog data based on the data stored in the 3D (three-dimensional) data storage unit 21 and the parts list storage unit 22 formed in the memory 2 of FIG. 1 is stored in the catalog storage unit 23 formed in the memory 2 of FIG.

  The 3D data storage unit 21 is a database that holds 3D_CAD data used for creating a catalog. The 3D_CAD data holds part shape information representing the part shape of each part constituting the product (device) and overall shape information representing the assembled state of each part.

  The parts list storage unit 22 is a database describing a list of parts (replaceable parts) to be included in the catalog. In the parts list, part names, part ordering numbers, and the like are held in a unit unit of the product.

  Of the parts registered in the parts list stored in the parts list storage unit 22, the catalog creation unit 20 stores the 3D_CAD data in the 3D data storage unit 21 in the 3D data storage unit 21. With reference to the stored content, the image data (2D data) stored in the image data storage unit 24 is compensated and input by the image compensation unit 25 if the 3D_CAD data is not stored in the 3D data storage unit 21. In addition, for the image data input by the image compensation unit 25, the position information input from the position information compensation unit 26 is used as the position information used when displaying the part.

  The image data storage unit 24 is a database that holds images captured by a digital still camera in advance and images created by illustrations for parts that are described in the parts list but do not exist as 3D_CAD data.

  The image filling unit 25 creates an image (file) in the image data storage unit 24 specified by the user by operating the input / output device 3 for a part which is described in the parts list but does not have 3D_CAD data. Part 20 is given.

  The position information compensation unit 26 uses, as position information, the catalog creation unit 20 to indicate the position of the assembly state specified by the user by operating the input / output device 3 for a part that is described in the parts list but does not have 3D_CAD data. To give.

  The catalog storage unit 23 includes a list of parts in the catalog (name and order number), an image displaying a single part, an image indicating the assembly position of the part (from a plurality of viewpoints), and assembly position information of the part. Catalog data composed of (from a plurality of viewpoints) is stored for each part.

  Here, the image showing the assembly position of the part highlights the part so that the assembly position of the target part can be seen in the image of the unit indicating the product or part of the product (when created from 3D data) Alternatively, a rectangular area indicating the assembly position of the part or a rectangular parallelepiped surrounding the part is highlighted.

  The catalog browsing unit 27 displays the contents of catalog data created by the catalog creating unit 20 and stored in the catalog storage unit 23. In addition to searching by part name, it is possible to search for a part by specifying an area on the part assembly state diagram.

  FIG. 3 shows an example of catalog data formed for one part. This catalog data includes a part single image, a part assembly drawing, a part assembly enlarged view, boundary information, a part name, a part number, and a unit name.

  The part single image is a single image of the part. The scale ratio varies depending on each part, and is a ratio that is as large as possible and displays the entire part.

  The part assembly diagram is an image created for each part, in which only the part is highlighted and all other parts are non-highlighted such as semi-transparent drawing or wire frame drawing. Here, not only the viewpoint is in one direction, but a part assembly diagram from a plurality of viewpoints is created as necessary. The scale ratio is always constant in the same viewpoint direction, is as large as possible, and is a ratio at which all parts are displayed.

  The part assembly drawing enlarged view is an enlarged display of the part assembly drawing of each of the above parts. In the maximum ratio, the part is displayed as large and as large as possible. At the minimum ratio, all parts are displayed as large and all as possible. Parts assembly drawings with different ratios are created as necessary. The entire part is always displayed regardless of the ratio.

  The boundary information is information indicating where the part is in the image in the part assembly drawing and the part assembly enlarged view of each part. The upper left corner of the image is the origin (X = 0, Y = 0), where X is rightward and Y is positively increasing. It is.

  The part name represents the name of the part. The part number (order number) is a number assigned for each part. Parts with the same shape have the same number. The unit name is a name of a unit that is a unit of a part set. Indicates which unit each part belongs to. Normally, all parts belong to one of the units (for example, “paper feeding unit”, “paper ejection unit”, etc.).

  FIG. 4 shows functional blocks of the catalog creating unit 20 in FIG. The catalog creation unit 20 includes a model data management unit 31, a catalog data creation processing unit 32, and a line-of-sight direction selection processing unit 33. Among them, the model data management unit 31 and the catalog data creation processing unit 32 are the model data management unit, the image / boundary data creation processing unit, the image / boundary data described in FIG. 2 and FIG. It corresponds to a management unit, and a line-of-sight direction selection processing unit 33 is newly added.

  The model data management unit 31 manages 3D_CAD data including part shape information indicating the part shape of each part constituting the device and overall shape information indicating the assembled state of each part for a three-dimensional model prepared in advance. Assembling shape information, single shape information of multiple parts, and parts management information (part number, part name, single image file name, line-of-sight number, boundary information, highlight assembled image file name, etc.) create catalog data It passes to the processing unit 32 and the line-of-sight direction selection processing unit 33.

  The input / output device 3 gives the evaluation coordinate system, the elevation angle, and a plurality of azimuth angles to the line-of-sight direction selection processing unit 33 in accordance with a user operation. The line-of-sight direction selection processing unit 33 selects a line-of-sight direction in which as many parts as possible are located in front from among a plurality of line-of-sight direction candidates given from the input / output device 3, and indicates the line-of-sight direction. The information is passed to the catalog data creation processing unit 32.

Evaluation coordinate system from the input device 3 is provided in the line-of-sight direction selection processing section 33, elevation, and azimuth angle shown in FIG. The evaluation coordinate system is given by an orthogonal coordinate system with an origin, i-axis, j-axis, and k-axis. Specifically, as shown in FIG. 5A, in the coordinate system of the three-dimensional model (orthogonal coordinate system using x, y, and z axes), the i axis direction (x _i , y _i , z _i ), j axis _Given by the unit direction vector of each axis composed of the direction (x _j , y _j , z _j ), the k-axis direction (x _k , y _k , z _k ), and the origin position (x ₀ , y ₀ , z ₀ ) .

  As shown in FIG. 5B, the elevation angle is given as an angle φ with respect to the ij plane of the evaluation coordinate system. The azimuth angle is given as an angle θ around the k-axis with respect to the i-axis direction at the origin of the evaluation coordinate system. A plurality of azimuth angles are given, and a sight line direction candidate is determined by a combination of each azimuth angle and elevation angle. Thus, by changing the scalar value called the azimuth, it becomes possible to specify a plurality of line-of-sight directions that are vector values, and it is possible to reduce the labor of input compared to the case of inputting many vector values, and Since the line-of-sight direction can be evaluated on the basis of the reference around the axis, a systematic evaluation can be performed as compared with the case where the line-of-sight direction is randomly given.

  Here, conversion from the coordinate value of the coordinate system (xyz orthogonal coordinate system) of the three-dimensional model to the coordinate value of the evaluation coordinate system (ijk orthogonal coordinate system) is performed by the following equation [1].

  The conversion from the coordinate value of the evaluation coordinate system to the coordinate value of the coordinate system of the three-dimensional model is performed by the following equation [2].

  Further, the conversion from the elevation angle and the azimuth angle to the unit vector coordinate value of the evaluation coordinate system is performed by the following equation [3].

The line-of-sight direction selection processing unit 33 selects the optimum line-of-sight direction by executing the steps shown in the flowchart of FIG.
First, in step S1, a point that becomes the center position of one part of the three-dimensional model is obtained, and then in step S2, the point that becomes the center position is determined in the evaluation coordinate system as shown in FIG. Projects vertically on a plane and stores the coordinates of the projection point.

  Here, the point which becomes the center position of the part is obtained by the following equation [4] as the position in the coordinate system of the three-dimensional model obtained by averaging all the points (n) defining the shape of the part.

  When this is converted into the evaluation coordinate system, the projection point is obtained by the i coordinate value and the j coordinate value.

  When steps S1 and S2 are repeated to finish the projection process for the point that is the center position of each part (step S3: NO), the process proceeds to step S4, and as shown in FIG. 8, one given azimuth is evaluated. A straight line L that passes through the origin O of the coordinate system and is orthogonal to the direction of the azimuth angle is drawn on the ij plane, and the direction of the azimuth angle with respect to the straight line L among the projection points previously obtained in steps S1 to S2 ( The number of projection points on the side of the azimuth direction arrow in the figure is obtained.

  Next, the process proceeds to step S5, where it is checked whether or not the number of projection points obtained this time in step S4 is larger than the number of projection points obtained so far. If so (S5: YES), the optimum combination with the elevation angle is made in step S7. After storing the azimuth angle as the line-of-sight direction, in step S8, the presence / absence of an azimuth angle for which the number of projection points has not yet been obtained is checked. On the other hand, if the number is smaller than the number of projection points obtained so far (S5: NO), the process directly proceeds to step S8.

  Steps S4 to S6 are repeated to determine the number of projection points in each azimuth direction with respect to the straight line L among the projection points previously obtained in steps S1 to S2 (step S7: YES), step S8. In step S6, the combination of the azimuth angle having the largest number of projection points and the elevation angle stored in step S6 is set as the optimum line-of-sight direction, and is converted into a direction vector in the coordinate system of the three-dimensional model. As a result, it is possible to select the line-of-sight direction in which the center position of the part is the most forward.

  The catalog data creation processing unit 32 uses the overall shape information and part shape information received from the model data management unit 31 and the optimum line-of-sight direction received from the line-of-sight direction selection processing unit 32, and the overall image information of the line-of-sight direction, Single image information, boundary information, and a whole image with highlight are created. Since this process is described in detail in Patent Document 1, a description thereof will be omitted.

  As described above in detail, according to the data processing apparatus of this embodiment, it is possible to select a line-of-sight direction in which more parts are positioned in front of the given line-of-sight direction candidates. When the line-of-sight direction is limited to one in order to reduce the size, it is possible to determine the line-of-sight direction that minimizes the parts that are difficult to identify. In the above embodiment, the line-of-sight direction in which the most parts are located in front is selected from the given line-of-sight candidates, but the line-of-sight direction in which the next most parts are next is selected. You can also

It is a figure which shows the structure of the image data processing apparatus of embodiment of this invention. It is a block diagram which shows the parts catalog creation function of embodiment of this invention. It is a figure which shows an example of the catalog data formed about one part. It is a functional block of the catalog preparation part of FIG. It is a figure which shows the evaluation coordinate system, an elevation angle, and an azimuth | direction angle which are given to the gaze direction selection process part from the input / output device of embodiment of this invention. It is a flowchart which shows the step which the gaze direction selection process part of embodiment of this invention selects the optimal gaze direction. It is a figure which shows a mode that the point used as the center position of parts is vertically projected on the plane of an evaluation coordinate system. It is a figure which shows the projection point which exists in the direction of an azimuth with respect to the straight line which passes along the origin of an evaluation coordinate system and is orthogonal to the direction of an azimuth about one given azimuth.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... CPU, 2 ... Memory, 3 ... Input / output device, 31 ... Model data management part, 32 ... Catalog data creation process part, 33 ... Gaze direction selection process part

Claims (4)

Model data management means for managing three-dimensional model information including part shape information representing the part shape of each part constituting the device and overall shape information representing the assembled state of each part for the three-dimensional model of the device;
Based on the plurality of gaze direction candidates input by the user and the three-dimensional model information, the gaze direction in which as many parts as possible are located in front of the plurality of gaze direction candidates is determined as the optimum gaze direction. Gaze direction selection processing means for selecting as a direction ,
And it has a,
The plurality of line-of-sight direction candidates are an evaluation coordinate system composed of three axes, an elevation angle from a plane constituted by two axes of the evaluation coordinate system, and an azimuth angle with respect to a straight line passing through the origin of the evaluation coordinate system on the plane And indicated by
The line-of-sight direction selection processing means and means for projecting the center position of each part onto the plane and the direction of the azimuth angle with a straight line passing through the origin of the evaluation coordinate system and orthogonal to the direction of the azimuth angle as a boundary. An image data processing apparatus comprising: means for counting the number of existing projection points; and means for setting the combination of the azimuth angle and the elevation angle at which the count value is the largest to the optimum line-of-sight direction . Model data management means for managing three-dimensional model information including part shape information representing the part shape of each part constituting the device and overall shape information representing the assembled state of each part for the three-dimensional model of the device An image data processing method executed by an image data processing apparatus,
The line-of-sight direction selection processing means locates as many parts as possible from among the plurality of line-of-sight direction candidates based on the plurality of line-of-sight direction candidates input by the user and the three-dimensional model information. Selecting the viewing direction as the optimal viewing direction;
Data creation processing means, using the three-dimensional model information and the optimal viewing direction, creating a part image from the viewing direction ;
And it has a,
The plurality of line-of-sight direction candidates are an evaluation coordinate system composed of three axes, an elevation angle from a plane constituted by two axes of the evaluation coordinate system, and an azimuth angle with respect to a straight line passing through the origin of the evaluation coordinate system on the plane And indicated by
The step of selecting as the optimum line-of-sight direction includes projecting the center position of each part onto the plane, and passing through the origin of the evaluation coordinate system and intersecting the straight line perpendicular to the direction of the azimuth. An image data processing method comprising the steps of: counting the number of projection points existing in a direction; and setting the combination of the azimuth angle and the elevation angle at which the count value is maximum to the optimum viewing direction . The computer program for causing to function as each means of the image data processing apparatus according to claim 1. A computer-readable recording medium on which the program according to claim 3 is recorded.

Images