JP7197875B1 - Program, image processing method and image processing apparatus - Google Patents

Abstract

An object of the present invention is to shorten the time for enlarging or reducing an image. A program causes a computer to associate an image data specifying unit 141 for specifying target image data with target image data or a pasting region based on an operation of designating target image data to be displayed in a pasting region on a screen. The size and size of the level-specific image data are obtained from a plurality of level-specific image data including the division number, which is the number of parts image data included in the level-specific image data, and a plurality of parts image data, which are stored in the storage unit 13. an image data selection unit 142 that selects one level-specific image data based on the relationship with the size of the pasting area; and a display processing unit 144 that displays one or more parts image data among the parts image data in the pasting area. [Selection drawing] Fig. 3

Description

The present invention relates to a program, an image processing method, and an image processing apparatus.

2. Description of the Related Art Conventionally, there is known an image layout device that pastes an image selected by a user onto a mount image and displays it on a display device (see, for example, Japanese Unexamined Patent Application Publication No. 2002-100000).

JP 2018-55533 A

In a conventional image layout device, it is possible to display an image pasted at a position selected by the user on a mount image on a display device. However, when the user performs an operation to enlarge or reduce the displayed image, the larger the size of the image, the longer it takes to enlarge or reduce the image. There is a problem that it takes a long time to display on the device.

Accordingly, the present invention has been made in view of these points, and it is an object of the present invention to shorten the time required for enlarging or reducing an image.

A program according to a first aspect of the present invention comprises: an image data specifying unit for specifying target image data based on an operation for specifying target image data to be displayed in a pasting area on a screen; data or a plurality of level-specific image data including a plurality of parts image data created by dividing the target image data, stored in a storage unit in association with the pasting area, wherein the level-specific image data is Based on the relationship between the size of the level-specific image data and the size of the pasting area from the plurality of level-specific image data including the number of divisions, which is the number of the parts image data, and the plurality of parts image data and one or more of the plurality of parts image data included in the selected level-specific image data, which is one level-specific image data selected by the image data selection unit. and a display processing unit that displays the parts image data in the pasting area.

The computer is further caused to function as an area specifying unit that specifies a display target area to be displayed in the pasting area in the target image data, and the display processing unit determines the plurality of parts images included in the image data classified by selection level. Of the data, the one or more parts image data corresponding to the display target area may be displayed in the pasting area.

The level-specific image data further includes pixel number data indicating the number of pixels of the level-specific image data, and the image data selection unit determines that the number of pixels indicated by the pixel number data is greater than the number of pixels of the pasting area. One level-specific image data having a ratio of the number of pixels indicated by the pixel number data to the pixel number of the pasting area within a predetermined range may be selected from the level-specific image data.

The image data specifying unit may store the image object including the plurality of level-based image data in the storage unit in association with the pasting area.

The display processing unit selects the first selection level-specific image data selected by the image data selection unit based on the relationship between the size of the level-specific image data and the size of the first pasting area for displaying the target image data. After being displayed in the first pasting area, the second selection level selected by the image data selection unit based on the relationship between the size of the second pasting area included in the first pasting area and the size of the level-specific image data Separate image data may be displayed in the second pasting area.

The display processing unit, when an enlargement ratio of the one or more parts image data displayed in the pasting region with respect to the target image data is within a predetermined range, is associated with the one or more parts image data. The image data may be superimposed on the one or more parts image data and displayed.

The image data specifying unit specifies the plurality of target image data based on an operation of specifying the plurality of target image data to be displayed in the pasting area, and the display processing unit specifies the plurality of target image data among the plurality of target image data. After displaying the one or more part image data included in the first selected level-specific image data of a predetermined level associated with the first target image data, a predetermined operation for changing the enlargement ratio for display. is received, second selection level image data including a division number different from the number of divisions included in the first selection level image data, wherein the first target image data among the plurality of target image data One or more parts image data included in the second selection level-specific image data corresponding to the associated second target image data may be displayed in the pasting area.

If the plurality of level-specific image data associated with the target image data are not stored in the storage unit, the computer is configured to store the plurality of level-specific image data based on the operation of designating the target image data. It may further function as a creating unit that creates.

When the number of pixels in the vertical direction and the number of pixels in the horizontal direction of the target image data are 2 ^j (j is a natural number), the creation unit divides the target image data into 4 ^k (k is a natural number) pieces. and the plurality of level-specific image data having different values of k may be created.

When either the number of pixels in the vertical direction or the number of pixels in the horizontal direction of the target image data is not 2 ^j (j is a natural number), the creation unit sets the number of pixels in the vertical direction to 2 ^m (m is a natural number). and by dividing the image data to which pixels are added so that the number of pixels in the horizontal direction is 2 ⁿ (n is a natural number) into 4 ^k pieces, the plurality of level-specific image data each having a different value of k are created. You may

The creation unit may create the plurality of parts image data included in the plurality of level-specific image data by dividing the image data obtained by excluding an area within a predetermined range from the outer periphery of the target image data. good.

The creation unit converts the pasting area on which the one or more part image data is displayed into target image data having the same size as the pasting area, and the plurality of level-specific image data corresponding to the target image data. You may create an image object containing

The creation unit determines the maximum number of divisions based on the number of pixels of the target image data, and divides the target image data by a plurality of division numbers equal to or smaller than the maximum number of divisions, thereby The plurality of parts image data included in the plurality of level-based image data corresponding to a plurality of division numbers may be created.

An image processing method according to a second aspect of the present invention includes a step of specifying target image data based on an operation of specifying target image data to be displayed in a paste area on a screen; A plurality of level-specific image data including a plurality of parts image data created by dividing the target image data associated with an area, wherein the level-specific image data includes the number of the parts image data. One level-specific image data is selected from the plurality of level-specific image data including the number of divisions and the plurality of parts image data based on the relationship between the size of the level-specific image data and the size of the pasting area. and displaying at least one parts image data among the plurality of parts image data included in the selected level-specific image data, which is the one level-specific image data, in the pasting area.

An image processing apparatus according to a third aspect of the present invention includes an image data specifying unit for specifying target image data based on an operation for specifying target image data to be displayed in a pasting area on a screen; or a plurality of level-specific image data including a plurality of parts image data created by dividing the target image data, stored in a storage unit in association with the pasting area, wherein the level-specific image data includes Based on the relationship between the size of the level-specific image data and the size of the pasting area, from the plurality of level-specific image data including the division number, which is the number of the parts image data, and the plurality of parts image data an image data selection unit that selects one level-specific image data; and a display processing unit that displays the parts image data in the pasting area.

According to the present invention, there is an effect of shortening the time required for enlarging or reducing an image.

1 is a diagram for explaining an overview of an image processing apparatus 1 according to this embodiment; FIG. 4A and 4B are diagrams for explaining an operation of displaying an image by the image processing apparatus 1; FIG. 1 is a diagram showing a configuration of an image processing apparatus 1; FIG. 4 is a diagram showing an example of a parts image database stored in a storage unit 13; FIG. It is a figure for demonstrating a parts image area. FIG. 10 is a diagram for explaining an operation of displaying an enlarged image; FIG. It is a figure for demonstrating the operation|movement which displays a 1st sticking area|region and a 2nd sticking area|region. FIG. 10 is a diagram for explaining the operation of displaying related image data; FIG. 10 is a diagram for explaining an operation of displaying image data classified by second selection level; This is division number information for determining the maximum division number. 4 is a flowchart showing the flow of processing in the image processing apparatus 1; FIG. 11 is a diagram for explaining an outline of an image processing device 1 according to a third modified example;

<Overview of Image Processing Apparatus 1>
FIG. 1 is a diagram for explaining an overview of an image processing apparatus 1 according to this embodiment. The image processing apparatus 1 is a terminal having a display for displaying images, such as a smart phone, tablet, or personal computer. The image processing apparatus 1 may be connected to an external display device (not shown) having a display via a digital interface such as HDMI (High-Definition Multimedia Interface) (registered trademark).

A dedicated application program (hereinafter referred to as “dedicated application”) for displaying an image on the display is installed in the image processing apparatus 1 . Through the dedicated app, the user can select the image to be superimposed on the mount on the display, specify the area to display the image, and specify the size of the image to be displayed on the display. .

As shown in FIG. 1, the image processing apparatus 1 stores an image object database and a board database. The image object database includes a plurality of image objects D (D1 to D3 in FIG. 1), and each of the plurality of image objects D includes original image data, image information and parts image database.

The original image data is image data in which pixels are not thinned out or compressed among the plurality of image data registered in the image object database, and is data indicating pixel values of each of the plurality of pixels. The image information includes, for example, the file name of the original image data and information on the size of the original image data (for example, the number of pixels).

The parts image database includes a plurality of levels of image data corresponding to the original image data. A plurality of level-specific image data corresponding to one original image data is created based on one original image data, but each has a different number of pixels. The level-specific image data includes a plurality of parts image data created by dividing the original image data. The level-specific image data includes the division number, which is the number of parts image data included in the level-specific image data, and the plurality of parts image data. The level-specific image data may further include pixel number data indicating the number of pixels of the parts image data included in the level-specific image data. Details of the parts image database, level-specific image data, and parts image data will be described later with reference to FIG.

The mount database includes a plurality of mount image data B (mount image data B1 and B2 in FIG. 1) for pasting image data. Pasting the image data onto the mount image data means associating the image data with the mount image database. The display window is a window for displaying the image data pasted on the mount image data so as to be superimposed on the mount image data on the display.

When the user selects an image to be superimposed and displayed on the board on the screen of the display, the image processing apparatus 1 identifies level-specific image data corresponding to the image. If the parts image database does not contain level-specific image data corresponding to the image, the image processing apparatus 1 creates level-specific image data based on the original image data of the selected image.

When the image processing apparatus 1 accepts an operation of pasting image data on the mount image data and displaying it from the user, the image processing apparatus 1 superimposes the part image data included in the image object D corresponding to the image data on the mount image data on the display. display. In FIG. 1, the image processing apparatus 1 superimposes the parts image data included in the image object D1 and the image object D2 on the mount image data B1 and displays the parts image data included in the image object D3 as the mount image data B2. are superimposed on the Details of the pasting process and the display process will be described later.

FIG. 2 is a diagram for explaining the operation of displaying an image by the image processing apparatus 1. As shown in FIG. The mount space is an area where the part image data is pasted in the mount image data. The display space is a display area on the screen of the display, for example, a window area set by the user via a dedicated application.

The image processing apparatus 1 prepares original image data (hereinafter referred to as "target image data") to be pasted on mount image data, mount image data to which target image data is to be pasted, and mount image data for target image data in a display area. An operation to designate an area to be pasted (hereinafter referred to as a "pasting area") is accepted. The image processing apparatus 1 identifies the image object D corresponding to the target image data designated by the user by referring to the image object database shown in FIG. The image processing apparatus 1 identifies the mount image data B specified by the user by referring to the mount database shown in FIG.

Subsequently, the image processing apparatus 1 identifies an area for displaying the target image data in the mount space of the identified mount image data B based on the pasting area specified by the user in the display area. The image processing device 1 selects level-specific image data corresponding to the number of pixels in the identified region by referring to the parts image database. The image processing apparatus 1 displays the parts image data included in the selected level-specific image data so as to be superimposed on the mount image data ((1) shown in FIG. 2).

The image processing device 1 displays the parts image data superimposed on the base sheet image data in the pasting regions (the pasting regions C1 and C2 in FIG. 2) specified by the user in the display space ((2) shown in FIG. 2). . By operating the image processing device 1 in this manner, the image processing device 1 can display parts image data corresponding to the size of the pasting area on the display. As a result, the image processing apparatus 1 can display the target image data in the pasting area without executing processing for enlarging or reducing the target image data to the size specified by the user. It is possible to shorten the time until it is displayed.
The configuration and operation of the image processing apparatus 1 will be described in detail below.

<Configuration of Image Processing Apparatus 1>
FIG. 3 is a diagram showing the configuration of the image processing apparatus 1. As shown in FIG. The image processing device 1 has an input unit 11 , a display unit 12 , a storage unit 13 and a control unit 14 .

The input unit 11 is an input device for receiving input operations from the user of the image processing apparatus 1, such as a keyboard, touch panel, mouse, joystick, or microphone. The input unit 11 performs, for example, an operation of registering a plurality of original image data in an image object database, an operation of pasting original image data (i.e., target image data) selected by the user from among the plurality of original image data to mount image data, An input operation such as an operation for enlarging or reducing the size of target image data is accepted from the user. The display unit 12 is a display device for displaying image data, such as a display.

The storage unit 13 has a storage medium such as a ROM (Read Only Memory), a RAM (Random Access Memory), an HDD (Hard Disk Drive), or an SSD (Solid State Drive). The storage unit 13 stores programs executed by the control unit 14 . The storage unit 13 also stores image data, mount image data, and data used for executing various processes based on the image data or the mount image data.

The storage unit 13 stores, in a database, various kinds of information used for displaying the target image data pasted on the mount image data. The storage unit 13 stores, for example, the mount image data B in the mount database. The storage unit 13 includes, for example, original image data (that is, target image data) or a pasting area, image information of the original image data, and a parts image database containing a plurality of level-based image data corresponding to the original image data. An image object D is stored in the image object database.

FIG. 4 is a diagram showing an example of the parts image database stored in the storage unit 13. As shown in FIG. In the parts image database shown in FIG. 4, the original image data name, the level-specific image data ID that is level-specific image data identification information for identifying the level-specific image data, the number of divisions, the number of pixels, the parts image data name and the parts Image regions are associated.

The original image data name is the file name of the original image data, and the control section 14 can access the original image data stored in the storage section 13 by designating the original image data name. The number of divisions is the number of parts image data constituting each of the plurality of level-specific image data. The number of pixels is the number of pixels of the level-specific image data. The parts image data name is the file name of the parts image data, and the control unit 14 can access the parts image data by designating the parts image data name. The parts image area is information indicating the area of each parts image data in the original image data.

FIG. 5 is a diagram for explaining the parts image area. FIG. 5A shows four parts image data "P102" (P102-1 to P102- 4) shows the parts image area. FIG. 5B shows 16 parts image data "P103" (P103-1 to P103- 16) shows the parts image area.

As shown in FIG. 5A, the parts image area of each of the four pieces of parts image data "P102" is represented by a combination of horizontal addresses x1 to x2 and vertical addresses y1 to y2. The four parts image data "P102" have the same number of pixels, which is 250,000 pixels obtained by dividing 1,000,000 pixels, which is the number of pixels of the level-specific image data "L102" shown in FIG. As shown in FIG. 5B, the parts image area of each of the 16 pieces of parts image data "P103" is represented by a combination of horizontal addresses x1 to x4 and vertical addresses y1 to y4. The 16 pieces of parts image data "P103" have the same number of pixels, which is 250,000 pixels obtained by dividing 4,000,000 pixels, which is the number of pixels of the level-specific image data "L103" shown in FIG.

The control unit 14 is, for example, a CPU (Central Processing Unit) or a GPU (Graphical Processing Unit). The control unit 14 functions as at least one of the image data specifying unit 141, the image data selecting unit 142, the area specifying unit 143, the display processing unit 144, and the creating unit 145 by executing the programs stored in the storage unit 13. do. The control unit 14 may execute the functions of all these constituent units, or may execute the functions of some of these constituent units.

The configuration of each unit implemented by the control unit 14 will be described below.
The image data specifying unit 141 specifies the target image data based on the operation of specifying the target image data to be displayed in the paste area on the screen of the display. The image data specifying unit 141 may specify a plurality of target image data based on an operation of specifying a plurality of target image data to be displayed in the pasting area. The pasting area is an area of the mount image, an area of the mount image displayed on the display, or an area selected by the user in the mount image area. The target image data is original image data selected by the user from a plurality of original image data.

For example, the image data specifying unit 141 selects a file name of an image to be pasted on the mount image or accepts an operation of pasting an image on the mount image from the input unit 11 by the user. The original image data (that is, the target image data) to be processed is specified. The image data specifying unit 141 specifies the target image data associated with the file name of the image selected by the user, for example, by referring to the plurality of original image data stored in the storage unit 13 .

For example, the image data specifying unit 141 causes the storage unit 13 to store an image object D including a plurality of levels of image data in association with the pasting area. The image data specifying unit 141, for example, stores information indicating an area selected by the user in the pasting area (for example, coordinate information indicating the area selected by the user) and an image object D corresponding to the target image data selected by the user. They are stored in the storage unit 13 in association with each other.

The image data selection unit 142 selects a plurality of level-specific image data included in the image object D stored in the storage unit 13 in association with the pasting area, based on the relationship between the size of the level-specific image data and the size of the pasting area. One image data by level (that is, image data by selected level) is selected. The size of the level-specific image data and the size of the pasting area are information represented by, for example, the number of pixels or data obtained by encoding the number of pixels. The image data selection unit 142 selects a plurality of level-specific image data included in the image object D stored in the storage unit 13 in association with the target image data, based on the relationship between the size of the level-specific image data and the size of the pasting area. You may select one level-specific image data by using the

The image data selection unit 142 specifies, for example, one or more levels of image data in which the number of pixels indicated by the pixel number data of the level of image data is larger than the number of pixels of the pasting area. The image data selection unit 142 selects one level-specific image data whose ratio of the number of pixels indicated by the pixel number data to the pixel number of the pasting area is within a predetermined range from among the specified one or more level-specific image data. Select as image data. The predetermined range is, for example, a range in which the ratio of the number of pixels indicated by the pixel number data to the number of pixels in the pasting area is smaller than 1:4.

As an example, assume that the image data selection unit 142, which has received an operation to display part or all of the target image data in the mount space in the paste area, specifies that the number of pixels in the paste area is 500,000 pixels. . In this case, the image data selection unit 142 refers to the "number of pixels" shown in FIG. Identify.

Subsequently, the image data selection unit 142 selects, among the specified plurality of level-specific image data, the level-specific image data in a range in which the number of pixels of the level-specific image data to the number of pixels of the pasting area (500,000 pixels) is smaller than 1:4. "L102", which is image data (that is, image data by level indicating the number of pixels smaller than 2,000,000 pixels), is selected as image data by selection level.

By operating the image data selection unit 142 in this way, the image data selection unit 142 can select the level-specific image data according to the size of the pasting area. Further, it is possible to select level-specific image data such that the pasting area is displayed using four or less parts image data among a plurality of parts image data. As a result, the image data selection unit 142 can make the data amount of the image data acquired by the display processing unit 144 to be displayed in the pasting area smaller than the data amount of the target image data, thereby increasing the display speed. can be

Note that the image data selection unit 142 causes the creation unit 145 to create the level image data when the storage unit 13 does not store the level image data associated with the target image data. The details of the process of creating the level-specific image data by the creating unit 145 will be described later.

The region specifying unit 143 specifies a region in which an image based on the parts image data included in the level-specific image data is to be displayed. The region specifying unit 143 obtains from the input unit 11 the content of the operation for designating the pasting region selected by the user in the display space shown in FIG. Identify. The area specifying unit 143 specifies the specified area of the target image data displayed superimposed on the mount image data as the display target area. The area specifying unit 143 notifies the display processing unit 144 of the specified display target area. By specifying the display target region by the region specifying unit 143, the display processing unit 144 can select parts image data corresponding to the display target region from a plurality of parts image data associated with the target image data.

The user may want to enlarge and display a partial area of the target image data. In this case, the user can, for example, perform an operation to select a partial area of the displayed target image data, perform an operation to enlarge the paste area, or input an enlargement ratio to enlarge the image. can be done. When an enlargement operation is performed, the area specifying unit 143 specifies a display target area to be displayed in the pasting area in an enlarged state from the target image data. The area specifying unit 143 specifies, for example, an area included in the pasting area after enlargement among the areas of the image indicated by the target image data specified by the image data specifying unit 141 .

The display processing unit 144 displays one or more parts image data among a plurality of parts image data included in the selected level-specific image data, which is one level-specific image data selected by the image data selection unit 142, in the pasting area. The display processing unit 144 identifies one or more parts image data included in the image data by selection level by referring to the "parts image data name" shown in FIG. 4, for example, and displays it in the pasting area.

Since the display processing unit 144 operates in this way, it is possible to display the parts image data corresponding to the size of the pasting area. It is possible to acquire and display the image data in the pasting area without performing the process of reducing or enlarging the image data at that time. As a result, the display processing unit 144 can shorten the time from when the user designates the pasting area to when the image is displayed in the pasting area. Such an operation of the display processing unit 144 is suitable when the size of the pasting area is smaller than the size of the target image data (that is, when the target image data is displayed with a large magnification ratio).

For example, when the user performs an operation to enlarge an image, the display processing unit 144 selects one or more parts image data corresponding to the display target area specified by the area specifying unit 143 from among the plurality of parts image data included in the image data classified by selection level. is displayed in the pasting area. The display processing unit 144 identifies one or more parts image data included in the display target area, for example, by referring to the "parts image area" shown in FIG. 4, and displays it in the pasting area.

FIG. 6 is a diagram for explaining the operation of displaying an enlarged image. FIG. 6(a) shows a screen displaying an image before enlargement, and FIG. 6(b) shows a screen displaying an enlarged image. In FIG. 6A, four parts image data "P102" included in the level-specific image data "L102" shown in FIG. Area A is an area designated by the user in the operation of enlarging the image, and corresponds to one of the areas obtained by dividing the parts image data "P102-2" shown in FIG. 5 into four areas. 6(b), an enlarged image of the area A shown in FIG. 6(a) is displayed in the pasting area C. In FIG.

First, as shown in FIG. 6A, the display processing unit 144 selects four parts image data included in the level-specific image data “L102” selected by the image data selection unit 142 based on the size of the pasting area C. "P102" is displayed in the pasting area C.

Subsequently, when the user performs an operation to enlarge and display the area A, the image data selection unit 142 selects the level-specific image data " L103”. The region identifying unit 143 refers to the “parts image region” shown in FIG. 5 to select the parts image data “P103 -8”. The display processing unit 144 causes the parts image data "P103-8" to be displayed in the pasting area C, as shown in FIG. 6(b).

With the display processing unit 144 operating in this way, when the user performs an operation to enlarge or reduce a part of the image, the display processing unit 144 can display parts image data corresponding to the size and area specified by the user. can be displayed in the pasting area in a short time. As a result, the display processing unit 144 enlarges or reduces the target image data and displays the time from when the user designates a part of the image until the area designated by the user is displayed in the pasting area. can be shorter than

By the way, the user may want to display a selected image and an enlarged image obtained by enlarging a part of the image on the same screen. Specifically, this is a case where, while browsing the map image displayed in the pasting area, a part of the map image is enlarged and browsed. Therefore, the display processing unit 144 displays an image (for example, a map image) displayed in the first pasting area and an image (for example, a partial image of the map image) displayed in the second pasting area included in the first pasting area. , may be displayed on the same screen.

The display processing unit 144 selects the first selection level image data selected by the image data selection unit 142 based on the relationship between the size of the level-specific image data and the size of the first paste area for displaying the target image data. display in the area. Subsequently, the display processing unit 144 selects the second selection level image data selected by the image data selection unit 142 based on the relationship between the size of the second pasting area included in the first pasting area and the size of the level image data. is displayed in the second pasting area.

FIG. 7 is a diagram for explaining the operation of displaying the first pasting area and the second pasting area. FIG. 7A is a diagram showing image data classified by first selection level displayed in the first pasting area C1. FIG. 7B is a diagram showing image data by first selection level displayed in the first pasting area C1 and image data by second selection level displayed in the second pasting area C2. The image data for each second selection level shown in FIG. 7B is an image obtained by enlarging and displaying the area A shown in FIG. 7A.

As shown in FIG. 7A, the display processing unit 144 displays the first selection level image data selected by the image data selection unit 142 in the first pasting area C1. Subsequently, as shown in FIG. 7B, the display processing unit 144 selects image data by second selection level selected by the image data selection unit 142 based on the size of the second pasting area C2 and the size of the area A. is displayed in the second pasting area C2.

For example, if the first selection level-specific image data is the level-specific image data "L102" shown in FIG. 4, the second selection level-specific image data is the level-specific image data "L103" or "L104" shown in FIG. be. The display processing unit 144 causes the parts image data corresponding to the display target area specified by the area specifying unit 143 among the plurality of parts image data included in the image data classified by the second selection level to be displayed in the pasting area C2.

By the display processing unit 144 operating in this manner, the display processing unit 144 can display level-specific image data with different numbers of divisions associated with the same target image data in each of the plurality of pasting regions. As a result, the user can view the original image data and start viewing a part of the original image data in detail in a short period of time.

When the magnification ratio of the target image data displayed on the display is within a predetermined range, the user may want to display other information that is different from the target image data in a superimposed manner. Specifically, I want to display a group photo generated by taking a picture of a place where many people have gathered, and display the nameplates of the displayed people overlaid when displaying them at an enlargement ratio that allows the faces of the people to be identified. It is a case of thinking. Therefore, when the enlargement ratio of the one or more parts image data displayed in the pasting area with respect to the target image data is within a predetermined range, the display processing unit 144 sets the image data associated with the one or more parts image data. (hereinafter referred to as "related image data") is superimposed on one or more parts image data and displayed. The enlargement ratio is, for example, a value obtained by dividing the number of pixels of the target image data (that is, the number of pixels of the part image data whose division number is 1) by the number of pixels of the pasting area.

The display processing unit 144 receives from the user, for example, an area in which the related image data is displayed and a range of magnification of the parts image data when displaying the related image data, and associates them with the target image data. The associated image data is stored in the storage unit 13 and can be associated with the parts image data by the user operating the image processing device 1 . The related image data may be original image data registered in the image object database, or may be image data not registered in the image object database.

FIG. 8 is a diagram for explaining the operation of displaying related image data. FIG. 8(a) shows a pasting area C in which related image data is not superimposed and displayed, and FIG. 8(b) shows a pasting area C in which related image data is superimposed and displayed. The image of the pasting area C shown in FIG. 8(b) is an enlarged image of the area A shown in FIG. 8(a). Image N1 and image N2 shown in FIG. 8B are related image data associated with parts image data representing person P1 and person P2.

In FIG. 8A , the display processing unit 144 divides the number of pixels of the parts image data whose division number is 1 by the number of pixels of the pasting area C, thereby increasing the enlargement ratio of the parts image data displayed in the pasting area C. Identify. When the display processing unit 144 determines that the specified magnification is not within the predetermined range set by the user, the display processing unit 144 causes the display to display the related image data without displaying it.

On the other hand, in FIG. 8B, the display processing unit 144 identifies that the magnification of the parts image data displayed in the pasting area C is within a predetermined range. The display processing unit 144 causes the image N1 and the image N2, which are related image data associated with the parts image data displayed in the pasting area C, to be superimposed on the parts image data.

By operating the display processing unit 144 in this way, the display processing unit 144 can display the parts image data within a predetermined magnification range and the image data associated with the parts image data in an overlapping manner. can. As a result, the display processing unit 144 can superimpose and display other image data set by the user according to the enlargement ratio of the target image data.

Furthermore, when the target image data displayed on the display has a predetermined enlargement rate, the user may want to display other target image data different from the displayed target image data in the pasting area. One example is displaying an image of an animal's skeleton, muscles, or internal organs by enlarging the image of the animal.

Therefore, when the display processing unit 144 receives an operation for changing the enlargement ratio of the first target image data to a predetermined enlargement ratio after displaying the parts image data obtained by dividing the first target image data, Part image data obtained by dividing the second target image data associated with the first target image data is displayed. The second target image data is original image data associated with the first target image data by the user operating the image processing apparatus 1, and is associated with the image information of the second target image data and the parts image database. stored in the object database.

The display processing unit 144, for example, after displaying one or more parts image data included in the first selection level-specific image data of a predetermined level associated with the first target image data among the plurality of target image data, Receives a predetermined operation for changing the enlargement ratio for display. In this case, the display processing unit 144 selects the second selection level image data including the division number different from the division number included in the first selection level image data, which is the first target image data among the plurality of target image data. one or more parts image data included in the second selection level-specific image data corresponding to the second target image data associated with is displayed in the pasting area. By operating the image processing apparatus 1, the user can designate image data of a predetermined level for each first selection level, or set a predetermined operation for changing the enlargement ratio.

FIG. 9 is a diagram for explaining the operation of displaying the image data classified by the second selection level. FIG. 9A is a diagram showing first target image data Q1 representing the appearance of an animal and second target image data Q2 representing the skeleton of the animal. The storage unit 13 stores first target image data Q1 and second target image data Q2. FIG. 9(b) is a diagram showing parts image data included in the first selection level-specific image data. FIG. 9(c) is a diagram showing image data classified by the second selection level.

First, the display processing unit 144 causes the parts image data included in the first selection level-specific image data associated with the first target image data Q1 to be displayed in the pasting area C, as shown in FIG. 9B. Subsequently, when receiving an operation for changing the enlargement ratio for displaying the pasting region C to within a predetermined range, the display processing unit 144 performs the following operations as shown in FIG. The part image data included in the second selection level-specific image data corresponding to the 2 target image data is displayed in the pasting area C.

With the display processing unit 144 operating in this manner, the display processing unit 144 can display other target image data associated with the target image data when displaying the pasting area at the enlargement ratio specified by the user. can be done. As a result, the user can create image content that combines, for example, an image of the exterior of the subject and an image of the interior of the subject.

[Creating level-specific image data]
The creation unit 145 creates a plurality of level-specific image data when the plurality of level-specific image data associated with the target image data are not stored in the storage unit 13 based on the operation of designating the target image data. . For example, by referring to the image object database shown in FIG. Create image data. The creation unit 145 creates a plurality of level-specific image data by creating a plurality of parts image data obtained by dividing the target image data by a plurality of division numbers, and stores them in the storage unit 13 .

For example, the creating unit 145 determines the maximum number of divisions based on the number of pixels of the target image data, and divides the target image data by a plurality of division numbers equal to or less than the maximum number of divisions, thereby obtaining a plurality of divisions. Create a plurality of parts image data included in a plurality of level-based image data corresponding to the number.

FIG. 10 shows division number information for determining the maximum division number. The division number information shown in FIG. 10 is stored in the storage unit 13, and is associated with the number of levels, the number of divisions, and the number of pixels of the target image data. The number of divisions is the number of parts image data created by dividing the target image data. The number of levels is the number of level-specific image data, and is determined by the size of the target image data (for example, the number of pixels).

Specifically, when the number of pixels of the target image data is 12 million pixels, the creation unit 145 refers to the “number of pixels of target image data” and the “number of levels” shown in FIG. Specifies that separate image data should be created. The creation unit 145 identifies that the maximum value of the number of divisions of the target image data is 64 by referring to the "number of divisions" shown in FIG. The creation unit 145 creates level-specific image data corresponding to level 4, including 64 parts image data generated by dividing the target image data into 64 pieces and information indicating that the number of divisions is 64. do.

Subsequently, the creating unit 145 divides the first reduced image data generated by reducing the target image data into 16 pieces of image data, and generates 16 parts image data, and information indicating that the number of divisions is 16. Create level-specific image data corresponding to level 3, including The first reduced image data is, for example, image data created by thinning out some pixels such that the number of pixels in the vertical direction and the number of pixels in the horizontal direction of the target image data are halved.

Further, the creation unit 145 indicates four parts image data generated by dividing the second reduced image data generated by further reducing the first reduced image data into four and that the number of divisions is four. Level-by-level image data corresponding to level 2 is created, including information. Similarly, the creation unit 145 creates level-specific image data corresponding to level 1 . By creating the parts image data by the creation unit 145 in this way, the creation unit 145 can create a plurality of level-specific image data suitable for the number of pixels of the target image data.

For example, when the number of pixels in the vertical direction and the number of pixels in the horizontal direction of the target image data are 2 ^j (j is a natural number), the creation unit 145 divides the target image data into 4 ^k (k is a natural number) pieces. A plurality of level-specific image data with different values of k are created. Specifically, the creating unit 145 determines that the number of pixels in the vertical direction of the target image data specified by the image data specifying unit 141 is 2048 (ie, 2 ¹¹ ) and the number of pixels in the horizontal direction is 4096 (ie, 2 ¹² ). ). In this case, the creation unit 145 creates a plurality of level-specific image data obtained by dividing the target image data into 4, 16, and 64, respectively. When the creating unit 145 creates the level-specific image data in this way, the creating unit 145 can equalize the number of pixels in the vertical direction and the number of pixels in the horizontal direction for each of the plurality of parts image data.

If either the number of pixels in the vertical direction or the number of pixels in the horizontal direction of the target image data is not 2 ^j (j is a natural number), the creation unit 145 sets the number of pixels in the vertical direction to 2 ^m (m is a natural number), In addition, image data is created by adding pixels so that the number of pixels in the horizontal direction is 2 ⁿ (n is a natural number). The creation unit 145 creates a plurality of level-specific image data with different values of k by dividing the created image data into 4 ^k pieces. For example, when the creation unit 145 specifies that at least one of the number of pixels in the vertical direction and the number of pixels in the horizontal direction of the target image data specified by the image data specifying unit 141 is not 2 ^j (j is a natural number), 4 ^k image data obtained by adding pixels so that the number of pixels in the vertical direction is 2 ^m (m is a natural number) and the number of pixels in the horizontal direction is 2 ⁿ (n is a natural number) around the outer periphery of the target image data. split into pieces.

The pixels that the creation unit 145 adds to the outer circumference of the target image data are, for example, pixels on the outer circumference of the target image data, pixels of a single color such as white or black, or pixels around an area in which the target image data is superimposed and displayed in the mount image data. is a pixel included in the area of . When the creating unit 145 creates image data in this way, the creating unit 145 can create a plurality of parts having the same number of pixels in the vertical direction and the number of pixels in the horizontal direction regardless of the size of the target image data. Image data can be created.

When captured image data generated by an image captured by a camera is target image data, brightness near the periphery of the target image data may be lower than brightness near the center of the target image data due to vignetting. In such a case, the user does not want to display the vicinity of the outer circumference of the target image data. On the other hand, the creation unit 145 creates a plurality of parts image data included in a plurality of level-specific image data by dividing the image data obtained by excluding an area within a predetermined range from the outer circumference of the target image data. may The area within the predetermined range is, for example, 10% of the number of pixels in the vertical and horizontal directions, and can be set by the user operating the image processing apparatus 1 .

With the creation unit 145 operating in this manner, the creation unit 145 can create an area that is darker than the area near the center due to limb darkening when the captured image data generated by the camera is the target image data. It is possible to create a plurality of parts image data excluding .

By the way, the user may want to display the mount image data displayed in the pasting area as target image data on other mount image data. On the other hand, the creation unit 145 selects the pasting area in which one or more parts image data is displayed as a target having the same size as the pasting area (i.e., the number of pixels in the vertical direction and the number of pixels in the horizontal direction of the pasting area). Image data is converted into image data, and an image object D including a plurality of level-based image data corresponding to the target image data is created. For example, upon receiving an operation from the user to designate the mount image data as the target image data, the creating unit 145 creates an image object D using the mount image data as the target image data.

With the creation unit 145 operating in this manner, the display processing unit 144 can display image data larger than the conventional image data by enlarging or reducing the image data to the size displayed by the display processing unit 144. can be displayed using level-specific image data suitable for As a result, the display processing unit 144 can shorten the time until the image is displayed even if the target image data becomes large.

<Flow of Processing in Image Processing Apparatus 1>
FIG. 11 is a flow chart showing the flow of processing in the image processing apparatus 1. As shown in FIG. The flowchart shown in FIG. 11 shows the operation from when the image processing apparatus 1 receives designation of the target image data and the paste area to when the target image data is displayed in the paste area.

The image data specifying unit 141 receives designation of target image data and a pasting area from the input unit 11 (S1). The image data specifying unit 141 specifies the target image data received from the input unit 11 by referring to the image object database shown in FIG. 1 (S2).

If the level-specific image data associated with the specified target image data cannot be identified (NO in S3), that is, if the level-specific image data is not stored in the storage unit 13, the creation unit 145 creates a plurality of level-specific image data. Image data is created (S4). If the level-specific image data associated with the specified target image data can be identified (YES in S3), that is, if the level-specific image data associated with the target image data is stored in the storage unit 13, the creation The unit 145 does not create level-specific image data.

The image data selection unit 142 identifies the number of pixels in the pasting area received by the image data identification unit 141 from the input unit 11 (S5). The image data selection unit 142 selects one level-specific image data (i.e., selection level-specific image data) based on the number of pixels in the specified pasting area and the number of pixels in the level-specific image data associated with the target image data. Select (S6).

The area specifying unit 143 specifies a display target area to be displayed in the pasting area in the target image data (S7). Based on the display target area specified by the area specifying unit 143 and the "parts image area" shown in FIG. Part image data to be displayed is specified (S8). The display processing unit 144 displays the identified parts image data in the pasting area (S9).

The image processing apparatus 1 repeats the processes from S1 to S9 when an operation to end the process has not been performed (NO in S10). The image processing apparatus 1 ends the process when an operation to end the process is performed (YES in S10).

<First modification>
In the above description, the image processing apparatus 1 shows the operation of displaying the target image data in the paste area of the mount image data, but the present invention is not limited to this. The image processing apparatus 1 may display other mount image data specified by the user in the paste area of the mount image data. One or more target image data may be displayed as other mount image data.

<Second modification>
In the above description, the image processing device 1 shows the operation of displaying the pasting area on the display unit 12 such as a display, but the present invention is not limited to this. The image processing apparatus 1 may store the parts image data displayed in the pasting area in the storage unit 13 as an image file, or may transmit the data to a printing device such as a printer for printing.

<Third modification>
In the above description, the image processing apparatus 1 identifies an area in which the target image data is displayed in the mount space of the mount image data B, and superimposes the part image data corresponding to the number of pixels in the identified area on the mount image data B. Thus, the operation of displaying the parts image data superimposed on the mount image data B on the display window has been shown, but the present invention is not limited to this. The image processing apparatus 1 creates a mount object by superimposing the part image data on the mount image data B, and then creates a paper object including display image data generated by enlarging or reducing the mount object. Data may be displayed in a display window.

FIG. 12 is a diagram for explaining an outline of the image processing device 1 according to the third modification. The image processing apparatus 1 identifies an area in which the target image data is displayed in the board space of the board image data B1 based on the pasting area specified by the user in the display area. By referring to the parts image database included in the image object, the image processing apparatus 1 creates a mount object in which the parts image data included in the level-specific image data corresponding to the number of pixels in the specified area is superimposed on the mount image data B1. ((1) shown in FIG. 12).

The image processing apparatus 1 creates mount paper, which is display image data obtained by reducing the created mount object ((2) shown in FIG. 12). The image processing apparatus 1 creates partially enlarged paper, which is display image data obtained by enlarging a part of the mount object (area A1 in FIG. 12) ((3) in FIG. 12). The image processing apparatus 1 displays the mount paper in the area specified by the user in the display window (that is, the display area) ((4) shown in FIG. 12). The image processing apparatus 1 displays the partially enlarged paper in the area designated by the user in the display area ((5) shown in FIG. 12).

Note that the image processing apparatus 1 uses display image data such as mount paper or partial enlargement paper included in the paper object to create an image object D4 including a plurality of level-specific image data corresponding to the display image data. ((6) shown in FIG. 12).

<Effect of image processing apparatus 1>
As described above, the image processing apparatus 1 executes the program stored in the storage unit 13 to perform image data specification for specifying the target image data based on the operation of specifying the target image data to be displayed in the pasting area. and an image data selection unit 142 that selects one level-specific image data from among a plurality of level-specific image data associated with the target image data based on the size of the pasting area.

Then, the display processing unit 144 causes one or more parts image data out of the plurality of parts image data included in the level-specific image data selected by the image data selection unit 142 to be displayed in the pasting area. By operating the image processing apparatus 1 in this manner, parts image data corresponding to the size of the pasting area specified by the user is displayed. can be made Furthermore, it is possible to display the target image data without enlarging or reducing the size of the pasting area specified by the user. As a result, the image processing apparatus 1 can shorten the time for displaying the target image data.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist thereof. be. For example, all or part of the device can be functionally or physically distributed and integrated in arbitrary units. Further, new embodiments resulting from arbitrary combinations of multiple embodiments are also included in the embodiments of the present invention. The effect of the new embodiment caused by the combination has the effect of the original embodiment.

1 image processing device 11 input unit 12 display unit 13 storage unit 14 control unit 141 image data identification unit 142 image data selection unit 143 area identification unit 144 display processing unit 145 creation unit

Claims (15)

the computer,
an image data specifying unit for specifying target image data based on an operation for specifying target image data to be displayed in a pasting area on a screen;
A plurality of level-specific image data including a plurality of parts image data created by dividing the target image data, stored in a storage unit in association with the target image data or the pasting region, wherein the level-specific image data The size of the level-specific image data and the size of the pasting area are obtained from the plurality of level-specific image data including the number of divisions, which is the number of the parts image data included in the image data, and the plurality of parts image data. an image data selection unit that selects one level-specific image data based on the relationship;
a display processing unit configured to display, in the attachment area, one or more parts image data among the plurality of parts image data included in the selected level-based image data, which is one level-based image data selected by the image data selection unit;
A program to function as said computer,
Further functioning as an area specifying unit for specifying a display target area to be displayed in the pasting area among the target image data,
The display processing unit causes the one or more parts image data corresponding to the display target area among the plurality of parts image data included in the selection level-specific image data to be displayed in the pasting area.
A program according to claim 1. The level-specific image data further includes pixel number data indicating the number of pixels of the level-specific image data,
The image data selection unit selects one or more of the level-specific image data whose number of pixels indicated by the pixel number data is larger than the number of pixels of the pasting area, and selects pixels indicated by the pixel number data with respect to the number of pixels of the pasting area. selecting one level-specific image data whose number ratio is within a predetermined range;
3. A program according to claim 1 or 2. The image data specifying unit stores the image object including the plurality of level-specific image data in the storage unit in association with the pasting area.
A program according to claim 1. The display processing unit selects the first selection level-specific image data selected by the image data selection unit based on the relationship between the size of the level-specific image data and the size of the first pasting area for displaying the target image data. After being displayed in the first pasting area, the second selection level selected by the image data selection unit based on the relationship between the size of the second pasting area included in the first pasting area and the size of the level-specific image data displaying another image data in the second pasting area;
A program according to claim 1. The display processing unit, when an enlargement ratio of the one or more parts image data displayed in the pasting region with respect to the target image data is within a predetermined range, is associated with the one or more parts image data. displaying the image data superimposed on the one or more parts image data;
A program according to claim 1. The image data specifying unit specifies the plurality of target image data based on an operation of specifying the plurality of target image data to be displayed in the pasting area,
After the display processing unit displays the one or more parts image data included in the first selection level-specific image data of a predetermined level associated with the first target image data among the plurality of target image data, second selection level image data including a division number different from the number of divisions included in the first selection level image data, when a predetermined operation for changing the enlargement ratio at the time of display is received; displaying one or more part image data included in the second selection level-specific image data corresponding to second target image data associated with the first target image data among a plurality of target image data in the pasting area;
A program according to claim 1. said computer,
A creation unit for creating the plurality of level-specific image data when the plurality of level-specific image data associated with the target image data are not stored in the storage unit based on the operation of designating the target image data. to further function as
A program according to claim 1. When the number of pixels in the vertical direction and the number of pixels in the horizontal direction of the target image data are 2 ^j (j is a natural number), the creation unit divides the target image data into 4 ^k (k is a natural number) pieces. creating the plurality of level-specific image data each having a different value of k;
9. A program according to claim 8. When either the number of pixels in the vertical direction or the number of pixels in the horizontal direction of the target image data is not 2 ^j (j is a natural number), the creation unit sets the number of pixels in the vertical direction to 2 ^m (m is a natural number). and by dividing the image data to which pixels are added so that the number of pixels in the horizontal direction is 2 ⁿ (n is a natural number) into 4 ^k pieces, the plurality of level-specific image data each having a different value of k are created. do,
10. A program according to claim 9. The creation unit creates the plurality of parts image data included in the plurality of level-specific image data by dividing the image data excluding an area within a predetermined range from the outer circumference of the target image data.
9. A program according to claim 8. The creation unit converts the pasting area on which the one or more part image data is displayed into target image data having the same size as the pasting area, and the plurality of level-specific image data corresponding to the target image data. create an image object containing,
9. A program according to claim 8. The creation unit determines the maximum number of divisions based on the number of pixels of the target image data, and divides the target image data by a plurality of division numbers equal to or smaller than the maximum number of divisions, thereby creating the plurality of parts image data included in the plurality of level-specific image data corresponding to a plurality of division numbers;
A program according to any one of claims 8 to 12. identifying the target image data based on an operation of specifying the target image data to be displayed in the pasting area on the screen;
A plurality of level-specific image data associated with the target image data or the pasting region and including a plurality of parts image data created by dividing the target image data, wherein the level-specific image data includes the 1 based on the relationship between the size of the level-specific image data and the size of the pasting area from the plurality of level-specific image data including the number of divisions, which is the number of parts image data, and the plurality of parts image data; selecting two levels of image data;
a step of displaying one or more parts image data among the plurality of parts image data included in the selected level-specific image data, which is the one level-specific image data, in the pasting area;
An image processing method comprising: an image data specifying unit for specifying target image data based on an operation for specifying target image data to be displayed in a pasting area on a screen;
A plurality of level-specific image data including a plurality of parts image data created by dividing the target image data, stored in a storage unit in association with the target image data or the pasting region, wherein the level-specific image data The size of the level-specific image data and the size of the pasting area are obtained from the plurality of level-specific image data including the number of divisions, which is the number of the parts image data included in the image data, and the plurality of parts image data. an image data selection unit that selects one level-specific image data based on the relationship;
a display processing unit configured to display, in the attachment area, one or more parts image data among the plurality of parts image data included in the selected level-based image data, which is one level-based image data selected by the image data selection unit;
An image processing device having

Images