JP7388065B2 - Image output device and program - Google Patents

Description

The present invention relates to an image output device and a program.

BACKGROUND ART Conventionally, a system has been disclosed that uses Web3D to distribute images of artworks such as paintings stored in a museum database to an unspecified number of customers (for example, Patent Document 1).

JP2003-296587A

In the system described in Patent Document 1, ``When you select the exhibit list from the main menu screen of the virtual museum, thumbnail panoramic images of all the works exhibited in the gallery are displayed. When you select a sculpture, a walk-through screen will guide you to the courtyard where the sculpture is displayed.''
There is a need for ways to present not only works of art but also various works of art in a way that makes them easy for users to understand at first glance.

SUMMARY OF THE INVENTION Therefore, an object of the present invention is to provide an image output device and a program that express an object such as a work in an easy-to-understand manner for a user.

The present invention solves the above problems by the following solving means.
A first invention includes: an explanatory information storage section that stores a plurality of items related to the object including an image of the object and related text; and a three-dimensional space represented by three predetermined axes. visualization image generation means for generating an arrangement image in which images of the object stored in the object are arranged based on the related text; and visualization for outputting the arrangement image generated by the visualization image generation means to a display device. An image output device includes an image output means.
A second invention is the image output device according to the first invention, further comprising an item receiving means that receives designation of three items from the plurality of items, and the visualized image generating means is configured to receive the three items received by the item receiving means. The present invention is an image output device that generates the arrangement image in which the image of the object is arranged in the three-dimensional space having a cubic shape with one item as each axis.
A third invention is the image output device according to the second invention, wherein the axis operation receiving means receives an operation on at least one axis among the arranged images displayed on the display device; The image output device is provided with an operation image output means for outputting an image after axis operation, in which an image of the object is arranged in the three-dimensional space in the shape of a rectangular parallelepiped in which the received axis is extended.
A fourth invention is the image output device according to the third invention, wherein the plurality of items include a year related to the object, and the operation image output means is configured to output the one image received by the axis operation reception means. The image output device outputs the axis-operated image in which, when the axis is an age item, a year visualization image indicating the year is further arranged in the rectangular parallelepiped-shaped three-dimensional space.
A fifth invention is the image output device according to the first invention, wherein the plurality of items include latitude and longitude as positional information regarding the object, and the visualized image generating means is configured to generate an image on the three predetermined axes. When the three-dimensional space is generated with the latitude and longitude as two axes, the image output device generates the arranged image in which a map image including the latitude and longitude is further arranged.
A sixth invention is the image output device according to the fifth invention, wherein the plurality of items include a year related to the object, and the visualized image generating means selects the year from among the three predetermined axes. The image output device generates the arrangement image in which the map images related to each era corresponding to the object are further arranged in the three-dimensional space defined as a third axis.
A seventh invention provides the image output device according to any one of the first to sixth inventions, further comprising a similarity degree calculating means for calculating a degree of similarity between each object stored in the explanation information storage section. The visualized image generation means further arranges related line images representing the relationships based on the degree of similarity calculated by the degree of similarity calculation means by images showing the manner in which images of each object are connected. , an image output device that generates the arrangement image.
An eighth invention is an object that receives an operation on an image of one of the objects included in the layout image displayed on the display device, in the image output device according to any one of the first invention to the seventh invention. Object image receiving means, an association image generation unit that generates an association image in which an image of the operated object and a keyword related to the object indicated by the image of the object are arranged in an associated manner. and an associated image output means for outputting the associated image generated by the associated image generating means to the display device.
A ninth invention is the image output device according to the eighth invention, wherein keyword receiving means receives an operation on the keyword outputted by the association image outputting means, and a keyword receiving means that receives an operation on the keyword outputted by the associated image outputting means, and a keyword receiving means that receives related information related to the operated keyword. and a related information image generation means for extracting related information of the object from a related information database that stores it and generating a related information image, and the association image output means is configured to extract the related information of the object from a related information database that stores the related information and generate a related information image, The image output device outputs the association image to which the information image is added to the display device.
A tenth invention is the image output device according to the ninth invention, wherein the keyword receiving means receives a combination operation for two or more of the keywords, and the related information image generation means The image output device extracts related information related to any of two or more keywords from the related information database and generates the related information image.
An eleventh invention is a program for causing a computer to function as an image output device according to any one of the first invention to the tenth invention.

According to the present invention, it is possible to provide an image output device and a program that express an object such as a work in an easy-to-understand manner for a user.

1 is an overall schematic diagram of an image processing system according to an embodiment. FIG. 2 is a functional block diagram of an image processing server according to the present embodiment. FIG. 3 is a diagram illustrating an example of a storage unit of an image processing server according to the present embodiment. FIG. 3 is a diagram for explaining a method of registering work information in the input device according to the present embodiment. 3 is a flowchart showing image generation processing of the image processing server according to the present embodiment. This is a continuation of FIG. FIG. 3 is a diagram showing an example of an axis designation screen displayed on the user terminal according to the present embodiment. 7 is a flowchart showing visualized image generation processing by the image processing server according to the present embodiment. FIG. 3 is a diagram illustrating an example of a work group visualization image displayed on a user terminal according to the present embodiment. FIG. 7 is a diagram showing an example of another work group visualization image displayed on the user terminal according to the present embodiment. 7 is a flowchart showing operation reception processing of the image processing server according to the present embodiment. FIG. 2 is a diagram showing an example of a UI displayed on a user terminal according to the present embodiment. 7 is a flowchart showing post-axis operation image generation processing of the image processing server according to the present embodiment. FIG. 7 is a diagram showing an example of an image after axis operation generated by the image processing server according to the present embodiment. FIG. 7 is a diagram illustrating an example of another axis-operated image generated by the image processing server according to the present embodiment. FIG. 7 is a diagram illustrating an example of another axis-operated image generated by the image processing server according to the present embodiment. FIG. 7 is a diagram illustrating an example of another axis-operated image generated by the image processing server according to the present embodiment. 3 is a flowchart showing work image processing by the image processing server according to the present embodiment. FIG. 3 is a diagram illustrating an example of an associated image generated by the image processing server according to the present embodiment. FIG. 7 is a diagram showing an example of another associated image generated by the image processing server according to the present embodiment. FIG. 7 is a diagram showing an example of another associated image generated by the image processing server according to the present embodiment. 7 is a flowchart illustrating related image generation processing by the image processing server according to the present embodiment. FIG. 3 is a diagram illustrating an example of a work group visualization image displayed on a user terminal according to the present embodiment.

Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. Note that this is just an example, and the technical scope of the present invention is not limited to this.
(Embodiment)
<Image processing system 100>
FIG. 1 is an overall schematic diagram of an image processing system 100 according to this embodiment.
FIG. 2 is a functional block diagram of the image processing server 1 according to this embodiment.
FIG. 3 is a diagram showing an example of the storage unit 30 of the image processing server 1 according to the present embodiment.
FIG. 4 is a diagram for explaining a method of registering work information in the input device 8 according to the present embodiment.

The image processing system 100 shown in FIG. 1 is a system that includes an image processing server 1 (image output device), a related information DB (database) 4, a user terminal 5 (display device), and an input device 8.
The image processing server 1 receives and stores explanatory information regarding the work (object) inputted by the input device 8 in advance from the input device 8 . Then, the image processing server 1 generates a work group visualization image (placement image) that visualizes a work group including each work in response to the signal received from the user terminal 5, and generates it for the user terminal 5. Send the visualized images of your works. By doing so, the image processing server 1 provides the user with a viewing screen for the work group that expresses the work group in an easy-to-understand manner at a glance.
In the following, the viewing screen for a group of works will be explained using, as an example, earthenware pottery owned by a museum or the like. However, this is just an example, and other works such as sculptures and paintings may be used.

The image processing server 1, user terminal 5, and input device 8 are communicably connected via a communication network N. The communication network N is, for example, an Internet line, and it does not matter whether it is wired or wireless.
Further, the image processing server 1 is communicably connected to the related information DB 4. In the example of FIG. 1, the image processing server 1 and the related information DB 4 are directly connected, but they may of course be connected via the communication network N.

<Image processing server 1>
The image processing server 1 generates a work group visualization image in response to an operation from the user terminal 5 and transmits it to the user terminal 5.
The image processing server 1 is, for example, a web server. The image processing server 1 may also be a personal computer (PC) or the like.
As shown in FIG. 2, the image processing server 1 includes a control section 10, a storage section 30, and a communication interface section 39.
The control unit 10 is a central processing unit (CPU) that controls the entire image processing server 1. The control unit 10 cooperates with the above-mentioned hardware and executes various functions by appropriately reading and executing the operating system (OS) and application programs stored in the storage unit 30.

The control section 10 includes an item reception section 11 (item reception means), a visualized image generation section 12 (visualized image generation means), a visualized image output section 13 (visualized image output means), and an axis operation reception section 14 (axis operation an operation image output unit 15 (operation image output unit), a work image reception unit 16 (object image reception unit), an association image processing unit 17 (association image generation unit, association image output unit), It includes a keyword reception section 18 (keyword reception means), a related information image processing section 19 (related information image generation means), and a similarity degree calculation section 20 (similarity degree calculation means).

The item receiving unit 11 receives from the user terminal 5 the designation of three items out of a plurality of items describing each work. Here, the plurality of items are, for example, the same as the items in the work information storage section 32 (description information storage section) described later.

The visualized image generation unit 12 generates a cube-shaped three-dimensional space according to predetermined conditions. Here, the predetermined condition may be, for example, to set the three items received by the item reception unit 11 as each axis.
Then, the visualized image generation unit 12 generates a work group visualized image (placement image) in which images of works (images of objects) stored in the work information storage unit 32 are arranged in the generated three-dimensional space.
Furthermore, when generating a three-dimensional space with latitude and longitude as two of the three axes, the visualized image generation unit 12 generates a work group visualization image in which a map image including latitude and longitude is further arranged. You can.
Furthermore, the visualized image generation unit 12 generates a work group visualization image in which related line images connecting the images of the works are further arranged based on the relevance based on the degree of similarity calculated by the degree of similarity calculation unit 20 described later. You may.

The image of the work is, for example, a photographed image of the work. Note that the image of the work may be another image such as an illustration image of the work, but it is preferable that the work is expressed in an easy-to-understand manner. Further, the image of the work may be two-dimensional image data or three-dimensional modeling data.
The visualized image output unit 13 outputs the work group visualized image generated by the visualized image generation unit 12 to the user terminal 5.

The axis operation receiving unit 14 receives from the user terminal 5 an operation signal corresponding to an operation on at least one axis in the work group visualization image. For example, in a state where the visualized works group image is displayed on the user terminal 5 by the visualized image output unit 13, the user presses a key corresponding to one axis in the visualized works group image (for example, for the X axis, press the ), the user terminal 5 transmits an operation signal to the image processing server 1. Further, for example, an operation by the user to simultaneously select keys corresponding to two axes (for example, an X key and a Y key in the case of an X axis and a Y axis) may be accepted in the work group visualization image.

The operation image output unit 15 outputs to the user terminal 5 an image after the axis operation, which is a rectangular parallelepiped three-dimensional space obtained by extending the axis received by the axis operation reception unit 14 . By creating a rectangular three-dimensional space in which the received axis is stretched, the position of the image of the placed work is changed according to the degree to which the axis is stretched.
Further, when the expanded axis is an age item, the operation image output unit 15 outputs to the user terminal 5 an axis-operated image in which an age visualization image is further arranged in a three-dimensional space.

The work image reception unit 16 receives from the user terminal 5 an operation signal corresponding to an operation on an image of one work in the work group visualization image. For example, in a state where the visualized image output unit 13 displays a group of works visualized images on the user terminal 5, an operation by the user to select an image of one work from among the group visualized images displayed on the user terminal 5 is accepted. Accordingly, the user terminal 5 transmits an operation signal to the image processing server 1.

The associated image processing unit 17 generates an associated image in which keywords related to the image of the one work are arranged in a manner such that they are associated with the image of the one work, with the image of the one work being operated as the center. generate. Then, the association image processing unit 17 outputs the generated association image to the user terminal 5.

The keyword receiving unit 18 receives from the user terminal 5 an operation signal corresponding to an operation on a keyword in the associated image. For example, when the association image processing unit 17 displays the association images on the user terminal 5, by accepting an operation by the user to select one keyword from among the displayed association images, the user terminal 5 receives the operation signal. Send.
Further, the keyword reception unit 18 receives from the user terminal 5 an operation signal corresponding to an operation (combining operation) of moving one keyword in the associated image to the vicinity of another keyword while keeping it selected.

The related information image processing unit 19 extracts related information related to the operated keyword from the related information DB 4 when the operation received by the keyword receiving unit 18 is an operation of selecting one keyword by the user. , generate a related information image.
Further, when the operation received by the keyword reception unit 18 is an operation by the user to select one keyword and move it to the vicinity of another keyword, the related information image processing unit 19 selects one of the two keywords. Also, related information is extracted from the related information DB 4 and a related information image is generated. Note that the related information image generated by the related information image processing unit 19 may be related to two or more keywords. For example, when the keyword reception unit 18 receives an operation by the user to select another keyword and move it near another keyword, the related information image processing unit 19 selects another keyword and moves it to the vicinity of another keyword. Related information related to any of the three included keywords is extracted from the related information DB 4 to generate a related information image.
Then, the related information image processing unit 19 outputs an associated image to which the generated related information image is added to the user terminal 5.

The similarity degree calculation unit 20 calculates the degree of similarity between the works stored in the work information storage unit 32. More specifically, the similarity degree calculating unit 20 calculates the degree of similarity from, for example, the matching rate of the contents of the works corresponding to each item. Here, in the calculation by the similarity degree calculation unit 20, it is not necessary to use all the items, and the items used for calculation may be stored in the storage unit 30 in advance. Further, each item used in the calculation by the similarity degree calculation unit 20 may be weighted differently.

The storage unit 30 is a storage area such as a hard disk or a semiconductor memory device for storing programs, data, etc. necessary for the control unit 10 to execute various processes.
The storage unit 30 includes a program storage unit 31 and a work information storage unit 32.
The program storage unit 31 is a storage area that stores various programs. The program storage unit 31 stores programs 31a for performing various functions executed by the control unit 10 of the image processing server 1.

The work information storage unit 32 is a storage area that stores a plurality of items related to the work, including items of images of the work, and content (text) of the work corresponding to each of the plurality of items.
FIG. 3 shows an example of the work information storage section 32, taking the contents of one work as an example. The work information storage unit 32 stores the content of the work for each item such as work ID (IDentification), name, year, latitude, longitude, genre, material, location, image, and keyword.
The work ID is identification information for identifying the work, and may be arbitrarily determined by the image processing system 100.
The name is the title of the work. In this example, since the work is earthenware, the name is given by the data registrant, for example.
The year indicates when the work was created. In this example, since the work is earthenware, the date indicates the approximate period.
The latitude and longitude indicate the location information where the work was excavated.
Genre indicates the genre of the work, and Material indicates the material of the work.
The holding location indicates the actual storage location of the work.
The image is the image itself of the work.
A keyword is a word that represents a work, and is assigned by a data registrant, for example.

FIG. 4 shows an example of a registration screen 80 for registering in the work information storage section 32.
The control unit 10 of the image processing server 1 causes the input device 8 to display a registration screen 80. In the input device 8, for example, a data registrant inputs contents for each item displayed on the registration screen 80 for each work. Then, when the data registrant selects the "Register" button at the bottom of the registration screen 80, the input contents are transmitted to the image processing server 1. The image processing server 1 stores the received input contents in the work information storage section 32.

Note that data registration in the work information storage section 32 is not limited to this example. For example, by preparing a batch registration screen (not shown) and specifying a text file that stores the content of the work and a folder that stores image data, you can create a system based on the image data stored in the text file and folder. Then, the data may be added to the work information storage section 32.
Furthermore, input of work information using the registration screen 80 can be performed at any time before the start of the service provided by the image processing server 1 and during the service.

The communication interface section 39 in FIG. 2 is an interface for communicating with, for example, the user terminal 5, the input device 8, etc. via the communication network N.

<Related information DB4>
The related information DB 4 shown in FIG. 1 is a database that stores related information regarding a plurality of works. In this example, the related information DB 4 is a database from which, when a keyword is input, search results related to the keyword can be obtained, and stores metadata such as domestic and foreign cultural properties, for example.

<User terminal 5>
The user terminal 5 is, for example, a portable terminal such as a tablet that also has computer functions. The user terminal 5 may also be a portable terminal such as a smartphone or a mobile phone, or a stationary terminal such as a PC.
Although not shown, the user terminal 5 includes at least a control section, a storage section, a touch panel display (or an input/output section), and a communication interface section.

<Input device 8>
The input device 8 is, for example, a stationary terminal such as a PC. The input device 8 may also be a portable terminal, such as a tablet, which also has the functions of a computer.
Although not shown, the input device 8 includes at least a control section, a storage section, an input section, a display section, and a communication interface section.

Here, the computer refers to an information processing device equipped with a control section, a storage device, etc., and the image processing server 1, the user terminal 5, and the input device 8 are information processing devices each equipped with a control section, a storage section, etc. Yes, it is included in the concept of computer.

<Processing of image processing system 100>
Next, the processing performed between the image processing server 1 and the user terminal 5 will be described with reference to a flowchart.
5 and 6 are flowcharts showing image generation processing of the image processing server 1 according to the present embodiment.

As a premise of this process, the user terminal 5 that receives the service provided by the image processing server 1 (hereinafter, this service is also referred to as "work viewing service") first accesses the image processing server 1.
Then, in step S (hereinafter simply referred to as "S") 10 of FIG. 5, the control unit 10 of the image processing server 1 transmits axis designation screen data to the user terminal 5.
By receiving data from the image processing server 1, the user terminal 5 outputs, for example, an axis designation screen 50 shown in FIG. 7 on the touch panel display.

The axis specification screen 50 shown in FIG. 7 is a screen for specifying items corresponding to three axes: the X axis, the Y axis, and the Z axis. In the input fields 50a to 50c, for example, at least some of the items in the work information storage section 32 can be displayed, and one item can be selected and specified. In the example shown in FIG. 7, the year is specified in the input field 50a, the latitude is specified in the input field 50b, and the longitude is specified in the input field 50c.
Then, when the enter button on the axis specification screen 50 is selected on the user terminal 5, in S11 of FIG. Accept items to

In S12, the control unit 10 (visualized image generation unit 12) performs visualized image generation processing.
Here, the visualized image generation process will be explained based on FIG. 8.
In S21 of FIG. 8, the control unit 10 of the image processing server 1 generates a three-dimensional space in which the three items received from the user terminal 5 are arranged on corresponding axes (X-axis, Y-axis, and Z-axis).
In S22, the control unit 10 specifies the position of the work in the three-dimensional space for each work stored in the work information storage unit 32 based on the contents of the items corresponding to each axis.
In S23, the control unit 10 places the image of the work at the specified position.

FIG. 9 shows an example of a work group visualization image 60 in which images of works are arranged at specified positions.
A work group visualization image 60 shown in FIG. 9 is an image in which a plurality of images 60b corresponding to each of a plurality of works stored in the work information storage unit 32 are arranged in a three-dimensional space 60a. The image 60b is the image itself of the work.
Note that the work group visualization image 60 in FIG. 9 shows a three-dimensional space 60a and a plurality of images 60b, but in reality, the axis name and memory are shown on each axis, and the memory is are shown with corresponding values.

In S24 of FIG. 8, the control unit 10 determines whether the axes include latitude and longitude. If the axes include latitude and longitude (S24: YES), the control unit 10 moves the process to S25. On the other hand, if the axes do not include latitude and longitude (S24: NO), the control unit 10 ends this process and moves the process to S13 in FIG. 5.
In S25, the control unit 10 arranges the map image in three-dimensional space. Furthermore, the control unit 10 associates the position on the map specified by latitude and longitude with the image of the work.

FIG. 10 shows an example of a work group visualization image 61 in which a map image is further arranged.
As shown in FIG. 10, the work group visualized image 61 is an image in which a plurality of images 60b corresponding to each of the plurality of works stored in the work information storage unit 32 are arranged in a three-dimensional space 60a. The work group visualization image 61 is an image in which one map image 61c corresponding to the latitude and longitude of each of a plurality of works is arranged on one plane 61e. In the work group visualization image 61, the latitude and longitude of the work indicated by the image 60b are plotted on a map image 61c, and are associated with the work image 60b by an association line 61d.
Note that although the work group visualized image 61 described with reference to FIG. 10 is one in which one map image 61c is arranged on one plane 61e, the present invention is not limited to this. As shown in FIG. 10, when the axis excluding latitude and longitude is the era, although not shown, a map image 61c corresponding to the era may be displayed on a plane 61e corresponding to each era.

In S13 of FIG. 5, the control unit 10 (visualized image output unit 13) outputs the generated work group visualized image to the user terminal 5.
Thereby, the user terminal 5 can display the visualized works group image 60 shown in FIG. 9 and the works group visualized image 61 shown in FIG. 10.

Note that by operating the displayed work group visualized image on the user terminal 5 via the touch panel display, the work group visualized image can be displayed by various movements corresponding to the operation.
In S14, the control unit 10 determines whether an operation regarding the output work group visualization image has been received. When the operation regarding the output work group visualization image is accepted (S14: YES), the control unit 10 moves the process to S15. On the other hand, if the operation regarding the output work group visualization image has not been accepted (S14: NO), the control unit 10 moves the process to S16 in FIG. 6.
In S15, the control unit 10 performs an operation reception process to be described later. After that, the control unit 10 moves the process to S16 in FIG.
In S16 of FIG. 6, the control unit 10 (item reception unit 11) determines whether or not changes to the items corresponding to each axis have been accepted. If changes to the items corresponding to each axis are accepted (S16: YES), the control unit 10 moves the process to S12 of FIG. 5, and generates a work group visualization image using the changed items. On the other hand, if changes to the items corresponding to each axis have not been accepted (S16: NO), the control unit 10 moves the process to S17.
In S17, the control unit 10 determines whether to end the process. If the process is to be ended (S17: YES), the control unit 10 ends this process. If the process does not end (S17: NO), the control unit 10 moves the process to S14 in FIG. 5.

Next, a description will be given of the processing of the image processing server 1 when an operation regarding the visualized work group image outputted to the user terminal 5 is received from the user terminal 5.
FIG. 11 is a flowchart showing the operation reception process of the image processing server 1 according to this embodiment.
Before explaining the process in FIG. 11, the operation screen will be explained.
The image processing server 1 displays, for example, an icon or the like for displaying a menu at the end of the screen that includes the work group visualization image. It is conceivable that the user selects an icon to display an operation screen.
As an example of the operation screen, there is a UI 95 (User Interface) shown in FIG. 12 that the user uses for operations. The user operates the UI 95 with the user's finger 55.

The UI 95 shown in FIG. 12 corresponds to a work group visualization image, and schematically represents a three-dimensional space consisting of an X-axis 95a, a Y-axis 95b, and a Z-axis 95c. Then, for example, by performing a sliding operation with the user's finger 55, the entire work group visualization image (cube) may be rotated in the sliding direction and displayed. In this case, it is desirable that the images of the works included in the work group visualization image always face forward. Furthermore, for example, the user may perform a pinch-in or pinch-out operation with two fingers to reduce or enlarge the work group visualization image.
Although this example has been described as operating the UI 95, the operation may be performed on the screen itself containing the work group visualization images. For example, even when the user slides his or her finger on the screen containing the visualized image of the work group or performs a pinch-in or pinch-out operation using two fingers, the control unit 10 displays the same display as described above. may be displayed.

In S31 of FIG. 11, the control unit 10 (axis operation reception unit 14) determines whether or not an axis operation has been accepted. The axis operation is performed by the user, for example, by displaying a keyboard on the screen containing the visualized image of the work group displayed by the user terminal 5, and operating the X key for the X-axis operation. Good too. Alternatively, the operation may be to select the X-axis 95a of the UI 95 in FIG. 12. When an axis operation is received from the user terminal 5 by the user's operation (S31: YES), the control unit 10 moves the process to S32. On the other hand, if the axis operation is not received (S31: NO), the control unit 10 moves the process to S34.
In S32, the control unit 10 (operation image output unit 15) performs post-axis operation image generation processing.

Here, the post-axis operation image generation process will be explained based on FIG. 13.
In S41 of FIG. 13, the control unit 10 generates an axially operated image including a three-dimensional space in the shape of a rectangular parallelepiped extending in the received axial direction.
FIG. 14 shows an axis-operated image 62 that is generated when the Y-axis 95b is stretched in the UI 95 of FIG. 12. The post-axis operation image 62 is a rectangular parallelepiped-shaped image in which the Y axis is longer than the X and Z axes. The images of the work are scattered in the Y-axis direction in response to the stretching of the Y-axis.

In S42 of FIG. 13, the control unit 10 determines whether the item on the extended axis is the year. If it is the year (S42: YES), the control unit 10 moves the process to S43. On the other hand, if it is not the age (S42: NO), the control unit 10 ends this process and moves the process to S34 in FIG. 11.

In S43, the control unit 10 determines whether each work has a range of ages. For example, if the content corresponding to the era item refers to multiple years or is expressed in eras, it is determined that the content has a range. Specifically, things that have a range include things that have a range of 100 years, such as the 300s B.C., things that represent eras, such as the Heian period, and things that range from ○ to △. If it has a width (S43: YES), the control unit 10 moves the process to S44. On the other hand, if it does not have a width (S43: NO), the control unit 10 ends this process and moves the process to S34 in FIG. 11.

In S44, the control unit 10 associates the image of the work with a visualized age image representing the age.
15 to 17 show images 62a to 62c after axis manipulation. The post-axis manipulation images 62a to 62c are images obtained by adding age visualization images 63a to 63c to the post-shaft manipulation image 62 shown in FIG. 14.

In the axis-operated image 62a shown in FIG. 15, a plate-shaped age visualization image 63a is arranged in a position close to the image of the corresponding work. Here, the length of the board shape represents the age range of the corresponding work.
In the axis-operated image 62b shown in FIG. 16, an age-visualized image 63b in which a plurality of images of the work are connected is arranged. Here, the number of images of a series of works represents the age range of the corresponding works.
In the axis-operated image 62c shown in FIG. 17, a bar-shaped age visualization image 63c is arranged in a position close to the image of the corresponding work. Here, the length of the bar represents the age range of the corresponding work.

Note that the post-axis operation images 62a to 62c shown in FIGS. 15 to 17 are examples. The age-visualized image that shows the age of the work may be any other image as long as it is included near or in part of the image of the work. Further, the user terminal 5 may display any of the post-axis manipulation images 62a to 62c, or may switch the post-shaft manipulation images to be displayed by the user's operation.

In S33 of FIG. 11, the control unit 10 outputs the post-axis manipulation image 62 (or the post-shaft manipulation images 62a to 62c) to the user terminal 5.
At the user terminal 5, the user can check the age more accurately by viewing the image 62 after the axis operation. Further, in the user terminal 5, for example, when the user looks at the post-axis operation image 62a, the user can understand at a glance from the age visualization image 63a that there is a wide range of ages.

In S34, the control unit 10 (work image receiving unit 16) determines whether or not an operation for selecting an image of the work has been received. For example, when the user terminal 5 performs an operation to select one of the images of the work being displayed, the control unit 10 receives the selection operation for the image of the work. If the selection operation for the image of the work is accepted (S34: YES), the control unit 10 moves the process to S35. On the other hand, if the selection operation for the image of the work has not been accepted (S34: NO), the control unit 10 moves the process to S36.
In S35, the control unit 10 performs work image processing.

Here, work image processing will be explained based on FIG. 18.
In S51 of FIG. 18, the control unit 10 (associated image processing unit 17) obtains a keyword related to the image of the selected work, for example, by referring to the work information storage unit 32.
In S52, the control unit 10 (associated image processing unit 17) generates an associated image in which the image of the work is centered and the image of the work and the acquired keyword are connected by a line. Then, the control unit 10 (associated image processing unit 17) transmits the generated associated image to the user terminal 5.

FIG. 19 shows an example of the association image 70 generated by the image processing server 1. In this example, the user performs an operation to select an image of a flame-shaped pottery from the group of works visualization images. The associated image 70 is arranged around the image 70a of the selected flame-shaped earthenware, and the image 70a and each keyword 70b are associated with each other by a line image (an associated mode).

In S53 of FIG. 18, the control unit 10 (keyword accepting unit 18) determines whether an operation for the keyword has been accepted. For example, when the user terminal 5 performs an operation to select a displayed keyword, the control unit 10 receives the operation for the keyword. If the operation for the keyword is accepted (S53: YES), the control unit 10 moves the process to S54. On the other hand, if the operation for the keyword has not been accepted (S53: NO), the control unit 10 ends this process and moves the process to S36 in FIG. 11.

In S54, the control unit 10 (keyword reception unit 18) determines whether the operation on the keyword is a combination operation on two keywords. Here, the merging operation for two keywords means that after performing a selection operation on one keyword, with the selected keyword moved to the position of another keyword, the keyword moved to the other keyword is combined. This refers to the operation that causes If the operation is a combination of two keywords (S54: YES), the control unit 10 moves the process to S55. On the other hand, if the operation is not a combination of two keywords (S54: NO), the control unit 10 moves the process to S56.

In S55, the control unit 10 (related information image processing unit 19) extracts related information related to both of the two keywords from the related information DB4. Then, the control unit 10 (related information image processing unit 19) generates a related information image in which the extracted related information is associated with the two keywords. After that, the control unit 10 moves the process to S57.

On the other hand, in S56, the control unit 10 (related information image processing unit 19) extracts the related information for the one keyword for which the selection operation has been performed from the related information DB 4. Then, the control unit 10 (related information image processing unit 19) generates a related information image in which the extracted related information is associated with the operated keyword.
In S57, the control unit 10 (association image processing unit 17) outputs an association image in which the generated related information image is additionally arranged to the user terminal 5. After that, the control unit 10 moves the process to S36 in FIG. 11.

FIG. 20 shows a case where the keyword "flame-shaped earthenware" has been selected in the association image 70 shown in FIG. 19, and shows an example of an association image 71 including the added related information image 71a.
The association image 71 shows information related to the selected keyword in association with the keyword. Therefore, the user can obtain deeper knowledge about the keyword he/she wants to know.

Further, FIG. 21 shows a case where an operation is performed to move and combine the keyword "flame-shaped earthenware" with the keyword "○○ ruins" selected in the association image 70 shown in FIG. An example of an association image 72 including an information image 72a is shown.
In the association image 72, information that is commonly related to two keywords specified by the user is shown in association with the two keywords. Therefore, the user can know related information common to two keywords through a simple operation.

In S36 of FIG. 11, the control unit 10 determines whether a relationship display operation has been received. Here, the relationship display operation refers to an operation for displaying the relationship between images of each work. For example, on the user terminal 5, an icon (not shown) for displaying the relationship is provided at the edge of the screen containing the displayed work group visualization image, and the user terminal 5 accepts an operation to select the icon. Accordingly, the control unit 10 determines whether or not the operation signal has been received. When the relevance display operation is accepted (S36: YES), the control unit 10 moves the process to S37. On the other hand, if the relevance display operation is not accepted (S36: NO), the control unit 10 ends this process and moves the process to S16 in FIG.
In S37, the control unit 10 (visualized image generation unit 12) performs related image generation processing.

Here, related image generation processing will be explained based on FIG. 22.
In S61 of FIG. 22, the control unit 10 (similarity degree calculation unit 20) refers to the work information storage unit 32 and calculates the degree of similarity between images of works included in the output work group visualization image.
In S62, the control unit 10 (visualized image generation unit 12) generates a related line image connecting the images of the work based on the calculated degree of similarity.
In S63, the control unit 10 (visualized image generation unit 12, visualized image output unit 13) outputs to the user terminal 5 a work group visualized image in which the generated related line images are added and arranged.

FIG. 23 shows an example of a work group visualization image 64 to which related line images have been added.
A work group visualization image 64 shown in FIG. 23 is an image in which a plurality of images 64b corresponding to each of a plurality of works stored in the work information storage unit 32 are arranged in a three-dimensional space 64a. The work group visualization image 64 is an image in which a related line image 64c indicating the relationship between the two images 64b is further arranged to connect the two images 64b. In this example, the related line image 64c is a moving image in which a plurality of small ball shapes move back and forth between the two images 64b.

Note that the control unit 10 may change the related line image 64c into various different forms depending on the degree of similarity. For example, in the example shown in FIG. 23, the size, density, and moving speed of the ball shape may be made different depending on the degree of similarity. Further, the color and thickness of the related line image 64c may be made different depending on the degree of similarity. In either case, it is desirable that the degree of similarity be easily understood by the user depending on the manner in which it is displayed. Furthermore, if the relationship has a direction, in the example shown in FIG. 23, the movement direction of the ball shape may be made to correspond to the direction of the relationship.

Further, in the work group visualization image 64, the shape of the related line image 64c may be changed using the line shape specification field 64d. The line shape specification field 64d allows specifying whether the related line image 64c is represented by a straight line or a curved line. In the work group visualization image 64 shown in FIG. 23, "0.0" is specified in the line shape specification field 64d, so the related line image 64c is represented by a straight line. By inputting a numerical value into the line shape specification field 64d, the control unit 10 generates a work group visualization image 64 representing the related line image 64c using a curve corresponding to the numerical value.

In the above, operations regarding the output work group visualization image have been explained in detail along with specific examples. However, the operations regarding the output work group visualization image may include other operations.
For example, when receiving an operation to select an image of a work, the control unit 10 generates and outputs an associated image including a keyword, but in this state, if an operation to select an image of a work is further received , an explanatory text or the like corresponding to the image of the work may be displayed.

As described above, the image processing server 1 of this embodiment has the following effects.
(1) A work group visualization image is generated in which images of works stored in the work information storage unit 32 are arranged in a three-dimensional space represented by three axes, and output to the user terminal 5. Therefore, by displaying images of the works stored in the work information storage section 32, the works can be presented to the user in an easy-to-understand manner.
(2) By accepting three items from the user terminal 5, the three axes that make up the three-dimensional space are made into the items specified by the user. Therefore, it is possible to generate a three-dimensional space and show a group of works using images from a viewpoint that the user wants to focus on.

(3) When an operation on one or more axes is received, the one or more received axes are extended in three-dimensional space. Therefore, by operating the axis of the item that the user wants to check in detail, images of a group of works can be checked over a wide span.
(4) When the extended axis is set as a year, a year-visualized image showing the year is placed on the image of the work. Therefore, when the age is not a dot but has a width, the width can be shown in an image to make it easier for the user to understand.

(5) When the two axes are latitude and longitude, a map image including latitude and longitude is arranged. Therefore, by representing a position specified from latitude and longitude as a position on a map, it can be expressed more easily.
(6) The relationships based on the degree of similarity between the displayed images of the works are arranged as related line images that connect the images of the works. Therefore, relationships between works can be more clearly expressed using related line images.

(7) When an operation on an image of a work is accepted, an associated image is generated and output in which keywords related to the operated work are arranged in a manner that they are associated with the work image. Therefore, characteristics of images of works of interest can be displayed as keywords.
(8) When an operation for the displayed keyword is accepted, related information related to the operated keyword is extracted from the related information DB 4, and a related information image is generated and output. Therefore, it is possible to focus on keywords and output related information.

Although the embodiments of the present invention have been described above, the present invention is not limited to the embodiments described above. Further, the effects described in the embodiments are merely a list of the most preferable effects resulting from the present invention, and the effects of the present invention are not limited to those described in the embodiments. In addition, although the embodiment mentioned above and the modification mentioned later can be used in combination suitably, detailed description is abbreviate|omitted.

(Deformed form)
(1) Although this embodiment has been described using an example of what is displayed on a user terminal, the present invention is not limited to this. For example, it may be an image processing device that has the functions of an image processing server and a user terminal.
(2) In this embodiment, the user terminal is described using a tablet as an example, but the present invention is not limited to this. For example, it may be an HMD (Head Mounted Display), an exhibition equipment theater, or the like.

(3) In the present embodiment, the combination operation for two keywords has been described as an example, but the present invention is not limited to this. The image processing server allows a join operation for three or more keywords, extracts related information related to all of the combined keywords from the related information DB, and adds the extracted related information to the related information associated with all the keywords. An information image may also be generated.

(4) In this embodiment, an example has been described in which the object is related to earthenware held in art galleries and museums, but the invention is not limited to this. Any item that is useful for showing multiple items from multiple perspectives may be used, and may be other works of art, paintings, etc. Furthermore, it can be used not only for works of art, but also for corporate portfolios, etc., which enable comparison and reference of multiple companies. In that case, the image may be, for example, a company logo.

1 Image processing server 4 Related information DB
5 User terminal 8 Input device 10 Control unit 11 Item reception unit 12 Visualized image generation unit 13 Visualized image output unit 14 Axis operation reception unit 15 Operation image output unit 16 Work image reception unit 17 Association image processing unit 18 Keyword reception unit 19 Related information Image processing unit 20 Similarity calculation unit 30 Storage unit 31a Program 32 Work information storage unit 60, 61, 64 Work group visualization images 62, 62a to 62c, 64 Image after axis operation 100 Image processing system

Claims (11)

an explanatory information storage unit that stores a plurality of items related to the object, including an image of the object and associated text;
Visualized image generation means for generating an arrangement image in which the image of the object stored in the explanatory information storage unit is arranged in a cubic three- dimensional space expressed by three predetermined axes based on the related text; ,
Visualized image output means for outputting the arrangement image generated by the visualized image generation means to a display device;
axis operation receiving means for accepting an operation on at least one axis among the arranged images displayed on the display device;
operation image output means for outputting an image after axis operation, in which an image of the object is arranged in the three-dimensional space of a rectangular parallelepiped shape obtained by extending the axis received by the axis operation reception means;
An image output device comprising: The image output device according to claim 1,
comprising item receiving means for receiving designation of three items from the plurality of items,
The visualized image generation means generates the arrangement image in which the image of the object is arranged in the three -dimensional space of the cubic shape with each axis having the three items received by the item reception means, image output. Device. The image output device according to claim 1 or 2 ,
The plurality of items include the age related to the object,
When one of the axes accepted by the axis operation receiving means is a year item, the operation image output means further outputs a year visualization image indicating the year in the rectangular parallelepiped-shaped three-dimensional space. An image output device configured to output an image after the axis operation. The image output device according to any one of claims 1 to 3 ,
The plurality of items include latitude and longitude as position information regarding the object,
When the visualized image generating means generates the cubic-shaped three-dimensional space with the latitude and longitude as two axes among the three predetermined axes, further arranging a map image including the latitude and longitude. An image output device that generates the arranged image. The image output device according to claim 4 ,
The plurality of items include the age related to the object,
The visualized image generation means further generates the map images related to each era corresponding to the object in the cubic- shaped three-dimensional space with the era as the third axis among the three predetermined axes. An image output device that generates the arranged image. The image output device according to any one of claims 1 to 5 ,
comprising a degree of similarity calculation means for calculating the degree of similarity between each object stored in the explanation information storage unit,
The visualized image generation means further arranges a related line image representing a relationship based on the degree of similarity calculated by the degree of similarity calculation means by an image showing a manner in which images of each object are connected. An image output device that generates a layout image. an explanatory information storage unit that stores a plurality of items related to the object, including an image of the object and associated text;
similarity degree calculation means for calculating the degree of similarity between the objects stored in the explanation information storage unit;
The image of the object stored in the explanatory information storage unit is arranged in a three-dimensional space represented by three predetermined axes based on the related text, and the degree of similarity calculated by the degree of similarity calculation means is calculated. a visualized image generating means for generating a layout image in which related line images are further arranged, representing the relationship based on the image by an image showing a manner of connecting the images of each object;
Visualized image output means for outputting the arrangement image generated by the visualized image generation means to a display device;
An image output device comprising: The image output device according to any one of claims 1 to 7,
object image receiving means for accepting an operation on one image of the object included in the arrangement image displayed on the display device;
an association image generating means for generating an association image in which an image of the operated object and a keyword related to the object indicated by the image of the object are arranged in an associated manner;
association image output means for outputting the association image generated by the association image generation means to the display device;
An image output device comprising: The image output device according to claim 8,
keyword receiving means for accepting an operation on the keyword outputted by the association image outputting means;
a related information image generation unit that extracts related information related to the operated keyword from a related information database that stores related information of each object, and generates a related information image;
Equipped with
The associated image output means is an image output device that outputs the associated image to which the related information image generated by the related information image generation means is added to the display device. The image output device according to claim 9,
The keyword accepting means accepts a combination operation for two or more of the keywords,
The related information image generation means is an image output device that extracts related information related to any of the two or more keywords subjected to a combination operation from the related information database to generate the related information image. A program for causing a computer to function as the image output device according to any one of claims 1 to 10.

Images