JP2008271094A - List image display device, list image display control method, and list image display control program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a list image display device capable of arbitrarily magnifying and reducing each list image to be displayed in a list picture, to provide a list image display control method, and to provide a list image display control program. <P>SOLUTION: The list image display device includes: a list display means for displaying a plurality of images, received from a server, by making them into a list; an operation means for performing a magnifying or reducing operation with respect to each image of the list; an acquisition means for acquiring an original image, from the server, which corresponds to a thumbnail image when the image to be magnified by the operation means is the thumbnail image; and an image replacement means for magnifying or reducing the acquired original image to the display size of the thumbnail image to be magnified, and replacing the images of the list. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a list image display device, a list image display control method, and a list image display control program for displaying a list of images stored in a server on a network.

  An Internet portal site or the like may provide a service for searching for images stored in a large number of servers on a network.

  FIG. 1 is a diagram showing an overview of a conventional image search service. A search server 01 that provides an image search service includes an image search index DB that holds a correspondence between a search keyword and an image, and an image in advance. And a thumbnail image DB for holding thumbnail images generated by crawling (collecting) (images reduced for simple display).

  When a query (inquiry) with a keyword for image search is input from the client terminal 03 to the search server 01 (step S1), the search server 01 searches the index DB, and the image size and thumbnail of the image hit in the search. Information such as the URL (Uniform Resource Locator) of the storage location of the image and the original image is returned to the client terminal 03 as a search result (step S2). Based on the information obtained from the search server 01, the client terminal 03 accesses the thumbnail image DB of the search server 01 and acquires a thumbnail image (steps S3 and S4).

  The client terminal 03 generates and displays a list screen including thumbnail images A, B, C,... Based on the acquired search results. When the user selects, for example, the thumbnail image A from the list screen (step S5), the client terminal 03 acquires (downloads) the original image from the image providing source server 04 based on the image URL included in the search result. (Steps S6 and S7), the thumbnail image list screen is deleted and the original image is displayed.

On the other hand, Patent Document 1 discloses an image processing apparatus and the like that can perform a search quickly and easily. That is, in Patent Document 1, when compressed image data of a captured image and its thumbnail image are stored in advance in a flash memory, and a desired image is designated from a list of thumbnail images displayed, compression of the designated thumbnail image is performed. The image data is displayed as an intermediate image that is smaller than the full image and larger than the thumbnail image. When the intermediate image is selected, the image is displayed as a full image. Further, when the image is enlarged with the corner of the thumbnail image being pressed, the thumbnail image is enlarged, and when the enlarged thumbnail image is selected, a full image is displayed.
JP 2000-341644 A

  In the conventional image search service shown in FIG. 1, a thumbnail image having a smaller image size than the original image is transmitted from the search server 01 so that the user can quickly confirm the search result. Thumbnail images are suitable for data communication because of their small amount of data, but they are not suitable for detailed confirmation of images because of their small image size.

  In addition, when checking images in detail, the user selects a desired thumbnail image from the list of thumbnail images and displays the original image. However, in order to view another thumbnail image again, the screen is displayed in a list of thumbnail images. The operation must be complicated. At this time, re-reading for displaying a list of search results is performed, and it takes some time to complete the display. Although there is an operation method in which a plurality of windows are opened on the browser and the original image is opened in another window while leaving the window of the list screen, the window operation becomes complicated.

  Furthermore, with an ordinary browser, the original image cannot be further enlarged or reduced. To do this, another image display application must be used, which complicates the operation.

  On the other hand, in the technique disclosed in Patent Document 1, an original image and a thumbnail image are stored in advance in a flash memory. In a network environment in which a client terminal acquires images from a search server and an image providing source server, respectively. It cannot be applied.

  Although the thumbnail image itself can be enlarged, the thumbnail image has a limited amount of data because the amount of data is small, and may not be displayed with sufficient image quality. Furthermore, in order to compare with other images after displaying the original image, it is necessary to return the display to the list of thumbnail images after displaying the original image, and the operation is complicated. Furthermore, after switching to the display of the original image after the operation for enlarging the thumbnail image, the original image cannot be enlarged, and the usability is poor.

  The present invention has been proposed in view of the above-described conventional problems, and an object of the present invention is to provide a list capable of arbitrarily enlarging / reducing individual list images displayed on the list screen. An object is to provide an image display device, a list image display control method, and a list image display control program.

  In order to solve the above-described problems, in the present invention, as described in claim 1, list display means for displaying a list of a plurality of images received from a server, and individual images in the list are displayed. An operation unit that performs an enlargement or reduction operation on the image, and an acquisition of obtaining an original image corresponding to the thumbnail image from the server when the image is the target of the enlargement operation performed by the operation unit. The summary image display device comprises: a means for replacing the image on the list by enlarging or reducing the acquired original image to the display size of the thumbnail image subjected to the enlargement operation; .

  According to a second aspect of the present invention, in the list image display device according to the first aspect, when the acquisition unit receives a plurality of thumbnail images from the server and displays the list, all the thumbnail images are displayed. Acquisition of the corresponding original image can be started.

  According to a third aspect of the present invention, in the list image display device according to the first aspect, when the acquisition unit receives a plurality of thumbnail images from the server and displays the list, all the thumbnail images are displayed. The acquisition of the original image corresponding to the upper predetermined number of thumbnail images having a higher display order can be started.

  According to a fourth aspect of the present invention, in the list image display device according to the first aspect, the acquiring means receives the plurality of thumbnail images from the server and displays the list when displaying the list. The acquisition of the original image corresponding to the image that is the target of the process can be started.

  In addition, as described in claim 5, in the list image display device according to any one of claims 1 to 4, the acquisition unit includes a size of the thumbnail image and an original image corresponding to the thumbnail image. If the size difference is less than a predetermined value, the process of acquiring the original image can be omitted.

  According to a sixth aspect of the present invention, a list display unit that displays a list of a plurality of images received from the server, an operation unit that performs an enlargement or reduction operation on each image in the list, A first acquisition unit that acquires, from the server, an intermediate image corresponding to the thumbnail image when the image is the target of the enlargement operation by the operation unit, and the target of the enlargement operation. First image replacement means for replacing the image on the list by enlarging or reducing the acquired intermediate image to the display size of the thumbnail image, and an original image corresponding to the intermediate image following acquisition of the intermediate image A second acquisition means for acquiring the image from the server, and enlarging the acquired original image to the display size of the replaced intermediate image on the list or Small to be able to configure a list image display apparatus and a second image replacing means for replacing the image on the list.

  According to a seventh aspect of the present invention, in the list image display device according to the sixth aspect, the first and second acquisition units receive a plurality of thumbnail images from the server and display the list. In addition, acquisition of an intermediate image or an original image corresponding to all thumbnail images can be started.

  Further, as described in claim 8, in the list image display device according to claim 6, when the first and second acquisition means receive a plurality of thumbnail images from the server and display the list. In addition, acquisition of intermediate images or original images corresponding to a predetermined number of thumbnail images having a higher display order among all thumbnail images can be started.

  According to a ninth aspect of the present invention, in the list image display device according to the sixth aspect, the first and second acquisition means receive a plurality of thumbnail images from the server and display the list. In addition, acquisition of an intermediate image or an original image corresponding to the image subjected to the enlargement operation can be started.

  Further, as described in claim 10, in the list image display device according to any one of claims 6 to 9, the first and second acquisition means include the size of the thumbnail image and the thumbnail. The size of the original image corresponding to the image is compared, and if the size difference is less than the size difference corresponding to the first predetermined value, the acquisition of the intermediate image and the original image is omitted, and the size difference is The intermediate image acquisition process can be omitted when the size difference is less than the size difference corresponding to the second predetermined value that is larger than the predetermined value and larger than the first predetermined value.

  In addition, as described in claim 11, in the list image display device according to any one of claims 1 to 10, an area in the displayed image is designated for each image in the list. And means for performing partial enlargement.

  According to a twelfth aspect of the present invention, when a list display unit that displays a plurality of images received from the server as a list and an enlargement operation is performed on each of the images in the list, For an image subjected to an enlargement operation, if the image is a thumbnail image, the original image corresponding to the thumbnail image is started to be received and the thumbnail image is enlarged according to the enlargement operation. Can be configured as a list image display device provided with image replacement means for replacing the image on the list by enlarging or reducing the original image to the display size of the thumbnail image.

  According to a thirteenth aspect of the present invention, when a list display unit that displays a list of a plurality of images received from the server and an enlargement operation is performed on each of the images in the list, When the image that is the target of the enlargement operation is a thumbnail image, the intermediate image corresponding to the thumbnail image is started to be received and the thumbnail image is enlarged according to the enlargement operation. When the reception of the intermediate image is completed, the intermediate image is enlarged or reduced to the display size of the thumbnail image to replace the image on the list, and the enlargement is performed following the completion of the reception of the intermediate image. While starting to receive the original image corresponding to the thumbnail image to be operated, the replaced intermediate image is enlarged according to the enlargement operation, and the original image When the reception is completed, the original image may be configured as a list image display device and a second image replacing means for expanding or reduced to the display size of the intermediate image replacing the image on the list.

  Moreover, as described in claims 14 and 15, it can be configured as a list image display control method.

  Further, as described in claims 16 and 17, it can be configured as a list image display control program.

  In the list image display device, list image display control method, and list image display control program of the present invention, each list image displayed on the list screen can be arbitrarily enlarged / reduced with sufficient image quality. it can.

  Hereinafter, preferred embodiments of the present invention will be described. Although an example for an image search service will be described, the present invention can also be applied to a case where a plurality of images are acquired from a server and displayed as a list without searching.

<Term definition>
In the following description, terms are defined as follows.
Thumbnail image: An image obtained by reducing the original image.
List image: Images displayed as a list as a result of image search (either thumbnail images, intermediate images, or original images).
Intermediate image: An image having an intermediate amount of data between the thumbnail image and the original image.

<System configuration>
FIG. 2 is a diagram illustrating a configuration example of a system according to an embodiment of the present invention.

  In FIG. 2, a network 2 such as the Internet includes a search server 1 that provides an image search service, a client terminal 3 such as a PC (Personal Computer), a PDA (Personal Digital Assistant), or a mobile phone operated by a user, An image provider server 4 that holds the original image of the target image is connected.

  FIG. 3 is a diagram illustrating a configuration example of the search server 1.

  In FIG. 3, the search server 1 includes, as a database (DB), keywords (text), thumbnail information (image URL, image size), original information (page URL, image URL, image size), intermediate image information (storage destination). , Image size) and the like, a search index DB 111, a thumbnail image DB 112 that holds thumbnail images, and an intermediate image DB 113 that holds intermediate images. The thumbnail image and the intermediate image are created in advance by crawling on the network. The intermediate image is used in the processing in the third and fourth embodiments described later, and is not used in the first and second embodiments.

  In addition, the search server 1 functions as a query receiving unit 101 that receives a query including a keyword for search from the client terminal 3, and a search execution that searches the index DB 111 based on the query received by the query receiving unit 101. Unit 102 and a search result transmission unit 103 that transmits the search result of the search execution unit 102 to the client terminal 3.

  Further, the search server 1 functions as a thumbnail image acquisition request receiving unit 104 that receives a thumbnail image acquisition request from the client terminal 3, and a thumbnail image acquisition unit 105 that acquires the requested thumbnail image from the thumbnail image DB 112. A thumbnail image transmission unit 106 that transmits the acquired thumbnail image to the client terminal 3.

  Further, the search server 1 has, as functional units, an intermediate image acquisition request receiving unit 107 that receives an intermediate image acquisition request from the client terminal 3, and an intermediate image acquisition unit 108 that acquires the requested intermediate image from the intermediate image DB 113. An intermediate image transmission unit 109 that transmits the acquired intermediate image to the client terminal 3.

  FIG. 4 is a diagram illustrating a configuration example of the client terminal 3.

  4, the client terminal 3 includes a UI control unit 31 that provides a user interface (UI) to a user who operates, and a communication control unit 32 that performs communication via the network 2.

  The UI control unit 31 receives an operation from a user and inputs a query to an input screen display unit 311 that displays a screen for inputting a query for image search and an input screen displayed by the input screen display unit 311. A query input unit 312 is provided.

  The UI control unit 31 also displays a search result display unit 313 that displays a plurality of images (list images) included in the search result as a list screen, and a list image management table 314 that manages various types of information on the list images (data structure). , An image operation unit 315 that receives operations from the user and performs operations such as enlargement / reduction on each list image in the list screen displayed by the search result display unit 313, and a search result display A list image enlargement / reduction unit 316 that is called from the unit 313 to enlarge / reduce the list image, and a received image holding unit 317 that holds thumbnail images, original images, and intermediate images received from the server side.

  The communication control unit 32 transmits a query input on the input screen displayed by the input screen display unit 311 to the search server 1 (FIG. 2) via the network 2 and the search server 1 to the network 2. A search result receiving unit 322 that receives a search result transmitted via the search result and passes it to the search result display unit 313, and starts processing immediately after an enlargement operation to the list image in the search result display unit 313 or immediately after the list display. An image acquisition / replacement unit 323 that acquires the original image or intermediate image and replaces the list image.

  The image acquisition / replacement unit 323 uses AJAX (Asynchronous JavaScript + XML: JavaScript (HyperText Transfer Protocol) communication function implemented in a Web browser) and the server and XML (Extensible Markup Language) without reloading the Web page. )) Is a software module that is configured to perform processing such as screen control by exchanging data in a format. The image acquisition / replacement unit 323 may be realized by Flash (software developed by Adobe, which can be used by installing a dedicated plug-in in a Web browser) instead of AJAX. .

  The image acquisition / replacement unit 323 sends an acquisition request for an original image or an intermediate image via the network 2 or the search during the enlargement operation to the list image displayed by the search result display unit 313 or immediately after the list display. An image acquisition request transmission unit 324 that transmits to the server 1; an image reception unit 325 that receives an original image or an intermediate image transmitted from the image providing source server 4 or the search server 1; A list image replacement unit 326 that replaces the list image by enlarging / reducing the original image or the intermediate image received by the unit 325 to the current display size.

  FIG. 5 is a diagram showing an example of the data structure of the list image management table 314. The “list image ID” for identifying the list image, the “display position” indicating the display position of the list image on the list screen, and the list image file “List image file name” indicating the name, “Type (thumbnail image, intermediate image, original image)” indicating whether the list image is a thumbnail image, an intermediate image or an original image, an intermediate image or an original image is “Status (Received, Receiving)” indicating whether it has been received or being received, “Display Size” indicating the display size of the list image on the list screen, and when the list image is partially enlarged It has an item “display area (ratio)” indicating the display area.

  Also, a “thumbnail image URL” indicating the storage location of the corresponding thumbnail image, a “thumbnail image size” indicating the size of the thumbnail image, an “original image URL” indicating the location of the original image, and an “original image” indicating the size of the original image Items such as “image size”, “intermediate image URL” indicating the storage destination of the intermediate image, and “intermediate image size” indicating the size of the intermediate image are included.

<First embodiment>
In the first embodiment, an original image is acquired according to an image size for a list image that is an object of enlargement operation.

  FIG. 6 is a flowchart showing an example of processing according to the first embodiment.

  In FIG. 6, when the client terminal 3 inputs an image search query with a keyword from the user via the query input unit 312 to the input screen displayed by the input screen display unit 311, the input screen display unit 311. Transmits the query input to the query transmission unit 321, and the query transmission unit 321 transmits the query to the search server 1 via the network 2 (step S101).

  When the query receiving unit 101 receives a query from the client terminal 3 via the network 2, the search server 1 searches the index DB 111 based on the keyword included in the query by the search execution unit 102, and the search result is the search result. The transmission unit 103 transmits the data to the client terminal 3 via the network 2. The search result includes the URL of the thumbnail image, the thumbnail image size, the URL of the corresponding original image, and the size of the original image.

  When the client terminal 3 receives the search result from the search server 1 via the network 2 by the search result receiving unit 322 (step S102), the client terminal 3 delivers the search result to the search result display unit 313. The search result display unit 313 stores the search results in the list image management table 314 and acquires thumbnail images from the search server 1. When the search request is received by the thumbnail image acquisition request receiving unit 104 from the client terminal 3 via the network 2, the search server 1 acquires the corresponding thumbnail image from the thumbnail image DB 112 by the thumbnail image acquisition unit 105, and the thumbnail image The thumbnail image transmission unit 106 transmits the image to the client terminal 3 via the network 2. The search result display unit 313 stores the acquired thumbnail images in the received image holding unit 317, and then displays a list of thumbnail images (step S103).

  Thereafter, when the search result display unit 313 receives an operation from the user via the image operation unit 315, the search result display unit 313 determines whether the operation is for the list image (step S104). Operations on the list image include an enlargement operation that grabs the corner of the list image with the mouse pointer and drags (drags) outward, a reduction operation that drags inward, and a partial enlargement start operation that places the mouse pointer on the list image It is. In addition, operations that are not performed on the list image include an operation of closing (closing) the list screen. In addition, about a specific operation content, there can be various deformation | transformation.

  If the operation is not an operation on the list image (No in step S104), it is subsequently determined whether the operation is a closing operation of the list screen (step S105). If the operation is not a closing operation (No in step S105), the operation is determined (step S105). Returning to S104), if the operation is a close operation (Yes in Step S105), the list screen is closed and the processing in FIG. 6 is terminated (Step S106).

  On the other hand, if the operation is for a list image (Yes in step S104), the search result display unit 313 subsequently determines whether the operation is an enlargement operation, a reduction operation, or a partial enlargement start operation (step S107).

  If the operation is an enlargement operation (enlargement in step S107), the search result display unit 313 subsequently determines whether the list image to be operated is a thumbnail image or an original image at the present time (step S108). Whether the list image is a thumbnail image or an original image can be determined by referring to the item “type” of the list image management table 314 (FIG. 5).

  If the list image is a thumbnail image (thumbnail in step S108), the search result display unit 313 subsequently determines whether an original image corresponding to the thumbnail image is currently being received (step S109). Whether or not the original image is currently being received can be determined by referring to the item “state” in the list image management table 314 (FIG. 5). If the original image is not currently received (No in step S109), the search result display unit 313 starts the original image acquisition process by the image acquisition / replacement unit 323 (step S110). Details of the original image acquisition process will be described later. If the original image is currently being received (Yes in step S109), since it is not necessary to newly acquire the original image, the acquisition process of the original image is not started. Next, in parallel with the original image acquisition process, the search result display unit 313 performs an enlargement process corresponding to the user's enlargement operation on the list image using the thumbnail image by the list image enlargement / reduction unit 316 (step S111). ), The process returns to the operation determination (step S104).

  If the list image is an original image (original in step S108), the search result display unit 313 performs an enlargement process corresponding to the user's enlargement operation on the list image based on the original image by the list image enlargement / reduction unit 316 ( Step S112) and return to the operation determination (Step S104).

  FIG. 7 is a diagram showing an example of a screen when enlarging the list image. When the user grabs the lower right corner of the list image D with the mouse pointer P indicated by the thick arrow from the list shown in FIG. 7A and drags it in the lower right direction, the state shown in FIG. As shown, the lower right corner of the list image D moves in conjunction with the movement of the mouse pointer P, so that the list image is enlarged. At this time, the display position is automatically shifted so that the other list images do not overlap with the enlarged list image D. It should be noted that the enlarged list image D may be displayed on top without shifting the display position of other list images, or when the mouse drag is released, the list image is restored to the original display size. You may make it return.

  Similarly, by grasping the lower right corner of the list image D with the mouse pointer P from the state of FIG. 7B and further dragging in the lower right direction, FIGS. 7C and 7D. It will be in the state shown in Note that if the list image D that is the target of the enlargement operation is a thumbnail image at that time, the image quality slightly deteriorates in the enlarged state, but the original image acquisition process (details of the process) performed in parallel is performed. The image is replaced when the original image is received in accordance with (to be described later), and the image quality is sufficient. In the case of a list image that is already an original image at the time of the enlargement operation, enlargement is performed with sufficient image quality from the beginning of the operation.

  FIG. 8 is a diagram showing another screen example when enlarging a list image. When an enlargement operation is performed on one list image included in the list, the same applies to other list images in the list screen. It is intended to be enlarged. When the user grabs the lower right corner of the list image A with the mouse pointer P from the list shown in FIG. 8A and drags it in the lower right direction, the list image as shown in FIG. 8B. The list image is enlarged by moving the lower right corner of A in conjunction with the movement of the mouse pointer P, and the other list images in the list screen are also enlarged at the same rate. Similarly, by grasping the lower right corner of the list image A with the mouse pointer P from the state of FIG. 8B and further dragging in the lower right direction, FIGS. 8C and 8D. It will be in the state shown in

  Returning to FIG. 6, in the case of a reduction operation (reduction in step S <b> 107), the search result display unit 313 performs a list image enlargement / reduction unit 316 on a list image (whether it is a thumbnail image or an original image). A reduction process corresponding to the user's reduction operation is performed (step S113), and the process returns to the operation determination (step S104).

  If the operation is a partial enlargement start operation (partial enlargement in step S107), the search result display unit 313 performs a partial enlargement process of the list image (step S114), and returns to the operation determination (step S104). Details of the partial enlargement process of the list image will be described later.

  FIG. 9 is a flowchart showing an example of an original image acquisition process (process activated in step S110 in FIG. 6) corresponding to a list image to be enlarged.

  In FIG. 9, when the search result display unit 313 starts processing (step S121), the search result display unit 313 determines whether or not the original image of the operated list image has a size equal to or larger than a predetermined size (for example, 2 times) of the thumbnail image ( Step S122). This determination can be made by referring to “thumbnail image size” and “original image size” in the list image management table 314 (FIG. 5). If the original image is not larger than a predetermined size of the thumbnail image (No in step S122), no significant improvement in image quality can be expected even if the original image is acquired (the thumbnail image can maintain the same image quality). Therefore, the acquisition of the original image is stopped and the process of FIG. 9 is terminated (step S127).

  On the other hand, when the original image has a size larger than the predetermined size of the thumbnail image (Yes in step S122), the search result display unit 313 requests the image acquisition / replacement unit 323 to acquire an image, and the image acquisition / replacement unit 323 Based on the original image URL (“original image URL” in the list image management table 314), the acquisition request transmission unit 324 transmits an original image acquisition request to the image providing source server 4 via the network 2 (step S123). The image providing source server 4 transmits the original image to the client terminal 3 via the network 2 by using a normal HTTP Web server function or the like.

  When the image receiving unit 325 of the image acquisition / replacement unit 323 receives the original image (step S124), the received image is stored in the received image holding unit 317 and the original image is delivered to the list image replacement unit 326. The list image management table 314 is also updated. The list image replacement unit 326 resizes (resizes) the original image up to the current display size (“display size” in the list image management table 314) of the list image to be enlarged (step S125), and the search result display unit 313. The thumbnail image that is the target of the enlargement operation managed in step (b) is replaced with the resized original image (step S126), and the process of FIG. 9 is terminated (step S127).

  In the above resizing process (step S125), when the list image is partially enlarged and displayed in the list, the display portion is displayed based on the display area ("display area" in the list image management table 314). Cut out together.

  FIG. 10 is a flowchart showing an example of the partial enlargement process (step S114 in FIG. 6).

  In FIG. 10, when the search result display unit 313 starts processing (step S131), an area designation window is opened (step S132). FIG. 11 is a diagram showing a screen example when the list image is partially enlarged. For example, when the mouse pointer P is placed on the list image D from the list shown in FIG. Then, an area designation window W is displayed as shown in FIG. In the area designating window W shown in FIG. 11B, the user drags the mouse pointer P in a straight line (upper left to lower right in the figure) to designate a rectangular area to be partially enlarged, and the partial enlarge button B Press to confirm the enlargement area specification.

  Returning to FIG. 10, the search result display unit 313 displays the position ratio of the designated area in the list image from the area designation window (for example, the upper left corner of the rectangle with the origin at the upper left corner of the list image with respect to the horizontal size and vertical size of the list image). The ratio of the X coordinate and the Y coordinate of the start position and the lower right end position) is acquired (step S133), and then it is determined whether or not the partial enlarge button has been pressed (step S134). If the partial enlarge button has not been pressed (No in step S134), the process returns to acquisition of the position ratio of the designated area (step S133).

  When the partial enlarge button is pressed (Yes in step S134), the search result display unit 313 closes the area designating window (step S135), and determines whether the list image is a thumbnail image or an original image (step S135). Step S136). Whether the list image is a thumbnail image or an original image can be determined by referring to the item “type” of the list image management table 314 (FIG. 5).

  If the list image is a thumbnail image (thumbnail in step S136), the search result display unit 313 subsequently determines whether or not the corresponding original image is currently received (step S137). Whether or not the original image is currently being received can be determined by referring to the item “state” in the list image management table 314 (FIG. 5). If the original image is not currently received (No in step S137), the search result display unit 313 starts the original image acquisition process by the image acquisition / replacement unit 323 (step S138). The original image acquisition process started here is the same as that shown in FIG.

  If the original image is currently being received (Yes in step S137), the original image acquisition process is not started because there is no need to newly acquire the original image. Next, the search result display unit 313 cuts out the designated area from the thumbnail image (step S139).

  On the other hand, when it is determined that the list image is the original image (original in step S136), the search result display unit 313 cuts out the designated area from the original image (step S140).

  After cutting out the designated area from the thumbnail image or the original image, the original image is resized (changed in size) to the current display size of the corresponding list image (“display size” in the list image management table 314) (step S141), and the search result The list image (whether it is a thumbnail image or an original image) that is the target of the partial enlargement operation managed by the display unit 313 is replaced with the resized original image (step S142). Then, an enlargement process is performed on the partially displayed list image in accordance with a user operation (step S143), and the process of FIG. 10 is terminated (step S144).

  FIG. 11C shows a state in which the designated area of the list image is cut out and replaced. The lower right corner of the partially displayed list image D is grasped with the mouse pointer P in the lower right direction. By dragging in the direction, it can be enlarged to an arbitrary size as shown in FIG.

  In addition, when the mouse pointer is placed on the list image and the partial enlargement start operation is started, the case where the current thumbnail image or the original image is shifted to the partial display has been described. You may enable it to expand.

<Second embodiment>
In the second embodiment, all the list images included in the search result immediately after displaying the list or the upper predetermined number with the highest display order (in order of the hit rate to the query) (for example, the top 10 of the 20 display) The original image is acquired according to the image size for each of the list images, and the original image is acquired preferentially according to the image size for the list image subjected to the enlargement operation.

  FIG. 12 is a flowchart showing an example of processing according to the second embodiment.

  In FIG. 12, when the client terminal 3 receives an image search query with a keyword from the user via the query input unit 312 on the input screen displayed by the input screen display unit 311, the input screen display unit 311. Transmits the query input to the query transmission unit 321, and the query transmission unit 321 transmits the query to the search server 1 via the network 2 (step S201).

  When the query receiving unit 101 receives a query from the client terminal 3 via the network 2, the search server 1 searches the index DB 111 based on the keyword included in the query by the search execution unit 102, and the search result is the search result. The transmission unit 103 transmits the data to the client terminal 3 via the network 2. The search result includes the URL of the thumbnail image, the thumbnail image size, the URL of the corresponding original image, and the size of the original image.

  When the client terminal 3 receives the search result from the search server 1 via the network 2 by the search result receiving unit 322 (step S202), the client terminal 3 delivers the search result to the search result display unit 313. The search result display unit 313 stores the search results in the list image management table 314 and acquires thumbnail images from the search server 1. When the search request is received by the thumbnail image acquisition request receiving unit 104 from the client terminal 3 via the network 2, the search server 1 acquires the corresponding thumbnail image from the thumbnail image DB 112 by the thumbnail image acquisition unit 105, and the thumbnail image The thumbnail image transmission unit 106 transmits the image to the client terminal 3 via the network 2. The search result display unit 313 stores the acquired thumbnail images in the received image holding unit 317, and then displays a list of thumbnail images (step S203).

  Next, the search result display unit 313 starts acquisition processing of original images for all the list images included in the search results or the upper predetermined number of list images having a higher display order (step S204). Details of the processing will be described later.

  Thereafter, when the search result display unit 313 receives an operation from the user via the image operation unit 315, the search result display unit 313 determines whether the operation is for the list image (step S205). Operations on the list image include an enlargement operation in which a corner of the list image is grabbed with the mouse pointer and dragged outward, a reduction operation in which the image is dragged inward, and a partial enlargement start operation for placing the mouse pointer on the list image. In addition, operations that are not performed on the list image include operations for closing the list screen. In addition, about a specific operation content, there can be various deformation | transformation.

  If the operation is not an operation on the list image (No in step S205), it is subsequently determined whether the operation is a closing operation of the list screen (step S206). If the operation is not a closing operation (No in step S206), the operation is determined (step S206). Returning to S205), if the operation is a close operation (Yes in Step S206), the processing of FIG. 12 is terminated together with the closing of the list screen (Step S207).

  On the other hand, if the operation is for a list image (Yes in step S205), the search result display unit 313 subsequently determines whether the operation is an enlargement operation, a reduction operation, or a partial enlargement start operation (step S208).

  If the operation is an enlargement operation (enlargement in step S208), the search result display unit 313 determines whether the list image that is the operation target is a thumbnail image or an original image at present (step S209). Whether the list image is a thumbnail image or an original image can be determined by referring to the item “type” of the list image management table 314 (FIG. 5).

  When the list image is a thumbnail image (thumbnail in step S209), the search result display unit 313 subsequently determines whether an original image corresponding to the thumbnail image is currently being received (step S210). Whether or not the original image is currently being received can be determined by referring to the item “state” in the list image management table 314 (FIG. 5). If the original image is not currently received (No in step S210), the search result display unit 313 starts an original image acquisition process by the image acquisition / replacement unit 323 (step S211). Details of the original image acquisition process will be described later. If the original image is currently being received (Yes in step S210), it is not necessary to newly acquire the original image, so the acquisition process of the original image is not started. Next, in parallel with the original image acquisition process, the search result display unit 313 performs an enlargement process corresponding to the user's enlargement operation on the list image using the thumbnail image by the list image enlargement / reduction unit 316 (step S212). ), And returns to the operation determination (step S205).

  If the list image is an original image (original in step S209), the search result display unit 313 performs an enlargement process according to the user's enlargement operation on the list image based on the original image by the list image enlargement / reduction unit 316 ( Step S213) and return to the operation determination (step S205).

  On the other hand, when the operation is a reduction operation (reduction in step S208), the search result display unit 313 reduces the list image (whether it is a thumbnail image or an original image) by the list image enlargement / reduction unit 316. A reduction process corresponding to the operation is performed (step S214), and the process returns to the operation determination (step S205).

  If the operation is a partial enlargement start operation (partial enlargement in step S208), the search result display unit 313 performs partial enlargement processing of the list image (step S215), and the process returns to the operation determination (step S205). The partial enlargement process of the list image is the same as that shown in FIG. 10, but the original image acquisition process that is started (step S138) is performed by starting the original image acquisition process (step S211) in FIG. It replaces the original image acquisition process (described later).

  FIG. 13 is a flowchart showing an example of an original image acquisition process (process activated in step S204 in FIG. 12) by batch processing.

  In FIG. 13, when the search result display unit 313 starts processing (step S221), the search result thumbnail images are sequentially designated from the top (step S222), and the original image is a predetermined multiple (for example, two times) of the thumbnail image. It is determined whether the size is the above or not (step S223). This determination can be made by referring to “thumbnail image size” and “original image size” in the list image management table 314 (FIG. 5). If the original image is not larger than a predetermined size of the thumbnail image (No in step S223), no significant improvement in image quality can be expected even if the original image is acquired (the thumbnail image can maintain the same image quality). Therefore, the process proceeds to determination (step S229) as to whether or not all or a predetermined number of thumbnail images have been processed.

  On the other hand, when the original image has a size larger than the predetermined size of the thumbnail image (Yes in Step S223), the search result display unit 313 subsequently receives the original image separately (including receiving) (Step S211 in FIG. 12). It is determined whether or not the original image has already been acquired in the original image acquisition process started in step S224 (step S224). This determination can be made by referring to the “state” or “type” of the list image management table 314 (FIG. 5). If the original image has been received separately (Yes in step S224), since it is not necessary to newly acquire the original image, it is determined whether all or a predetermined number of thumbnail images have been processed (step The process proceeds to S229).

  If the original image has not been received separately (No in step S224), the search result display unit 313 requests the image acquisition / replacement unit 323 to acquire an image, and the image acquisition / replacement unit 323 uses the image acquisition request transmission unit 324 to transmit the original image. Based on the URL (“original image URL” in the list image management table 314), an original image acquisition request is transmitted to the image providing source server 4 via the network 2 (step S225). The image providing source server 4 transmits the original image to the client terminal 3 via the network 2 by using a normal HTTP Web server function or the like.

  When the image receiving unit 325 of the image acquisition / replacement unit 323 receives the original image (step S226), the received image is stored in the received image holding unit 317 and the original image is delivered to the list image replacement unit 326. The list image management table 314 is also updated. The list image replacement unit 326 resizes (changes the size of) the original image up to the current display size of the corresponding list image (“display size” in the list image management table 314) (step S227), and is managed by the search result display unit 313. The thumbnail image of the corresponding list image is replaced with the resized original image (step S228), and the process proceeds to the determination (step S229) as to whether all or a predetermined number of thumbnail images have been processed. Note that in the above-described original image reception process (step S226), reception is stopped when a reception stop request described later is made, and re-reading is performed when a re-read request is made. Further, in the above resizing process (step S227), when the list image is partially enlarged in the list, the display portion is displayed based on the display area ("display area" in the list image management table 314). Cut out together.

  If all or a predetermined number of upper thumbnail images have been processed (step S229) and have not yet been processed (No in step S229), the process returns to the sequential designation of thumbnail images (step S222) and has been processed. If there is (Yes in step S229), the process in FIG. 13 is terminated (step S230).

  FIG. 14 is a flowchart showing an example of an original image acquisition process (process activated in step S211 in FIG. 12) corresponding to a list image to be enlarged.

  In FIG. 14, when the search result display unit 313 starts processing (step S241), the search result display unit 313 determines whether the original image of the operated list image is a size that is a predetermined size (for example, 2 times) or more of the thumbnail image (step S241). Step S242). This determination can be made by referring to “thumbnail image size” and “original image size” in the list image management table 314 (FIG. 5). If the original image is not larger than a predetermined size of the thumbnail image (No in step S242), a significant improvement in image quality cannot be expected even if the original image is acquired (the thumbnail image can maintain the same image quality). Therefore, the acquisition of the original image is stopped and the processing of FIG. 14 is ended (step S249).

  On the other hand, if the original image has a size larger than the predetermined size of the thumbnail image (Yes in step S242), the search result display unit 313 receives the original image corresponding to another list image, and if the original image is being received, A reception stop request is sent to H.323 (step S243). Whether or not an original image corresponding to another list image is being received can be determined by referring to the item of “state” in the list image management table 314 (FIG. 5).

  Next, the search result display unit 313 requests the image acquisition / replacement unit 323 to acquire an image, and the image acquisition / replacement unit 323 sends an original image URL (“original image URL” in the list image management table 314) by the image acquisition request transmission unit 324. ), An original image acquisition request is transmitted to the image provider server 4 via the network 2 (step S244). The image providing source server 4 transmits the original image to the client terminal 3 via the network 2 by using a normal HTTP Web server function or the like.

  When receiving the original image (step S245), the image receiving unit 325 of the image acquisition / replacement unit 323 stores the received original image in the received image holding unit 317 and delivers the original image to the list image replacement unit 326. The list image management table 314 is also updated. In addition, since the search result display unit 313 does not need to stop receiving the original image corresponding to the other list image by receiving the original image of the list image to be operated, the search result display unit 313 provides the image acquisition / replacement unit 323 with it. Then, a request for re-reading another original image is made (step S246).

  Next, the list image replacement unit 326 resizes (changes the size of) the original image up to the current display size of the corresponding list image (“display size” in the list image management table 314) (step S247), and the search result display unit 313 manages it. The thumbnail image of the corresponding list image is replaced with the resized original image (step S248), and the process of FIG. 14 is terminated (step S249). In the above resizing process (step S247), when the list image is partially enlarged and displayed in the list, the display portion is displayed based on the display area ("display area" in the list image management table 314). Cut out together.

<Third embodiment>
In the third embodiment, an intermediate image or an original image is acquired according to the image size for a list image that is an object of enlargement operation. By acquiring the images in three stages of the thumbnail image, the intermediate image, and the original image, it is possible to compensate for the delay in the enlargement process due to the difference in the data amount from the thumbnail image to the original image.

  FIG. 15 is a flowchart showing an example of processing according to the third embodiment.

  In FIG. 15, when a query for an image search with a keyword is input from the user via the query input unit 312 to the input screen displayed by the input screen display unit 311, the client terminal 3 inputs the input screen display unit 311. Transmits the query input to the query transmission unit 321, and the query transmission unit 321 transmits the query to the search server 1 via the network 2 (step S301).

  When the query receiving unit 101 receives a query from the client terminal 3 via the network 2, the search server 1 searches the index DB 111 based on the keyword included in the query by the search execution unit 102, and the search result is the search result. The transmission unit 103 transmits the data to the client terminal 3 via the network 2. The search result includes the URL of the thumbnail image, the thumbnail image size, the URL of the corresponding original image, the size of the original image, the URL of the intermediate image, and the size of the intermediate image.

  When the client terminal 3 receives the search result from the search server 1 via the network 2 by the search result receiving unit 322 (step S302), the client terminal 3 delivers the search result to the search result display unit 313. The search result display unit 313 stores the search results in the list image management table 314 and acquires thumbnail images from the search server 1. When the search request is received by the thumbnail image acquisition request receiving unit 104 from the client terminal 3 via the network 2, the search server 1 acquires the corresponding thumbnail image from the thumbnail image DB 112 by the thumbnail image acquisition unit 105, and the thumbnail image The thumbnail image transmission unit 106 transmits the image to the client terminal 3 via the network 2. The search result display unit 313 stores the acquired thumbnail images in the received image holding unit 317 and then displays a list of thumbnail images (step S303).

  Thereafter, when the search result display unit 313 receives an operation from the user via the image operation unit 315, the search result display unit 313 determines whether the operation is for the list image (step S304). Operations on the list image include an enlargement operation in which a corner of the list image is grabbed with the mouse pointer and dragged outward, a reduction operation in which the image is dragged inward, and a partial enlargement start operation for placing the mouse pointer on the list image. In addition, operations that are not performed on the list image include operations for closing the list screen. In addition, about a specific operation content, there can be various deformation | transformation.

  If the operation is not an operation on the list image (No in step S304), it is subsequently determined whether the operation is a closing operation of the list screen (step S305). If the operation is not a closing operation (No in step S305), the operation is determined (step S305). Returning to S304, if the operation is a close operation (Yes in Step S305), the process of FIG. 15 is terminated along with the closing of the list screen (Step S306).

  On the other hand, if the operation is an operation on the list image (Yes in step S304), the search result display unit 313 subsequently determines whether the operation is an enlargement operation, a reduction operation, or a partial enlargement start operation (step S307).

  In the case of an enlargement operation (enlargement in step S307), the search result display unit 313 determines whether the list image that is the operation target is a thumbnail image, an intermediate image, or an original image at the present time (step S308). ). Whether the list image is a thumbnail image, an intermediate image, or an original image can be determined by referring to the “type” item of the list image management table 314 (FIG. 5).

  When the list image is a thumbnail image (thumbnail in step S308), the search result display unit 313 subsequently determines whether an intermediate image or an original image corresponding to the thumbnail image is currently received (step S309). . Whether or not the intermediate image or the original image is currently received can be determined by referring to the item “state” in the list image management table 314 (FIG. 5). When the intermediate image or the original image is not currently received (No in step S309), the search result display unit 313 starts the intermediate image or original image acquisition process by the image acquisition / replacement unit 323 (step S310). Details of the intermediate image or original image acquisition process will be described later. If the intermediate image or the original image is currently being received (Yes in step S309), since it is not necessary to newly acquire the intermediate image or the original image, the acquisition process of the intermediate image or the original image is not started.

  Next, the search result display unit 313 performs an enlargement process corresponding to the user's enlargement operation on the list image using the thumbnail image by the list image enlargement / reduction unit 316 in parallel with the acquisition process of the intermediate image or the original image. (Step S311), the process returns to the operation determination (Step S304).

  When the list image is an intermediate image (middle of step S308), the search result display unit 313 performs an enlargement process corresponding to the user's enlargement operation on the list image based on the intermediate image by the list image enlargement / reduction unit 316 ( In step S312), the process returns to the operation determination (step S304).

  If the list image is an original image (original in step S308), the search result display unit 313 performs an enlargement process according to the user's enlargement operation on the list image based on the original image by the list image enlargement / reduction unit 316 ( Step S313) and return to the operation determination (Step S304).

  On the other hand, in the case of a reduction operation (reduction in step S307), the search result display unit 313 displays a list image enlargement / reduction unit for a list image (whether it is a thumbnail image, an intermediate image, or an original image). A reduction process corresponding to the user's reduction operation is performed at 316 (step S314), and the process returns to the operation determination (step S304).

  If the operation is a partial enlargement start operation (partial enlargement in step S307), the search result display unit 313 performs a partial enlargement process of the list image (step S315), and returns to the operation determination (step S304). The partial enlargement process of the list image is the same as that shown in FIG. 10, but the acquisition process of the original image that is started (step S138) is the intermediate image or original image acquisition process of FIG. 15 (step S310). It replaces the intermediate image or original image acquisition process (described later).

  FIG. 16 is a flowchart showing an example of an intermediate image or original image acquisition process (process activated in step S310 in FIG. 15) corresponding to a list image to be enlarged.

  In FIG. 16, when the search result display unit 313 starts processing (step S321), the search result display unit 313 determines whether or not the original image of the operated list image has a size equal to or larger than a predetermined size (for example, 2 times) of the thumbnail image ( Step S322). This determination can be made by referring to “thumbnail image size” and “original image size” in the list image management table 314 (FIG. 5). If the original image is not larger than a predetermined size of the thumbnail image (No in step S322), no significant improvement in image quality can be expected even if the original image is acquired (the thumbnail image can maintain the same image quality). Therefore, the acquisition of the intermediate image or the original image is stopped and the processing of FIG. 16 is ended (step S332).

  On the other hand, when the original image is a size larger than the predetermined size of the thumbnail image (Yes in step S322), the search result display unit 313 subsequently determines whether the data difference between the original image and the thumbnail image is equal to or greater than a predetermined value. (Step S323). This is because if the data difference between the original image and the thumbnail image is greater than or equal to a predetermined value, the intermediate image is acquired in advance to maintain the image quality faster, and if the data difference is less than the predetermined value, the intermediate image is This is because the acquisition of the intermediate image is omitted because the acquisition is not so effective.

  When the data difference between the original image and the thumbnail image is equal to or larger than the predetermined value (Yes in step S323), the search result display unit 313 requests the image acquisition / replacement unit 323 to acquire the image, and the image acquisition / replacement unit 323 acquires the image. The request transmission unit 324 transmits an intermediate image acquisition request to the search server 1 via the network 2 based on the intermediate image URL (“intermediate image URL” in the list image management table 314) (step S324). When the search server 1 receives an intermediate image acquisition request from the client terminal 3 via the network 2 by the intermediate image acquisition request receiving unit 107, the intermediate image acquisition unit 108 acquires the corresponding intermediate image from the intermediate image DB 113, and the intermediate image The transmission unit 109 transmits the intermediate image to the client terminal 3 via the network 2.

  When receiving the intermediate image (step S325), the image receiving unit 325 of the image acquisition / replacement unit 323 stores the received intermediate image in the received image holding unit 317 and delivers the intermediate image to the list image replacement unit 326. The list image management table 314 is also updated. The list image replacement unit 326 resizes (resizes) the intermediate image up to the current display size of the corresponding list image (“display size” in the list image management table 314) (step S326), and is managed by the search result display unit 313. The thumbnail image of the corresponding list image is replaced with the resized intermediate image (step S327). In the above resizing process (step S326), when the list image is partially enlarged and displayed in the list, the display portion is displayed based on the display area ("display area" in the list image management table 314). Cut out together.

  After that, or when the data difference between the original image and the thumbnail image is not equal to or larger than the predetermined value (No in step S323), the search result display unit 313 requests the image acquisition / replacement unit 323 to acquire the image, and the image acquisition / replacement unit 323 Based on the original image URL (“original image URL” in the list image management table 314), the image acquisition request transmission unit 324 transmits an original image acquisition request to the image providing source server 4 via the network 2 (step S328). . The image providing source server 4 transmits the original image to the client terminal 3 via the network 2 by using a normal HTTP Web server function or the like.

  When receiving the original image (step S329), the image receiving unit 325 of the image acquisition / replacement unit 323 stores the received original image in the received image holding unit 317 and delivers the original image to the list image replacement unit 326. The list image management table 314 is also updated. The list image replacement unit 326 resizes (resizes) the original image up to the current display size of the corresponding list image (“display size” in the list image management table 314) (step S330), and is managed by the search result display unit 313. The corresponding list image (the intermediate image replaced in step S327 or the thumbnail image displayed in step S303) is replaced with the resized original image (step S331), and the process of FIG. 16 is terminated (step S332). In the above resizing process (step S330), when the list image is partially enlarged and displayed in the list, the display portion is displayed based on the display area ("display area" in the list image management table 314). Cut out together.

  Although the acquisition of the original image is performed subsequent to the acquisition of the intermediate image, once the intermediate image is acquired, the intermediate image is not enlarged without being shifted continuously to the acquisition of the original image. The operation may be performed, and the original image may be acquired when the display size by enlargement exceeds the display size that can be displayed by the intermediate image and the image quality cannot be maintained.

  FIG. 17 is a diagram illustrating a transition example of the display target image when the list image is enlarged. If the list image A is displayed by the thumbnail image provided from the thumbnail image DB 112 of the search server 1 in the state shown in (a), the lower right corner of the list image A is moved to the lower right direction with the mouse pointer P. By dragging to, the acquisition of the intermediate image is started. Since it takes some time to acquire the intermediate image, enlargement to the state of (b) is performed based on the thumbnail image. Thereafter, when the reception of the intermediate image is completed, the list image A is replaced with the intermediate image acquired from the intermediate image DB 113 of the search server 1, and the enlargement operation shown in (c) is performed while maintaining the image quality by the intermediate image. . Similarly, the enlargement to the state of (d) is performed based on the intermediate image, and thereafter, when reception of the original image is completed, the list image A is replaced with the original image acquired from the image providing source server 4, ( The enlargement operation shown in e) is performed while maintaining the image quality with the original image.

<Fourth embodiment>
In the fourth embodiment, an intermediate image or an original image is acquired according to the image size for all the list images included in the search results immediately after the list display or the upper predetermined number of list images having a high display order, and an enlargement operation is performed. The intermediate image or the original image is preferentially acquired according to the image size for the list image that is the target of the above.

  FIG. 18 is a flowchart showing an example of processing according to the fourth embodiment.

  In FIG. 18, when the client terminal 3 receives an image search query with a keyword from the user via the query input unit 312 on the input screen displayed by the input screen display unit 311, the input screen display unit 311. Transmits the query input to the query transmission unit 321, and the query transmission unit 321 transmits the query to the search server 1 via the network 2 (step S401).

  When the query receiving unit 101 receives a query from the client terminal 3 via the network 2, the search server 1 searches the index DB 111 based on the keyword included in the query by the search execution unit 102, and the search result is the search result. The transmission unit 103 transmits the data to the client terminal 3 via the network 2. The search result includes the URL of the thumbnail image, the thumbnail image size, the URL of the corresponding original image, the size of the original image, the URL of the intermediate image, and the size of the intermediate image.

  When the client terminal 3 receives the search result from the search server 1 via the network 2 by the search result receiving unit 322 (step S402), the client terminal 3 delivers the search result to the search result display unit 313. The search result display unit 313 stores the search results in the list image management table 314 and acquires thumbnail images from the search server 1. When the search request is received by the thumbnail image acquisition request receiving unit 104 from the client terminal 3 via the network 2, the search server 1 acquires the corresponding thumbnail image from the thumbnail image DB 112 by the thumbnail image acquisition unit 105, and the thumbnail image The thumbnail image transmission unit 106 transmits the image to the client terminal 3 via the network 2. The search result display unit 313 stores the acquired thumbnail images in the received image holding unit 317, and then displays a list of thumbnail images (step S403).

  Next, the search result display unit 313 starts acquisition processing of intermediate images or original images for all the list images included in the search results or the upper predetermined number of list images having a higher display order (step S404). Details of the processing will be described later.

  Thereafter, when the search result display unit 313 receives an operation from the user via the image operation unit 315, the search result display unit 313 determines whether the operation is an operation on the list image (step S405). Operations on the list image include an enlargement operation in which a corner of the list image is grabbed with the mouse pointer and dragged outward, a reduction operation in which the image is dragged inward, and a partial enlargement start operation for placing the mouse pointer on the list image. In addition, operations that are not performed on the list image include operations for closing the list screen. In addition, about a specific operation content, there can be various deformation | transformation.

  If the operation is not an operation on the list image (No in step S405), it is subsequently determined whether the operation is a closing operation of the list screen (step S406). If the operation is not a closing operation (No in step S406), the operation is determined (step Returning to S405), if the operation is a close operation (Yes in step S406), the process of FIG. 18 is terminated together with the closing of the list screen (step S407).

  On the other hand, when the operation is an operation on the list image (Yes in step S405), the search result display unit 313 subsequently determines whether the operation is an enlargement operation, a reduction operation, or a partial enlargement start operation (step S408).

  If the operation is an enlargement operation (enlargement in step S408), the search result display unit 313 subsequently determines whether the list image that is the operation target is a thumbnail image, an intermediate image, or an original image at the present time (step S409). ). Whether the list image is a thumbnail image, an intermediate image, or an original image can be determined by referring to the “type” item of the list image management table 314 (FIG. 5).

  When the list image is a thumbnail image (thumbnail in step S409), the search result display unit 313 subsequently determines whether an intermediate image or original image corresponding to the thumbnail image is currently being received (step S410). . Whether or not the intermediate image or the original image is currently received can be determined by referring to the item “state” in the list image management table 314 (FIG. 5). If the intermediate image or the original image is not currently received (step S410: No), the search result display unit 313 starts the intermediate image or original image acquisition process by the image acquisition / replacement unit 323 (step S411). Details of the original image acquisition process will be described later. If the intermediate image or the original image is currently being received (Yes in step S410), it is not necessary to newly acquire the intermediate image or the original image, so the acquisition process of the intermediate image or the original image is not started. Next, the search result display unit 313 performs an enlargement process corresponding to the user's enlargement operation on the list image using the thumbnail image by the list image enlargement / reduction unit 316 in parallel with the acquisition process of the intermediate image or the original image. (Step S412), the process returns to the operation determination (Step S405).

  When the list image is an intermediate image (middle of step S409), the search result display unit 313 performs an enlargement process corresponding to the user's enlargement operation on the list image based on the intermediate image by the list image enlargement / reduction unit 316 ( Step S413) and return to the operation determination (Step S405).

  When the list image is an original image (original in step S409), the search result display unit 313 performs an enlargement process corresponding to the user's enlargement operation on the list image based on the original image by the list image enlargement / reduction unit 316 ( Step S414), the process returns to the operation determination (step S405).

  On the other hand, when the operation is a reduction operation (reduction in step S408), the search result display unit 313 displays a list image enlargement / reduction unit for a list image (whether it is a thumbnail image, an intermediate image, or an original image). In 316, a reduction process corresponding to the user's reduction operation is performed (step S415), and the process returns to operation determination (step S405).

  If the operation is a partial enlargement start operation (partial enlargement in step S408), the search result display unit 313 performs partial enlargement processing of the list image (step S416), and the process returns to the operation determination (step S405). The partial enlargement process of the list image is the same as that shown in FIG. 10, but the original image acquisition process started therein (step S138) starts the intermediate image or original image acquisition process of FIG. 18 (step S411). It replaces the intermediate image or original image acquisition process (described later).

  FIG. 19 is a flowchart showing an example of an original image acquisition process (process activated in step S404 in FIG. 18) by batch processing.

  In FIG. 19, when the search result display unit 313 starts processing (step S421), the thumbnail images of the search results are sequentially specified from the top (step S422), and the original image is a predetermined multiple (for example, two times) of the thumbnail image. ) It is determined whether or not the size is the above (step S423). This determination can be made by referring to “thumbnail image size” and “original image size” in the list image management table 314 (FIG. 5). If the original image is not larger than a predetermined size of the thumbnail image (No in step S423), no significant improvement in image quality can be expected even if the intermediate image or the original image is acquired (an equivalent image quality is maintained by the thumbnail image). Therefore, the process proceeds to determination (step S434) as to whether or not all or a predetermined number of thumbnail images have been processed.

  On the other hand, when the original image has a size larger than the predetermined size of the thumbnail image (Yes in step S423), the search result display unit 313 subsequently receives the intermediate image or the original image separately (including during reception) (FIG. 18). It is determined whether or not the intermediate image or original image has already been acquired in the intermediate image or original image acquisition process started in step S411 (step S424). This determination can be made by referring to the “state” or “type” of the list image management table 314 (FIG. 5). If the original image has been received separately (Yes in step S424), since it is not necessary to newly acquire an intermediate image or an original image, it is determined whether all or a predetermined number of thumbnail images have been processed. The process proceeds to determination (step S434).

  When the intermediate image or the original image has not been received separately (No in step S424), the search result display unit 313 subsequently determines whether the data difference between the original image and the thumbnail image is equal to or greater than a predetermined value (step S425). This is because if the data difference between the original image and the thumbnail image is greater than or equal to a predetermined value, the intermediate image is acquired in advance to maintain the image quality faster, and if the data difference is less than the predetermined value, the intermediate image is This is because the acquisition of the intermediate image is omitted because the acquisition is not so effective.

  If the data difference between the original image and the thumbnail image is greater than or equal to a predetermined value (Yes in step S425), the search result display unit 313 requests the image acquisition / replacement unit 323 to acquire an image, and the image acquisition / replacement unit 323 acquires the image. The request transmission unit 324 transmits an intermediate image acquisition request to the search server 1 via the network 2 based on the intermediate image URL (“intermediate image URL” in the list image management table 314) (step S426). When the search server 1 receives an intermediate image acquisition request from the client terminal 3 via the network 2 by the intermediate image acquisition request receiving unit 107, the intermediate image acquisition unit 108 acquires the corresponding intermediate image from the intermediate image DB 113, and the intermediate image The transmission unit 109 transmits the intermediate image to the client terminal 3 via the network 2.

  When receiving the intermediate image (step S427), the image receiving unit 325 of the image acquisition / replacement unit 323 stores the received intermediate image in the received image holding unit 317 and delivers the intermediate image to the list image replacement unit 326. The list image management table 314 is also updated. The list image replacement unit 326 resizes (resizes) the intermediate image up to the current display size of the corresponding list image (“display size” in the list image management table 314) (step S428), and is managed by the search result display unit 313. The thumbnail image of the corresponding list image is replaced with the resized intermediate image (step S429). In the above-described original image reception process (step S427), the reception is stopped when a later-described reception stop request is made, and the re-read is performed when a re-read request is made. Further, in the above resizing process (step S428), when the list image is partially enlarged and displayed in the list, the display portion is displayed based on the display area ("display area" in the list image management table 314). Cut out together.

  After that, or when the data difference between the original image and the thumbnail image is not equal to or larger than the predetermined value (No in step S425), the search result display unit 313 requests the image acquisition / replacement unit 323 to acquire the image, and the image acquisition / replacement unit 323 Based on the original image URL (“original image URL” in the list image management table 314), the image acquisition request transmission unit 324 transmits an original image acquisition request to the image providing source server 4 via the network 2 (step S430). . The image providing source server 4 transmits the original image to the client terminal 3 via the network 2 by using a normal HTTP Web server function or the like.

  When receiving the original image (step S431), the image receiving unit 325 of the image acquisition / replacement unit 323 stores the received original image in the received image holding unit 317 and delivers the original image to the list image replacement unit 326. The list image management table 314 is also updated. The list image replacement unit 326 resizes (resizes) the original image up to the current display size of the corresponding list image (“display size” in the list image management table 314) (step S432), and is managed by the search result display unit 313. The corresponding list image (the intermediate image replaced in step S429 or the thumbnail image displayed in step S403) is replaced with the resized original image (step S433), and whether or not all or a predetermined number of thumbnail images have been processed. The process proceeds to determination (step S434). In the above-described original image reception process (step S431), the reception is stopped when a later-described reception stop request is made, and the re-read is performed when a re-read request is made. In the above resizing process (step S432), when the list image is partially enlarged in the list and displayed, the display portion is displayed based on the display area ("display area" in the list image management table 314). Cut out together.

  If all or a predetermined number of upper thumbnail images have been processed (step S434) and have not yet been processed (No in step S434), the process returns to the sequential designation of thumbnail images (step S422) and has been processed. If there is (Yes in step S434), the process in FIG. 19 is terminated (step S435).

  Although the acquisition of the original image is performed subsequent to the acquisition of the intermediate image, once the intermediate image is acquired, the intermediate image is not enlarged without being shifted continuously to the acquisition of the original image. The operation may be performed, and the original image may be acquired when the display size by enlargement exceeds the display size that can be displayed by the intermediate image and the image quality cannot be maintained.

  FIG. 20 is a flowchart illustrating an example of an intermediate image or original image acquisition process (process activated in step S411 in FIG. 18) corresponding to a list image to be enlarged.

  In FIG. 20, when the search result display unit 313 starts processing (step S441), the search result display unit 313 determines whether or not the original image of the operated list image has a size larger than a predetermined size (for example, 2 times) of the thumbnail image (see FIG. 20). Step S442). This determination can be made by referring to “thumbnail image size” and “original image size” in the list image management table 314 (FIG. 5). If the original image is not larger than a predetermined size of the thumbnail image (No in step S442), a significant improvement in image quality cannot be expected even if the original image is acquired (the thumbnail image can maintain the same image quality). Therefore, the acquisition of the original image is stopped and the process of FIG. 20 is terminated (step S456).

  On the other hand, when the original image has a size larger than a predetermined size of the thumbnail image (Yes in step S442), the search result display unit 313 subsequently determines whether or not the data difference between the original image and the thumbnail image is a predetermined value or more. (Step S443). This is because if the data difference between the original image and the thumbnail image is greater than or equal to a predetermined value, the intermediate image is acquired in advance to maintain the image quality faster, and if the data difference is less than the predetermined value, the intermediate image is This is because the acquisition of the intermediate image is omitted because the acquisition is not so effective.

  If the data difference between the original image and the thumbnail image is greater than or equal to a predetermined value (Yes in step S443), the search result display unit 313 receives an intermediate image or original image corresponding to another list image, A reception stop request is sent to the replacement unit 323 (step S444). Whether an intermediate image or an original image corresponding to another list image is being received can be determined by referring to the item “state” in the list image management table 314 (FIG. 5).

  Next, the search result display unit 313 requests the image acquisition / replacement unit 323 to acquire an image, and the image acquisition / replacement unit 323 transmits an intermediate image URL (“intermediate image URL” in the list image management table 314) by the image acquisition request transmission unit 324. ), An intermediate image acquisition request is transmitted to the search server 1 via the network 2 (step S445). When the search server 1 receives an intermediate image acquisition request from the client terminal 3 via the network 2 by the intermediate image acquisition request receiving unit 107, the intermediate image acquisition unit 108 acquires the corresponding intermediate image from the intermediate image DB 113, and the intermediate image The transmission unit 109 transmits the intermediate image to the client terminal 3 via the network 2.

  When the image receiving unit 325 of the image acquisition / replacement unit 323 receives the intermediate image (step S446), the intermediate reception unit 317 stores the received intermediate image in the received image holding unit 317 and delivers the intermediate image to the list image replacement unit 326. The list image management table 314 is also updated. In addition, since the search result display unit 313 has received the intermediate image of the list image to be operated, there is no need to stop receiving the intermediate image or the original image corresponding to the other list image. A request to re-read another intermediate image or original image is made to H.323 (step S447).

  Next, the list image replacement unit 326 resizes (changes the size of) the intermediate image up to the current display size of the corresponding list image (“display size” in the list image management table 314) (step S448), and the search result display unit 313 manages it. The thumbnail image of the corresponding list image is replaced with the resized intermediate image (step S449). In the above resizing process (step S448), when the list image is partially enlarged and displayed in the list, the display portion is displayed based on the display area ("display area" in the list image management table 314). Cut out together.

  After that, or when the data difference between the original image and the thumbnail image is not greater than or equal to the predetermined value (No in step S443), the search result display unit 313 except for the case where an intermediate image is requested for acquisition, If the original image is being received, a reception stop request is made to the image acquisition / replacement unit 323 (step S450). This is because, when an acquisition request for an intermediate image is made, the image quality can be maintained by the intermediate image received later, so there is no need to rush to acquire the original image. Whether an intermediate image or an original image corresponding to another list image is being received can be determined by referring to the item “state” in the list image management table 314 (FIG. 5).

  Next, the search result display unit 313 requests the image acquisition / replacement unit 323 to acquire an image, and the image acquisition / replacement unit 323 sends an original image URL (“original image URL” in the list image management table 314) by the image acquisition request transmission unit 324. ) To send an original image acquisition request to the image provider server 4 via the network 2 (step S451). The image providing source server 4 transmits the original image to the client terminal 3 via the network 2 by using a normal HTTP Web server function or the like.

  When receiving the original image (step S452), the image receiving unit 325 of the image acquisition / replacement unit 323 stores the received original image in the received image holding unit 317 and delivers the original image to the list image replacement unit 326. The list image management table 314 is also updated. In addition, since the search result display unit 313 has received the original image of the list image to be operated, there is no need to stop receiving the intermediate image or the original image corresponding to the other list image. A request to re-read another intermediate image or original image is made to H.323 (step S453).

  Next, the list image replacement unit 326 resizes (changes the size of) the original image to the current display size of the corresponding list image (“display size” in the list image management table 314) (step S454), and the search result display unit 313 manages it. The thumbnail image of the corresponding list image is replaced with the resized original image (step S455), and the process of FIG. 20 is terminated (step S456). In the above resizing process (step S454), when the list image is partially enlarged in the list, it is displayed based on the display area (“display area” in the list image management table 314). Cut out together.

  Although the acquisition of the original image is performed subsequent to the acquisition of the intermediate image, once the intermediate image is acquired, the intermediate image is not enlarged without being shifted continuously to the acquisition of the original image. The operation may be performed, and the original image may be acquired when the display size by enlargement cannot maintain the image quality.

<Summary>
As described above, according to the embodiment of the present invention, there are the following advantages.
(1) The list image can be changed to a desired size on the thumbnail image list screen, and even when comparing the images, there is no need to perform page transition and the operation becomes easy.
(2) Since the intermediate image or original image is acquired and replaced by processing on the back side of the image display for the list image of the operation target, the image quality of the image being enlarged is prevented from becoming rough, and appropriate image quality is maintained. can do.
(3) The list image can be arbitrarily enlarged or reduced on the list screen, and can be enlarged beyond the size of the original image without using another application.
(4) When all original images are not received, the memory consumption of the client terminal is suppressed and the burden on the client terminal is reduced.

  The present invention has been described above by the preferred embodiments of the present invention. While the invention has been described with reference to specific embodiments, various modifications and changes may be made to the embodiments without departing from the broad spirit and scope of the invention as defined in the claims. Obviously you can. In other words, the present invention should not be construed as being limited by the details of the specific examples and the accompanying drawings.

It is a figure which shows the outline | summary of the conventional image search service. It is a figure which shows the structural example of the system concerning one Embodiment of this invention. It is a figure which shows the structural example of a search server. It is a figure which shows the structural example of a client terminal. It is a figure which shows the example of a data structure of a list image management table. It is a flowchart which shows the process example concerning a 1st Example. FIG. 10 is a first diagram illustrating an exemplary screen when enlarging a list image; FIG. 10 is a second diagram illustrating an exemplary screen when enlarging a list image; It is a flowchart which shows the example of the acquisition process of the original image corresponding to the list image of enlargement operation object. It is a flowchart which shows the example of a partial expansion process. It is a figure which shows the example of a screen at the time of partial expansion of a list image. It is a flowchart which shows the process example concerning a 2nd Example. It is a flowchart which shows the example of the acquisition process of the original image by a batch process. It is a flowchart which shows the example of the acquisition process of the original image corresponding to the list image of enlargement operation object. It is a flowchart which shows the process example concerning a 3rd Example. 12 is a flowchart illustrating an example of acquisition processing of an intermediate image or an original image corresponding to a list image to be enlarged. It is a figure which shows the example of a transition of the display target image at the time of the expansion of a list image. It is a flowchart which shows the process example concerning a 4th Example. It is a flowchart which shows the example of the acquisition process of the original image by a batch process. 12 is a flowchart illustrating an example of acquisition processing of an intermediate image or an original image corresponding to a list image to be enlarged.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Search server 101 Query reception part 102 Search execution part 103 Search result transmission part 104 Thumbnail image acquisition request reception part 105 Thumbnail image acquisition part 106 Thumbnail image transmission part 107 Intermediate image acquisition request reception part 108 Intermediate image acquisition part 109 Intermediate image transmission part 111 Index DB
112 Thumbnail image DB
113 Intermediate image DB
2 network 3 client terminal 31 UI control unit 311 input screen display unit 312 query input unit 313 search result display unit 314 list image management table 315 image operation unit 316 list image enlargement / reduction unit 317 received image holding unit 32 communication control unit 321 query transmission Unit 322 Search result receiving unit 323 Image acquisition / replacement unit 324 Image acquisition request transmission unit 325 Image reception unit 326 List image replacement unit 4 Image provider server

Claims (17)

List display means for displaying a list of a plurality of images received from the server;
Operation means for performing an enlargement or reduction operation on each image in the list;
An obtaining unit that obtains an original image corresponding to the thumbnail image from the server when the image is a thumbnail image for the enlargement operation by the operation unit;
A list image display device comprising image replacement means for replacing the images on the list by enlarging or reducing the acquired original image up to the display size of the thumbnail image subjected to the enlargement operation. The list image display device according to claim 1,
The acquisition means is
A list image display device which starts acquisition of original images corresponding to all thumbnail images when receiving a plurality of thumbnail images from a server and displaying the list. The list image display device according to claim 1,
The acquisition means is
List image display characterized in that when a plurality of thumbnail images are received from a server and displayed as a list, acquisition of original images corresponding to a predetermined number of thumbnail images having a higher display order among all thumbnail images is started. apparatus. The list image display device according to claim 1,
The acquisition means is
A list image display device, wherein when a plurality of thumbnail images are received from the server and displayed in a list, acquisition of an original image corresponding to the image subjected to the enlargement operation is started. In the list image display device according to any one of claims 1 to 4,
The acquisition means is
A list image display device that compares the size of the thumbnail image with the size of the original image corresponding to the thumbnail image, and omits the process of acquiring the original image when the size difference is less than a predetermined value. . List display means for displaying a list of a plurality of images received from the server;
Operation means for performing an enlargement or reduction operation on each image in the list;
First acquisition means for acquiring, from a server, an intermediate image corresponding to the thumbnail image when the image is a thumbnail image for the enlargement operation by the operation means;
First image replacement means for expanding or reducing the acquired intermediate image up to the display size of the thumbnail image subjected to the enlargement operation and replacing the image on the list;
Second acquisition means for acquiring an original image corresponding to the intermediate image from the server following acquisition of the intermediate image;
A list image display device comprising: a second image replacement unit that expands or reduces the acquired original image to a display size of the replaced intermediate image on the list and replaces the image on the list. . The list image display device according to claim 6,
The first and second acquisition means are:
A list image display device which starts acquisition of an intermediate image or an original image corresponding to all thumbnail images when receiving a plurality of thumbnail images from a server and displaying a list. The list image display device according to claim 6,
The first and second acquisition means are:
When receiving a plurality of thumbnail images from a server and displaying a list, acquisition of intermediate images or original images corresponding to a predetermined number of thumbnail images having a higher display order among all thumbnail images is started. List image display device. The list image display device according to claim 6,
The first and second acquisition means are:
An apparatus for displaying a list image, wherein when a plurality of thumbnail images are received from the server and displayed as a list, acquisition of an intermediate image or an original image corresponding to the image subjected to the enlargement operation is started. In the list image display device according to any one of claims 6 to 9,
The first and second acquisition means are:
The size of the thumbnail image is compared with the size of the original image corresponding to the thumbnail image, and the acquisition of the intermediate image and the original image is omitted when the size difference is less than the size difference corresponding to the first predetermined value. The intermediate image acquisition process is omitted when the size difference is larger than the first predetermined value and smaller than the second predetermined value larger than the first predetermined value. A list image display device as a feature. In the list image display device according to any one of claims 1 to 10,
A list image display device comprising means for partially enlarging each image in the list by designating a region in the displayed image. List display means for displaying a list of a plurality of images received from the server;
When an enlargement operation is performed on an individual image in the above list, if the image targeted for the enlargement operation is a thumbnail image, the original image corresponding to the thumbnail image is received. When starting, the thumbnail image is enlarged according to the enlargement operation, and when reception of the original image is completed, the original image is enlarged or reduced to the display size of the thumbnail image to replace the image on the list. A list image display device comprising image replacement means. List display means for displaying a list of a plurality of images received from the server;
When an enlargement operation is performed on each image in the above list, if the image targeted for the enlargement operation is a thumbnail image, an intermediate image corresponding to the thumbnail image is received. When starting, the thumbnail image is enlarged according to the enlargement operation, and when reception of the intermediate image is completed, the intermediate image is enlarged or reduced to the display size of the thumbnail image to replace the image on the list. First image replacement means;
Following the completion of reception of the intermediate image, the reception of the original image corresponding to the thumbnail image that is the target of the enlargement operation is started, and the replaced intermediate image is enlarged according to the enlargement operation. A list image display device comprising: a second image replacement unit that, when reception is completed, enlarges or reduces the original image to the display size of the intermediate image and replaces the image on the list. A list display step for displaying a plurality of images received from the server as a list;
An operation step of performing an enlargement or reduction operation on each image in the above list;
An acquisition step of acquiring an original image corresponding to the thumbnail image from the server when it is a thumbnail image for an image subjected to an enlargement operation by the operation step;
A list image display control method comprising: an image replacement step of replacing the image on the list by enlarging or reducing the acquired original image to the display size of the thumbnail image subjected to the enlargement operation . A list display step for displaying a plurality of images received from the server as a list;
An operation step of performing an enlargement or reduction operation on each image in the above list;
A first acquisition step of acquiring, from the server, an intermediate image corresponding to the thumbnail image when the image is the target of the enlargement operation in the operation step;
A first image replacement step of enlarging or reducing the acquired intermediate image to replace the image on the list to the display size of the thumbnail image that is the target of the enlargement operation;
A second acquisition step of acquiring an original image corresponding to the intermediate image from the server following acquisition of the intermediate image;
A list image display control comprising: a second image replacement step of replacing the image on the list by enlarging or reducing the acquired original image to the display size of the replaced intermediate image on the list. Method. Computer
List display means for displaying a list of a plurality of images received from the server,
An operation means for performing an enlargement or reduction operation on each image in the list,
Obtaining means for obtaining, from a server, an original image corresponding to the thumbnail image when the thumbnail image is an image subjected to an enlargement operation by the operation means;
An image replacement means for enlarging or reducing the acquired original image up to the display size of the thumbnail image subjected to the enlarging operation and replacing the image on the list;
A computer-readable list image display control program that functions as a computer program. Computer
List display means for displaying a list of a plurality of images received from the server,
An operation means for performing an enlargement or reduction operation on each image in the list,
First acquisition means for acquiring, from a server, an intermediate image corresponding to the thumbnail image when the image has been subjected to an enlargement operation by the operation means when the image is a thumbnail image;
First image replacement means for expanding or reducing the acquired intermediate image to the display size of the thumbnail image subjected to the enlargement operation and replacing the image on the list;
Second acquisition means for acquiring an original image corresponding to the intermediate image from the server following acquisition of the intermediate image;
Second image replacement means for expanding or reducing the acquired original image to the display size of the replaced intermediate image on the list to replace the image on the list;
A computer-readable list image display control program that functions as a computer program.

Images