JP2007065793A - Display controller and display control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display controller capable of improving a display property and operability when making a display device simultaneously display a plurality of images. <P>SOLUTION: The plurality of images P1 displayed on a screen DP of the display device 4 are partially superimposed such that a key item K1 included inside each the image P1 is displayed in at least one portion along at least one layout reference line L set on the screen DP, and are exhibited and displayed. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a display control device and a display control method, and more particularly to a display control technique suitable for use when simultaneously displaying a plurality of images on a display device.

  In recent years, with the spread of the Internet, it has become possible to acquire various information from each home computer (for example, a personal computer) via the Internet, and display and browse the acquired information on a display device connected to the computer. Yes.

  Conventionally, when a plurality of images acquired by a computer or a plurality of images stored in an internal or external storage device after the acquisition are displayed on a display device and the images are searched for from the display device, the display device Are generally displayed in a thumbnail (reduced image) format in a vertical and horizontal matrix.

  However, in the above method, since a plurality of thumbnails are simply displayed in a list, when the number of images displayed at a time increases, it is intuitively determined what kind of images are included in the images. It becomes difficult to interpret and understand. For this reason, there is a problem that it takes time to find the target image. At that time, in some cases, an operation of scrolling up, down, left and right in the screen may be required, and this is also troublesome. Further, when the target image is stored in the storage device, it is necessary to perform a prior work such as searching for a folder in which the file exists, and accordingly, it takes much time and labor. In addition, a series of operations such as searching for folders and scrolling operations are complicated and difficult to understand for elderly people and those who are unfamiliar with computer operations, so-called information weak people. Further use of applications that handle images It was one of the impediments to expansion.

  The present invention has been made in view of such conventional circumstances, and an object of the present invention is to provide a display control device and a display capable of improving display properties and operability when simultaneously displaying a plurality of images on a display device. It is to provide a control method.

  In order to achieve the above object, a first aspect of the present invention is a display control device that is connected to an operating device and a display device and simultaneously displays a plurality of images on the display device. A capturing unit that captures tag information that defines image content, a storage unit that stores the image and the tag information, and a key item that can be a discriminating element of the image is set from the tag information, and an image by the image recognition unit Based on a recognition result, key management means for setting the position of the key item included in the image, and one or a plurality of layout reference lines are set on the display device, and a plurality of images to be displayed on the display device are displayed. Display means for partially displaying the key items included in each image along the layout reference line so that the key items are partially overlapped and displayed. To. According to this configuration, a plurality of images are displayed in a partially overlapped manner, thereby greatly increasing the number of images that can be displayed on one screen of the display device and making scrolling operations unnecessary. Can do. In addition, since the key items of each image are always displayed along at least a part of the layout reference line, it is possible to perform display that allows the user to intuitively read and understand the contents of each image. Thereby, the display property and operability when simultaneously displaying a plurality of images can be improved at the same time.

  In the display control device having the above configuration, it is possible to adopt an aspect in which the tag information is information created by the external device. According to this configuration, the tag information setting work by the user can be reduced by taking in the tag information generated in the external device.

  In the display control device having the above-described configuration, the key item recognized by the image recognition unit is recorded as similarity information in the storage unit, and the capture unit captures an image captured from the external device. When the key item that is recognized by the recognition unit and recorded as the similarity information is included in the recognized image, a mode in which the key item is incorporated as the tag information is adopted. Can do. According to this configuration, it is possible to reduce the tag information setting work by the user by setting already recognized key items as tag information.

  In the display control device having the above-described configuration, it is possible to adopt a mode in which the capturing unit has a function of capturing information input by the user through the operation device as the tag information. According to this configuration, the user can set arbitrary tag information.

  In the display control device having the above-described configuration, the display unit determines the number and size of the layout reference lines based on the number of displayed images, and uses the tag information as an arrangement order of a plurality of images arranged on the layout reference lines. A mode of setting based on the above can be adopted. According to this configuration, it is easy to view images by determining the arrangement order (display order) of the images arranged on the layout reference line based on the tag information.

  In the display control apparatus having the above configuration, the display unit may adopt an aspect in which the layout reference line is divided based on the tag information. According to this configuration, it is easy to view an image by dividing the arrangement position of the layout reference line for each tag information.

  In the display control device having the above-described configuration, the display unit may adopt an aspect in which the layout reference line is divided based on the key item. According to this configuration, it is easy to view an image by dividing the arrangement position of the layout reference line for each key item.

  In the display control device having the above-described configuration, the storage unit stores operation information related to display / viewing input by the user through the operation device in association with the identification information of the user, and the display unit stores the user's identification information. It is possible to adopt a mode in which the user has a function of analyzing a tendency regarding past display / browsing of the user based on the operation information and auxiliaryly setting the arrangement order based on the analysis result. According to this configuration, it is possible to realize an image arrangement that meets the user's preference based on the user's past operation information.

  In the display control device having the above-described configuration, the display unit may employ a mode in which the display unit has a function of changing the arrangement order of the plurality of displayed images based on information input by a user through the operation device. it can. According to this configuration, the user can arbitrarily change the arrangement order of the displayed images using the operation device.

  In the display control device having the above-described configuration, it is possible to adopt a mode in which the key management unit has a function of searching for an image to be displayed on the display device from the storage unit based on the tag information. According to this configuration, the user can search for a target image by inputting tag information.

  In the display control device having the above configuration, the key management unit has a function of searching the image to be displayed on the display device from the storage unit on the basis of the result of analyzing the user's past display / viewing tendency. Aspects can be employed. According to this configuration, it is possible to provide pleasure, surprise, and joy of accidentally reaching an image that the user originally did not intend by searching for an image from the user's past operation information.

  In the display control apparatus having the above-described configuration, the key management unit associates a plurality of images having the different tag information based on the operation information of the user, and extracts the associated one image from the storage unit. In addition, it is possible to adopt a mode in which a function of extracting other images associated therewith is provided. According to this configuration, even if the images cannot be found to have any relationship from the tag information, the images associated with each other can be extracted simultaneously by finding the relationship between the images based on the user operation information. Can be displayed.

  In the display control device having the above-described configuration, it is possible to adopt a mode in which the external device is a computer existing on a network, and further includes a communication unit for connecting to the network and communicating with the external device. According to this configuration, an image can be acquired from a computer on the network.

  In the display control device having the above-described configuration, it is possible to adopt an aspect in which the image is a book image and the tag information includes bibliographic information of the book. According to this configuration, it is possible to display the book image.

  In the display control device having the above-described configuration, it is possible to adopt an aspect in which the bibliographic information is created and provided by a computer of a book publisher that publishes the book. According to this configuration, the setting work of bibliographic information (= tag information) by the user can be reduced.

  According to a second aspect of the present invention, there is provided a display control method for simultaneously displaying a plurality of images on a display device, the step of capturing an image and tag information defining the image content from the outside, and a discriminating element for the image Setting a key item to be obtained from the tag information, detecting the key item from the image and setting the position of the key item in the image; and setting one or a plurality of layout reference lines on the display device A plurality of images to be set and displayed on the display device are displayed in a partially overlapped manner so that the key items included in each image are displayed at least partially along the layout reference line Providing a step. According to this method, the same effect as that of the first aspect can be obtained.

  Hereinafter, an embodiment in which the present invention is embodied in, for example, a display control system that simultaneously displays a plurality of images (book images) of an electronic book (also referred to as an electronic book) captured from a network on a display device will be described with reference to FIGS. A description will be given with reference to FIG.

FIG. 1 is an overall configuration diagram showing a display control system 1 according to the present embodiment.
The display control system 1 includes a display control device 2. An operation device 3 and a display device 4 are connected to the display control device 2, and an external computer 6 as an external device is connected via the Internet 5. In the present embodiment, the display control device 2 is constituted by a personal computer (personal computer), the operation device 3 is constituted by a keyboard and a mouse, and the display device 4 is constituted by a liquid crystal monitor.

  The external computer 6 is a so-called server computer owned by a book publisher that provides (distributes) an electronic book, and a database (not shown) connected to the computer has a display control device 2 of the present embodiment. Many electronic books that can be distributed to other computers including are stored. The display control device 2 obtains an image of an electronic book (hereinafter simply referred to as an image) by accessing the external computer 6 via the Internet 5.

  The display control device 2 operates in cooperation with the display control software 7 for simultaneously displaying (displaying display) a plurality of images taken from the external computer 6 on the display device 4, and is included in the image. And image recognition software 8 for detecting an image of a person, a building, etc. (so-called subject) based on each feature amount.

  In the present embodiment, “display display” refers to “key item” in each image including a plurality of images to be displayed along one or more “layout reference lines” set on the display device 4. Is a mode in which the images are partially overlapped and displayed so as to be displayed at least partially (see FIG. 7). Here, the “layout reference line” means a line that serves as an index for determining the display position of each image, and the “key item” means an image part or a text part (for example, an image discriminating element) This means a person, a subject such as a building, or a book name included in the cover image of the book). The key item is set from tag information T1 (see FIG. 2) described later.

  The display control software 7 includes capture software 9, management software 10, and display software 11. In general, the image acquired by the capture software 9 is transferred to the display software 11 through the management software 10, and the display software 11 generates display data for display and outputs it to the display device 4. ing. Details of the software 9 to 11 will be described later. In the present embodiment, the capture software 9 corresponds to capture means, the management software 10 corresponds to key management means, and the display software 11 corresponds to display means.

  In addition, the display control device 2 includes a database 12. The database 12 stores an image information file F1, a similarity information file F2, an operation information file F3, and a display data file F4. Hereinafter, each of the files F1 to F4 will be described.

[Image information file F1]
FIG. 2 is an explanatory diagram showing the image information file F1.
In the image information file F1, an image (electronic book image) P1 and tag information T1 defining the contents of the image P1 are recorded. Among these, the tag information T1 includes three types of primary tag information T11 (FIG. 2A), secondary tag information T12 (FIG. 2B), and tertiary tag information T13 (FIG. 2C). It is classified into information.

  The primary tag information T11 is bibliographic information generated by the external computer 6 (information on electronic books provided by a book publisher). This bibliographic information includes, for example, information such as publisher, ISBN (International Standard Book Number), publication date, book (number of pages), size, editor's name, and the like. The primary tag information T11 is captured at the same time when the image P1 is captured by the capture software 9.

  The secondary tag information T12 is information additionally set by the capture software 9 based on the result of recognizing the key item image included in the image P1 by the image recognition software 8. For example, in FIG. 2B, information about the subject (cover model) A in the image P1 recognized by the image recognition software 8 is set as the secondary tag information T12.

  The tertiary tag information T13 is information that is additionally set by the capturing software 9 based on an input (for example, keyboard input) from the operation device 3 by the user. For example, in FIG. 2C, information regarding the acquisition progress and acquisition date of the image P1 is set as the tertiary tag information T13. The tertiary tag information T13 can set other arbitrary information besides this.

[Similarity information file F2]
In the similarity information file F2, key item images (subject images and text images of people, buildings, etc.) that can be recognized by the image recognition software 8 are registered. The image recognition software 8 detects and recognizes the key item in the image P1 by comparing the registered image in the similarity information file F2 with the image to be recognized and determining the similarity.

[Operation Information File F3]
In the operation information file F3, user operation information related to image display / viewing is recorded in association with the user identification information (for example, the user identification number). The type of information recorded as operation information is arbitrary. For example, in the operation information file F3, the date, time, position (location where browsing is performed), temperature (temperature at the start of browsing) at the time of display execution, and other types of browsing images, the number of browsing, browsing frequency, browsing Information such as time can be recorded. This operation information is used to analyze a user's operation tendency regarding image display / viewing.

[Display data file F4]
Display data displayed on the display device 4 in the past is recorded in the display data file F4. By reading the display data recorded in the display data file F4, it is possible to display the display data of images browsed in the past.

FIG. 3 is a block diagram illustrating a hardware configuration of the display control device 2.
The display control device 2 includes a CPU 21, a memory 22, a storage device 23, an input interface (I / F) 24, an output I / F 25, a communication device 26, and a drive device 27, which are connected to each other via a bus 28. Has been.

  The CPU 21 transfers a program and data stored in the storage device 23 to the memory 22 and executes the program using the memory 22. The memory 22 is composed of a ROM, a RAM, and the like, and normally includes a cache memory, a system memory, a display memory, and the like. The storage device 23 includes a magnetic disk device, an optical disk device, a magneto-optical disk device, and the like. Note that the above-described various programs (capture software 9, management software 10, display software 11, image recognition software 8) and data necessary for executing these programs are stored in the storage device 23. This storage device 23 is also used as the database 12.

  The operation device 3 is connected to the input I / F 24 and sends an operation signal corresponding to the operation input from the operation device 3 to the CPU 21. The display device 4 is connected to the output I / F 25, and the display data is output to the display device 4 under the control of the CPU 21. The communication device 26 (communication means) is used for connection to the Internet 5, performs data conversion associated with communication, and transmits / receives programs and data to / from the external computer 6.

  Programs and data executed by the CPU 21 are provided on the recording medium 29. The drive device 27 drives the recording medium 29 to access the recorded contents, reads out programs and data from the recording medium 29, and stores them in the storage device 23. The recording medium 29 includes a medium such as an optical disk and a magneto-optical disk, a medium recording a program uploaded or downloaded from another network device via the communication device 26, a disk device, and the like.

Next, the processing in the acquisition software 9, management software 10, and display software 11 will be specifically described individually.
[Capture software 9]
The capture software 9 captures the image P1 and primary tag information T11 (see FIG. 2A) from the external computer 6, and secondary tag information T12 (see FIG. 2B) and tertiary tag information T13 (see FIG. 2). c) is a processing unit that generates an image information file F1 with additional settings as appropriate.

FIG. 4 is a flowchart showing processing in the capture software 9.
First, the CPU 21 determines whether or not the display control device 2 is connected to the Internet 5 (step 100). If an affirmative determination is made (connection is detected), the CPU 21 then takes in the image P1 and the primary tag information T11 from the external computer 6 (acquisition of the latest data) (step 101). Note that this capturing is not limited to the time of connection to the Internet 5, and may be a mode in which, for example, it is automatically acquired periodically from the external computer 6 while being always connected to the Internet 5 or manually by the user. The aspect to acquire may be sufficient.

  Next, the CPU 21 detects the key item image included in the image P1 based on the similarity information file F2 by the image recognition software 8 (step 102), and is similar to the image registered in the similarity information file F2. It is determined whether an image to be present exists in the image P1 (whether there is similarity information) (step 103). If an affirmative determination is made here, the CPU 21 additionally sets information on the key item image detected from the image P1 as the secondary tag information T12 (step 104).

  Next, the CPU 21 determines whether or not there is a new input of tag information from the operation device 3 by the user (step 105). If the determination is affirmative (input acceptance), the CPU 21 additionally sets the information input through the operation device 3 as the tertiary tag information T13 (step 106).

  Thus, the CPU 21 generates the tag information T1 by appropriately setting the secondary tag information T12 and the tertiary tag information T13 to the primary tag information T11, and creates the image information file F1 composed of the tag information T1 and the image P1. (Step 107). The image information file F1 is transferred to the management software 10 or stored in the database 12 based on a user instruction.

[Management software 10]
The management software 10 is a processing unit that acquires the image information file F1 created by the capture software 9 and generates an image file for display display (hereinafter referred to as a display image file).

FIG. 5 is a flowchart showing processing in the management software 10.
When the CPU 21 acquires the image information file F1 from the capture software 9 (step 200), first, the key item is set according to one of the following setting modes (setting by the user) (step 201).

First setting mode: A preset default value is set as a key item.
Second setting mode: The key item selected by the user is set.
Third setting mode: Key item setting tendency is analyzed based on user operation information recorded in the operation information file F3, and key items are automatically set from the analysis result.

  Subsequently, the CPU 21 detects a key item image from the image P1 based on the similarity information file F2 by the image recognition software 8 (step 202), and whether the key item set in the previous step 201 exists in the image P1. It is determined whether or not (step 203).

  If an affirmative determination is made (key item is detected), the CPU 21 then sets the position (coordinate position) of the key item in the image P1 based on the detection result (step 204). On the other hand, if a negative determination is made in step 203, the CPU 21 processes that there is no key item in the image P1 (step 205). A file created through step 204 or step 205 is created as a display image file.

  Next, the CPU 21 determines whether or not the key item position has been set for all the images P1 (image information file F1) (step 206). If the determination is affirmative, the CPU 21 ends the process and outputs the display image file created in the previous step 204 or step 205 to the display software 11. On the other hand, if a negative determination is made in step 206, the CPU 21 returns to step 202 and repeats the processing of steps 202 to 205 until the key item position setting is completed for all the images P1.

[Display software 11]
The display software 11 is a processing unit that acquires the display image file created by the management software 10 and creates display data for display display.

FIG. 6 is a flowchart showing processing in the display software 11.
When the CPU 21 acquires the display image file from the management software 10 (step 300), it first sets a layout reference line L (see FIG. 7) on the display device 4 (screen DP) (step 301). The number and size of layout reference lines L to be set are determined according to the number of displayed images. The shape is arbitrary. In the present embodiment, it is set linearly in the horizontal direction of the screen DP.

Next, the CPU 21 performs processing for matching the bottom of each image P1 to be displayed with the layout reference line L on the screen DP (step 302).
Next, the CPU 21 determines the arrangement (display order) of the images P1 on the layout reference line L using the tag information T1 (the type of tag information to be used is arbitrary) (step 303). For example, the primary tag information T11 may be used for each publisher, ISBN, publication date, page number, or size, or the secondary tag information T12 may be used for each cover model. And it is good also as acquisition date order using tertiary tag information T13.

  Next, the CPU 21 retrieves the user operation information from the operation information file F3 (step 304), analyzes the user's past display / browsing tendency, and makes auxiliary settings regarding the display order (step 304). Step 305). Specifically, this is a process for grasping images that the user is interested in from past operation information such as the number of times of browsing, browsing frequency, and browsing time, and arranging these images closer to the screen.

  Next, the CPU 21 displays all or a part of the key items for each image P1 based on the set display order and the position of the key item for each image P1 set by the management software 10. Display data is generated by partially overlapping on the layout reference line L, and is output to the display device 4 to execute display display (step 306).

  Next, the CPU 21 determines whether or not an operation for changing the arrangement (display order) of each image P1 has been performed by the user through the operation device 3 (step 307). If an affirmative determination is made here, the CPU 21 changes the arrangement (changes the display order) in accordance with the operation input (step 308). Further, the operation information related to the arrangement change at that time is recorded in the operation information file F3 (step 309).

  Thereafter, the CPU 21 determines whether or not an operation to change the display image (display data) or an operation to end the display (browsing) has been performed by the user (step 310). If an affirmative determination is made here, the CPU 21 makes an inquiry to the user to determine whether or not to save the display data at that time (step 311). If an affirmative determination is made (accepting an operation input for storage), The CPU 21 stores the display data in the display data file F4 (step 312) and ends the process.

FIG. 7 is a screen diagram showing a display example of display by the display control system 1 of the present embodiment.
As shown in the figure, each image P1 is partially displayed in such a manner that each key item K1 (for example, a book name) is displayed at least partially along the layout reference line L set in the screen DP. It is displayed overlapping.

  In such a display mode, since the key item K1 is displayed without being hidden, the user intuitively determines what kind of image (book) each image P1 is based on the key item K1. Thus, it becomes possible to easily find the target image (book). Further, since the images P1 are arranged in a line along the layout reference line L, it is easy to search for the images P1. Furthermore, since each image P1 is displayed partially overlapping, the number of images displayed in one screen DP of the display device 4 can be greatly increased. As a result, it is possible to perform a display that makes the scroll operation unnecessary.

As described above, according to the present embodiment, the following effects can be obtained.
(1) A mode in which a plurality of images P1 to be displayed on the display device 4 are displayed in a partially overlapped manner so that the key item K1 of each image P1 is displayed at least partially along the layout reference line L It was. As a result, the contents of each image P1 can be intuitively determined by the user, and the number of images that can be displayed in one screen DP of the display device 4 can be greatly increased. As a result, it is possible to realize a display in which a scroll operation is unnecessary.

  (2) The user can display the image P1 (book image) acquired from the Internet 5 without any special operation. Therefore, even an elderly person or a so-called information weak person who is unfamiliar with the operation of a computer can easily enjoy displaying and browsing images.

  (3) Primary tag information T11 generated by the external computer 6 is taken in as tag information T1. Thereby, the setting operation of the tag information T1 by the user can be reduced as much as possible.

  (4) When the image P1 captured from the external computer 6 is recognized by the image recognition software 8, and the key item recognized by the software 8 in the past is included in the image P1, the tag information ( One tag information T12) is additionally set. Thereby, the setting operation of the tag information T1 by the user can be reduced as much as possible.

(5) The arrangement order (display order) of the plurality of images P1 to be displayed is set using the tag information T1. This makes it easier to browse images.
(6) Based on the user's operation information recorded in the operation information file F3, the user's operation tendency regarding display / browsing is analyzed, and the arrangement order of the images P1 is supplementarily set based on the analysis result. I did it. Thereby, it is possible to realize an image layout that meets the user's preference.

In addition, you may implement the said embodiment in the aspect of the following modifications.
(Modification 1) The form of the network is not limited to the Internet 5 alone. Further, the external device is not limited to the external computer 6 on the Internet 5, and may be a digital camera or a camera built-in mobile phone connected via a wired or wireless communication network.

  (Modification 2) The number of key items set by the management software 10 is not necessarily limited to one. For example, in step 201, a plurality of key items may be set with priorities, and in step 203, the presence or absence of key items may be determined in descending order of priority. In this way, different key items can be set for each image.

  (Modification 3) In the above embodiment, the image acquired by the capture software 9 is directly transferred to the display software 11 through the management software 10 and displayed, but the image in the database 12 is displayed by the management software 10. Of course, it is possible to display and display the images acquired from the database 12 by searching. In this case, for example, tag information T1 can be used as a search key. In this way, the image information file F1 that the user desires can be acquired from the database 12 and displayed.

  (Modification 4) In Modification 3, the user identification information can be used as a search key. In this case, specifically, the user's past operation information is first acquired from the operation information file F3 based on the user identification information. Next, the user's tendency regarding past display / browsing is analyzed from the operation information (an image in which the user is interested, such as an image having a large number of browsing times or an image having a high browsing frequency is examined), and based on the analysis result To automatically select tag information as search keys. Then, an image is searched from the database 12 based on the tag information. With such an aspect, since the image is searched with the tag information automatically selected based on the user's interest image, the joy of accidentally reaching the image originally intended by the user or the surprise Can provide joy.

  (Modification 5) In the modifications 3 and 4, the two or more images P1 having different tag information T1 are based on user operation information (for example, the same two images are always viewed simultaneously). And when extracting the associated one image, another image associated therewith may be extracted together. In this aspect, even if the images P1 cannot find any relationship from the tag information T1, the images P1 can be associated with each other based on the past operation information and can be displayed simultaneously.

(Modification 6) The tag information T1 is not limited to the information illustrated in FIG.
(Modification 7) The display control device 2 is not limited to a personal computer.
(Modification 8) The operating device 3 is not limited to a keyboard or a mouse. For example, known motion recognition software that recognizes the movement of the user's finger may be incorporated in the display control device 2 and used as the operation device 3. FIG. 8 is a screen diagram illustrating an operation image of a user when browsing an image using the motion recognition software. The operation OP1 is an operation for changing the arrangement position of the image P11 from the back to the front by touching the image P11 with a finger. When this operation OP1 is performed, it is recorded in the operation information that the user is interested in the image P11. In addition, the operation OP2 is an operation of moving the image P12 so as to protrude laterally (leftward in the figure) with a finger to remove the image P12 from the layout reference line L (remove from the screen DP). When this operation OP2 is performed, it is recorded in the operation information that the user is not interested in the image P12. In the operation OP3, the image P13 is dragged with the finger to temporarily remove it from the layout reference line L, and after browsing the image P13 (browsing the electronic book), the image P13 is returned to the same layout reference line L again. At the time, it is arranged at the forefront of the related book series). When this operation OP3 is performed, it is recorded in the operation information that the user is interested in the image P13. Such operation information is used when determining the next image search or image arrangement order.

  (Modification 9) In the above embodiment, the layout reference line L may be segmented based on the tag information T1. In this way, the image can be displayed and displayed along the layout reference line L divided for each type of the tag information T1, so that it is easier to view the image.

  (Modification 10) In the above embodiment, the layout reference line L may be segmented based on the key item K1. In this way, the image can be displayed and displayed along the layout reference line L divided for each type of the key item K1, which makes it easier to view the image.

  (Modification 11) Other design matters in the configuration of the above-described embodiment and each modification can be appropriately changed within the scope of the technical idea of the present invention.

1 is an overall configuration diagram showing a display control system of an embodiment. (A)-(c) is explanatory drawing which shows an image information file (an image and tag information). The hardware block diagram of a display control apparatus. The flowchart which shows the process in acquisition software. The flowchart which shows the process in management software. The flowchart which shows the process in display software. The screen figure which shows an example of the display displayed on a display apparatus. The screen figure which shows the user's operation image at the time of browsing an image using motion recognition software.

Explanation of symbols

  1: display control system, 2: display control device, 3: operation device, 4: display device, 5: internet (network), 6: external computer (external device), 7: display control software, 8: image recognition software ( Image recognition means), 9: capture software (capture means), 10: management software (key management means), 11: display software (display means), 12: database (storage means), 21: CPU, 23: storage device , 26: communication device (communication means), DP: screen, F1: image information file, F2: similarity information file, F3: operation information file, F4: display data file, K1: key item, L: layout reference line, P1, P11, P12, P13: Image, T1: Tag information, T11: Primary tag information, T12: Secondary tag information, T13: Tertiary tag information.

Claims (16)

A display control device that is connected to an operation device and a display device and displays a plurality of images simultaneously on the display device,
Capture means for capturing an image and tag information defining the image content from an external device;
Storage means for storing the image and the tag information;
Key management means for setting key items that can be discriminating elements of the image from the tag information, and setting positions of the key items included in the image based on an image recognition result by the image recognition means;
One or more layout reference lines are set on the display device, and a plurality of images to be displayed on the display device are arranged along the layout reference line with at least a part of the key items included in the images. Display means for displaying the display partly superimposed so as to be displayed;
A display control device. The tag information is information created by the external device.
The display control apparatus according to claim 1. In the storage means, the key item recognized by the image recognition means is recorded as similarity information,
The capture unit recognizes an image captured from the external device by the image recognition unit, and the key item recorded as the similarity information is included in the recognized image. A function of capturing an item as the tag information;
The display control apparatus according to claim 1 or 2. The capturing means includes a function of capturing information input by a user through the operation device as the tag information.
The display control apparatus as described in any one of Claims 1 thru | or 3. The display means determines the number and size of the layout reference lines based on the number of displayed images, and sets the arrangement order of a plurality of images arranged on the layout reference lines based on the tag information.
The display control apparatus as described in any one of Claims 1 thru | or 4. The display means divides the layout reference line based on the tag information;
The display control apparatus according to claim 1. The display means divides the layout reference line based on the key items;
The display control apparatus according to claim 1. In the storage means, operation information related to display / browsing input by the user through the operation device is recorded in association with the identification information of the user,
The display means has a function of analyzing a tendency of the user's past display / browsing based on the operation information of the user and auxiliaryly setting the arrangement order based on the analysis result.
The display control apparatus according to claim 5. The display means includes a function of changing the arrangement order of the plurality of displayed images based on information input by a user through the operation device.
The display control apparatus according to claim 1. The key management means has a function of searching for an image to be displayed on the display device from the storage means based on the tag information.
The display control apparatus according to claim 1. The key management unit includes a function of searching the storage unit based on a result of analyzing a tendency related to past display / viewing of the user for an image to be displayed on the display device.
The display control apparatus as described in any one of Claims 8 thru | or 10. The key management unit associates a plurality of images having the different tag information with each other based on the operation information of the user, and extracts the associated one image from the storage unit when the other image associated therewith is extracted. With the ability to extract
The display control apparatus according to claim 10 or 11. The external device is a computer existing on a network;
A communication means for connecting to the network and communicating with the external device;
The display control apparatus as described in any one of Claims 1 thru | or 12. The image is a book image;
The tag information includes bibliographic information of books.
The display control apparatus as described in any one of Claims 1 thru | or 13. The bibliographic information is created and provided by a computer of a book publisher that publishes the book,
The display control apparatus according to claim 14. A display control method for simultaneously displaying a plurality of images on a display device,
Capturing an image and tag information defining the image content from the outside;
Setting a key item that can be a discriminating element of the image from the tag information, detecting the key item from the image, and setting the position of the key item in the image;
One or more layout reference lines are set on the display device, and a plurality of images to be displayed on the display device are arranged along the layout reference line with at least a part of the key items included in the images. Displaying in a partially overlapped manner so as to be displayed,
A display control method comprising:

Images