JP2012108609A - Display device, display method, computer program and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device, a display method, a computer program and a recording medium which have simple configurations requiring no other components and perform grouping of images or the like automatically, not manually.SOLUTION: A classification unit 11 classifies plural images to be displayed on a display unit 7 into groups by using a keyword acquired by a keyword acquisition unit 12 and based on the group classification result, a display control unit 8 displays the plural images divided into groups.

Description

  The present invention relates to a display device that acquires and displays a plurality of images, a display method, a computer program, and a recording medium that records the computer program.

  Conventionally, the KJ method has been generally used for so-called idea meetings in which multiple people share ideas. The KJ method is to write ideas, opinions, etc. extracted by brainstorming one by one on the card one by one, and repeat the grouping that collects and classifies the contents that are close to each other. It is a method of organizing.

  With regard to such a KJ method, for example, Patent Document 1 discloses an input device including a small built-in camera, a memory, an image processor, and a communication unit, and which position on which paper is input by the input device. An idea extraction support system that can perform brainstorming or KJ method on a desk using paper (card and mount) with embedded information for identifying information such as information and a wireless tag is disclosed. Yes.

JP 2008-123265 A

  However, in the idea extraction support system of Patent Document 1 as described above, a small built-in camera, a memory, an image processor, an input device including a communication unit, a sheet in which information is embedded and a wireless tag is attached, etc. Cost and cost.

  Furthermore, the idea extraction support system of Patent Document 1 has a configuration in which grouping in the KJ method is performed manually, and there is a problem that it takes time and effort for the user.

  The present invention has been made in view of such circumstances, and an object of the present invention is to provide classification means, classify a plurality of images to be displayed on the display unit into groups, and classify the groups. Based on the result of the above, by displaying the plurality of images in groups, it is a simple configuration that does not require other components, and the grouping of the plurality of images can be performed automatically instead of manually. The present invention provides a display device, a display method, a computer program, and a recording medium.

  The display device according to the present invention is a display device including a display unit that acquires and displays a plurality of images, a classification unit that classifies the plurality of images into groups, and a result of group classification by the classification unit, And a display means for displaying the plurality of images in groups.

  In the present invention, the classification unit classifies the plurality of images to be displayed on the display unit into groups, and the display unit performs the plurality of the plurality of images based on the group classification result by the classification unit. Images are displayed in groups.

  The display device according to the present invention includes an arrangement receiving unit that receives an arrangement designation of a group related to the classification result.

  In the present invention, the placement accepting unit accepts the placement designation of the group related to the classification result from the user, and based on the placement designation received by the placement accepting unit, the display means adds the classification designation to the result of the classification. This group is displayed separately.

  The display device according to the present invention includes an acquisition unit that acquires a keyword related to the classification.

  In the present invention, the acquisition unit acquires a keyword related to the classification, and the classification unit classifies the plurality of images into groups using the keyword acquired by the acquisition unit.

  The display device according to the present invention is configured such that the character recognition means for recognizing characters included in each image, and the classification means classifies the plurality of images into groups based on the recognition result by the character recognition means. It is characterized by.

  In the present invention, the character recognition means recognizes a character included in each of the plurality of images. Based on the character recognition result for each image, the classification unit classifies the plurality of images into groups.

  The display device according to the present invention is characterized in that the acquisition means is configured to acquire a keyword via the Internet.

  In the present invention, the acquisition unit acquires a keyword related to the classification via the Internet, and the classification unit classifies the plurality of images into groups using the keyword acquired by the acquisition unit.

  The display method according to the present invention includes a step of recognizing characters included in each image and a group of the plurality of images based on the recognition result in a display method of acquiring a plurality of images and displaying them in groups. And a step of classifying the data.

  The computer program according to the present invention is a computer program for causing a computer to acquire a plurality of images and to display them in groups. The step of causing the computer to recognize characters included in each image; and the result of the recognition to the computer. And a step of classifying the plurality of images into groups.

  In the present invention, characters included in each of the plurality of images are recognized. Accordingly, the plurality of images are classified into groups based on the characters recognized for each image.

  A recording medium according to the present invention records the computer program of the above-described invention.

  In the present invention, the aforementioned computer program is recorded on the recording medium. The computer reads the computer program from the recording medium, and the above display device and display method are realized by the computer.

  According to the present invention, the classification unit classifies the plurality of images to be displayed on the display unit into groups, and displays the plurality of images divided into groups based on the group classification result. Therefore, in addition to a simple configuration that does not require other components, grouping of the plurality of images is performed automatically instead of manually.

It is a functional block diagram which shows the principal part structure of the electronic blackboard apparatus of Embodiment 1 of this invention. It is an illustration figure which shows an example of the keyword table of the memory | storage part of the electronic blackboard apparatus in Embodiment 1 of this invention. It is an illustration figure which shows an example of the keyword table of the memory | storage part of the electronic blackboard apparatus in Embodiment 1 of this invention. It is explanatory drawing explaining operation of the grouping operation menu in the electronic blackboard apparatus of Embodiment 1 of this invention. It is explanatory drawing explaining operation of the grouping operation menu in the electronic blackboard apparatus of Embodiment 1 of this invention. It is explanatory drawing explaining operation of the grouping operation menu in the electronic blackboard apparatus of Embodiment 1 of this invention. It is a flowchart which shows the process of grouping display in the electronic blackboard apparatus of Embodiment 1 of this invention. It is an illustration figure which shows the example by which the several image based on an acquired image is displayed on the display part of the electronic blackboard apparatus of Embodiment 1 of this invention. In the electronic blackboard device according to the first embodiment of the present invention, it is an explanatory diagram illustrating a display operation of a grouping operation menu. It is an illustration figure which shows the processing result of the grouping display in the electronic blackboard apparatus of Embodiment 1 of this invention. It is a functional block diagram which shows the principal part structure of the electronic blackboard apparatus of Embodiment 2 of this invention. It is a flowchart which shows the process of grouping display in the electronic blackboard apparatus of Embodiment 2 of this invention. It is explanatory drawing explaining operation of the grouping operation menu in the electronic blackboard apparatus of Embodiment 2 of this invention. It is a functional block diagram which shows the principal part structure of the electronic blackboard apparatus of Embodiment 3 of this invention.

  Hereinafter, a display device, a display method, a computer program, and a recording medium according to an embodiment of the present invention will be described in detail with reference to the drawings, taking as an example a case where the display device is applied to a so-called electronic blackboard device.

(Embodiment 1)
FIG. 1 is a functional block diagram showing a main configuration of the electronic blackboard device 100 according to Embodiment 1 of the present invention. The electronic blackboard device 100 includes a CPU 1, a ROM 2 and a RAM 3.

  Various control programs (for example, an electronic blackboard application and a drawing application) are stored in the ROM 2 in advance, and the RAM 3 temporarily stores data and can be read out regardless of the storage order, storage position, and the like. is there. The RAM 3 stores, for example, a program read from the ROM 2 and various data generated by executing the program.

  The CPU 1 loads the control program stored in advance in the ROM 2 onto the RAM 3 and executes it, thereby controlling the following various hardware via the bus N, and the entire apparatus as the electronic blackboard device 100 of the present invention. Make it work.

  In addition, the electronic blackboard device 100 includes a display unit 7, a display control unit 8 that controls display of characters, images, and the like on the display unit 7, and a display unit 7 from a user via a pen-type input device 92 described later. The pen input unit 9 that accepts input such as position designation and selection above, the pen input control unit 10 that controls the acceptance of input by the pen input unit 9, and the image to be displayed on the display unit 7 are classified for each group. A classification unit 11; a keyword acquisition unit 12 that acquires keywords or classification criteria related to classification by the classification unit 11; a character recognition unit 13 that recognizes characters included in an image to be displayed on the display unit 7; Are provided with an arrangement receiving unit 14 that receives an arrangement designation on the display unit 7 of a group related to the classification result of the above, and a communication unit 6 that transmits and receives images to and from the outside.

  Furthermore, the electronic blackboard device 100 is, for example, a nonvolatile semiconductor memory such as a hard disk, and includes a storage unit 4 that stores an acquired image, which will be described later, and a timer unit 5 that measures the passage of time from a predetermined time. Yes.

  The storage unit 4 stores a keyword table. The keyword table stores keywords or classification criteria used when the classification unit 11 performs classification processing. The keyword acquisition unit 12 acquires keywords or classification criteria used when the classification unit 11 performs classification processing based on the keyword table in the storage unit 4.

  2 and 3 are exemplary diagrams illustrating an example of a keyword table in the storage unit 4 of the electronic blackboard device 100 according to Embodiment 1 of the present invention.

  In the keyword table shown in FIG. 2, keywords for grouping images to be displayed into animals / plants, keywords for classifying into Asia / Europe, and the like are written.

  In the keyword table shown in FIG. 3, keywords and the like for classifying images to be displayed based on color / monochrome, the size of the original of the image, presence / absence of memo writing, and the like are written.

  For example, when the user performs classification using keywords or classification criteria, a grouping operation menu described later is displayed on the display unit 7. In the grouping operation menu, selection items are displayed based on the keyword table in the storage unit 4.

  The display unit 7 is, for example, an LCD monitor. The display unit 7 displays, for example, an acquired image transmitted from a connected external device (image reading device 200) and acquired through the communication unit 6. The display unit 7 displays an interface screen for selecting and starting software operating on the electronic blackboard device 100.

The display control unit 8 causes the display unit 7 to display a plurality of acquired images classified by the classification unit 11 in groups.
Specifically, the classification unit 11 performs a classification process on the plurality of acquired images to be displayed on the display unit 7 using the keywords acquired by the keyword acquisition unit 12. On the other hand, the arrangement receiving unit 14 receives the arrangement designation of the group related to the result of the classification process by the classification unit 11. The display control unit 8 displays the plurality of acquired images on the display unit 7 based on the result of the classification process by the classification unit 11 and the group arrangement designation received by the arrangement reception unit 14.

  The pen input unit 9 is a so-called touch panel, and has a position designation receiving unit 91 that accepts a position designation on the display screen of the display unit 7 from a user, and a pen shape, and when the user designates the position. And a pen-type input device 92 to be used. The pen input unit 9 accepts a position designation on the display unit 7 from the user via these, and the CPU 1 accepts a predetermined selection by the user based on the position designation accepted by the pen input unit 9.

  The pen input control unit 10 performs control related to the reception of the position designation by the pen input unit 9 and coordinates related to the position designation received through the position designation receiving unit 91 of the pen input unit 9 (hereinafter referred to as designated coordinates). ) To the CPU 1.

  The CPU 1 acquires designated coordinates from the pen input control unit 10 and recognizes that a predetermined soft key corresponding to the designated coordinates, for example, a predetermined soft key on the interface screen has been selected.

  The position designation receiving unit 91 of the pen input unit 9 is installed on the display screen of the display unit 7 in an overlapping manner. In the present embodiment, it is assumed that the position designation receiving unit 91 is a so-called light blocking type. In the light blocking type, the input is realized by detecting the light blocking by the position designation receiving unit 91 in response to the tip of the pen-type input device 92 approaching the surface of the position designation receiving unit 91. . It should be noted that the present invention is not limited to the pen-type input device 92 and may be configured to be operable with a user's finger.

  The character recognition unit 13 recognizes characters included in the acquired image. For example, the character recognition unit 13 performs OCR processing on the acquired image, and recognizes characters corresponding to text data that can be acquired by the OCR processing.

  As described above, the keyword acquisition unit 12 acquires keywords or classification criteria used when the classification unit 11 performs the classification process based on the keyword table in the storage unit 4. The classification unit 11 performs a classification process based on the keywords or classification criteria acquired by the keyword acquisition unit 12. For example, the classifying unit 11 can classify an image including the keyword and an image not including the keyword based on the result of character recognition by the character recognizing unit 13, and different groups such as animals / plants. It is also possible to classify them.

  The classification unit 11 performs the classification process using not only the classification process using the keyword acquired by the keyword acquisition unit 12 but also the classification standard such as the image format. Therefore, it is possible to classify into different formats such as color / monochrome. That is, the keyword acquisition unit 12 acquires a keyword used when the classification unit 11 performs the classification process, and acquires a classification standard used when the classification unit 11 performs the classification process. The classification criteria are, for example, whether the document relating to the image to be displayed is color / monochrome, the size of the document (A4, A3, B4, etc.), as stored in the keyword table of the storage unit 4, An example is whether the manuscript is text / image.

  The arrangement receiving unit 14 receives the arrangement designation of the group related to the result of the classification process by the classification unit 11. That is, when there are a plurality of groups related to the result of the classification process by the classification unit 11, an arrangement designation such as a vertically opposed display, a horizontally opposed display, or a display for each sheet is accepted for the plurality of groups. The display control unit 8 displays the plurality of acquired images on the display unit 7 divided into groups based on the group arrangement designation received by the arrangement reception unit 14.

  The communication unit 6 is connected to an external image reading device 200, acquires an image read by the image reading device 200, and sends it to the storage unit 4.

4 to 6 are explanatory diagrams for explaining the operation of the grouping operation menu in the electronic blackboard device 100 according to the first embodiment of the present invention.
For example, when the user appropriately operates the interface screen of the display unit 7, a grouping operation menu is displayed on the display unit 7 as shown in FIG.

  In the grouping operation menu, an item “grouping condition selection” and an item “group arrangement selection” are provided. The user can select an item by checking a radio button related to any item.

  For example, when the item “grouping condition selection” is selected by the user, as shown in FIG. 5, an item “divide by keyword” and an item “divide by format” are provided. A menu is displayed. Each item has a pull-down menu for displaying sub-items. For example, when the “animal / plant” item is selected by the user from the pull-down menu, the keyword acquisition unit 12 acquires keywords corresponding to the animal group and the plant group based on the keyword table.

  Further, the submenu is provided with a “start classification” soft key, which is based on the keyword or classification criteria acquired by the keyword acquisition unit 12 when the user operates the “start classification” soft key. Classification begins.

  That is, the user appropriately operates the grouping operation menu to select a grouping condition, and the keyword acquisition unit 12 acquires the classification-related keyword or classification reference via the grouping operation menu. However, the present invention is not limited to this, and the user may be able to input a predetermined keyword by himself (for example, handwriting using the pen-type input device 92).

  On the other hand, for example, when the item “group arrangement selection” is selected by the user, as shown in FIG. 6, the item “up / down”, the item “left / right”, and the item “upper left” A sub-menu including an item “/ lower right”, an item “upper right / lower left”, and an item “by sheet” is displayed. For example, when the item “Up / Down” is selected by the user from the pull-down menu, the arrangement receiving unit 14 receives an arrangement designation for arranging the groups above / below.

  That is, the user appropriately operates the grouping operation menu to specify the arrangement of the group according to the result of the classification process by the classification unit 11, and the arrangement reception unit 14 selects the group through the grouping operation menu. Accept placement specification.

  FIG. 7 is a flowchart showing grouping display processing in the electronic blackboard apparatus 100 according to the first embodiment of the present invention. For convenience of explanation, it is assumed that the user instructs the image reading apparatus 200 to read a document prior to the group display operation.

  The image reading apparatus 200 reads the original, and a plurality of images read by the image reading apparatus 200 are acquired by the communication unit 6 (S101) and stored in the storage unit 4. The display control unit 8 displays a plurality of images stored in the storage unit 4 on the display unit 7. FIG. 8 is an exemplary diagram showing an example in which a plurality of images based on the acquired images are displayed on the display unit 7 of the electronic blackboard device 100 according to the first embodiment of the present invention.

  In this case, for example, when the sizes of the plurality of images are different, the display control unit 8 displays the plurality of images reduced / enlarged to a uniform size as shown in FIG. You may comprise.

  Next, the user appropriately operates the interface screen to instruct display of a grouping operation menu. FIG. 9 is an explanatory diagram for explaining a display operation of the grouping operation menu in the electronic blackboard device 100 according to the first embodiment of the present invention.

  For example, when a user performs a touch operation on a predetermined soft key (indicated by an arrow in the drawing) shown in FIG. 9 twice using the pen-type input device 92, the CPU 1 performs the touch operation. The designated coordinates are acquired from the pen input control unit 10, and the CPU 1 receives an instruction to display the grouping operation menu (S102). Thereafter, the CPU 1 instructs the display control unit 8 to display the grouping operation menu shown in FIG. 4 on the display unit 7 (S103).

  Next, the user appropriately operates a submenu of the grouping operation menu shown in FIG. 5 to instruct acquisition of a keyword or classification standard. The keyword acquisition unit 12 receives an instruction to acquire a keyword or classification standard via the grouping operation menu, and acquires a keyword or classification standard based on the keyword table in the storage unit 4 (S104). Acquisition of keywords or classification criteria by the keyword acquisition unit 12 is as described above, and a detailed description thereof is omitted. (In the following, for convenience of explanation, a case where the keyword acquisition unit 12 acquires a keyword will be described as an example.)

  Further, the user appropriately operates the submenu of the grouping operation menu shown in FIG. 6 to designate the arrangement of the groups related to the result of the classification processing by the classification unit 11. The placement receiving unit 14 receives the group placement instruction via the grouping operation menu (S105). The reception of position designation by the arrangement receiving unit 14 is as described above, and detailed description thereof is omitted.

  After instructing acquisition of keywords or classification criteria and specifying group arrangement, the user operates the “start classification” soft key provided in the submenu of FIG. 5 or FIG. The CPU 1 accepts an instruction to start classification through the “start classification” soft key of the submenu (S106).

  Next, the CPU 1 instructs the character recognition unit 13 to recognize characters included in the acquired image acquired in S101. In accordance with an instruction from the CPU 1, the character recognition unit 13 performs an OCR process on the acquired image, and recognizes a character corresponding to the text data acquired by the OCR process (S107).

  Thereafter, the classification unit 11 performs a classification process (S108). That is, the classification unit 11 performs the classification process by comparing the keyword acquired by the keyword acquisition unit 12 with the characters included in each image recognized by the character recognition unit 13. For example, the classification unit 11 classifies an image including the keyword as a character and an image not including the keyword.

  After the classification process by the classification unit 11 is completed, the CPU 1 instructs the display control unit 8 to display the acquired image in groups related to the result of the classification process by the classification unit 11. In response to an instruction from the CPU 1, the display control unit 8 displays the acquired images in groups based on the group arrangement designation received by the arrangement reception unit 14 (S109).

  FIG. 10 is an exemplary diagram showing a processing result of grouping display in the electronic blackboard device 100 according to the first embodiment of the present invention. For convenience of explanation, in S105, the arrangement receiving unit 14 has received an arrangement instruction to arrange the groups related to the classification processing result above / below. As a result of the classification by the classification unit 11, an image including a predetermined keyword is displayed. Assume that the images are classified into images that do not include the keyword.

  Before the processing, the plurality of acquired images shown in FIG. 9 are obtained by performing grouping display processing according to the present invention, as shown in FIG. 10, an image including a predetermined keyword, an image not including the keyword, They are divided into upper and lower portions of the display unit 7 respectively.

  The configuration of the display device according to the present invention is not limited to the above description. For example, the image reading device 200 may be configured to be incorporated in the electronic blackboard device 100, or the CPU 1 may be configured to be provided outside the electronic blackboard device 100.

(Embodiment 2)
FIG. 11 is a functional block diagram showing a main configuration of the electronic blackboard device 100 according to Embodiment 2 of the present invention. The electronic blackboard apparatus 100 according to the second embodiment has substantially the same configuration as the electronic blackboard apparatus 100 according to the first embodiment, but is connected not only to the image reading apparatus 200 but also to the Internet 300 via the communication unit 6. Yes. Therefore, the electronic blackboard apparatus 100 according to the second embodiment can acquire a keyword from the Internet.

  FIG. 12 is a flowchart showing grouping display processing in the electronic blackboard apparatus 100 according to the second embodiment of the present invention.

  Prior to the grouping display operation, the user instructs the image reading apparatus 200 to read a document. The image reading apparatus 200 reads the original, and a plurality of images read by the image reading apparatus 200 are acquired by the communication unit 6 (S201) and stored in the storage unit 4. The display control unit 8 displays a plurality of images stored in the storage unit 4 on the display unit 7.

  Next, the user appropriately operates the interface screen to instruct display of a grouping operation menu. As a result, the CPU 1 accepts an instruction to display the grouping operation menu (S202). Thereafter, the CPU 1 instructs the display control unit 8 to display the grouping operation menu shown in FIG. 4 on the display unit 7 (S203).

  Next, the user appropriately operates a submenu of the grouping operation menu shown in FIG. 13 to instruct acquisition of a keyword or classification standard. Unlike the case of the first embodiment, the submenu further includes an item “obtained from the Internet”. In the following, for convenience of explanation, a case where the user checks the radio button of the item “acquire from the Internet” in the submenu will be described as an example.

  When the user checks the radio button of the item “acquire from the Internet” in the submenu, the CPU 1 instructs the communication unit 6 to connect to the Internet 300. In response to an instruction from the CPU 1, the communication unit 6 connects to the Internet 300 (S204).

  Next, the keyword acquisition unit 12 acquires a keyword from the Internet 300 (S205). For example, the keyword acquisition unit 12 is connected to Google (registered trademark) via the communication unit 6 and acquires the first search term as a keyword.

The subsequent processing is the same as the processing from S105 to S109 in the first embodiment, and detailed description thereof is omitted.

  The same parts as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.

(Embodiment 3)
FIG. 14 is a functional block diagram showing a main configuration of the electronic blackboard device 100 according to Embodiment 3 of the present invention. The electronic blackboard device 100 according to the third embodiment is configured such that a computer program for performing an operation can be provided on a portable recording medium A such as a CD-ROM via the I / F 15. . Furthermore, the electronic blackboard device 100 according to the third embodiment is configured such that the computer program can be downloaded from an external device (not shown) via the communication unit 6. The contents will be described below.

  The electronic blackboard device 100 according to the third embodiment includes an exterior (or interior) recording medium reading device (not shown), and causes the recording medium reading device to recognize characters included in each image. Based on the result, a portable recording medium A on which a program for classifying a plurality of images into groups is inserted, and for example, the CPU 1 installs this program in the ROM 2. Such a program is loaded into the RAM 3 and executed. Thereby, it functions as the electronic blackboard apparatus 100 of the present invention of the first embodiment and the second embodiment.

  The recording medium may be a so-called program medium, a tape system such as a magnetic tape and a cassette tape, a magnetic disk such as a flexible disk and a hard disk, and a disk system of an optical disk such as a CD-ROM / MO / MD / DVD, It may be a medium carrying a fixed program code including a card system such as an IC card (including a memory card) / optical card or a semiconductor memory such as a mask ROM, EPROM, EEPROM, flash ROM or the like.

  It may be a medium that fluidly carries the program code so as to download the program code from the network via the communication unit 6. When the program is downloaded from the communication network in this way, the download program may be stored in the main device in advance or may be installed from another recording medium. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  The same parts as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.

1 CPU
6 Communication part 7 Display part 8 Display control part (display means)
DESCRIPTION OF SYMBOLS 11 Classification part 12 Keyword acquisition part 13 Character recognition part 14 Arrangement reception part 100 Electronic blackboard apparatus

Claims (8)

In a display device including a display unit that acquires and displays a plurality of images,
Classification means for classifying the plurality of images into groups;
And a display unit configured to display the plurality of images divided into groups based on a result of group classification by the classification unit.   The display device according to claim 1, further comprising an arrangement receiving unit that receives an arrangement designation of a group related to the classification result.   The display device according to claim 1, further comprising an acquisition unit configured to acquire a keyword related to the classification. Character recognition means for recognizing characters included in each image;
4. The display device according to claim 1, wherein the classifying unit is configured to classify the plurality of images into groups based on a result of recognition by the character recognizing unit.   The display device according to claim 3, wherein the acquisition unit is configured to be able to acquire a keyword via the Internet. In the display method of acquiring multiple images and displaying them in groups,
Recognizing characters contained in each image;
Classifying the plurality of images into groups based on the recognition result. In a computer program that causes a computer to acquire a plurality of images and display them in groups,
Causing a computer to recognize characters contained in each image;
And causing the computer to classify the plurality of images into groups based on the recognition result.   A computer-readable recording medium on which the computer program according to claim 7 is recorded.

Images