JP2010205137A - Image management device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To improve operability when calling an image formed as a plurality of pieces of additional information are affixed in certain positions. <P>SOLUTION: If a document with a memo that is formed (created) is re-displayed on a display screen for a previous conference that proceeded as attendants shared ideas by inputting and/or creating memos showing the contents of the ideas they created on portable terminals, and attaching and displaying the memos on the display screens of display devices, the memo attached to the document with the memo to be displayed is displayed on a portable terminal and re-display is instructed (210); then the memo's ID is sent from the portable terminal to a document display management device (214) and the document display management device searches for information about the document with the memo to be displayed, according to the memo's ID (216), obtains necessary information from each server (218-226), and creates and/or displays an image of the document with the memo to be displayed (228). <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image management apparatus and an image management program.

  When collaborating with a group of people while sharing ideas, each person writes their ideas on a sticky note or paper card. By arranging them above, it is often the case that content is gathered while sharing ideas.

  In relation to the above, Patent Document 1 provides a display shared by users attending a meeting on a table device, and each user is instructed to transfer information input using a pen computer to the table device. And a technique for transferring the information to a table device and displaying the information on a display.

  Patent Document 2 detects whether or not the terminal device is in contact with the image display unit of the display device. If the terminal device is in contact, the selected pasted image is transmitted from the terminal device to the display device. The display device discloses a technique for controlling the display layout of the received pasted image based on the contact state of the terminal device with the image display unit.

JP 2000-236329 A JP 2007-316925 A

  An object of the present invention is to obtain an image management apparatus and an image management program capable of improving the operability when calling an image formed by pasting a plurality of additional information at arbitrary positions.

  In order to achieve the above object, the image management apparatus according to the first aspect of the present invention represents a plurality of additional information in which a pasting position in each pasting area is designated and pasting is designated, and the designated pasting position is indicated. Registration means each associated with position information and associated with each other and registered in the storage means; specific additional information specified as information for specifying an output target image; additional information associated with the specific additional information; Reading means for reading position information corresponding to each piece of additional information from the storage means, and each piece of additional information read from the storage means by the reading means to the pasting position represented by the corresponding position information. Output means for generating a pasted image and outputting the generated image.

  The invention according to claim 2 is the invention according to claim 1, wherein the pasted area is a display surface of a display means, and the registration means is for a mount image displayed on the display surface of the display means. The plurality of additional information is registered in response to the designation of the pasting position and the pasting instruction of the additional information, and the information on the mount image is also associated with the plurality of additional information in the storage unit. The reading means also reads information on the mount image associated with the specific additional information from the storage means, and the output means stores the individual additional information read from the storage means in the storage Of the mount images whose information is read from the means, images pasted at the pasting positions indicated by the corresponding position information are generated.

  According to a third aspect of the present invention, in the first or second aspect of the present invention, the output unit performs display on the display unit as the output of the generated image.

  According to a fourth aspect of the present invention, in the invention according to any one of the first to third aspects, the registration means includes the additional information instructed to be pasted and the position information indicating the designated pasting position, The information is registered in the storage unit together with the identification information given to the additional information, and the reading unit stores the storage using the identification information set as the specific additional information specified as information for specifying the output target image as a key. The specific additional information registered in the means is searched.

  The invention according to claim 5 is the invention according to any one of claims 1 to 4, wherein the area to be pasted is a display surface of a display means, and the designation of the pasting position and an instruction for pasting additional information are provided. Correspondingly, display control means for displaying the additional information at the designated pasting position on the display surface of the display means is further provided.

  The invention according to claim 6 is the invention according to any one of claims 1 to 5, wherein the receiving means for receiving information from the portable terminal is brought close to or brought into contact with an arbitrary position in the pasted area. Position detecting means for detecting the approached or touched position of the mobile terminal, and the registration means includes information on the position of the mobile terminal approached or touched detected by the position detecting means. The additional information received from the portable terminal by the receiving means is associated with the corresponding position information and the additional information and registered in the storage means.

  According to a seventh aspect of the present invention, in the sixth aspect of the present invention, the receiving unit preliminarily receives the portable terminal from the portable terminal before an operation for bringing the portable terminal into or near an arbitrary position in the pasted area is performed. The additional information to be transmitted is received, and the portable terminal should be pasted to the position transmitted from the portable terminal when an operation for bringing the portable terminal into or near an arbitrary position in the pasted area is performed. Information for specifying additional information is received, and the registration means registers the additional information in the storage means when the receiving means receives the additional information, and the receiving means specifies the additional information Of the additional information registered in the storage means, the additional information specified by the received information represents the position detected by the position detection means. Causes registered in the storage means in association with the serial position information, already performs processing to associate with other additional information registered in the storage means.

  The invention according to claim 8 is the invention according to any one of claims 1 to 7, wherein the additional information is generated on the portable terminal by operating an input key provided on the portable terminal. Text information, or image information generated on the portable terminal by performing a handwriting input operation on a touch panel provided on the portable terminal.

  The image management program according to the invention described in claim 9 is directed to a computer capable of reading and writing storage means, a plurality of additional information in which a pasting position in each pasting area is designated and pasting is designated, and a designated pasting position. Each of which is associated with the position information representing the registration information, the registration means each of which is associated with each other and registered in the storage means, the specific additional information specified as the information for specifying the output target image, the additional information associated with the specific additional information, And reading means for reading position information corresponding to each additional information from the storage means, and a pasting position represented by the corresponding position information for each additional information read from the storage means by the reading means. An image pasted on each of the images is generated and functions as output means for outputting the generated image.

  The inventions of claims 1, 2, 8 and 9 are more operable when calling up an image formed by pasting a plurality of additional information at arbitrary positions, as compared with the case without this configuration. It is possible to improve the effect.

  The invention according to claim 3 has an effect that a plurality of persons can simultaneously confirm the output image as compared with the case where the present configuration is not provided.

  The invention according to claim 4 has an effect that the time required for the retrieval of the additional information by the reading means can be shortened as compared with the case where this configuration is not provided.

  According to the fifth aspect of the present invention, it is possible to visually confirm the state in which a plurality of additional information instructing the pasting is pasted at the designated pasting position, as compared with the case without this configuration. Has the effect.

  The invention according to claim 6 has an effect that the operation for designating the sticking position is simplified as compared with the case where this configuration is not provided.

  The invention according to claim 7 completes the processing in a short time when an operation for bringing the portable terminal close to or in contact with an arbitrary position in the pasted region is performed, as compared with the case without this configuration. Has the effect of being able to.

It is a block diagram which shows schematic structure of the meeting assistance system which concerns on this embodiment. It is a flowchart which shows the content of the document display management process by a document display management apparatus. It is a sequence diagram which shows the processing sequence at the time of document preparation with a memo. It is an image figure of the screen displayed on the display part of a portable terminal. It is the schematic for demonstrating sticking operation which instruct | indicates sticking of a memo. It is a sequence diagram which shows the processing sequence at the time of document redisplay with a memo. It is a sequence diagram which shows the process sequence at the time of related memo download.

  Hereinafter, an example of an embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 shows a conference support system 10 according to the present embodiment and mobile terminals 40 possessed by individual users who use the conference support system 10. The conference support system 10 includes a document storage server 12, a memo storage server 14, an external access point 16, and a document display management device 18, which are connected to each other via a network 20 such as a LAN. The document storage server 12, the memo storage server 14, and the external access point 16 are each composed of a server computer and are provided with storage units 12A, 14A, 16A each composed of an HDD (Hard Disk Drive) or the like. The storage unit 12A of the document storage server 12 stores information on an arbitrary document (excluding a document with a memo attached), and the storage unit 14A of the memo storage server 14 stores memo information. The The external access point 16 is connected to the Internet 84, and information received by the external access point 16 via the Internet 84 is temporarily stored in the storage unit 16 </ b> A of the external access point 16.

  The document display management device 18 is composed of, for example, an LCD, a plasma display, etc., and is installed on a wall of a conference room. The document display management device 18 has a display screen so that individual users attending the conference can visually recognize the images displayed on the display screen. A display device 22 having a large screen is provided. In addition, a position detection unit 24 is attached to the display device 22. In this embodiment, when the user desires to attach a memo to a desired position in the image displayed on the display screen of the display device 22, the portable terminal 40 possessed by the user is On the display screen of the display device 22, an operation (pasting instruction operation) for contacting a position where a memo is to be pasted is performed (details will be described later). The position detection unit 24 includes, for example, a touch panel disposed on the display screen of the display device 22, and the XY coordinates of the position (pasting instruction position) where the mobile terminal 40 is touched when the above-described pasting instruction operation is performed. Detect value. The position detection method by the position detection unit 24 may be any known method such as a resistive film method or a surface acoustic wave method. The position detector 24 corresponds to the position detector described in claim 6.

  The display device 22 and the position detection unit 24 are connected to the control unit 26. The control unit 26 includes a CPU 26A, a memory 26B, an HDD (Hard Disk Drive), a flash memory, and the like, and includes a non-volatile storage unit 26C that can rewrite the storage contents, and the network 20 via the communication I / F unit 28. It is connected to the. In addition, a document display management program for performing document display management processing, which will be described later, is installed in the storage unit 26C of the control unit 26 in advance. This document display management program corresponds to the image management program according to the present invention, and the document display management device 18 is configured such that the CPU 26A of the control unit 26 executes the document display management program, whereby the document storage server 12 and the memo storage server. 14 and the external access point 16 function as an image management apparatus according to the present invention.

  The control unit 26 is connected to an IC chip head 30 for short-distance wireless communication with a portable terminal 40 (an IC chip 42 (described later) built in the portable terminal 40). The IC chip head 30 includes an antenna 32, an RF circuit 34, and a conversion circuit 36. When the electromagnetic wave is received by the antenna 32, the RF circuit 34 amplifies the signal output from the antenna 32 and outputs the amplified signal to the conversion circuit 36. When the signal is input from the conversion circuit 36, the RF circuit 34 Is supplied to the antenna 32, and the input signal is radiated from the antenna as an electromagnetic wave. The conversion circuit 36 demodulates and decodes the signal input from the RF circuit 34, outputs the digital data obtained by the demodulation and decoding to the control unit 26, and encodes the digital data input from the control unit 26. The carrier signal is modulated with the signal thus output, and the modulated signal is output to the RF circuit 34. The IC chip head 30 corresponds to the receiving means described in claim 6 and the like.

  On the other hand, the portable terminal 40 includes an IC chip 42, which is integrated with an antenna 44 and includes a power circuit 46, an RF circuit 48, a conversion circuit 50, a CPU 52, and a memory 54. . The power supply circuit 46 forms a resonance circuit together with the antenna 44. When an electromagnetic wave having a specific frequency is received by the antenna 44, the power is accumulated in a capacitor (not shown) by mutual induction action, and the accumulated power is rectified to be CPU 52 or the like. It is comprised so that it may supply to the circuit of this. The CPU 52 controls the operation of each part of the IC chip 42. The RF circuit 48 amplifies the signal output from the antenna 44 when the electromagnetic wave is received by the antenna 44 and outputs the amplified signal to the conversion circuit 50. When the signal is input from the conversion circuit 50, the RF circuit 48 The signal is amplified and supplied to the antenna 44. The conversion circuit 50 demodulates and decodes the signal input from the RF circuit 48, outputs digital data obtained by the demodulation and decoding to the CPU 52, and encodes the digital data input from the CPU 52 with a carrier signal. And the modulated signal is output to the RF circuit 48.

  Note that the IC chip head 30 of the document display management device 18 is disposed in the vicinity of the display screen of the display device 22, and the casing of the mobile terminal 40 contacts the display screen of the display device 22 (the pasted area according to the present invention). Alternatively, when the display device 22 is moved to a position very close to the display screen of the display device 22, the IC chip head 30 and the portable terminal 40 of the document display management device 18 can communicate with the IC chip 42.

  Next, the main body of the mobile terminal 40 will be described. The IC chip 42 built in the portable terminal 40 is connected to a control unit 56 that includes a CPU and a memory, and can communicate with the control unit 56. The control unit 56 is connected to a storage unit 58 composed of a non-volatile memory (for example, a flash memory) that can rewrite the stored contents. The storage unit 58 can be executed by various CPUs that can be executed by the CPU of the control unit 56. These programs are stored in advance, and memo information to be described later is also stored. Further, a display unit 60 with a touch panel and an operation unit 62 configured to include a power switch, a numeric keypad, and the like are provided on the front surface of the portable terminal 40, and the display unit 60 with a touch panel and the operation unit 62 are control units. 56. Note that the position detection method in the display unit 60 with a touch panel may be any known method such as a resistive film method or a surface acoustic wave method, as in the position detection unit 24. The mobile terminal 40 also includes a gyro sensor 64 that detects the inclination of the casing of the mobile terminal 40, and this gyro sensor 64 is also connected to the control unit 56.

  The mobile terminal 40 also has a function as a mobile phone that enables a call or communication via the wireless communication network 80. Although not shown in the figure, the wireless communication network 80 includes a large number of exchanges connected to each other via a communication line, and a large number of base stations that are installed at different locations and perform wireless communication with the mobile terminal 40. Each is connected to any of a number of exchanges. On the other hand, a speaker 68 is connected to the control unit 56 through an amplifier 66, a microphone 72 is connected through an amplifier 70, and an antenna 76 is connected through a wireless communication unit 74. Yes. The wireless communication unit 74 is a part that performs wireless communication via the wireless communication network 80, and is controlled by the electromagnetic wave of a predetermined frequency band that is allocated in advance for the mobile phone via the antenna 76 under the control of the control unit 56. The wireless communication network 80 has a function of performing wireless communication with a specific base station.

  The wireless communication network 80 is interconnected with the Internet 84. The mobile terminal 40 has a function for transmitting and receiving information between a computer connected to the Internet 84 and the mobile terminal 40 (hereinafter referred to as an Internet access function), and the wireless communication network 80 is connected to the Internet 84. A server 82 is provided that controls transmission and reception of information (for example, browsing of web pages, transmission and reception of electronic mail, file transfer, etc.) between the computer and the portable terminal 40 having the Internet access function. As the mobile terminal in the present embodiment, a mobile phone equipped with various additional functions is suitable, but other devices such as PDA (Personal Digital Assistants) may be used.

  Next, as an operation of the present embodiment, referring to FIG. 2 showing the contents of the document display management process executed by the control unit 26 of the document display management device 18, first, in the conference room where the display device 22 is installed, With reference to FIG. 3, a processing sequence when a meeting is held in which an attached document is created (formed) and discussed and collaborated is considered.

  In the above meeting, if there is a document that serves as a basis for discussion (documents whose contents should be displayed on the display device 22 during the meeting), any user attending the meeting prior to the start of the meeting The document to be displayed is selected from the documents stored in the storage unit 12A of the document storage server 12, and the document display management device 18 is instructed to display the document on the display device 22. This instruction may be performed via a PC (not shown) connected to the network 20 or by operating the portable terminal 40 possessed by any user attending the conference. It is also possible.

  In the document display management process in the document display management device 18, in step 100, it is determined whether a display target document is selected and an instruction to display on the display device 22 is given. If this determination is negative, the process proceeds to step 102, and it is determined whether or not an instruction to attach a memo to the document displayed on the display device 22 has been issued. If this determination is negative, the routine proceeds to step 104, where it is determined whether or not an instruction to save the memo-added document displayed on the display device 22 has been issued. When this determination is also denied, the process proceeds to step 106, and it is determined whether or not an instruction to redisplay the memo-added document stored in the storage unit 12A of the document storage server 12 on the display device 22 is issued. When this determination is also denied, the process proceeds to step 108, and it is determined whether or not downloading of a memo related to a specific memo is requested. If this determination is also negative, the process returns to step 100, and steps 100 to 108 are repeated until any of the above determinations are affirmed.

  Therefore, when a document to be displayed is selected and a display on the display device 22 is instructed, the determination in step 100 in FIG. 2 is affirmed and the process proceeds to step 110, and a display on the display device 22 is instructed. Requests document information to the document storage server 12 (see also step 160 in FIG. 3). As a result, the document storage server 12 retrieves the requested document information from the document information stored in the storage unit 12A, and transmits the document information extracted by the retrieval to the document display management device 18. (See also step 162 in FIG. 3). When the requested document information is received from the document storage server 12, the process proceeds to step 112, and an image representing the content of the document selected as a display target (document with no memo attached) based on the information received from the document storage server 12. Is displayed on the display surface of the display device 22 (see also step 164 in FIG. 3). In the following, a document whose contents are displayed on the display device 22 in the above processing is referred to as a mount document, and an image representing the contents of the mount document (the image displayed on the display device 22 in step 112) is referred to as a mount image). .

  Each document whose information is stored in the storage unit 12A of the document storage server 12 is given a document ID for identifying the individual document, and the document storage server 12 stores information on the mount document. When transmitting, the document ID of the mount document is also transmitted at the same time. A document information storage area with a memo is provided on the memory 26B of the document display management device 18. In the next step 114, the document ID of the mount document received from the document storage server 12 is stored in the document information storage area with a memo. And return to step 100. Note that the present embodiment is not limited to displaying the mount image on the display device 22 during the conference. The conference is started without an instruction to display the mount document on the display device 22, and the display device 22 is displayed. A memo may be pasted in a state where the mount image is not displayed. In this case, the document ID of the mount document is not stored in the document information storage area with a memo. The mount image may be a blank image or an image on which only a frame indicating the pasting range is displayed.

  When the conference is started, discussions and the like by each user who attends the conference start. A user who has some idea while proceeding with the discussion or the like starts with the mobile terminal 40 owned by the user. To input a floating idea as a memo (see also step 166 in FIG. 3). This memo input operation is a character string or figure representing the contents of a floating idea in a state where, for example, a memo handwriting input screen as shown in FIG. Is performed by handwriting on the display screen with the pen 90.

  When the memo input operation is performed by the user, the control unit 56 of the portable terminal 40 detects the XY coordinates (plane coordinates) of the portion pressed by the tip of the pen 90 in the display screen of the display unit 60 with a touch panel. -It is memorized and it is handwritten by a memo input operation by the user by repeatedly displaying dots on the portion pressed by the tip of the pen 90 in the display screen of the display unit 60 with a touch panel based on the detected XY coordinates. An input memo display process for displaying the input memo on the display screen of the display unit 60 with a touch panel is performed (see also step 168 in FIG. 3).

  As shown in FIG. 4 (A), the memo handwriting input screen is provided with a button 91 for instructing to save the memo input by the memo input operation. By performing an operation such as selecting the button 91 by 90, an instruction to save the memo input by the memo input operation is given (see also step 170 in FIG. 3). When the user instructs saving of the memo, the control unit 56 of the portable terminal 40 hashes information (memo ID) for identifying the memo to be stored displayed on the display screen of the display unit 60 with a touch panel. It is generated using a function or the like (see also step 172 in FIG. 3). Further, memo image information representing a memo to be stored displayed on the display screen of the display unit 60 with a touch panel is generated, and the generated memo image information is stored in the storage unit 58 in association with the previously generated memo ID. At the same time, the memo image information and memo ID are transmitted to the memo storage server 14 via the wireless communication unit 74 (see also step 174 in FIG. 3).

  Information transmitted from the wireless communication unit 74 of the portable terminal 40 is temporarily received by the external access point 16 via the wireless communication network 80 and the Internet 84 and temporarily stored in the storage unit 16A of the external access point 16. On the other hand, the memo storage server 14 makes an inquiry to the external access point 16 at regular intervals as to whether or not the information addressed to the server is received, and the memo storage server transmitted from the portable terminal 40 when the inquiry is made. If the information addressed to 14 is stored in the storage unit 16 </ b> A of the external access point 16, the information is transferred from the external access point 16 to the memo storage server 14. The memo storage server 14 can discriminate from the information (memo image information, memo ID) transferred from the external access point 16 from the information indicating the current date and time as the storage date and the information identifying the transmission source mobile terminal 40. Information indicating the creator of the memo is added and registered as new memo information in the storage unit 14A (see also step 176 in FIG. 3).

  When the storage of the memo input by the memo input operation as described above is completed, the user who created the memo instructs the user to paste the created memo at a desired position on the display screen of the display device 22. I do. This operation is performed when the memo to be pasted is displayed on the display unit 60 with a touch panel (see FIG. 4B), and the processing menu for the currently displayed memo displayed on the display unit 60 with the touch panel is displayed. The button 92 for instructing the user is selected with the pen 90, and “Paste on screen” is selected from among a plurality of options (see FIG. 4C) displayed on the display unit 60 with a touch panel in accordance with this operation. 90 (see also step 178 in FIG. 3), and then an operation of bringing the casing of the portable terminal 40 into contact with a desired pasting position in the display screen of the display device 22 (see also step 182 in FIG. 3). ).

  Note that the memo to be pasted is not limited to the memo immediately after the input, but may be a memo input in the past and stored as memo image information in the storage unit 58 of the portable terminal 40. In this case, a memo stored as memo image information in the storage unit 58 is displayed on the display unit 60 with a touch panel, and when the displayed memo is not a target to be pasted, an instruction to switch the memo to be displayed is given. Can be instructed to attach a memo input in the past by performing the above-described series of operations after the state is displayed on the display unit 60 with a touch panel.

  When “paste to screen” is selected by the user, the control unit 56 of the portable terminal 40 is associated with the memo image information of the memo (the memo to be pasted) displayed on the display unit 60 with a touch panel. The stored memo ID is read from the storage unit 58 (see also step 180 in FIG. 3), and the inclination (inclination information) of the casing of the mobile terminal 40 detected by the gyro sensor 64 is acquired from the gyro sensor 64, After the ID, the tilt information, and the information for instructing the pasting of the memo are stored in the memory 54 of the IC chip 42 as the transmission target information, the tilt information is acquired from the gyro sensor 64 and stored in the memory 54 as the transmission target information. Repeat overwriting the tilt information with the acquired tilt information.

  On the other hand, in the document display management device 18, when an operation for bringing the casing of the portable terminal 40 into contact with the display screen of the display device 22 is performed by the user, the IC chip head 30 performs information on the IC chip 42 of the portable terminal 40. In response to this request, the IC chip 42 reads out the memo ID, the tilt information, and the information for instructing the memo from the memory 54 and transmits the information (see also step 184 in FIG. 3). Received by the IC chip head 30. In the document display management device 18, the position detection unit 24 detects that the casing of the portable terminal 40 is in contact with the display screen of the display device 22, and the IC chip head 30 attaches the memo ID, the tilt information, and the memo. When the instructing information is received from the portable terminal 40 (the IC chip 42), the determination in step 102 of the document display management process (FIG. 2) is affirmed and the process proceeds to step 116, and the received memo ID and inclination information are received. Is obtained from the IC chip head 30.

  In the next step 118, the memo ID received from the portable terminal 40 (the IC chip 42 thereof) is transmitted to the memo storage server 14, and the memo storage server 14 is requested for information on the memo assigned with the memo ID (FIG. 3). (See also step 186). Accordingly, the memo storage server 14 searches the storage unit 14A using the memo ID received from the document display management device 18 as a key, and manages the memo image information of the memo (the memo to be pasted) extracted by the search. Transmit to device 18 (see also step 188 in FIG. 3).

  In the document display management device 18, when the memo image information of the memo to be pasted is received from the memo storage server 14, the process proceeds to step 120, where the casing of the portable terminal 40 is touched on the display screen of the display device 22, that is, utilization. The position information (XY coordinates) of the memo pasting position designated by the person is acquired from the position detection unit 24 (see also step 190 in FIG. 3). Thereby, for example, when the casing of the portable terminal 40 is brought into contact with the position indicated by the dashed arrow indicated as “paste instruction operation” in FIG. 5 on the display screen of the display device 22, the position information ( As XY coordinates), the XY coordinates at the position where the two broken lines shown in FIG. 5 intersect are acquired.

  In the next step 122, the memo represented by the memo image information acquired from the memo storage server 14 is received in the previous step 116 at the memo pasting position represented by the position information acquired in step 120 in the display screen of the display device 22. Are additionally displayed in the direction corresponding to the tilt information (see also step 192 in FIG. 3). Thereby, the memo (additional information according to the present invention) input and created by the user via the portable terminal 40 is used at the memo pasting position designated by the user for the mount image displayed on the display device 22. It is pasted in the direction according to the inclination of the portable terminal 40 when the person indicates the memo pasting position. This step 122 corresponds to the display control means described in claim 5. In step 124, the information of the memo additionally displayed on the display device 22 in step 122 (the memo ID, the position information of the memo pasting position and the tilt information) is additionally stored in the document information storage area with memo on the memory 26B. Return to 100 (see also step 194 in FIG. 3).

  Each operation of creating and storing a memo and pasting it on the display screen of the display device 22 is performed each time an idea floats by each user who attends the conference. Therefore, as the conference progresses, the display device 22 As shown in FIG. 5 as an example, the display screen of FIG. 5 is in a state where a plurality of memos representing the contents of the idea that each user who attended the meeting came up with are attached to the mount image displayed from the beginning. Then, by proceeding with the discussion while referring to an image with a plurality of memos as described above, it is possible to quickly summarize the contents while sharing the ideas that each user has come up with.

  In addition, when the discussion is divided into sections and the discussion is performed on a new agenda or when the conference is ended, any user who participates in the conference operates the portable terminal 40 and is displayed on the display device 22. The document display management device 18 is instructed to store the memo-added document (see also step 196 in FIG. 3). Note that the storage of a document with a memo is instructed not only when the discussion is delimited, but also when the discussion is interrupted on the assumption that it will be resumed at the next opportunity. In the document display management device 18, when the above instruction is input, the determination in step 104 of the document display management process (FIG. 2) is affirmed, the process proceeds to step 126, and is stored in the document information storage area with memo on the memory 26B. Information (the memo ID of each memo displayed on the display device 22, the position information and tilt information of the memo pasting position, and if the mount image is also displayed on the display device 22, the mount document corresponding to the mount image) Is registered in the storage unit 26C as information on a new document with a memo (see also step 198 in FIG. 3), and the process returns to step 100. In addition, said step 126 respond | corresponds to the registration means which concerns on this invention with the previous steps 116-120,124.

  Also, created (formed) at a past conference and saved for the purpose of resuming the discussion that was interrupted at the previous conference, or for discussing a new topic based on the previous discussion. When the user wants to redisplay the document with a memo displayed on the display device 22, the user instructs the redisplay of the document with a memo to be redisplayed by performing the following operation via the portable terminal 40.

  That is, first, a memo stored as memo image information in the storage unit 58 of the portable terminal 40 is displayed on the display unit 60 with a touch panel, and the memo to be redisplayed is instructed appropriately by switching the displayed memo appropriately. The memo attached to the attached document is displayed on the display unit 60 with a touch panel. Next, a button 92 (see FIG. 4B) for instructing display of a processing menu for the currently displayed memo displayed on the display unit 60 with a touch panel is selected with the pen 90, and accompanying this operation. Of the plurality of options displayed on the display unit 60 with a touch panel (see FIG. 4C), “document display with memo” is selected with the pen 90. Then, the casing of the portable terminal 40 is brought close to an arbitrary position on the display screen of the display device 22 (see also step 210 in FIG. 6).

  As described above, when “display document with memo” is selected by the user, the control unit 56 of the mobile terminal 40 displays the memo displayed on the display unit 60 with a touch panel (attached to the document with memo to be redisplayed). The memo ID stored in association with the memo image information of the memo is read from the storage unit 58 (see also step 212 in FIG. 6), and the memo ID and information for instructing the display of the memo-added document are displayed on the IC chip. 42 is stored as transmission target information in the memory 54.

  On the other hand, in the document display management device 18, when the user performs an operation to bring the casing of the mobile terminal 40 close to the display screen of the display device 22, the IC chip head 30 causes the IC chip head 30 to store information on the IC chip 42. In response to this request, the IC chip 42 reads out the memo ID and information instructing display of the memo-added document from the memory 54 and transmits the information (see also step 214 in FIG. 6). Received by the IC chip head 30. In the document display management device 18, when the IC chip head 30 receives information for instructing display of a memo ID and a document with a memo from the portable terminal 40 (the IC chip 42 thereof), a step of the document display management process (FIG. 2). The determination of 106 is affirmed and the process proceeds to step 128, and the received memo ID is acquired from the IC chip head 30.

  In the next step 130, the memo with the memo of the memo ID received from the portable terminal 40 out of the information of the document with the memo stored in the storage unit 26C using the memo ID received from the portable terminal 40 as a key. Information on attached documents is searched (see also step 216 in FIG. 6). In step 132, the information of the document with memo extracted by the search in step 130 is referred to, and the document ID included in the information is extracted to recognize the document ID of the mount document in the document with memo to be displayed. In the next step 134, the recognized document ID is transmitted to the document storage server 12, and the document storage server 12 is requested for information on the document to which the document ID is assigned (see also step 218 in FIG. 6). As a result, the document storage server 12 searches the storage unit 12A using the document ID received from the document display management device 18 as a key, and transmits information of the document extracted by the search to the document display management device 18 (FIG. 6). (See also step 220).

  When the information on the mount document is received from the document storage server 12, the process proceeds to step 136, and the display is performed by referring to the information on the document with memo extracted by the search in step 130 and extracting all the memo IDs included in the information. The memo IDs of all memos attached to the target memo-attached document are recognized (see also step 222 in FIG. 6). In the next step 138, the recognized memo IDs are respectively transmitted to the memo storage server 14, and information on all memos corresponding to the individual memo IDs is requested to the memo storage server 14 (see also step 224 in FIG. 6). As a result, the memo storage server 14 searches the storage unit 14A using each memo ID received from the document display management device 18 as a key, and the memo information extracted by each search is sent to the document display management device 18 respectively. Transmit (see also step 226 in FIG. 6). Steps 128 to 138 described above correspond to the reading unit according to the present invention together with the document storage server 12 that actually reads the information of the mount document and the memo storage server 14 that actually reads the information of the memo.

  When the information of all memos attached to the document with a memo to be displayed is received from the memo storage server 14, the process proceeds to step 140, and first, the contents of the mount document are developed as images based on the information received from the document storage server 12. Later, the memo image represented by the memo image information included in the information of the specific memo received from the memo storage server 14 is represented by the position information of the specific memo included in the information of the document with the memo extracted by the search in step 130. By performing the expansion in the direction indicated by the inclination information of the specific memo included in the information of the memo-attached document at each position for all the memo information received from the memo storage server 14, Generate an image representing the document. In step 142, the image of the document with a note generated in step 140 is displayed on the display device 22 (see also step 226 in FIG. 6), and the process returns to step 100. Steps 140 and 142 correspond to the output means according to the present invention.

  Thus, in this embodiment, when redisplaying a desired memo-attached document, if any memo (a memo ID) attached to the memo-attached document that is desired to be redisplayed is specified, Since the target memo-added document is specified and displayed again, the operability when the desired memo-added document is displayed again is improved. In the present embodiment, since a single memo can be pasted on a plurality of mount images, the memo with the memo ID received from the portable terminal 40 is pasted in the redisplay of the memo-attached document described above. There may be a plurality of memo-attached documents. In this case, the user is notified, and one of the corresponding memo-added documents is displayed on the display device 22 and displayed on the display device 22. It is preferable to switch the document with memo to be sequentially switched in accordance with an instruction from the user.

  In addition, when the user wants to download and view a memo attached to a specific document with a memo created (formed) in the past to the mobile terminal 40, the user performs the following operation via the mobile terminal 40. Instruct to download the memo.

  That is, first, a memo stored as memo image information in the storage unit 58 of the mobile terminal 40 is displayed on the display unit 60 with a touch panel, and the memo with the memo to be downloaded is displayed by appropriately instructing switching of the displayed memo. A memo attached to the document is displayed on the display unit 60 with a touch panel. Next, a button 92 (see FIG. 4B) for instructing display of a processing menu for the currently displayed memo displayed on the display unit 60 with a touch panel is selected with the pen 90, and accompanying this operation. Of the plurality of options (see FIG. 4C) displayed on the display unit 60 with a touch panel, “related memo download” is selected with the pen 90. Then, the casing of the portable terminal 40 is brought close to an arbitrary position on the display screen of the display device 22 (see also step 230 in FIG. 7).

  As described above, when “download related memo” is selected by the user, the control unit 56 of the mobile terminal 40 displays the memo displayed on the display unit 60 with a touch panel (the same memo document as the memo to be downloaded). The memo ID stored in association with the memo image information of the memo attached to the memo is read from the storage unit 58 (see also step 232 in FIG. 7), and information for instructing to download the memo ID and the related memo is displayed. The information is stored in the memory 54 of the IC chip 42 as transmission target information.

  On the other hand, in the document display management device 18, when the user performs an operation to bring the casing of the mobile terminal 40 close to the display screen of the display device 22, the IC chip head 30 causes the IC chip head 30 to store information on the IC chip 42. In response to the request, the IC chip 42 reads out the information for instructing the download of the memo ID and the related memo from the memory 54 and transmits the information (see also step 234 in FIG. 7). Received by the chip head 30. In the document display management device 18, when the IC chip head 30 receives information instructing to download the memo ID and the related memo from the portable terminal 40 (the IC chip 42), step 108 of the document display management process (FIG. 2). Is affirmed, the process proceeds to step 144, and the received memo ID is acquired from the IC chip head 30.

  In the next step 146, the memo with the memo of the memo ID received from the mobile terminal 40 out of the information of the memo-added document stored in the storage unit 26C using the memo ID received from the mobile terminal 40 as a key. The attached document information is searched (see also step 236 in FIG. 7). In step 148, the information of the memo-attached document extracted by the search in step 146 is referred to, and all the memo IDs included in the information are extracted, so that they are attached to the same memo-added document as the received memo ID. The memo IDs of all memos are recognized (see also step 238 in FIG. 7). In the next step 150, the recognized memo IDs are respectively transmitted to the memo storage server 14, and information on all memos corresponding to the individual memo IDs is requested to the memo storage server 14 (see also step 240 in FIG. 7). As a result, the memo storage server 14 searches the storage unit 14A using each memo ID received from the document display management device 18 as a key, and the memo information extracted by each search is sent to the document display management device 18 respectively. Transmit (see also step 242 in FIG. 7).

  When the information of all the notes attached to the document with the same memo ID as the received memo ID is received from the memo storage server 14, the process proceeds to step 152, and the information of each memo received from the memo storage server 14 (the memo ID, The position information of each memo included in the information of the document with the memo extracted in the search in step 146 is added to the memo image information), and transmitted to the portable terminal 40 as the download instruction source via the Internet 84 (FIG. 7 (see also step 244 of FIG. 7), and returns to step 100. Of the memos that have received information from the memo storage server 14, the memo that matches the creator that can be identified from the information that identifies the download instruction source mobile terminal 40 by the creator of the memo included in the received information. Since it is highly likely that the data is stored in the mobile terminal 40 that is the download instruction source, it may be excluded from the transmission target to the mobile terminal 40 that is the download instruction source in step 152, or the position information may be When each memo is browsed using the memo, only the memo ID and the position information may be transmitted.

  In the portable terminal 40 in which the information of the memo transmitted from the document display management device 18 as described above is downloaded according to the user's instruction and saved in the storage unit 58, a memo browsing application is activated, and this memo is displayed. As shown in FIG. 4D as an example, the browsing application displays a related memo display screen on which a scroll mark 93 for switching the display target memo is displayed on the display unit 60 with a touch panel and downloaded. The memo image is displayed on the related memo display screen (see also step 246 in FIG. 7).

  When a memo viewing application displays a specific memo on the related memo display screen, it compares the position information of the specific memo with the position information of other memos, so that it is displayed on the memo-attached document with the specific memo attached. The direction in which another memo is present is determined, and only the scroll mark 93 corresponding to the direction in which the other memo is present is displayed on the related memo display screen on which the image of the specific memo is displayed (FIG. 4D). In the example shown in FIG. 8, eight scroll marks 93 for instructing scrolling in eight different directions are shown, but only the scroll mark 93 corresponding to the direction in which another mark exists is actually displayed. ) Then, when any of the scroll marks 93 displayed on the related memo display screen is selected, the memo browsing application selects the currently displayed memo on the memo-added document. A memo located in the direction corresponding to the selected scroll mark 93 is selected, and the selected memo is displayed on the related memo display screen. Thereby, each memo stuck on the same memo-added document can be browsed while grasping the positional relationship of each memo on the memo-added document.

  In addition, although the aspect which produces | generates memo ID by the portable terminal 40 was demonstrated above, it is not limited to this, The production | generation of memo ID is performed by the meeting assistance system 10 side (for example, memo preservation | save server 14), and is produced | generated. You may make it notify portable terminal 40 of memo ID which carried out.

  In the above description, the memo information input / created on the portable terminal 40 is stored in the memo storage server 14 before being instructed to be pasted on the display screen of the display device 22. When the application to the display screen of the display device 22 is instructed, the portable terminal 40 to the conference support system 10 side, for example, by wireless communication between the IC chip head 30 and the IC chip 42, etc. The memo image information may also be transferred.

  In addition, of the information of the document with a memo, a description will be given of a mode in which the information body of the mount document is stored in the document storage server 12 and the information body (memo image information) of each memo attached to the mount document is distributed and stored in the memo storage server 14. However, the present invention is not limited to this, and when an instruction to save a document with a memo is given, the entire information of the document with a memo including the information body of the mount document and the memo image information is stored in the storage unit 26C of the document display management device 18. You may make it memorize.

  Furthermore, in the above description, a mode in which re-displaying on the display device 22 when a document with a memo created and stored in the past is called up has been described. However, image output by the output unit according to the present invention has been described. However, the present invention is not limited to this. For example, printing on a paper medium or the like may be performed.

  Further, the additional information according to the present invention is not limited to the memo input / created on the mobile terminal 40. For example, a photographic image captured and stored by the mobile terminal 40 having a shooting function, or a mobile terminal 40 may be various marks registered in advance.

  In the above description, the aspect in which the present invention is applied to the support of a conference in which a plurality of people share ideas and discuss jointly is described. However, the present invention is not limited to this, and other embodiments may be used without departing from the present invention. Needless to say, it is also applicable to other applications.

  In the above description, the document display management program corresponding to the image management program according to the present invention is stored (installed) in the storage unit 26C of the control unit 26 of the document display management device 18 in advance. Such an image management program can be provided in a form recorded on a recording medium such as a CD-ROM or a DVD-ROM.

DESCRIPTION OF SYMBOLS 10 Meeting support system 12 Document storage server 14 Memo storage server 18 Document display management apparatus 22 Display apparatus 24 Position detection part 26 Control part 26C Storage part 30 IC chip head 40 Portable terminal 42 IC chip 56 Control part 58 Storage part 60 Display with a touch panel Part 90 pen

Claims (9)

A registration unit that associates a plurality of pieces of additional information, each of which is designated with a pasting position in the pasted area and instructed to be pasted, with position information representing the designated pasting position, and associates them with each other in the storage unit;
Reading means for respectively reading specific additional information designated as information for specifying an image to be output, additional information associated with the specific additional information, and position information corresponding to each additional information from the storage means; ,
An output unit that generates an image in which each additional information read from the storage unit by the reading unit is pasted at a pasting position represented by the corresponding position information, and outputs the generated image;
An image management device. The pasted area is a display surface of a display unit, and the registration unit is configured to specify the pasting position and an instruction to paste the additional information performed on the mount image displayed on the display surface of the display unit. Accordingly, each of the plurality of additional information is registered, and the information on the mount image is also registered in the storage unit in association with the plurality of additional information,
The reading means also reads information on the mount image associated with the specific additional information from the storage means,
The output means pastes each additional information read from the storage means to each of the mount images from which information has been read from the storage means, and pastes the images to the paste positions indicated by the corresponding position information. The image management apparatus according to claim 1 to be generated.   The image management apparatus according to claim 1, wherein the output unit performs display on the display unit as an output of the generated image. The registration means registers the additional information instructed to be pasted and the position information indicating the designated pasting position in the storage means together with the identification information given to the additional information,
The reading means searches for the specific additional information registered in the storage means by using identification information set in the specific additional information specified as information specifying the image to be output as a key. The image management apparatus according to any one of claims 1 to 3. The pasted area is a display surface of a display means,
The display control means for further displaying the additional information at the designated pasting position on the display surface of the display means in accordance with the designation of the pasting position and an instruction for pasting the additional information. 5. The image management apparatus according to any one of 4. Receiving means for receiving information from the mobile terminal;
Position detecting means for detecting the approached or contacted position of the mobile terminal that is approached or brought into contact with any position in the pasted area;
Further comprising
The registration unit includes the position information detected by the position detection unit and the additional information received from the mobile terminal by the receiving unit as the position information and the additional information corresponding to the information on the position at which the mobile terminal is approaching or touched. The image management apparatus according to claim 1, wherein the image management apparatus is associated and registered in the storage unit. The receiving unit receives the additional information transmitted in advance from the portable terminal before an operation for bringing the portable terminal to an arbitrary position in the pasted area or contacting is performed, and Received information for specifying additional information to be pasted to the position, transmitted from the mobile terminal when an operation for approaching or contacting an arbitrary position in the pasted area is performed,
The registration means registers the additional information in the storage means when the receiving means receives the additional information, and stores the additional information in the storage means when the receiving means receives information for specifying additional information. Among the registered additional information, the additional information specified by the received information is associated with the position information indicating the position detected by the position detecting means and registered in the storage means, and the storage 7. The image management apparatus according to claim 6, wherein a process for associating with other additional information already registered in said means is performed.   The additional information may be text information generated on the mobile terminal by operating an input key provided on the mobile terminal, or a handwriting input operation performed on a touch panel provided on the mobile terminal. The image management apparatus according to claim 1, wherein the image management apparatus is image information generated on a portable terminal. A computer that can read and write storage means
A plurality of additional information in which a pasting position in each pasting area is designated and pasting is instructed, each of which is associated with position information representing the designated pasting position, and is registered in association with each other in a storage unit;
Reading means for reading specific additional information specified as information for specifying an image to be output, additional information associated with the specific additional information, and position information corresponding to each additional information from the storage means,
And generating an image in which each additional information read from the storage unit by the reading unit is pasted to the pasting position represented by the corresponding position information, and functioning as an output unit that outputs the generated image. Image management program.