JP2006018760A - Image sharing system and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To share an image with all the terminals while discriminating clearly which terminals have performed writing. <P>SOLUTION: The image sharing system is provided with: a material management part 14 for storing material images; an antenna 20 and a radio communication part 16 for receiving drawing information transmitted by a plurality of terminals together with identification information specific to the respective terminals; a recording part 19 for recording a plurality of pieces of drawing information in association with each identification information; and a control unit 11 for creating image information which extends and superimposes the material image and the plurality of pieces of drawing information and having the antenna 20 and the radio communication part 16 transmit them to the plurality of terminals. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image sharing system and program suitable for an electronic conference using an image as a medium, for example.

Conventionally, write data input from a plurality of terminal devices is transferred to a shared display device, and the shared display device that has received this data displays the updated content on the shared screen, and at the same time, transfers the update information to each terminal device. The technology that was made to do was considered. (For example, Patent Document 1)
JP 05-056425 A

  However, the technique of the above-mentioned patent document is to simply superimpose and share the original image and the image written by the terminal device, and the contents once written are mixed with other writings so far. Since it is managed, it cannot be determined which part of the writing is made from which terminal device.

  The present invention has been made in view of the above circumstances, and the purpose of the present invention is to make one image in all terminal devices while clearly distinguishing the history of which terminal device is writing. It is an object to provide an image sharing system and a program capable of sharing the image.

  According to the first aspect of the present invention, a first receiving means for receiving image information, a display means for expanding and displaying the image information received by the first receiving means, and a writing input for the image displayed by the display means Handwriting input means for performing writing, handwriting display means for displaying a handwriting image corresponding to writing input by the writing input means superimposed on a display image by the display means, and drawing corresponding to writing input by the writing input means A plurality of terminal devices provided with a first transmission means for transmitting information together with terminal-specific identification information, a material storage means for storing material images, and sent from the plurality of terminal devices together with identification information unique to each terminal. Second receiving means for receiving drawing information, management means for managing a plurality of drawing information received by the second receiving means in association with each identification information, and a material image stored in the material storage means The superimposed image creating means for creating a superimposed image information by developing and superimposing a plurality of drawing information managed in association with the managing means, and the image information created by the superimposed image creating means for the plurality of terminal devices And an image management apparatus provided with a second transmission means for transmitting.

  According to a second aspect of the present invention, in the first aspect of the invention, the superimposed image creating means creates image information by using a plurality of drawing information using different visual expression methods for each piece of identification information. And

  According to a third aspect of the invention, in the first aspect of the invention, the material storage means stores a plurality of pages of material images, and the management means identifies a plurality of drawing information for each page of the material images. It is characterized by being managed in association with information.

  According to a fourth aspect of the present invention, in the first aspect of the invention, the image management device further includes a template storage unit that stores a plurality of template images combined with the material image, and the plurality of terminal devices include: The apparatus further comprises a template designating unit for designating at least one of a plurality of template images stored in the template storage unit, wherein the superimposed image creating unit includes a material image stored in the material storage unit and the management unit. A plurality of pieces of drawing information managed in association with each other and image information obtained by developing and superimposing a template image designated by the template designating means are created.

  The invention according to claim 5 is a receiving step for receiving image information, a step for expanding and displaying the image information received in the receiving step, and a writing input step for performing writing input for the image displayed in the displaying step. The handwriting display step for superimposing and displaying the handwriting image corresponding to the writing input in the writing input step on the display image, and the drawing information corresponding to the writing input in the writing input step are transmitted together with the unique identification information. The transmission step is executed by a computer.

  The invention described in claim 6 is a material storage step for storing material images, a reception step for receiving drawing information sent together with identification information unique to each terminal from a plurality of terminal devices, and reception by this second means. A management step for associating and managing the plurality of drawing information together with each identification information, image information obtained by developing and superimposing the material image stored in the material storage step and the plurality of drawing information managed in association with the management step. It is characterized by causing a computer to execute a superimposed image creation step to be created and a transmission step for transmitting the image information created in the superimposed image creation step to the plurality of terminal devices.

  According to the first aspect of the present invention, each terminal device transmits drawing information to which identification information specific to the terminal is added, and the image management device superimposes the images while superimposing them while managing the drawing information to which the identification information is added. Is created and transmitted to all the terminal devices, so that it is possible to recognize the history of which written portion is made by which terminal device from the managed contents, if necessary.

  According to the invention described in claim 2, in addition to the effect of the invention described in claim 1, for example, if a superimposed image is created with a different color or the like for each terminal device that performed writing, which writing portion You can understand at a glance which terminal device was used.

  According to the invention described in claim 3, in addition to the effect of the invention described in claim 1, the image is managed for each page over a plurality of pages, and the range of images that can be handled for various materials. Can be greatly expanded.

  According to the invention described in claim 4, in addition to the effect of the invention described in claim 1, it is possible to increase the variation of the contents to be written and execute writing with more expressive power.

  According to the invention described in claim 5, by transmitting drawing information with identification information unique to the terminal transmitted from each terminal device, which writing portion is made by which terminal device on the side of the management device receiving it. If necessary, the history can be easily recognized.

  According to the sixth aspect of the present invention, the drawing information that is received from each terminal device and that is added with identification information unique to the terminal is managed and the superimposed image is created and transmitted to all the terminal devices. From the contents to be managed, it is possible to easily recognize the history of which writing portion is made by which terminal device, if necessary.

(First embodiment)
Hereinafter, a first example in which the present invention is applied to an image sharing system using a notebook type personal computer as an image management apparatus and a plurality of pen input type PDAs (Personal Digital Assistants) as terminal apparatuses. Embodiments will be described with reference to the drawings.

  FIG. 1 shows the external configuration of the entire system. In the figure, reference numeral 1 denotes a personal computer (PC) serving as an image management apparatus. A plurality of PDAs 2, 2 serving as terminal apparatuses are connected to the personal computer 1 by a wireless LAN technology conforming to, for example, the IEEE 802.11g standard. Are connected wirelessly to construct an image sharing system.

  Here, it is assumed that the personal computer 1 is connected to, for example, a projector 3 as necessary, and can appropriately project image information to be described later onto a screen (not shown).

  Each PDA 2 is composed of a PDA body 2a and a stylus pen 2b. The PDA body 2a is provided with a tablet input unit integrally provided on the display unit screen together with some operation keys including a power key. By performing writing input or pointing operation with the Stalice pen 2b on the tablet input unit, drawing and instruction of a predetermined function are performed.

  FIG. 2 shows a functional configuration of the personal computer 1 as an image management apparatus. In the figure, reference numeral 11 denotes a control unit comprising a CPU and a memory storing its operation program, and its work area. The control unit 11 performs overall control of the operation of the personal computer 1 as a whole. An input from a key input unit 12 including a pointing device such as a mouse is directly input, and a timer 13, a data management unit 14, a layer management unit 15, a wireless communication unit 16, a display control unit 17, an image conversion unit 18, and The recording unit 19 is connected by a bus.

  The timer 13 is an RTC (Real Time Clock) that keeps counting the current time regardless of the power on / off state of the personal computer 1, and the control unit 11 has a plurality of times according to the current time measured by the timer 13. The transmission / reception timing with PDA 2, 2,... Is determined.

  The material management unit 14 stores and manages material image data prepared in advance, and reads the material image data based on the control from the control unit 11.

  The layer management unit 15 stores and manages a plurality of PDAs 2, 2,..., Individual ID information and the presence / absence of display of drawing data, display color, and pointer information.

  The wireless communication unit 16 transmits and receives image data according to the above-described wireless LAN technology with the PDAs 2, 2,.

  The display control unit 17 causes the display unit 21 of the personal computer 1 to display and drive display data. The display unit 21 is composed of a color liquid crystal display panel with a backlight, for example, and displays a superimposed image and the like to be described later.

  The image conversion unit 18 expands image data in accordance with various standards and formats the expanded data into image data of a predetermined standard as necessary.

  The recording unit 19 records image data obtained by superimposing drawing data sent from the PDAs 2, 2... On the material image stored in the material management unit 14 based on an instruction from the control unit 11.

Next, the functional configuration of the PDA 2 as a terminal device will be described with reference to FIG.
As shown in the figure, the PDA 2 has a key input unit 32 directly connected to the control unit 31, an image storage unit 33, a wireless communication unit 34, a display control unit 35, a tablet control unit 36, and ink data. The storage unit 37 is bus-connected.

  The control unit 31 includes a CPU, a memory that stores an operation program thereof, a work area thereof, and the like, and comprehensively controls the operation of the entire PDA 2.

  The image storage unit 33 stores the image data sent from the personal computer 1. The wireless communication unit 34 transmits and receives image data according to the wireless LAN technology described above with the personal computer 1 via the antenna 38.

  The display control unit 17 sends image data to the display unit 39 of the PDA 2 to drive display. The display unit 39 is configured by a color liquid crystal display panel with a backlight, for example, and the tablet input unit 40 formed of a transparent electrode plate is integrally configured with the display unit 39.

  The tablet control unit 36 controls scanning of the tablet input unit 40, and extracts two-dimensional coordinate data according to the contact operation or writing operation of the Stalis pen 2b as needed. The extracted time-series coordinate value data Is stored in the ink data storage unit 37 as ink data.

  Ink data stored in the ink data storage unit 37 is appropriately transmitted to the personal computer 1 in response to a transmission request from the personal computer 1, and the transmitted data portion is automatically deleted from the ink data storage unit 37. The personal computer 1 creates image data by superimposing the ink data and material data sent from each PDA 2 and distributes them to all the PDAs 2, 2,.

Next, the operation of the above embodiment will be described.
FIG. 4 mainly shows the processing contents by the control unit 31 regarding the handling of the image data on the PDA 2 side which is a terminal device. (Step A01), whether or not there is a request to send ink data from the personal computer 1 (Step A04), and whether or not image data has been received from the personal computer 1 (Step A06). Wait for any state.

  If a writing operation is performed on the tablet input unit 40 by the Stalice pen 2b, this is determined in step A01, and ink data is obtained by using time-series two-dimensional coordinate value data corresponding to the operation position as ink data. The storage unit 37 is updated and stored (step A02), and handwriting display data corresponding to the writing operation position is generated in real time and displayed on the display unit 39 from the display control unit 35, as if directly displayed on the Stalice pen 2b. Ink data associated with the writing operation with the Stalice pen 2b is performed by repeatedly executing the process of proceeding to step A04 after executing display control as if drawing is performed on the unit 39 (step A03). Are stored in the ink data storage unit 37 and handwriting corresponding to the operation is displayed.

  FIG. 6 exemplifies the contents written by the Stalice pen 2b and the tablet input unit 40 at this time. For example, the horizontal direction is the x coordinate and the vertical direction is the y coordinate with the upper left corner of the tablet input unit 40 as a base point. And a series of writing operations, that is, the range of the trajectory moved from when the Stalice pen 2b is brought into contact with the tablet input unit 40 until it is separated, the x coordinate value from “x0” to “x1”, the y coordinate value Is from “y0” to “y1”, the coordinate position of an arbitrary point in the trajectory that has been written can be expressed as “xm, yn” (x0 ≦ xm ≦ x1, y0 ≦ yn ≦ y1). .

  Therefore, the ink data can be formed by a series of data in which such point coordinates are arranged, and the ink data is sequentially stored in the ink data storage unit 37 corresponding to the writing operation.

  Further, when the ink data transmission request is received from the personal computer 1, this is determined in step A04, and the transmission data of a predetermined format is determined using the ink data stored in the ink data storage unit 37 at that time. Is transmitted to the personal computer 1 via the wireless communication unit 34 and the antenna 38 (step A05), and the process then proceeds to step A06.

  FIG. 7 illustrates a format configuration of the ink data created at this time. As shown in the figure, the ink data stored in the ink data storage unit 37 is read as it is, and the terminal ID information unique to the PDA 2 and the display / input resolution of the display unit 39 and the tablet input unit 40 are shown. Assume that the terminal resolution, the absolute address indicating each maximum value of the x-coordinate and y-coordinate of the display unit 39 and the tablet input unit 40, and ink data indicating the line thickness, line type, and the like are created as a set of data.

  Thus, when the ink data is read from the ink data storage unit 37 and formatted, the ink data storage unit 37 automatically erases the read ink data as described above, and the contents are duplicated by receiving and displaying the image data described later. Avoid doing as much as possible.

  If it is determined in step A06 that the image data sent from the personal computer 1 has been received, the control unit 31 stores the received data in the image storage unit 33 and the image data and ink data storage unit 37. Each of the stored ink data is developed and superimposed to create display data, which is displayed on the display unit 39 by the display control unit 35 (step A07), and then returns to the processing from step A01 again.

  As described above, the PDA 2 side sequentially executes the creation of ink data associated with the writing operation, the transmission of ink data in response to a request from the personal computer 1, and the reception and display of image data from the personal computer 1.

Next, the operation of the personal computer 1 as an image management apparatus that controls the plurality of PDAs 2, 2,... Operating as described above will be described with reference to FIG.
That is, FIG. 5 shows the contents of the overall control processing executed by the personal computer 1 as an image management apparatus in this image sharing system. Initially, the material image data stored in the material management unit 14 is read out. After being recorded in the recording unit 19 (step B01), it waits for the access timing to each PDA 2, 2,... Every 5 [seconds], for example, according to the timed content of the timer 13 (step B02).

  When it is determined that the access timing is reached, an initial value “1” is set to a terminal ID variable i for selecting one of the plurality of PDAs 2, 2,... (Step B03). A transmission request for ink data is transmitted to the PDA 2 having “1”, and the ink data transmitted in response to this request is received and acquired (step B04), and recorded in the recording unit 19 (step S04). B05).

  Next, the terminal ID variable i is updated to “+1” and set to “2” (step B06), and it is confirmed that the updated value does not exceed the total number “n” of all PDAs 2, 2,. (Step B07), the process returns to Step B04 again, and ink data is acquired from the PDA 2 corresponding to the next terminal ID information.

  By repeatedly executing the processes of steps B04 to B07 in this way, the process of acquiring and recording ink data from the PDA 2 that is the corresponding terminal device while updating and setting the terminal ID information is sequentially performed.

  When the terminal ID variable i is updated and set to a value “n + 1” exceeding the total number “n” of PDAs 2, 2,... In step B06 with ink data acquired from all the PDAs 2, 2,. In step B07, it is determined that the acquisition and recording of the ink data from all the PDAs 2, 2,... Have been completed, and the document image data and all the PDAs 2, 2,. The image data is created by developing and superimposing the ink data from (step B08).

  8 illustrates the recording state of the material image recorded in the recording unit 19 at this time and the ink data by handwriting from each PDA 2, 2,..., And the original material data and all the PDAs 2, 2,. It can be seen that the ink data acquired from... Is not mixed and managed in a separated layer (multilayer) structure.

  Further, as shown in FIG. 9, for the terminal ID information of PDAs 2, 2,..., The layer management unit 15 displays the presence / absence of display, color information corresponding to handwritten ink data, and display pointer information. Shall be prepared in advance.

  Accordingly, when creating the image data in which the original document data and the ink data are expanded and superimposed in step B08, the color of the ink data is set for each PDA 2 with reference to the contents of the layer management unit 15 If the image data is to be created in accordance with the contents, the ink data contents are color-coded for each PDA 2 and a pointer having a different shape is added to the final drawing position. Therefore, with this image data, it is possible to see at a glance what kind of drawing has been performed by the writing operation at which terminal and where the final drawing position is.

  The personal computer 1 transmits the image data thus created to all the PDAs 2, 2,... (Step B09), and also displays them on the display unit 21 of the own device (Step B10), and then returns to Step B02 again. And wait for the access timing to the next PDA 2, 2,.

  In the following, each PDA 2, 2,... On the terminal device side transmits ink data to which the terminal-specific ID information is added, and the personal computer 1, which is an image management device that receives this, sends the ink data to which the ID information is added. While recording and managing in the recording unit 19 as having a layer structure, the process of creating image data on which these are superimposed and collectively transmitting them to all PDAs 2, 2,.

  As described above, in the personal computer 1, it is possible to appropriately extract and recognize the history of what is written by which PDA 2 from the contents recorded in the recording unit 19 as necessary.

  In addition, since the image data is created by superimposing the drawing contents by color-coding for each PDA 2 that has written, it is possible to understand at a glance which writing part is performed by which PDA 2.

(Second Embodiment)
A second embodiment when the present invention is applied to an image sharing system using a notebook type personal computer as an image management apparatus and a plurality of pen input type PDAs as terminal apparatuses will be described below with reference to the drawings. .

The external configuration of the entire system is substantially the same as that shown in FIG. 1, and the same reference numerals are used for the same parts, and illustration and description thereof are omitted.
Next, FIG. 10 shows a functional configuration of the personal computer 1 which is an image management apparatus. Also in FIG. 10, since the basic functional configuration of the personal computer 1 is basically the same as that shown in FIG. 2, the same parts are denoted by the same reference numerals and the description thereof is omitted.

  Thus, the material management unit 14 stores and manages the document image data for a plurality of pages prepared in advance, and is provided at one end of the material image data of all the pages other than the last page, for example, the upper right end. In this example, a page break mark for instructing a page update to the next page is added.

  Further, it is assumed that a page management unit 41 that manages which page is being processed at that time and how many pages are the last page is connected to the control unit 11.

  Note that the functional configuration of the PDA 2 that is a terminal device is substantially the same as that shown in FIG. 3, and therefore, the same parts are denoted by the same reference numerals and the description thereof is omitted.

  Next, the operation of the above embodiment will be described.

  FIG. 11 mainly shows the processing contents by the control unit 31 regarding the handling of image data on the PDA 2 side which is a terminal device, and at the beginning, whether or not there is a writing operation to the tablet input unit 40 by the Stalice pen 2b. (Step C01), whether or not there is an operation for instructing a page break mark in the displayed image data (Step C04), whether or not there is a request for sending ink data from the personal computer 1 (Step C06), By repeatedly determining whether or not image data has been received from the personal computer 1 (step C08), it waits for any of these states.

  If a writing operation is performed on the tablet input unit 40 by the Stalice pen 2b, this is determined in step C01, and the time-series two-dimensional coordinate value data corresponding to the operation position is used as the ink data. The storage unit 37 is updated and stored (step C02), and handwriting display data corresponding to the writing operation position is generated in real time and displayed on the display unit 39 from the display control unit 35, as if directly displayed on the Stalice pen 2b. Ink data associated with the writing operation with the Stalice pen 2b is performed by repeatedly executing the process of proceeding to step C04 after executing display control such as drawing on the unit 39 (step C03). Are stored in the ink data storage unit 37 and handwriting corresponding to the operation is displayed.

  At this time, for example, the upper left corner of the tablet input unit 40 is used as a base point, the horizontal direction is the x coordinate, and the vertical direction is the y coordinate. If the x coordinate value is from “x0” to “x1” and the y coordinate value is from “y0” to “y1”, the coordinates of any one point in the locus that has been written The position can be represented by “xm, yn” (x0 ≦ xm ≦ x1, y0 ≦ yn ≦ y1).

  Therefore, the ink data can be formed by a series of data in which such point coordinates are arranged, and the ink data is sequentially stored in the ink data storage unit 37 corresponding to the writing operation.

  If there is an operation for instructing a page break mark in the displayed image data in particular, this is determined in step C04, and the page break request data is added to the ink data in the ink data storage unit 37. Store (step C05), and then go to step C06.

  Further, when an ink data transmission request is received from the personal computer 1, this is determined in step C06, and transmission data of a predetermined format is determined using the ink data stored in the ink data storage unit 37 at that time. Is transmitted to the personal computer 1 via the wireless communication unit 34 and the antenna 38 (step C07), and then the process proceeds to step C08.

  The format of the ink data created at this time is almost the same as that shown in FIG. 7, and the ink data stored in the ink data storage unit 37 is read as it is, and the terminal unique to the PDA 2 The ID information, the terminal resolution indicating the display / input resolution of the display unit 39 and the tablet input unit 40, the absolute address indicating each maximum value of the x coordinate and the y coordinate of the display unit 39 and the tablet input unit 40, and the thickness of the line Ink data indicating the sheath type and the like is created as a set of data, and if it is determined in step C04 that there is an operation for instructing a page break mark, the page break request data is additionally set. The

  When the ink data is read from the ink data storage unit 37 and formatted, the ink data storage unit 37 automatically deletes the read ink data, and the contents are duplicated due to reception and display of image data to be described later. Avoid as much as possible.

  If it is determined in step C08 that the image data sent from the personal computer 1 has been received, the control unit 31 stores the received data in the image storage unit 33 and the image data and ink data storage unit 37. Each of the stored ink data is developed and superimposed to create display data, which is displayed on the display unit 39 by the display control unit 35 (step C09), and then returns to the processing from step C01 again.

  As described above, the PDA 2 side creates ink data associated with the writing operation, stores the page break information associated with the page break mark operation, transmits the ink data and the page break request in response to the request from the personal computer 1, and Reception and display of image data from the personal computer 1 are sequentially executed.

Next, the operation of the personal computer 1 as an image management apparatus that controls the plurality of PDAs 2, 2,... Operating as described above will be described with reference to FIG.
That is, FIG. 12 shows the contents of the overall control processing executed by the personal computer 1 as an image management apparatus in this image sharing system. Initially, the material image of the first page stored in the material management unit 14 is shown. The data is read out, expanded, recorded in the recording unit 19 (step D01), and the access timing to each PDA 2, 2,... (Step D02).

  When it is determined that the access timing is reached, an initial value “1” is set to a terminal ID variable i for selecting one of the plurality of PDAs 2, 2,... (Step D03). A transmission request for ink data is transmitted to the PDA 2 having "1", and the ink data (and added page break request) transmitted in response to this request is received and acquired (step D04). ) And recorded in the recording unit 19 (step D05).

  Next, the terminal ID variable i is updated to “+1” and set to “2” (step D06), and it is confirmed that the updated value does not exceed the total number “n” of all PDAs 2, 2,. (Step D07), the process returns to Step D04 again, and ink data is acquired from the PDA 2 corresponding to the next terminal ID information.

  By repeatedly executing the processes in steps D04 to B07 in this way, the process of acquiring and recording ink data from the PDA 2 that is the corresponding terminal device while updating and setting the terminal ID information is sequentially performed.

  When the terminal ID variable i is updated and set to a value “n + 1” exceeding the total number “n” of PDAs 2, 2,... In step D06 in a state where ink data has been acquired from all the PDAs 2, 2,. In step D07, it is determined that the acquisition and recording of the ink data from all the PDAs 2, 2,... Have been completed, and then a page break request is added to at least one of the acquired ink data. It is determined whether it has been set (step D08).

  If it is determined that a page break request is not additionally set for one ink data, the document image data of the current page already recorded in the recording unit 19 at that time and all the PDAs 2, 2, Image data is created by developing and superimposing corresponding ink data from... (Step D13).

  At this time, as shown in FIG. 9, layer management is performed for the terminal ID information of PDAs 2, 2,..., The presence / absence of display, color information corresponding to handwritten ink data, and display pointer information. Assuming that the data is prepared in advance in the unit 15, when creating the image data in which the original material data and the ink data are expanded and superimposed in step D13, each content is referred to by referring to the contents of the layer management unit 15. By creating the color of the ink data for each PDA 2 according to the set contents, the image data to be finally created is color-coded for the contents of the ink data for each PDA 2 and has a different shape at the final drawing position. A pointer will be added. Therefore, with this image data, it is possible to see at a glance what kind of drawing has been performed by the writing operation at which terminal and where the final drawing position is.

  The personal computer 1 transmits the image data thus created to all the PDAs 2, 2,... (Step D14), and displays them on the display unit 21 of the own device (step D15), and then returns to step D02 again. And wait for the access timing to the next PDA 2, 2,.

  If it is determined in step D08 that a page break request has been added to at least one ink data, it is determined whether or not the page of the document image data displayed at that time is the last page. If it is not the last page, the document image data of the next page is read out from the document management unit 14 and expanded and recorded in the recording unit 19 (step D10). , Etc., are collectively transmitted (step D11), and are also displayed on the display unit 21 of the own device (step D12). Then, the process returns to step D02 again, and the timing of access to the next PDA 2, 2,. Wait to become.

  If it is determined in step D09 that the page of the document image data displayed at that time is the last page, it is determined that further page updating cannot be performed, and the process proceeds to step D13. The process proceeds to creation of a superimposed image of the material image on the last page and the ink data from all the PDAs 2, 2,.

  In the following, each PDA 2, 2,... On the terminal device side transmits ink data to which the terminal-specific ID information is added, and the personal computer 1, which is an image management device that receives this, sends the ink data to which the ID information is added. While recording and managing in the recording unit 19 as having a layer structure, the image data on which these are superimposed is created and sent to all the PDAs 2, 2,..., And the page of the document image is updated as required. The process of performing is repeatedly executed.

  FIG. 13 exemplifies a recording state of the material image recorded in the recording unit 19 at this time and ink data by handwriting from each PDA 2, 2,... It can be seen that the original data including the page break mark NP and the ink data having a separated layer (multilayer) structure are managed without mixing the ink data acquired from all the PDAs 2, 2,... .

  As described above, in addition to the effects of the first embodiment, images are managed for each page over a plurality of pages, and the range of images that can be handled such as various materials can be greatly expanded. .

(Third embodiment)
A third embodiment in the case where the present invention is applied to an image sharing system in which a notebook type personal computer is used as an image management apparatus and a plurality of pen input type PDAs are used as terminal apparatuses will be described below with reference to the drawings. .

The external configuration of the entire system is substantially the same as that shown in FIG. 1, and the same reference numerals are used for the same parts, and illustration and description thereof are omitted.
Next, FIG. 14 shows a functional configuration of the personal computer 1 which is an image management apparatus. Also in FIG. 14, the basic functional configuration of the personal computer 1 is basically the same as that shown in FIG. 10. Therefore, the same parts are denoted by the same reference numerals and the description thereof is omitted.

  Accordingly, it is assumed that a template storage unit 42 storing a plurality of template image data is further connected to the control unit 11.

  Note that the functional configuration of the PDA 2 that is a terminal device is substantially the same as that shown in FIG. 3, and therefore, the same parts are denoted by the same reference numerals and the description thereof is omitted.

  Next, the operation of the above embodiment will be described.

  FIG. 15 mainly shows the processing contents by the control unit 31 regarding the handling of the image data on the PDA 2 side which is a terminal device, and at the beginning, whether or not there is a writing operation to the tablet input unit 40 by the Stalice pen 2b. (Step E01), whether or not there is an operation for instructing a page break mark in the displayed image data (Step E04), or some of the template marks in the displayed image data Repeatedly (step E06), whether there is a request to send ink data from the personal computer 1 (step E08), and whether image data has been received from the personal computer 1 (step E10). By judging, it waits to be in any of these states.

  If there is a writing operation on the tablet input unit 40 by the Stalice pen 2b, this is determined in step E01, and ink data is obtained using the two-dimensional coordinate value data on the time series corresponding to the operation position as ink data. The storage unit 37 is updated and stored (step E02), and handwriting display data corresponding to the writing operation position is generated in real time and displayed on the display unit 39 from the display control unit 35, as if directly displayed on the Stalice pen 2b. Ink data associated with the writing operation with the Stalice pen 2b is performed by repeatedly executing the process of proceeding to step E04 after executing display control such as drawing on the unit 39 (step E03). Are stored in the ink data storage unit 37 and handwriting corresponding to the operation is displayed.

  At this time, for example, the upper left corner of the tablet input unit 40 is used as a base point, the horizontal direction is the x coordinate, and the vertical direction is the y coordinate. If the x coordinate value is from “x0” to “x1” and the y coordinate value is from “y0” to “y1”, the coordinates of any one point in the locus that has been written The position can be represented by “xm, yn” (x0 ≦ xm ≦ x1, y0 ≦ yn ≦ y1).

  Therefore, the ink data can be formed by a series of data in which such point coordinates are arranged, and the ink data is sequentially stored in the ink data storage unit 37 corresponding to the writing operation.

  If there is an operation for instructing a page break mark in the displayed image data in particular, it is determined in step E04, and the page break request data is added to the ink data in the ink data storage unit 37. Store (step E05), and then go to step E06.

  Further, when there is an operation for instructing any one of the template image marks to be prepared in the displayed image data, this is determined in step E06, and the ink data storage unit 37 stores the ink. Data for requesting insertion of the template image with the number is stored in a form to be added to the data (step E07), and then the process proceeds to step E08.

  Further, when an ink data transmission request is received from the personal computer 1, this is determined in step E <b> 08, and transmission data in a predetermined format using the ink data stored in the ink data storage unit 37 at that time. Is transmitted to the personal computer 1 via the wireless communication unit 34 and the antenna 38 (step E09), and then the process goes to step E10.

  The format of the ink data created at this time is almost the same as that shown in FIG. 7, and the ink data stored in the ink data storage unit 37 is read as it is, and the terminal unique to the PDA 2 The ID information, the terminal resolution indicating the display / input resolution of the display unit 39 and the tablet input unit 40, the absolute address indicating each maximum value of the x coordinate and the y coordinate of the display unit 39 and the tablet input unit 40, and the thickness of the line Ink data indicating the sheath line type and the like is created as a set of data, and if it is determined in step E04 that there is an operation for instructing a page break mark, the page break request data is If there is an operation to instruct insertion of template image data at E06, the template request data of that number is The pressure is set.

  When the ink data is read from the ink data storage unit 37 and formatted, the ink data storage unit 37 automatically erases the read ink data, and the contents are duplicated due to reception and display of image data, which will be described later. Avoid as much as possible.

  Further, when it is determined in step E10 that the image data sent from the personal computer 1 has been received, the control unit 31 stores the received data in the image storage unit 33 and also stores the received data in the image data and ink data storage unit 37. Each of the stored ink data is developed and superimposed to create display data, which is displayed on the display unit 39 by the display control unit 35 (step E11), and then returns to the processing from step E01 again.

  As described above, the PDA 2 side creates ink data associated with the writing operation, stores the page break information associated with the page break mark operation, and stores the template number information associated with any one of several template image marks. Storage, transmission of ink data in response to a request from the personal computer 1 and a request for page break or template insertion, and reception and display of image data from the personal computer 1 are sequentially executed.

Next, the operation of the personal computer 1 as an image management apparatus that controls the plurality of PDAs 2, 2,... Operating as described above will be described with reference to FIG.
That is, FIG. 16 shows the contents of the overall control processing executed by the personal computer 1 as an image management apparatus in this image sharing system. Initially, the material image of the first page stored in the material management unit 14 is shown. The data is read out, expanded, recorded in the recording unit 19 (step F01), and the access timing to each PDA 2, 2,... (Step F02).

  When it is determined that the access timing is reached, an initial value “1” is set to a terminal ID variable i for selecting one of the plurality of PDAs 2, 2,... (Step F03). A transmission request for ink data is transmitted to the PDA 2 whose is “1”, and the ink data (and the added page break request and template number insertion request) sent in response to this request is received. Obtain (step F04) and record in the recording unit 19 (step F05).

  Next, the terminal ID variable i is updated to “+1” and set to “2” (step F06), and it is confirmed that the updated value does not exceed the total number “n” of all PDAs 2, 2,. (Step F07), the process returns to Step F04 again, and ink data is acquired from the PDA 2 corresponding to the next terminal ID information.

  By repeatedly executing the processes of steps F04 to B07 in this way, the process of acquiring and recording the ink data and the request data added thereto from the corresponding terminal device PDA2 while updating the terminal ID information is set. Are sequentially performed.

  When the terminal ID variable i is updated and set to a value “n + 1” exceeding the total number “n” of PDAs 2, 2,... In step F06 in a state where ink data has been acquired from all the PDAs 2, 2,. In step F07, it is determined that the acquisition and recording of the ink data from all the PDAs 2, 2,... Have been completed, and then a page break request is added to at least one of the acquired ink data. It is determined whether it has been set (step F08).

  If it is determined that a page break request is not additionally set for one ink data, the template image number and insertion request data are additionally set for at least one of the acquired ink data. It is determined whether or not it has been performed (step F13).

  Only when it is determined that the template image number and insertion request data are additionally set, the template image data of the requested number is read from the template storage unit 42 and expanded and recorded in the recording unit 19 (step F14). ).

  Thereafter, the material image data of the current page recorded in the recording unit 19 and the corresponding ink data from all the PDAs 2, 2,... In addition to the template image if the template image is inserted. Further, the image data is created by developing and superimposing (step F15).

  At this time, as shown in FIG. 9, layer management is performed for the terminal ID information of PDAs 2, 2,..., The presence / absence of display, color information corresponding to handwritten ink data, and display pointer information. Assuming that the data is prepared in advance in the unit 15, when creating the image data in which the original material data and the ink data are expanded and superimposed in step F 15, each content is referred to by referring to the contents of the layer management unit 15. By creating the color of the ink data for each PDA 2 according to the set contents, the image data to be finally created is color-coded for the contents of the ink data for each PDA 2 and has a different shape at the final drawing position. A pointer will be added. Therefore, with this image data, it is possible to see at a glance what kind of drawing has been performed by the writing operation at which terminal and where the final drawing position is.

  The personal computer 1 transmits the image data thus created to all the PDAs 2, 2,... (Step F16), and also displays them on the display unit 21 of the own device (step F17), and then returns to step F02 again. And wait for the access timing to the next PDA 2, 2,.

  If it is determined in step F08 that a page break request has been added to at least one ink data, it is determined whether or not the page of the document image data displayed at that time is the last page. If it is not the last page, the material image data of the next page is read out and expanded from the material management unit 14 and recorded in the recording unit 19 (step F10). ... Are sent together (step F11), and are also displayed on the display unit 21 of the own device (step F12). Then, the process returns to step F02 again, and the access timing to the next PDA 2, 2,. Wait to become.

  If it is determined in step F09 that the page of the document image data displayed at that time is the last page, it is determined that further page updating cannot be performed, and the process proceeds to step F13. The process proceeds to creation of a superimposed image of the material image on the last page and the ink data from all the PDAs 2, 2,.

  In the following, the PDA 2, 2,... On each terminal device side transmits ink data with ID information unique to the terminal and, if necessary, a page break request and a template image number and insertion request, and receives this image management. The personal computer 1 serving as an apparatus records and manages ink data with ID information added and the like in the recording unit 19 as having a layer structure, and creates image data on which these are superimposed to create all PDAs 2, 2,... And the process of updating the page of the document image and inserting the template image as required is repeated.

  FIG. 17 illustrates the recording state of the material image recorded in the recording unit 19 at this time and the ink data by handwriting from each of the PDAs 2, 2,... It can be seen that the original document data including the page break mark NP and the ink data having a separated layer (multilayer) structure are managed without mixing the ink data acquired from all the PDAs 2, 2,. .

  Further, in particular, it is exemplified that the template image of number 2 is inserted corresponding to the ink data of the first page of the document (P1), and this template image is requested by any one of PDA2, 2,... Accordingly, it is selectively read from the template storage unit 42 and inserted.

  As described above, in addition to the effects of the first and second embodiments, a plurality of contents are prepared in advance as template images, and the contents are appropriately converted into original document images in response to requests from the terminal device side, In addition, it is possible to create a new image by superimposing it as an image together with ink data by handwriting operation from PDAs 2, 2,..., Increasing the variation of the contents to be written and executing writing with higher expressive power. be able to.

  The first to third embodiments are applied to a case where an image sharing system is constructed using the personal computer 1 as an image management device and the PDAs 2, 2,... As terminal devices. The present invention is not limited to this. For example, a web server provides a document image based on an internet chat format, and data written from an individual personal computer using an input device such as a digitizer is transmitted. You can think of an image sharing system, or you can have several mobile phones with functions that allow you to perform simple drawing with your finger on the display screen, and use specific map images as material images It can be easily applied to a system that provides navigation-instructed content such as a tracking game.

  In addition, the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the scope of the invention.

  Further, the above embodiments include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some constituent elements are deleted from all the constituent elements shown in the embodiment, at least one of the problems described in the column of the problem to be solved by the invention can be solved, and described in the column of the effect of the invention. In a case where at least one of the obtained effects can be obtained, a configuration in which this configuration requirement is deleted can be extracted as an invention.

The figure which shows the external appearance structure of the whole system which concerns on the 1st Embodiment of this invention. The block diagram which shows the function structure as an image management apparatus of the personal computer which concerns on the embodiment. The block diagram which shows the function structure as a terminal device of PDA which concerns on the embodiment. 6 is a flowchart showing processing contents of handling of image data of the PDA according to the embodiment. 6 is a flowchart showing processing contents of image data handling of the personal computer according to the embodiment. The figure which shows the drawing display content accompanying the writing operation | movement based on the embodiment, and the production | generation range of ink data. The figure which illustrates the format structure of the ink data which concerns on the embodiment. FIG. 3 is a diagram illustrating layer-structured image data managed by the recording unit of the personal computer according to the embodiment. The figure which illustrates ID information other configurations of each PDA managed by the layer management part of the personal computer concerning the embodiment. The block diagram which shows the function structure as an image management apparatus of the personal computer which concerns on the 2nd Embodiment of this invention. 6 is a flowchart showing processing contents of handling of image data of the PDA according to the embodiment. 6 is a flowchart showing processing contents of image data handling of the personal computer according to the embodiment. FIG. 3 is a diagram illustrating layer-structured image data managed by the recording unit of the personal computer according to the embodiment. The block diagram which shows the function structure as an image management apparatus of the personal computer which concerns on the 3rd Embodiment of this invention. 6 is a flowchart showing processing contents of handling of image data of the PDA according to the embodiment. 6 is a flowchart showing processing contents of image data handling of the personal computer according to the embodiment. FIG. 3 is a diagram illustrating layer-structured image data managed by the recording unit of the personal computer according to the embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Personal computer (PC), 2 ... PDA, 2a ... PDA main body, 2b ... Stalice pen, 3 ... Projector, 11 ... Control part, 12 ... Key input part, 13 ... Timer, 14 ... Material management part, 15 ... Layer management unit, 16 ... wireless communication unit, 17 ... display control unit, 18 ... image conversion unit, 19 ... recording unit, 20 ... antenna, 21 ... display unit, 31 ... control unit, 32 ... key input unit, 33 ... image Storage unit 34 ... Wireless communication unit 35 ... Display control unit 36 ... Tablet control unit 37 ... Ink data storage unit 38 ... Antenna 39 ... Display unit 40 ... Tablet input unit 41 ... Page management unit 42 ... Template storage unit, NP ... Page break mark, TMP1 to TMP3 ... Template mark.

Claims (6)

First receiving means for receiving image information, display means for expanding and displaying the image information received by the first receiving means, writing input means for performing writing input on the image displayed by the display means, and the writing Handwriting display means for displaying the handwriting image corresponding to the handwriting input by the input means on the display image by the display means, and the drawing information corresponding to the handwriting input by the writing input means together with identification information unique to the terminal A plurality of terminal devices including first transmission means for transmitting;
Material storage means for storing material images, second receiving means for receiving drawing information sent together with identification information unique to each terminal from the plurality of terminal devices, and a plurality of drawing information received by the second receiving means Management means that associates and manages each of the identification information together with the identification information, and a superimposed image that creates and superimposes a material image stored in the material storage means and a plurality of drawing information managed in association with the management means. An image sharing system comprising: a creation unit; and an image management device including a second transmission unit configured to transmit the image information created by the superimposed image creation unit to the plurality of terminal devices.   The image sharing system according to claim 1, wherein the superimposed image creating means creates image information by using a visual expression method that is different for each piece of drawing information. The material storage means stores a plurality of pages of material images,
2. The image sharing system according to claim 1, wherein the management means manages a plurality of drawing information in association with each identification information for each page of the document image. The image management device further includes a template storage unit that stores a plurality of template images to be combined with the material image,
The plurality of terminal devices further comprise template designating means for designating at least one of the plurality of template images stored in the template storage means,
The superimposed image creating means develops and superimposes a material image stored in the material storage means, a plurality of drawing information managed in association with the management means, and a template image designated by the template designation means. The image sharing system according to claim 1, wherein information is created. A receiving step for receiving image information;
Expanding and displaying the image information received in this receiving step;
A writing input step for performing writing input on the image displayed in this display step;
A handwriting display step for superimposing and displaying a handwriting image corresponding to the writing input in this writing input step on the display image;
A program for causing a computer to execute a transmission step of transmitting drawing information corresponding to a writing input in the writing input step together with unique identification information. A material storage step for storing material images;
A receiving step of receiving drawing information sent together with identification information unique to each terminal from a plurality of terminal devices;
A management step for managing a plurality of pieces of drawing information received by the second means in association with each identification information;
A superimposed image creating step for creating a superimposed image information by expanding and superimposing a plurality of drawing information managed in association with the document image stored in the document storing step;
A program that causes a computer to execute a transmission step of transmitting image information created in the superimposed image creation step to the plurality of terminal devices.

Images