JP6702029B2 - Conference-related information reproduction device, conference-related information reproduction method, and conference-related information reproduction program - Google Patents

Description

  The present invention relates to a meeting-related information reproducing device, a meeting-related information reproducing method, and a meeting-related information reproducing program, and particularly to a meeting-related information reproducing device and a meeting-related information reproducing method for reproducing information related to a meeting in which a plurality of users participate. And the conference related information reproduction program.

  2. Description of the Related Art In a conference or the like, a conference system is known in which data prepared as presentation materials is displayed on electronic terminals such as portable information devices carried by all participants. For example, Japanese Unexamined Patent Application Publication No. 2014-098972 discloses an electronic conferencing system including an image display device and one or more electronic terminals, wherein the electronic terminal displays a plurality of images displayed on the image display device. Image/operation recording means for recording in a recording medium in association with operation information indicating a user's operation on the plurality of images, the image display device communicates with the electronic terminal, and the image/operation recording means causes the image/operation recording means to communicate with the electronic terminal. An electronic conferencing system is described, which includes an image generation unit that generates a display image based on a plurality of images recorded on a recording medium and operation information associated with the plurality of images.

According to the electronic conference system described above, the participants of the conference can reconfirm the contents of the conference by reproducing the operation of the user related to the conference by the display image. On the other hand, when a user who does not carry an electronic terminal participates in the conference, the user participates in the conference while referring to the paper on which the material is printed. In this case, in the electronic conference system described in Japanese Patent Laid-Open No. 2014-098972, it is impossible to collect information generated by an operation performed by a user who does not carry an electronic terminal, for example, an operation of handwriting on a sheet. There is.
JP, 2014-098972, A

  The present invention has been made to solve the above-mentioned problems, and one of the objects of the present invention is to provide a conference-related information reproducing apparatus capable of easily reproducing more information related to a conference. It is to be.

  Another object of the present invention is to provide a meeting-related information reproducing method capable of easily reproducing more information related to a meeting.

  Still another object of the present invention is to provide a conference related information reproducing program capable of easily reproducing more information related to the conference.

According to an aspect of the present invention in order to achieve the above-mentioned object, the conference-related information reproduction device includes a reference information acquisition unit that acquires reference information generated by any of the own device and one or more other devices, The reference information includes additional information added to presentation data accessible to the own device and one or more other devices, and position information indicating a position where the additional information is added in the presentation data, and the reference information acquisition unit Of the plurality of pieces of reference information acquired by the grouping means for classifying the plurality of pieces of reference information in which the position of the additional information is within the predetermined range in the presentation data into the same group, and one of the one or more groups is selected. Accordingly, the reference information display unit displays at least one of the plurality of reference information belonging to the selected group, and the reference information acquisition unit is a recording medium on which an image based on the presentation data is formed. Read data acquisition means for acquiring read data obtained by reading, additional information extraction means for extracting an image that does not exist in the presentation data as additional information from the read data acquired by the read data acquisition means, and extracted in the read data Position determining means for determining the position in the presentation data corresponding to the position of the additional information as the added position of the extracted additional information, and the additional information extracted by the additional information extracting means and the position determined by the position determining means based on, viewed contains a recording medium corresponding generating means for generating a reference information corresponding to the recording medium, each of the plurality of reference information corresponding to the presentation data including additional information added to the presentation data, the additional information The grouping means includes a plurality of pieces of reference information corresponding to the presentation data acquired by the reference information acquisition means, and the position of the additional information is within a predetermined range in the presentation data. The reference information corresponding to the recording medium acquired by the reference information acquisition means is classified such that the plurality of reference information that are within the predetermined time period and belong to the same group. The position of the additional information is classified into a group included in a predetermined range from a position of any one of the plurality of reference information included in the group, which is one or more groups of the plurality of groups .

According to this aspect, the reference information generated by one of the own device and one or more other devices is acquired, and the image that does not exist in the announcement data is obtained from the read data obtained by reading the recording medium on which the image based on the announcement data is formed. Is extracted as additional information, the position in the presentation data corresponding to the position of the extracted additional information is determined as the added position of the extracted additional information, and based on the extracted additional information and the determined position , Reference information corresponding to the recording medium is generated. Then, among the plurality of reference information, the plurality of reference information in which the position of the additional information is within the predetermined range in the presentation data is classified into the same group, and one of the one or more groups is selected. , At least one of a plurality of pieces of reference information belonging to the selected group is displayed. For this reason, an image that does not exist in the presentation data, which is extracted from the read data obtained by reading the recording medium on which the image based on the presentation data is formed, is added to the presentation data by the own device or another device as the additional information. Can be reproduced with. As a result, more information related to the conference can be easily reproduced.
Further, each of the plurality of reference information corresponding to the presentation data is classified into one or more groups based on the position of the additional information and the input period. Further, each of the plurality of reference information corresponding to the recording medium has a position of the additional information of the reference information is one or more groups of the plurality of groups and is one of the plurality of reference information included in the group. The position is classified into a group included in a predetermined range. This makes it possible to properly classify the plurality of reference information corresponding to the presentation data and the plurality of reference information corresponding to the recording medium into a plurality of groups.

  Preferably, the reference information acquisition unit further includes a size determination unit that determines the size of the additional information extracted by the additional information extraction unit based on at least one of the read data and the presentation data.

  According to this aspect, since the extracted additional information is displayed in a size corresponding to the size of the additional information added to at least one of the read data and the presentation data, the variation in the size of the displayed additional information is reduced. can do.

  Preferably, the reference information acquisition unit determines the size of the additional information extracted by the additional information extraction unit based on the size of the additional information added to the presentation data by either the own device or one or more other devices. A size determining means is further provided.

  According to this aspect, since the extracted additional information is displayed in a size according to the size of the additional information added to the presentation data by either the own device or one or more other devices, the size of the additional information varies. Can be reduced.

  Preferably, when the additional information extracted by the additional information extracting unit is not present in any of the images of the plurality of pages included in the presentation data, the position determining unit preferably extracts the additional information extracted from the plurality of pages included in the presentation data. The page corresponding to the image having the closest information and the position of the extracted additional information relative to the corresponding page are determined as the position of the additional information.

  According to this aspect, the position of the additional information extracted from the read data obtained by reading the recording medium on which the image based on the announcement data is formed is located in the announcement data and the extracted addition to the page corresponding to the image to which the additional information is closest. Since the relative position of the information is determined, the additional information extracted from the read data can be classified into any one or more groups. Therefore, the additional information extracted from the read data can be reproduced together with the additional information added to the presentation data by the own device or another device.

  Preferably, the reference information acquisition unit determines whether or not the additional information extracted by the additional information extraction unit includes a condition image extending from inside to outside of an image of a plurality of pages included in the presentation data. The position determining means further includes an image determining means, and when a condition image is present in the additional information, the position determining means, in a page of images overlapping the condition image among a plurality of pages included in the presentation data, an end portion of the condition image of the page. The position of is added to the position to which the additional information is added.

  According to this aspect, when the condition image is present in the additional information, the position of the end of the condition image in the page of the image overlapping the condition image is determined as the position where the additional information is added. Can be determined at an appropriate position within the page of the presentation data.

  Preferably, the conference-related information reproducing apparatus can select one or more groups, a conference information acquisition unit that acquires information about the state of the conference as conference information, a conference information output unit that outputs at least a part of the conference information. And a group selection means for selecting any one of the one or more groups displayed by the group list display means. The conference information output means includes one or more groups selected by the group selection means. Presentation data part display means for displaying a presentation part in the presentation data corresponding to the selected group in response to selection of any one of the groups, and the reference information display means is the presentation data part display means. Additional information display means for superimposing and displaying one or more additional information included in each of the one or more reference information belonging to the selected group on the presentation portion displayed by, and the additional information extracted by the additional information extracting means. If at least a part of them does not exist in any of the images of a plurality of pages included in the presentation data, an index display unit that superimposes and displays the index indicating the existence of the additional information on the presentation part instead of the additional information. And an outside additional information display means for receiving an operation of the index by the user and displaying additional information corresponding to the index when the index is operated.

  According to this aspect, in response to the selection of any one of the one or more groups, one or more reference information belonging to the selected group is added to the presentation part in the presentation data corresponding to the selected group. One or more additional information included in each is displayed in a superimposed manner. Thereby, the user can easily recognize the existence of the additional information added to the announcement part while referring to the announcement part in the announcement data. Also, instead of the additional information that does not exist in any of the images of multiple pages included in the presentation data, an index indicating the existence of the additional information is overlaid and displayed on the presentation part, and when the index is operated, the index is displayed. Additional information corresponding to is displayed. This makes it possible to display additional information that does not exist in any of the images on the plurality of pages.

  Preferably, the conference information changes with the passage of time, and the conference-related information reproduction device sets the group period based on the input period of each of the one or more reference information belonging to the group, for each of the one or more groups. And a reproduction period determination means for determining the group period determined for the selected group as a reproduction period in response to selection of one of the one or more groups. Further, the conference information output means outputs the portion of the conference information corresponding to the determined reproduction period.

  According to this aspect, for each of the one or more groups, the group period is determined based on the input period of each of the one or more reference information belonging to the group, and any one of the one or more groups is selected. Accordingly, the group period determined for the selected group is determined as the reproduction period, and the portion of the conference information corresponding to the determined reproduction period is output. Therefore, it is possible to limit and reproduce the state of the conference during the period when the additional information is input by the user who operates one of the own device and one or more other devices.

  Preferably, the reference information further includes user identification information for identifying the user who added the additional information, and the reference information acquisition unit includes the read data acquired by the read data acquisition unit and the additional information included in the read data. The recording medium correspondence generation means further includes user identification information acquisition means for acquiring user identification information of the added user, and the recording medium correspondence generation means, based on the user identification information acquired by the user identification information acquisition means, reference information corresponding to the recording medium. And displaying the at least one of the plurality of reference information, the reference information display means simultaneously displays the additional information included in each reference information and the user identification information corresponding to the additional information.

  According to this aspect, the user identification information for identifying the user who added the additional information to the recording medium is acquired together with the read data. Reference information corresponding to the recording medium is generated based on the acquired user identification information. When at least one of the plurality of reference information is displayed, the additional information included in each reference information and the user identification information corresponding to the additional information are simultaneously displayed. Accordingly, it is possible to notify the user of the user who added the additional information regarding the reference information corresponding to the recording medium.

According to another aspect of the present invention, a conference-related information reproduction method includes a reference information acquisition step of acquiring reference information generated by the device itself and one or more other devices, and the reference information is obtained by the device itself. A plurality of references acquired by the reference information acquisition step , including additional information added to the presentation data accessible by each of the one or more other devices and position information indicating a position where the additional information is added in the presentation data. Of the information, a grouping step of classifying a plurality of reference information in which the position of the additional information is within a predetermined range in the presentation data into the same group, and one of the one or more groups are selected, A reference information display step of displaying at least one of the plurality of reference information belonging to the selected group, and the reference information acquisition step acquires read data obtained by reading a recording medium on which an image based on the presentation data is formed. The read data acquisition step, the additional information extraction step of extracting an image that does not exist in the presentation data as additional information from the read data acquired by the read data acquisition step, and the position of the extracted additional information in the read data. Based on the position determination step of determining the position in the presentation data as position information indicating the added position of the extracted additional information, and the additional information extracted by the additional information extraction step and the position determined by the position determination step , look including a recording medium corresponding generation step of generating a reference information corresponding to the recording medium, each of the plurality of reference information corresponding to the presentation data including additional information added to the presentation data, the start of the input of the additional information The grouping step includes a plurality of reference information corresponding to the presentation data acquired in the reference information acquisition step, and the position of the additional information is within a predetermined range in the presentation data. And, the plurality of pieces of reference information corresponding to the recording medium acquired by the reference information acquisition step are classified so that the plurality of pieces of reference information having a start time within a predetermined period belong to the same group. position of the additional information, one or a plurality of groups and a and including a classifying the groups included in a predetermined range from any of the positions of the plurality of reference information included in the group of the plurality of groups.

  According to this aspect, it is possible to provide a meeting-related information reproduction method capable of easily reproducing more information related to the meeting.

According to another aspect of the present invention, the conference-related information reproduction program includes a reference information acquisition step of acquiring reference information generated by the own device and one or more other devices; A plurality of references acquired by the reference information acquisition step , including additional information added to the presentation data accessible by each of the one or more other devices and position information indicating a position where the additional information is added in the presentation data. Of the information, a grouping step of classifying a plurality of reference information in which the position of the additional information is within a predetermined range in the presentation data into the same group, and one of the one or more groups are selected, A reference information display step of displaying at least one of the plurality of reference information belonging to the selected group is executed by a computer controlling the own device and one or more other devices, and the reference information acquisition step is based on the presentation data. A read data acquisition step of acquiring read data obtained by reading a recording medium on which an image is formed, and an additional information extraction step of extracting an image that does not exist in the presentation data from the read data acquired by the read data acquisition step as additional information, The position in the presentation data corresponding to the position of the extracted additional information in the read data is determined as position information indicating the position of the extracted additional information, and the position is determined by the additional information extracting step. based on the position determined by the additional information and the position determining step, see contains a recording medium corresponding generation step of generating a reference information corresponding to the recording medium, corresponding to the presentation data including additional information added to the presentation data Each of the plurality of reference information includes an input period that defines the start time and end time of the input of additional information, the grouping step, the plurality of reference information corresponding to the presentation data acquired by the reference information acquisition step, The position of the additional information is within a predetermined range in the presentation data and the start time is within a predetermined period. A plurality of reference information is classified so as to belong to the same group, and the recording medium acquired by the reference information acquisition step is classified. Each of the corresponding plurality of reference information is determined such that the position of the additional information of the reference information is one or more of the plurality of groups and is determined from any position of the plurality of reference information included in the group. including and be classified into groups that are included in the range.

  According to this aspect, it is possible to provide a conference-related information reproduction program capable of easily reproducing more information related to the conference.

It is a figure showing an example of the whole outline of the conference system containing the personal digital assistant concerning an embodiment of the invention. FIG. 3 is a block diagram showing an outline of a hardware configuration of the MFP in this embodiment. It is a block diagram which shows the outline of the hardware constitutions of the portable information device in this Embodiment. It is a block diagram showing an example of a function which a CPU with which a personal digital assistant is provided. It is a figure which shows an example of the format of audio|voice related information. It is a figure which shows an example of the format of presentation image relevant information. It is a figure which shows an example of a format of pointer related information. It is a figure which shows an example of the format of the reference information corresponding to presentation data. It is a figure which shows an example of the format of the reference information corresponding to a recording medium. It is a figure which shows an example of the display state of a display part when user A operates a portable information device and participates in a meeting. It is a figure which shows an example of the reference information corresponding to the presentation data produced|generated in the portable information device of user A. It is a figure which shows an example of the reference information corresponding to the presentation data produced|generated in the portable information device of the user B. It is a figure which shows an example of the reference information corresponding to the presentation data produced|generated in the portable information device of the user C. It is a figure which shows an example of the reference information corresponding to the presentation data produced|generated in the portable information device of the user D. 9 is a diagram showing an example of reference information corresponding to presentation data generated in the portable information device of user E. FIG. 8 is a schematic diagram for explaining an example of reference information corresponding to a user's F presentation manuscript. FIG. 8 is a schematic diagram for explaining an example of reference information corresponding to a user G's presentation manuscript. FIG. FIG. 9 is a schematic diagram for explaining an example of reference information corresponding to an announcement manuscript of user H. It is a schematic diagram which shows the example of the grouping of the reference information corresponding to presentation data. It is a schematic diagram which shows the example of grouping of the reference information based on a presentation manuscript. It is a figure which shows an example of a group list. It is a figure which shows an example of a group list. It is a figure which shows the example of a display when one group identification information is selected from the group list. It is a display example when the reference image of the user F is selected. It is a display example when the reference image of the user G is selected. It is a display example when the character size button is operated in the display state of FIG. 24. It is a figure which shows the other example of a display when one group identification information is selected from the group list. It is a display example when the reference image of the user H is selected. It is a flowchart which shows an example of the flow of a meeting information acquisition process. It is a flowchart which shows an example of the flow of a presentation image related process. It is a flow chart which shows an example of the flow of reference information acquisition processing corresponding to presentation data. 9 is a flowchart showing an example of the flow of reference information acquisition processing corresponding to a presentation manuscript. It is a flow chart which shows an example of the flow of grouping processing. It is a flowchart which shows an example of the flow of a reproduction process. It is a flow chart which shows an example of the flow of the 1st reference information display processing. It is a flow chart which shows an example of the flow of the 2nd reference information display processing.

  Hereinafter, a conference related information reproducing apparatus according to an embodiment of the present invention will be described with reference to the drawings. In the following description, the same parts are designated by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated. Hereinafter, a portable information device will be described as an example of the conference-related information reproducing device.

  FIG. 1 is a diagram showing an example of an overall outline of a conference system including a portable information device according to an embodiment of the present invention. Referring to FIG. 1, the conference system 1 includes an MFP (Multi Function Peripheral) 400 that is a multifunction peripheral and a plurality (five in this example) of portable information devices 200A, 200B, 200C, 200D, and 200E. .. The MFP 400 and the portable information devices 200A to 200E may be located at the same base or different bases. When MFP 400 and portable information devices 200A to 200E are arranged at a plurality of bases, the distance between the plurality of bases is not particularly limited.

  The MFP 400 and the wireless station 3A are connected to the network 2A. The portable information devices 200A and 200B can be connected to the network 2A by communicating with the wireless station 3A. The wireless station 3B is connected to the network 2B. The portable information devices 200C, 200D, 200E can be connected to the network 2B by communicating with the wireless station 3B. Each of the networks 2A and 2B is connected to the Internet 5. Therefore, the MFP 400 and the portable information devices 200A to 200E can communicate with each other.

  The networks 2A and 2B are LANs (local area networks), and the connection form may be wired or wireless. The networks 2A and 2B are not limited to LANs, but may be WANs (wide area networks), PSTNs (public switched telephone networks), the Internet, and the like.

  Each of the portable information devices 200A to 200E is a personal computer. Since the portable information devices 200A to 200E have the same hardware configuration and function, the portable information device 200A will be described here as an example unless otherwise specified. Note that each of the portable information devices 200A to 200E may have the function of FIG. 4 described later. Therefore, each of portable information devices 200A to 200E may be a portable information terminal having a function similar to that of FIG. 4 described later. Examples of such portable information terminals include smartphones, tablet terminals, and PDAs (Personal Digital Assistants).

  FIG. 2 is a block diagram showing an example of the outline of the hardware configuration of the MFP 400. Referring to FIG. 2, MFP 400 includes a main circuit 410. The main circuit 410 includes a CPU 411, a communication interface (I/F) unit 412, a ROM (Read Only Memory) 413, a RAM (Random Access Memory) 414, and a hard disk drive (HDD) 415 as a mass storage device. , A facsimile unit 416 and an external storage device 417. The CPU 411 is connected to the automatic document feeder 420, the document reading unit 430, the image forming unit 440, the paper feeding unit 450, and the operation panel 460, and controls the entire MFP 400.

  The ROM 413 stores a program executed by the CPU 411, or data necessary for executing the program. The RAM 414 is used as a work area when the CPU 411 executes a program. Further, the RAM 414 temporarily stores the read images continuously sent from the document reading unit 430.

  Facsimile unit 416 is connected to the public switched telephone network (PSTN) and transmits facsimile data to PSTN or receives facsimile data from PSTN. The facsimile unit 416 stores the received facsimile data in the HDD 415 or converts it into print data that can be printed by the image forming unit 440, and outputs the print data to the image forming unit 440. As a result, the image forming unit 440 forms an image based on the facsimile data received by the facsimile unit 416 on the paper fed by the paper feeding unit 450. Further, the facsimile unit 416 converts the data read by the document reading unit 430 or the data stored in the HDD 415 into facsimile data and transmits the facsimile data to the facsimile apparatus connected to the PSTN.

  Communication I/F unit 412 is an interface for connecting MFP 400 to network 2A. The communication I/F unit 412 communicates with the portable information devices 200A to 200E connected to the networks 2A and 2B by a communication protocol such as TCP (Transmission Control Protocol) or FTP (File Transfer Protocol).

  The external storage device 417 is controlled by the CPU 411, and is equipped with a CD-ROM (Compact Disk Read Only Memory) 418 or a semiconductor memory. The CPU 411 can access the CD-ROM 418 or the semiconductor memory via the external storage device 417. The CPU 411 loads the program recorded in the CD-ROM 418 mounted on the external storage device 417 or the semiconductor memory into the RAM 414 and executes the program. The program executed by the CPU 411 is not limited to the program recorded in the CD-ROM 418, and the program stored in the HDD 415 may be loaded into the RAM 414 and executed. In this case, another computer connected to the network, via the network connected to the communication I/F unit 412, rewrites the program stored in the HDD 415 of the MFP 400 or additionally writes a new program. You may do it. Further, MFP 400 may download the program from another computer connected to the network and store the program in HDD 415. The program mentioned here includes not only a program directly executable by the CPU 411 but also a source program, a compressed program, an encrypted program, and the like.

The medium for storing the program executed by the CPU 411 is not limited to the CD-ROM 418, and may be an optical disc (MO (Magnetic Optical Disc)/MD (Mini Disc)/DVD (Digital Versatile Disc)), an IC card, an optical card, It may be a semiconductor memory such as a mask ROM, an EPROM (Erasable Programmable ROM), or an EEPROM (registered trademark) (Electrically EPROM).

  Operation panel 460 includes a display unit 461 and an operation unit 463. The display unit 461 is a display such as a liquid crystal display device (LCD) or an organic ELD (Electro-Luminescence Display), and displays an instruction menu for the user, information regarding acquired image data, and the like. The operation unit 463 includes a touch panel 465 and a hard key unit 467 including a plurality of keys. Each of the plurality of keys included in the hard key unit 467 includes a contact switch and is connected to the CPU 411.

  When a plurality of keys of the hard key unit 467 are pressed, the operation unit 463 accepts input of data such as an instruction, characters, and numbers corresponding to the pressed keys. The touch panel 465 is provided on the upper surface or the lower surface of the display unit 461, and outputs the coordinates of the position designated by the operating user to the CPU 411. The touch panel 465 detects a position designated by the operating user with a finger or a stylus pen, and outputs the coordinates of the detected position to the CPU 411.

  The touch panel 465 is preferably the same size as or larger than the display surface of the display unit 461. Since the touch panel 465 is provided so as to be superimposed on the display unit 461, when the operation user points the display surface of the display unit 461, the touch panel 465 displays the coordinates of the position designated by the operation user on the display surface of the display unit 461. Output to the CPU 411. The touch panel 465 can use, for example, a resistance film method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, or a capacitance method, and the method is not limited.

  The operations that can be accepted by the operation unit 463 include an operation of pressing a plurality of keys of the hard key unit 467, a single touch operation of instructing the touch panel 465, and a multi-touch operation.

  The HDD 415 stores in advance schedules to which one or more conference dates and times are assigned and presentation data serving as materials used in each conference. The presentation data is data shared by one or more users participating in the conference, and is accessible to each of the portable information devices 200A to 200E. Further, the CPU 411 manages the users who participate in the conference using the portable information devices 200A to 200E for each of the predetermined conferences. For example, each user of the portable information devices 200A to 200E requests the CPU 411 to participate in the conference by using the user ID (identifier) and password given in advance at the start of the conference. User IDs and passwords corresponding to a plurality of users are stored in advance in the HDD 415 as management information. When there is a request to participate in the conference from the portable information devices 200A to 200E, the CPU 411 compares the user ID and password input together with the request for participation with the management information to determine whether to permit the request for participation. ..

  When permitting the participation request to the conference from any of the portable information devices 200A to 200E, the CPU 411 downloads the conference announcement data corresponding to the participation request to the portable information device. Further, the CPU 411 manages the operation of one or more portable information devices of the portable information devices 200A to 200E that have permitted the participation request.

  In the conference system 1 according to the present embodiment, each of a plurality of users participating in the conference using the portable information devices 200A to 200E can request the CPU 411 that they should be the presenter. When the CPU 411 receives a request from a user to become a presenter, the CPU 411 determines whether to permit the request from the user according to a predetermined condition.

  For example, when permitting a request from any of the portable information devices 200A to 200E, for example, the portable information device 200A to be a presenter, the CPU 411 grants the presenting authority to the portable information device. On the other hand, if the CPU 411 does not permit the request from the portable information device 200A to become the presenter, it does not give the portable information device 200A the presentation authority. The presentation authority specifies the image (hereinafter referred to as the presentation image) that should be presented to all the users who participate in the conference among the presentation data about the conference, and outputs their own remarks to all the users. Means the right to do.

  An arbitrary user can instruct the MFP 400 to create a document (hereinafter referred to as a presentation document) based on the presentation data stored in the HDD 415. For example, this is a case where a user who does not carry the band information devices 200A to 200E participates in the conference using a sheet on which an image based on the presentation data is formed. When the user inputs an operation for designating the presentation data by operating the operation panel 460, the CPU 411 controls the image forming unit 440 to form an image based on the presentation data on a sheet. In this way, the presentation manuscript is created by the MFP 400. The presentation manuscript is an example of a recording medium on which an image based on the presentation data is formed. The size of the presentation manuscript is the size specified by the user who has instructed to create the presentation manuscript. For example, when the paper size of A4 is designated, the size of the presentation manuscript is A4, and when the paper size of A3 is designated, the size of the presentation manuscript is A3. Further, when the presentation data is composed of a plurality of pages, the presentation manuscript is composed of the same number of sheets as the number of pages of the plurality of pages when the plurality of pages included in the presentation data are formed on the paper. The presentation manuscript is composed of a smaller number of sheets than the number of pages of a plurality of pages when two or more images of a plurality of pages included in the presentation data are formed on one sheet. For example, if the presentation data includes 10 pages and 2 pages are formed on 1 sheet, the presentation manuscript is composed of 5 sheets, and if 4 pages are formed on 1 sheet, The presentation manuscript consists of three sheets.

  The user who obtains the presentation manuscript may add a memo by hand to the presentation manuscript while participating in the conference. Here, the image of the presentation manuscript to which the handwritten memo is added is referred to as a presentation manuscript image. In this case, for example, the user can operate the operation panel 460 to log in to the MFP 400 after the end of the conference, and cause the MFP 400 to read the presentation manuscript to which the memo is added. Specifically, when the user places the presentation document on the automatic document feeder 420 and inputs an operation to instruct reading on the operation panel 460, the CPU 411 controls the document reading unit 430 to display the presentation document image. Is stored in the HDD 415 in association with the user identification information of the logged-in user.

  Further, the user who causes the MFP 400 to read the presentation document image can cause the MFP 400 to transmit the set of the read data and the user identification information to any of the portable information devices 200A to 200E. For example, a user who causes the MFP 400 to read the presentation document image operates the operation panel 460 to specify any one of the portable information devices 200A to 200E, and inputs an operation to instruct the transmission of the read data stored in the HDD 415. Then, CPU 411 transmits the read data and the user identification information to the designated portable information device. Further, when there is a transmission request for the read data stored in HDD 415 from any of portable information devices 200A to 200E, CPU 411 provides the requested read data and user identification information associated with the read data. Is transmitted to the portable information device that has transmitted the transmission request.

  FIG. 3 is a block diagram showing an outline of the hardware configuration of portable information device 200A in the present embodiment. Referring to FIG. 3, portable information device 200A in the present embodiment stores a central processing unit (hereinafter referred to as “CPU”) 201 for controlling the entire portable information device 200A, a program executed by CPU 201, and the like. A ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203 used as a work area of the CPU 201, a flash memory 204 for storing data in a nonvolatile manner, a display unit 205 for displaying information, and a user's unit 205. An operation unit 206 that receives an operation, a voice input unit 207 that receives a voice around the portable information device 200A, a voice output unit 208 that outputs a voice, a wireless LAN I/F (wireless local area network interface) 209, and an external storage. And a device 210.

  The flash memory 204 stores a program executed by the CPU 201 or data necessary for executing the program. The CPU 201 loads the program recorded in the flash memory 204 into the RAM 203 and executes it. The CPU 201 executes the program recorded in the flash memory 204 to generate reference information and conference information described later, and the generated reference information and conference information are stored in the flash memory 204.

  The display unit 205 is an LCD (liquid crystal display device), an organic ELD (organic electroluminescence display device), or the like. The operation unit 206 includes a main key 206A, a touch panel 206B, a keyboard 206C, and a mouse 206D. The main key 206A is a hard key including a contact switch, for example. The touch panel 206B is provided on the upper surface or the lower surface of the display unit 205 so as to overlap with the display unit 205. The touch panel 206B detects a position designated by the user on the display surface of the display unit 205 and outputs the detected position of the display surface to the CPU 201.

  The CPU 201 receives input of various instructions, data such as characters and numbers, which are operated by the user, based on the screen displayed on the display unit 205 and the position detected by the touch panel 206B. For example, when displaying a screen including a numeric keypad image on the display unit 205, the number corresponding to the key displayed at the position detected by the touch panel 206B is accepted. Further, the CPU 201 can detect drawing based on the position information input from the touch panel 206B. Specifically, the CPU 201 generates drawing data indicating a handwritten image in which the pixel value of the pixel at the position detected by the touch panel 206B is "1" and the pixel values of the other pixels are "0".

  The keyboard 206C includes a plurality of alphanumeric keys. The CPU 201 detects an alphanumeric key pressed by the user and accepts input of data such as various characters and numbers by the user's operation. The mouse 206D includes a position designating mechanism for designating an arbitrary position with the mouse pointer displayed on the display unit 205, and one or more hard keys. The position pointing mechanism of the mouse 206D outputs the position information designated by the user to the CPU 201. The hard key of the mouse 206D outputs an on/off signal to the CPU 201 by a user operation. The CPU 201 detects the position designated by the user on the display surface of the display unit 205 based on the position information input from the mouse 206D. Further, the CPU 201 detects an operation state (for example, a click operation, a drag operation, etc.) of the mouse 206D by the user based on an ON/OFF signal input from the mouse 206D. Further, the CPU 201 can also detect drawing based on the position information and the operation state detected by the position information and the ON/OFF signal input from the mouse 206D. Specifically, the CPU 201 indicates a handwritten image in which the pixel value of the pixel at the position on the display surface of the display unit 205 designated by the mouse 206D is “1” and the pixel values of other pixels are “0”. It is also possible to generate drawing data.

  The voice input unit 207 is, for example, a microphone, and the voice output unit 208 is, for example, a speaker. The voice input unit 207 collects the voice of the user around the portable information device 200A, converts the collected sound into voice data, and outputs the voice data to the CPU 201. The audio output unit 208 is controlled by the CPU 201, reproduces the audio data input from the CPU 201, and generates sound.

  The wireless LAN I/F 209 is an interface for communicating with the wireless station 3A and connecting the portable information device 200A to the network 2A. By registering the IP (Internet Protocol) address of MFP 400 in portable information device 200A, portable information device 200A can communicate with MFP 400 and can send and receive data. In the present embodiment, a case where portable information device 200A communicates with MFP 400 using wireless LAN I/F 209 will be described as an example, but communication may be performed using another communication method. Specifically, when the portable information device 200A and the MFP 400 are equipped with a short-range wireless device such as Bluetooth (registered trademark), the portable information device 200A communicates with the MFP 400 on a one-to-one basis. Good.

  The external storage device 210 is detachably attached to the portable information device 200A, and a CD-ROM 210A in which a conference related information reproduction program is stored can be attached. The CPU 201 can access the CD-ROM 210A via the external storage device 210. The CPU 201 can load the conference-related information reproduction program recorded in the CD-ROM 210A mounted on the external storage device 210 into the RAM 203 and execute it. Further, the CPU 201 may store the conference-related information reproduction program recorded in the CD-ROM 210A in the ROM 202 or the flash memory 204. In this case, the CPU 201 can load the conference-related information reproduction program stored in the ROM 202 or the flash memory 204 into the RAM 203 and execute it.

  The program executed by the CPU 201 is not limited to the programs stored in the ROM 202, the flash memory 204, and the CD-ROM 210A in advance. The CPU 201 may execute, for example, a program stored in the flash memory 204 and rewritten by another computer connected to the networks 2A and 2B or the Internet 5. Further, the CPU 201 may execute a new program additionally written in the flash memory 204 by another computer connected to the networks 2A, 2B or the Internet 5. Furthermore, the CPU 201 may execute a program downloaded from another computer connected to the network 2 or the Internet 5. The program mentioned here includes not only a program directly executable by the CPU 201 but also a source program, a compressed program, an encrypted program, and the like.

The medium for storing the program executed by the CPU 201 is not limited to the CD-ROM 210A, and may be an optical disk such as MO (Magnetic Optical disc), MD (Mini Disc), and DVD (Digital Versatile Disc). The medium for storing the program executed by the CPU 201 may be a semiconductor memory such as an IC card, an optical card, a mask ROM, an EPROM (Erasable Programmable ROM), or an EEPROM (registered trademark) (Electrically EPROM).

  FIG. 4 is a block diagram showing an example of functions of the CPU 201 included in the portable information device 200A. In FIG. 4, portable information devices 200B to 200E are shown as other devices.

  The functions shown in FIG. 4 are functions formed in the CPU 201 by the CPU 201 included in each of the portable information devices 200A to 200E executing various programs stored in the ROM 202, the flash memory 204, and the CD-ROM 210A. The functions of the CPU 201 included in each of the portable information devices 200A to 200E have the same function. Below, the functions of the CPU 201 of the portable information device 200A will be described on behalf of the CPU 201 of the portable information devices 200A to 200E.

  Referring to FIG. 4, the CPU 201 includes a conference information acquisition unit 110, a reference information acquisition unit 120, a grouping unit 130, a group list display unit 131, a group period determination unit 133, a selection unit 134, and a reproduction unit. It includes a period determination unit 138, a reference information display unit 150, a conference information output unit 160, a reproduction operation instruction unit 170, and a clock unit 190. The clock unit 190 acquires the current time information and outputs the acquired time information to the conference information acquisition unit 110 and the reference information acquisition unit 120.

  The conference information acquisition unit 110 acquires, as the conference information, information regarding the state of the conference that changes with the passage of time. The conference information is generated by any of the portable information devices 200A to 200E of the users who participate in the conference. The conference information acquisition unit 110 generates conference information and transmits the generated conference information to the other portable information devices 200B to 200E via the wireless LAN I/F 209 while the device mode is the announcement mode. On the other hand, the conference information acquisition unit 110 receives the conference information transmitted from the portable information device in the announcement mode among the other portable information devices 200B to 200E in the device mode being the participation mode. Since the conference information acquisition unit 110 generates the conference information in the announcement mode and receives the conference information in the participation mode, the conference information acquisition unit 110 continuously acquires the conference information during the conference in which the user of the portable information device 200A participates.

  Here, a case will be described in which the mobile information device 200A of the mobile information devices 200A to 200E of the users participating in the conference whose device mode is the announcement mode generates the conference information. In this case, the conference information acquisition unit 110 included in the portable information device 200A generates conference information and transmits the conference information to the other portable information devices 200B to 200E via the wireless LAN I/F 209. The conference information acquisition unit 110 included in each of the other mobile information devices 200B to 200E acquires the conference information by receiving the conference information generated by the mobile information device 200A from the mobile information device 200A.

  The conference information includes voice related information, presentation image related information, and pointer related information. The voice-related information is information in which the voice of the presenter who is given the presentation authority is associated with the time when the voice is generated. The presentation image related information is information in which the presentation portion designated by the presenter in the presentation data is associated with the designated time. The pointer-related information is information in which the position of the mouse pointer designated by the presenter is associated with the time when the position is designated.

  The conference information acquisition unit 110 switches the device mode to either the presentation mode or the participation mode while the user is participating in the conference. Specifically, the conference information acquisition unit 110 sets the device mode to the participation mode by default. When the presentation mode is selected by the user through the operation unit 206 while the device mode is in the participation mode, the conference information acquisition unit 110 controls the wireless LAN I/F 209 to send a request signal indicating that it should be the presenter. It is transmitted to the MFP 400. The conference information acquisition unit 110 switches the device mode to the presentation mode on the condition that the request to become a presenter is permitted by the MFP 400, that is, when the user of the portable information device 200A is given the presentation authority. On the other hand, the conference information acquisition unit 110 does not switch the device mode to the presenter mode when the request for becoming the presenter is not permitted by the MFP 400, that is, when the user of the portable information device 200A is not given the presenting authority. Maintain join mode.

  The portable information device 200A can set the announcement part in a state where the device mode is switched to the announcement mode. The presentation part is a part of the presentation data used for the conference, which is displayed on each of the portable information devices 200A to 200E of the users who participate in the conference. The portable information device 200A cannot set the announcement part in the participation mode.

  The conference information acquisition unit 110 acquires the voice data input from the voice input unit 207. The conference information acquisition unit 110 detects the presentation start time and the presentation end time based on the time information acquired by the clock unit 190 in the presentation mode. The presentation start time is the time when the device mode is switched from the participant mode to the presentation mode, and the time when the user of the portable information device 200A becomes the presenter. The presentation end time is the time when the device mode is switched from the presentation mode to the participant mode, and is the time when the user of the portable information device 200A is no longer the presenter. The conference information acquisition unit 110 acquires audio data between the presentation start time and the presentation end time. The conference information acquisition unit 110 generates audio related information by associating the audio data with the detected presentation start time and presentation end time.

  The conference information acquisition unit 110 detects the position of the mouse pointer when the presenter operates the mouse 206D in the presentation mode. The conference information acquisition unit 110 generates pointer-related information by associating the detected mouse pointer position with the time information acquired by the clock unit 190 in the presentation mode.

  The conference information acquisition unit 110 includes a presentation part setting unit 111. When the presenter operates the operation unit 206 to specify a presentation page in the presentation mode, the presentation portion setting unit 111 extracts the designated presentation page and sets the entire presentation page as the presentation portion. . Further, when the presenter operates the operation unit 206 to enlarge or reduce the announcement page in a state where the announcement page is extracted, the announcement part setting unit 111 sets the enlarged or reduced area in the announcement page as the announcement part. Set. The conference information acquisition unit 110 generates the announcement image related information by associating the announcement portion set by the announcement portion setting unit 111 in the announcement mode with the time information acquired by the timer unit 190.

  In response to acquiring the conference information, the conference information acquisition unit 110 displays the image of the presentation portion specified by the presentation image related information included in the conference information on the display unit 205 and refers to the acquired conference information. The information is output to the information acquisition unit 120, the group list display unit 131, and the conference information output unit 160.

  FIG. 5 is a diagram showing an example of a format of voice-related information. Referring to FIG. 5, the voice-related information includes a voice data item, a presentation start time item, and a presentation end time item. In the item of voice data, voice data obtained by converting the presenter's voice into electronic data is set. In the item of presentation start time, the time when the device mode is switched to the presentation mode is set, and in the item of presentation end time, the time when the device mode is switched from the presentation mode to the participant mode is set.

  FIG. 6 is a diagram showing an example of a format of presentation image related information. Referring to FIG. 6, the presentation image related information includes an item of page data, an item of partial data, and an item of time information. In the page data item, page identification information for identifying a presentation page designated by the presenter among a plurality of pages included in the presentation data used in the conference is set. Area identification information for identifying the area designated by the presenter on the announcement page is set in the partial data item. In the item of time information, the time when the area is specified by the presenter on the announcement page is set.

  FIG. 7 is a diagram showing an example of a format of pointer-related information. With reference to FIG. 7, the pointer-related information includes a position item and a time information item. In the position item, position data indicating the position where the presenter points on the screen of the display unit 205 with the mouse pointer is set, and in the time information item, the time when the position indicated by the position data is specified is set. To be done.

  Returning to FIG. 4, the reference information acquisition unit 120 acquires reference information. Here, the reference information according to the present embodiment includes reference information corresponding to the presentation data and reference information corresponding to the presentation manuscript.

  First, the reference information corresponding to the presentation data will be described. The reference information corresponding to the presentation data is the additional information input by each user of the portable information devices 200A to 200E participating in the conference, the position in the presentation data at which the additional information is input, and the time when the additional information is input. Is information associated with. Specifically, the reference information includes user identification information for identifying a user who has input additional information, additional information, position information indicating a position in the announcement data of the additional information, and an input period.

  When the operation unit 206 receives the additional information, the reference information acquisition unit 120 generates the reference information corresponding to the presentation data, and also transmits the generated reference information to another portable information device 200B via the wireless LAN I/F 209. ~200E each. The additional information includes information input by a user operating the portable information device 200A operating the operation unit 206. For example, when the keyboard 206C or the soft keyboard receives the character string, the reference information acquisition unit 120 receives the received character string as additional information. Further, when the touch panel 206B detects a position on the surface of the display unit 205 that the user points with a finger or a stylus pen, the reference information acquisition unit 120 uses the handwritten drawing as additional information based on the detected position. Accept.

  When receiving the additional information, the reference information acquisition unit 120 determines the user who operates the portable information device 200A, the position in the presentation data in which the additional information is input, and the input period. Specifically, the reference information acquisition unit 120 determines the user who has logged in to the mobile information device 200A as the user who operates the mobile information device 200A. In addition, the reference information acquisition unit 120 adds the presentation portion specified by the presentation image related information included in the conference information input from the conference information acquisition unit 110 and the image of the presentation portion displayed on the display unit 205. The position of the area where the information is input is determined as the position information. The position information includes page identification information for identifying a page including a presentation part among a plurality of pages included in the conference data, and area position information indicating a position of an area where additional information is arranged in the page. Including. Further, the reference information acquisition unit 120 determines the input period based on the time information acquired by the clock unit 190. The input period is a period from the input start time when the input of the additional information is started to the input end time when the input of the additional information is ended.

  When the wireless LAN I/F 209 receives the reference information corresponding to the presentation data from any of the other portable information devices 200B to 200E, the reference information acquisition unit 120 acquires the received reference information. Therefore, the reference information acquisition unit 120 generates reference information corresponding to the additional information input by the user operating the portable information device 200A, and corresponds to the additional information input by the user operating the portable information devices 200B to 200E. Since the reference information is received, the reference information corresponding to the additional information input by all the users participating in the conference is continuously obtained during the conference. The reference information acquisition unit 120 outputs the reference information corresponding to the acquired presentation data to the grouping unit 130 and the reproduction period determination unit 138.

  FIG. 8 is a diagram showing an example of a format of reference information corresponding to presentation data. Referring to FIG. 8, the reference information corresponding to the presentation data includes a user ID item, an additional information item, a position information item, and an input period item. In the item of user ID, user identification information for identifying the user is set. In the additional information item, additional information input by the user specified by the user identification information set in the user ID item is set. In the position information item, position information indicating the position of the area in the conference data where the additional information is input is set. The input period item includes a start time item and an end time item. In the item of start time, the input start time when the input of the additional information is started is set, and in the item of the end time, the input end time when the input of the additional information is ended is set.

  As described above, the additional information corresponding to the presentation data is input on the image of the presentation portion displayed on the display unit 205. Here, it is assumed that the presentation data includes, for each page, a predetermined reference image (for example, a frame or the like) for defining the reference size of the page. In this case, the relative size of the additional information with respect to the reference size includes the ratio of the size of the presentation portion to the reference size, the image size of the presentation portion displayed on the display unit 205, and the additional information input on the image of the presentation portion. It is uniquely determined based on the size.

  Next, reference information corresponding to the presentation manuscript will be described. The reference information corresponding to the presentation manuscript is basically data of a memo handwritten in the presentation manuscript by a user who participated in the conference using the presentation manuscript.

  Referring to FIG. 4, reference information acquisition unit 120 generates reference information corresponding to the presentation manuscript based on the read data of the presentation manuscript. The reference information acquisition unit 120 includes a read data acquisition unit 121, an additional information extraction unit 122, a position determination unit 123, a recording medium correspondence generation unit 124, a condition image determination unit 125, a user identification information acquisition unit 126, and a size determination unit 127. .

  For example, when the user operates operation panel 460 of MFP 400 to instruct to transmit the read data to portable information device 200A, MFP 400 corresponds to the read data stored in HDD 415 and the read data as described above. The user identification information is transmitted to portable information device 200A. The read data acquisition unit 121 acquires the read data received from the MFP 400. Further, the user identification information acquisition unit 126 acquires the user identification information received from the MFP 400 together with the read data.

  As described above, the size of the presentation manuscript is not always a fixed size. Further, in the presentation manuscript, the number of pages formed on one sheet is not always constant. Therefore, in the read data, the ratio of the image size per page with respect to the reference size is likely to be different for each presentation manuscript.

  Therefore, the additional information extraction unit 122 according to the present embodiment first extracts one or more pages included in the presentation manuscript from the read data corresponding to one presentation manuscript. This extraction processing is executed by detecting a reference image provided for each page of the presentation manuscript using pattern matching or the like, for example.

  After that, the additional information extraction unit 122 compares the extracted read data for each page with the announcement data for each page to extract an image that does not exist in the announcement data from the read data as additional information. That is, the additional information extracting unit 122 extracts an image that is present in the presentation document image but not in the presentation image as additional information corresponding to the presentation document. At this time, the additional information extraction unit 122 may vectorize the extracted additional information. Accordingly, the image quality of the additional information when displaying the additional information can be improved, and the data amount of the additional information can be reduced.

  Further, the additional information extraction unit 122 defines the image size of one page of the read data as the read reference size based on the reference image included in the read data extracted for each page, and then adds the read data to the read reference size. The ratio of the size of information is calculated as the scaling rate.

  The presentation manuscript contains a blank area surrounding the presentation image area in addition to the presentation image area in which the presentation image is formed. Therefore, a user who uses the presentation manuscript may write a memo in the blank area by using the leader line extending from the presentation image area to the blank area. Therefore, an image having a specific shape that is considered to indicate that there is a memo in the blank area is set as the condition image. In the present embodiment, an image extending from inside to outside of any of a plurality of pages of images included in the presentation data, for example, a linear image extending from the presentation image area to the margin area of the presentation document image is set as the condition image. To do.

  The condition image determination unit 125 determines whether or not a condition image exists in the additional information extracted by the additional information extraction unit 122.

  The position determination unit 123 determines the position in the presentation data corresponding to the position of the extracted additional information in the read data as the position to which the extracted additional information is added, and adds the information indicating the determined position to the addition. Position information corresponding to the information. In addition, when the condition image determination unit 125 determines that the condition image exists, the position determination unit 123 determines whether the condition image of the page is included in the pages of the presentation image that overlap the condition image among the plurality of pages included in the presentation data. The position of the end in the presentation image area is determined as the position where the additional information is added. This allows the position of the additional information to be determined at an appropriate position within the page of the presentation data.

  Further, when the additional information extracted by the additional information extracting unit 122 does not exist in any of the images of the plurality of pages included in the presentation data, the position determination unit 123 extracts the plurality of pages included in the presentation data. The page corresponding to the image having the closest additional information and the relative position of the extracted additional information with respect to the corresponding page are determined as the position of the additional information.

  In this way, the position of the additional information extracted from the read data obtained by reading the announcement document on which the image based on the announcement data is formed is the position of the additional information extracted from the page corresponding to the image having the closest additional information. Since the relative position is determined, the additional information extracted from the read data can be classified into one or more groups. Therefore, the additional information extracted from the read data can be reproduced together with the additional information added to the presentation data.

  Here, the size of the additional information written on the presentation image or the presentation manuscript varies depending on the user. When the additional information is a character, if the sizes of the plurality of additional information written by the plurality of users vary, each additional information is confirmed when the plurality of additional information is displayed on the display unit 205 as described later. Hard to do.

  Each of the plurality of characters included in the additional information can be detected based on, for example, a histogram of pixel values representing a drawn image including the additional information, and the size of one character can be detected. Therefore, the size determination unit 127, based on at least one of the read data and the presentation data, so that each of the plurality of pieces of additional information can be displayed on the display unit 205 with an appropriate character size. The ideal size of the additional information with respect to the reference size is determined as the appropriate character size for each additional information. In this case, the appropriate character size may be, for example, the same as the maximum, minimum, or average size of a plurality of characters described in the presentation manuscript corresponding to the read data, or may be the same size as the plurality of characters in the presentation data. It may be as large as the maximum, minimum or average size. As a result, the extracted additional information is displayed in a size corresponding to the size of each page of the presentation data, the size of characters, or the like, so that the variation in the size of the displayed additional information can be reduced.

  Alternatively, the size determination unit 127 adds each of the plurality of pieces of additional information to the presentation image in any of the portable information devices 200A to 200E so that the additional information can be displayed on the display unit 205 with an appropriate character size. The appropriate character size may be determined based on the size of the added information. In this case, the appropriate character size may be the same as the maximum, minimum, or average size of the plurality of pieces of additional information added to the presentation image in any of the mobile information devices 200A to 200E. As a result, the extracted additional information is displayed in a size according to the size of the additional information added to the presentation data by any of the portable information devices 200A to 200E, so that the variation in the size of the additional information can be reduced. You can

  The recording medium correspondence generation unit 124 includes the user identification information acquired by the user identification information acquisition unit 126, the additional information extracted by the additional information extraction unit 122, the scaling ratio calculated by the additional information extraction unit 122, and the position determination unit. The reference information corresponding to the presentation manuscript is generated based on the position information indicating the position determined by 123, the determination result by the condition image determination unit 125, and the appropriate character size determined by the size determination unit 127.

  FIG. 9 is a diagram showing an example of a format of reference information corresponding to a presentation manuscript. Referring to FIG. 9, reference information corresponding to the presentation manuscript includes user ID items, additional information items, position information items, enlargement/reduction ratio items, appropriate character size items, and condition images. And the item of the determination result. The user identification information acquired by the user identification information acquisition unit 126 is set in the user ID item. In the item of additional information, the additional information extracted by the additional information extraction unit 122 is set. Position information indicating the position of the additional information determined by the position determination unit 123 is set in the position information item. In the item of scaling rate, the scaling rate calculated by the additional information extraction unit 122 is set. The appropriate character size determined by the size determining unit 127 is set in the item of appropriate character size. In the item of the condition image judgment result, the judgment result by the condition image judgment unit 125 is set. The reference information acquisition unit 120 outputs the reference information corresponding to the acquired presentation manuscript to the grouping unit 130.

  The reference information corresponding to the presentation manuscript needs to include at least items of additional information and position information, and may not include items of user ID, enlargement/reduction ratio, appropriate character size, and condition image determination result.

  Returning to FIG. 4, the grouping unit 130 classifies the plurality of pieces of reference information input from the reference information acquisition unit 120 into one or more groups. In the present embodiment, first, grouping section 130 has the position indicated by the position information within a predetermined range in the presentation data and the input start time within a predetermined period for a plurality of reference information corresponding to the presentation data. Classify one or more pieces of reference information into the same group. It should be noted that one or more pieces of reference information whose input start time is within a predetermined period may be classified into the same group. Here, the predetermined range and the predetermined period may be set by the user who operates portable information device 200A, or may be predetermined in conference system 1. When predetermined in the conference system 1, the predetermined range and the predetermined period have the same value in the portable information devices 200A to 200D. The predetermined range and the predetermined period are values set by the user of the portable information device 200A. The shorter the predetermined range or the shorter the predetermined period, the larger the number of groups. On the contrary, the longer the predetermined range or the longer the predetermined period, the smaller the number of groups. Here, an example in which the grouping unit 130 classifies one or more pieces of reference information whose position indicated by the position information is within a predetermined range in the presentation data and whose input start time is within a predetermined period into the same group Explained.

  As described above, the reference information corresponding to the presentation image does not include the input period. Therefore, the grouping unit 130 groups a plurality of pieces of reference information corresponding to the presentation data, and then groups a plurality of pieces of reference information corresponding to the presentation manuscript into a plurality of pieces of reference information corresponding to the presentation data. Group of which the position of the additional information of the reference information is one or more groups of the plurality of groups and included in a predetermined range from any position of the plurality of reference information included in the group. Classified into all. Accordingly, it is possible to appropriately classify the plurality of reference information corresponding to the presentation data and the plurality of reference information corresponding to the recording medium into a plurality of groups. Further, when there is no group set based on the presentation data within a predetermined range from the position of the reference information corresponding to the presentation manuscript, the grouping unit 130 refers to the group closest to the reference information. Classify information. If the input from the reference information acquisition unit 120 is only the reference information corresponding to the presentation image, the grouping unit 130 has at least one reference information in which the position indicated by the position information is within a predetermined range in the presentation data. Are classified into the same group.

  The grouping unit 130 classifies the plurality of reference information into one or more groups, and then displays one or more reference information for each of the one or more groups in the group list display unit 131, the group period determination unit 133, and the reference information display unit 150. Output to.

  The group period determination unit 133 receives one or more pieces of reference information corresponding to the presentation data for each one or more groups from the grouping unit 130. The group period determination unit 133 determines a group period for each of one or more groups. The group period determination unit 133 determines the group period for each one or more groups based on the input period included in each of the one or more reference information belonging to the group. Specifically, the group period determination unit 133 includes one or more that belong to the group to be processed from the earliest time among one or more input start times included in each of the one or more reference information belonging to the group to be processed. Of the one or more input end times respectively included in the reference information of 1., the period up to the latest time is determined as the group period. The group period determination unit 133 outputs the group period determined for each one or more groups to the reproduction period determination unit 138.

  Here, when the reference information input from the reference information acquisition unit 120 to the grouping unit 130 is only the reference information corresponding to the presentation image, the reference information input to the group period determination unit 133 has no input period. .. Therefore, when the input reference information does not include all input periods, the group period determination unit 133 determines, for example, the group period of all groups to be a period from the presentation start time to the presentation end time.

  The group list display unit 131 receives one or more pieces of reference information for each of one or more groups from the grouping unit 130, and the conference information from the conference information acquisition unit 110. The group list display unit 131 selectively displays on the display unit 205 group identification information for identifying each of one or more groups. The group list display unit 131 generates group identification information for each of the one or more groups based on the one or more reference information for each of the one or more groups from the grouping unit 130. The group identification information indicates the position of the area specified by one or more additional information included in each of the one or more reference information belonging to the group, and one or more position information included in each of the one or more reference information belonging to the group. It is at least one of the information shown and the group period of the group.

  Here, as an example, the group identification information is one or more additional information included in one or more reference information belonging to the group and one or more position information included in each of the one or more reference information belonging to the group. explain. The group list display unit 131 corresponds to one or more pieces of reference information based on the one or more pieces of reference information belonging to the group and the presentation image related information included in the meeting information input from the meeting information acquisition unit 110. The above reference image is generated. The reference image includes the user identification information included in the reference information, the additional information, and the image of the area specified by the position information included in the reference information in the announcement portion specified by the announcement image related information. Specifically, the group list display unit 131 adds the addition included in the reference information to the image of the portion including the area specified by the position information included in the reference information in the presentation part specified by the presentation image related information. The reference image is generated by adding the image of the user identification information included in the reference information to the image in which the image of the information is combined with the area specified by the position information included in the reference information. The group list display unit 131 generates one or more reference images respectively corresponding to one or more reference information belonging to the group, and generates an image in which the generated one or more reference images are arranged as group identification information. The group list display unit 131 displays on the display unit 205 a group list in which one or more group identification information generated corresponding to each of the one or more groups is arranged.

  The selection unit 134 includes a group selection unit 135, a reference information selection unit 136, and an index selection unit 137. The group selection unit 135 selects one of the one or more pieces of group identification information displayed on the display unit 205 by the group list display unit 131 in a selectable manner based on an operation input by the user into the operation unit 206. Specifically, the group selection unit 135 receives a click operation of the mouse 206D in a state where the mouse pointer is placed at any position of the one or more group identification information displayed on the display unit 205, for example. , Select the group identified by the group identification information displayed at the position where the mouse pointer is placed. This allows the user to easily select a desired group. The group selection unit 135 outputs the group identification information of the selected group to the reproduction period determination unit 138 and the reference information display unit 150 in response to the selection of the group by the user.

  The reference information selection unit 136 is based on an operation in which the user inputs one of the one or more reference images included in the selected group identification information to the operation unit 206 while the group is selected by the group selection unit 135. To select. Specifically, the reference information selection unit 136 receives a click operation of the mouse 206D in a state where the mouse pointer is placed at any position of the one or more reference images included in the group identification information, Select the reference information corresponding to the reference image displayed at the position where the mouse pointer is placed. The reference information selection unit 136 outputs reference information identification information for identifying the selected reference information to the reproduction period determination unit 138 and the reference information display unit 150 in response to the reference information selected by the user.

  As described later, when the reference information selection unit 136 selects the reference information, the reference information display unit 150 displays the additional information of the selected reference information on the display unit 205. At this time, when the reference information includes a determination result indicating the presence of the condition image, an index indicating the presence of the reference information is displayed on the display unit 205 instead of the additional information.

  The index selection unit 137 allows the user to select one of the one or more indexes on the operation unit 206 while the display unit 205 displays one or more indexes by the reference information selection unit 136 selecting the reference information. Select an index based on the input operation. Specifically, the index selection unit 137 receives the click operation of the mouse 206D in a state where the mouse pointer is placed at any one of the one or more indices included in the reference information, and Select the index corresponding to the index displayed at the position to be placed. The index selection unit 137 outputs index identification information for identifying the selected index to the reference information display unit 150 in response to the selection of the index by the user.

  The reproduction period determination unit 138 receives the group periods of one or more groups from the group period determination unit 133 and the group identification information from the selection unit 134. In response to the input of the group identification information, the reproduction period determination unit 138 determines the group period of the group specified by the group identification information from among the group periods of one or more groups input from the group period determination unit 133. And the determined group period is determined as the reproduction period. The reproduction period indicates a period from the reproduction start time to the reproduction end time. When the group identification information is given from the selection unit 134, the reproduction period determination unit 138 reproduces the group period of the group indicated by the group identification information from among the group periods of each of the one or more groups input from the group period determination unit 133. Determine the period.

  Furthermore, the reproduction period determination unit 138 may input the reference information identification information after the group identification information is input from the selection unit 134. When the reference information identification information is given from the selection unit 134, the reproduction period determination unit 138 specifies the reference information indicated by the reference identification information from the plurality of reference information input from the reference information acquisition unit 120, and is specified. The input period included in the reference information is determined as the reproduction period. The reproduction period determination unit 138 outputs the determined reproduction period to the conference information output unit 160.

  The conference information output unit 160 receives the conference information from the conference information acquisition unit 110 and the reproduction period from the reproduction period determination unit 138. The conference information output unit 160 outputs a portion of the conference information corresponding to the reproduction period. Thereby, the state of the conference during the period when the additional information is input can be limited and reproduced. The conference information output unit 160 includes a presentation data partial display unit 161, and also includes a conference voice output unit, a text conversion output unit, a static output control unit, and a dynamic output control unit, which are not shown.

  The presentation data partial display unit 161 predetermines, on the display surface of the display unit 205, a corresponding presentation portion as a presentation image during the reproduction period based on the presentation image related information of the conference information acquired by the conference information acquisition unit 110. It is displayed in the specified reproduction area. Specifically, the announcement data part display unit 161 extracts the announcement image related information in which the time within the reproduction period is set in the time information item of the announcement image related information. The announcement data part display unit 161 displays the announcement part in the announcement data specified by the page identification information set in the page data item of the extracted presentation image related information and the area identification information set in the item of partial data. Identify.

  The conference voice output unit outputs the voice of the presenter during the reproduction period from the voice output unit 208 based on the voice-related information of the conference information acquired by the conference information acquisition unit 110. Specifically, the conference audio output unit extracts all audio-related information in which the time within the reproduction period is set in the item of audio data. The conference voice output unit outputs the voice data set in the voice data item of the extracted voice related information from the voice output unit 208. As a result, the user can grasp the details of the presentation at the conference in more detail.

  The text conversion output unit converts voice data of the voice related information acquired from the conference information acquisition unit 110 into text data by performing voice recognition. Further, the text conversion output unit displays the character string of the text data obtained by character recognition of the voice during the reproduction period in a predetermined area on the display surface of the display unit 205. Specifically, the text conversion output unit extracts all the voice related information in which the time within the reproduction period is set in the item of voice data. The text conversion output unit converts the voice data of the extracted voice-related information into text data, and displays the character string of the converted text data on the display unit 205. This allows the user to visually recognize the voice of the presenter during the meeting.

  The text conversion output unit may display, on the display unit 205, not only the character string of the text data during the reproduction period but also the character string of the text data during a period other than the reproduction period. In this case, the text conversion output unit highlights, for example, the character string of the text data during the reproduction period in a display mode different from the character string of the text data during the period excluding the reproduction period. Thereby, the user can easily recognize the presenter's voice during the reproduction period.

  The static output control unit displays, on the display unit 205, a trajectory image showing the trajectory of the mouse pointer during the reproduction period on the display unit 205 based on the pointer-related information of the conference information acquired by the conference information acquisition unit 110. It is superimposed and displayed on the presentation image displayed by. Specifically, the static output control unit extracts all pointer-related information in which the time within the reproduction period is set in the item of time information in the pointer-related information. The static output control unit displays the trajectory image including the position specified by the position data set in the position item of the extracted pointer-related information in the reproduction area. Since the image of the presentation portion during the reproduction period is displayed in the reproduction area, the user can easily recognize the trajectory of the mouse pointer of the presenter during the reproduction period together with the presentation portion. The static output control unit changes the display mode of the trajectory image of the mouse pointer with the passage of time and displays it. Thereby, the user can recognize the operating state such as the moving direction and moving speed of the presenter's mouse pointer during the reproduction period.

  The dynamic output control unit superimposes and displays a moving image showing the movement of the mouse pointer during the reproduction period on the reproduction area of the display unit 205 based on the pointer-related information of the conference information acquired by the conference information acquisition unit 110. Specifically, the dynamic output control unit extracts all pointer-related information in which the time within the reproduction period is set in the item of time information in the pointer-related information. The dynamic output control unit displays the image of the mouse pointer at the position specified by the position data set in the position item of the extracted pointer-related information in the reproduction area. Since the image of the presentation portion during the reproduction period is displayed in the reproduction area, the user can easily recognize the operation state such as the position, the moving direction, and the moving speed of the mouse pointer of the presenter during the reproduction period. ..

  When the presenter operates the operation unit 206 to instruct the operation regarding the reproduction of the conference information, the reproduction operation instruction unit 170 receives the instructed operation. Further, the reproduction operation instructing unit 170 controls the dynamic output control unit of the conference information output unit 160 based on the instructed operation. For example, when the reproduction operation instruction unit 170 is instructed to reproduce the conference information, the reproduction operation instruction unit 170 causes the dynamic output control unit to reproduce the moving image showing the movement of the pointer during the reproduction period. In addition, when the reproduction operation instruction unit 170 is instructed to stop the reproduction of the conference information during the reproduction of the conference information, the reproduction operation instruction unit 170 causes the dynamic output control unit to stop the moving image being reproduced. Further, when the reverse reproduction of the conference information is instructed, the reproduction operation instructing unit 170 reversely reproduces the moving image indicating the movement of the pointer during the reproduction period in the dynamic output control unit. Further, when the reproduction operation instruction unit 170 is instructed to stop the reverse reproduction of the conference information during the reverse reproduction of the conference information, the reproduction operation instruction unit 170 causes the dynamic output control unit to stop the reverse reproduction video.

  The reproduction operation instructing unit 170 may control the conference audio output unit by the dynamic output control unit based on the instructed operation. In this case, when the reproduction operation instruction unit 170 is instructed to reproduce the conference information, the dynamic output control unit causes the conference sound output unit to reproduce the presenter's voice during the reproduction period. Further, when the reproduction operation instruction unit 170 is instructed to stop the reproduction of the conference information during the reproduction of the conference information, the dynamic output control unit causes the conference audio output unit to stop the audio being reproduced.

  The conference information output unit 160 may reproduce the portion of the conference information corresponding to the reproduction period determined by the reproduction period determination unit 138 only once. Alternatively, the conference information output unit 160 may repeatedly reproduce the portion of the conference information corresponding to the reproduction period determined by the reproduction period determination unit 138.

  In addition, in the case where the second group is selected after the first group is selected by the group selection unit 135, the reproduction period determination unit 138 determines the first group period and the first group period corresponding to the first group. When the second group period corresponding to the second group overlaps, after determining the first group period as the reproduction period, a portion of the second group period that does not overlap with the first group period becomes the reproduction period. decide. In this case, the conference information corresponding to the period in which the first group period and the second group period overlap is not repeatedly output. Therefore, the output of the conference information does not become redundant.

  Furthermore, the reproduction period determination unit 138 is the case where the second reference information is selected after the first reference information is selected by the reference information selection unit 136, and the first reference information corresponding to the first reference information is selected. When the input period and the second input period corresponding to the second reference information overlap, after determining the first input period as the reproduction period, it does not overlap with the first input period of the second input period. The part is determined as the reproduction period. Even in this case, the conference information corresponding to the period in which the first input period and the second input period overlap is not repeatedly output. Therefore, the output of the conference information does not become redundant.

  In the reference information display unit 150, one or more reference information for each one or more groups is input from the grouping unit 130, and group identification information is input from the selection unit 134. Further, the reference information display unit 150 may receive the index identification information from the selection unit 134. The reference information display unit 150 includes an additional information display unit 151, an index display unit 152, and an outside additional information display unit 153. In response to the group identification information being input from the selection unit 134, the additional information display unit 151 sets 1 in the reproduction area of the display unit 205 based on one or more pieces of reference information belonging to the group identified by the group identification information. One or more additional information included in each of the above reference information is displayed. Specifically, the additional information display unit 151 displays the image of the additional information included in the reference information at the position specified by the position information included in the reference information in the reproduction area of the display unit 205. Since the image of the announcement part is displayed by the announcement data part display part 161 in the reproduction area of the display part 205, the additional information display part 151 superimposes and displays the image of the additional information on the image of the announcement part. The additional information display unit 151 does not display the additional information included in the reference information including the determination result indicating the presence of the condition image or the reference information including the position information in the margin area. This is because such additional information is not located in the reproduction area.

  In response to the input of the reference information identification information from the selection unit 134, the additional information display unit 151 changes the image of the additional information included in the reference information specified by the reference information identification information to the image of the other additional information. It is displayed in a display mode different from the display mode. This allows the user to be notified of the position in the image of the announcement part of the additional image corresponding to the reference image selected by the user.

  The index display unit 152 belongs to the group specified by the group identification information when at least a part of one or more pieces of reference information belonging to the group specified by the group identification information includes a determination result indicating the presence of the condition image. When at least a part of the one or more pieces of reference information includes additional information located in the blank area, the display unit 205 displays an index indicating the presence of the reference information. Specifically, the index display unit 152 includes a reproduction area (presentation image area) near the position specified by the position information included in the reference information in the reproduction area of the display unit 205 or near the position specified by the position information. The part indicating the existence of the reference information is superimposed and displayed at a position within the (presentation part of). Thereby, the user can easily recognize the existence of the additional information added to the announcement part while referring to the announcement part in the announcement data.

  The outer additional information display unit 153 displays the additional information corresponding to the index specified by the index identification information on the display unit 205 in response to the index identification information input from the selection unit 134. This additional information includes the image written in the blank area of the presentation manuscript. At this time, the outside additional information display unit 153 may superimpose the additional information on the image of the announcement portion displayed on the display unit 205 or may be different from the image of the announcement portion on the screen of the display unit 205. It may be displayed at the position. In this way, it is possible to display additional information that does not exist in any of the images of the plurality of pages in the presentation data.

  In the following description, the users of the portable information devices 200A, 200B, 200C, 200D, and 200E who have participated in a conference will be referred to as user A, user B, user C, user D, and user E, respectively. Further, the three users who participated in the conference using the presentation manuscript are called user F, user G, and user H.

  FIG. 10 is a diagram showing an example of a display state of the display unit 205 when the user A operates the portable information device 200A to participate in the conference. With reference to FIG. 10, a participation button 221, a presentation button 222, and a list button 223 are displayed on the screen of the display unit 205 of the portable information device 200A, and a presentation image display area 231 is provided. The user A can operate the participation button 221, the announcement button 222, and the list button 223 using the operation unit 206.

  The participation button 221 displays either the character string “participating” or the character string “personal mode”. The announcement button 222 displays a character string of "individual mode" by default. When user A operates join button 221 on which the character string “personal mode” is displayed, portable information device 200A requests MFP 400 to join the conference using the user ID and password. When the request for participation in the conference is permitted by the MFP 400, the participation button 221 displays the character string “participating”. At this time, the presentation image is displayed in the presentation image display area 231. On the other hand, when the request for participation in the conference is not permitted by the MFP 400, a character string of “individual mode” is displayed on the participation button 221. When the character string of “individual mode” is displayed on the announcement button 222, it indicates that the user A of the portable information device 200A is not participating in the conference.

  The announcement button 222 displays either a character string of “announcement” or a character string of “write”. The announcement button 222 displays a character string “write” by default. When the user A operates the announcement button 222 in which the character string “write” is displayed, the CPU 201 requests the MFP 400 that it should be the presenter. When the request to become a presenter is permitted by the MFP 400 and the presenting authority is given, a character string “announcement” is displayed on the presenting button 222. If the presenting authority is not given because the request to become the presenter is not permitted by the MFP 400, the character string “write” remains displayed on the presenting button 222.

  A specific example of reference information corresponding to the presentation data acquired by the CPU 201 will be described. 11: is a figure which shows an example of the reference information corresponding to the presentation data produced|generated in the portable information device 200A of the user A. FIG. Referring to FIG. 11, the presentation image is displayed in presentation image display area 231, and a handwritten drawing image p1 is arranged as additional information in the upper left area of the presentation image. Here, the input period of the additional information is from 13:00:00 to 13:00:07.

  FIG. 12 is a diagram showing an example of reference information corresponding to presentation data generated in the portable information device 200B of the user B. Referring to FIG. 12, a presentation image is displayed in presentation image display area 231, and an image p2 including a balloon and a character string of “misprint” as additional information is arranged in the upper left area of the presentation image. Here, the input period of the additional information is from 13:00:05 to 13:00:09.

  FIG. 13 is a diagram showing an example of reference information corresponding to presentation data generated in the portable information device 200C of the user C. Referring to FIG. 13, the presentation image is displayed in presentation image display area 231, and a handwritten drawing image p3 is arranged as additional information in the upper right area of the presentation image. Here, the input period of the additional information is from 13:00:08 to 13:00:28.

  FIG. 14 is a diagram showing an example of reference information corresponding to presentation data generated in the portable information device 200D of the user D. Referring to FIG. 14, the presentation image is displayed in presentation image display area 231, and a handwritten drawing image p4 is arranged as additional information in the lower left area of the presentation image. Here, the input period of the additional information is from 13:00:30 to 13:00:38.

  FIG. 15 is a diagram showing an example of reference information corresponding to presentation data generated in the portable information device 200E of the user E. Referring to FIG. 15, the presentation image is displayed in presentation image display area 231, and a handwritten drawing image p5 is arranged as additional information in the lower left area of the presentation image. Here, the input period of the additional information is from 13:00:25 to 13:00:29.

  A specific example of reference information corresponding to a presentation manuscript generated after the meeting is described. FIG. 16 is a schematic diagram for explaining an example of reference information corresponding to a user F's presentation manuscript. FIG. 16 shows a presentation document in which the presentation images shown in FIGS. 11 to 15 are printed on A4 size paper. In the presentation manuscript shown in FIG. 16, the boundary line between the presentation image area and the blank area is indicated by a dashed line. In the upper left area in the presentation image area, a drawn image p6 composed of a handwritten character string “There is an error” is arranged as additional information.

  FIG. 17 is a schematic diagram for explaining an example of reference information corresponding to the user's G presentation manuscript. FIG. 17 shows a presentation manuscript in which the presentation images shown in FIGS. 11 to 15 and the presentation image of the next page are printed on A3 size paper. In the presentation manuscript of FIG. 17, the boundary line between the presentation image area and the blank area is indicated by a dashed line. Further, in this presentation manuscript, a drawing image p7 composed of a handwritten character string of "repair" is arranged as additional information in the upper left area of the blank area.

  FIG. 18 is a schematic diagram for explaining an example of reference information corresponding to the manuscript announced by the user H. FIG. 18 shows a presentation manuscript in which the presentation images shown in FIGS. 11 to 15 are printed on A4 size paper. Further, in the presentation manuscript of FIG. 18, the boundary line between the presentation image area and the blank area is indicated by a dashed line. A leader line is arranged as additional information so as to extend from the margin to the lower left area in the announcement image area. The lead line in FIG. 18 corresponds to the above condition image. A handwritten character string “point” is arranged as additional information near one end of the lead line located in the margin area. A drawn image p8 is formed by the leader line and the handwritten character string.

  FIG. 19 is a schematic diagram showing an example of grouping of reference information corresponding to presentation data. FIG. 19 shows an example in which the reference information of each of the users A to E shown in FIGS. 11 to 15 is grouped. Referring to FIG. 19, the reference information input period of each of users A to E is indicated by a white line on the time axis. Regarding the reference information of each of the users A to E, one or more reference information whose input start time is within a predetermined period and whose position indicated by the position information is within a predetermined range in the announcement image is classified into the same group. ..

  Specifically, for example, n (n is a natural number) seconds are preset as the predetermined period. Further, as the predetermined range, for example, a range of m (m is a natural number) pixels centering on the position where the additional information is input is set. In this case, each of the five pieces of reference information corresponding to the users A to E has an input start time within n seconds from the input start time included in the reference information, and the additional information included in the reference information. The reference information within the range of m pixels from the position of is classified into the same group as the reference information. As described above, the predetermined period is relatively set based on the input start time of the reference information to be processed. In addition, the predetermined range is relatively set based on the position of the additional information included in the reference information to be processed. It should be noted that the overlapping of at least some of the different pieces of additional information may be set in advance as a condition for satisfying being within the predetermined range.

  11 and 12, the position of the additional information of user A and the position of the additional information of user B are substantially equal to each other, and the additional information of user B is within a predetermined range from the additional information of user A. .. Further, it is assumed that the difference between the input start time included in the reference information of user A and the input start time included in the reference information of user B is within 10 seconds, which is within a predetermined period. In this case, referring to FIG. 19, the reference information of user A and the reference information of user B are classified into the first group. Also, from the input start time 13:00:00 included in the reference information of the user A to the input end time 13:00:09 included in the reference information of the user B is determined as the group period α of the first group.

  With reference to FIG. 13, the additional information of the reference information of the user C is largely separated from the additional information of the reference information of the users A, B, D, and E, and the additional information of the users A, B, D, and E is It is assumed that the additional information of the user A does not fall within the predetermined range. In this case, referring to FIG. 19, only the reference information of the user C is classified into the second group. Further, the input start time 13:00:08 included in the reference information of the user C to the input end time 13:00:28 included in the reference information of the user C are determined as the group period β of the second group.

  14 and 15, the position of the additional information of user D and the position of the additional information of user E are substantially equal to each other, and the additional information of user E is within a predetermined range from the additional information of user D. .. Further, the difference between the input start time included in the reference information of user D and the input start time included in the reference information of user E is within 10 seconds, which is within a predetermined period. In this case, referring to FIG. 19, CPU 201 classifies the reference information of user D and the reference information of user E into the third group. Further, the input start time 13:00:25 included in the reference information of the user E to the input end time 13:00:38 included in the reference information of the user D are determined as the group period γ of the third group.

  FIG. 20 is a schematic diagram showing an example of grouping of reference information based on a presentation manuscript. FIG. 20 shows an example in which the reference information of each of the users F to H shown in FIGS. 16 to 18 is grouped. With reference to FIG. 20, occupied areas on the images corresponding to the first to third groups into which the reference information of users A to F are classified by the grouping of FIG. 19 are indicated by chain double-dashed lines. The occupied area on the image corresponding to the first to third groups is an area indicating that it is within a predetermined range from the position of one or more additional information included in each group. In this case, each of the plurality of reference information of the users F to H based on the presentation manuscript is classified into any of the first to third groups.

  In this example, a part of the drawn image p6 corresponding to the user F is included in the occupied area on the image corresponding to the first group. Thereby, the reference information of the user F is classified into the first group.

  Further, in the present example, the drawn image p8 corresponding to the user H includes the lead line which is the condition image. In this case, the position information corresponding to the drawn image p8 is set near the character string "voice reproduction" in the presentation image area. Therefore, a part of the drawn image p8 corresponding to the user H is included in the occupied area on the image corresponding to the third group. Thereby, the reference information of the user H is classified into the third group.

  By the way, in this example, the drawn image p7 corresponding to the user G is not included in the occupied area on the image corresponding to any of the first to third groups. In this case, the reference information of the user G is classified into the first group located closest to the drawn image p7 among the first to third groups.

  Referring to FIG. 10, when user A operates list button 223, group list in which group identification information of each of the first to third groups is arranged is displayed on display unit 205. 21 and 22 are diagrams showing an example of a group list. With reference to FIGS. 21 and 22, a group list display area 241 is provided on the side of the presentation image display area 231. Further, a character size button 291 and a return button 292 are displayed above the group list display area 241.

  A slider 249 is provided in the group list display area 241. The slider 249 expands the area in which the group list can be displayed in the group list display area 241. In FIG. 21, since the slider 249 is located above the screen, the group list of the first group is mainly displayed. On the other hand, in FIG. 22, the group list of the third group is mainly displayed because the slider 249 is located below the screen.

  In the group list display area 241, group identification information 242 for identifying each of the first, second and third groups is displayed. In each group identification information 242, reference images 243 of reference information belonging to the group corresponding to the group identification information 242 are arranged. Each reference image 243 includes the user identification information included in the reference information, the additional information, and the image of the area specified by the position information included in the reference information in the presentation portion specified by the presentation image related information. Including. Thereby, the user A can identify one or more groups by the additional information. The group identification information 242 may include a group period of one or more groups. In this case, the user A can identify one or more groups by the group period.

  Further, in the group identification information 242, a character string indicating whether the reference information represented by the reference image 243 corresponds to the presentation data or the presentation manuscript is displayed near each reference image 243. Therefore, the user A can easily identify the type of each reference information.

  The user A can select one of the plurality of group identification information 242 displayed in the group list display area 241 by operating the operation unit 206. FIG. 23 is a diagram showing a display example when one group identification information 242 is selected from the group list. When the user A selects one group identification information 242, a voice text display area 251 and a reproduction operation display area 261 are provided below the announcement image display area 231. At this time, the group period corresponding to the selected group identification information 242 is determined as the reproduction period.

  Referring to FIG. 23, in group list display area 241, a portion of group identification information 242 selected by user A except for arranged reference images 243 is different from other group identification information 242 that is not selected. It is displayed in a different manner. In FIG. 23, the part of the group identification information 242 of the first group except for the arranged reference images 243 is hatched. Thereby, the user A can easily identify the group identification information 242 selected by himself.

  In the presentation image display area 231, the presentation image 401 corresponding to the selected first group during the group period is displayed. Further, a trail image 402 showing the trail of the mouse pointer during the group period of the selected first group is displayed on the presentation image 401. Further, on the presentation image 401, the drawn images p1, p2, p6 are displayed in a semi-transparent state as one or more additional information included in the one or more reference information belonging to the selected first group.

  At this time, the sizes of the drawn images p1 and p2, which are additional information corresponding to the presentation data, on the presentation image are uniquely determined based on the size of the additional information input on the image of the presentation portion. On the other hand, the size of the drawn image p6, which is the additional information corresponding to the presentation document, on the presentation image is determined based on the enlargement/reduction rate calculated by the additional information extraction unit 122 for the additional information. As a result, the drawing image p6 of the user F is displayed on the presentation image so that the presentation document of the user F is reproduced on the presentation image display area 231.

  By the way, the drawn image p7 of the user G belonging to the first group is located in the margin area. In the example of FIG. 23, only the display image area is displayed in the announcement image display area 231. Therefore, in this example, a sticky note-like index p11 indicating that at least a part of the additional information (drawing image p7) is present in the margin area instead of the drawing image p7 is near the additional information and within the display image area. It is displayed in a semi-transparent state at the position.

  In the voice text display area 251, a character string of text data obtained by character recognition of voices during the group period of the selected first group is displayed. Further, in the reproduction operation display area 261, operation buttons for instructing start of reproduction of conference information, stop of reproduction, start of reverse reproduction, and stop of reverse reproduction, and a time slider showing a reproduction time of the conference information. Is displayed.

  In this state, the user A operates the operation button displayed in the reproduction operation display area 261 to display, for example, a moving image showing the movement of the mouse pointer during the group period of the selected first group in the announcement image display area 231. It is possible to superimpose and display it on the presentation image 401 displayed at. In addition, the voice output unit 208 can reproduce the voice during the group period of the selected first group.

  In the present example, the voice text display area 251 displays a character string of text data obtained by character recognition of voice during the group period of the selected first group, but the present invention is not limited to this. The voice text display area 251 may display a character string of text data obtained by character recognition of voice during a period including the group period of the first group and periods before and after the group period. In this case, the character string of the text data in the group period of the first group is highlighted in a display mode different from the character strings of the text data in the periods before and after the group period. Thereby, the user A can easily identify the voice of the presenter in the group period of the first group.

  The user A further refers to the reference image 243 of the user A, the reference image 243 of the user B, the reference image 243 of the user F, and the reference image 243 of the user F arranged in the group identification information 242 of the first group selected by operating the operation unit 206. By selecting one of the E reference images 243, one of the plurality of pieces of reference information belonging to the first group can be selected. Alternatively, the user A further operates the operation unit 206 to select any one of the drawn images p1, p2, p6 and the index p11 displayed on the presentation image 401, thereby selecting the selected image or index. The reference information corresponding to can be selected. At this time, the input period included in the selected reference information is determined as the reproduction period.

  FIG. 24 is a display example when the reference image 243 of the user F is selected. 24, when the user A selects the reference image 243 of the user F or the drawn image p6, the reference image 243 of the selected user F becomes the reference images 243 of the unselected users A, B, and G. Are displayed in different ways. In FIG. 24, the reference image 243 of the user F is shown by hatching. Accordingly, the user A can easily identify the reference image 243 selected by himself.

  The reference information of the user F does not include the input period because it corresponds to the presentation manuscript. In this case, the announcement image display area 231 displays the announcement image 401 corresponding to the selected first group during the group period. Further, a trail image 402 showing the trail of the mouse pointer during the group period is displayed on the presentation image 401. Further, on the presentation image 401, the drawn image p6, which is the additional information included in the reference information of the selected user F, is displayed in an emphasized state. At this time, as in the example of FIG. 23, the drawing images p1 and p2 of the unselected users A and B are displayed in a semi-transparent state on the presentation image 401. Further, the index p11 corresponding to the reference information of the unselected user G is displayed in a semitransparent state. In the voice text display area 251, the character string of the text data obtained by character recognition of the voice during the group period of the previously selected first group is displayed.

  FIG. 25 is a display example when the reference image 243 of the user G is selected. Referring to FIG. 25, when the user A selects the reference image 243 of the user G or the index p11, the reference image 243 of the selected user G becomes the reference images 243 of the unselected users A, B, and F. It is displayed in a different manner. In FIG. 25, the reference image 243 of the user G is shown by hatching. Accordingly, the user A can easily identify the reference image 243 selected by himself.

  Like the reference information of the user F, the reference information of the user G corresponds to the presentation manuscript and thus does not include the input period. In this case, the announcement image display area 231 displays the announcement image 401 corresponding to the selected first group during the group period.

  Here, the additional information included in the reference information of the user G is located on the blank area of the presentation manuscript. In this way, when the additional information of the selected reference information is located on the margin area, the announcement image display area 231 displays a margin area image 403 surrounding the announcement image 401 in addition to the announcement image 401. Further, in the presentation image display area 231, the drawing image p7 of the user G is displayed in an emphasized state on the blank area image 403 so that the presentation document of the user G is reproduced. At this time, as in the example of FIG. 23, the drawn images p1, p2, p6 of the users A, B, F are displayed in a semi-transparent state on the presentation image 401, and the trajectory image 402 of the mouse pointer is displayed. It When the blank area image 403 is displayed, the index p11 shown in FIGS. 23 and 24 displayed on the presentation image 401 is erased. In the voice text display area 251, the character string of the text data obtained by character recognition of the voice during the group period of the previously selected first group is displayed.

  In the display state of FIG. 25, when the user A reselects the reference image 243 of the user F, the display unit 205 transitions to the display state of FIG. As a result, the blank area image 403 is not displayed in the presentation image display area 231, and the index p11 is displayed instead of the drawing image p6 of the user G.

  The user A operates the character size button 291 after selecting the group identification information 242 to adjust the size of the additional information of the reference information belonging to the selected group and corresponding to the presentation manuscript to an appropriate character size of the additional information. can do.

  FIG. 26 is a display example when the character size button 291 is operated in the display state of FIG. In the example of FIG. 26, when the character size button 291 is operated, the size of the character string included in the drawn image p6 that is the additional information of the user F is the character string of the presentation data included in the presentation image 401 and the presentation data. Approximately matches the size of the drawn images p1, p2 of the reference information based on. This improves the visibility of the drawn image p6.

  FIG. 27 is a diagram showing another display example when one group identification information 242 is selected from the group list. The difference between the display example of FIG. 27 and the display example of FIG. 23 will be described.

  In the display example of FIG. 27, when the user A selects the third group, the part of the group identification information 242 of the third group excluding the arranged reference images 243 is the other group identification information 242 that is not selected. Is displayed in a different manner. In FIG. 27, the portion of the group identification information 242 of the third group excluding the arranged reference images 243 is hatched.

  In the presentation image display area 231, a presentation image 401 corresponding to the selected third group during the group period is displayed. Further, a trail image 402 showing the trail of the mouse pointer during the group period of the selected third group is displayed on the presentation image 401. Further, on the presentation image 401, the drawn images p4 and p5 are displayed in a semi-transparent state as one or more additional information included in the one or more reference information belonging to the selected first group.

  By the way, the drawn image p8 of the user H belonging to the third group includes a leader line which is a condition image, and is located so as to straddle the announcement image region and the blank region. In the example of FIG. 27, only the display image area is displayed in the announcement image display area 231. Therefore, in the present example, a sticky note-like index p12 indicating that at least a part of the additional information (drawn image p8) is present in the margin area instead of the drawn image p8 is represented by the position information of the additional information. It is displayed in a semi-transparent state at (the end position of the leader line). In the voice text display area 251, a character string of text data obtained by character recognition of voice during the group period of the third group is displayed.

  Also in the example of FIG. 27, the user A has the reference image 243 of the user D, the reference image 243 of the user E, and the user H that are arranged in the group identification information 242 of the third group selected by operating the operation unit 206. By selecting one of the reference images 243 of 1, it is possible to select one of the plurality of reference information belonging to the third group. Alternatively, the user A further corresponds to the selected image or index by operating the operation unit 206 to select any one of the drawn images p4 and p5 and the index p12 displayed on the presentation image 401. The reference information to be selected can be selected.

  FIG. 28 is a display example when the reference image 243 of the user H is selected. 28, when the user A selects the reference image 243 of the user H or the index p12, the reference image 243 of the selected user H is different from the reference images 243 of the unselected users D and E. Is displayed. In FIG. 28, the reference image 243 of the user H is shown by hatching.

  The reference information of the user H does not include the input period because it corresponds to the presentation manuscript. In this case, the announcement image 401 is displayed in the announcement image display area 231 during the group period of the selected third group.

  As described above, the additional information of the user H includes the condition image, a part of which is located on the blank area of the presentation manuscript. In this case, in the presentation image display area 231, a blank area image 403 surrounding the presentation image 401 is displayed in addition to the presentation image 401. Further, in the presentation image display area 231, the drawing image p8 of the user H is displayed in an emphasized state on the presentation image 401 and the blank area image 403 so that the presentation document of the user H is reproduced. At this time, as in the example of FIG. 27, the drawing images p4 and p5 of the users D and E are displayed in a semitransparent state on the presentation image 401, and the trajectory image 402 of the mouse pointer is displayed. When the blank area image 403 is displayed, the index p12 of FIG. 27 displayed on the presentation image 401 is deleted. In the voice text display area 251, the character string of the text data obtained by character recognition of the voice during the group period of the previously selected third group is displayed.

  In the above example, in order to present the additional information, at least a part of which is present in the blank area, to the user A, when the reference information including the additional information is selected, the presentation image 401 and the blank space are displayed in the presentation image display area 231. Although the area images 403 are displayed and the additional information is superimposed and displayed on the images, the present invention is not limited to this.

  When only the presentation image 401 is displayed in the presentation image display area 231, and reference information including additional information at least partially present in the margin area is selected, only the additional information is displayed on the screen of the display unit 205. May be displayed separately from the display in the announcement image display area 231.

  Alternatively, if at least one additional information item among the plurality of reference information items displayed in the group list is present in the blank area, the presentation image 401 and the blank area image 403 are displayed in the presentation image display area 231, and those images are displayed. All the additional information belonging to the group selected above may be displayed in a superimposed manner.

  FIG. 29 is a flowchart showing an example of the flow of the conference information acquisition process. The conference information acquisition process is a process executed by the CPU 201 when the CPU 201 included in each of the portable information devices 200A to 200E executes the conference information acquisition program stored in the ROM 202, the RAM 203, the flash memory 204, or the CD-ROM 210A. is there. The conference information acquisition program is part of the conference-related information reproduction program. In the initial state of various processes described below, it is assumed that the presentation data is downloaded from the MFP 400 to the portable information device 200A in advance. Further, it is assumed that the flash memory 204 of the portable information device 200A stores user identification information of the user A in advance.

  Referring to FIG. 29, in step S01, the device mode is set to the participation mode, and the process proceeds to step S02. In step S02, it is determined whether the presentation mode has been selected. If the presentation mode is selected, the process proceeds to step S03. If not, the process proceeds to step S11.

  In step S03, a presenter request signal for requesting that the user be the presenter is transmitted to MFP 400, and the process proceeds to step S04. In step S04, it is determined whether a permission signal for a request to become a presenter has been received from MFP 400. If the permission signal is received from MFP 400, the process proceeds to step S05; otherwise, the process returns to step S02.

  In step S05, the device mode is set to the announcement mode. In step S06, it is determined whether conference information has been generated. Specifically, it is determined whether or not any of the presentation image related information, the pointer related information, and the voice related information is generated by at least one of the presentation image related processing, the pointer related processing, and the voice related processing described below. .. If the conference information is generated, the process proceeds to step S07. If not, the process proceeds to step S08.

  In step S07, the generated conference information is transmitted to portable information devices 200B to 200E of all users B to E participating in the conference, and the process proceeds to step S08. In step S08, it is determined whether the participation mode has been selected. If the participation mode is selected, the process proceeds to step S09. If not, the process proceeds to step S06. In step S09, the device mode is set to the participation mode, and the process proceeds to step S02.

  In step S11, it is determined whether or not the conference information is received from any of the other portable information devices 200B to 200E. If the conference information is received, the process proceeds to step S12. If not, the process returns to step S02. In step S12, the received conference information is stored in RAM 203 or flash memory 204, and the process returns to step S02.

  FIG. 30 is a flowchart showing an example of the flow of presentation image-related processing. The announcement image-related process is a process executed by the CPU 201 when the CPU 201 included in each of the portable information devices 200A to 200E executes the announcement image-related program stored in the ROM 202, the RAM 203, the flash memory 204, or the CD-ROM 210A. is there. The presentation image related program is a part of the conference related information reproduction program. Here, a case where the CPU 201 included in the portable information device 200A executes the announcement image related program will be described as an example.

  Referring to FIG. 30, in step S21, it is determined whether or not the device mode is set to the announcement mode. The process waits until it is determined that the device mode is set to the announcement mode (NO in step S21), and if it is determined that the device mode is set to the announcement mode (YES in step S21), the process proceeds to step S22. Proceed to. In step S22, the announcement part is set in the announcement data, the image of the set announcement part is displayed on the display unit 205 as an announcement image, and the process proceeds to step S23. Specifically, the user A who is the presenter operates the operation unit 206 to set an area specified by the specified announcement page and area as the announcement part. Further, the image of the announcement portion set in the announcement data is displayed on the display unit 205 as an announcement image.

  In step S23, the presentation image related information is generated, the generated presentation image related information is stored in the RAM 203 or the flash memory 204, and the process proceeds to step S24. The page identification information of the announcement page specified by the announcement portion set in step S22 is set in the page data item, and the area identification information indicating the position in the announcement page of the area specified by the announcement portion is set as the partial data item. And the present time is set in the item of time information to generate the presentation image related information. In step S24, the announcement part set in step S22 is transmitted to portable information devices 200B to 200E of all users B to E, and the process proceeds to step S25.

  In step S25, it is determined whether the announcement part has been changed. Specifically, it is determined whether the area different from the presentation portion set in step S22 is newly designated by the user A. If it is determined that the announcement part has been changed, the process returns to step S22, but if not, the process returns to step S21.

  FIG. 31 is a flowchart showing an example of the flow of reference information acquisition processing corresponding to presentation data. In the reference information acquisition process, the CPU 201 included in each of the portable information devices 200A to 200E executes the reference information acquisition program corresponding to the presentation data stored in the ROM 202, the RAM 203, the flash memory 204, or the CD-ROM 210A, so that the CPU 201 Is a process executed by. The reference information acquisition program corresponding to the presentation data is a part of the conference related information reproduction program. Here, a case where the CPU 201 included in the portable information device 200A executes the reference information acquisition program corresponding to the announcement data will be described as an example.

  31, in step S31, user identification information for identifying the user who operates portable information device 200 is acquired, and the process proceeds to step S32. Here, since the user identification information of the user who operates the portable information device 200A is stored in the flash memory 204, the user identification information stored in the flash memory 204 is read. The user operating the mobile information device 200A may acquire the user identification information input to the operation unit 206. In the next step S32, it is determined whether or not the user A operates the operation unit 206 to start the input of additional information on the presentation image. If the input of additional information is started, the process proceeds to step S33. If not, the process proceeds to step S39.

  In step S33, the current time is set as the input start time, and the process proceeds to step S34. In step S34, it is determined whether or not the user A has finished inputting the additional information on the presentation image. The process waits until it is determined that the user A has finished inputting the additional information on the presentation image (NO in step S34), and it is determined that the user A has finished inputting the additional information on the presentation image (step S34). (YES in S34), and the process proceeds to step S35.

  In step S35, the current time is set as the input end time, and the process proceeds to step S36. In step S36, the position of the area where the additional information is input in the announcement image is determined as the position information, and the process proceeds to step S37. In step S37, the reference information corresponding to the presentation data of user A is generated, the generated reference information is stored in RAM 203 or flash memory 204, and the process proceeds to step S38. Specifically, the user identification information acquired in step S31 is set in the item of user ID, the time set in the input start time in step S33 is set in the item of start time of the item of the input period, and step S35. The time set as the input end time is set as the end time item of the input period item, and the additional information started to be input at step S32 and ended at step S34 is set to the additional information item. , The reference information in which the position information determined in step S36 is set in the position information item is generated. In step S38, the reference information corresponding to the generated presentation data is transmitted to the portable information devices 200B to 200E of all the users B to E participating in the conference, and the process proceeds to step S39.

  In step S39, it is determined whether or not the reference information corresponding to the presentation data is received from any of the other portable information devices 200B to 200E. If the wireless LAN I/F 209 receives the reference information from any of the other portable information devices 200B to 200E, the process proceeds to step S40. If not, the process returns to step S32. In step S40, the received reference information is stored in RAM 203 or flash memory 204, and the process returns to step S32.

  FIG. 32 is a flowchart showing an example of the flow of reference information acquisition processing corresponding to a presentation manuscript. In this reference information acquisition processing, the CPU 201 included in each of the portable information devices 200A to 200E executes the reference information acquisition program corresponding to the presentation manuscript stored in the ROM 202, the RAM 203, the flash memory 204, or the CD-ROM 210A, and the CPU 201 Is a process executed by. The reference information acquisition program corresponding to the presentation manuscript is a part of the conference related information reproduction program. Here, a case where the CPU 201 included in the portable information device 200A executes the reference information acquisition program corresponding to the announcement data will be described as an example.

  Referring to FIG. 32, in step S41, it is determined whether or not the read data of the presentation document and the user identification information corresponding thereto are received from MFP 400. The wireless LAN I/F 209 is in a standby state until it determines that it has received the read data and the user identification information from the MFP 400 (NO in step S41), and determines that the wireless LAN I/F 209 has received the read data and the user identification information from the MFP 400 ( (YES in step S41), and the process proceeds to step S42.

  The presentation data according to the present embodiment includes, for each page, a predetermined reference image (for example, a frame) for defining the reference size of the page. Therefore, in the presentation manuscript, the reference image is formed for each page of the presentation data.

  In step S42, the page is extracted by detecting the reference image formed for each page of the presentation data from the received read data using pattern matching or the like, and the process proceeds to step S43. Thereby, the image size of one page of the presentation data formed on one sheet of the presentation document can be defined as the reading reference size.

  In step S43, the ratio of the size of the additional information to the read reference size is calculated as the enlargement/reduction ratio, and the process proceeds to step S44. In step S44, by comparing the extracted read data for each page with the announcement data for each page, each of one or more images not present in the announcement data is extracted as additional information from the read data, and the process is performed. Proceed to S45. When the process proceeds to step S45, one or more additional information included in the read data is extracted.

  In step S45, one piece of additional information to be processed is selected from the extracted one or more pieces of additional information, and the process proceeds to step S46. In step S46, it is determined whether a predetermined condition image exists in the additional information to be processed. As described above, in the present embodiment, the condition image is set as a linear image extending from the announcement image area to the blank area in the announcement document image. If the condition image does not exist, the process proceeds to step S47, but if the condition image exists, the process proceeds to step S48.

  In step S47, the position of the area where the additional information is input in the presentation document image is determined as the position information, and the process proceeds to step S49. In step S48, the position of the area where the end of the condition image is input in the announcement document image is determined as the position information of the additional information, and the process proceeds to step S49. In step S49, the appropriate character size of the additional information is determined based on the read data and the presentation data, and the process proceeds to step S50.

  In step S50, the reference information corresponding to the presentation manuscript is generated, and the generated reference information is stored in the RAM 203 or the flash memory 204. Specifically, the user identification information received in step S41 is set in the item of user ID, the additional information extracted in step S43 and selected in step S45 is set in the item of additional information, and steps S47 and S48 are set. The position information determined in any one of the above is set in the position information item, the enlargement/reduction ratio calculated in step S43 is set in the enlargement/reduction ratio item, and the determination result in step S46 is set in the condition image determination result item. The reference information is set and the appropriate character size determined in step S49 is set in the item of the appropriate character size to generate reference information. Then, the process proceeds to step S51.

  In step S51, it is determined whether or not there is additional information that has not been selected in step S45 for the one or more additional information extracted in step S44. If there is unselected additional information, the process returns to step S45, but if not, the process returns to step S41.

  If the additional information is not extracted in step S44, it may be determined that the additional information does not exist and the process may return to step S41.

  In the present embodiment, when at least a part of the additional information is in the blank area, the position of the additional information may be represented only by the page number. For example, in step S46 described above, instead of determining whether or not the conditional image exists in the additional information, it is determined whether or not at least a part of the additional information exists in the margin area. Accordingly, when at least a part of the additional information does not exist in the blank area, the process proceeds to step S47. On the other hand, when at least a part of the additional information exists in the blank area, the page including the additional information is determined as the position information of the reference information, and the process proceeds to step S47.

  Further, in the present embodiment, when the condition image does not exist in the additional information and all of the additional information is in the blank area, the position closest to the additional information in the announcement image area adjacent to the blank area is set. It may be determined as the position of the additional information.

  FIG. 33 is a flowchart showing an example of the flow of grouping processing. The grouping process is a process executed by the CPU 201 by the CPU 201 included in each of the portable information devices 200A to 200E executing the grouping program stored in the ROM 202, the RAM 203, the flash memory 204, or the CD-ROM 210A. The grouping program is part of the meeting-related information reproduction program. Here, a case where the CPU 201 included in the portable information device 200A executes the grouping program will be described as an example.

  Referring to FIG. 33, in step S61, the reference information corresponding to the presentation data stored in RAM 203 or flash memory 204 is read by the reference information acquisition process shown in FIG. 31, and the process proceeds to step S62. In step S62, one piece of reference information to be processed is selected from the read one or more pieces of reference information, and the process proceeds to step S63.

  In step S63, reference information whose input start time is within a predetermined period from the input start time of the reference information to be processed is extracted from the one or more reference information read in step S61, and the process is performed in step S64. Proceed to. In step S64, the reference information in which the position indicated by the position information is within the predetermined range from the position indicated by the position information of the reference information to be processed is extracted from the reference information extracted in step S63, and the process is performed. It proceeds to step S65.

  In step S65, the reference information to be processed and the one or more reference information extracted in step S64 are classified into the same group and stored in the RAM 203 or the flash memory 204. In the next step S66, the group period is determined, the determined group period is stored in RAM 203 or flash memory 204, and the process proceeds to step S67. Specifically, one or more reference information belonging to the same group stored in step S65 is set as a processing target, and one or more from the earliest time among one or more input start times included in each of the one or more reference information. Of the one or more input end times respectively included in the reference information of 1, the period until the latest time is determined as the group period.

  In step S67, it is determined whether or not there is reference information that has not been selected in step S62 for the one or more pieces of reference information read in step S61. If there is unselected reference information, the process returns to step S62, but if not, the process proceeds to step S68.

  In step S68, the reference information corresponding to the presentation manuscript stored in RAM 203 or flash memory 204 is read by the reference information acquisition process shown in FIG. 32, and the process proceeds to step S69. In step S69, one piece of reference information to be processed is selected from the read one or more pieces of reference information, and the process proceeds to step S70.

  In step S70, based on the position information of the selected reference information, it is determined whether any of the groups classified in the processes of steps S61 to S67 is within a predetermined range from the position of the additional information of the reference information. to decide. If any group is within the predetermined range, the process proceeds to step S71. If not, the process proceeds to step S72.

  In step S71, the reference information selected in step S59 is classified into a group within a predetermined range from the position of the additional information of the reference information, stored in the RAM 203 or the flash memory 204, and the process proceeds to step S63. On the other hand, in step S72, the reference information selected in step S69 is classified into a group closest to the position of the additional information of the reference information, stored in the RAM 203 or the flash memory 204, and the process proceeds to step S73. ..

  In step S73, it is determined whether or not there is reference information that has not been selected in step S69 for the one or more pieces of reference information read in step S68. If there is unselected reference information, the process returns to step S69. If not, the process ends.

  If the position of the additional information is specified only by the page number because at least a part of the additional information is in the blank area (when the position information is expressed only by the page number), the selected reference information The page may contain multiple groups. In this case, the selected reference information may be classified into all of the plurality of groups set in the page indicated by the position information.

  It is possible that only the reference information corresponding to the presentation data is stored in the RAM 203 or the flash memory 204 at the start of the grouping process, and the reference information corresponding to the presentation manuscript is not stored. In this case, the processes of steps S68 to S73 in the grouping process of FIG. 33 are omitted. Further, at the start of the grouping process, it is possible that only the reference information corresponding to the presentation manuscript is stored in the RAM 203 or the flash memory 204, and the reference information corresponding to the presentation data is not stored. In this case, in the grouping process of FIG. 33, the processes of steps S61 to S67 are omitted, and instead of the processes of steps S70 to S72, reference information within a predetermined range is extracted from the selected reference information and extracted. The obtained reference information is classified into the same group and stored in the RAM 203 or the flash memory 204. Further, the group period of each group is determined and stored as the period from the announcement start time to the announcement end time.

  FIG. 34 is a flowchart showing an example of the flow of reproduction processing. The reproduction processing is processing executed by the CPU 201 when the CPU 201 included in each of the portable information devices 200A to 200E executes the reproduction program stored in the ROM 202, the RAM 203, the flash memory 204 or the CD-ROM 210A. The reproduction program is a part of the conference related information reproduction program. Here, a case where the CPU 201 included in the portable information device 200A executes the reproduction program will be described as an example.

  Referring to FIG. 34, in step S81, the group list is displayed on display unit 205, and the process proceeds to step S82. Specifically, one or more reference information classified into one or more groups by the grouping process shown in FIG. 33 is stored in the RAM 203 or the flash memory 204. The CPU 201 displays on the display unit 205 a group list in which one or more group identification information for identifying each of one or more groups stored in the RAM 203 or the flash memory 204 is arranged. The group identification information is an image in which one or more reference images respectively corresponding to one or more reference information belonging to the group are arranged. The reference image includes the user identification information included in the reference information, the additional information, and the image of the area specified by the position information included in the reference information in the announcement portion specified by the announcement image related information. Specifically, the CPU 201 synthesizes the image of the additional information included in the reference information with the image of the portion including the area specified by the position information set in the position information item of the reference information in the presentation data. Then, a reference image to which the image of the user identification information included in the reference information is added is generated. The CPU 201 generates, as group identification information, an image in which one or more reference images respectively corresponding to one or more reference information belonging to the group are arranged.

  In step S82, it is determined whether or not any one of the one or more groups is selected. Specifically, when any one of the one or more group identification information shown in the group list is selected by the user A, it is determined that the group corresponding to the selected group identification information is selected. Further, when none of the one or more group identification information is selected, it is determined that the group is not selected. If a group is selected, the process proceeds to step S83; otherwise, the process ends.

  In step S83, the group period determined by the grouping process shown in FIG. 33 corresponding to the selected group is determined as the reproduction period, and the process proceeds to step S84. In step S84, the first reference information display process is performed, and the process proceeds to step S85. By the first reference information display processing, the announcement image during the reproduction period is displayed on the display unit 205. Details of the first reference information display processing will be described later.

  In step S85, a static output control process is performed, and the process proceeds to step S86. In this static output control process, a trajectory image showing the trajectory of the mouse pointer during the reproduction period is displayed on the announcement image during the reproduction period displayed on the display unit 205. Further, a character string representing the sound during the reproduction period is displayed on the display unit 205.

  In step S86, it is determined whether a reproduction operation instruction has been received. Specifically, when the touch panel 206B detects that the user A has instructed the operation button displayed in the reproduction operation display area 261, the reproduction operation instruction is accepted. If the reproduction operation instruction is received, the process proceeds to step S87. If not, the process proceeds to step S88. In step S87, a dynamic output control process is performed, and the process proceeds to step S88. In this dynamic output control process, the moving image of the mouse pointer is displayed so that the movement of the mouse pointer during the reproduction period is reproduced on the announcement image during the reproduction period. Also, the sound during the reproduction period is reproduced.

  In step S88, it is determined whether any one of the one or more pieces of reference information belonging to the group selected in step S82 has been selected. Specifically, when any one of the one or more reference images arranged in the group identification information of the group selected in step S82 is selected by the user A, the reference information corresponding to the selected reference image. Is determined to have been selected. In the first reference information display processing of step S84, the presentation image corresponding to the reproduction period determined in step S83 is displayed on the display unit 205, and at least one additional information or index corresponding to the reproduction image is displayed during the reproduction period. Is displayed on the presentation image. In step S88, when the additional information or the index displayed on the presentation image is selected, it is determined that the reference information including the additional information or the reference information including the additional information corresponding to the index is selected. If none of the one or more reference images is selected, it is determined that the reference information is not selected. If the reference information is selected, the process proceeds to step S89. If not, the process returns to step S82. Since the reference information includes the additional information, the selection of the reference information is the same as the selection of the additional information.

  In step S89, the second reference information display process is performed, and the process proceeds to step S90. By the second reference information display processing, the announcement image during the reproduction period is displayed on the display unit 205, and the selected additional information is emphasized and displayed in the announcement image over the additional information of other reference information. .. Alternatively, the presentation image and the blank area image during the reproduction period are displayed on the display unit 205, and the selected additional information is displayed in the presentation image and the blank area image while being emphasized over the additional information of other reference information. To do. Details of the second reference information display processing will be described later.

  In step S90, it is determined whether the reference information selected in step S88 or step S99 described later corresponds to the presentation data. If the reference information corresponds to the presentation data, the process proceeds to step S91. If not (if the reference information corresponds to the presentation manuscript), the process proceeds to step S92.

  In step S91, the input period of the reference information selected in step S88 or step S99 described later is determined as the reproduction period, and the process proceeds to step S93. On the other hand, in step S92, the group period of the group selected in the immediately preceding step of step S82 and step S100 described later is determined as the reproduction period, and the process proceeds to step S93. In step S93, the reproduction period determined in either step S91 or step S92 is stored in RAM 203 or flash memory 204, and the process proceeds to step S94.

  In the static output control processing of step S85, the display unit 205 displays the character string of the voice corresponding to the reproduction period determined in step S83, in other words, the voice of the voice in the group period of the group selected in step S82. The character string is displayed. In this case, the voice character string displayed on the display unit 205 includes the voice character string during the input period of the reference information selected in step S88.

  In step S94, it is determined whether or not an instruction to properly adjust the character size has been received for the additional information corresponding to the presentation manuscript among the additional information displayed on display unit 205 in the processing of steps S84 and S89. This instruction is generated, for example, by the user A operating the character size button 291 in FIG. If an instruction to properly adjust the character size is received, the process proceeds to step S95. If not, the process proceeds to step S96. In step S95, the character size of the additional information corresponding to the presentation manuscript among the additional information displayed on display unit 205 is adjusted to an appropriate character size.

  In step S96, among the voice character strings displayed on the display unit 205, the voice character string during the input period of the reference information selected in step S88 is displayed during the period other than the input period of the selected reference information. Is emphasized more than the character string of the voice is displayed, and the process proceeds to step S97.

  In step S97, similarly to step S86, it is determined whether or not a reproduction operation instruction has been received. If the instruction of the reproducing operation is accepted, the process proceeds to step S98; otherwise, the process proceeds to step S99. In step S98, similar to step S87, the dynamic output control process is performed, and the process proceeds to step S100.

  In step S99, it is determined whether any one of the one or more pieces of reference information belonging to the group selected in step S82 is newly selected. If the reference information is selected, the process returns to step S89. If not, the process proceeds to step S100.

  In step S100, similarly to step S82, it is determined whether or not any one of the one or more groups is selected. If the group is selected, the process returns to step S83. If not, the process returns to step S97.

  FIG. 35 is a flowchart showing an example of the flow of the first reference information display processing. The first reference information display process is a process executed in step S84 of the reproduction process shown in FIG. The group is selected by the user A before the first reference information display process is executed.

  Referring to FIG. 35, in step S101, the presentation image related information corresponding to the reproduction period (in this example, the group period of the group selected in step S82 of FIG. 34) is read, and the process proceeds to step S102. . Among the one or more presentation image related information stored in the RAM 203 or the flash memory 204, the presentation image related information in which the time set in the time information item is included in the reproduction period is read. In step S102, the announcement image during the reproduction period is displayed on display unit 205 based on the read announcement image-related information, and the process proceeds to step S103. Specifically, according to the page identification information set in the page data item of the presentation image related information and the position information set in the partial data item, the presentation part in the presentation data is specified and the image of the presentation part is presented. The image is displayed on the display unit 205 as an image.

  In step S103, one or more pieces of reference information classified into the group selected by user A are read out, and the process proceeds to step S104. From the one or more reference information stored in the RAM 203 or the flash memory 204, all the reference information classified into the group selected by the user A is read.

  In step S104, one piece of reference information to be processed is selected from the read one or more pieces of reference information, and the process proceeds to step S105. In step S105, it is determined whether or not the conditional image exists in the additional information of the selected reference information. If the condition image does not exist, the process proceeds to step S107, but if the condition image exists, the process proceeds to step S106. In step S106, an index indicating that the additional information is present in the margin area is displayed on the presentation image at the position of the additional information (the position of the end portion of the condition image indicated by the position information), and the process is performed. Proceed to S110.

  In step S107, it is determined whether at least a part of the additional information of the selected reference information exists in the blank area. If the additional information does not exist in the blank area, the process proceeds to step S109, but if the additional information exists in the blank region, the process proceeds to step S108. In step S108, an index indicating that the additional information is present in the margin area is superimposed and displayed in the vicinity of the additional information on the presentation image, and the process proceeds to step S110.

  In step S109, the image of the additional information included in the read one or more pieces of reference information is superimposed and displayed on the presentation image, and the process proceeds to step S110. At this time, simultaneously with the display of the additional information, the user identification information corresponding to the additional information may be superimposed and displayed on the announcement image, or the user identification information corresponding to the additional information may be displayed on the announcement image on the display unit 205. It may be displayed at the position. Thereby, not only the reference information corresponding to the presentation data but also the reference information corresponding to the presentation manuscript can be notified to the user who added the additional information.

  In step S110, it is determined whether or not there is reference information that has not been selected in step S104 for the one or more pieces of reference information read in step S103. If there is unselected reference information, the process returns to step S103, but if not, the process proceeds to step S75 of the reproduction process shown in FIG.

  If the position of the additional information is specified only by the page number because at least a part of the additional information is in the blank area (when the position information is expressed only by the page number), in steps S106 and S108. May display an index at a predetermined position on the presentation image.

  FIG. 36 is a flowchart showing an example of the flow of the second reference information display process. The second reference information display process is a process executed in step S79 of the reproduction process shown in FIG.

  Referring to FIG. 36, in step S111, the reference information selected in step S78 of FIG. 34 is read out, and the process proceeds to step S112. In step S112, it is determined whether or not a condition image exists in the additional information of the selected reference information. If the condition image does not exist, the process proceeds to step S113, but if the condition image exists, the process proceeds to step S114.

  In step S113, it is determined whether at least a part of the additional information of the selected reference information exists in the blank area. If the additional information does not exist in the blank area, the process proceeds to step S113, but if the conditional image exists, the process proceeds to step S114.

  Here, in the above-described first reference information display processing, the index is displayed on the announcement image when the conditional image exists in the additional information and when the additional information exists in the blank area. In step S114, the index displayed in steps S105 and S107 of FIG. 35 is erased, the announcement image and the blank area image are displayed on the display unit 205, and the process proceeds to step S115.

  In step S115, the additional information of the selected reference information is highlighted at the position indicated by the position information, and the process proceeds to step S80 of the reproduction process shown in FIG. At this time, the user identification information corresponding to the additional information may be highlighted at the same time as the additional information is highlighted. Thereby, with respect to the reference information corresponding to the selected reference information, the user who added the additional information can be notified to the user.

  As described above, the mobile information device 200A according to the present embodiment functions as a conference-related information reproduction device, and is reference information generated by the device itself or any of the other mobile information devices 200B to 200E. Reference information including additional information such as a memo added to the announcement data and position information indicating a position where the additional information is added in the announcement data is acquired. Further, portable information device 200A acquires read data obtained by reading an announcement document on which an image based on the announcement data is formed by MFP 100, and extracts an image that does not exist in the announcement data from the acquired read data as additional information. When the user draws a memo by handwriting on the presentation document on which an image based on the presentation data is formed, the image of the memo drawn by the user is extracted as additional information. Portable information device 200A determines the position in the presentation data corresponding to the position of the extracted additional information as the added position of the extracted additional information, and based on the extracted additional information and the determined position, The reference information corresponding to the recording medium is generated. The portable information device 200A classifies a plurality of pieces of reference information in which the position of the additional information is within a predetermined range in the presentation data among the plurality of pieces of reference information acquired as described above into the same group, and one or more groups. At least one of the plurality of pieces of reference information belonging to the selected group is displayed in response to the user selecting any one of the above.

  Therefore, the portable information device 200A extracts a memo, which is extracted from the read data output by the MFP 100 by reading and outputting the announcement document, and presents the memo, which is not present in the announcement data, to the announcement data in the device itself or in any of the other portable information devices 200B to 200E. Can be reproduced with the notes added to. As a result, more information related to the conference can be easily reproduced.

  In the above embodiment, the CPU 201 of the portable information device 200A generates the conference information while the user A is the presenter, that is, during the period from the announcement start time to the announcement end time, but the present invention is not limited to this. Not done. The CPU 201 may generate the conference information only when the user A is the presenter and acquires the reference information from the portable information devices 200B to 200E of the other users B to E. Thereby, the data amount of the conference information stored in each of the portable information devices 200A to 200E can be reduced.

  Although the portable information devices 200A to 200E have been described as an example of the conference-related information reproducing device in the above-described embodiment, the processes illustrated in FIGS. 29 to 36 are performed on the portable information devices 200A to 200E, respectively. It goes without saying that the invention can be understood as a conference-related information reproducing method to be executed, or as a conference-related information reproducing program that causes the CPU 201 included in each of the portable information devices 200A to 200E to execute the conference-related information reproducing method.

  The embodiments disclosed this time are to be considered as illustrative in all points and not restrictive. The scope of the present invention is shown not by the above description but by the claims, and is intended to include meanings equivalent to the claims and all modifications within the scope.

<Appendix>
(1) The conference-related information reproduction device according to any one of claims 1 to 9, wherein the reference information acquisition unit vectorizes the additional information extracted by the additional information extraction unit. According to this aspect, the image quality when displaying the additional information is improved and the amount of data representing the additional information is reduced.

  (2) The meeting-related information reproduction device according to claim 6, wherein the group list display means displays, for each of the one or more groups, any additional information of one or more pieces of reference information belonging to the group. According to this aspect, since the additional information of the reference information belonging to the group is displayed in the group list, the group to be selected can be easily identified.

  (3) The group list display means selectably displays one or more pieces of reference information respectively belonging to one or more groups, and selects one of the one or more pieces of reference information displayed by the group list display means. 7. The reference information selecting unit for further comprising, wherein the group list displaying unit displays the reference information selected by the reference information selecting unit in a display mode different from a display mode of other reference information. Meeting related information reproduction device. According to this aspect, since the selected reference information is displayed in a display mode different from the display mode of other reference information, the selected reference information can be easily identified.

  (4) The additional information display means is selected from the one or more additional information displayed by the additional information display means when any one of the one or more reference information is selected by the reference information selection means. The meeting-related information reproduction device according to claim 6, wherein the additional information included in the reference information is displayed in a display mode different from that of the other additional information. According to this aspect, since the additional information included in the selected reference information is displayed in a display mode different from the display mode of the other additional information, the selected reference information can be easily identified.

  1 conference system, 2 network, 2A, 2B network, 3A, 3B wireless station, 5 internet, 100 MFP, 110 conference information acquisition unit, 111 presentation part setting unit, 120 reference information acquisition unit, 121 read data acquisition unit, 122 addition Information extraction unit, 123 position determination unit, 124 recording medium correspondence generation unit, 125 condition image determination unit, 126 user identification information acquisition unit, 127 size determination unit, 130 grouping unit, 131 group list display unit, 133 group period determination unit , 134 selection unit, 135 group selection unit, 136 reference information selection unit, 137 index selection unit, 138 reproduction period determination unit, 150 reference information display unit, 151 additional information display unit, 152 index display unit, 153 outer additional information display unit , 160 conference information output unit, 161 announcement data portion display unit, 170 reproduction operation instruction unit, 190 timing unit, 200A, 200B, 200C, 200D, 200E portable information device, 201 CPU, 202 ROM, 203 RAM, 204 flash memory, 205,461 Display, 206,463 Operation, 206A Main Key, 206B, 465 Touch Panel, 206C Keyboard, 206D Mouse, 207 Voice Input, 208 Voice Output, 209 Wireless LAN I/F, 210 External Storage, 210A CD -ROM, 221, participation button, 222 presentation button, 223 list button, 231 presentation image display area, 241 group list display area, 242 group identification information, 243 reference image, 249 slider, 251 voice text display area, 261 playback operation display area , 291 character size button, 292 return button, 400 MFP, 401 presentation image, 402 trajectory image, 403 blank area image, 410 main circuit, 411 CPU, 412 communication I/F unit, 413 ROM, 414 RAM, 415 HDD, 416 Facsimile unit, 417 external storage device, 418 CD-ROM, 420 automatic document feeder, 430 document reading unit, 440 image forming unit, 450 paper feed unit, 460 operation panel, 461 display unit, 463 operation unit, 465 touch panel, 467 hard Key part, p1, p2, p3, p4, p5, p6, p7, p8 Drawing image.

Claims (10)

Reference information acquisition means for acquiring reference information generated by the device itself or one or more other devices;
The reference information includes additional information added to announcement data accessible by the own device and one or more other devices, and position information indicating a position in the announcement data to which the additional information is added.
Of the plurality of reference information acquired by the reference information acquisition means, a grouping means for classifying the plurality of reference information in which the position of the additional information is within a predetermined range in the announcement data into the same group,
Reference information display means for displaying at least one of a plurality of reference information belonging to the selected group in response to selection of any one of the one or more groups,
The reference information acquisition means,
Read data acquisition means for acquiring read data obtained by reading a recording medium on which an image based on the announcement data is formed;
Additional information extracting means for extracting, as the additional information, an image that does not exist in the presentation data from the read data acquired by the read data acquiring means,
Position determining means for determining a position in the announcement data corresponding to a position of the extracted additional information in the read data as an added position of the extracted additional information,
Based on the determined position by the additional information and the position determining means extracted by the additional information extracting unit, seen including a recording medium corresponding generating means for generating a reference information corresponding to said recording medium,
Each of the plurality of reference information corresponding to the announcement data including the additional information added to the announcement data includes an input period that defines a start time and an end time of inputting the additional information,
The grouping means is
A plurality of pieces of reference information corresponding to the announcement data acquired by the reference information acquisition unit are arranged such that the position of the additional information is within a predetermined range in the announcement data and the start time is within a predetermined period. Classify them to belong to the same group,
Each of the plurality of pieces of reference information corresponding to the recording medium acquired by the reference information acquisition unit is assigned to a group in which the position of the additional information of the reference information is one or more groups of the plurality of groups. A meeting-related information reproduction device that classifies into a group included in a predetermined range from any position of a plurality of included reference information .   The reference information acquisition means further comprises a size determination means for determining the size of the additional information extracted by the additional information extraction means based on at least one of the read data and the presentation data. Meeting related information reproduction device.   The reference information acquisition unit determines the size of the additional information extracted by the additional information extraction unit based on the size of the additional information added to the presentation data by either the own device or one or more other devices. The meeting-related information reproduction device according to claim 1, further comprising a size determination unit.   If the additional information extracted by the additional information extracting unit does not exist in any of the images of the plurality of pages included in the presentation data, the position determining unit extracts the plurality of pages included in the presentation data. The page corresponding to the image having the closest additional information and the relative position of the extracted additional information with respect to the corresponding page are determined as the position of the additional information. The meeting-related information reproduction device described. The reference information acquisition unit is a condition for determining whether or not the additional information extracted by the additional information extraction unit includes a condition image extending from inside to outside of an image of a plurality of pages included in the presentation data. Further comprising image determination means,
When the condition image is present in the additional information, the position determining means determines, among the plurality of pages included in the presentation data, a page of an image that overlaps the condition image, at the end of the condition image of the page. The meeting-related information reproduction device according to claim 1, wherein the position is determined as the position to which the additional information is added. Meeting information acquisition means for acquiring information about the status of the meeting as meeting information,
Meeting information output means for outputting at least a part of the meeting information;
Group list display means for selectively displaying the one or more groups,
Group selection means for selecting any one of the one or more groups displayed by the group list display means,
The meeting information output means,
Presentation data part display means for displaying a presentation part in the presentation data corresponding to the selected group in response to selection of any one of the one or more groups by the group selection means,
The reference information display means,
Additional information display means for superimposing and displaying one or more additional information included in each of the one or more reference information belonging to the selected group on the announcement part displayed by the announcement data part display means,
When at least a part of the additional information extracted by the additional information extracting unit does not exist in any of the images of the plurality of pages included in the presentation data, an index indicating the existence of the additional information is set as the additional information. Instead, an index display means for superimposing and displaying on the announcement part,
The conference-related information reproduction device according to claim 1, further comprising: an outside additional information display unit that receives an operation of the index by a user and displays additional information corresponding to the index when the index is operated. The meeting information changes over time,
For each of the one or more groups, group period determining means for determining a group period based on the input period of each of the one or more reference information belonging to the group,
A reproduction period determining means for determining a group period determined for the selected group as a reproduction period in response to selection of any one of the one or more groups,
The meeting-related information reproducing device according to claim 6 , wherein the meeting information output unit outputs a part of the meeting information corresponding to the determined reproduction period. The reference information further includes user identification information for identifying the user who added the additional information,
The reference information acquisition unit further includes a user identification information acquisition unit that acquires the user identification information of the user who has added the additional information included in the read data together with the read data acquired by the read data acquisition unit,
The recording medium correspondence generation unit generates reference information corresponding to the recording medium based on the user identification information acquired by the user identification information acquisition unit,
The reference information display means, when displaying at least one of the plurality of reference information, simultaneously displays additional information included in each reference information and user identification information corresponding to the additional information. ~ The meeting-related information reproduction device according to any one of 7 to 8 . A reference information acquisition step of acquiring reference information generated by one of the own device and one or more other devices;
The reference information includes additional information added to announcement data accessible by the own device and one or more other devices, and position information indicating a position in the announcement data to which the additional information is added.
Of the plurality of reference information acquired by the reference information acquisition step , a grouping step of classifying a plurality of reference information in which the position of the additional information is within a predetermined range in the announcement data into the same group,
A reference information display step of displaying at least one of a plurality of reference information belonging to the selected group in response to selection of any one of the one or more groups,
The reference information acquisition step,
A read data acquisition step of acquiring read data obtained by reading a recording medium on which an image based on the announcement data is formed;
An additional information extracting step of extracting, as the additional information, an image that does not exist in the presentation data from the read data acquired by the read data acquiring step;
A position determining step of determining a position in the presentation data corresponding to a position of the extracted additional information in the read data as position information indicating an added position of the extracted additional information,
Based on the determined position by additional information and the location determining step extracted by the additional information extracting step, seen including a recording medium corresponding generation step of generating a reference information corresponding to said recording medium,
Each of the plurality of reference information corresponding to the announcement data including the additional information added to the announcement data includes an input period that defines a start time and an end time of inputting the additional information,
The grouping step is
A plurality of pieces of reference information corresponding to the announcement data acquired in the reference information acquisition step are provided, in which the position of the additional information is within a predetermined range in the announcement data and the start time is within a predetermined period. Classify them to belong to the same group,
Each of the plurality of pieces of reference information corresponding to the recording medium acquired in the reference information acquisition step is assigned to a group in which the position of the additional information of the reference information is one or more groups of the plurality of groups. a plurality of either including a classifying the groups included in a predetermined range from the position of the reference information, meeting-related information reproducing method included. A reference information acquisition step of acquiring reference information generated by one of the own device and one or more other devices;
The reference information includes additional information added to announcement data accessible by the own device and one or more other devices, and position information indicating a position in the announcement data to which the additional information is added.
Of the plurality of reference information acquired by the reference information acquisition step , a grouping step of classifying a plurality of reference information in which the position of the additional information is within a predetermined range in the announcement data into the same group,
A reference information display step of displaying at least one of a plurality of reference information belonging to the selected group in response to the selection of any one of the one or more groups; Causes a computer that controls other devices to execute,
The reference information acquisition step,
A read data acquisition step of acquiring read data obtained by reading a recording medium on which an image based on the announcement data is formed;
An additional information extracting step of extracting, as the additional information, an image that does not exist in the presentation data from the read data acquired by the read data acquiring step;
A position determining step of determining a position in the presentation data corresponding to a position of the extracted additional information in the read data as position information indicating an added position of the extracted additional information,
Based on the determined position by additional information and the location determining step extracted by the additional information extracting step, seen including a recording medium corresponding generation step of generating a reference information corresponding to said recording medium,
Each of the plurality of reference information corresponding to the announcement data including the additional information added to the announcement data includes an input period that defines a start time and an end time of inputting the additional information,
The grouping step is
A plurality of pieces of reference information corresponding to the announcement data acquired in the reference information acquisition step are provided, in which the position of the additional information is within a predetermined range in the announcement data and the start time is within a predetermined period. Classify them to belong to the same group,
Each of the plurality of pieces of reference information corresponding to the recording medium acquired in the reference information acquisition step is assigned to a group in which the position of the additional information of the reference information is one or more groups of the plurality of groups. multiple including a classifying the groups included in a predetermined range from any position of the reference information, meeting-related information reproduction program contained.

Images